2024-09-17T01:32:17.995 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T01:32:18.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:32:18.117 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7908051' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 599 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 33/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIX+70Ix0urPXCrASYoX49shZ6JaMg08/2bosChNUu7tY/5GS/PVa0JMK0NXL3k1jS2qgxrstEne9DFGnrJD5K8= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/WHDWwiLswFuD9N9/D1GisxLIsRkR31tYR0yhB+Yss0wN3lyBU/QC23yiGb5nKNoLGS4xXE0iwI1u/vgMW91c= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_21:08:04 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-17T01:32:18.117 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa; will attempt to use it 2024-09-17T01:32:18.118 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks 2024-09-17T01:32:18.118 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T01:32:18.120 INFO:teuthology.task.internal:Checking packages... 2024-09-17T01:32:18.146 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T01:32:18.146 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:32:18.146 INFO:teuthology.packaging:ref: None 2024-09-17T01:32:18.147 INFO:teuthology.packaging:tag: None 2024-09-17T01:32:18.147 INFO:teuthology.packaging:branch: squid 2024-09-17T01:32:18.147 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:32:18.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T01:32:18.350 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-17T01:32:18.352 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T01:32:18.359 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T01:32:18.359 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T01:32:18.366 INFO:teuthology.task.internal:Saving configuration 2024-09-17T01:32:18.385 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T01:32:18.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T01:32:18.412 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:27:20.428172', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIX+70Ix0urPXCrASYoX49shZ6JaMg08/2bosChNUu7tY/5GS/PVa0JMK0NXL3k1jS2qgxrstEne9DFGnrJD5K8='} 2024-09-17T01:32:18.432 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:27:20.429357', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/WHDWwiLswFuD9N9/D1GisxLIsRkR31tYR0yhB+Yss0wN3lyBU/QC23yiGb5nKNoLGS4xXE0iwI1u/vgMW91c='} 2024-09-17T01:32:18.432 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T01:32:18.438 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T01:32:18.438 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-17T01:32:18.438 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T01:32:18.489 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff793033ac0>, signals=[15]) 2024-09-17T01:32:18.489 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T01:32:18.495 INFO:teuthology.task.internal:Opening connections... 2024-09-17T01:32:18.496 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:32:18.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:32:18.576 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-17T01:32:18.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:32:18.654 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T01:32:18.661 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-09-17T01:32:18.679 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-09-17T01:32:18.680 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T01:32:18.741 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-09-17T01:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-09-17T01:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T01:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-09-17T01:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T01:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T01:32:18.742 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T01:32:18.742 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-09-17T01:32:18.766 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-17T01:32:18.784 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-17T01:32:18.785 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-17T01:32:18.841 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-17T01:32:18.841 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-17T01:32:18.841 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T01:32:18.842 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T01:32:18.843 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-17T01:32:18.866 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T01:32:18.879 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T01:32:18.886 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T01:32:18.887 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:32:18.891 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:32:18.906 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T01:32:18.912 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T01:32:18.912 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:32:18.948 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:32:18.974 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T01:32:19.023 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T01:32:19.038 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T01:32:19.038 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T01:32:19.039 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:32:19.039 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:32:19.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:32:19.055 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-17T01:32:19.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:32:19.056 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-17T01:32:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-17T01:32:19.112 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-17T01:32:19.112 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-17T01:32:19.115 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-503.el9.x86_64 2024-09-17T01:32:19.115 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.14.0-503.el9.x86_64 2024-09-17T01:32:19.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2024-09-17T01:32:21.573 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-17T01:32:22.823 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-17T01:32:23.633 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-17T01:32:26.156 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-17T01:32:29.344 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-17T01:32:30.917 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-17T01:32:31.431 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-17T01:32:31.929 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-17T01:32:33.256 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 19 kB 00:00 2024-09-17T01:32:34.094 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-17T01:32:37.535 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-17T01:32:39.416 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-17T01:32:39.433 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T01:32:39.433 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T01:32:39.534 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T01:32:39.550 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout:Install 4 Packages 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:32:39.551 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 79 M 2024-09-17T01:32:39.552 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 126 M 2024-09-17T01:32:39.552 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:32:39.946 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T01:32:39.985 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T01:32:40.014 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T01:32:40.027 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T01:32:40.084 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.169 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T01:32:40.177 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T01:32:40.184 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.198 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.226 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.227 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.234 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.264 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.269 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.285 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.301 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.306 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.343 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.628 INFO:teuthology.orchestra.run.smithi031.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 45 kB/s | 36 kB 00:00 2024-09-17T01:32:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T01:32:40.735 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T01:32:40.763 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T01:32:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T01:32:41.297 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T01:32:41.297 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T01:32:41.394 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T01:32:41.404 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T01:32:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T01:32:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:32:41.405 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:32:41.405 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:32:41.405 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-17T01:32:41.405 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:32:41.406 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-17T01:32:41.406 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-17T01:32:41.406 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:32:41.525 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 490 kB/s | 36 kB 00:00 2024-09-17T01:32:42.778 INFO:teuthology.orchestra.run.smithi031.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-17T01:32:43.280 INFO:teuthology.orchestra.run.smithi031.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-09-17T01:32:45.383 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.8 MB/s | 29 MB 00:07 2024-09-17T01:32:50.924 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.6 MB/s | 35 MB 00:09 2024-09-17T01:32:50.924 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:32:50.925 INFO:teuthology.orchestra.run.smithi092.stdout:Total 8.3 MB/s | 79 MB 00:09 2024-09-17T01:32:51.612 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:32:51.981 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:32:51.981 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:32:52.932 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:32:52.933 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:32:55.385 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:32:56.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:32:56.116 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:32:58.906 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:32:59.020 INFO:teuthology.orchestra.run.smithi031.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 1.8 MB/s | 35 MB 00:19 2024-09-17T01:32:59.024 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:32:59.024 INFO:teuthology.orchestra.run.smithi031.stdout:Total 4.0 MB/s | 79 MB 00:19 2024-09-17T01:32:59.045 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:32:59.733 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:33:00.131 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:33:00.183 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:33:01.108 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:33:01.108 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:33:03.677 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:33:03.856 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:33:03.912 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:04.357 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:33:04.438 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:33:07.193 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:33:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:33:08.749 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:12.443 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:33:12.483 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:17.625 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:47.044 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:47.085 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:47.363 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:47.363 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:33:47.363 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:33:47.363 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:33:48.173 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:33:48.174 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:33:48.508 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:33:48.593 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:33:48.594 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:33:48.594 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T01:33:48.594 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:33:48.594 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:33:48.594 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T01:33:48.594 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:33:48.594 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:33:48.653 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:33:48.653 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:33:48.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-17T01:33:48.685 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-17T01:33:48.685 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-17T01:33:48.686 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:33:48.687 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T01:33:48.688 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T01:33:48.688 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-508.el9.x86_64 2024-09-17T01:33:48.688 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T01:33:49.349 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-17T01:33:50.702 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T01:33:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-17T01:33:50.744 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-17T01:33:50.759 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.mTfK8tQle5 2024-09-17T01:33:50.759 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mTfK8tQle5 2024-09-17T01:33:50.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.mTfK8tQle5 2024-09-17T01:33:50.966 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.mTfK8tQle5 is 6KB 2024-09-17T01:33:51.015 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.mTfK8tQle5 2024-09-17T01:33:51.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T01:33:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T01:33:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T01:33:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T01:33:51.093 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T01:33:51.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T01:33:51.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-17T01:33:56.516 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:56.557 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:33:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:33:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:33:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:33:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:33:57.749 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:33:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T01:33:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T01:33:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T01:33:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T01:33:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:33:57.750 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:33:58.098 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:33:58.198 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:33:58.198 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:33:58.199 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T01:33:58.199 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:33:58.199 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:33:58.199 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T01:33:58.199 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:33:58.199 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:33:58.258 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:33:58.259 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:33:58.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-09-17T01:33:58.291 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-09-17T01:33:58.291 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-09-17T01:33:58.291 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.06 2024-09-17T01:33:58.291 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 82.el9 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Group : Unspecified 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 8274670 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : builder@centos.org 2024-09-17T01:33:58.292 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T01:33:58.293 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-09-17T01:33:58.294 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:33:58.294 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T01:33:58.295 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T01:33:58.295 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 5.14.0-508.el9.x86_64 2024-09-17T01:33:58.295 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T01:33:58.957 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-17T01:34:00.259 INFO:teuthology.orchestra.run.smithi031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T01:34:00.288 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-17T01:34:00.291 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-17T01:34:00.306 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.RfiEIbAtxZ 2024-09-17T01:34:00.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RfiEIbAtxZ 2024-09-17T01:34:00.373 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.RfiEIbAtxZ 2024-09-17T01:34:00.525 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.RfiEIbAtxZ is 6KB 2024-09-17T01:34:00.545 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.RfiEIbAtxZ 2024-09-17T01:34:00.560 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T01:34:00.629 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T01:34:00.629 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T01:34:00.629 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T01:34:00.629 INFO:teuthology.orchestra.run.smithi031.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T01:34:00.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T01:34:00.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-09-17T01:34:21.281 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T01:34:21.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-17T01:34:21.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:34:30.785 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T01:34:30.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T01:34:30.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:34:55.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-17T01:35:04.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-17T01:35:04.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:35:23.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-17T01:35:30.796 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T01:35:35.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-17T01:35:35.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:35:35.607 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-17T01:35:36.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-17T01:35:36.041 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T01:35:36.042 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-17T01:35:36.057 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-508.el9.x86_64 2024-09-17T01:35:36.057 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T01:35:36.057 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:35:36.057 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T01:35:37.058 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T01:35:37.058 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:35:37.176 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2024-09-17T01:35:37.202 DEBUG:teuthology.parallel:result is None 2024-09-17T01:35:39.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T01:35:39.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:35:40.142 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-17T01:35:40.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T01:35:40.520 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T01:35:40.521 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-17T01:35:40.538 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-508.el9.x86_64 2024-09-17T01:35:40.539 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T01:35:40.539 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:35:40.539 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T01:35:41.539 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T01:35:41.540 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:35:41.615 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-09-17T01:35:41.643 DEBUG:teuthology.parallel:result is None 2024-09-17T01:35:41.643 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T01:35:41.649 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T01:35:41.650 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:35:41.652 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:35:41.670 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T01:35:41.676 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T01:35:41.682 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T01:35:41.682 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:35:41.711 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:35:41.749 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T01:35:41.756 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T01:35:41.756 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:35:41.785 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:35:41.818 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:35:41.828 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:35:41.829 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:35:41.839 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:35:41.840 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T01:35:41.847 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T01:35:41.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:35:41.874 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:35:41.908 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T01:35:41.941 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T01:35:41.941 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:35:41.943 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:35:41.964 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:35:42.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:35:42.092 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:35:42.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:35:42.219 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:35:42.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:35:42.285 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:35:42.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:35:42.375 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:35:42.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:35:42.498 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:35:42.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:35:42.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-09-17T01:35:42.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-17T01:35:42.610 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:35:42.654 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:35:43.059 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T01:35:43.066 INFO:teuthology.task.internal:Starting timer... 2024-09-17T01:35:43.066 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T01:35:43.075 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T01:35:43.154 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-17T01:35:43.154 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-09-17T01:35:43.200 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-09-17T01:35:43.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-17T01:35:43.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T01:35:43.279 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-09-17T01:35:43.303 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-09-17T01:35:43.303 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-17T01:35:43.337 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-17T01:35:43.337 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2024-09-17T01:35:43.337 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T01:35:43.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:35:43.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T01:35:43.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:35:43.403 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T01:35:43.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-09-17T01:35:43.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-17T01:35:43.482 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T01:35:43.493 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T01:35:43.504 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T01:35:43.505 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T01:39:28.826 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2024-09-17T01:39:28.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T01:39:28.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:39:28.909 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-17T01:39:28.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T01:39:28.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-17T01:39:28.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:39:29.062 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-17T01:39:29.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-17T01:39:29.140 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T01:39:29.152 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T01:39:29.152 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:39:29.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:39:29.155 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:39:29.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:39:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T01:39:29.200 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T01:39:29.208 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T01:39:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T01:39:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-09-17T01:39:29.238 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-09-17T01:39:29.249 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-17T01:39:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T01:39:29.257 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-17T01:39:29.269 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T01:39:29.271 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T01:39:29.285 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T01:39:29.334 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:39:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:39:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-09-17T01:39:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.348 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:39:29.352 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:39:29.352 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-17T01:39:29.352 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.352 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.352 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.352 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:39:29.353 INFO:teuthology.run_tasks:Running task install... 2024-09-17T01:39:29.362 DEBUG:teuthology.task.install:project ceph 2024-09-17T01:39:29.362 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-17T01:39:29.362 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T01:39:29.362 INFO:teuthology.task.install:Using flavor: default 2024-09-17T01:39:29.367 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T01:39:29.367 INFO:teuthology.task.install:extra packages: [] 2024-09-17T01:39:29.368 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-17T01:39:29.368 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-17T01:39:29.368 INFO:teuthology.packaging:ref: None 2024-09-17T01:39:29.368 INFO:teuthology.packaging:tag: v18.2.0 2024-09-17T01:39:29.368 INFO:teuthology.packaging:branch: None 2024-09-17T01:39:29.368 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:39:29.972 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-17T01:39:29.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-17T01:39:29.974 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-17T01:39:29.975 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-17T01:39:29.975 INFO:teuthology.packaging:ref: None 2024-09-17T01:39:29.975 INFO:teuthology.packaging:tag: v18.2.0 2024-09-17T01:39:29.975 INFO:teuthology.packaging:branch: None 2024-09-17T01:39:29.975 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:39:29.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-17T01:39:30.118 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-17T01:39:30.119 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-17T01:39:30.131 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-17T01:39:30.132 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-17T01:39:30.162 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T01:39:30.162 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:39:30.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T01:39:30.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T01:39:30.169 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:39:30.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T01:39:30.195 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T01:39:30.195 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-17T01:39:30.195 INFO:teuthology.packaging:ref: None 2024-09-17T01:39:30.195 INFO:teuthology.packaging:tag: v18.2.0 2024-09-17T01:39:30.195 INFO:teuthology.packaging:branch: None 2024-09-17T01:39:30.195 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:39:30.195 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T01:39:30.197 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T01:39:30.197 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-17T01:39:30.197 INFO:teuthology.packaging:ref: None 2024-09-17T01:39:30.197 INFO:teuthology.packaging:tag: v18.2.0 2024-09-17T01:39:30.197 INFO:teuthology.packaging:branch: None 2024-09-17T01:39:30.197 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:39:30.197 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T01:39:30.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T01:39:30.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T01:39:30.342 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T01:39:30.349 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T01:39:30.407 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-17T01:39:30.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-17T01:39:30.417 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-09-17T01:39:30.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-09-17T01:39:30.639 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-17T01:39:30.663 INFO:teuthology.orchestra.run.smithi031.stdout:45 files removed 2024-09-17T01:39:30.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw 2024-09-17T01:39:30.690 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw 2024-09-17T01:39:31.098 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 706 kB/s | 76 kB 00:00 2024-09-17T01:39:31.127 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 436 kB/s | 76 kB 00:00 2024-09-17T01:39:31.245 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 130 kB/s | 9.3 kB 00:00 2024-09-17T01:39:31.248 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 90 kB/s | 9.3 kB 00:00 2024-09-17T01:39:31.383 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 22 kB/s | 2.2 kB 00:00 2024-09-17T01:39:31.387 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 20 kB/s | 2.2 kB 00:00 2024-09-17T01:39:32.355 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.3 MB 00:00 2024-09-17T01:39:32.391 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.3 MB 00:00 2024-09-17T01:39:34.827 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-17T01:39:40.585 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-17T01:39:42.318 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-17T01:39:43.239 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-17T01:39:46.295 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 20 MB 00:12 2024-09-17T01:39:48.778 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T01:39:51.022 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.5 MB 00:00 2024-09-17T01:39:51.065 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:39:51.068 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:39:51.068 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-17T01:39:51.069 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T01:39:51.070 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:39:51.071 INFO:teuthology.orchestra.run.smithi031.stdout:Install 28 Packages 2024-09-17T01:39:51.072 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2024-09-17T01:39:51.072 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:39:51.072 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 53 M 2024-09-17T01:39:51.072 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:39:51.355 INFO:teuthology.orchestra.run.smithi031.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 29 MB/s | 5.2 MB 00:00 2024-09-17T01:39:51.405 INFO:teuthology.orchestra.run.smithi031.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 483 kB/s | 24 kB 00:00 2024-09-17T01:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 9.6 MB/s | 653 kB 00:00 2024-09-17T01:39:51.530 INFO:teuthology.orchestra.run.smithi031.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 8.0 MB/s | 474 kB 00:00 2024-09-17T01:39:51.681 INFO:teuthology.orchestra.run.smithi031.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-17T01:39:51.781 INFO:teuthology.orchestra.run.smithi031.stdout:(6/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 13 MB/s | 7.6 MB 00:00 2024-09-17T01:39:51.806 INFO:teuthology.orchestra.run.smithi031.stdout:(7/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 359 kB/s | 45 kB 00:00 2024-09-17T01:39:51.831 INFO:teuthology.orchestra.run.smithi031.stdout:(8/30): python3-ceph-common-18.2.0-0.el9.x86_64 2.3 MB/s | 119 kB 00:00 2024-09-17T01:39:51.865 INFO:teuthology.orchestra.run.smithi031.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-09-17T01:39:51.890 INFO:teuthology.orchestra.run.smithi031.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-09-17T01:39:51.915 INFO:teuthology.orchestra.run.smithi031.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-09-17T01:39:51.941 INFO:teuthology.orchestra.run.smithi031.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-17T01:39:52.133 INFO:teuthology.orchestra.run.smithi031.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 19 MB/s | 18 MB 00:00 2024-09-17T01:39:52.174 INFO:teuthology.orchestra.run.smithi031.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 413 kB/s | 107 kB 00:00 2024-09-17T01:39:52.200 INFO:teuthology.orchestra.run.smithi031.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 619 kB/s | 160 kB 00:00 2024-09-17T01:39:52.233 INFO:teuthology.orchestra.run.smithi031.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-17T01:39:52.275 INFO:teuthology.orchestra.run.smithi031.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-17T01:39:52.292 INFO:teuthology.orchestra.run.smithi031.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 721 kB/s | 42 kB 00:00 2024-09-17T01:39:52.325 INFO:teuthology.orchestra.run.smithi031.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi031.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-17T01:39:52.401 INFO:teuthology.orchestra.run.smithi031.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi031.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi031.stdout:(23/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 19 kB 00:00 2024-09-17T01:39:52.477 INFO:teuthology.orchestra.run.smithi031.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T01:39:52.510 INFO:teuthology.orchestra.run.smithi031.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T01:39:52.544 INFO:teuthology.orchestra.run.smithi031.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-17T01:39:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T01:39:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-17T01:39:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:(29/30): librados2-18.2.0-0.el9.x86_64.rpm 14 MB/s | 3.3 MB 00:00 2024-09-17T01:39:52.837 INFO:teuthology.orchestra.run.smithi031.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-17T01:39:52.841 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:39:52.842 INFO:teuthology.orchestra.run.smithi031.stdout:Total 30 MB/s | 53 MB 00:01 2024-09-17T01:39:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:39:52.952 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:39:52.952 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:39:53.317 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-17T01:39:53.590 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:39:53.592 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:39:55.028 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:39:55.109 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-17T01:39:55.142 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-17T01:39:55.193 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-17T01:39:55.569 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-17T01:39:55.615 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-17T01:39:55.708 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-17T01:39:55.790 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-17T01:39:55.817 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-17T01:39:55.880 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-17T01:39:55.908 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-17T01:39:55.943 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-17T01:39:56.011 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-17T01:39:56.052 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-17T01:39:56.102 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-17T01:39:56.212 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-17T01:39:56.252 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-17T01:39:56.292 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-17T01:39:56.325 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-17T01:39:56.352 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-17T01:39:56.388 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-17T01:39:56.421 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-17T01:39:56.734 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-17T01:39:56.783 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-17T01:39:56.874 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-17T01:39:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-17T01:39:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-17T01:39:57.357 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-17T01:39:57.385 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-17T01:39:57.457 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-17T01:39:57.535 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-17T01:39:57.571 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-17T01:39:58.708 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T01:39:59.656 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-17T01:39:59.700 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-17T01:40:00.276 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-17T01:40:00.320 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-17T01:40:00.416 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-17T01:40:00.416 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T01:40:00.416 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T01:40:00.416 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:00.446 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-17T01:40:00.924 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-17T01:40:00.939 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T01:40:00.940 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-17T01:40:00.941 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:00.942 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:00.943 INFO:teuthology.orchestra.run.smithi092.stdout:Install 28 Packages 2024-09-17T01:40:00.943 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 2 Packages 2024-09-17T01:40:00.943 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:00.943 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 53 M 2024-09-17T01:40:00.943 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:01.360 INFO:teuthology.orchestra.run.smithi092.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 36 MB/s | 5.2 MB 00:00 2024-09-17T01:40:01.385 INFO:teuthology.orchestra.run.smithi092.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 969 kB/s | 24 kB 00:00 2024-09-17T01:40:01.427 INFO:teuthology.orchestra.run.smithi092.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-09-17T01:40:01.460 INFO:teuthology.orchestra.run.smithi092.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-17T01:40:01.552 INFO:teuthology.orchestra.run.smithi092.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 48 MB/s | 4.4 MB 00:00 2024-09-17T01:40:01.578 INFO:teuthology.orchestra.run.smithi092.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-17T01:40:01.603 INFO:teuthology.orchestra.run.smithi092.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-17T01:40:01.628 INFO:teuthology.orchestra.run.smithi092.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-09-17T01:40:01.654 INFO:teuthology.orchestra.run.smithi092.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-09-17T01:40:01.679 INFO:teuthology.orchestra.run.smithi092.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 12 MB/s | 297 kB 00:00 2024-09-17T01:40:01.704 INFO:teuthology.orchestra.run.smithi092.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-17T01:40:01.796 INFO:teuthology.orchestra.run.smithi092.stdout:(12/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 13 MB/s | 7.6 MB 00:00 2024-09-17T01:40:01.980 INFO:teuthology.orchestra.run.smithi092.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 24 MB/s | 18 MB 00:00 2024-09-17T01:40:02.080 INFO:teuthology.orchestra.run.smithi092.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 285 kB/s | 107 kB 00:00 2024-09-17T01:40:02.147 INFO:teuthology.orchestra.run.smithi092.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-09-17T01:40:02.189 INFO:teuthology.orchestra.run.smithi092.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 408 kB/s | 160 kB 00:00 2024-09-17T01:40:02.239 INFO:teuthology.orchestra.run.smithi092.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-17T01:40:02.264 INFO:teuthology.orchestra.run.smithi092.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 561 kB/s | 42 kB 00:00 2024-09-17T01:40:02.331 INFO:teuthology.orchestra.run.smithi092.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-17T01:40:02.373 INFO:teuthology.orchestra.run.smithi092.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 829 kB/s | 111 kB 00:00 2024-09-17T01:40:02.406 INFO:teuthology.orchestra.run.smithi092.stdout:(21/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-17T01:40:02.432 INFO:teuthology.orchestra.run.smithi092.stdout:(22/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 458 kB/s | 26 kB 00:00 2024-09-17T01:40:02.457 INFO:teuthology.orchestra.run.smithi092.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-17T01:40:02.482 INFO:teuthology.orchestra.run.smithi092.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T01:40:02.516 INFO:teuthology.orchestra.run.smithi092.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T01:40:02.558 INFO:teuthology.orchestra.run.smithi092.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-17T01:40:02.616 INFO:teuthology.orchestra.run.smithi092.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T01:40:02.684 INFO:teuthology.orchestra.run.smithi092.stdout:(28/30): librados2-18.2.0-0.el9.x86_64.rpm 26 MB/s | 3.3 MB 00:00 2024-09-17T01:40:02.750 INFO:teuthology.orchestra.run.smithi092.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-09-17T01:40:02.825 INFO:teuthology.orchestra.run.smithi092.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-17T01:40:02.830 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:02.830 INFO:teuthology.orchestra.run.smithi092.stdout:Total 28 MB/s | 53 MB 00:01 2024-09-17T01:40:02.902 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:02.937 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:02.937 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:03.568 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:03.568 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:05.020 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:40:05.111 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-17T01:40:05.148 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-17T01:40:05.206 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-17T01:40:05.537 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-17T01:40:05.638 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-17T01:40:05.721 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-17T01:40:05.832 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-17T01:40:05.872 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-17T01:40:05.935 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-17T01:40:05.964 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-17T01:40:06.007 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-17T01:40:06.074 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-17T01:40:06.100 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-17T01:40:06.166 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-17T01:40:06.280 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-17T01:40:06.307 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-17T01:40:06.364 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-17T01:40:06.397 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-17T01:40:06.424 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-17T01:40:06.460 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-17T01:40:06.493 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-17T01:40:06.790 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-17T01:40:06.839 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-17T01:40:06.928 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-17T01:40:06.960 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-17T01:40:06.996 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-17T01:40:07.388 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-17T01:40:07.416 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-17T01:40:07.471 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-17T01:40:07.546 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-17T01:40:07.577 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-17T01:40:09.634 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-17T01:40:09.673 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-17T01:40:10.215 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-17T01:40:10.251 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-17T01:40:10.350 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-17T01:40:10.350 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T01:40:10.350 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T01:40:10.350 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:10.403 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2024-09-17T01:40:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-09-17T01:40:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-17T01:40:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-17T01:40:11.521 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:11.521 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T01:40:11.521 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:40:11.521 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:40:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T01:40:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T01:40:11.605 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T01:40:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T01:40:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-17T01:40:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-17T01:40:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-17T01:40:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-17T01:40:12.724 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-17T01:40:12.725 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-17T01:40:12.726 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-17T01:40:12.727 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-17T01:40:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-17T01:40:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T01:40:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:13.734 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:14.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-test 2024-09-17T01:40:14.671 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:14.825 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:14.825 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:14.826 INFO:teuthology.orchestra.run.smithi031.stdout:Install 4 Packages 2024-09-17T01:40:14.827 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:14.827 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 40 M 2024-09-17T01:40:14.827 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 165 M 2024-09-17T01:40:14.827 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:14.984 INFO:teuthology.orchestra.run.smithi031.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-17T01:40:15.026 INFO:teuthology.orchestra.run.smithi031.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-17T01:40:15.051 INFO:teuthology.orchestra.run.smithi031.stdout:(3/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 805 kB/s | 161 kB 00:00 2024-09-17T01:40:15.643 INFO:teuthology.orchestra.run.smithi031.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 50 MB/s | 40 MB 00:00 2024-09-17T01:40:15.645 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:15.646 INFO:teuthology.orchestra.run.smithi031.stdout:Total 49 MB/s | 40 MB 00:00 2024-09-17T01:40:15.674 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:15.695 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:15.695 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:16.045 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:16.045 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:16.663 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:16.754 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T01:40:16.810 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T01:40:16.837 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-17T01:40:20.563 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-17T01:40:20.563 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-17T01:40:20.563 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-17T01:40:20.563 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-17T01:40:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-17T01:40:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-17T01:40:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-17T01:40:20.564 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-17T01:40:20.564 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:20.793 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-17T01:40:20.879 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-17T01:40:21.325 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-17T01:40:21.351 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-17T01:40:21.351 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:21.351 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T01:40:21.351 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:40:21.351 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:40:21.351 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:21.353 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T01:40:21.444 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-17T01:40:21.444 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T01:40:22.588 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T01:40:22.588 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-17T01:40:22.589 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-17T01:40:22.590 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-17T01:40:22.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-17T01:40:22.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-17T01:40:22.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-17T01:40:22.591 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-17T01:40:22.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-17T01:40:22.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-17T01:40:22.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-17T01:40:22.901 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-17T01:40:22.901 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-17T01:40:22.901 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-17T01:40:22.901 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T01:40:23.208 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T01:40:23.209 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:23.209 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:23.209 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.209 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T01:40:23.209 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:23.209 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:23.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.594 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T01:40:23.595 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T01:40:23.596 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:23.596 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:23.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-test 2024-09-17T01:40:24.066 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:24.206 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:24.208 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-17T01:40:24.209 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:24.209 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:24.209 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-17T01:40:24.209 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:40:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-17T01:40:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-17T01:40:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-17T01:40:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-17T01:40:24.210 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-17T01:40:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T01:40:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T01:40:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T01:40:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T01:40:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T01:40:24.211 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T01:40:24.212 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T01:40:24.213 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T01:40:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T01:40:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T01:40:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T01:40:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T01:40:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T01:40:24.214 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T01:40:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T01:40:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:24.215 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:24.215 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:24.215 INFO:teuthology.orchestra.run.smithi031.stdout:Install 33 Packages 2024-09-17T01:40:24.215 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:24.217 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 30 M 2024-09-17T01:40:24.217 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 109 M 2024-09-17T01:40:24.217 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:24.515 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:24.644 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T01:40:24.645 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 40 M 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 165 M 2024-09-17T01:40:24.646 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:24.749 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.8 MB/s | 161 kB 00:00 2024-09-17T01:40:24.883 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-09-17T01:40:24.909 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-17T01:40:24.959 INFO:teuthology.orchestra.run.smithi031.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 88 kB/s | 6.4 kB 00:00 2024-09-17T01:40:25.010 INFO:teuthology.orchestra.run.smithi031.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-17T01:40:25.060 INFO:teuthology.orchestra.run.smithi031.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2024-09-17T01:40:25.143 INFO:teuthology.orchestra.run.smithi031.stdout:(4/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-17T01:40:25.169 INFO:teuthology.orchestra.run.smithi031.stdout:(5/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 2.2 MB/s | 240 kB 00:00 2024-09-17T01:40:25.359 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 59 MB/s | 40 MB 00:00 2024-09-17T01:40:25.360 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:25.361 INFO:teuthology.orchestra.run.smithi092.stdout:Total 56 MB/s | 40 MB 00:00 2024-09-17T01:40:25.387 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:25.406 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:25.406 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:25.503 INFO:teuthology.orchestra.run.smithi031.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 36 MB/s | 18 MB 00:00 2024-09-17T01:40:25.736 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:25.736 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:25.886 INFO:teuthology.orchestra.run.smithi031.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 341 kB/s | 253 kB 00:00 2024-09-17T01:40:25.978 INFO:teuthology.orchestra.run.smithi031.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 224 kB/s | 106 kB 00:00 2024-09-17T01:40:26.003 INFO:teuthology.orchestra.run.smithi031.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-17T01:40:26.170 INFO:teuthology.orchestra.run.smithi031.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-09-17T01:40:26.196 INFO:teuthology.orchestra.run.smithi031.stdout:(12/33): python3-requests-2.25.1-8.el9.noarch.r 574 kB/s | 125 kB 00:00 2024-09-17T01:40:26.229 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:40:26.254 INFO:teuthology.orchestra.run.smithi031.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 416 kB/s | 35 kB 00:00 2024-09-17T01:40:26.279 INFO:teuthology.orchestra.run.smithi031.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-17T01:40:26.302 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T01:40:26.304 INFO:teuthology.orchestra.run.smithi031.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-17T01:40:26.329 INFO:teuthology.orchestra.run.smithi031.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-17T01:40:26.354 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T01:40:26.377 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-17T01:40:26.380 INFO:teuthology.orchestra.run.smithi031.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-17T01:40:26.405 INFO:teuthology.orchestra.run.smithi031.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 472 kB/s | 11 kB 00:00 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi031.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 707 kB/s | 18 kB 00:00 2024-09-17T01:40:26.456 INFO:teuthology.orchestra.run.smithi031.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-17T01:40:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-17T01:40:26.506 INFO:teuthology.orchestra.run.smithi031.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-17T01:40:26.531 INFO:teuthology.orchestra.run.smithi031.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-17T01:40:26.557 INFO:teuthology.orchestra.run.smithi031.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-17T01:40:26.582 INFO:teuthology.orchestra.run.smithi031.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-17T01:40:26.607 INFO:teuthology.orchestra.run.smithi031.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-17T01:40:26.632 INFO:teuthology.orchestra.run.smithi031.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-17T01:40:26.658 INFO:teuthology.orchestra.run.smithi031.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-17T01:40:26.683 INFO:teuthology.orchestra.run.smithi031.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-17T01:40:26.716 INFO:teuthology.orchestra.run.smithi031.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-17T01:40:26.742 INFO:teuthology.orchestra.run.smithi031.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-17T01:40:26.758 INFO:teuthology.orchestra.run.smithi031.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2024-09-17T01:40:26.784 INFO:teuthology.orchestra.run.smithi031.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T01:40:26.789 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:26.789 INFO:teuthology.orchestra.run.smithi031.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-17T01:40:26.915 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:27.377 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:27.377 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:28.738 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:28.796 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-17T01:40:28.837 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-17T01:40:28.878 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-17T01:40:28.975 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-17T01:40:29.169 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-17T01:40:29.215 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-17T01:40:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-17T01:40:29.278 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-17T01:40:29.321 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-17T01:40:29.354 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-17T01:40:29.395 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-17T01:40:29.439 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-17T01:40:29.476 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-17T01:40:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-17T01:40:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-17T01:40:29.753 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-17T01:40:29.842 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-17T01:40:29.902 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-17T01:40:29.940 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-17T01:40:29.999 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-17T01:40:30.063 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-17T01:40:30.086 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-17T01:40:30.182 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-17T01:40:30.261 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-17T01:40:30.310 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-17T01:40:30.393 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-17T01:40:30.499 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-17T01:40:30.542 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-17T01:40:30.665 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-17T01:40:30.848 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-17T01:40:30.876 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-17T01:40:30.905 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-17T01:40:30.905 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:30.905 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T01:40:30.905 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:40:30.905 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:40:30.905 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:32.242 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-17T01:40:32.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-17T01:40:32.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-17T01:40:32.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T01:40:32.511 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-17T01:40:32.541 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-17T01:40:32.541 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:32.541 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T01:40:32.541 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:40:32.541 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:40:32.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:32.550 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T01:40:32.550 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:32.550 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:40:32.551 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:32.551 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T01:40:32.551 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:32.551 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:32.859 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph 2024-09-17T01:40:33.012 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-17T01:40:33.037 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-17T01:40:33.037 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:33.037 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T01:40:33.038 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:40:33.038 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:40:33.038 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:33.254 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-17T01:40:33.279 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-17T01:40:33.279 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:33.279 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T01:40:33.280 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:40:33.280 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:40:33.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:33.345 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-17T01:40:33.443 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:33.583 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:33.585 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-17T01:40:33.585 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:33.585 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:33.585 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T01:40:33.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T01:40:33.587 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout:Install 33 Packages 2024-09-17T01:40:33.588 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:33.589 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 30 M 2024-09-17T01:40:33.589 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 109 M 2024-09-17T01:40:33.590 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:34.108 INFO:teuthology.orchestra.run.smithi092.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 98 kB/s | 6.4 kB 00:00 2024-09-17T01:40:34.158 INFO:teuthology.orchestra.run.smithi092.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-17T01:40:34.217 INFO:teuthology.orchestra.run.smithi092.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2024-09-17T01:40:34.242 INFO:teuthology.orchestra.run.smithi092.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-09-17T01:40:34.335 INFO:teuthology.orchestra.run.smithi092.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi092.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 44 MB/s | 18 MB 00:00 2024-09-17T01:40:34.585 INFO:teuthology.orchestra.run.smithi092.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 740 kB/s | 253 kB 00:00 2024-09-17T01:40:34.627 INFO:teuthology.orchestra.run.smithi092.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-17T01:40:34.661 INFO:teuthology.orchestra.run.smithi092.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 3.8 MB/s | 1.2 MB 00:00 2024-09-17T01:40:34.686 INFO:teuthology.orchestra.run.smithi092.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 848 kB/s | 106 kB 00:00 2024-09-17T01:40:34.711 INFO:teuthology.orchestra.run.smithi092.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-09-17T01:40:34.736 INFO:teuthology.orchestra.run.smithi092.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-17T01:40:34.803 INFO:teuthology.orchestra.run.smithi092.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-09-17T01:40:34.837 INFO:teuthology.orchestra.run.smithi092.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-17T01:40:34.870 INFO:teuthology.orchestra.run.smithi092.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 935 kB/s | 172 kB 00:00 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-17T01:40:34.895 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-17T01:40:34.896 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-17T01:40:34.897 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-17T01:40:34.898 INFO:teuthology.orchestra.run.smithi092.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 451 kB/s | 42 kB 00:00 2024-09-17T01:40:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-17T01:40:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-17T01:40:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-17T01:40:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-17T01:40:34.946 INFO:teuthology.orchestra.run.smithi092.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 400 kB/s | 43 kB 00:00 2024-09-17T01:40:34.971 INFO:teuthology.orchestra.run.smithi092.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-17T01:40:34.996 INFO:teuthology.orchestra.run.smithi092.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-17T01:40:35.022 INFO:teuthology.orchestra.run.smithi092.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-17T01:40:35.047 INFO:teuthology.orchestra.run.smithi092.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-09-17T01:40:35.072 INFO:teuthology.orchestra.run.smithi092.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-17T01:40:35.098 INFO:teuthology.orchestra.run.smithi092.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 389 kB/s | 20 kB 00:00 2024-09-17T01:40:35.123 INFO:teuthology.orchestra.run.smithi092.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 918 kB/s | 46 kB 00:00 2024-09-17T01:40:35.149 INFO:teuthology.orchestra.run.smithi092.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-17T01:40:35.182 INFO:teuthology.orchestra.run.smithi092.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-17T01:40:35.207 INFO:teuthology.orchestra.run.smithi092.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-09-17T01:40:35.232 INFO:teuthology.orchestra.run.smithi092.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-17T01:40:35.258 INFO:teuthology.orchestra.run.smithi092.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-17T01:40:35.283 INFO:teuthology.orchestra.run.smithi092.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-17T01:40:35.308 INFO:teuthology.orchestra.run.smithi092.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-17T01:40:35.342 INFO:teuthology.orchestra.run.smithi092.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-17T01:40:35.368 INFO:teuthology.orchestra.run.smithi092.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-17T01:40:35.371 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:35.372 INFO:teuthology.orchestra.run.smithi092.stdout:Total 17 MB/s | 30 MB 00:01 2024-09-17T01:40:35.492 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:35.529 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:35.529 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:35.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T01:40:35.707 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T01:40:35.708 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:35.709 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:35.930 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:35.930 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:36.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-base 2024-09-17T01:40:36.682 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:36.775 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:40:36.819 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:36.820 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:40:36.820 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:36.889 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install cephadm 2024-09-17T01:40:37.147 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:40:37.211 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-17T01:40:37.252 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-17T01:40:37.288 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-17T01:40:37.381 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-17T01:40:37.483 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-17T01:40:37.489 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:37.533 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-17T01:40:37.568 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-17T01:40:37.598 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-17T01:40:37.625 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:37.626 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:37.627 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:40:37.627 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:37.627 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 209 k 2024-09-17T01:40:37.627 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 200 k 2024-09-17T01:40:37.627 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:37.632 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-17T01:40:37.666 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-17T01:40:37.702 INFO:teuthology.orchestra.run.smithi031.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.7 MB/s | 209 kB 00:00 2024-09-17T01:40:37.703 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:37.703 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.7 MB/s | 209 kB 00:00 2024-09-17T01:40:37.703 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:37.706 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-17T01:40:37.709 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:37.709 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:37.712 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:37.712 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-17T01:40:37.779 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:37.792 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-17T01:40:37.830 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-17T01:40:37.904 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-17T01:40:38.052 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-17T01:40:38.131 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-17T01:40:38.183 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-17T01:40:38.200 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:38.222 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-17T01:40:38.288 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-17T01:40:38.292 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:38.351 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-17T01:40:38.538 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-17T01:40:38.592 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-17T01:40:38.678 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:38.678 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-17T01:40:38.776 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-17T01:40:38.824 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:38.948 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-17T01:40:39.106 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-17T01:40:39.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T01:40:39.135 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-17T01:40:39.161 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-17T01:40:39.161 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:39.161 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T01:40:39.161 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:40:39.161 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:40:39.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:39.727 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:39.866 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:39.867 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:39.867 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-09-17T01:40:39.867 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:39.867 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 142 k 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 399 k 2024-09-17T01:40:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:39.941 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 1.9 MB/s | 142 kB 00:00 2024-09-17T01:40:39.941 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:39.942 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-09-17T01:40:39.942 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:39.949 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:39.950 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:40.009 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:40.010 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:40.163 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:40:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:40:40.252 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:40.252 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T01:40:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:40.686 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-17T01:40:40.716 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-17T01:40:40.716 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:40.716 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T01:40:40.716 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:40:40.716 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:40:40.716 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:41.187 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-17T01:40:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:40:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:41.210 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:41.210 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:41.212 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-17T01:40:41.212 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:41.212 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T01:40:41.212 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:40:41.213 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:40:41.213 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:41.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr 2024-09-17T01:40:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-17T01:40:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-17T01:40:41.453 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:41.454 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T01:40:41.454 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:40:41.454 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:40:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:41.554 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-17T01:40:42.031 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:42.123 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:40:42.167 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:42.168 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:40:42.168 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:42.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T01:40:42.841 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:42.978 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:42.979 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:42.979 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-17T01:40:42.979 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:42.979 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:42.979 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:42.980 INFO:teuthology.orchestra.run.smithi031.stdout:Install 7 Packages 2024-09-17T01:40:42.981 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:42.981 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 2.0 M 2024-09-17T01:40:42.981 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 8.1 M 2024-09-17T01:40:42.981 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:43.094 INFO:teuthology.orchestra.run.smithi031.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 287 kB/s | 23 kB 00:00 2024-09-17T01:40:43.144 INFO:teuthology.orchestra.run.smithi031.stdout:(2/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 13 MB/s | 1.7 MB 00:00 2024-09-17T01:40:43.169 INFO:teuthology.orchestra.run.smithi031.stdout:(3/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 94 kB/s | 15 kB 00:00 2024-09-17T01:40:43.203 INFO:teuthology.orchestra.run.smithi031.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 83 kB/s | 9.0 kB 00:00 2024-09-17T01:40:43.237 INFO:teuthology.orchestra.run.smithi031.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 453 kB/s | 41 kB 00:00 2024-09-17T01:40:43.262 INFO:teuthology.orchestra.run.smithi031.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 361 kB/s | 31 kB 00:00 2024-09-17T01:40:43.287 INFO:teuthology.orchestra.run.smithi031.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-17T01:40:43.291 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:43.291 INFO:teuthology.orchestra.run.smithi031.stdout:Total 6.4 MB/s | 2.0 MB 00:00 2024-09-17T01:40:43.291 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:43.300 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:43.300 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:43.382 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:43.382 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-17T01:40:43.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-17T01:40:43.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-17T01:40:43.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-17T01:40:43.388 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-17T01:40:43.388 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-17T01:40:43.388 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-17T01:40:43.388 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-17T01:40:43.687 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:43.747 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-17T01:40:43.782 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-17T01:40:43.829 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-17T01:40:43.859 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-17T01:40:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-17T01:40:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-17T01:40:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-17T01:40:44.429 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-17T01:40:44.429 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T01:40:44.430 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T01:40:44.431 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:44.432 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-17T01:40:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-17T01:40:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-17T01:40:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-17T01:40:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-17T01:40:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-17T01:40:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-17T01:40:44.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-base 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-17T01:40:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-17T01:40:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T01:40:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T01:40:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:44.976 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:45.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T01:40:45.371 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:45.460 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:40:45.501 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:45.502 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:40:45.502 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:45.569 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install cephadm 2024-09-17T01:40:45.776 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:45.915 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:45.916 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:45.916 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T01:40:45.917 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout:Install 12 Packages 2024-09-17T01:40:45.918 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:45.919 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 38 M 2024-09-17T01:40:45.919 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 212 M 2024-09-17T01:40:45.919 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:46.141 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:46.194 INFO:teuthology.orchestra.run.smithi031.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-17T01:40:46.273 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:46.273 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 209 k 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 200 k 2024-09-17T01:40:46.274 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:46.319 INFO:teuthology.orchestra.run.smithi031.stdout:(2/12): ceph-mgr-diskprediction-local-18.2.0-0. 29 MB/s | 7.4 MB 00:00 2024-09-17T01:40:46.327 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.9 MB/s | 209 kB 00:00 2024-09-17T01:40:46.328 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:46.328 INFO:teuthology.orchestra.run.smithi092.stdout:Total 3.8 MB/s | 209 kB 00:00 2024-09-17T01:40:46.328 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:46.333 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:46.333 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:46.336 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:46.336 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:46.344 INFO:teuthology.orchestra.run.smithi031.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-17T01:40:46.408 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:40:46.419 INFO:teuthology.orchestra.run.smithi031.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 145 kB/s | 33 kB 00:00 2024-09-17T01:40:46.461 INFO:teuthology.orchestra.run.smithi031.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 155 kB/s | 18 kB 00:00 2024-09-17T01:40:46.503 INFO:teuthology.orchestra.run.smithi031.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-17T01:40:46.637 INFO:teuthology.orchestra.run.smithi031.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-17T01:40:46.695 INFO:teuthology.orchestra.run.smithi031.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.0 MB/s | 3.0 MB 00:00 2024-09-17T01:40:46.754 INFO:teuthology.orchestra.run.smithi031.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-17T01:40:46.848 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:46.871 INFO:teuthology.orchestra.run.smithi031.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 12 MB/s | 4.9 MB 00:00 2024-09-17T01:40:46.939 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:46.946 INFO:teuthology.orchestra.run.smithi031.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-17T01:40:47.213 INFO:teuthology.orchestra.run.smithi031.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-17T01:40:47.214 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:47.214 INFO:teuthology.orchestra.run.smithi031.stdout:Total 29 MB/s | 38 MB 00:01 2024-09-17T01:40:47.271 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:47.529 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-17T01:40:47.530 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:47.530 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:40:47.530 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-17T01:40:47.530 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:47.530 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:47.578 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:47.606 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:47.606 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:47.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T01:40:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:48.321 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:48.457 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:48.458 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:40:48.459 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:48.459 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 142 k 2024-09-17T01:40:48.459 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 399 k 2024-09-17T01:40:48.459 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:48.501 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 3.3 MB/s | 142 kB 00:00 2024-09-17T01:40:48.502 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:48.502 INFO:teuthology.orchestra.run.smithi092.stdout:Total 3.2 MB/s | 142 kB 00:00 2024-09-17T01:40:48.502 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:48.510 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:48.510 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:48.568 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:48.568 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:48.713 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:40:48.786 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:40:48.811 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:40:48.811 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:40:48.811 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T01:40:48.811 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:48.985 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T01:40:49.028 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:40:49.132 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:40:49.171 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T01:40:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T01:40:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T01:40:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T01:40:49.813 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:40:49.813 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:49.814 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:40:49.814 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-17T01:40:49.814 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:49.814 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:50.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr 2024-09-17T01:40:50.192 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T01:40:50.311 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T01:40:50.612 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:50.704 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:40:50.745 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:50.746 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:40:50.746 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:50.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T01:40:51.395 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:51.527 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout:Install 7 Packages 2024-09-17T01:40:51.529 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:51.530 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.0 M 2024-09-17T01:40:51.530 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 8.1 M 2024-09-17T01:40:51.530 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:51.630 INFO:teuthology.orchestra.run.smithi092.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 337 kB/s | 23 kB 00:00 2024-09-17T01:40:51.639 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:40:51.655 INFO:teuthology.orchestra.run.smithi092.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 156 kB/s | 15 kB 00:00 2024-09-17T01:40:51.697 INFO:teuthology.orchestra.run.smithi092.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-17T01:40:51.722 INFO:teuthology.orchestra.run.smithi092.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-17T01:40:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 407 kB/s | 41 kB 00:00 2024-09-17T01:40:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-17T01:40:51.823 INFO:teuthology.orchestra.run.smithi092.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 6.5 MB/s | 1.7 MB 00:00 2024-09-17T01:40:51.826 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:51.827 INFO:teuthology.orchestra.run.smithi092.stdout:Total 6.7 MB/s | 2.0 MB 00:00 2024-09-17T01:40:51.827 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:51.834 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:51.834 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:51.917 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:51.917 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:52.217 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:40:52.282 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-17T01:40:52.325 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-17T01:40:52.372 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-17T01:40:52.404 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-17T01:40:52.440 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-17T01:40:52.671 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-17T01:40:52.702 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-17T01:40:52.712 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T01:40:52.734 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-17T01:40:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-17T01:40:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-17T01:40:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-17T01:40:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-17T01:40:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-17T01:40:53.287 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-17T01:40:53.288 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-17T01:40:53.562 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-17T01:40:53.562 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:53.562 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:53.563 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:40:53.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T01:40:54.353 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:40:54.486 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:40:54.487 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T01:40:54.488 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout:Install 12 Packages 2024-09-17T01:40:54.489 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:40:54.490 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 38 M 2024-09-17T01:40:54.490 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 212 M 2024-09-17T01:40:54.490 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:40:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-17T01:40:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:40:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T01:40:55.162 INFO:teuthology.orchestra.run.smithi092.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 50 MB/s | 7.4 MB 00:00 2024-09-17T01:40:55.279 INFO:teuthology.orchestra.run.smithi092.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 722 kB/s | 191 kB 00:00 2024-09-17T01:40:55.305 INFO:teuthology.orchestra.run.smithi092.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-17T01:40:55.388 INFO:teuthology.orchestra.run.smithi092.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 218 kB/s | 18 kB 00:00 2024-09-17T01:40:55.430 INFO:teuthology.orchestra.run.smithi092.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-17T01:40:55.464 INFO:teuthology.orchestra.run.smithi092.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:40:55.589 INFO:teuthology.orchestra.run.smithi092.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-17T01:40:55.898 INFO:teuthology.orchestra.run.smithi092.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.8 MB/s | 3.0 MB 00:00 2024-09-17T01:40:55.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-rook 2024-09-17T01:40:55.981 INFO:teuthology.orchestra.run.smithi092.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-17T01:40:56.511 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:08 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:40:56.515 INFO:teuthology.orchestra.run.smithi092.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-17T01:40:56.582 INFO:teuthology.orchestra.run.smithi092.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.3 MB/s | 4.9 MB 00:01 2024-09-17T01:40:56.647 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T01:40:56.649 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout:Install 13 Packages 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:40:56.651 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 2.2 M 2024-09-17T01:40:56.651 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 26 M 2024-09-17T01:40:56.651 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:40:57.041 INFO:teuthology.orchestra.run.smithi031.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 634 kB/s | 47 kB 00:00 2024-09-17T01:40:57.074 INFO:teuthology.orchestra.run.smithi031.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 237 kB/s | 26 kB 00:00 2024-09-17T01:40:57.091 INFO:teuthology.orchestra.run.smithi031.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 153 kB/s | 19 kB 00:00 2024-09-17T01:40:57.233 INFO:teuthology.orchestra.run.smithi031.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-17T01:40:57.258 INFO:teuthology.orchestra.run.smithi031.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 222 kB 00:00 2024-09-17T01:40:57.283 INFO:teuthology.orchestra.run.smithi031.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-17T01:40:57.309 INFO:teuthology.orchestra.run.smithi031.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 709 kB/s | 54 kB 00:00 2024-09-17T01:40:57.359 INFO:teuthology.orchestra.run.smithi031.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-17T01:40:57.384 INFO:teuthology.orchestra.run.smithi031.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 141 kB/s | 14 kB 00:00 2024-09-17T01:40:57.418 INFO:teuthology.orchestra.run.smithi031.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-17T01:40:57.443 INFO:teuthology.orchestra.run.smithi031.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-17T01:40:57.468 INFO:teuthology.orchestra.run.smithi031.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-17T01:40:57.510 INFO:teuthology.orchestra.run.smithi031.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.9 MB/s | 1.0 MB 00:00 2024-09-17T01:40:57.512 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:57.513 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-17T01:40:57.578 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:40:57.594 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:40:57.594 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:40:57.692 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:40:57.692 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:40:58.228 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:40:58.290 INFO:teuthology.orchestra.run.smithi092.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-09-17T01:40:58.290 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:40:58.291 INFO:teuthology.orchestra.run.smithi092.stdout:Total 10 MB/s | 38 MB 00:03 2024-09-17T01:40:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T01:40:58.464 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T01:40:58.528 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T01:40:58.563 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T01:40:58.605 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T01:40:58.646 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:40:58.672 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:40:58.672 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:40:58.711 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T01:40:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T01:40:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T01:40:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:40:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:40:59.649 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T01:40:59.728 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T01:40:59.761 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T01:40:59.808 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T01:40:59.830 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-17T01:40:59.936 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:00.003 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T01:41:00.046 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:41:00.145 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:41:00.189 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T01:41:00.373 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T01:41:00.413 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T01:41:00.495 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T01:41:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-17T01:41:00.622 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T01:41:00.623 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T01:41:00.955 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:00.956 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:01.152 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T01:41:01.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T01:41:01.266 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T01:41:01.832 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:13 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:01.982 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T01:41:01.983 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout:Install 6 Packages 2024-09-17T01:41:01.984 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:01.985 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 7.0 M 2024-09-17T01:41:01.985 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 33 M 2024-09-17T01:41:01.985 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:02.353 INFO:teuthology.orchestra.run.smithi031.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.8 MB/s | 127 kB 00:00 2024-09-17T01:41:02.411 INFO:teuthology.orchestra.run.smithi031.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T01:41:02.454 INFO:teuthology.orchestra.run.smithi031.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-17T01:41:02.479 INFO:teuthology.orchestra.run.smithi031.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 858 kB/s | 58 kB 00:00 2024-09-17T01:41:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-17T01:41:02.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:41:02.637 INFO:teuthology.orchestra.run.smithi031.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-17T01:41:02.639 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:02.639 INFO:teuthology.orchestra.run.smithi031.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-17T01:41:02.712 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:02.724 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:02.724 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:02.828 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:02.829 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:03.161 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:03.338 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T01:41:03.399 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T01:41:03.570 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T01:41:03.603 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-17T01:41:03.960 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T01:41:04.054 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T01:41:04.120 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T01:41:04.142 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T01:41:05.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T01:41:05.179 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:05.179 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:05.180 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:05.375 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-fuse 2024-09-17T01:41:05.987 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:17 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:06.125 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:06.125 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout:Install 2 Packages 2024-09-17T01:41:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:06.127 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 914 k 2024-09-17T01:41:06.127 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 2.7 M 2024-09-17T01:41:06.127 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:06.238 INFO:teuthology.orchestra.run.smithi031.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 9.0 MB/s | 835 kB 00:00 2024-09-17T01:41:06.289 INFO:teuthology.orchestra.run.smithi031.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 568 kB/s | 80 kB 00:00 2024-09-17T01:41:06.289 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:06.289 INFO:teuthology.orchestra.run.smithi031.stdout:Total 5.5 MB/s | 914 kB 00:00 2024-09-17T01:41:06.301 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:06.323 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:06.324 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:06.358 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-17T01:41:06.358 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-17T01:41:06.358 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:41:06.358 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:41:06.358 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T01:41:06.358 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T01:41:06.359 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T01:41:06.359 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T01:41:06.359 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T01:41:06.359 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T01:41:06.359 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:41:06.359 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T01:41:06.411 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:06.412 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:06.743 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T01:41:06.770 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T01:41:06.771 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T01:41:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T01:41:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T01:41:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T01:41:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T01:41:06.772 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:06.772 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:06.816 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-17T01:41:07.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-rook 2024-09-17T01:41:07.484 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-17T01:41:07.484 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-17T01:41:07.722 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:09 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:07.753 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T01:41:07.753 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:07.753 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:07.753 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T01:41:07.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:07.754 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:07.853 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:07.854 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:07.854 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-17T01:41:07.854 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:07.854 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T01:41:07.855 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout:Install 13 Packages 2024-09-17T01:41:07.856 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:07.857 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.2 M 2024-09-17T01:41:07.857 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 26 M 2024-09-17T01:41:07.857 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:08.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados-devel 2024-09-17T01:41:08.327 INFO:teuthology.orchestra.run.smithi092.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.3 MB/s | 47 kB 00:00 2024-09-17T01:41:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 61 kB/s | 19 kB 00:00 2024-09-17T01:41:08.621 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:20 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 76 kB/s | 26 kB 00:00 2024-09-17T01:41:08.760 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 126 k 2024-09-17T01:41:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 456 k 2024-09-17T01:41:08.762 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:08.834 INFO:teuthology.orchestra.run.smithi031.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.7 MB/s | 126 kB 00:00 2024-09-17T01:41:08.834 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:08.835 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.7 MB/s | 126 kB 00:00 2024-09-17T01:41:08.835 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:08.841 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:08.841 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:08.907 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:08.907 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:08.920 INFO:teuthology.orchestra.run.smithi092.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 375 kB/s | 222 kB 00:00 2024-09-17T01:41:08.978 INFO:teuthology.orchestra.run.smithi092.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-17T01:41:09.020 INFO:teuthology.orchestra.run.smithi092.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 773 kB/s | 32 kB 00:00 2024-09-17T01:41:09.046 INFO:teuthology.orchestra.run.smithi092.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 428 kB/s | 54 kB 00:00 2024-09-17T01:41:09.066 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:09.071 INFO:teuthology.orchestra.run.smithi092.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-17T01:41:09.105 INFO:teuthology.orchestra.run.smithi092.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 585 kB/s | 279 kB 00:00 2024-09-17T01:41:09.147 INFO:teuthology.orchestra.run.smithi092.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-17T01:41:09.165 INFO:teuthology.orchestra.run.smithi092.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T01:41:09.175 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:09.189 INFO:teuthology.orchestra.run.smithi092.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-17T01:41:09.223 INFO:teuthology.orchestra.run.smithi092.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.1 MB/s | 1.0 MB 00:00 2024-09-17T01:41:09.225 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:09.226 INFO:teuthology.orchestra.run.smithi092.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-09-17T01:41:09.293 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:09.309 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:09.309 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:09.401 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:09.403 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:09.595 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:09.851 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:09.851 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:09.851 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:09.851 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:09.851 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:09.851 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:09.904 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:10.071 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T01:41:10.096 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs2 2024-09-17T01:41:10.133 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T01:41:10.196 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T01:41:10.233 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T01:41:10.274 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T01:41:10.393 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T01:41:10.503 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T01:41:10.559 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T01:41:10.706 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:22 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:10.799 INFO:teuthology.orchestra.run.smithi031.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:10.845 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:10.846 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:10.846 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:10.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs-devel 2024-09-17T01:41:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T01:41:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T01:41:11.374 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T01:41:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T01:41:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-17T01:41:11.518 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:11.654 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:11.656 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:11.656 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:11.656 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:11.656 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:11.656 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-17T01:41:11.656 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 30 k 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 137 k 2024-09-17T01:41:11.657 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:11.721 INFO:teuthology.orchestra.run.smithi031.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 470 kB/s | 30 kB 00:00 2024-09-17T01:41:11.721 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:11.722 INFO:teuthology.orchestra.run.smithi031.stdout:Total 460 kB/s | 30 kB 00:00 2024-09-17T01:41:11.722 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:11.725 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:11.725 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:11.819 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:11.921 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-17T01:41:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-17T01:41:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T01:41:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T01:41:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T01:41:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T01:41:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T01:41:12.297 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:12.551 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:12.551 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T01:41:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:12.585 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-17T01:41:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T01:41:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:12.587 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:12.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2024-09-17T01:41:12.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T01:41:13.348 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:25 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:13.404 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:15 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:13.441 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:13.486 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:13.487 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:13.487 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:13.535 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 7.0 M 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 33 M 2024-09-17T01:41:13.538 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:13.556 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librbd1 2024-09-17T01:41:13.717 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.5 MB/s | 127 kB 00:00 2024-09-17T01:41:13.792 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.2 MB/s | 548 kB 00:00 2024-09-17T01:41:13.817 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T01:41:13.842 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-17T01:41:13.917 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 993 kB/s | 248 kB 00:00 2024-09-17T01:41:14.166 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:26 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:14.257 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:14.302 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:14.304 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:14.304 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:14.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rados 2024-09-17T01:41:14.977 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:26 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:15.071 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:15.117 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:15.118 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:15.118 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:15.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rgw 2024-09-17T01:41:15.797 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:15.889 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:15.935 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:15.936 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:15.936 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:16.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-cephfs 2024-09-17T01:41:16.209 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-17T01:41:16.211 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:16.211 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.6 MB/s | 7.0 MB 00:02 2024-09-17T01:41:16.284 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:16.295 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:16.296 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:16.395 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:16.396 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:16.611 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:16.695 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:16.749 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:16.750 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:16.750 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:16.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rbd 2024-09-17T01:41:16.880 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T01:41:16.960 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T01:41:17.431 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:17.486 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T01:41:17.523 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:17.568 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:17.570 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-09-17T01:41:17.570 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:17.570 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T01:41:17.631 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T01:41:17.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-fuse 2024-09-17T01:41:17.656 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-17T01:41:18.239 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:18.376 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:18.376 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:18.376 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 86 k 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 230 k 2024-09-17T01:41:18.377 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:18.396 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-17T01:41:18.396 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-17T01:41:18.396 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T01:41:18.396 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T01:41:18.396 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T01:41:18.396 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T01:41:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-17T01:41:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.0 MB/s | 86 kB 00:00 2024-09-17T01:41:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:18.465 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:18.465 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:18.673 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T01:41:18.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:18.673 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:18.673 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-17T01:41:18.673 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T01:41:18.673 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T01:41:18.674 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T01:41:18.674 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T01:41:18.674 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T01:41:18.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:18.674 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:18.684 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:18.790 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:18.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-fuse 2024-09-17T01:41:19.157 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:19.409 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:19.409 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:19.409 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:19.409 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:19.409 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:19.409 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:19.488 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:21 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:19.620 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:19.620 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:Install 2 Packages 2024-09-17T01:41:19.621 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:19.622 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 914 k 2024-09-17T01:41:19.622 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 2.7 M 2024-09-17T01:41:19.622 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:19.624 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-mirror 2024-09-17T01:41:19.952 INFO:teuthology.orchestra.run.smithi092.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 15 MB/s | 835 kB 00:00 2024-09-17T01:41:20.069 INFO:teuthology.orchestra.run.smithi092.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 467 kB/s | 80 kB 00:00 2024-09-17T01:41:20.069 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:20.069 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.0 MB/s | 914 kB 00:00 2024-09-17T01:41:20.082 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:20.103 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:20.104 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:20.185 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:20.186 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:20.232 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:20.370 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:20.371 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:20.371 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:20.371 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:20.371 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:20.371 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-17T01:41:20.371 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 3.0 M 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 12 M 2024-09-17T01:41:20.372 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:20.374 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:20.484 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 27 MB/s | 3.0 MB 00:00 2024-09-17T01:41:20.485 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:20.485 INFO:teuthology.orchestra.run.smithi031.stdout:Total 26 MB/s | 3.0 MB 00:00 2024-09-17T01:41:20.485 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:20.495 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:20.495 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:20.523 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T01:41:20.579 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:20.579 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:20.609 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-17T01:41:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:21.111 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:21.112 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:41:21.112 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T01:41:21.112 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:41:21.112 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:41:21.112 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:21.317 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-17T01:41:21.317 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-17T01:41:21.565 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T01:41:21.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:21.566 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:21.566 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T01:41:21.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:21.566 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:21.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados-devel 2024-09-17T01:41:22.210 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:22.210 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:22.210 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:22.210 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:22.210 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:22.211 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:22.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-nbd 2024-09-17T01:41:22.456 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:22.593 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:22.594 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:22.594 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:22.594 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:22.594 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:22.594 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-17T01:41:22.594 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 126 k 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 456 k 2024-09-17T01:41:22.595 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:22.640 INFO:teuthology.orchestra.run.smithi092.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.8 MB/s | 126 kB 00:00 2024-09-17T01:41:22.641 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:22.641 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.7 MB/s | 126 kB 00:00 2024-09-17T01:41:22.641 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:22.646 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:22.646 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:22.710 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:22.710 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:22.879 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:22.997 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:23.054 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 01:39:48 AM UTC. 2024-09-17T01:41:23.191 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-09-17T01:41:23.192 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:23.192 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:23.192 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:23.192 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-09-17T01:41:23.192 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-17T01:41:23.192 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 169 k 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 490 k 2024-09-17T01:41:23.193 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-09-17T01:41:23.271 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.1 MB/s | 169 kB 00:00 2024-09-17T01:41:23.272 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:23.272 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.1 MB/s | 169 kB 00:00 2024-09-17T01:41:23.272 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-09-17T01:41:23.280 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-09-17T01:41:23.280 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-09-17T01:41:23.347 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-09-17T01:41:23.347 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-09-17T01:41:23.422 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:23.503 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-09-17T01:41:23.612 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:23.683 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:23.684 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:23.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs2 2024-09-17T01:41:24.014 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:24.276 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:24.276 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:24.276 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-09-17T01:41:24.276 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:24.276 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:41:24.276 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-09-17T01:41:24.503 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:26 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:24.511 DEBUG:teuthology.parallel:result is None 2024-09-17T01:41:24.595 INFO:teuthology.orchestra.run.smithi092.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:24.639 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:24.640 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:24.640 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:24.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs-devel 2024-09-17T01:41:25.281 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:25.412 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:25.413 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:25.414 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:25.414 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:41:25.414 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:25.414 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 30 k 2024-09-17T01:41:25.414 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 137 k 2024-09-17T01:41:25.414 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:25.468 INFO:teuthology.orchestra.run.smithi092.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 564 kB/s | 30 kB 00:00 2024-09-17T01:41:25.469 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:25.469 INFO:teuthology.orchestra.run.smithi092.stdout:Total 551 kB/s | 30 kB 00:00 2024-09-17T01:41:25.469 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:25.472 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:25.472 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:25.490 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:25.490 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:25.576 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:25.690 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:26.073 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:26.313 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:26.313 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:26.313 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:26.313 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:26.313 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:26.313 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:26.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados2 2024-09-17T01:41:27.090 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:27.177 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:27.220 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:27.221 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:27.221 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:27.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librbd1 2024-09-17T01:41:27.869 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:27.956 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:28.000 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:28.001 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:28.001 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:28.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rados 2024-09-17T01:41:28.648 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:28.737 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:28.780 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:28.781 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:28.781 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:28.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rgw 2024-09-17T01:41:29.425 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:29.514 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:29.557 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:29.558 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:29.558 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:29.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-cephfs 2024-09-17T01:41:30.206 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:30.295 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:30.338 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:30.338 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:30.339 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:30.402 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rbd 2024-09-17T01:41:30.975 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:31.064 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:41:31.106 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:31.107 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-09-17T01:41:31.108 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:31.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-fuse 2024-09-17T01:41:31.743 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:31.873 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:41:31.874 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:31.875 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 86 k 2024-09-17T01:41:31.875 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 230 k 2024-09-17T01:41:31.875 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:31.937 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-09-17T01:41:31.938 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:31.938 INFO:teuthology.orchestra.run.smithi092.stdout:Total 1.3 MB/s | 86 kB 00:00 2024-09-17T01:41:31.938 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:31.945 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:31.945 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:32.007 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:32.007 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:32.155 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:32.241 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:32.618 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:32.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:32.887 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:32.887 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:32.887 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:32.887 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:32.887 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:33.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-mirror 2024-09-17T01:41:33.706 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:33.843 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:33.843 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 3.0 M 2024-09-17T01:41:33.844 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 12 M 2024-09-17T01:41:33.845 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:33.915 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 42 MB/s | 3.0 MB 00:00 2024-09-17T01:41:33.917 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:33.917 INFO:teuthology.orchestra.run.smithi092.stdout:Total 41 MB/s | 3.0 MB 00:00 2024-09-17T01:41:33.917 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:34.005 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:34.006 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:34.425 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:34.516 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:34.541 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:34.541 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:41:34.541 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T01:41:34.541 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:41:34.542 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:41:34.542 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:35.603 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:35.603 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:35.603 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:35.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-nbd 2024-09-17T01:41:36.450 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 01:39:58 AM UTC. 2024-09-17T01:41:36.586 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-17T01:41:36.587 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:36.587 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-17T01:41:36.587 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:36.587 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-17T01:41:36.587 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 169 k 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 490 k 2024-09-17T01:41:36.588 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 169 kB 00:00 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.9 MB/s | 169 kB 00:00 2024-09-17T01:41:36.645 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-17T01:41:36.652 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-17T01:41:36.652 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-17T01:41:36.714 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-17T01:41:36.715 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-17T01:41:36.863 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-17T01:41:36.975 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:37.644 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-17T01:41:37.644 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:37.645 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-17T01:41:37.645 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-17T01:41:37.645 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:41:37.645 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-17T01:41:37.882 DEBUG:teuthology.parallel:result is None 2024-09-17T01:41:37.882 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-17T01:41:37.883 INFO:teuthology.packaging:ref: None 2024-09-17T01:41:37.883 INFO:teuthology.packaging:tag: v18.2.0 2024-09-17T01:41:37.883 INFO:teuthology.packaging:branch: None 2024-09-17T01:41:37.883 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:41:37.883 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-17T01:41:38.036 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T01:41:38.063 INFO:teuthology.orchestra.run.smithi031.stdout:18.2.0-0.el9 2024-09-17T01:41:38.064 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-17T01:41:38.064 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-17T01:41:38.066 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-17T01:41:38.066 INFO:teuthology.packaging:ref: None 2024-09-17T01:41:38.066 INFO:teuthology.packaging:tag: v18.2.0 2024-09-17T01:41:38.066 INFO:teuthology.packaging:branch: None 2024-09-17T01:41:38.066 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:41:38.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-17T01:41:38.226 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T01:41:38.248 INFO:teuthology.orchestra.run.smithi092.stdout:18.2.0-0.el9 2024-09-17T01:41:38.248 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-17T01:41:38.248 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-17T01:41:38.250 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T01:41:38.250 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:41:38.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:41:38.282 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:41:38.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:41:38.315 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T01:41:38.315 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:41:38.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:41:38.352 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:41:38.422 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:41:38.422 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:41:38.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:41:38.513 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T01:41:38.514 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:41:38.514 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:41:38.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:41:38.613 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:41:38.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:41:38.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:41:38.703 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T01:41:38.703 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:41:38.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:41:38.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:41:38.799 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:41:38.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:41:38.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:41:38.888 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:41:38.899 INFO:teuthology.task.print:**** done install task... 2024-09-17T01:41:38.900 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T01:41:38.994 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T01:41:38.995 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-09-17T01:41:38.995 INFO:tasks.cephadm:Cluster fsid is fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:41:38.995 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T01:41:38.996 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-17T01:41:38.996 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi031': '172.21.15.31', 'mon.smithi092': '172.21.15.92'} 2024-09-17T01:41:38.996 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T01:41:38.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname $(hostname -s) 2024-09-17T01:41:39.026 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-09-17T01:41:39.051 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-17T01:41:39.051 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:41:39.193 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56092/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-330-gc2ddf972', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-330.gc2ddf972'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-16 16:11:17.578068', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-17T01:41:39.481 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-17T01:41:39.483 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-17T01:41:39.483 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-17T01:41:39.483 DEBUG:teuthology.orchestra.run.smithi031:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T01:41:39.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 01:41 /home/ubuntu/cephtest/cephadm 2024-09-17T01:41:39.982 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T01:41:40.451 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 01:41 /home/ubuntu/cephtest/cephadm 2024-09-17T01:41:40.452 DEBUG:teuthology.orchestra.run.smithi031:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T01:41:40.472 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T01:41:40.503 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-09-17T01:41:40.503 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-17T01:41:40.515 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-17T01:41:42.066 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-17T01:41:42.107 INFO:teuthology.orchestra.run.smithi031.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout: "repo_digests": [ 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T01:41:54.241 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:41:56.947 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-17T01:41:56.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph 2024-09-17T01:41:57.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-09-17T01:41:57.032 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /etc/ceph 2024-09-17T01:41:57.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-09-17T01:41:57.100 INFO:tasks.cephadm:Writing seed config... 2024-09-17T01:41:57.101 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-17T01:41:57.101 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-17T01:41:57.102 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-17T01:41:57.103 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-17T01:41:57.104 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-17T01:41:57.105 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-17T01:41:57.106 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:41:57.106 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T01:41:57.133 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = fb7c6180-7495-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-17T01:41:57.133 DEBUG:teuthology.orchestra.run.smithi031:mon.smithi031> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service 2024-09-17T01:41:57.176 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T01:41:57.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid fb7c6180-7495-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.31 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:41:57.343 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:41:57.343 INFO:teuthology.orchestra.run.smithi031.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'fb7c6180-7495-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.31', '--skip-admin-label'] 2024-09-17T01:41:57.367 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout 5.2.2 2024-09-17T01:41:57.367 INFO:teuthology.orchestra.run.smithi031.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T01:41:57.367 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying podman|docker is present... 2024-09-17T01:41:57.390 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout 5.2.2 2024-09-17T01:41:57.390 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying lvm2 is present... 2024-09-17T01:41:57.390 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying time synchronization is in place... 2024-09-17T01:41:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T01:41:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T01:41:57.404 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T01:41:57.404 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-09-17T01:41:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout enabled 2024-09-17T01:41:57.417 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout active 2024-09-17T01:41:57.417 INFO:teuthology.orchestra.run.smithi031.stdout:Unit chronyd.service is enabled and running 2024-09-17T01:41:57.417 INFO:teuthology.orchestra.run.smithi031.stdout:Repeating the final host check... 2024-09-17T01:41:57.440 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout 5.2.2 2024-09-17T01:41:57.440 INFO:teuthology.orchestra.run.smithi031.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T01:41:57.440 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl is present 2024-09-17T01:41:57.440 INFO:teuthology.orchestra.run.smithi031.stdout:lvcreate is present 2024-09-17T01:41:57.448 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T01:41:57.448 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T01:41:57.453 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T01:41:57.453 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-09-17T01:41:57.460 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout enabled 2024-09-17T01:41:57.467 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout active 2024-09-17T01:41:57.468 INFO:teuthology.orchestra.run.smithi031.stdout:Unit chronyd.service is enabled and running 2024-09-17T01:41:57.468 INFO:teuthology.orchestra.run.smithi031.stdout:Host looks OK 2024-09-17T01:41:57.468 INFO:teuthology.orchestra.run.smithi031.stdout:Cluster fsid: fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:41:57.468 INFO:teuthology.orchestra.run.smithi031.stdout:Acquiring lock 140074966635856 on /run/cephadm/fb7c6180-7495-11ef-bceb-c7b262605968.lock 2024-09-17T01:41:57.468 INFO:teuthology.orchestra.run.smithi031.stdout:Lock 140074966635856 acquired on /run/cephadm/fb7c6180-7495-11ef-bceb-c7b262605968.lock 2024-09-17T01:41:57.469 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying IP 172.21.15.31 port 3300 ... 2024-09-17T01:41:57.469 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying IP 172.21.15.31 port 6789 ... 2024-09-17T01:41:57.469 INFO:teuthology.orchestra.run.smithi031.stdout:Base mon IP(s) is [172.21.15.31:3300, 172.21.15.31:6789], mon addrv is [v2:172.21.15.31:3300,v1:172.21.15.31:6789] 2024-09-17T01:41:57.471 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.31 metric 100 2024-09-17T01:41:57.471 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.31 metric 100 2024-09-17T01:41:57.474 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T01:41:57.474 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-17T01:41:57.474 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-17T01:41:57.477 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T01:41:57.477 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T01:41:57.477 INFO:teuthology.orchestra.run.smithi031.stdout:Mon IP `172.21.15.31` is in CIDR network `172.21.0.0/20` 2024-09-17T01:41:57.478 INFO:teuthology.orchestra.run.smithi031.stdout:Mon IP `172.21.15.31` is in CIDR network `172.21.0.0/20` 2024-09-17T01:41:57.478 INFO:teuthology.orchestra.run.smithi031.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T01:41:57.478 INFO:teuthology.orchestra.run.smithi031.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T01:41:57.478 INFO:teuthology.orchestra.run.smithi031.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-17T01:41:58.251 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-17T01:41:58.252 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-09-17T01:41:58.252 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T01:41:58.252 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-09-17T01:41:58.252 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-09-17T01:41:58.252 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-17T01:41:58.252 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T01:41:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-17T01:41:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-17T01:41:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T01:42:00.187 INFO:teuthology.orchestra.run.smithi031.stdout:stat: stdout 167 167 2024-09-17T01:42:00.187 INFO:teuthology.orchestra.run.smithi031.stdout:Creating initial keys... 2024-09-17T01:42:01.168 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph-authtool: stdout AQBo3uhm60HXHRAAVB5yxSBVUTymuwxZydnTvQ== 2024-09-17T01:42:02.081 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph-authtool: stdout AQBp3uhmndwnHRAAxw7CgOvm9WcsV9GEAqZa5Q== 2024-09-17T01:42:08.713 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph-authtool: stdout AQBq3uhmaRmBGxAAL6S9XJYZ0i9yRtMYReKu4A== 2024-09-17T01:42:08.713 INFO:teuthology.orchestra.run.smithi031.stdout:Creating initial monmap... 2024-09-17T01:42:13.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T01:42:13.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-17T01:42:13.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:13.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T01:42:13.482 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool for smithi031 [v2:172.21.15.31:3300,v1:172.21.15.31:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T01:42:13.482 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = pacific 2024-09-17T01:42:13.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: set fsid to fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:13.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T01:42:13.482 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:42:13.482 INFO:teuthology.orchestra.run.smithi031.stdout:Creating mon... 2024-09-17T01:42:14.480 INFO:teuthology.orchestra.run.smithi031.stdout:create mon.smithi031 on 2024-09-17T01:42:14.704 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-17T01:42:14.857 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T01:42:15.044 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-fb7c6180-7495-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-fb7c6180-7495-11ef-bceb-c7b262605968.target. 2024-09-17T01:42:15.044 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-fb7c6180-7495-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-fb7c6180-7495-11ef-bceb-c7b262605968.target. 2024-09-17T01:42:15.289 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031 2024-09-17T01:42:15.289 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service: Unit ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service not loaded. 2024-09-17T01:42:15.461 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-fb7c6180-7495-11ef-bceb-c7b262605968.target.wants/ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service → /etc/systemd/system/ceph-fb7c6180-7495-11ef-bceb-c7b262605968@.service. 2024-09-17T01:42:16.004 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:42:16.004 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-09-17T01:42:16.011 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:42:16.011 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-09-17T01:42:16.011 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-09-17T01:42:16.011 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T01:42:16.011 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mon to start... 2024-09-17T01:42:16.012 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mon... 2024-09-17T01:42:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout id: fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout services: 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi031 (age 1.05388s) 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout data: 2024-09-17T01:42:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.924+0000 7fe900281700 1 Processor -- start 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.924+0000 7fe900281700 1 -- start start 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe900281700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f8105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe900281700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81064c0 con 0x7fe8f8105b70 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe8fe01d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f8105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe8fe01d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f8105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32808/0 (socket says 172.21.15.31:32808) 2024-09-17T01:42:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe8fe01d700 1 -- 172.21.15.31:0/3741741170 learned_addr learned my addr 172.21.15.31:0/3741741170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe8fe01d700 1 -- 172.21.15.31:0/3741741170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8106600 con 0x7fe8f8105b70 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.925+0000 7fe8fe01d700 1 --2- 172.21.15.31:0/3741741170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f8105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40098a0 tx=0x7fe8f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88b2e88110edc64 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe8fd01b700 1 -- 172.21.15.31:0/3741741170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f4004180 con 0x7fe8f8105b70 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe8fd01b700 1 -- 172.21.15.31:0/3741741170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f40042e0 con 0x7fe8f8105b70 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe8fd01b700 1 -- 172.21.15.31:0/3741741170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f40036a0 con 0x7fe8f8105b70 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 -- 172.21.15.31:0/3741741170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 msgr2=0x7fe8f8105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 --2- 172.21.15.31:0/3741741170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f8105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40098a0 tx=0x7fe8f4009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 -- 172.21.15.31:0/3741741170 shutdown_connections 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 --2- 172.21.15.31:0/3741741170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f8105f80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 -- 172.21.15.31:0/3741741170 >> 172.21.15.31:0/3741741170 conn(0x7fe8f8101220 msgr2=0x7fe8f8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 -- 172.21.15.31:0/3741741170 shutdown_connections 2024-09-17T01:42:17.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.926+0000 7fe900281700 1 -- 172.21.15.31:0/3741741170 wait complete. 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe900281700 1 Processor -- start 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe900281700 1 -- start start 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe900281700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe900281700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f819b7e0 con 0x7fe8f8105b70 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe8fe01d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe8fe01d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f819b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32812/0 (socket says 172.21.15.31:32812) 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.927+0000 7fe8fe01d700 1 -- 172.21.15.31:0/1404403035 learned_addr learned my addr 172.21.15.31:0/1404403035 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe8fe01d700 1 -- 172.21.15.31:0/1404403035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f4009550 con 0x7fe8f8105b70 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe8fe01d700 1 --2- 172.21.15.31:0/1404403035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f819b2a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe8f81068a0 tx=0x7fe8f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f4003ce0 con 0x7fe8f8105b70 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f4020070 con 0x7fe8f8105b70 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f819b9e0 con 0x7fe8f8105b70 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8f4011630 con 0x7fe8f8105b70 2024-09-17T01:42:17.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f819be00 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.928+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe8f4022030 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.929+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe8f4025d10 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.929+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f8062380 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:16.932+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe8f4025480 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.006+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fe8f819e930 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.007+0000 7fe8ef7fe700 1 -- 172.21.15.31:0/1404403035 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7fe8f4036070 con 0x7fe8f8105b70 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.007+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 msgr2=0x7fe8f819b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.007+0000 7fe900281700 1 --2- 172.21.15.31:0/1404403035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f819b2a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe8f81068a0 tx=0x7fe8f4004750 comp rx=0 tx=0).stop 2024-09-17T01:42:17.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.007+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 shutdown_connections 2024-09-17T01:42:17.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.007+0000 7fe900281700 1 --2- 172.21.15.31:0/1404403035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f8105b70 0x7fe8f819b2a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.007+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 >> 172.21.15.31:0/1404403035 conn(0x7fe8f8101220 msgr2=0x7fe8f807a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:17.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.008+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 shutdown_connections 2024-09-17T01:42:17.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.008+0000 7fe900281700 1 -- 172.21.15.31:0/1404403035 wait complete. 2024-09-17T01:42:17.545 INFO:teuthology.orchestra.run.smithi031.stdout:mon is available 2024-09-17T01:42:17.545 INFO:teuthology.orchestra.run.smithi031.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T01:42:19.629 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout fsid = fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.31:3300,v1:172.21.15.31:6789] 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T01:42:19.630 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.938+0000 7f26280d3700 1 Processor -- start 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.938+0000 7f26280d3700 1 -- start start 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f26280d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f2620108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f26280d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26200744a0 con 0x7f2620106690 2024-09-17T01:42:19.631 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2625e6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f2620108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2625e6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f2620108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32820/0 (socket says 172.21.15.31:32820) 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2625e6f700 1 -- 172.21.15.31:0/3646831836 learned_addr learned my addr 172.21.15.31:0/3646831836 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2625e6f700 1 -- 172.21.15.31:0/3646831836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200745e0 con 0x7f2620106690 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2625e6f700 1 --2- 172.21.15.31:0/3646831836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f2620108a70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f261c0098a0 tx=0x7f261c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2880c27199204f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2624e6d700 1 -- 172.21.15.31:0/3646831836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f261c004180 con 0x7f2620106690 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2624e6d700 1 -- 172.21.15.31:0/3646831836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c0042e0 con 0x7f2620106690 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.939+0000 7f2624e6d700 1 -- 172.21.15.31:0/3646831836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f261c0036a0 con 0x7f2620106690 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 -- 172.21.15.31:0/3646831836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 msgr2=0x7f2620108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 --2- 172.21.15.31:0/3646831836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f2620108a70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f261c0098a0 tx=0x7f261c009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 -- 172.21.15.31:0/3646831836 shutdown_connections 2024-09-17T01:42:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 --2- 172.21.15.31:0/3646831836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f2620108a70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 -- 172.21.15.31:0/3646831836 >> 172.21.15.31:0/3646831836 conn(0x7f2620100110 msgr2=0x7f2620102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 -- 172.21.15.31:0/3646831836 shutdown_connections 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.940+0000 7f26280d3700 1 -- 172.21.15.31:0/3646831836 wait complete. 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f26280d3700 1 Processor -- start 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f26280d3700 1 -- start start 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f26280d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f26201990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f26280d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2620199620 con 0x7f2620106690 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f2625e6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f26201990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f2625e6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f26201990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32832/0 (socket says 172.21.15.31:32832) 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f2625e6f700 1 -- 172.21.15.31:0/2882351319 learned_addr learned my addr 172.21.15.31:0/2882351319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f2625e6f700 1 -- 172.21.15.31:0/2882351319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009550 con 0x7f2620106690 2024-09-17T01:42:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f2625e6f700 1 --2- 172.21.15.31:0/2882351319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f26201990e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f261c004000 tx=0x7f261c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.941+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f261c003ce0 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.942+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c020070 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.942+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f261c011630 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.942+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2620199820 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.942+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2620199c40 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.942+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f261c022030 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.942+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f261c025d40 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.943+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2620192e60 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:17.945+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f261c025480 con 0x7f2620106690 2024-09-17T01:42:19.634 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.016+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f262002ce60 con 0x7f2620106690 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.019+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f261c011c20 con 0x7f2620106690 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.019+0000 7f2616ffd700 1 -- 172.21.15.31:0/2882351319 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f261c0375d0 con 0x7f2620106690 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 msgr2=0x7f26201990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 --2- 172.21.15.31:0/2882351319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f26201990e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f261c004000 tx=0x7f261c004750 comp rx=0 tx=0).stop 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 shutdown_connections 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 --2- 172.21.15.31:0/2882351319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2620106690 0x7f26201990e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 >> 172.21.15.31:0/2882351319 conn(0x7f2620100110 msgr2=0x7f2620101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 shutdown_connections 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:18.021+0000 7f26280d3700 1 -- 172.21.15.31:0/2882351319 wait complete. 2024-09-17T01:42:19.635 INFO:teuthology.orchestra.run.smithi031.stdout:Generating new minimal ceph.conf... 2024-09-17T01:42:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:20 smithi031 ceph-mon[27309]: from='client.? 172.21.15.31:0/2281759162' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:20.731 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.056+0000 7f7a53901700 1 Processor -- start 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.056+0000 7f7a53901700 1 -- start start 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.056+0000 7f7a53901700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a53901700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0744a0 con 0x7f7a4c106690 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a5169d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a5169d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32844/0 (socket says 172.21.15.31:32844) 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a5169d700 1 -- 172.21.15.31:0/1044146507 learned_addr learned my addr 172.21.15.31:0/1044146507 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a5169d700 1 -- 172.21.15.31:0/1044146507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0745e0 con 0x7f7a4c106690 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a5169d700 1 --2- 172.21.15.31:0/1044146507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c108a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009e80 tx=0x7f7a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f7c3ce0cd2b569 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a4bfff700 1 -- 172.21.15.31:0/1044146507 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a3c00e070 con 0x7f7a4c106690 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a4bfff700 1 -- 172.21.15.31:0/1044146507 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7a3c003e90 con 0x7f7a4c106690 2024-09-17T01:42:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.057+0000 7f7a4bfff700 1 -- 172.21.15.31:0/1044146507 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a3c004380 con 0x7f7a4c106690 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 -- 172.21.15.31:0/1044146507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 msgr2=0x7f7a4c108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 --2- 172.21.15.31:0/1044146507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c108a70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009e80 tx=0x7f7a3c00b330 comp rx=0 tx=0).stop 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 -- 172.21.15.31:0/1044146507 shutdown_connections 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 --2- 172.21.15.31:0/1044146507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c108a70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 -- 172.21.15.31:0/1044146507 >> 172.21.15.31:0/1044146507 conn(0x7f7a4c100110 msgr2=0x7f7a4c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 -- 172.21.15.31:0/1044146507 shutdown_connections 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.058+0000 7f7a53901700 1 -- 172.21.15.31:0/1044146507 wait complete. 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a53901700 1 Processor -- start 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a53901700 1 -- start start 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a53901700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c105ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a53901700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c106530 con 0x7f7a4c106690 2024-09-17T01:42:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a5169d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c105ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a5169d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c105ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32852/0 (socket says 172.21.15.31:32852) 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a5169d700 1 -- 172.21.15.31:0/2281759162 learned_addr learned my addr 172.21.15.31:0/2281759162 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a5169d700 1 -- 172.21.15.31:0/2281759162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009b30 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.059+0000 7f7a5169d700 1 --2- 172.21.15.31:0/2281759162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c105ff0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009530 tx=0x7f7a3c004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a3c00e040 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7a3c003c30 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c104640 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a3c01b740 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c104ac0 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a3c019040 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.060+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7a3c01a6d0 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.061+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c109c00 con 0x7f7a4c106690 2024-09-17T01:42:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.063+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7a3c029060 con 0x7f7a4c106690 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.135+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7a4c109e20 con 0x7f7a4c106690 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.135+0000 7f7a4a7fc700 1 -- 172.21.15.31:0/2281759162 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f7a3c01f070 con 0x7f7a4c106690 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 msgr2=0x7f7a4c105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 --2- 172.21.15.31:0/2281759162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c105ff0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009530 tx=0x7f7a3c004920 comp rx=0 tx=0).stop 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 shutdown_connections 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 --2- 172.21.15.31:0/2281759162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4c106690 0x7f7a4c105ff0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 >> 172.21.15.31:0/2281759162 conn(0x7f7a4c100110 msgr2=0x7f7a4c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 shutdown_connections 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:20.136+0000 7f7a53901700 1 -- 172.21.15.31:0/2281759162 wait complete. 2024-09-17T01:42:20.735 INFO:teuthology.orchestra.run.smithi031.stdout:Restarting the monitor... 2024-09-17T01:42:21.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:20 smithi031 systemd[1]: Stopping Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:42:21.370 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[27305]: 2024-09-17T01:42:21.030+0000 7f2b7622f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi031 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:42:21.370 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[27305]: 2024-09-17T01:42:21.030+0000 7f2b7622f700 -1 mon.smithi031@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T01:42:21.370 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 podman[27553]: 2024-09-17 01:42:21.102852571 +0000 UTC m=+0.209888100 container died e0dfc62046558c137b2bf0d99b47413e81a2451f67b5e13b23e23903451b51bc (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, RELEASE=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:42:21.713 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 podman[27553]: 2024-09-17 01:42:21.455794597 +0000 UTC m=+0.562830127 container cleanup e0dfc62046558c137b2bf0d99b47413e81a2451f67b5e13b23e23903451b51bc (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=HEAD, ceph=True, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2024-09-17T01:42:21.713 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 bash[27553]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031 2024-09-17T01:42:22.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 podman[27567]: 2024-09-17 01:42:21.715392703 +0000 UTC m=+0.611196405 container remove e0dfc62046558c137b2bf0d99b47413e81a2451f67b5e13b23e23903451b51bc (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-17T01:42:22.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service: Deactivated successfully. 2024-09-17T01:42:22.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 systemd[1]: Stopped Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:42:22.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:21 smithi031 systemd[1]: Starting Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:42:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 podman[27655]: 2024-09-17 01:42:22.121201746 +0000 UTC m=+0.133807843 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-17T01:42:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 podman[27655]: 2024-09-17 01:42:22.51658768 +0000 UTC m=+0.529193836 container create ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0) 2024-09-17T01:42:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 podman[27655]: 2024-09-17 01:42:22.735415637 +0000 UTC m=+0.748021734 container init ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T01:42:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 podman[27655]: 2024-09-17 01:42:22.738924245 +0000 UTC m=+0.751530335 container start ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, RELEASE=HEAD, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212) 2024-09-17T01:42:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:42:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-17T01:42:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: pidfile_write: ignore empty --pid-file 2024-09-17T01:42:22.804 INFO:teuthology.orchestra.run.smithi031.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T01:42:23.029 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: load: jerasure load: lrc 2024-09-17T01:42:23.029 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Git sha 0 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: DB SUMMARY 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: DB Session ID: ZWBACDK5YC1UMXG4FS8A 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi031/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi031/store.db: 000009.log size: 99569 ; 2024-09-17T01:42:23.030 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.env: 0x55d8b929d720 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:42:23.031 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.info_log: 0x55d8bb47f2c0 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.statistics: (nil) 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.use_fsync: 0 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:42:23.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.db_log_dir: 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.wal_dir: 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:42:23.033 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.write_buffer_manager: 0x55d8ba70e5a0 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:42:23.034 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.unordered_write: 0 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.row_cache: None 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.wal_filter: None 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:42:23.035 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.wal_compression: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:42:23.036 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:42:23.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:42:23.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:42:23.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:42:23.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:42:23.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:42:23.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:42:23.038 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:42:23.038 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_open_files: -1 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:42:23.039 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Compression algorithms supported: 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kZSTD supported: 0 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:42:23.040 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi031/store.db/MANIFEST-000010 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.merge_operator: 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_filter: None 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d8bb47f3c0) 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:42:23.041 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: index_type: 0 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: data_block_index_type: 0 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: index_shortening: 1 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: checksum: 4 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: no_block_cache: 0 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache: 0x55d8ba7911f0 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:42:23.042 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache_options: 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: capacity : 536870912 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: num_shard_bits : 4 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: strict_capacity_limit : 0 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache_compressed: (nil) 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: persistent_cache: (nil) 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_size: 4096 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_size_deviation: 10 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_restart_interval: 16 2024-09-17T01:42:23.043 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: index_block_restart_interval: 1 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: metadata_block_size: 4096 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: partition_filters: 0 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: use_delta_encoding: 1 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: filter_policy: bloomfilter 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: whole_key_filtering: 1 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: verify_compression: 0 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: format_version: 5 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: enable_index_compression: 1 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_align: 0 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: max_auto_readahead_size: 262144 2024-09-17T01:42:23.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: prepopulate_block_cache: 0 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression: NoCompression 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.num_levels: 7 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:42:23.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:42:23.046 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:42:23.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:42:23.048 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:42:23.049 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.table_properties_collectors: 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:42:23.050 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.ttl: 2592000 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:42:23.051 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi031/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 33e40c68-552c-40ca-aa10-0d17c7dd0ada 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537342769614, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537342770719, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94423, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 331, "table_properties": {"data_size": 92429, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13747, "raw_average_key_size": 49, "raw_value_size": 84898, "raw_average_value_size": 305, "num_data_blocks": 11, "num_entries": 278, "num_filter_entries": 278, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726537342, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "33e40c68-552c-40ca-aa10-0d17c7dd0ada", "db_session_id": "ZWBACDK5YC1UMXG4FS8A", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537342770783, "job": 1, "event": "recovery_finished"} 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi031/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:42:23.052 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d8ba82e000 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: DB pointer 0x55d8ba81a000 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** DB Stats ** 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:42:23.053 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** Compaction Stats [default] ** 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: L0 2/0 94.08 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Sum 2/0 94.08 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** Compaction Stats [default] ** 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:42:23.054 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative compaction: 0.00 GB write, 26.95 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval compaction: 0.00 GB write, 26.95 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:42:23.055 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Block cache BinnedLRUCache@0x55d8ba7911f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: starting mon.smithi031 rank 0 at public addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] at bind addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi031 fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???) e1 preinit fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).mds e1 new map 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).mds e1 print_map 2024-09-17T01:42:23.056 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: e1 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: legacy client fscid: -1 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: No filesystems configured 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 bash[27655]: ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 systemd[1]: Started Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mon.smithi031 is new leader, mons smithi031 in quorum (ranks 0) 2024-09-17T01:42:23.057 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: monmap e1: 1 mons at {smithi031=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0]} removed_ranks: {} 2024-09-17T01:42:23.058 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: fsmap 2024-09-17T01:42:23.058 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T01:42:23.058 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:22 smithi031 ceph-mon[27673]: mgrmap e1: no daemons active 2024-09-17T01:42:24.039 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4cae6a700 1 Processor -- start 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4cae6a700 1 -- start start 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4cae6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4cae6a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41064f0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4c8c06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4c8c06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32860/0 (socket says 172.21.15.31:32860) 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4c8c06700 1 -- 172.21.15.31:0/3967611031 learned_addr learned my addr 172.21.15.31:0/3967611031 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.228+0000 7ff4c8c06700 1 -- 172.21.15.31:0/3967611031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4106630 con 0x7ff4c4105ba0 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4c8c06700 1 --2- 172.21.15.31:0/3967611031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4105fb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098a0 tx=0x7ff4b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef576e4b6cba4bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4c37fe700 1 -- 172.21.15.31:0/3967611031 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4b8004180 con 0x7ff4c4105ba0 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4c37fe700 1 -- 172.21.15.31:0/3967611031 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff4b80042e0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4c37fe700 1 -- 172.21.15.31:0/3967611031 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4b8011a50 con 0x7ff4c4105ba0 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 -- 172.21.15.31:0/3967611031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 msgr2=0x7ff4c4105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 --2- 172.21.15.31:0/3967611031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4105fb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098a0 tx=0x7ff4b8009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 -- 172.21.15.31:0/3967611031 shutdown_connections 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 --2- 172.21.15.31:0/3967611031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4105fb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 -- 172.21.15.31:0/3967611031 >> 172.21.15.31:0/3967611031 conn(0x7ff4c4101250 msgr2=0x7ff4c4103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 -- 172.21.15.31:0/3967611031 shutdown_connections 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.229+0000 7ff4cae6a700 1 -- 172.21.15.31:0/3967611031 wait complete. 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.230+0000 7ff4cae6a700 1 Processor -- start 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.230+0000 7ff4cae6a700 1 -- start start 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.230+0000 7ff4cae6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.230+0000 7ff4cae6a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4199da0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c8c06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c8c06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32864/0 (socket says 172.21.15.31:32864) 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c8c06700 1 -- 172.21.15.31:0/191648182 learned_addr learned my addr 172.21.15.31:0/191648182 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c8c06700 1 -- 172.21.15.31:0/191648182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8009550 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c8c06700 1 --2- 172.21.15.31:0/191648182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4199860 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8000c00 tx=0x7ff4b8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4b8003b90 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff4b80248b0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4b801a8e0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4199fa0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.231+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c419a3c0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.232+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff4b802d3f0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.232+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff4b80194a0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.232+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c4062380 con 0x7ff4c4105ba0 2024-09-17T01:42:24.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.235+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff4b8024db0 con 0x7ff4c4105ba0 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.306+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7ff4c4107a10 con 0x7ff4c4105ba0 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.311+0000 7ff4c1ffb700 1 -- 172.21.15.31:0/191648182 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff4b8024a20 con 0x7ff4c4105ba0 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 msgr2=0x7ff4c4199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 --2- 172.21.15.31:0/191648182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4199860 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8000c00 tx=0x7ff4b8011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 shutdown_connections 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 --2- 172.21.15.31:0/191648182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c4105ba0 0x7ff4c4199860 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 >> 172.21.15.31:0/191648182 conn(0x7ff4c4101250 msgr2=0x7ff4c4102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 shutdown_connections 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:23.312+0000 7ff4cae6a700 1 -- 172.21.15.31:0/191648182 wait complete. 2024-09-17T01:42:24.043 INFO:teuthology.orchestra.run.smithi031.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T01:42:24.064 INFO:teuthology.orchestra.run.smithi031.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:42:24.064 INFO:teuthology.orchestra.run.smithi031.stdout:Creating mgr... 2024-09-17T01:42:24.065 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T01:42:24.065 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T01:42:24.065 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mgr.smithi031.ealpiz 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mgr.smithi031.ealpiz.service: Unit ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mgr.smithi031.ealpiz.service not loaded. 2024-09-17T01:42:24.470 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-fb7c6180-7495-11ef-bceb-c7b262605968.target.wants/ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mgr.smithi031.ealpiz.service → /etc/systemd/system/ceph-fb7c6180-7495-11ef-bceb-c7b262605968@.service. 2024-09-17T01:42:24.702 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:24 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/191648182' entity='client.admin' 2024-09-17T01:42:24.994 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:42:24.994 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-09-17T01:42:25.002 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:42:25.002 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-09-17T01:42:25.003 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-09-17T01:42:25.003 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T01:42:25.013 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:42:25.013 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-09-17T01:42:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:42:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-09-17T01:42:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-09-17T01:42:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-17T01:42:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr to start... 2024-09-17T01:42:25.022 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr... 2024-09-17T01:42:25.834 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:25 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1937647775' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:42:26.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:26.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "fb7c6180-7495-11ef-bceb-c7b262605968", 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "smithi031" 2024-09-17T01:42:26.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:42:26.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:42:26.109 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:42:26.109 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:42:26.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:42:26.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:42:26.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:42:26.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:42:26.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T01:42:26.118 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:42:15.955566+0000", 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7dac2fe700 1 Processor -- start 2024-09-17T01:42:26.120 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7dac2fe700 1 -- start start 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7dac2fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da41042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7dac2fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da41047f0 con 0x7f7da4103ea0 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7daa09a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da41042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7daa09a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da41042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51198/0 (socket says 172.21.15.31:51198) 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.455+0000 7f7daa09a700 1 -- 172.21.15.31:0/1506541841 learned_addr learned my addr 172.21.15.31:0/1506541841 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.456+0000 7f7daa09a700 1 -- 172.21.15.31:0/1506541841 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4104930 con 0x7f7da4103ea0 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.456+0000 7f7daa09a700 1 --2- 172.21.15.31:0/1506541841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da41042b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098a0 tx=0x7f7da0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194cf1b9aff0695f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:26.121 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.456+0000 7f7da9098700 1 -- 172.21.15.31:0/1506541841 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7da0004180 con 0x7f7da4103ea0 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.456+0000 7f7da9098700 1 -- 172.21.15.31:0/1506541841 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7da00042e0 con 0x7f7da4103ea0 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.456+0000 7f7da9098700 1 -- 172.21.15.31:0/1506541841 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7da0011a50 con 0x7f7da4103ea0 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1506541841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 msgr2=0x7f7da41042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 --2- 172.21.15.31:0/1506541841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da41042b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098a0 tx=0x7f7da0009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1506541841 shutdown_connections 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 --2- 172.21.15.31:0/1506541841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da41042b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.122 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1506541841 >> 172.21.15.31:0/1506541841 conn(0x7f7da40ff880 msgr2=0x7f7da4101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1506541841 shutdown_connections 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.457+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1506541841 wait complete. 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7dac2fe700 1 Processor -- start 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7dac2fe700 1 -- start start 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7dac2fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7dac2fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4199e40 con 0x7f7da4103ea0 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7daa09a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7daa09a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da4199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51214/0 (socket says 172.21.15.31:51214) 2024-09-17T01:42:26.123 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.458+0000 7f7daa09a700 1 -- 172.21.15.31:0/1937647775 learned_addr learned my addr 172.21.15.31:0/1937647775 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7daa09a700 1 -- 172.21.15.31:0/1937647775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009550 con 0x7f7da4103ea0 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7daa09a700 1 --2- 172.21.15.31:0/1937647775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da4199900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7da0000c00 tx=0x7f7da0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7da0003b90 con 0x7f7da4103ea0 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7da00248b0 con 0x7f7da4103ea0 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da419a040 con 0x7f7da4103ea0 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7da001a8e0 con 0x7f7da4103ea0 2024-09-17T01:42:26.124 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da419a460 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7da002d3f0 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.459+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7da0019400 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.460+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da4062380 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.462+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7da0024a20 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.537+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7da419cf90 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.537+0000 7f7d9b7fe700 1 -- 172.21.15.31:0/1937647775 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f7da0035090 con 0x7f7da4103ea0 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 msgr2=0x7f7da4199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:26.125 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 --2- 172.21.15.31:0/1937647775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da4199900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7da0000c00 tx=0x7f7da0011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.126 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 shutdown_connections 2024-09-17T01:42:26.126 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 --2- 172.21.15.31:0/1937647775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7da4103ea0 0x7f7da4199900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.126 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 >> 172.21.15.31:0/1937647775 conn(0x7f7da40ff880 msgr2=0x7f7da4100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:26.126 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 shutdown_connections 2024-09-17T01:42:26.126 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:25.538+0000 7f7dac2fe700 1 -- 172.21.15.31:0/1937647775 wait complete. 2024-09-17T01:42:26.126 INFO:teuthology.orchestra.run.smithi031.stdout:mgr not available, waiting (1/15)... 2024-09-17T01:42:29.113 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:28 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/580010244' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:42:29.345 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "fb7c6180-7495-11ef-bceb-c7b262605968", 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:42:29.346 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "smithi031" 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:42:29.347 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:42:29.355 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.356 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:29.357 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:42:15.955566+0000", 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.532+0000 7f7e85f30700 1 Processor -- start 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.532+0000 7f7e85f30700 1 -- start start 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e85f30700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e80108760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e85f30700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80108ca0 con 0x7f7e800743e0 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e80108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e80108760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51226/0 (socket says 172.21.15.31:51226) 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e7f7fe700 1 -- 172.21.15.31:0/3124918952 learned_addr learned my addr 172.21.15.31:0/3124918952 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e7f7fe700 1 -- 172.21.15.31:0/3124918952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80108de0 con 0x7f7e800743e0 2024-09-17T01:42:29.358 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.533+0000 7f7e7f7fe700 1 --2- 172.21.15.31:0/3124918952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e80108760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7e700098a0 tx=0x7f7e70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4bf596a0a2a9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e7effd700 1 -- 172.21.15.31:0/3124918952 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e70004180 con 0x7f7e800743e0 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e7effd700 1 -- 172.21.15.31:0/3124918952 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7e700042e0 con 0x7f7e800743e0 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e7effd700 1 -- 172.21.15.31:0/3124918952 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e70011a50 con 0x7f7e800743e0 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 -- 172.21.15.31:0/3124918952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 msgr2=0x7f7e80108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 --2- 172.21.15.31:0/3124918952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e80108760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7e700098a0 tx=0x7f7e70009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 -- 172.21.15.31:0/3124918952 shutdown_connections 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 --2- 172.21.15.31:0/3124918952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e80108760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 -- 172.21.15.31:0/3124918952 >> 172.21.15.31:0/3124918952 conn(0x7f7e80100110 msgr2=0x7f7e80102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 -- 172.21.15.31:0/3124918952 shutdown_connections 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.534+0000 7f7e85f30700 1 -- 172.21.15.31:0/3124918952 wait complete. 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e85f30700 1 Processor -- start 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e85f30700 1 -- start start 2024-09-17T01:42:29.359 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e85f30700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e801060b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e85f30700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801065f0 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e801060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e801060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51228/0 (socket says 172.21.15.31:51228) 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.535+0000 7f7e7f7fe700 1 -- 172.21.15.31:0/580010244 learned_addr learned my addr 172.21.15.31:0/580010244 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7f7fe700 1 -- 172.21.15.31:0/580010244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70009550 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7f7fe700 1 --2- 172.21.15.31:0/580010244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e801060b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e70011a00 tx=0x7f7e70011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e70003970 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7e70003ad0 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e70024800 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e80104700 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80104b20 con 0x7f7e800743e0 2024-09-17T01:42:29.360 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e7002d3f0 con 0x7f7e800743e0 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.536+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7e700193c0 con 0x7f7e800743e0 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.537+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e800623f0 con 0x7f7e800743e0 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.540+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7e800623f0 con 0x7f7e800743e0 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.615+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7e80104e20 con 0x7f7e800743e0 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.615+0000 7f7e7d7fa700 1 -- 172.21.15.31:0/580010244 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f7e7001aba0 con 0x7f7e800743e0 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.616+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 msgr2=0x7f7e801060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.616+0000 7f7e85f30700 1 --2- 172.21.15.31:0/580010244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e801060b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e70011a00 tx=0x7f7e70011ae0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.617+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 shutdown_connections 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.617+0000 7f7e85f30700 1 --2- 172.21.15.31:0/580010244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e800743e0 0x7f7e801060b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.617+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 >> 172.21.15.31:0/580010244 conn(0x7f7e80100110 msgr2=0x7f7e80101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.617+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 shutdown_connections 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:28.617+0000 7f7e85f30700 1 -- 172.21.15.31:0/580010244 wait complete. 2024-09-17T01:42:29.361 INFO:teuthology.orchestra.run.smithi031.stdout:mgr not available, waiting (2/15)... 2024-09-17T01:42:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/201159177' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:42:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: Activating manager daemon smithi031.ealpiz 2024-09-17T01:42:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: mgrmap e2: smithi031.ealpiz(active, starting, since 0.00317645s) 2024-09-17T01:42:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:42:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:42:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:42:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:42:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:42:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:31 smithi031 ceph-mon[27673]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "fb7c6180-7495-11ef-bceb-c7b262605968", 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:42:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "smithi031" 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:42:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:42:32.479 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:42:32.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T01:42:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:42:32.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:42:15.955566+0000", 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d6bd4700 1 Processor -- start 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d6bd4700 1 -- start start 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d6bd4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d0104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d6bd4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01053d0 con 0x7f84d0104a80 2024-09-17T01:42:32.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d4970700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d0104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d4970700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d0104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51244/0 (socket says 172.21.15.31:51244) 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d4970700 1 -- 172.21.15.31:0/51266068 learned_addr learned my addr 172.21.15.31:0/51266068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d4970700 1 -- 172.21.15.31:0/51266068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d0105510 con 0x7f84d0104a80 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.774+0000 7f84d4970700 1 --2- 172.21.15.31:0/51266068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d0104e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84c400bb40 tx=0x7f84c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9defba125385ae65 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84cf7fe700 1 -- 172.21.15.31:0/51266068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c400dc00 con 0x7f84d0104a80 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84cf7fe700 1 -- 172.21.15.31:0/51266068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f84c40044a0 con 0x7f84d0104a80 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84cf7fe700 1 -- 172.21.15.31:0/51266068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c4010470 con 0x7f84d0104a80 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 -- 172.21.15.31:0/51266068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 msgr2=0x7f84d0104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 --2- 172.21.15.31:0/51266068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d0104e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84c400bb40 tx=0x7f84c400be50 comp rx=0 tx=0).stop 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 -- 172.21.15.31:0/51266068 shutdown_connections 2024-09-17T01:42:32.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 --2- 172.21.15.31:0/51266068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d0104e90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 -- 172.21.15.31:0/51266068 >> 172.21.15.31:0/51266068 conn(0x7f84d0100110 msgr2=0x7f84d0102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 -- 172.21.15.31:0/51266068 shutdown_connections 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.775+0000 7f84d6bd4700 1 -- 172.21.15.31:0/51266068 wait complete. 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d6bd4700 1 Processor -- start 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d6bd4700 1 -- start start 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d6bd4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d01976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d6bd4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d0197c00 con 0x7f84d0104a80 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d4970700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d01976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d4970700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d01976c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51248/0 (socket says 172.21.15.31:51248) 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.776+0000 7f84d4970700 1 -- 172.21.15.31:0/201159177 learned_addr learned my addr 172.21.15.31:0/201159177 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:32.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84d4970700 1 -- 172.21.15.31:0/201159177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c400b7f0 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84d4970700 1 --2- 172.21.15.31:0/201159177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d01976c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f84c40046d0 tx=0x7f84c4003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c401e070 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d0197e00 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f84c4004260 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c40229c0 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d0198220 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84c402c740 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.777+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f84c4019980 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.778+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d01913b0 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.780+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f84c4027070 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.856+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f84d0062380 con 0x7f84d0104a80 2024-09-17T01:42:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.856+0000 7f84cdffb700 1 -- 172.21.15.31:0/201159177 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f84c4010de0 con 0x7f84d0104a80 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 msgr2=0x7f84d01976c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 --2- 172.21.15.31:0/201159177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d01976c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f84c40046d0 tx=0x7f84c4003d70 comp rx=0 tx=0).stop 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 shutdown_connections 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 --2- 172.21.15.31:0/201159177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d0104a80 0x7f84d01976c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 >> 172.21.15.31:0/201159177 conn(0x7f84d0100110 msgr2=0x7f84d018e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 shutdown_connections 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:31.857+0000 7f84d6bd4700 1 -- 172.21.15.31:0/201159177 wait complete. 2024-09-17T01:42:32.487 INFO:teuthology.orchestra.run.smithi031.stdout:mgr not available, waiting (3/15)... 2024-09-17T01:42:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:32 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:42:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:32 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:42:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:32 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:32 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:32 smithi031 ceph-mon[27673]: from='mgr.14100 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:32 smithi031 ceph-mon[27673]: mgrmap e3: smithi031.ealpiz(active, since 1.00706s) 2024-09-17T01:42:35.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:34 smithi031 ceph-mon[27673]: mgrmap e4: smithi031.ealpiz(active, since 2s) 2024-09-17T01:42:36.012 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:35 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1220000591' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "fb7c6180-7495-11ef-bceb-c7b262605968", 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:42:36.017 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "smithi031" 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:42:36.018 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:42:36.019 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:42:36.030 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:42:36.031 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.032 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:42:15.955566+0000", 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.099+0000 7f9bdd9f1700 1 Processor -- start 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.099+0000 7f9bdd9f1700 1 -- start start 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bdd9f1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd8108220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bdd9f1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8108760 con 0x7f9bd8107e10 2024-09-17T01:42:36.033 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd8108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd8108220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50316/0 (socket says 172.21.15.31:50316) 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd6ffd700 1 -- 172.21.15.31:0/3083992725 learned_addr learned my addr 172.21.15.31:0/3083992725 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd6ffd700 1 -- 172.21.15.31:0/3083992725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd81088a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd6ffd700 1 --2- 172.21.15.31:0/3083992725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd8108220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0098a0 tx=0x7f9bcc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e97c3f9216e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd5ffb700 1 -- 172.21.15.31:0/3083992725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bcc004180 con 0x7f9bd8107e10 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd5ffb700 1 -- 172.21.15.31:0/3083992725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9bcc0042e0 con 0x7f9bd8107e10 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.100+0000 7f9bd5ffb700 1 -- 172.21.15.31:0/3083992725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bcc011a50 con 0x7f9bd8107e10 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/3083992725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 msgr2=0x7f9bd8108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 --2- 172.21.15.31:0/3083992725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd8108220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0098a0 tx=0x7f9bcc009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/3083992725 shutdown_connections 2024-09-17T01:42:36.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 --2- 172.21.15.31:0/3083992725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd8108220 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/3083992725 >> 172.21.15.31:0/3083992725 conn(0x7f9bd807b210 msgr2=0x7f9bd807b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/3083992725 shutdown_connections 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/3083992725 wait complete. 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.101+0000 7f9bdd9f1700 1 Processor -- start 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bdd9f1700 1 -- start start 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bdd9f1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bdd9f1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd819c000 con 0x7f9bd8107e10 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bd6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bd6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50324/0 (socket says 172.21.15.31:50324) 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bd6ffd700 1 -- 172.21.15.31:0/1220000591 learned_addr learned my addr 172.21.15.31:0/1220000591 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:36.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bd6ffd700 1 -- 172.21.15.31:0/1220000591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc009550 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.102+0000 7f9bd6ffd700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd819bac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0119e0 tx=0x7f9bcc011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.103+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bcc003b90 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.103+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9bcc01a8a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.103+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd819c200 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.103+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bcc019930 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.103+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd819c620 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.103+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f9bcc019ba0 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.104+0000 7f9bdc9ef700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9bc00383b0 0x7f9bc003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.104+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd81088a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.104+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bcc04c4a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.036 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.104+0000 7f9bd67fc700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9bc00383b0 0x7f9bc003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.104+0000 7f9bd67fc700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9bc00383b0 0x7f9bc003a860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.109+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9bd81088a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.390+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9bd81088a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.391+0000 7f9bdc9ef700 1 -- 172.21.15.31:0/1220000591 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f9bd81088a0 con 0x7f9bd8107e10 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9bc00383b0 msgr2=0x7f9bc003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9bc00383b0 0x7f9bc003a860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 msgr2=0x7f9bd819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd819bac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0119e0 tx=0x7f9bcc011ac0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 shutdown_connections 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9bc00383b0 0x7f9bc003a860 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.037 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 --2- 172.21.15.31:0/1220000591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bd8107e10 0x7f9bd819bac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.038 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 >> 172.21.15.31:0/1220000591 conn(0x7f9bd807b210 msgr2=0x7f9bd81060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:36.038 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 shutdown_connections 2024-09-17T01:42:36.038 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:35.393+0000 7f9bdd9f1700 1 -- 172.21.15.31:0/1220000591 wait complete. 2024-09-17T01:42:36.038 INFO:teuthology.orchestra.run.smithi031.stdout:mgr is available 2024-09-17T01:42:36.976 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:36 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3288446453' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout fsid = fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T01:42:37.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.459+0000 7f91c7ffc700 1 Processor -- start 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.459+0000 7f91c7ffc700 1 -- start start 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.459+0000 7f91c7ffc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c0106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.459+0000 7f91c7ffc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0106590 con 0x7f91c0105c40 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c5d98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c0106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c5d98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c0106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50340/0 (socket says 172.21.15.31:50340) 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c5d98700 1 -- 172.21.15.31:0/418806623 learned_addr learned my addr 172.21.15.31:0/418806623 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c5d98700 1 -- 172.21.15.31:0/418806623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c01066d0 con 0x7f91c0105c40 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c5d98700 1 --2- 172.21.15.31:0/418806623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c0106050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009e80 tx=0x7f91bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3df149c862008e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c4d96700 1 -- 172.21.15.31:0/418806623 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91bc00e070 con 0x7f91c0105c40 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c4d96700 1 -- 172.21.15.31:0/418806623 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f91bc003e90 con 0x7f91c0105c40 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.460+0000 7f91c4d96700 1 -- 172.21.15.31:0/418806623 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91bc004380 con 0x7f91c0105c40 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 -- 172.21.15.31:0/418806623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 msgr2=0x7f91c0106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 --2- 172.21.15.31:0/418806623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c0106050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009e80 tx=0x7f91bc00b330 comp rx=0 tx=0).stop 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 -- 172.21.15.31:0/418806623 shutdown_connections 2024-09-17T01:42:37.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 --2- 172.21.15.31:0/418806623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c0106050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 -- 172.21.15.31:0/418806623 >> 172.21.15.31:0/418806623 conn(0x7f91c01012b0 msgr2=0x7f91c01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 -- 172.21.15.31:0/418806623 shutdown_connections 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.461+0000 7f91c7ffc700 1 -- 172.21.15.31:0/418806623 wait complete. 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c7ffc700 1 Processor -- start 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c7ffc700 1 -- start start 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c7ffc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c007bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c7ffc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c007c1b0 con 0x7f91c0105c40 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c5d98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c007bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c5d98700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c007bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50344/0 (socket says 172.21.15.31:50344) 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c5d98700 1 -- 172.21.15.31:0/3288446453 learned_addr learned my addr 172.21.15.31:0/3288446453 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c5d98700 1 -- 172.21.15.31:0/3288446453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc009b30 con 0x7f91c0105c40 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.462+0000 7f91c5d98700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c007bc70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00d010 tx=0x7f91bc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:37.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.463+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91bc00e040 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.463+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f91bc003c30 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.463+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c007a2c0 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.463+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91bc01b790 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.463+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c007a740 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.463+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f91bc019040 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.464+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c0062380 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.464+0000 7f91b6ffd700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f91ac038360 0x7f91ac03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.464+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f91bc04bfe0 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.464+0000 7f91c5597700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f91ac038360 0x7f91ac03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.464+0000 7f91c5597700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f91ac038360 0x7f91ac03a810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.469+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f91bc023d40 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.667+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f91c0107ab0 con 0x7f91c0105c40 2024-09-17T01:42:37.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.668+0000 7f91b6ffd700 1 -- 172.21.15.31:0/3288446453 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f91bc023b60 con 0x7f91c0105c40 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f91ac038360 msgr2=0x7f91ac03a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f91ac038360 0x7f91ac03a810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 msgr2=0x7f91c007bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c007bc70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00d010 tx=0x7f91bc004430 comp rx=0 tx=0).stop 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 shutdown_connections 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f91ac038360 0x7f91ac03a810 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 --2- 172.21.15.31:0/3288446453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91c0105c40 0x7f91c007bc70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 >> 172.21.15.31:0/3288446453 conn(0x7f91c01012b0 msgr2=0x7f91c0102070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 shutdown_connections 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:36.671+0000 7f91c7ffc700 1 -- 172.21.15.31:0/3288446453 wait complete. 2024-09-17T01:42:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:Enabling cephadm module... 2024-09-17T01:42:39.045 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:38 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1084181084' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f9199ad8700 1 Processor -- start 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f9199ad8700 1 -- start start 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f9199ad8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f9194105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f9199ad8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91941064c0 con 0x7f9194105b70 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f91937fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f9194105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f91937fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f9194105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50348/0 (socket says 172.21.15.31:50348) 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.696+0000 7f91937fe700 1 -- 172.21.15.31:0/720003853 learned_addr learned my addr 172.21.15.31:0/720003853 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:39.384 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.697+0000 7f91937fe700 1 -- 172.21.15.31:0/720003853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194106600 con 0x7f9194105b70 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.697+0000 7f91937fe700 1 --2- 172.21.15.31:0/720003853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f9194105f80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91840098a0 tx=0x7f9184009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde127719a489382 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.697+0000 7f91927fc700 1 -- 172.21.15.31:0/720003853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9184004180 con 0x7f9194105b70 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.697+0000 7f91927fc700 1 -- 172.21.15.31:0/720003853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f91840042e0 con 0x7f9194105b70 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.697+0000 7f91927fc700 1 -- 172.21.15.31:0/720003853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9184011a50 con 0x7f9194105b70 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 -- 172.21.15.31:0/720003853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 msgr2=0x7f9194105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 --2- 172.21.15.31:0/720003853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f9194105f80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91840098a0 tx=0x7f9184009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 -- 172.21.15.31:0/720003853 shutdown_connections 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 --2- 172.21.15.31:0/720003853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f9194105f80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 -- 172.21.15.31:0/720003853 >> 172.21.15.31:0/720003853 conn(0x7f9194101220 msgr2=0x7f9194103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 -- 172.21.15.31:0/720003853 shutdown_connections 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 -- 172.21.15.31:0/720003853 wait complete. 2024-09-17T01:42:39.385 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.698+0000 7f9199ad8700 1 Processor -- start 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f9199ad8700 1 -- start start 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f9199ad8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f91941998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f9199ad8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194199df0 con 0x7f9194105b70 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f91937fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f91941998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f91937fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f91941998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50358/0 (socket says 172.21.15.31:50358) 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f91937fe700 1 -- 172.21.15.31:0/1084181084 learned_addr learned my addr 172.21.15.31:0/1084181084 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f91937fe700 1 -- 172.21.15.31:0/1084181084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184009550 con 0x7f9194105b70 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f91937fe700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f91941998b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9184000c00 tx=0x7f9184011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.699+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9184003b90 con 0x7f9194105b70 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.700+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f91840248b0 con 0x7f9194105b70 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.700+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9194199ff0 con 0x7f9194105b70 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.700+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f918401a8e0 con 0x7f9194105b70 2024-09-17T01:42:39.386 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.700+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919419a410 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.701+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f918401ab50 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.701+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919410a000 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.701+0000 7f9190ff9700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f917c0383f0 0x7f917c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.701+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f918404c210 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.701+0000 7f9192ffd700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f917c0383f0 0x7f917c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.702+0000 7f9192ffd700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f917c0383f0 0x7f917c03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9188006fd0 tx=0x7f9188006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.706+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f918401ae00 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:37.966+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f91940623d0 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.783+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f918404e130 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.784+0000 7f9190ff9700 1 -- 172.21.15.31:0/1084181084 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f9184024db0 con 0x7f9194105b70 2024-09-17T01:42:39.387 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f917c0383f0 msgr2=0x7f917c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f917c0383f0 0x7f917c03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9188006fd0 tx=0x7f9188006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 msgr2=0x7f91941998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f91941998b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9184000c00 tx=0x7f9184011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 shutdown_connections 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f917c0383f0 0x7f917c03a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 --2- 172.21.15.31:0/1084181084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9194105b70 0x7f91941998b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.787+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 >> 172.21.15.31:0/1084181084 conn(0x7f9194101220 msgr2=0x7f9194101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.788+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 shutdown_connections 2024-09-17T01:42:39.388 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:38.788+0000 7f9199ad8700 1 -- 172.21.15.31:0/1084181084 wait complete. 2024-09-17T01:42:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:39 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1084181084' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T01:42:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:39 smithi031 ceph-mon[27673]: mgrmap e5: smithi031.ealpiz(active, since 6s) 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "active_name": "smithi031.ealpiz", 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.819+0000 7f54d1d8b700 1 Processor -- start 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.819+0000 7f54d1d8b700 1 -- start start 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.819+0000 7f54d1d8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.819+0000 7f54d1d8b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc106590 con 0x7f54cc105c40 2024-09-17T01:42:40.667 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50402/0 (socket says 172.21.15.31:50402) 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54cb7fe700 1 -- 172.21.15.31:0/1076180484 learned_addr learned my addr 172.21.15.31:0/1076180484 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54cb7fe700 1 -- 172.21.15.31:0/1076180484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc1066d0 con 0x7f54cc105c40 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54cb7fe700 1 --2- 172.21.15.31:0/1076180484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc106050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0098a0 tx=0x7f54bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ea51627b623f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54ca7fc700 1 -- 172.21.15.31:0/1076180484 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54bc004180 con 0x7f54cc105c40 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54ca7fc700 1 -- 172.21.15.31:0/1076180484 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f54bc0042e0 con 0x7f54cc105c40 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.820+0000 7f54ca7fc700 1 -- 172.21.15.31:0/1076180484 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54bc011a50 con 0x7f54cc105c40 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1076180484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 msgr2=0x7f54cc106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 --2- 172.21.15.31:0/1076180484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc106050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0098a0 tx=0x7f54bc009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1076180484 shutdown_connections 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 --2- 172.21.15.31:0/1076180484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc106050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.668 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1076180484 >> 172.21.15.31:0/1076180484 conn(0x7f54cc1012b0 msgr2=0x7f54cc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1076180484 shutdown_connections 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1076180484 wait complete. 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.821+0000 7f54d1d8b700 1 Processor -- start 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54d1d8b700 1 -- start start 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54d1d8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc07bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54d1d8b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc07c1b0 con 0x7f54cc105c40 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc07bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc07bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50416/0 (socket says 172.21.15.31:50416) 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54cb7fe700 1 -- 172.21.15.31:0/1477899370 learned_addr learned my addr 172.21.15.31:0/1477899370 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54cb7fe700 1 -- 172.21.15.31:0/1477899370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc009550 con 0x7f54cc105c40 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54cb7fe700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc07bc70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54bc003de0 tx=0x7f54bc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.669 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.822+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54bc003930 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.823+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f54bc003a90 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.823+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc07a2c0 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.823+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54bc019730 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.823+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc07a6e0 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.823+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f54bc019a30 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.824+0000 7f54c8ff9700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 0x7f54b803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.824+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f54bc04d0c0 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.824+0000 7f54caffd700 1 -- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 msgr2=0x7f54b803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.824+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc062380 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.824+0000 7f54caffd700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 0x7f54b803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:39.829+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f54bc023370 con 0x7f54cc105c40 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.025+0000 7f54caffd700 1 -- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 msgr2=0x7f54b803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:40.670 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.025+0000 7f54caffd700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 0x7f54b803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.085+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f54cc07b0c0 con 0x7f54cc105c40 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.086+0000 7f54c8ff9700 1 -- 172.21.15.31:0/1477899370 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f54bc018350 con 0x7f54cc105c40 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 msgr2=0x7f54b803a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 0x7f54b803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 msgr2=0x7f54cc07bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc07bc70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54bc003de0 tx=0x7f54bc011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 shutdown_connections 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54b8038440 0x7f54b803a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 --2- 172.21.15.31:0/1477899370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54cc105c40 0x7f54cc07bc70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 >> 172.21.15.31:0/1477899370 conn(0x7f54cc1012b0 msgr2=0x7f54cc1029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.089+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 shutdown_connections 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:40.090+0000 7f54d1d8b700 1 -- 172.21.15.31:0/1477899370 wait complete. 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for the mgr to restart... 2024-09-17T01:42:40.671 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr epoch 5... 2024-09-17T01:42:41.069 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:40 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1477899370' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T01:42:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: Active manager daemon smithi031.ealpiz restarted 2024-09-17T01:42:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: Activating manager daemon smithi031.ealpiz 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: mgrmap e6: smithi031.ealpiz(active, starting, since 0.00340545s) 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:46.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:42:46.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:45 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:42:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:46 smithi031 ceph-mon[27673]: Found migration_current of "None". Setting to last migration. 2024-09-17T01:42:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:46 smithi031 ceph-mon[27673]: mgrmap e7: smithi031.ealpiz(active, since 1.00643s) 2024-09-17T01:42:47.325 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92fce3e700 1 Processor -- start 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92fce3e700 1 -- start start 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92fce3e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f807a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92fce3e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f807a8a0 con 0x7f92f807be60 2024-09-17T01:42:47.332 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f807a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f807a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50422/0 (socket says 172.21.15.31:50422) 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.092+0000 7f92f659c700 1 -- 172.21.15.31:0/2195460133 learned_addr learned my addr 172.21.15.31:0/2195460133 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.093+0000 7f92f659c700 1 -- 172.21.15.31:0/2195460133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f807a9e0 con 0x7f92f807be60 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.093+0000 7f92f659c700 1 --2- 172.21.15.31:0/2195460133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f807a360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098a0 tx=0x7f92e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982cf680ff25abed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.093+0000 7f92f559a700 1 -- 172.21.15.31:0/2195460133 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e8004180 con 0x7f92f807be60 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.093+0000 7f92f559a700 1 -- 172.21.15.31:0/2195460133 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f92e80042e0 con 0x7f92f807be60 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.093+0000 7f92f559a700 1 -- 172.21.15.31:0/2195460133 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e8011a50 con 0x7f92f807be60 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 -- 172.21.15.31:0/2195460133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 msgr2=0x7f92f807a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 --2- 172.21.15.31:0/2195460133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f807a360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f92e80098a0 tx=0x7f92e8009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 -- 172.21.15.31:0/2195460133 shutdown_connections 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 --2- 172.21.15.31:0/2195460133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f807a360 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 -- 172.21.15.31:0/2195460133 >> 172.21.15.31:0/2195460133 conn(0x7f92f8101220 msgr2=0x7f92f8103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:47.333 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 -- 172.21.15.31:0/2195460133 shutdown_connections 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.094+0000 7f92fce3e700 1 -- 172.21.15.31:0/2195460133 wait complete. 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92fce3e700 1 Processor -- start 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92fce3e700 1 -- start start 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92fce3e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92fce3e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819c0b0 con 0x7f92f807be60 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92f659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f819bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50426/0 (socket says 172.21.15.31:50426) 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92f659c700 1 -- 172.21.15.31:0/1921996874 learned_addr learned my addr 172.21.15.31:0/1921996874 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92f659c700 1 -- 172.21.15.31:0/1921996874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8009550 con 0x7f92f807be60 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.095+0000 7f92f659c700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f819bb70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f92e8003de0 tx=0x7f92e8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.096+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e8003930 con 0x7f92f807be60 2024-09-17T01:42:47.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.096+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f819c2b0 con 0x7f92f807be60 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.096+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f92e8003a90 con 0x7f92f807be60 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.096+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f819c6d0 con 0x7f92f807be60 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.096+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e80196c0 con 0x7f92f807be60 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.097+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f92e801abc0 con 0x7f92f807be60 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.097+0000 7f92e77fe700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.097+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92e003afb0 con 0x7f92e00383f0 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.097+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f92e804c090 con 0x7f92f807be60 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.097+0000 7f92f5d9b700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.097+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.298+0000 7f92f5d9b700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.298+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.699+0000 7f92f5d9b700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:47.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:41.699+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:42.500+0000 7f92f5d9b700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:42.500+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:44.101+0000 7f92f5d9b700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:44.101+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:45.750+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7f92e8019be0 con 0x7f92f807be60 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:45.750+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:45.750+0000 7f92e77fe700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.753+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f92e804dbe0 con 0x7f92f807be60 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.753+0000 7f92e77fe700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.753+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92e003afb0 con 0x7f92e00383f0 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.754+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.754+0000 7f92f5d9b700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f92ec003a10 tx=0x7f92ec009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.755+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f92e003afb0 con 0x7f92e00383f0 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f92f810be90 con 0x7f92e00383f0 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92e77fe700 1 -- 172.21.15.31:0/1921996874 <== mgr.14120 v2:172.21.15.31:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f92f810be90 con 0x7f92e00383f0 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 msgr2=0x7f92e003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f92ec003a10 tx=0x7f92ec009290 comp rx=0 tx=0).stop 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 msgr2=0x7f92f819bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f819bb70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f92e8003de0 tx=0x7f92e8011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 shutdown_connections 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f92e00383f0 0x7f92e003a8a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 --2- 172.21.15.31:0/1921996874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f807be60 0x7f92f819bb70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 >> 172.21.15.31:0/1921996874 conn(0x7f92f8101220 msgr2=0x7f92f81028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.762+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 shutdown_connections 2024-09-17T01:42:47.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:46.763+0000 7f92fce3e700 1 -- 172.21.15.31:0/1921996874 wait complete. 2024-09-17T01:42:47.338 INFO:teuthology.orchestra.run.smithi031.stdout:mgr epoch 5 is available 2024-09-17T01:42:47.338 INFO:teuthology.orchestra.run.smithi031.stdout:Setting orchestrator backend to cephadm... 2024-09-17T01:42:47.996 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:47 smithi031 ceph-mon[27673]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T01:42:47.996 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:47 smithi031 ceph-mon[27673]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T01:42:47.996 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:47 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:47.996 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:47 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.773+0000 7f2536b75700 1 Processor -- start 2024-09-17T01:42:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.773+0000 7f2536b75700 1 -- start start 2024-09-17T01:42:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2536b75700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2536b75700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530106590 con 0x7f2530105c40 2024-09-17T01:42:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2534911700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2534911700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41602/0 (socket says 172.21.15.31:41602) 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2534911700 1 -- 172.21.15.31:0/3934940902 learned_addr learned my addr 172.21.15.31:0/3934940902 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2534911700 1 -- 172.21.15.31:0/3934940902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25301066d0 con 0x7f2530105c40 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f2534911700 1 --2- 172.21.15.31:0/3934940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530106050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25240098a0 tx=0x7f2524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e45236de135a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f252f7fe700 1 -- 172.21.15.31:0/3934940902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2524004180 con 0x7f2530105c40 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f252f7fe700 1 -- 172.21.15.31:0/3934940902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f25240042e0 con 0x7f2530105c40 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.774+0000 7f252f7fe700 1 -- 172.21.15.31:0/3934940902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2524011a50 con 0x7f2530105c40 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 -- 172.21.15.31:0/3934940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 msgr2=0x7f2530106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 --2- 172.21.15.31:0/3934940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530106050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25240098a0 tx=0x7f2524009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 -- 172.21.15.31:0/3934940902 shutdown_connections 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 --2- 172.21.15.31:0/3934940902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530106050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 -- 172.21.15.31:0/3934940902 >> 172.21.15.31:0/3934940902 conn(0x7f25301012b0 msgr2=0x7f25301036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:48.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 -- 172.21.15.31:0/3934940902 shutdown_connections 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.775+0000 7f2536b75700 1 -- 172.21.15.31:0/3934940902 wait complete. 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2536b75700 1 Processor -- start 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2536b75700 1 -- start start 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2536b75700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2536b75700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530199e60 con 0x7f2530105c40 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2534911700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2534911700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41612/0 (socket says 172.21.15.31:41612) 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2534911700 1 -- 172.21.15.31:0/4287963222 learned_addr learned my addr 172.21.15.31:0/4287963222 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.776+0000 7f2534911700 1 -- 172.21.15.31:0/4287963222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524009550 con 0x7f2530105c40 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.777+0000 7f2534911700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530199920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2524003f80 tx=0x7f2524011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.777+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2524003a80 con 0x7f2530105c40 2024-09-17T01:42:48.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.777+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2524003be0 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.777+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253019a060 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.777+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2524019820 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.777+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253019a480 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.778+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530062380 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.778+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f2524019ac0 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.778+0000 7f252dffb700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2520038270 0x7f252003a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.778+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f252404c5b0 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.778+0000 7f252ffff700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2520038270 0x7f252003a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.779+0000 7f252ffff700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2520038270 0x7f252003a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f251c006fd0 tx=0x7f251c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.783+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f252402b750 con 0x7f2530105c40 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:47.998+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f253019d2e0 con 0x7f2520038270 2024-09-17T01:42:48.572 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.004+0000 7f252dffb700 1 -- 172.21.15.31:0/4287963222 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f253019d2e0 con 0x7f2520038270 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2520038270 msgr2=0x7f252003a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2520038270 0x7f252003a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f251c006fd0 tx=0x7f251c006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 msgr2=0x7f2530199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530199920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2524003f80 tx=0x7f2524011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 shutdown_connections 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2520038270 0x7f252003a720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 --2- 172.21.15.31:0/4287963222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2530105c40 0x7f2530199920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 >> 172.21.15.31:0/4287963222 conn(0x7f25301012b0 msgr2=0x7f25301029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 shutdown_connections 2024-09-17T01:42:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:48.006+0000 7f2536b75700 1 -- 172.21.15.31:0/4287963222 wait complete. 2024-09-17T01:42:49.251 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: [17/Sep/2024:01:42:47] ENGINE Bus STARTING 2024-09-17T01:42:49.251 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:49.251 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:49.251 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:49.251 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: [17/Sep/2024:01:42:48] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:42:49.251 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: [17/Sep/2024:01:42:48] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:42:49.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: [17/Sep/2024:01:42:48] ENGINE Bus STARTED 2024-09-17T01:42:49.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:49.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:49 smithi031 ceph-mon[27673]: mgrmap e8: smithi031.ealpiz(active, since 2s) 2024-09-17T01:42:49.749 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T01:42:49.749 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd71dd64700 1 Processor -- start 2024-09-17T01:42:49.749 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd71dd64700 1 -- start start 2024-09-17T01:42:49.749 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd71dd64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd71dd64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718079d40 con 0x7fd7181066f0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd7177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd7177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41620/0 (socket says 172.21.15.31:41620) 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd7177fe700 1 -- 172.21.15.31:0/1278313592 learned_addr learned my addr 172.21.15.31:0/1278313592 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.043+0000 7fd7177fe700 1 -- 172.21.15.31:0/1278313592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718079e80 con 0x7fd7181066f0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd7177fe700 1 --2- 172.21.15.31:0/1278313592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718108ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098a0 tx=0x7fd708009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba76dfb83adae14a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd7167fc700 1 -- 172.21.15.31:0/1278313592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd708004180 con 0x7fd7181066f0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd7167fc700 1 -- 172.21.15.31:0/1278313592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd7080042e0 con 0x7fd7181066f0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd7167fc700 1 -- 172.21.15.31:0/1278313592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd708011a50 con 0x7fd7181066f0 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd71dd64700 1 -- 172.21.15.31:0/1278313592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 msgr2=0x7fd718108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd71dd64700 1 --2- 172.21.15.31:0/1278313592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718108ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098a0 tx=0x7fd708009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.750 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd71dd64700 1 -- 172.21.15.31:0/1278313592 shutdown_connections 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd71dd64700 1 --2- 172.21.15.31:0/1278313592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718108ad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd71dd64700 1 -- 172.21.15.31:0/1278313592 >> 172.21.15.31:0/1278313592 conn(0x7fd7181000f0 msgr2=0x7fd718102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.044+0000 7fd71dd64700 1 -- 172.21.15.31:0/1278313592 shutdown_connections 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.045+0000 7fd71dd64700 1 -- 172.21.15.31:0/1278313592 wait complete. 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.045+0000 7fd71dd64700 1 Processor -- start 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.045+0000 7fd71dd64700 1 -- start start 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.045+0000 7fd71dd64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718106050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.045+0000 7fd71dd64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718106590 con 0x7fd7181066f0 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd7177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd7177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41634/0 (socket says 172.21.15.31:41634) 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd7177fe700 1 -- 172.21.15.31:0/2085154531 learned_addr learned my addr 172.21.15.31:0/2085154531 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd7177fe700 1 -- 172.21.15.31:0/2085154531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708009550 con 0x7fd7181066f0 2024-09-17T01:42:49.751 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd7177fe700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718106050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd708006af0 tx=0x7fd708011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd708003b90 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7181046a0 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd70801a8a0 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd708019880 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.046+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd718104ac0 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.047+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd70801aa10 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.047+0000 7fd714ff9700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd7000383b0 0x7fd70003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.047+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd718109c00 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.047+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd70804c6d0 con 0x7fd7181066f0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.048+0000 7fd716ffd700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd7000383b0 0x7fd70003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.752 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.048+0000 7fd716ffd700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd7000383b0 0x7fd70003a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd70c006fd0 tx=0x7fd70c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.053+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd708018530 con 0x7fd7181066f0 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.253+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7181023b0 con 0x7fd7000383b0 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.254+0000 7fd714ff9700 1 -- 172.21.15.31:0/2085154531 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fd7181023b0 con 0x7fd7000383b0 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd7000383b0 msgr2=0x7fd70003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd7000383b0 0x7fd70003a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd70c006fd0 tx=0x7fd70c006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 msgr2=0x7fd718106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718106050 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd708006af0 tx=0x7fd708011a90 comp rx=0 tx=0).stop 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 shutdown_connections 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd7000383b0 0x7fd70003a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 --2- 172.21.15.31:0/2085154531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7181066f0 0x7fd718106050 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 >> 172.21.15.31:0/2085154531 conn(0x7fd7181000f0 msgr2=0x7fd718101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:49.753 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 shutdown_connections 2024-09-17T01:42:49.754 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:49.256+0000 7fd71dd64700 1 -- 172.21.15.31:0/2085154531 wait complete. 2024-09-17T01:42:49.754 INFO:teuthology.orchestra.run.smithi031.stdout:Generating ssh key... 2024-09-17T01:42:50.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:50 smithi031 ceph-mon[27673]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:51.223 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.193+0000 7fd5af813700 1 Processor -- start 2024-09-17T01:42:51.223 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.193+0000 7fd5af813700 1 -- start start 2024-09-17T01:42:51.223 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5af813700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a8108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.223 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5af813700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8079d60 con 0x7fd5a8106730 2024-09-17T01:42:51.223 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5ad5af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a8108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5ad5af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a8108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41644/0 (socket says 172.21.15.31:41644) 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5ad5af700 1 -- 172.21.15.31:0/1392173562 learned_addr learned my addr 172.21.15.31:0/1392173562 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5ad5af700 1 -- 172.21.15.31:0/1392173562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8079ea0 con 0x7fd5a8106730 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.194+0000 7fd5ad5af700 1 --2- 172.21.15.31:0/1392173562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a8108b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098a0 tx=0x7fd5a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2df52dc9c1e574 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd59ffff700 1 -- 172.21.15.31:0/1392173562 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4004180 con 0x7fd5a8106730 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd59ffff700 1 -- 172.21.15.31:0/1392173562 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd5a40042e0 con 0x7fd5a8106730 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd59ffff700 1 -- 172.21.15.31:0/1392173562 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4011a50 con 0x7fd5a8106730 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 -- 172.21.15.31:0/1392173562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 msgr2=0x7fd5a8108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 --2- 172.21.15.31:0/1392173562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a8108b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098a0 tx=0x7fd5a4009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 -- 172.21.15.31:0/1392173562 shutdown_connections 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 --2- 172.21.15.31:0/1392173562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a8108b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 -- 172.21.15.31:0/1392173562 >> 172.21.15.31:0/1392173562 conn(0x7fd5a8100130 msgr2=0x7fd5a8102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 -- 172.21.15.31:0/1392173562 shutdown_connections 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.195+0000 7fd5af813700 1 -- 172.21.15.31:0/1392173562 wait complete. 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5af813700 1 Processor -- start 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5af813700 1 -- start start 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5af813700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5af813700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8199df0 con 0x7fd5a8106730 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5ad5af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5ad5af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a81998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41660/0 (socket says 172.21.15.31:41660) 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5ad5af700 1 -- 172.21.15.31:0/2625459532 learned_addr learned my addr 172.21.15.31:0/2625459532 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:51.225 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.196+0000 7fd5ad5af700 1 -- 172.21.15.31:0/2625459532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009550 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.197+0000 7fd5ad5af700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a81998b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006af0 tx=0x7fd5a4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.197+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4003b90 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.197+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd5a401a8a0 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.197+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a819a050 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.197+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a819a4d0 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.197+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4019880 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.198+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c005320 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.198+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd5a4019af0 con 0x7fd5a8106730 2024-09-17T01:42:51.226 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.198+0000 7fd59e7fc700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd594038400 0x7fd59403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.198+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd5a404c820 con 0x7fd5a8106730 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.198+0000 7fd5acdae700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd594038400 0x7fd59403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.199+0000 7fd5acdae700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd594038400 0x7fd59403a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd598006fd0 tx=0x7fd598006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.203+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd5a402b750 con 0x7fd5a8106730 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.403+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd58c000bf0 con 0x7fd594038400 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.593+0000 7fd59e7fc700 1 -- 172.21.15.31:0/2625459532 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd58c000bf0 con 0x7fd594038400 2024-09-17T01:42:51.227 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd594038400 msgr2=0x7fd59403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd594038400 0x7fd59403a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd598006fd0 tx=0x7fd598006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 msgr2=0x7fd5a81998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a81998b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006af0 tx=0x7fd5a4011a90 comp rx=0 tx=0).stop 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 shutdown_connections 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd594038400 0x7fd59403a8b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 --2- 172.21.15.31:0/2625459532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5a8106730 0x7fd5a81998b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.595+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 >> 172.21.15.31:0/2625459532 conn(0x7fd5a8100130 msgr2=0x7fd5a8100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.596+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 shutdown_connections 2024-09-17T01:42:51.228 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:50.596+0000 7fd5af813700 1 -- 172.21.15.31:0/2625459532 wait complete. 2024-09-17T01:42:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:51 smithi031 ceph-mon[27673]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:51 smithi031 ceph-mon[27673]: Generating ssh key... 2024-09-17T01:42:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:51 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:51 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvP3t0rzla7vx4YB5JzPVFdD3ClwgPkxAJaJXXJSKhuihgNsODA3j8EwXPp1i3uW+jtgS091tO+ZTwJLQTPZ2WiC5JQc1fISiBL5Z0SyqeX9JsSrMOneUVBgI7gKy3i9PE2jMboxWkia9yX2q8/L9JMlVCwQInHAVKjmTFnwMsspbi9fQ+Lg9OTItacBGVuc2iwn7g5lr26uCPa6LE4nSVi/Rc8qerhxK7T6i3uy997x7LLsvKvN++avFd2jLCv5bUq6fkyMOSO8Fvzh+RvTdxmLDERzbo5Rk7M1g5L9e2lZvF5EMazPQi/SmnbgFegvFj/baMzy55362gDfRQhx7ErfeNmzsSoYr0lx7va9Kx1eB2ZlNmHn72cdGVxqOka+qv976CRhdFYphGEIXFVPwn0jB2Puk/HFJfnoUjz3Tmwjw8Q3w5UcW1Jag4ZTmz/yi+fJuYpG12rEAnkDeXHD/wUFmXX/gSfdg4v/8+zHT0LOQ2kFKRGjK3E5kqYGMIuiU= ceph-fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f194df36700 1 Processor -- start 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f194df36700 1 -- start start 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f194df36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f194df36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480744a0 con 0x7f1948106690 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f19477fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f19477fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41666/0 (socket says 172.21.15.31:41666) 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f19477fe700 1 -- 172.21.15.31:0/1064100961 learned_addr learned my addr 172.21.15.31:0/1064100961 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f19477fe700 1 -- 172.21.15.31:0/1064100961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480745e0 con 0x7f1948106690 2024-09-17T01:42:52.395 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.613+0000 7f19477fe700 1 --2- 172.21.15.31:0/1064100961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948108a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19380098a0 tx=0x7f1938009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12db6d47bc9500a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f1946ffd700 1 -- 172.21.15.31:0/1064100961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1938004180 con 0x7f1948106690 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f1946ffd700 1 -- 172.21.15.31:0/1064100961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f19380042e0 con 0x7f1948106690 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f1946ffd700 1 -- 172.21.15.31:0/1064100961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1938011a50 con 0x7f1948106690 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 -- 172.21.15.31:0/1064100961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 msgr2=0x7f1948108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 --2- 172.21.15.31:0/1064100961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948108a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19380098a0 tx=0x7f1938009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 -- 172.21.15.31:0/1064100961 shutdown_connections 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 --2- 172.21.15.31:0/1064100961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948108a70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 -- 172.21.15.31:0/1064100961 >> 172.21.15.31:0/1064100961 conn(0x7f1948100110 msgr2=0x7f1948102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 -- 172.21.15.31:0/1064100961 shutdown_connections 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.614+0000 7f194df36700 1 -- 172.21.15.31:0/1064100961 wait complete. 2024-09-17T01:42:52.396 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.615+0000 7f194df36700 1 Processor -- start 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.615+0000 7f194df36700 1 -- start start 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.615+0000 7f194df36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.615+0000 7f194df36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948199e60 con 0x7f1948106690 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19477fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19477fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41670/0 (socket says 172.21.15.31:41670) 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19477fe700 1 -- 172.21.15.31:0/1468882235 learned_addr learned my addr 172.21.15.31:0/1468882235 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19477fe700 1 -- 172.21.15.31:0/1468882235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938009550 con 0x7f1948106690 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19477fe700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948199920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1938000c00 tx=0x7f1938011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1938003b90 con 0x7f1948106690 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f19380248b0 con 0x7f1948106690 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194819a060 con 0x7f1948106690 2024-09-17T01:42:52.397 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f193801a8e0 con 0x7f1948106690 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.616+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194819a480 con 0x7f1948106690 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.617+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1938024a20 con 0x7f1948106690 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.617+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1948062380 con 0x7f1948106690 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.617+0000 7f19457fa700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f19340383f0 0x7f193403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.617+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f193804c420 con 0x7f1948106690 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.618+0000 7f193effd700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f19340383f0 0x7f193403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.618+0000 7f193effd700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f19340383f0 0x7f193403a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1930006fd0 tx=0x7f1930006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.622+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1938024440 con 0x7f1948106690 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.823+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1948102400 con 0x7f19340383f0 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.824+0000 7f19457fa700 1 -- 172.21.15.31:0/1468882235 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1948102400 con 0x7f19340383f0 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f19340383f0 msgr2=0x7f193403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.398 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f19340383f0 0x7f193403a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1930006fd0 tx=0x7f1930006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 msgr2=0x7f1948199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948199920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1938000c00 tx=0x7f1938011ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 shutdown_connections 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f19340383f0 0x7f193403a8a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 --2- 172.21.15.31:0/1468882235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1948106690 0x7f1948199920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 >> 172.21.15.31:0/1468882235 conn(0x7f1948100110 msgr2=0x7f19481017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 shutdown_connections 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:51.826+0000 7f194df36700 1 -- 172.21.15.31:0/1468882235 wait complete. 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:42:52.399 INFO:teuthology.orchestra.run.smithi031.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T01:42:52.400 INFO:teuthology.orchestra.run.smithi031.stdout:Adding host smithi031... 2024-09-17T01:42:53.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:52 smithi031 ceph-mon[27673]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:53.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:53 smithi031 ceph-mon[27673]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi031", "addr": "172.21.15.31", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:53.967 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:53 smithi031 ceph-mon[27673]: Deploying cephadm binary to smithi031 2024-09-17T01:42:56.068 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Added host 'smithi031' with addr '172.21.15.31' 2024-09-17T01:42:56.068 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a934f5700 1 Processor -- start 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a934f5700 1 -- start start 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a934f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c07a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a934f5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c07a880 con 0x7f4a8c07be40 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a91291700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c07a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a91291700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c07a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41674/0 (socket says 172.21.15.31:41674) 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.825+0000 7f4a91291700 1 -- 172.21.15.31:0/3773899947 learned_addr learned my addr 172.21.15.31:0/3773899947 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.826+0000 7f4a91291700 1 -- 172.21.15.31:0/3773899947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c07a9c0 con 0x7f4a8c07be40 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.826+0000 7f4a91291700 1 --2- 172.21.15.31:0/3773899947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c07a340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4a880098a0 tx=0x7f4a88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9d4b506d0660d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.826+0000 7f4a83fff700 1 -- 172.21.15.31:0/3773899947 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a88004180 con 0x7f4a8c07be40 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.826+0000 7f4a83fff700 1 -- 172.21.15.31:0/3773899947 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4a880042e0 con 0x7f4a8c07be40 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.826+0000 7f4a83fff700 1 -- 172.21.15.31:0/3773899947 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a88011a50 con 0x7f4a8c07be40 2024-09-17T01:42:56.069 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.826+0000 7f4a934f5700 1 -- 172.21.15.31:0/3773899947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 msgr2=0x7f4a8c07a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 --2- 172.21.15.31:0/3773899947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c07a340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4a880098a0 tx=0x7f4a88009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 -- 172.21.15.31:0/3773899947 shutdown_connections 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 --2- 172.21.15.31:0/3773899947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c07a340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 -- 172.21.15.31:0/3773899947 >> 172.21.15.31:0/3773899947 conn(0x7f4a8c101220 msgr2=0x7f4a8c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 -- 172.21.15.31:0/3773899947 shutdown_connections 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 -- 172.21.15.31:0/3773899947 wait complete. 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 Processor -- start 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.827+0000 7f4a934f5700 1 -- start start 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a934f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a934f5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c19c090 con 0x7f4a8c07be40 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a91291700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a91291700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c19bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41690/0 (socket says 172.21.15.31:41690) 2024-09-17T01:42:56.070 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a91291700 1 -- 172.21.15.31:0/156970915 learned_addr learned my addr 172.21.15.31:0/156970915 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a91291700 1 -- 172.21.15.31:0/156970915 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a88009550 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a91291700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c19bb50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006af0 tx=0x7f4a88011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a88003b90 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4a8801a8a0 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c19c290 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a88019880 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.828+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c19c6b0 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.829+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f4a8801a430 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.829+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c10be20 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.829+0000 7f4a827fc700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4a780383b0 0x7f4a7803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.829+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4a8804c6b0 con 0x7f4a8c07be40 2024-09-17T01:42:56.071 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.830+0000 7f4a90a90700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4a780383b0 0x7f4a7803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.830+0000 7f4a90a90700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4a780383b0 0x7f4a7803a860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c006fd0 tx=0x7f4a7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:52.835+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4a880189a0 con 0x7f4a8c07be40 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:53.037+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi031", "addr": "172.21.15.31", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a8c103530 con 0x7f4a780383b0 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.486+0000 7f4a827fc700 1 -- 172.21.15.31:0/156970915 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f4a8c103530 con 0x7f4a780383b0 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4a780383b0 msgr2=0x7f4a7803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4a780383b0 0x7f4a7803a860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c006fd0 tx=0x7f4a7c006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 msgr2=0x7f4a8c19bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c19bb50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006af0 tx=0x7f4a88011a90 comp rx=0 tx=0).stop 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 shutdown_connections 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4a780383b0 0x7f4a7803a860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 --2- 172.21.15.31:0/156970915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a8c07be40 0x7f4a8c19bb50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 >> 172.21.15.31:0/156970915 conn(0x7f4a8c101220 msgr2=0x7f4a8c102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:56.072 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 shutdown_connections 2024-09-17T01:42:56.073 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:55.489+0000 7f4a934f5700 1 -- 172.21.15.31:0/156970915 wait complete. 2024-09-17T01:42:56.073 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying mon service with default placement... 2024-09-17T01:42:56.647 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:56 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:56.647 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:56 smithi031 ceph-mon[27673]: Added host smithi031 2024-09-17T01:42:56.647 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:56 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:57 smithi031 ceph-mon[27673]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:57 smithi031 ceph-mon[27673]: Saving service mon spec with placement count:5 2024-09-17T01:42:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:57 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:58.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.515+0000 7f4355b25700 1 Processor -- start 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.515+0000 7f4355b25700 1 -- start start 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f4355b25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f4350104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f4355b25700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43501053d0 con 0x7f4350104a80 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f434f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f4350104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f434f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f4350104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45826/0 (socket says 172.21.15.31:45826) 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f434f7fe700 1 -- 172.21.15.31:0/178856576 learned_addr learned my addr 172.21.15.31:0/178856576 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f434f7fe700 1 -- 172.21.15.31:0/178856576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350105510 con 0x7f4350104a80 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.516+0000 7f434f7fe700 1 --2- 172.21.15.31:0/178856576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f4350104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f434000bb40 tx=0x7f434000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74698602a615c3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f434e7fc700 1 -- 172.21.15.31:0/178856576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f434000dc00 con 0x7f4350104a80 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f434e7fc700 1 -- 172.21.15.31:0/178856576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f43400044a0 con 0x7f4350104a80 2024-09-17T01:42:58.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f434e7fc700 1 -- 172.21.15.31:0/178856576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4340010470 con 0x7f4350104a80 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 -- 172.21.15.31:0/178856576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 msgr2=0x7f4350104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 --2- 172.21.15.31:0/178856576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f4350104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f434000bb40 tx=0x7f434000be50 comp rx=0 tx=0).stop 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 -- 172.21.15.31:0/178856576 shutdown_connections 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 --2- 172.21.15.31:0/178856576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f4350104e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 -- 172.21.15.31:0/178856576 >> 172.21.15.31:0/178856576 conn(0x7f4350100110 msgr2=0x7f4350102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 -- 172.21.15.31:0/178856576 shutdown_connections 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.517+0000 7f4355b25700 1 -- 172.21.15.31:0/178856576 wait complete. 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f4355b25700 1 Processor -- start 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f4355b25700 1 -- start start 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f4355b25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f435019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f4355b25700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435019c010 con 0x7f4350104a80 2024-09-17T01:42:58.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f434f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f435019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f434f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f435019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45834/0 (socket says 172.21.15.31:45834) 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.518+0000 7f434f7fe700 1 -- 172.21.15.31:0/2007322862 learned_addr learned my addr 172.21.15.31:0/2007322862 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f434f7fe700 1 -- 172.21.15.31:0/2007322862 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434000b7f0 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f434f7fe700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f435019bad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f43400046d0 tx=0x7f4340003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43400042a0 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4340010b50 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435019c210 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4340021ae0 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.519+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435019c5d0 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.520+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43501913b0 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.521+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f4340021d50 con 0x7f4350104a80 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.521+0000 7f434cff9700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4338038440 0x7f433803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.521+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f434004c470 con 0x7f4350104a80 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.521+0000 7f434effd700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4338038440 0x7f433803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.521+0000 7f434effd700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4338038440 0x7f433803a8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4344006fd0 tx=0x7f4344006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.526+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f434000e770 con 0x7f4350104a80 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.742+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f4350061190 con 0x7f4338038440 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.747+0000 7f434cff9700 1 -- 172.21.15.31:0/2007322862 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4350061190 con 0x7f4338038440 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4338038440 msgr2=0x7f433803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4338038440 0x7f433803a8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4344006fd0 tx=0x7f4344006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 msgr2=0x7f435019bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f435019bad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f43400046d0 tx=0x7f4340003d70 comp rx=0 tx=0).stop 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 shutdown_connections 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4338038440 0x7f433803a8f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 --2- 172.21.15.31:0/2007322862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4350104a80 0x7f435019bad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 >> 172.21.15.31:0/2007322862 conn(0x7f4350100110 msgr2=0x7f435018e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:58.209 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 shutdown_connections 2024-09-17T01:42:58.209 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:56.749+0000 7f4355b25700 1 -- 172.21.15.31:0/2007322862 wait complete. 2024-09-17T01:42:58.209 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying mgr service with default placement... 2024-09-17T01:42:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:58 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:58 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.674+0000 7f4290996700 1 Processor -- start 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.674+0000 7f4290996700 1 -- start start 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.674+0000 7f4290996700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.674+0000 7f4290996700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c105430 con 0x7f428c104ae0 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.675+0000 7f428a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.675+0000 7f428a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45836/0 (socket says 172.21.15.31:45836) 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.675+0000 7f428a59c700 1 -- 172.21.15.31:0/2777382357 learned_addr learned my addr 172.21.15.31:0/2777382357 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.675+0000 7f428a59c700 1 -- 172.21.15.31:0/2777382357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c105570 con 0x7f428c104ae0 2024-09-17T01:42:59.738 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.675+0000 7f428a59c700 1 --2- 172.21.15.31:0/2777382357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c104ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f427c0098a0 tx=0x7f427c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe4f6972263ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.676+0000 7f428959a700 1 -- 172.21.15.31:0/2777382357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f427c004180 con 0x7f428c104ae0 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.676+0000 7f428959a700 1 -- 172.21.15.31:0/2777382357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f427c0042e0 con 0x7f428c104ae0 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.676+0000 7f428959a700 1 -- 172.21.15.31:0/2777382357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f427c011af0 con 0x7f428c104ae0 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.676+0000 7f4290996700 1 -- 172.21.15.31:0/2777382357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 msgr2=0x7f428c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.676+0000 7f4290996700 1 --2- 172.21.15.31:0/2777382357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c104ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f427c0098a0 tx=0x7f427c009bb0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.677+0000 7f4290996700 1 -- 172.21.15.31:0/2777382357 shutdown_connections 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.677+0000 7f4290996700 1 --2- 172.21.15.31:0/2777382357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c104ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.677+0000 7f4290996700 1 -- 172.21.15.31:0/2777382357 >> 172.21.15.31:0/2777382357 conn(0x7f428c100130 msgr2=0x7f428c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.677+0000 7f4290996700 1 -- 172.21.15.31:0/2777382357 shutdown_connections 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.677+0000 7f4290996700 1 -- 172.21.15.31:0/2777382357 wait complete. 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.677+0000 7f4290996700 1 Processor -- start 2024-09-17T01:42:59.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f4290996700 1 -- start start 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f4290996700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f4290996700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c199e60 con 0x7f428c104ae0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f428a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f428a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45838/0 (socket says 172.21.15.31:45838) 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f428a59c700 1 -- 172.21.15.31:0/1497578885 learned_addr learned my addr 172.21.15.31:0/1497578885 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f428a59c700 1 -- 172.21.15.31:0/1497578885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c009550 con 0x7f428c104ae0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.678+0000 7f428a59c700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c199920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f427c006ba0 tx=0x7f427c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.679+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f427c003b00 con 0x7f428c104ae0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.679+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f427c01a8e0 con 0x7f428c104ae0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.679+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c19a060 con 0x7f428c104ae0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.679+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f427c0199c0 con 0x7f428c104ae0 2024-09-17T01:42:59.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.679+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c19a480 con 0x7f428c104ae0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.680+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f427c019c30 con 0x7f428c104ae0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.680+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c062380 con 0x7f428c104ae0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.680+0000 7f427b7fe700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f42740383f0 0x7f427403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.680+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f427c04c5d0 con 0x7f428c104ae0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.680+0000 7f4289d9b700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f42740383f0 0x7f427403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.681+0000 7f4289d9b700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f42740383f0 0x7f427403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4280006fd0 tx=0x7f4280006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.685+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f427c02d440 con 0x7f428c104ae0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.913+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f428c101620 con 0x7f42740383f0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.917+0000 7f427b7fe700 1 -- 172.21.15.31:0/1497578885 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f428c101620 con 0x7f42740383f0 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f42740383f0 msgr2=0x7f427403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.741 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f42740383f0 0x7f427403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4280006fd0 tx=0x7f4280006e40 comp rx=0 tx=0).stop 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 msgr2=0x7f428c199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c199920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f427c006ba0 tx=0x7f427c011b50 comp rx=0 tx=0).stop 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 shutdown_connections 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f42740383f0 0x7f427403a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 --2- 172.21.15.31:0/1497578885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f428c104ae0 0x7f428c199920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 >> 172.21.15.31:0/1497578885 conn(0x7f428c100130 msgr2=0x7f428c100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 shutdown_connections 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:42:58.919+0000 7f4290996700 1 -- 172.21.15.31:0/1497578885 wait complete. 2024-09-17T01:42:59.742 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying crash service with default placement... 2024-09-17T01:42:59.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:59 smithi031 ceph-mon[27673]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:59.983 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:59 smithi031 ceph-mon[27673]: Saving service mgr spec with placement count:2 2024-09-17T01:42:59.983 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:42:59 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-17T01:43:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.174+0000 7f5100348700 1 Processor -- start 2024-09-17T01:43:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.174+0000 7f5100348700 1 -- start start 2024-09-17T01:43:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.174+0000 7f5100348700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f8105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.174+0000 7f5100348700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f81064c0 con 0x7f50f8105b70 2024-09-17T01:43:00.994 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fe0e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f8105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fe0e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f8105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45848/0 (socket says 172.21.15.31:45848) 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fe0e4700 1 -- 172.21.15.31:0/387279117 learned_addr learned my addr 172.21.15.31:0/387279117 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fe0e4700 1 -- 172.21.15.31:0/387279117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8106600 con 0x7f50f8105b70 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fe0e4700 1 --2- 172.21.15.31:0/387279117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f8105f80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009e80 tx=0x7f50e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c859672c29a6b4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fd0e2700 1 -- 172.21.15.31:0/387279117 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50e800e070 con 0x7f50f8105b70 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fd0e2700 1 -- 172.21.15.31:0/387279117 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50e800b8c0 con 0x7f50f8105b70 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.175+0000 7f50fd0e2700 1 -- 172.21.15.31:0/387279117 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50e80044d0 con 0x7f50f8105b70 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 -- 172.21.15.31:0/387279117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 msgr2=0x7f50f8105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 --2- 172.21.15.31:0/387279117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f8105f80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009e80 tx=0x7f50e800b330 comp rx=0 tx=0).stop 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 -- 172.21.15.31:0/387279117 shutdown_connections 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 --2- 172.21.15.31:0/387279117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f8105f80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 -- 172.21.15.31:0/387279117 >> 172.21.15.31:0/387279117 conn(0x7f50f8101220 msgr2=0x7f50f8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:00.995 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 -- 172.21.15.31:0/387279117 shutdown_connections 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.176+0000 7f5100348700 1 -- 172.21.15.31:0/387279117 wait complete. 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f5100348700 1 Processor -- start 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f5100348700 1 -- start start 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f5100348700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f5100348700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f8199de0 con 0x7f50f8105b70 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f50fe0e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f50fe0e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45852/0 (socket says 172.21.15.31:45852) 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f50fe0e4700 1 -- 172.21.15.31:0/3058316832 learned_addr learned my addr 172.21.15.31:0/3058316832 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.177+0000 7f50fe0e4700 1 -- 172.21.15.31:0/3058316832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8009b30 con 0x7f50f8105b70 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.178+0000 7f50fe0e4700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f81998a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50e8004070 tx=0x7f50e80049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:00.996 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.178+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50e800e040 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.178+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50e800be00 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.178+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f8199fe0 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.178+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50e8012770 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.178+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f819a460 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.179+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f50e8019040 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.179+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f8062380 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.179+0000 7f50f77fe700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f50e0038440 0x7f50e003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.179+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f50e804bd30 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.179+0000 7f50fd8e3700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f50e0038440 0x7f50e003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.180+0000 7f50fd8e3700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f50e0038440 0x7f50e003a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f50ec006fd0 tx=0x7f50ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.184+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f50e801a570 con 0x7f50f8105b70 2024-09-17T01:43:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.399+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f50f8102670 con 0x7f50e0038440 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.403+0000 7f50f77fe700 1 -- 172.21.15.31:0/3058316832 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f50f8102670 con 0x7f50e0038440 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.405+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f50e0038440 msgr2=0x7f50e003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.405+0000 7f5100348700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f50e0038440 0x7f50e003a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f50ec006fd0 tx=0x7f50ec006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.405+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 msgr2=0x7f50f81998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.405+0000 7f5100348700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f81998a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50e8004070 tx=0x7f50e80049f0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.406+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 shutdown_connections 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.406+0000 7f5100348700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f50e0038440 0x7f50e003a8f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.406+0000 7f5100348700 1 --2- 172.21.15.31:0/3058316832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50f8105b70 0x7f50f81998a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.406+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 >> 172.21.15.31:0/3058316832 conn(0x7f50f8101220 msgr2=0x7f50f8101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.406+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 shutdown_connections 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:00.406+0000 7f5100348700 1 -- 172.21.15.31:0/3058316832 wait complete. 2024-09-17T01:43:00.998 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying ceph-exporter service with default placement... 2024-09-17T01:43:01.650 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:01 smithi031 ceph-mon[27673]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:01.651 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:01 smithi031 ceph-mon[27673]: Saving service crash spec with placement * 2024-09-17T01:43:01.651 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:01 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:01.651 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:01 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:02.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-17T01:43:02.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3897246700 1 Processor -- start 2024-09-17T01:43:02.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3897246700 1 -- start start 2024-09-17T01:43:02.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3897246700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3897246700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3890106520 con 0x7f3890105bd0 2024-09-17T01:43:02.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3894fe2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3894fe2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45862/0 (socket says 172.21.15.31:45862) 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.431+0000 7f3894fe2700 1 -- 172.21.15.31:0/501938223 learned_addr learned my addr 172.21.15.31:0/501938223 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.432+0000 7f3894fe2700 1 -- 172.21.15.31:0/501938223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890106660 con 0x7f3890105bd0 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.432+0000 7f3894fe2700 1 --2- 172.21.15.31:0/501938223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890105fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f388c0098a0 tx=0x7f388c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ba4cfeab4194e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.432+0000 7f38877fe700 1 -- 172.21.15.31:0/501938223 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f388c004180 con 0x7f3890105bd0 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.432+0000 7f38877fe700 1 -- 172.21.15.31:0/501938223 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f388c0042e0 con 0x7f3890105bd0 2024-09-17T01:43:02.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.432+0000 7f38877fe700 1 -- 172.21.15.31:0/501938223 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f388c011af0 con 0x7f3890105bd0 2024-09-17T01:43:02.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- 172.21.15.31:0/501938223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 msgr2=0x7f3890105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 --2- 172.21.15.31:0/501938223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890105fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f388c0098a0 tx=0x7f388c009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- 172.21.15.31:0/501938223 shutdown_connections 2024-09-17T01:43:02.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 --2- 172.21.15.31:0/501938223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890105fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- 172.21.15.31:0/501938223 >> 172.21.15.31:0/501938223 conn(0x7f3890101220 msgr2=0x7f3890103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- 172.21.15.31:0/501938223 shutdown_connections 2024-09-17T01:43:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- 172.21.15.31:0/501938223 wait complete. 2024-09-17T01:43:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 Processor -- start 2024-09-17T01:43:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- start start 2024-09-17T01:43:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.433+0000 7f3897246700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3890199eb0 con 0x7f3890105bd0 2024-09-17T01:43:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3894fe2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3894fe2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45864/0 (socket says 172.21.15.31:45864) 2024-09-17T01:43:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3894fe2700 1 -- 172.21.15.31:0/2434050157 learned_addr learned my addr 172.21.15.31:0/2434050157 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3894fe2700 1 -- 172.21.15.31:0/2434050157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009550 con 0x7f3890105bd0 2024-09-17T01:43:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3894fe2700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890199970 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f388c011670 tx=0x7f388c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f388c003a40 con 0x7f3890105bd0 2024-09-17T01:43:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f388c003ba0 con 0x7f3890105bd0 2024-09-17T01:43:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389019a0b0 con 0x7f3890105bd0 2024-09-17T01:43:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f388c024790 con 0x7f3890105bd0 2024-09-17T01:43:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.434+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389019a4d0 con 0x7f3890105bd0 2024-09-17T01:43:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.435+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f388c02d3f0 con 0x7f3890105bd0 2024-09-17T01:43:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.435+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3890062380 con 0x7f3890105bd0 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.435+0000 7f3885ffb700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3878038440 0x7f387803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.436+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f388c04c660 con 0x7f3890105bd0 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.436+0000 7f3887fff700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3878038440 0x7f387803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.436+0000 7f3887fff700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3878038440 0x7f387803a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3880006fd0 tx=0x7f3880006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.440+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f388c018d20 con 0x7f3890105bd0 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.653+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3890103500 con 0x7f3878038440 2024-09-17T01:43:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.658+0000 7f3885ffb700 1 -- 172.21.15.31:0/2434050157 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3890103500 con 0x7f3878038440 2024-09-17T01:43:02.259 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.660+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3878038440 msgr2=0x7f387803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.259 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.660+0000 7f3897246700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3878038440 0x7f387803a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3880006fd0 tx=0x7f3880006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:02.259 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 msgr2=0x7f3890199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.259 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890199970 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f388c011670 tx=0x7f388c011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:02.259 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 shutdown_connections 2024-09-17T01:43:02.259 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3878038440 0x7f387803a8f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.260 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 --2- 172.21.15.31:0/2434050157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3890105bd0 0x7f3890199970 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.260 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 >> 172.21.15.31:0/2434050157 conn(0x7f3890101220 msgr2=0x7f38901028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:02.260 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 shutdown_connections 2024-09-17T01:43:02.260 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:01.661+0000 7f3897246700 1 -- 172.21.15.31:0/2434050157 wait complete. 2024-09-17T01:43:02.260 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying prometheus service with default placement... 2024-09-17T01:43:02.896 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:02 smithi031 ceph-mon[27673]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:02.896 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:02 smithi031 ceph-mon[27673]: Saving service ceph-exporter spec with placement * 2024-09-17T01:43:02.896 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:02 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:02.896 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:02 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.698+0000 7f8e53b81700 1 Processor -- start 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.698+0000 7f8e53b81700 1 -- start start 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.698+0000 7f8e53b81700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.698+0000 7f8e53b81700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1064f0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.698+0000 7f8e5191d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.698+0000 7f8e5191d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45868/0 (socket says 172.21.15.31:45868) 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.699+0000 7f8e5191d700 1 -- 172.21.15.31:0/3462625209 learned_addr learned my addr 172.21.15.31:0/3462625209 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:03.567 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.699+0000 7f8e5191d700 1 -- 172.21.15.31:0/3462625209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c106630 con 0x7f8e4c105ba0 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.699+0000 7f8e5191d700 1 --2- 172.21.15.31:0/3462625209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c105fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098a0 tx=0x7f8e48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4396496d72d367 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.699+0000 7f8e5091b700 1 -- 172.21.15.31:0/3462625209 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e48004180 con 0x7f8e4c105ba0 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.699+0000 7f8e5091b700 1 -- 172.21.15.31:0/3462625209 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e480042e0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.699+0000 7f8e5091b700 1 -- 172.21.15.31:0/3462625209 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e48011af0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 -- 172.21.15.31:0/3462625209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 msgr2=0x7f8e4c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 --2- 172.21.15.31:0/3462625209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c105fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098a0 tx=0x7f8e48009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 -- 172.21.15.31:0/3462625209 shutdown_connections 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 --2- 172.21.15.31:0/3462625209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c105fb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 -- 172.21.15.31:0/3462625209 >> 172.21.15.31:0/3462625209 conn(0x7f8e4c101250 msgr2=0x7f8e4c103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 -- 172.21.15.31:0/3462625209 shutdown_connections 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.700+0000 7f8e53b81700 1 -- 172.21.15.31:0/3462625209 wait complete. 2024-09-17T01:43:03.568 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e53b81700 1 Processor -- start 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e53b81700 1 -- start start 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e53b81700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c07bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e53b81700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c07c1b0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e5191d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c07bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e5191d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c07bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45880/0 (socket says 172.21.15.31:45880) 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e5191d700 1 -- 172.21.15.31:0/1331064923 learned_addr learned my addr 172.21.15.31:0/1331064923 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e5191d700 1 -- 172.21.15.31:0/1331064923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009550 con 0x7f8e4c105ba0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.701+0000 7f8e5191d700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c07bc70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e48011ad0 tx=0x7f8e48011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.702+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e48003ab0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.702+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e48003c10 con 0x7f8e4c105ba0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.702+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c07a2c0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.702+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e480198e0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.569 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.702+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c07a6e0 con 0x7f8e4c105ba0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.703+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8e48019b50 con 0x7f8e4c105ba0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.703+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c062380 con 0x7f8e4c105ba0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.703+0000 7f8e42ffd700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e38038440 0x7f8e3803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.703+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e4804c150 con 0x7f8e4c105ba0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.703+0000 7f8e5111c700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e38038440 0x7f8e3803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.703+0000 7f8e5111c700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e38038440 0x7f8e3803a8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c006fd0 tx=0x7f8e3c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.708+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e4801a430 con 0x7f8e4c105ba0 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.933+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e4c102740 con 0x7f8e38038440 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.939+0000 7f8e42ffd700 1 -- 172.21.15.31:0/1331064923 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f8e4c102740 con 0x7f8e38038440 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e38038440 msgr2=0x7f8e3803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e38038440 0x7f8e3803a8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c006fd0 tx=0x7f8e3c006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:03.570 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 msgr2=0x7f8e4c07bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c07bc70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e48011ad0 tx=0x7f8e48011bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 shutdown_connections 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e38038440 0x7f8e3803a8f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 --2- 172.21.15.31:0/1331064923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c105ba0 0x7f8e4c07bc70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 >> 172.21.15.31:0/1331064923 conn(0x7f8e4c101250 msgr2=0x7f8e4c102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 shutdown_connections 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:02.941+0000 7f8e53b81700 1 -- 172.21.15.31:0/1331064923 wait complete. 2024-09-17T01:43:03.571 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying grafana service with default placement... 2024-09-17T01:43:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:03 smithi031 ceph-mon[27673]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:03 smithi031 ceph-mon[27673]: Saving service prometheus spec with placement count:1 2024-09-17T01:43:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:03 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:05.794 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-17T01:43:05.795 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0646d62700 1 Processor -- start 2024-09-17T01:43:05.795 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0646d62700 1 -- start start 2024-09-17T01:43:05.795 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0646d62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f06401048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:05.795 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0646d62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640079d40 con 0x7f06401044e0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0644afe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f06401048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0644afe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f06401048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50336/0 (socket says 172.21.15.31:50336) 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0644afe700 1 -- 172.21.15.31:0/1880375425 learned_addr learned my addr 172.21.15.31:0/1880375425 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.873+0000 7f0644afe700 1 -- 172.21.15.31:0/1880375425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640079e80 con 0x7f06401044e0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f0644afe700 1 --2- 172.21.15.31:0/1880375425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f06401048f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06340098a0 tx=0x7f0634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75219f18104dd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f063f7fe700 1 -- 172.21.15.31:0/1880375425 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0634004180 con 0x7f06401044e0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f063f7fe700 1 -- 172.21.15.31:0/1880375425 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06340042e0 con 0x7f06401044e0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f063f7fe700 1 -- 172.21.15.31:0/1880375425 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0634011af0 con 0x7f06401044e0 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f0646d62700 1 -- 172.21.15.31:0/1880375425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 msgr2=0x7f06401048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f0646d62700 1 --2- 172.21.15.31:0/1880375425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f06401048f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06340098a0 tx=0x7f0634009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f0646d62700 1 -- 172.21.15.31:0/1880375425 shutdown_connections 2024-09-17T01:43:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f0646d62700 1 --2- 172.21.15.31:0/1880375425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f06401048f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.874+0000 7f0646d62700 1 -- 172.21.15.31:0/1880375425 >> 172.21.15.31:0/1880375425 conn(0x7f06401000f0 msgr2=0x7f0640102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.875+0000 7f0646d62700 1 -- 172.21.15.31:0/1880375425 shutdown_connections 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.875+0000 7f0646d62700 1 -- 172.21.15.31:0/1880375425 wait complete. 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.875+0000 7f0646d62700 1 Processor -- start 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.875+0000 7f0646d62700 1 -- start start 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.875+0000 7f0646d62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f064019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.875+0000 7f0646d62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064019c0c0 con 0x7f06401044e0 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0644afe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f064019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0644afe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f064019bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50346/0 (socket says 172.21.15.31:50346) 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0644afe700 1 -- 172.21.15.31:0/1214424090 learned_addr learned my addr 172.21.15.31:0/1214424090 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0644afe700 1 -- 172.21.15.31:0/1214424090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009550 con 0x7f06401044e0 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0644afe700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f064019bb80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0634006ba0 tx=0x7f0634011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:05.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0634003b00 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f063401a8e0 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064019c2c0 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0634019990 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.876+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064019c6e0 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.877+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f0634019c50 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.877+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0640195360 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.878+0000 7f063dffb700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f06300383a0 0x7f063003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.878+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f063404c880 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.878+0000 7f063ffff700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f06300383a0 0x7f063003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.878+0000 7f063ffff700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f06300383a0 0x7f063003a850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:04.882+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f063402b700 con 0x7f06401044e0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.097+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f0640061190 con 0x7f06300383a0 2024-09-17T01:43:05.798 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.102+0000 7f063dffb700 1 -- 172.21.15.31:0/1214424090 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f0640061190 con 0x7f06300383a0 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f06300383a0 msgr2=0x7f063003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f06300383a0 0x7f063003a850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 msgr2=0x7f064019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f064019bb80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0634006ba0 tx=0x7f0634011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 shutdown_connections 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f06300383a0 0x7f063003a850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 --2- 172.21.15.31:0/1214424090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06401044e0 0x7f064019bb80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 >> 172.21.15.31:0/1214424090 conn(0x7f06401000f0 msgr2=0x7f06401900a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 shutdown_connections 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:05.104+0000 7f0646d62700 1 -- 172.21.15.31:0/1214424090 wait complete. 2024-09-17T01:43:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying node-exporter service with default placement... 2024-09-17T01:43:06.452 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:06 smithi031 ceph-mon[27673]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:06.453 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:06 smithi031 ceph-mon[27673]: Saving service grafana spec with placement count:1 2024-09-17T01:43:06.453 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:06 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:06.453 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:06 smithi031 ceph-mon[27673]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640c2f0700 1 Processor -- start 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640c2f0700 1 -- start start 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640c2f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f6404105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640c2f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64041064c0 con 0x7f6404105b70 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640a08c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f6404105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640a08c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f6404105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50362/0 (socket says 172.21.15.31:50362) 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640a08c700 1 -- 172.21.15.31:0/1682693328 learned_addr learned my addr 172.21.15.31:0/1682693328 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.234+0000 7f640a08c700 1 -- 172.21.15.31:0/1682693328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404106600 con 0x7f6404105b70 2024-09-17T01:43:06.975 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640a08c700 1 --2- 172.21.15.31:0/1682693328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f6404105f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64000098a0 tx=0x7f6400009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2304f57fa945f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640908a700 1 -- 172.21.15.31:0/1682693328 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6400004180 con 0x7f6404105b70 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640908a700 1 -- 172.21.15.31:0/1682693328 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64000042e0 con 0x7f6404105b70 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640908a700 1 -- 172.21.15.31:0/1682693328 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6400011af0 con 0x7f6404105b70 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640c2f0700 1 -- 172.21.15.31:0/1682693328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 msgr2=0x7f6404105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640c2f0700 1 --2- 172.21.15.31:0/1682693328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f6404105f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64000098a0 tx=0x7f6400009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640c2f0700 1 -- 172.21.15.31:0/1682693328 shutdown_connections 2024-09-17T01:43:06.976 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640c2f0700 1 --2- 172.21.15.31:0/1682693328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f6404105f80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.235+0000 7f640c2f0700 1 -- 172.21.15.31:0/1682693328 >> 172.21.15.31:0/1682693328 conn(0x7f6404101220 msgr2=0x7f6404103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640c2f0700 1 -- 172.21.15.31:0/1682693328 shutdown_connections 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640c2f0700 1 -- 172.21.15.31:0/1682693328 wait complete. 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640c2f0700 1 Processor -- start 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640c2f0700 1 -- start start 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640c2f0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f640407bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640c2f0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640407c1b0 con 0x7f6404105b70 2024-09-17T01:43:06.977 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.236+0000 7f640a08c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f640407bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f640a08c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f640407bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50376/0 (socket says 172.21.15.31:50376) 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f640a08c700 1 -- 172.21.15.31:0/1985977625 learned_addr learned my addr 172.21.15.31:0/1985977625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f640a08c700 1 -- 172.21.15.31:0/1985977625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6400009550 con 0x7f6404105b70 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f640a08c700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f640407bc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6400006ba0 tx=0x7f6400011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6400003b00 con 0x7f6404105b70 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640407a2c0 con 0x7f6404105b70 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f640001a8e0 con 0x7f6404105b70 2024-09-17T01:43:06.978 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64000199c0 con 0x7f6404105b70 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.237+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640407a6e0 con 0x7f6404105b70 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.238+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6400019c80 con 0x7f6404105b70 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.238+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404062380 con 0x7f6404105b70 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.238+0000 7f63fb7fe700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63f00383a0 0x7f63f003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.238+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f640004c7f0 con 0x7f6404105b70 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.238+0000 7f640988b700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63f00383a0 0x7f63f003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.239+0000 7f640988b700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63f00383a0 0x7f63f003a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63f4006fd0 tx=0x7f63f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:06.979 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.243+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6400018d20 con 0x7f6404105b70 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.454+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f6404102700 con 0x7f63f00383a0 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.459+0000 7f63fb7fe700 1 -- 172.21.15.31:0/1985977625 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f6404102700 con 0x7f63f00383a0 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63f00383a0 msgr2=0x7f63f003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63f00383a0 0x7f63f003a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f63f4006fd0 tx=0x7f63f4006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 msgr2=0x7f640407bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f640407bc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6400006ba0 tx=0x7f6400011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:06.980 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 shutdown_connections 2024-09-17T01:43:06.981 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63f00383a0 0x7f63f003a850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:06.981 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 --2- 172.21.15.31:0/1985977625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6404105b70 0x7f640407bc70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:06.981 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 >> 172.21.15.31:0/1985977625 conn(0x7f6404101220 msgr2=0x7f6404101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:06.981 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 shutdown_connections 2024-09-17T01:43:06.981 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:06.461+0000 7f640c2f0700 1 -- 172.21.15.31:0/1985977625 wait complete. 2024-09-17T01:43:06.981 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying alertmanager service with default placement... 2024-09-17T01:43:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:07 smithi031 ceph-mon[27673]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:07 smithi031 ceph-mon[27673]: Saving service node-exporter spec with placement * 2024-09-17T01:43:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:07 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:08.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-17T01:43:08.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.415+0000 7f777bfb1700 1 Processor -- start 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.415+0000 7f777bfb1700 1 -- start start 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f777bfb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774108a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f777bfb1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740744a0 con 0x7f7774106630 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f7779d4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774108a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f7779d4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774108a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50390/0 (socket says 172.21.15.31:50390) 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f7779d4d700 1 -- 172.21.15.31:0/3963244790 learned_addr learned my addr 172.21.15.31:0/3963244790 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f7779d4d700 1 -- 172.21.15.31:0/3963244790 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740745e0 con 0x7f7774106630 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f7779d4d700 1 --2- 172.21.15.31:0/3963244790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774108a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77700098a0 tx=0x7f7770009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c57fd741822f470 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.416+0000 7f7778d4b700 1 -- 172.21.15.31:0/3963244790 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7770004180 con 0x7f7774106630 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f7778d4b700 1 -- 172.21.15.31:0/3963244790 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77700042e0 con 0x7f7774106630 2024-09-17T01:43:08.205 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f7778d4b700 1 -- 172.21.15.31:0/3963244790 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7770011af0 con 0x7f7774106630 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 -- 172.21.15.31:0/3963244790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 msgr2=0x7f7774108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 --2- 172.21.15.31:0/3963244790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774108a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77700098a0 tx=0x7f7770009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 -- 172.21.15.31:0/3963244790 shutdown_connections 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 --2- 172.21.15.31:0/3963244790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774108a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 -- 172.21.15.31:0/3963244790 >> 172.21.15.31:0/3963244790 conn(0x7f77741000d0 msgr2=0x7f77741024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 -- 172.21.15.31:0/3963244790 shutdown_connections 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.417+0000 7f777bfb1700 1 -- 172.21.15.31:0/3963244790 wait complete. 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f777bfb1700 1 Processor -- start 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f777bfb1700 1 -- start start 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f777bfb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774105f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f777bfb1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77741064d0 con 0x7f7774106630 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f7779d4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f7779d4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774105f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50404/0 (socket says 172.21.15.31:50404) 2024-09-17T01:43:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f7779d4d700 1 -- 172.21.15.31:0/2521313868 learned_addr learned my addr 172.21.15.31:0/2521313868 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.418+0000 7f7779d4d700 1 -- 172.21.15.31:0/2521313868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770009550 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.419+0000 7f7779d4d700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774105f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7770006ba0 tx=0x7f7770011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.419+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7770003b00 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.419+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f777001a8e0 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.419+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77741045e0 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.419+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7770019990 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.419+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7774104a00 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.420+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7770019c00 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.420+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77740623f0 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.420+0000 7f776affd700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f77600383f0 0x7f776003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.420+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f777004c570 con 0x7f7774106630 2024-09-17T01:43:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.420+0000 7f777954c700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f77600383f0 0x7f776003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.421+0000 7f777954c700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f77600383f0 0x7f776003a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7764006fd0 tx=0x7f7764006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.425+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f77740623f0 con 0x7f7774106630 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.636+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f77740623f0 con 0x7f77600383f0 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.641+0000 7f776affd700 1 -- 172.21.15.31:0/2521313868 <== mgr.14120 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f77740623f0 con 0x7f77600383f0 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f77600383f0 msgr2=0x7f776003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f77600383f0 0x7f776003a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7764006fd0 tx=0x7f7764006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 msgr2=0x7f7774105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774105f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7770006ba0 tx=0x7f7770011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 shutdown_connections 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f77600383f0 0x7f776003a8a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 --2- 172.21.15.31:0/2521313868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7774106630 0x7f7774105f90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 >> 172.21.15.31:0/2521313868 conn(0x7f77741000d0 msgr2=0x7f7774101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:08.209 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 shutdown_connections 2024-09-17T01:43:08.209 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:07.643+0000 7f777bfb1700 1 -- 172.21.15.31:0/2521313868 wait complete. 2024-09-17T01:43:08.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:08 smithi031 ceph-mon[27673]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:08.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:08 smithi031 ceph-mon[27673]: Saving service alertmanager spec with placement count:1 2024-09-17T01:43:08.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:08 smithi031 ceph-mon[27673]: from='mgr.14120 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:08.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:08 smithi031 ceph-mon[27673]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8db667c700 1 Processor -- start 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8db667c700 1 -- start start 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8db667c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0104280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8db667c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db01047c0 con 0x7f8db0103e70 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8daffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8daffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50410/0 (socket says 172.21.15.31:50410) 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8daffff700 1 -- 172.21.15.31:0/2550560122 learned_addr learned my addr 172.21.15.31:0/2550560122 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.611+0000 7f8daffff700 1 -- 172.21.15.31:0/2550560122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0104900 con 0x7f8db0103e70 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8daffff700 1 --2- 172.21.15.31:0/2550560122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0104280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8da00098a0 tx=0x7f8da0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649be2cf5a212c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:09.435 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8daeffd700 1 -- 172.21.15.31:0/2550560122 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8da0004180 con 0x7f8db0103e70 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8daeffd700 1 -- 172.21.15.31:0/2550560122 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8da00042e0 con 0x7f8db0103e70 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8daeffd700 1 -- 172.21.15.31:0/2550560122 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8da0011af0 con 0x7f8db0103e70 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8db667c700 1 -- 172.21.15.31:0/2550560122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 msgr2=0x7f8db0104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8db667c700 1 --2- 172.21.15.31:0/2550560122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0104280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8da00098a0 tx=0x7f8da0009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8db667c700 1 -- 172.21.15.31:0/2550560122 shutdown_connections 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8db667c700 1 --2- 172.21.15.31:0/2550560122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0104280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8db667c700 1 -- 172.21.15.31:0/2550560122 >> 172.21.15.31:0/2550560122 conn(0x7f8db00ff870 msgr2=0x7f8db0101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.612+0000 7f8db667c700 1 -- 172.21.15.31:0/2550560122 shutdown_connections 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.613+0000 7f8db667c700 1 -- 172.21.15.31:0/2550560122 wait complete. 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.613+0000 7f8db667c700 1 Processor -- start 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.613+0000 7f8db667c700 1 -- start start 2024-09-17T01:43:09.436 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.613+0000 7f8db667c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:09.437 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.613+0000 7f8db667c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0199e90 con 0x7f8db0103e70 2024-09-17T01:43:09.437 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8daffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:09.437 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8daffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50424/0 (socket says 172.21.15.31:50424) 2024-09-17T01:43:09.437 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8daffff700 1 -- 172.21.15.31:0/2685219171 learned_addr learned my addr 172.21.15.31:0/2685219171 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:09.437 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8daffff700 1 -- 172.21.15.31:0/2685219171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da0009550 con 0x7f8db0103e70 2024-09-17T01:43:09.437 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8daffff700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0199950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8da0000c00 tx=0x7f8da0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8da0003a70 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8da0003bd0 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8da00238c0 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db019a090 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.614+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db019a4b0 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.615+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8da0023b30 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.615+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db0062380 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.615+0000 7f8dad7fa700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8d98038440 0x7f8d9803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.615+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8da004c370 con 0x7f8db0103e70 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.616+0000 7f8daf7fe700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8d98038440 0x7f8d9803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.616+0000 7f8daf7fe700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8d98038440 0x7f8d9803a8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8da4006fd0 tx=0x7f8da4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:09.438 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.620+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8da0010560 con 0x7f8db0103e70 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.818+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f8db019d650 con 0x7f8db0103e70 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.824+0000 7f8dad7fa700 1 -- 172.21.15.31:0/2685219171 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f8da001a8b0 con 0x7f8db0103e70 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.826+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8d98038440 msgr2=0x7f8d9803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.826+0000 7f8db667c700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8d98038440 0x7f8d9803a8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8da4006fd0 tx=0x7f8da4006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.826+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 msgr2=0x7f8db0199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.826+0000 7f8db667c700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0199950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8da0000c00 tx=0x7f8da0011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.826+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 shutdown_connections 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.827+0000 7f8db667c700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8d98038440 0x7f8d9803a8f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.827+0000 7f8db667c700 1 --2- 172.21.15.31:0/2685219171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db0103e70 0x7f8db0199950 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.827+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 >> 172.21.15.31:0/2685219171 conn(0x7f8db00ff870 msgr2=0x7f8db0100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.827+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 shutdown_connections 2024-09-17T01:43:09.439 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:08.827+0000 7f8db667c700 1 -- 172.21.15.31:0/2685219171 wait complete. 2024-09-17T01:43:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:09 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2685219171' entity='client.admin' 2024-09-17T01:43:10.599 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.838+0000 7f2f182e7700 1 Processor -- start 2024-09-17T01:43:10.599 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.838+0000 7f2f182e7700 1 -- start start 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.838+0000 7f2f182e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.838+0000 7f2f182e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101069b0 con 0x7f2f10106060 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.838+0000 7f2f16083700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f16083700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50428/0 (socket says 172.21.15.31:50428) 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f16083700 1 -- 172.21.15.31:0/3907781266 learned_addr learned my addr 172.21.15.31:0/3907781266 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f16083700 1 -- 172.21.15.31:0/3907781266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10106af0 con 0x7f2f10106060 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f16083700 1 --2- 172.21.15.31:0/3907781266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10106470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098a0 tx=0x7f2f0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d95cdcb959df581 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f15081700 1 -- 172.21.15.31:0/3907781266 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c004180 con 0x7f2f10106060 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f15081700 1 -- 172.21.15.31:0/3907781266 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c0042e0 con 0x7f2f10106060 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.839+0000 7f2f15081700 1 -- 172.21.15.31:0/3907781266 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c011af0 con 0x7f2f10106060 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 -- 172.21.15.31:0/3907781266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 msgr2=0x7f2f10106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 --2- 172.21.15.31:0/3907781266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10106470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098a0 tx=0x7f2f0c009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:10.600 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 -- 172.21.15.31:0/3907781266 shutdown_connections 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 --2- 172.21.15.31:0/3907781266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10106470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 -- 172.21.15.31:0/3907781266 >> 172.21.15.31:0/3907781266 conn(0x7f2f100ff870 msgr2=0x7f2f10101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 -- 172.21.15.31:0/3907781266 shutdown_connections 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 -- 172.21.15.31:0/3907781266 wait complete. 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.840+0000 7f2f182e7700 1 Processor -- start 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f182e7700 1 -- start start 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f182e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f182e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10197c40 con 0x7f2f10106060 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f16083700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f16083700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50430/0 (socket says 172.21.15.31:50430) 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f16083700 1 -- 172.21.15.31:0/1065970036 learned_addr learned my addr 172.21.15.31:0/1065970036 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f16083700 1 -- 172.21.15.31:0/1065970036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009550 con 0x7f2f10106060 2024-09-17T01:43:10.601 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f16083700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10197700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c006ba0 tx=0x7f2f0c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c003b00 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c01a8e0 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10197e40 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.841+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c0199c0 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.842+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f10198260 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.842+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2f0c019c80 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.842+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f101913b0 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.843+0000 7f2f077fe700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2efc03a5c0 0x7f2efc03ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.843+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2f0c04c800 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.843+0000 7f2f15882700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2efc03a5c0 0x7f2efc03ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.843+0000 7f2f15882700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2efc03a5c0 0x7f2efc03ca70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2f00006fd0 tx=0x7f2f00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:09.847+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2f0c02b700 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.049+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2f1002d050 con 0x7f2f10106060 2024-09-17T01:43:10.602 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.052+0000 7f2f077fe700 1 -- 172.21.15.31:0/1065970036 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2f0c02b340 con 0x7f2f10106060 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2efc03a5c0 msgr2=0x7f2efc03ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2efc03a5c0 0x7f2efc03ca70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2f00006fd0 tx=0x7f2f00006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 msgr2=0x7f2f10197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10197700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c006ba0 tx=0x7f2f0c011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 shutdown_connections 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2efc03a5c0 0x7f2efc03ca70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 --2- 172.21.15.31:0/1065970036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f10106060 0x7f2f10197700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 >> 172.21.15.31:0/1065970036 conn(0x7f2f100ff870 msgr2=0x7f2f1018e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 shutdown_connections 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:10.054+0000 7f2f182e7700 1 -- 172.21.15.31:0/1065970036 wait complete. 2024-09-17T01:43:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:Enabling the dashboard module... 2024-09-17T01:43:10.919 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:10 smithi031 ceph-mon[27673]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:10.920 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:10 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1065970036' entity='client.admin' 2024-09-17T01:43:12.107 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:11 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/618468838' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3bf546d700 1 Processor -- start 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3bf546d700 1 -- start start 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3bf546d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf0105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3bf546d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01064c0 con 0x7f3bf0105b70 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3beeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf0105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3beeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf0105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50436/0 (socket says 172.21.15.31:50436) 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.035+0000 7f3beeffd700 1 -- 172.21.15.31:0/1872192126 learned_addr learned my addr 172.21.15.31:0/1872192126 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3beeffd700 1 -- 172.21.15.31:0/1872192126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0106600 con 0x7f3bf0105b70 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3beeffd700 1 --2- 172.21.15.31:0/1872192126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf0105f80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3be00098a0 tx=0x7f3be0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546f5b63e3f5f41d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3bedffb700 1 -- 172.21.15.31:0/1872192126 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3be0004180 con 0x7f3bf0105b70 2024-09-17T01:43:12.422 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3bedffb700 1 -- 172.21.15.31:0/1872192126 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3be00042e0 con 0x7f3bf0105b70 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3bedffb700 1 -- 172.21.15.31:0/1872192126 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3be0011af0 con 0x7f3bf0105b70 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3bf546d700 1 -- 172.21.15.31:0/1872192126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 msgr2=0x7f3bf0105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.036+0000 7f3bf546d700 1 --2- 172.21.15.31:0/1872192126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf0105f80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3be00098a0 tx=0x7f3be0009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 -- 172.21.15.31:0/1872192126 shutdown_connections 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 --2- 172.21.15.31:0/1872192126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf0105f80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 -- 172.21.15.31:0/1872192126 >> 172.21.15.31:0/1872192126 conn(0x7f3bf0101220 msgr2=0x7f3bf0103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 -- 172.21.15.31:0/1872192126 shutdown_connections 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 -- 172.21.15.31:0/1872192126 wait complete. 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 Processor -- start 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.037+0000 7f3bf546d700 1 -- start start 2024-09-17T01:43:12.423 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3bf546d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf01998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3bf546d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0199e30 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3beeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf01998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3beeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf01998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50450/0 (socket says 172.21.15.31:50450) 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3beeffd700 1 -- 172.21.15.31:0/618468838 learned_addr learned my addr 172.21.15.31:0/618468838 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3beeffd700 1 -- 172.21.15.31:0/618468838 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009550 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3beeffd700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf01998f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3be0011ad0 tx=0x7f3be0011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3be0003ab0 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf019a030 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3be0003c10 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.038+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3be00198e0 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.039+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf019a450 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.039+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3be0019ba0 con 0x7f3bf0105b70 2024-09-17T01:43:12.424 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.039+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf010a000 con 0x7f3bf0105b70 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.040+0000 7f3bd7fff700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3bd80383f0 0x7f3bd803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.040+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3be004c3f0 con 0x7f3bf0105b70 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.040+0000 7f3bee7fc700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3bd80383f0 0x7f3bd803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.040+0000 7f3bee7fc700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3bd80383f0 0x7f3bd803a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3be4006fd0 tx=0x7f3be4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.044+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3be002b300 con 0x7f3bf0105b70 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.299+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f3bf00623d0 con 0x7f3bf0105b70 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.834+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f3be000bc80 con 0x7f3bf0105b70 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.836+0000 7f3bd7fff700 1 -- 172.21.15.31:0/618468838 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f3be0018350 con 0x7f3bf0105b70 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3bd80383f0 msgr2=0x7f3bd803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3bd80383f0 0x7f3bd803a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3be4006fd0 tx=0x7f3be4006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:12.425 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 msgr2=0x7f3bf01998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf01998f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3be0011ad0 tx=0x7f3be0011bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 shutdown_connections 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3bd80383f0 0x7f3bd803a8a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 --2- 172.21.15.31:0/618468838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bf0105b70 0x7f3bf01998f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.838+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 >> 172.21.15.31:0/618468838 conn(0x7f3bf0101220 msgr2=0x7f3bf0101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.839+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 shutdown_connections 2024-09-17T01:43:12.426 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:11.839+0000 7f3bf546d700 1 -- 172.21.15.31:0/618468838 wait complete. 2024-09-17T01:43:13.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:12 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/618468838' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T01:43:13.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:12 smithi031 ceph-mon[27673]: mgrmap e9: smithi031.ealpiz(active, since 26s) 2024-09-17T01:43:13.748 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:43:13.754 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "active_name": "smithi031.ealpiz", 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.881+0000 7fddb8de8700 1 Processor -- start 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.881+0000 7fddb8de8700 1 -- start start 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.881+0000 7fddb8de8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.881+0000 7fddb8de8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40744a0 con 0x7fddb4106690 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.755 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50474/0 (socket says 172.21.15.31:50474) 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb259c700 1 -- 172.21.15.31:0/1215702045 learned_addr learned my addr 172.21.15.31:0/1215702045 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb259c700 1 -- 172.21.15.31:0/1215702045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40745e0 con 0x7fddb4106690 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb259c700 1 --2- 172.21.15.31:0/1215702045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4108a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdda40098a0 tx=0x7fdda4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4983dd91babb8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb1d9b700 1 -- 172.21.15.31:0/1215702045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdda4004180 con 0x7fddb4106690 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb1d9b700 1 -- 172.21.15.31:0/1215702045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdda40042e0 con 0x7fddb4106690 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.882+0000 7fddb1d9b700 1 -- 172.21.15.31:0/1215702045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdda4011af0 con 0x7fddb4106690 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 -- 172.21.15.31:0/1215702045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 msgr2=0x7fddb4108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 --2- 172.21.15.31:0/1215702045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4108a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdda40098a0 tx=0x7fdda4009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.756 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 -- 172.21.15.31:0/1215702045 shutdown_connections 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 --2- 172.21.15.31:0/1215702045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4108a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 -- 172.21.15.31:0/1215702045 >> 172.21.15.31:0/1215702045 conn(0x7fddb4100110 msgr2=0x7fddb4102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 -- 172.21.15.31:0/1215702045 shutdown_connections 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.883+0000 7fddb8de8700 1 -- 172.21.15.31:0/1215702045 wait complete. 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb8de8700 1 Processor -- start 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb8de8700 1 -- start start 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb8de8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4105ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb8de8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4106530 con 0x7fddb4106690 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4105ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4105ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50486/0 (socket says 172.21.15.31:50486) 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.884+0000 7fddb259c700 1 -- 172.21.15.31:0/1775778442 learned_addr learned my addr 172.21.15.31:0/1775778442 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddb259c700 1 -- 172.21.15.31:0/1775778442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4009550 con 0x7fddb4106690 2024-09-17T01:43:13.757 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddb259c700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4105ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdda4000c00 tx=0x7fdda4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdda4003a70 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdda4003bd0 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb4104640 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdda40238c0 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.885+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb4104a60 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.886+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fdda4023b30 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.886+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4109c70 con 0x7fddb4106690 2024-09-17T01:43:13.758 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.886+0000 7fddab7fe700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 0x7fdda003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.886+0000 7fddabfff700 1 -- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 msgr2=0x7fdda003a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.886+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdda404c240 con 0x7fddb4106690 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.886+0000 7fddabfff700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 0x7fdda003a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:12.891+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdda4019c60 con 0x7fddb4106690 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.087+0000 7fddabfff700 1 -- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 msgr2=0x7fdda003a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.087+0000 7fddabfff700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 0x7fdda003a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.153+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fddb4109e60 con 0x7fddb4106690 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.153+0000 7fddab7fe700 1 -- 172.21.15.31:0/1775778442 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fdda4010b30 con 0x7fddb4106690 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 msgr2=0x7fdda003a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 0x7fdda003a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.759 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 msgr2=0x7fddb4105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4105ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdda4000c00 tx=0x7fdda4011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 shutdown_connections 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdda0038490 0x7fdda003a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 --2- 172.21.15.31:0/1775778442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddb4106690 0x7fddb4105ff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 >> 172.21.15.31:0/1775778442 conn(0x7fddb4100110 msgr2=0x7fddb41017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 shutdown_connections 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:13.156+0000 7fddb8de8700 1 -- 172.21.15.31:0/1775778442 wait complete. 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for the mgr to restart... 2024-09-17T01:43:13.760 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr epoch 9... 2024-09-17T01:43:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:13 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1775778442' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T01:43:19.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: Active manager daemon smithi031.ealpiz restarted 2024-09-17T01:43:19.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: Activating manager daemon smithi031.ealpiz 2024-09-17T01:43:19.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: mgrmap e10: smithi031.ealpiz(active, starting, since 0.00395034s) 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:19.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:18 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:43:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:19 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:43:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:19 smithi031 ceph-mon[27673]: mgrmap e11: smithi031.ealpiz(active, since 1.00587s) 2024-09-17T01:43:20.605 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:43:20.605 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T01:43:20.605 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f499568f700 1 Processor -- start 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f499568f700 1 -- start start 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f499568f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f4990105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f499568f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49901064c0 con 0x7f4990105b70 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f498effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f4990105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f498effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f4990105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49522/0 (socket says 172.21.15.31:49522) 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f498effd700 1 -- 172.21.15.31:0/4107340938 learned_addr learned my addr 172.21.15.31:0/4107340938 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.168+0000 7f498effd700 1 -- 172.21.15.31:0/4107340938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990106600 con 0x7f4990105b70 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.169+0000 7f498effd700 1 --2- 172.21.15.31:0/4107340938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f4990105f80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49800098a0 tx=0x7f4980009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59e5adb88486407 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.169+0000 7f498dffb700 1 -- 172.21.15.31:0/4107340938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4980004180 con 0x7f4990105b70 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.169+0000 7f498dffb700 1 -- 172.21.15.31:0/4107340938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49800042e0 con 0x7f4990105b70 2024-09-17T01:43:20.606 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.169+0000 7f498dffb700 1 -- 172.21.15.31:0/4107340938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4980011af0 con 0x7f4990105b70 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 -- 172.21.15.31:0/4107340938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 msgr2=0x7f4990105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 --2- 172.21.15.31:0/4107340938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f4990105f80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49800098a0 tx=0x7f4980009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 -- 172.21.15.31:0/4107340938 shutdown_connections 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 --2- 172.21.15.31:0/4107340938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f4990105f80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 -- 172.21.15.31:0/4107340938 >> 172.21.15.31:0/4107340938 conn(0x7f4990101220 msgr2=0x7f4990103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 -- 172.21.15.31:0/4107340938 shutdown_connections 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 -- 172.21.15.31:0/4107340938 wait complete. 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.170+0000 7f499568f700 1 Processor -- start 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f499568f700 1 -- start start 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f499568f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f49901998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f499568f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990199e30 con 0x7f4990105b70 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f498effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f49901998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:20.607 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f498effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f49901998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49524/0 (socket says 172.21.15.31:49524) 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f498effd700 1 -- 172.21.15.31:0/107086659 learned_addr learned my addr 172.21.15.31:0/107086659 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f498effd700 1 -- 172.21.15.31:0/107086659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4980009550 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.171+0000 7f498effd700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f49901998f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4980011ad0 tx=0x7f4980011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.172+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4980003ab0 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.172+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4980003c10 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.172+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499019a030 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.172+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49800198e0 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.172+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499019a450 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.173+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f498001a430 con 0x7f4990105b70 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.173+0000 7f4977fff700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.173+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f497803b050 con 0x7f4978038490 2024-09-17T01:43:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.173+0000 7f498e7fc700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.173+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f498004c180 con 0x7f4990105b70 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.173+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.374+0000 7f498e7fc700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.374+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.775+0000 7f498e7fc700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:14.775+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:15.576+0000 7f498e7fc700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:15.576+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:17.177+0000 7f498e7fc700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:17.177+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:18.825+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7f498001a780 con 0x7f4990105b70 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:18.825+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:18.825+0000 7f4977fff700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.825+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f498001cbf0 con 0x7f4990105b70 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.826+0000 7f4977fff700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.826+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f497803b050 con 0x7f4978038490 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.826+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.827+0000 7f498e7fc700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4984003a10 tx=0x7f4984009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.827+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f497803b050 con 0x7f4978038490 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f499019ac30 con 0x7f4978038490 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f4977fff700 1 -- 172.21.15.31:0/107086659 <== mgr.14164 v2:172.21.15.31:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f499019ac30 con 0x7f4978038490 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 msgr2=0x7f497803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4984003a10 tx=0x7f4984009270 comp rx=0 tx=0).stop 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 msgr2=0x7f49901998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f49901998f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4980011ad0 tx=0x7f4980011bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:20.610 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 shutdown_connections 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4978038490 0x7f497803a940 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 --2- 172.21.15.31:0/107086659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4990105b70 0x7f49901998f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.834+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 >> 172.21.15.31:0/107086659 conn(0x7f4990101220 msgr2=0x7f4990101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.835+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 shutdown_connections 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:19.835+0000 7f499568f700 1 -- 172.21.15.31:0/107086659 wait complete. 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:mgr epoch 9 is available 2024-09-17T01:43:20.611 INFO:teuthology.orchestra.run.smithi031.stdout:Generating a dashboard self-signed certificate... 2024-09-17T01:43:21.237 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:20 smithi031 ceph-mon[27673]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T01:43:21.237 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:20 smithi031 ceph-mon[27673]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T01:43:21.237 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:20 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:21.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T01:43:21.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60b8a2700 1 Processor -- start 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60b8a2700 1 -- start start 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60b8a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff604105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60b8a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6041064c0 con 0x7ff604105b70 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60963e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff604105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60963e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff604105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49584/0 (socket says 172.21.15.31:49584) 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.017+0000 7ff60963e700 1 -- 172.21.15.31:0/3384870526 learned_addr learned my addr 172.21.15.31:0/3384870526 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff60963e700 1 -- 172.21.15.31:0/3384870526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604106600 con 0x7ff604105b70 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff60963e700 1 --2- 172.21.15.31:0/3384870526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff604105f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff600009e80 tx=0x7ff60000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce76490535920eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff5fbfff700 1 -- 172.21.15.31:0/3384870526 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff60000e070 con 0x7ff604105b70 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff5fbfff700 1 -- 172.21.15.31:0/3384870526 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff60000b8c0 con 0x7ff604105b70 2024-09-17T01:43:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff5fbfff700 1 -- 172.21.15.31:0/3384870526 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6000044d0 con 0x7ff604105b70 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff60b8a2700 1 -- 172.21.15.31:0/3384870526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 msgr2=0x7ff604105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.018+0000 7ff60b8a2700 1 --2- 172.21.15.31:0/3384870526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff604105f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff600009e80 tx=0x7ff60000b330 comp rx=0 tx=0).stop 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 -- 172.21.15.31:0/3384870526 shutdown_connections 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 --2- 172.21.15.31:0/3384870526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff604105f80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 -- 172.21.15.31:0/3384870526 >> 172.21.15.31:0/3384870526 conn(0x7ff604101220 msgr2=0x7ff604103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 -- 172.21.15.31:0/3384870526 shutdown_connections 2024-09-17T01:43:21.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 -- 172.21.15.31:0/3384870526 wait complete. 2024-09-17T01:43:21.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 Processor -- start 2024-09-17T01:43:21.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 -- start start 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.019+0000 7ff60b8a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff60407bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60b8a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60407c1b0 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60963e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff60407bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60963e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff60407bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49600/0 (socket says 172.21.15.31:49600) 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60963e700 1 -- 172.21.15.31:0/685987302 learned_addr learned my addr 172.21.15.31:0/685987302 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60963e700 1 -- 172.21.15.31:0/685987302 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600009b30 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60963e700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff60407bc70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6000072a0 tx=0x7ff6000049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff60000e040 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff60000bd80 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60407a2c0 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6000126c0 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.020+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60407a740 con 0x7ff604105b70 2024-09-17T01:43:21.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.021+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7ff600019040 con 0x7ff604105b70 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.021+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff604062380 con 0x7ff604105b70 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.021+0000 7ff5fa7fc700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff5f0038330 0x7ff5f003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.021+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ff60004be70 con 0x7ff604105b70 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.021+0000 7ff608e3d700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff5f0038330 0x7ff5f003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.022+0000 7ff608e3d700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff5f0038330 0x7ff5f003a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006fd0 tx=0x7ff5f4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.026+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff600011750 con 0x7ff604105b70 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.081+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7ff600050070 con 0x7ff604105b70 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.238+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7ff604102670 con 0x7ff5f0038330 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.283+0000 7ff5fa7fc700 1 -- 172.21.15.31:0/685987302 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7ff604102670 con 0x7ff5f0038330 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff5f0038330 msgr2=0x7ff5f003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff5f0038330 0x7ff5f003a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4006fd0 tx=0x7ff5f4006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 msgr2=0x7ff60407bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:21.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff60407bc70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff6000072a0 tx=0x7ff6000049f0 comp rx=0 tx=0).stop 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 shutdown_connections 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff5f0038330 0x7ff5f003a7e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 --2- 172.21.15.31:0/685987302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff604105b70 0x7ff60407bc70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 >> 172.21.15.31:0/685987302 conn(0x7ff604101220 msgr2=0x7ff604101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 shutdown_connections 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:21.286+0000 7ff60b8a2700 1 -- 172.21.15.31:0/685987302 wait complete. 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi031.stdout:Creating initial admin user... 2024-09-17T01:43:21.986 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: [17/Sep/2024:01:43:20] ENGINE Bus STARTING 2024-09-17T01:43:21.986 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: [17/Sep/2024:01:43:20] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:43:21.986 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: [17/Sep/2024:01:43:20] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:43:21.986 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: [17/Sep/2024:01:43:20] ENGINE Bus STARTED 2024-09-17T01:43:21.986 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: mgrmap e12: smithi031.ealpiz(active, since 2s) 2024-09-17T01:43:21.986 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:21.987 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:21 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:23.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:22 smithi031 ceph-mon[27673]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:23.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:22 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:23.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:22 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Et/yzY5AcjyvNP295TBRX.FlaQoPe6lBC8mf2GKuDCHyOHnAm9gm.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726537402, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.302+0000 7f8e34629700 1 Processor -- start 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.302+0000 7f8e34629700 1 -- start start 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.302+0000 7f8e34629700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c1053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.302+0000 7f8e34629700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c105900 con 0x7f8e2c104fb0 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e323c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c1053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e323c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c1053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49608/0 (socket says 172.21.15.31:49608) 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e323c5700 1 -- 172.21.15.31:0/640244152 learned_addr learned my addr 172.21.15.31:0/640244152 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e323c5700 1 -- 172.21.15.31:0/640244152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c105a40 con 0x7f8e2c104fb0 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e323c5700 1 --2- 172.21.15.31:0/640244152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c1053c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e280098a0 tx=0x7f8e28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d33c21d4d6d5de server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e313c3700 1 -- 172.21.15.31:0/640244152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e28004180 con 0x7f8e2c104fb0 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e313c3700 1 -- 172.21.15.31:0/640244152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e280042e0 con 0x7f8e2c104fb0 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.303+0000 7f8e313c3700 1 -- 172.21.15.31:0/640244152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e28011af0 con 0x7f8e2c104fb0 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 -- 172.21.15.31:0/640244152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 msgr2=0x7f8e2c1053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 --2- 172.21.15.31:0/640244152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c1053c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e280098a0 tx=0x7f8e28009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 -- 172.21.15.31:0/640244152 shutdown_connections 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 --2- 172.21.15.31:0/640244152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c1053c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 -- 172.21.15.31:0/640244152 >> 172.21.15.31:0/640244152 conn(0x7f8e2c0ff880 msgr2=0x7f8e2c101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 -- 172.21.15.31:0/640244152 shutdown_connections 2024-09-17T01:43:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.304+0000 7f8e34629700 1 -- 172.21.15.31:0/640244152 wait complete. 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.305+0000 7f8e34629700 1 Processor -- start 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.305+0000 7f8e34629700 1 -- start start 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.305+0000 7f8e34629700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.305+0000 7f8e34629700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c199e70 con 0x7f8e2c104fb0 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e323c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e323c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49618/0 (socket says 172.21.15.31:49618) 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e323c5700 1 -- 172.21.15.31:0/2005177494 learned_addr learned my addr 172.21.15.31:0/2005177494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e323c5700 1 -- 172.21.15.31:0/2005177494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009550 con 0x7f8e2c104fb0 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e323c5700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c199930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e28000c00 tx=0x7f8e28011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e28003a70 con 0x7f8e2c104fb0 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e28003bd0 con 0x7f8e2c104fb0 2024-09-17T01:43:23.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c19a070 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e280238c0 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.306+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c19a490 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.307+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f8e28023b80 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.307+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c062380 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.308+0000 7f8e237fe700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e18038440 0x7f8e1803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.308+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f8e2804c3b0 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.308+0000 7f8e31bc4700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e18038440 0x7f8e1803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.308+0000 7f8e31bc4700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e18038440 0x7f8e1803a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c006fd0 tx=0x7f8e1c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.312+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e2802b300 con 0x7f8e2c104fb0 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.538+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8e2c108fa0 con 0x7f8e18038440 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.785+0000 7f8e237fe700 1 -- 172.21.15.31:0/2005177494 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f8e1c009e20 con 0x7f8e18038440 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e18038440 msgr2=0x7f8e1803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e18038440 0x7f8e1803a8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c006fd0 tx=0x7f8e1c006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 msgr2=0x7f8e2c199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c199930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e28000c00 tx=0x7f8e28011b50 comp rx=0 tx=0).stop 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 shutdown_connections 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8e18038440 0x7f8e1803a8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 --2- 172.21.15.31:0/2005177494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c104fb0 0x7f8e2c199930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.787+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 >> 172.21.15.31:0/2005177494 conn(0x7f8e2c0ff880 msgr2=0x7f8e2c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.788+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 shutdown_connections 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:22.788+0000 7f8e34629700 1 -- 172.21.15.31:0/2005177494 wait complete. 2024-09-17T01:43:23.549 INFO:teuthology.orchestra.run.smithi031.stdout:Fetching dashboard port number... 2024-09-17T01:43:23.922 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:23 smithi031 ceph-mon[27673]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:24.961 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:24 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/748813857' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T01:43:25.250 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T01:43:25.251 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37de91f700 1 Processor -- start 2024-09-17T01:43:25.251 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37de91f700 1 -- start start 2024-09-17T01:43:25.251 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37de91f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d8105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:25.251 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37de91f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d81064c0 con 0x7f37d8105b70 2024-09-17T01:43:25.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37d7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d8105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:25.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37d7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d8105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39096/0 (socket says 172.21.15.31:39096) 2024-09-17T01:43:25.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.432+0000 7f37d7fff700 1 -- 172.21.15.31:0/3764017563 learned_addr learned my addr 172.21.15.31:0/3764017563 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:25.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.433+0000 7f37d7fff700 1 -- 172.21.15.31:0/3764017563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8106600 con 0x7f37d8105b70 2024-09-17T01:43:25.252 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.433+0000 7f37d7fff700 1 --2- 172.21.15.31:0/3764017563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d8105f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c80098a0 tx=0x7f37c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fae0473d49aff server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:25.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.433+0000 7f37d6ffd700 1 -- 172.21.15.31:0/3764017563 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37c8004180 con 0x7f37d8105b70 2024-09-17T01:43:25.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.433+0000 7f37d6ffd700 1 -- 172.21.15.31:0/3764017563 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37c80042e0 con 0x7f37d8105b70 2024-09-17T01:43:25.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.433+0000 7f37d6ffd700 1 -- 172.21.15.31:0/3764017563 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37c8011af0 con 0x7f37d8105b70 2024-09-17T01:43:25.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 -- 172.21.15.31:0/3764017563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 msgr2=0x7f37d8105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:25.253 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 --2- 172.21.15.31:0/3764017563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d8105f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c80098a0 tx=0x7f37c8009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:25.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 -- 172.21.15.31:0/3764017563 shutdown_connections 2024-09-17T01:43:25.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 --2- 172.21.15.31:0/3764017563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d8105f80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:25.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 -- 172.21.15.31:0/3764017563 >> 172.21.15.31:0/3764017563 conn(0x7f37d8101220 msgr2=0x7f37d8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:25.254 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 -- 172.21.15.31:0/3764017563 shutdown_connections 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 -- 172.21.15.31:0/3764017563 wait complete. 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 Processor -- start 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.434+0000 7f37de91f700 1 -- start start 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37de91f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d807bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37de91f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d807c1b0 con 0x7f37d8105b70 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d807bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:25.255 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d807bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39106/0 (socket says 172.21.15.31:39106) 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d7fff700 1 -- 172.21.15.31:0/748813857 learned_addr learned my addr 172.21.15.31:0/748813857 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d7fff700 1 -- 172.21.15.31:0/748813857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8009550 con 0x7f37d8105b70 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d7fff700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d807bc70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37c8011ad0 tx=0x7f37c8011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37c8003ab0 con 0x7f37d8105b70 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37c8003c10 con 0x7f37d8105b70 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d807a2c0 con 0x7f37d8105b70 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.435+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37c80198e0 con 0x7f37d8105b70 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.436+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d807a6e0 con 0x7f37d8105b70 2024-09-17T01:43:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.436+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f37c8019b50 con 0x7f37d8105b70 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.436+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d8062380 con 0x7f37d8105b70 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.437+0000 7f37d57fa700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f37c0038490 0x7f37c003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.437+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f37c804c4d0 con 0x7f37d8105b70 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.437+0000 7f37d77fe700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f37c0038490 0x7f37c003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.437+0000 7f37d77fe700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f37c0038490 0x7f37c003a940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37cc006fd0 tx=0x7f37cc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.442+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f37c802b300 con 0x7f37d8105b70 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.642+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f37d8107a20 con 0x7f37d8105b70 2024-09-17T01:43:25.257 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.643+0000 7f37d57fa700 1 -- 172.21.15.31:0/748813857 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f37c8010b70 con 0x7f37d8105b70 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f37c0038490 msgr2=0x7f37c003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f37c0038490 0x7f37c003a940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37cc006fd0 tx=0x7f37cc006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 msgr2=0x7f37d807bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d807bc70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37c8011ad0 tx=0x7f37c8011bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 shutdown_connections 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f37c0038490 0x7f37c003a940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 --2- 172.21.15.31:0/748813857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37d8105b70 0x7f37d807bc70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 >> 172.21.15.31:0/748813857 conn(0x7f37d8101220 msgr2=0x7f37d8101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 shutdown_connections 2024-09-17T01:43:25.258 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:24.645+0000 7f37de91f700 1 -- 172.21.15.31:0/748813857 wait complete. 2024-09-17T01:43:25.260 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:43:25.260 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-09-17T01:43:25.260 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:43:25.261 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-09-17T01:43:25.261 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-09-17T01:43:25.261 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T01:43:25.261 INFO:teuthology.orchestra.run.smithi031.stdout:Ceph Dashboard is now available at: 2024-09-17T01:43:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: URL: https://smithi031.front.sepia.ceph.com:8443/ 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: User: admin 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: Password: 85tjxnjy8x 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:25.263 INFO:teuthology.orchestra.run.smithi031.stdout:Saving cluster configuration to /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config directory 2024-09-17T01:43:25.263 INFO:teuthology.orchestra.run.smithi031.stdout:Enabling autotune for osd_memory_target 2024-09-17T01:43:26.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:25 smithi031 ceph-mon[27673]: mgrmap e13: smithi031.ealpiz(active, since 6s) 2024-09-17T01:43:26.449 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.674+0000 7f2d7a234700 1 Processor -- start 2024-09-17T01:43:26.449 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.674+0000 7f2d7a234700 1 -- start start 2024-09-17T01:43:26.449 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.674+0000 7f2d7a234700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d74105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:26.449 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.674+0000 7f2d7a234700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741064c0 con 0x7f2d74105b70 2024-09-17T01:43:26.449 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d74105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:26.449 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d74105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39114/0 (socket says 172.21.15.31:39114) 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d737fe700 1 -- 172.21.15.31:0/3878204893 learned_addr learned my addr 172.21.15.31:0/3878204893 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d737fe700 1 -- 172.21.15.31:0/3878204893 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74106600 con 0x7f2d74105b70 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d737fe700 1 --2- 172.21.15.31:0/3878204893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d74105f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009e80 tx=0x7f2d6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44f384828b5e2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d72ffd700 1 -- 172.21.15.31:0/3878204893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d6400e070 con 0x7f2d74105b70 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d72ffd700 1 -- 172.21.15.31:0/3878204893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d6400b8c0 con 0x7f2d74105b70 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.675+0000 7f2d72ffd700 1 -- 172.21.15.31:0/3878204893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d640044d0 con 0x7f2d74105b70 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 -- 172.21.15.31:0/3878204893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 msgr2=0x7f2d74105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 --2- 172.21.15.31:0/3878204893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d74105f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009e80 tx=0x7f2d6400b330 comp rx=0 tx=0).stop 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 -- 172.21.15.31:0/3878204893 shutdown_connections 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 --2- 172.21.15.31:0/3878204893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d74105f80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 -- 172.21.15.31:0/3878204893 >> 172.21.15.31:0/3878204893 conn(0x7f2d74101220 msgr2=0x7f2d74103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 -- 172.21.15.31:0/3878204893 shutdown_connections 2024-09-17T01:43:26.450 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 -- 172.21.15.31:0/3878204893 wait complete. 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 Processor -- start 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.676+0000 7f2d7a234700 1 -- start start 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d7a234700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d741998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d7a234700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74199de0 con 0x7f2d74105b70 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d741998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d737fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d741998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39116/0 (socket says 172.21.15.31:39116) 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d737fe700 1 -- 172.21.15.31:0/1784340684 learned_addr learned my addr 172.21.15.31:0/1784340684 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d737fe700 1 -- 172.21.15.31:0/1784340684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d64009b30 con 0x7f2d74105b70 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d737fe700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d741998a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d640072a0 tx=0x7f2d640049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d6400e040 con 0x7f2d74105b70 2024-09-17T01:43:26.451 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d6400bd80 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.677+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74199fe0 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.678+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d640126c0 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.678+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7419a460 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.678+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2d64019040 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.678+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d74062380 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.679+0000 7f2d717fa700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2d600384a0 0x7f2d6003a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.679+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f2d6404c0f0 con 0x7f2d74105b70 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.679+0000 7f2d6affd700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2d600384a0 0x7f2d6003a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.679+0000 7f2d6affd700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2d600384a0 0x7f2d6003a950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:26.452 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.684+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2d6402cc30 con 0x7f2d74105b70 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.881+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f2d74107a20 con 0x7f2d74105b70 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.882+0000 7f2d717fa700 1 -- 172.21.15.31:0/1784340684 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2d6401f070 con 0x7f2d74105b70 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.884+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2d600384a0 msgr2=0x7f2d6003a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.884+0000 7f2d7a234700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2d600384a0 0x7f2d6003a950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.884+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 msgr2=0x7f2d741998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.884+0000 7f2d7a234700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d741998a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d640072a0 tx=0x7f2d640049f0 comp rx=0 tx=0).stop 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.884+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 shutdown_connections 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.885+0000 7f2d7a234700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2d600384a0 0x7f2d6003a950 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.885+0000 7f2d7a234700 1 --2- 172.21.15.31:0/1784340684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d74105b70 0x7f2d741998a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.885+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 >> 172.21.15.31:0/1784340684 conn(0x7f2d74101220 msgr2=0x7f2d74101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.885+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 shutdown_connections 2024-09-17T01:43:26.453 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:25.885+0000 7f2d7a234700 1 -- 172.21.15.31:0/1784340684 wait complete. 2024-09-17T01:43:27.713 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f771a010700 1 Processor -- start 2024-09-17T01:43:27.713 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f771a010700 1 -- start start 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f771a010700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f7714105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f771a010700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141064c0 con 0x7f7714105b70 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f77137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f7714105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f77137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f7714105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39122/0 (socket says 172.21.15.31:39122) 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f77137fe700 1 -- 172.21.15.31:0/2899140040 learned_addr learned my addr 172.21.15.31:0/2899140040 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.843+0000 7f77137fe700 1 -- 172.21.15.31:0/2899140040 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714106600 con 0x7f7714105b70 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f77137fe700 1 --2- 172.21.15.31:0/2899140040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f7714105f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0098a0 tx=0x7f76fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b676079d26a7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f77127fc700 1 -- 172.21.15.31:0/2899140040 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76fc004180 con 0x7f7714105b70 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f77127fc700 1 -- 172.21.15.31:0/2899140040 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76fc0042e0 con 0x7f7714105b70 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f77127fc700 1 -- 172.21.15.31:0/2899140040 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76fc011af0 con 0x7f7714105b70 2024-09-17T01:43:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 -- 172.21.15.31:0/2899140040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 msgr2=0x7f7714105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 --2- 172.21.15.31:0/2899140040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f7714105f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0098a0 tx=0x7f76fc009bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 -- 172.21.15.31:0/2899140040 shutdown_connections 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 --2- 172.21.15.31:0/2899140040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f7714105f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 -- 172.21.15.31:0/2899140040 >> 172.21.15.31:0/2899140040 conn(0x7f7714101220 msgr2=0x7f7714103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 -- 172.21.15.31:0/2899140040 shutdown_connections 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.844+0000 7f771a010700 1 -- 172.21.15.31:0/2899140040 wait complete. 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.845+0000 7f771a010700 1 Processor -- start 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.845+0000 7f771a010700 1 -- start start 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.845+0000 7f771a010700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f77141998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.845+0000 7f771a010700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714199e30 con 0x7f7714105b70 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f77137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f77141998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f77137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f77141998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39130/0 (socket says 172.21.15.31:39130) 2024-09-17T01:43:27.715 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f77137fe700 1 -- 172.21.15.31:0/1457371931 learned_addr learned my addr 172.21.15.31:0/1457371931 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f77137fe700 1 -- 172.21.15.31:0/1457371931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc009550 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f77137fe700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f77141998f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76fc011ad0 tx=0x7f76fc011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76fc003ab0 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76fc003c10 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76fc0198e0 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771419a030 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.846+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771419a450 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.847+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f76fc019b50 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.847+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771410a000 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.847+0000 7f7710ff9700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7700038530 0x7f770003a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.847+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f76fc04c580 con 0x7f7714105b70 2024-09-17T01:43:27.716 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.847+0000 7f7712ffd700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7700038530 0x7f770003a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.848+0000 7f7712ffd700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7700038530 0x7f770003a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7704006fd0 tx=0x7f7704006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:26.852+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f76fc02b300 con 0x7f7714105b70 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.164+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f77140623d0 con 0x7f7714105b70 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.167+0000 7f7710ff9700 1 -- 172.21.15.31:0/1457371931 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f76fc010b70 con 0x7f7714105b70 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7700038530 msgr2=0x7f770003a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7700038530 0x7f770003a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7704006fd0 tx=0x7f7704006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 msgr2=0x7f77141998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f77141998f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76fc011ad0 tx=0x7f76fc011bb0 comp rx=0 tx=0).stop 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 shutdown_connections 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7700038530 0x7f770003a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 --2- 172.21.15.31:0/1457371931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7714105b70 0x7f77141998f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 >> 172.21.15.31:0/1457371931 conn(0x7f7714101220 msgr2=0x7f7714101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:27.717 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 shutdown_connections 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-09-17T01:43:27.169+0000 7f771a010700 1 -- 172.21.15.31:0/1457371931 wait complete. 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.718 INFO:teuthology.orchestra.run.smithi031.stdout: ceph telemetry on 2024-09-17T01:43:27.719 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.719 INFO:teuthology.orchestra.run.smithi031.stdout:For more information see: 2024-09-17T01:43:27.719 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.719 INFO:teuthology.orchestra.run.smithi031.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T01:43:27.719 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:27.719 INFO:teuthology.orchestra.run.smithi031.stdout:Bootstrap complete. 2024-09-17T01:43:27.742 INFO:tasks.cephadm:Fetching config... 2024-09-17T01:43:27.742 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:43:27.742 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T01:43:27.759 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T01:43:27.760 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:43:27.760 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T01:43:27.817 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T01:43:27.817 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:43:27.817 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/keyring of=/dev/stdout 2024-09-17T01:43:27.883 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T01:43:27.884 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:43:27.884 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T01:43:27.940 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T01:43:27.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvP3t0rzla7vx4YB5JzPVFdD3ClwgPkxAJaJXXJSKhuihgNsODA3j8EwXPp1i3uW+jtgS091tO+ZTwJLQTPZ2WiC5JQc1fISiBL5Z0SyqeX9JsSrMOneUVBgI7gKy3i9PE2jMboxWkia9yX2q8/L9JMlVCwQInHAVKjmTFnwMsspbi9fQ+Lg9OTItacBGVuc2iwn7g5lr26uCPa6LE4nSVi/Rc8qerhxK7T6i3uy997x7LLsvKvN++avFd2jLCv5bUq6fkyMOSO8Fvzh+RvTdxmLDERzbo5Rk7M1g5L9e2lZvF5EMazPQi/SmnbgFegvFj/baMzy55362gDfRQhx7ErfeNmzsSoYr0lx7va9Kx1eB2ZlNmHn72cdGVxqOka+qv976CRhdFYphGEIXFVPwn0jB2Puk/HFJfnoUjz3Tmwjw8Q3w5UcW1Jag4ZTmz/yi+fJuYpG12rEAnkDeXHD/wUFmXX/gSfdg4v/8+zHT0LOQ2kFKRGjK3E5kqYGMIuiU= ceph-fb7c6180-7495-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T01:43:28.015 INFO:teuthology.orchestra.run.smithi031.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvP3t0rzla7vx4YB5JzPVFdD3ClwgPkxAJaJXXJSKhuihgNsODA3j8EwXPp1i3uW+jtgS091tO+ZTwJLQTPZ2WiC5JQc1fISiBL5Z0SyqeX9JsSrMOneUVBgI7gKy3i9PE2jMboxWkia9yX2q8/L9JMlVCwQInHAVKjmTFnwMsspbi9fQ+Lg9OTItacBGVuc2iwn7g5lr26uCPa6LE4nSVi/Rc8qerhxK7T6i3uy997x7LLsvKvN++avFd2jLCv5bUq6fkyMOSO8Fvzh+RvTdxmLDERzbo5Rk7M1g5L9e2lZvF5EMazPQi/SmnbgFegvFj/baMzy55362gDfRQhx7ErfeNmzsSoYr0lx7va9Kx1eB2ZlNmHn72cdGVxqOka+qv976CRhdFYphGEIXFVPwn0jB2Puk/HFJfnoUjz3Tmwjw8Q3w5UcW1Jag4ZTmz/yi+fJuYpG12rEAnkDeXHD/wUFmXX/gSfdg4v/8+zHT0LOQ2kFKRGjK3E5kqYGMIuiU= ceph-fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:43:28.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvP3t0rzla7vx4YB5JzPVFdD3ClwgPkxAJaJXXJSKhuihgNsODA3j8EwXPp1i3uW+jtgS091tO+ZTwJLQTPZ2WiC5JQc1fISiBL5Z0SyqeX9JsSrMOneUVBgI7gKy3i9PE2jMboxWkia9yX2q8/L9JMlVCwQInHAVKjmTFnwMsspbi9fQ+Lg9OTItacBGVuc2iwn7g5lr26uCPa6LE4nSVi/Rc8qerhxK7T6i3uy997x7LLsvKvN++avFd2jLCv5bUq6fkyMOSO8Fvzh+RvTdxmLDERzbo5Rk7M1g5L9e2lZvF5EMazPQi/SmnbgFegvFj/baMzy55362gDfRQhx7ErfeNmzsSoYr0lx7va9Kx1eB2ZlNmHn72cdGVxqOka+qv976CRhdFYphGEIXFVPwn0jB2Puk/HFJfnoUjz3Tmwjw8Q3w5UcW1Jag4ZTmz/yi+fJuYpG12rEAnkDeXHD/wUFmXX/gSfdg4v/8+zHT0LOQ2kFKRGjK3E5kqYGMIuiU= ceph-fb7c6180-7495-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T01:43:28.074 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvP3t0rzla7vx4YB5JzPVFdD3ClwgPkxAJaJXXJSKhuihgNsODA3j8EwXPp1i3uW+jtgS091tO+ZTwJLQTPZ2WiC5JQc1fISiBL5Z0SyqeX9JsSrMOneUVBgI7gKy3i9PE2jMboxWkia9yX2q8/L9JMlVCwQInHAVKjmTFnwMsspbi9fQ+Lg9OTItacBGVuc2iwn7g5lr26uCPa6LE4nSVi/Rc8qerhxK7T6i3uy997x7LLsvKvN++avFd2jLCv5bUq6fkyMOSO8Fvzh+RvTdxmLDERzbo5Rk7M1g5L9e2lZvF5EMazPQi/SmnbgFegvFj/baMzy55362gDfRQhx7ErfeNmzsSoYr0lx7va9Kx1eB2ZlNmHn72cdGVxqOka+qv976CRhdFYphGEIXFVPwn0jB2Puk/HFJfnoUjz3Tmwjw8Q3w5UcW1Jag4ZTmz/yi+fJuYpG12rEAnkDeXHD/wUFmXX/gSfdg4v/8+zHT0LOQ2kFKRGjK3E5kqYGMIuiU= ceph-fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:43:28.088 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T01:43:28.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:28 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1457371931' entity='client.admin' 2024-09-17T01:43:28.327 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 -- 172.21.15.31:0/1218675158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 msgr2=0x7ff0180ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 --2- 172.21.15.31:0/1218675158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff0180ff130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff008009910 tx=0x7ff008009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 -- 172.21.15.31:0/1218675158 shutdown_connections 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 --2- 172.21.15.31:0/1218675158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff0180ff130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 -- 172.21.15.31:0/1218675158 >> 172.21.15.31:0/1218675158 conn(0x7ff0180fa2b0 msgr2=0x7ff0180fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 -- 172.21.15.31:0/1218675158 shutdown_connections 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.660+0000 7ff01d72e700 1 -- 172.21.15.31:0/1218675158 wait complete. 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff01d72e700 1 Processor -- start 2024-09-17T01:43:30.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff01d72e700 1 -- start start 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff01d72e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff018193ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff01d72e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181943e0 con 0x7ff0180fed20 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff016ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff018193ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff016ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff018193ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39156/0 (socket says 172.21.15.31:39156) 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff016ffd700 1 -- 172.21.15.31:0/2410412474 learned_addr learned my addr 172.21.15.31:0/2410412474 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.661+0000 7ff016ffd700 1 -- 172.21.15.31:0/2410412474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080095f0 con 0x7ff0180fed20 2024-09-17T01:43:30.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.662+0000 7ff016ffd700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff018193ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff008005950 tx=0x7ff008009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:30.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.662+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00801d070 con 0x7ff0180fed20 2024-09-17T01:43:30.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.662+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0181945e0 con 0x7ff0180fed20 2024-09-17T01:43:30.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.662+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff00800be10 con 0x7ff0180fed20 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.662+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00800f460 con 0x7ff0180fed20 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.662+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff018194a80 con 0x7ff0180fed20 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.663+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff00800f690 con 0x7ff0180fed20 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.663+0000 7feffffff700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff000038490 0x7ff00003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.663+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ff00800b960 con 0x7ff0180fed20 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.663+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01818da00 con 0x7ff0180fed20 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.663+0000 7ff0167fc700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff000038490 0x7ff00003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:30.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.664+0000 7ff0167fc700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff000038490 0x7ff00003a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff00c006fd0 tx=0x7ff00c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:30.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.668+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff008027070 con 0x7ff0180fed20 2024-09-17T01:43:30.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.869+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ff01802cee0 con 0x7ff0180fed20 2024-09-17T01:43:30.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.872+0000 7feffffff700 1 -- 172.21.15.31:0/2410412474 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff00802c440 con 0x7ff0180fed20 2024-09-17T01:43:30.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff000038490 msgr2=0x7ff00003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff000038490 0x7ff00003a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff00c006fd0 tx=0x7ff00c006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 msgr2=0x7ff018193ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff018193ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff008005950 tx=0x7ff008009e60 comp rx=0 tx=0).stop 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 shutdown_connections 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff000038490 0x7ff00003a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 --2- 172.21.15.31:0/2410412474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0180fed20 0x7ff018193ea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 >> 172.21.15.31:0/2410412474 conn(0x7ff0180fa2b0 msgr2=0x7ff0180faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 shutdown_connections 2024-09-17T01:43:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:30.875+0000 7ff01d72e700 1 -- 172.21.15.31:0/2410412474 wait complete. 2024-09-17T01:43:31.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:31.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:31.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi031", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:43:31.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:31.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:43:31.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:43:31.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:31.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: Deploying daemon ceph-exporter.smithi031 on smithi031 2024-09-17T01:43:31.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:31 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2410412474' entity='client.admin' 2024-09-17T01:43:31.572 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T01:43:31.573 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T01:43:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.933+0000 7f3fcb093700 1 -- 172.21.15.31:0/1640234614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 msgr2=0x7f3fc40ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.933+0000 7f3fcb093700 1 --2- 172.21.15.31:0/1640234614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40ff140 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009910 tx=0x7f3fb8009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.933+0000 7f3fcb093700 1 -- 172.21.15.31:0/1640234614 shutdown_connections 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.933+0000 7f3fcb093700 1 --2- 172.21.15.31:0/1640234614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40ff140 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.933+0000 7f3fcb093700 1 -- 172.21.15.31:0/1640234614 >> 172.21.15.31:0/1640234614 conn(0x7f3fc40fa2c0 msgr2=0x7f3fc40fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.934+0000 7f3fcb093700 1 -- 172.21.15.31:0/1640234614 shutdown_connections 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.934+0000 7f3fcb093700 1 -- 172.21.15.31:0/1640234614 wait complete. 2024-09-17T01:43:34.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.934+0000 7f3fcb093700 1 Processor -- start 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.934+0000 7f3fcb093700 1 -- start start 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.934+0000 7f3fcb093700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.934+0000 7f3fcb093700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4197cc0 con 0x7f3fc40fed30 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc8e2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc8e2f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48262/0 (socket says 172.21.15.31:48262) 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc8e2f700 1 -- 172.21.15.31:0/2547920767 learned_addr learned my addr 172.21.15.31:0/2547920767 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc8e2f700 1 -- 172.21.15.31:0/2547920767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80095f0 con 0x7f3fc40fed30 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc8e2f700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40693a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8005b40 tx=0x7f3fb8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fb801d070 con 0x7f3fc40fed30 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3fb800be10 con 0x7f3fc40fed30 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fb800f460 con 0x7f3fc40fed30 2024-09-17T01:43:34.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.935+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4197e00 con 0x7f3fc40fed30 2024-09-17T01:43:34.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.936+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc41982a0 con 0x7f3fc40fed30 2024-09-17T01:43:34.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.936+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f3fb80227e0 con 0x7f3fc40fed30 2024-09-17T01:43:34.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.936+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc418da10 con 0x7f3fc40fed30 2024-09-17T01:43:34.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.936+0000 7f3fc1ffb700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3fb4038490 0x7f3fb403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:34.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.937+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f3fb804c390 con 0x7f3fc40fed30 2024-09-17T01:43:34.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.937+0000 7f3fc3fff700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3fb4038490 0x7f3fb403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:34.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.937+0000 7f3fc3fff700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3fb4038490 0x7f3fb403a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0006fd0 tx=0x7f3fb0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:34.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:34.941+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3fb8013250 con 0x7f3fc40fed30 2024-09-17T01:43:35.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.150+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fc4061220 con 0x7f3fb4038490 2024-09-17T01:43:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.154+0000 7f3fc1ffb700 1 -- 172.21.15.31:0/2547920767 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3fc4061220 con 0x7f3fb4038490 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3fb4038490 msgr2=0x7f3fb403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3fb4038490 0x7f3fb403a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0006fd0 tx=0x7f3fb0006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 msgr2=0x7f3fc40693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40693a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8005b40 tx=0x7f3fb8004740 comp rx=0 tx=0).stop 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 shutdown_connections 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3fb4038490 0x7f3fb403a940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 --2- 172.21.15.31:0/2547920767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fc40fed30 0x7f3fc40693a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 >> 172.21.15.31:0/2547920767 conn(0x7f3fc40fa2c0 msgr2=0x7f3fc40faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 shutdown_connections 2024-09-17T01:43:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:35.156+0000 7f3fcb093700 1 -- 172.21.15.31:0/2547920767 wait complete. 2024-09-17T01:43:36.014 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi092 2024-09-17T01:43:36.014 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:43:36.015 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.conf 2024-09-17T01:43:36.035 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:43:36.035 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:43:36.092 INFO:tasks.cephadm:Adding host smithi092 to orchestrator... 2024-09-17T01:43:36.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch host add smithi092 2024-09-17T01:43:36.375 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:36.375 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:36.376 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:36 smithi031 ceph-mon[27673]: Deploying daemon crash.smithi031 on smithi031 2024-09-17T01:43:36.761 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:43:38.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 -- 172.21.15.31:0/1096456699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 msgr2=0x7f90200ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 --2- 172.21.15.31:0/1096456699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200ff130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f901c009910 tx=0x7f901c009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 -- 172.21.15.31:0/1096456699 shutdown_connections 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 --2- 172.21.15.31:0/1096456699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200ff130 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 -- 172.21.15.31:0/1096456699 >> 172.21.15.31:0/1096456699 conn(0x7f90200fa2b0 msgr2=0x7f90200fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 -- 172.21.15.31:0/1096456699 shutdown_connections 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.869+0000 7f9027388700 1 -- 172.21.15.31:0/1096456699 wait complete. 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9027388700 1 Processor -- start 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9027388700 1 -- start start 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9027388700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9027388700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90200fc7a0 con 0x7f90200fed20 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9025124700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9025124700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48280/0 (socket says 172.21.15.31:48280) 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9025124700 1 -- 172.21.15.31:0/1594126632 learned_addr learned my addr 172.21.15.31:0/1594126632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9025124700 1 -- 172.21.15.31:0/1594126632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0095f0 con 0x7f90200fed20 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.870+0000 7f9025124700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200fc260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f901c005950 tx=0x7f901c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.871+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c01d070 con 0x7f90200fed20 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.871+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f901c00be10 con 0x7f90200fed20 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.871+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90200fa8b0 con 0x7f90200fed20 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.871+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f901c00f460 con 0x7f90200fed20 2024-09-17T01:43:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.871+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90200fad50 con 0x7f90200fed20 2024-09-17T01:43:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.872+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f901c00f5c0 con 0x7f90200fed20 2024-09-17T01:43:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.872+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9020062380 con 0x7f90200fed20 2024-09-17T01:43:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.872+0000 7f90167fc700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f900c0384e0 0x7f900c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.872+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f901c04c3b0 con 0x7f90200fed20 2024-09-17T01:43:38.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.872+0000 7f9024923700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f900c0384e0 0x7f900c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.872+0000 7f9024923700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f900c0384e0 0x7f900c03a990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9010006fd0 tx=0x7f9010006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:38.877+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f901c02a360 con 0x7f90200fed20 2024-09-17T01:43:39.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:39.106+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}) v1 -- 0x7f90200faf90 con 0x7f900c0384e0 2024-09-17T01:43:40.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:39 smithi031 ceph-mon[27673]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:40.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:39 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:40.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:39 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:40.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:39 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:40.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:39 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:40.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:39 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:41.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:40 smithi031 ceph-mon[27673]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:41.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:40 smithi031 ceph-mon[27673]: Deploying daemon node-exporter.smithi031 on smithi031 2024-09-17T01:43:41.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:40 smithi031 ceph-mon[27673]: Deploying cephadm binary to smithi092 2024-09-17T01:43:41.589 INFO:teuthology.orchestra.run.smithi031.stdout:Added host 'smithi092' with addr '172.21.15.92' 2024-09-17T01:43:41.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.589+0000 7f90167fc700 1 -- 172.21.15.31:0/1594126632 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f90200faf90 con 0x7f900c0384e0 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f900c0384e0 msgr2=0x7f900c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f900c0384e0 0x7f900c03a990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9010006fd0 tx=0x7f9010006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 msgr2=0x7f90200fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200fc260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f901c005950 tx=0x7f901c009e60 comp rx=0 tx=0).stop 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 shutdown_connections 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f900c0384e0 0x7f900c03a990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 --2- 172.21.15.31:0/1594126632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200fed20 0x7f90200fc260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 >> 172.21.15.31:0/1594126632 conn(0x7f90200fa2b0 msgr2=0x7f90200690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:41.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 shutdown_connections 2024-09-17T01:43:41.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:41.592+0000 7f9027388700 1 -- 172.21.15.31:0/1594126632 wait complete. 2024-09-17T01:43:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:41 smithi031 ceph-mon[27673]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:41 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:42.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T01:43:43.135 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:42 smithi031 ceph-mon[27673]: Added host smithi092 2024-09-17T01:43:43.223 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:43:44.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:43 smithi031 ceph-mon[27673]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:44.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:43 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:44.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:43 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:44.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:43 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:44.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:43 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:44.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:43 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:44.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 -- 172.21.15.31:0/1724663176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 msgr2=0x7f34f80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:44.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 --2- 172.21.15.31:0/1724663176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f80ff140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009910 tx=0x7f34e8009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:44.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 -- 172.21.15.31:0/1724663176 shutdown_connections 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 --2- 172.21.15.31:0/1724663176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f80ff140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 -- 172.21.15.31:0/1724663176 >> 172.21.15.31:0/1724663176 conn(0x7f34f80fa380 msgr2=0x7f34f80fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 -- 172.21.15.31:0/1724663176 shutdown_connections 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.787+0000 7f34fe47a700 1 -- 172.21.15.31:0/1724663176 wait complete. 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.788+0000 7f34fe47a700 1 Processor -- start 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.788+0000 7f34fe47a700 1 -- start start 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.788+0000 7f34fe47a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f8194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.788+0000 7f34fe47a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81954f0 con 0x7f34f80fed30 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.788+0000 7f34f7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f8194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f8194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48762/0 (socket says 172.21.15.31:48762) 2024-09-17T01:43:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f7fff700 1 -- 172.21.15.31:0/1004444144 learned_addr learned my addr 172.21.15.31:0/1004444144 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:44.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f7fff700 1 -- 172.21.15.31:0/1004444144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80095f0 con 0x7f34f80fed30 2024-09-17T01:43:44.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f7fff700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f8194fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f34e8005b40 tx=0x7f34e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34e801d070 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34e800be10 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f81956f0 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34e800f460 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.789+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f8195b90 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.790+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f34e800f5c0 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.790+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f818e9a0 con 0x7f34f80fed30 2024-09-17T01:43:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.790+0000 7f34f57fa700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f34e40384e0 0x7f34e403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.791+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f34e804c370 con 0x7f34f80fed30 2024-09-17T01:43:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.791+0000 7f34f77fe700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f34e40384e0 0x7f34e403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:44.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.791+0000 7f34f77fe700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f34e40384e0 0x7f34e403a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f34e0006fd0 tx=0x7f34e0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:44.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:44.796+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f34e802a360 con 0x7f34f80fed30 2024-09-17T01:43:45.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.014+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34f8061190 con 0x7f34e40384e0 2024-09-17T01:43:45.013 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:44 smithi031 ceph-mon[27673]: Deploying daemon alertmanager.smithi031 on smithi031 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.016+0000 7f34f57fa700 1 -- 172.21.15.31:0/1004444144 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f34f8061190 con 0x7f34e40384e0 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi031.stdout:[{"addr": "172.21.15.31", "hostname": "smithi031", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}] 2024-09-17T01:43:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f34e40384e0 msgr2=0x7f34e403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f34e40384e0 0x7f34e403a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f34e0006fd0 tx=0x7f34e0006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 msgr2=0x7f34f8194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f8194fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f34e8005b40 tx=0x7f34e8004740 comp rx=0 tx=0).stop 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 shutdown_connections 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f34e40384e0 0x7f34e403a990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 --2- 172.21.15.31:0/1004444144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f80fed30 0x7f34f8194fb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 >> 172.21.15.31:0/1004444144 conn(0x7f34f80fa380 msgr2=0x7f34f80690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 shutdown_connections 2024-09-17T01:43:45.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:45.018+0000 7f34fe47a700 1 -- 172.21.15.31:0/1004444144 wait complete. 2024-09-17T01:43:45.904 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T01:43:45.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T01:43:46.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:45 smithi031 ceph-mon[27673]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:46.265 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:43:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:46 smithi031 ceph-mon[27673]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:43:48.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:47 smithi031 ceph-mon[27673]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 -- 172.21.15.31:0/143437587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 msgr2=0x7f23040ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 --2- 172.21.15.31:0/143437587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f23040ff130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009910 tx=0x7f22f8009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 -- 172.21.15.31:0/143437587 shutdown_connections 2024-09-17T01:43:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 --2- 172.21.15.31:0/143437587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f23040ff130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 -- 172.21.15.31:0/143437587 >> 172.21.15.31:0/143437587 conn(0x7f23040fa2b0 msgr2=0x7f23040fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 -- 172.21.15.31:0/143437587 shutdown_connections 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.279+0000 7f230ad4c700 1 -- 172.21.15.31:0/143437587 wait complete. 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f230ad4c700 1 Processor -- start 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f230ad4c700 1 -- start start 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f230ad4c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f2304068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f230ad4c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2304197d30 con 0x7f23040fed20 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f2308ae8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f2304068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f2308ae8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f2304068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48778/0 (socket says 172.21.15.31:48778) 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f2308ae8700 1 -- 172.21.15.31:0/729210738 learned_addr learned my addr 172.21.15.31:0/729210738 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.280+0000 7f2308ae8700 1 -- 172.21.15.31:0/729210738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80095f0 con 0x7f23040fed20 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.281+0000 7f2308ae8700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f2304068ab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22f8005b40 tx=0x7f22f8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.281+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22f801d070 con 0x7f23040fed20 2024-09-17T01:43:48.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.281+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22f800be10 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.281+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2304197e70 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.281+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22f800f460 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.281+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23041982b0 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.282+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f22f800b960 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.282+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230418da00 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.282+0000 7f2301ffb700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f22f40384e0 0x7f22f403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.282+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f22f804c290 con 0x7f23040fed20 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.282+0000 7f2303fff700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f22f40384e0 0x7f22f403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.283+0000 7f2303fff700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f22f40384e0 0x7f22f403a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22f0006fd0 tx=0x7f22f0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:48.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.287+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f22f802bb60 con 0x7f23040fed20 2024-09-17T01:43:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.520+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f230402cc30 con 0x7f23040fed20 2024-09-17T01:43:48.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.893+0000 7f2301ffb700 1 -- 172.21.15.31:0/729210738 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f22f8027070 con 0x7f23040fed20 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f22f40384e0 msgr2=0x7f22f403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f22f40384e0 0x7f22f403a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22f0006fd0 tx=0x7f22f0006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 msgr2=0x7f2304068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f2304068ab0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22f8005b40 tx=0x7f22f8004740 comp rx=0 tx=0).stop 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 shutdown_connections 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f22f40384e0 0x7f22f403a990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 --2- 172.21.15.31:0/729210738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23040fed20 0x7f2304068ab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.895+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 >> 172.21.15.31:0/729210738 conn(0x7f23040fa2b0 msgr2=0x7f23040faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:48.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.896+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 shutdown_connections 2024-09-17T01:43:48.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:43:48.896+0000 7f230ad4c700 1 -- 172.21.15.31:0/729210738 wait complete. 2024-09-17T01:43:48.894 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-09-17T01:43:49.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:48 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/729210738' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T01:43:49.962 INFO:tasks.cephadm:Adding mon.smithi031 on smithi031 2024-09-17T01:43:49.962 INFO:tasks.cephadm:Adding mon.smithi092 on smithi092 2024-09-17T01:43:49.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi031:172.21.15.31=smithi031;smithi092:172.21.15.92=smithi092' 2024-09-17T01:43:50.136 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:49 smithi031 ceph-mon[27673]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:50.136 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:49 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/729210738' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T01:43:50.136 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:49 smithi031 ceph-mon[27673]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T01:43:50.184 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:43:50.229 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 -- 172.21.15.92:0/2090326513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 msgr2=0x7f8ab00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 --2- 172.21.15.92:0/2090326513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab00ff140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009910 tx=0x7f8aa4009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 -- 172.21.15.92:0/2090326513 shutdown_connections 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 --2- 172.21.15.92:0/2090326513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab00ff140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 -- 172.21.15.92:0/2090326513 >> 172.21.15.92:0/2090326513 conn(0x7f8ab00fa2c0 msgr2=0x7f8ab00fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 -- 172.21.15.92:0/2090326513 shutdown_connections 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 -- 172.21.15.92:0/2090326513 wait complete. 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.731+0000 7f8ab52b6700 1 Processor -- start 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.732+0000 7f8ab52b6700 1 -- start start 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.732+0000 7f8ab52b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab0069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.732+0000 7f8ab52b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0197d00 con 0x7f8ab00fed30 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.732+0000 7f8aaeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.732+0000 7f8aaeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab0069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:41612/0 (socket says 172.21.15.92:41612) 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.732+0000 7f8aaeffd700 1 -- 172.21.15.92:0/126589988 learned_addr learned my addr 172.21.15.92:0/126589988 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8aaeffd700 1 -- 172.21.15.92:0/126589988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40095f0 con 0x7f8ab00fed30 2024-09-17T01:43:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8aaeffd700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab0069360 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4005b40 tx=0x7f8aa4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa401d070 con 0x7f8ab00fed30 2024-09-17T01:43:51.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8aa400be10 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab0197e40 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8aa400f460 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.733+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab01982e0 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.734+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab018da10 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.734+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f8aa40227e0 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.734+0000 7f8a97fff700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8a98038490 0x7f8a9803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.734+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f8aa404c440 con 0x7f8ab00fed30 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.734+0000 7f8aae7fc700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8a98038490 0x7f8a9803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.735+0000 7f8aae7fc700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8a98038490 0x7f8a9803a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006fd0 tx=0x7f8aa0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.739+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8aa402bba0 con 0x7f8ab00fed30 2024-09-17T01:43:51.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.934+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi031:172.21.15.31=smithi031;smithi092:172.21.15.92=smithi092", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ab0061300 con 0x7f8a98038490 2024-09-17T01:43:51.939 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.941+0000 7f8a97fff700 1 -- 172.21.15.92:0/126589988 <== mgr.14164 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8ab0061300 con 0x7f8a98038490 2024-09-17T01:43:51.939 INFO:teuthology.orchestra.run.smithi092.stdout:Scheduled mon update... 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8a98038490 msgr2=0x7f8a9803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8a98038490 0x7f8a9803a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006fd0 tx=0x7f8aa0006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 msgr2=0x7f8ab0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab0069360 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4005b40 tx=0x7f8aa4004740 comp rx=0 tx=0).stop 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 shutdown_connections 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8a98038490 0x7f8a9803a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 --2- 172.21.15.92:0/126589988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ab00fed30 0x7f8ab0069360 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 >> 172.21.15.92:0/126589988 conn(0x7f8ab00fa2c0 msgr2=0x7f8ab00faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 shutdown_connections 2024-09-17T01:43:51.941 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:51.943+0000 7f8ab52b6700 1 -- 172.21.15.92:0/126589988 wait complete. 2024-09-17T01:43:52.206 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:51 smithi031 ceph-mon[27673]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:52.515 DEBUG:teuthology.orchestra.run.smithi092:mon.smithi092> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092.service 2024-09-17T01:43:52.518 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:43:52.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:43:52.747 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:43:52.790 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:43:53.218 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:52 smithi031 ceph-mon[27673]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi031:172.21.15.31=smithi031;smithi092:172.21.15.92=smithi092", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:53.218 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:52 smithi031 ceph-mon[27673]: Saving service mon spec with placement smithi031:172.21.15.31=smithi031;smithi092:172.21.15.92=smithi092;count:2 2024-09-17T01:43:53.218 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:52 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:53.219 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:52 smithi031 ceph-mon[27673]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:54.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 -- 172.21.15.92:0/1862284164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 msgr2=0x7f2f2c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 --2- 172.21.15.92:0/1862284164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009910 tx=0x7f2f28009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:54.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 -- 172.21.15.92:0/1862284164 shutdown_connections 2024-09-17T01:43:54.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 --2- 172.21.15.92:0/1862284164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 -- 172.21.15.92:0/1862284164 >> 172.21.15.92:0/1862284164 conn(0x7f2f2c0fb3d0 msgr2=0x7f2f2c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:54.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 -- 172.21.15.92:0/1862284164 shutdown_connections 2024-09-17T01:43:54.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.248+0000 7f2f3385f700 1 -- 172.21.15.92:0/1862284164 wait complete. 2024-09-17T01:43:54.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f3385f700 1 Processor -- start 2024-09-17T01:43:54.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f3385f700 1 -- start start 2024-09-17T01:43:54.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f3385f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f3385f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c075030 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f315fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f315fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:41628/0 (socket says 172.21.15.92:41628) 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f315fb700 1 -- 172.21.15.92:0/1054655274 learned_addr learned my addr 172.21.15.92:0/1054655274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f315fb700 1 -- 172.21.15.92:0/1054655274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280095f0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.249+0000 7f2f315fb700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c074af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005b40 tx=0x7f2f28004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.250+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f2801d070 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.250+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f2800be10 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.250+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c073140 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.250+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f2800f460 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.250+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c0735e0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.250+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2f2800f5c0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.251+0000 7f2f227fc700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f180384e0 0x7f2f1803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.251+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f2f2804c280 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.251+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c1008b0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.251+0000 7f2f30dfa700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f180384e0 0x7f2f1803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:54.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.251+0000 7f2f30dfa700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f180384e0 0x7f2f1803a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006fd0 tx=0x7f2f1c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:54.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.256+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2f2c1008b0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.524+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2f2c1008b0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.524+0000 7f2f227fc700 1 -- 172.21.15.92:0/1054655274 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2f2c1008b0 con 0x7f2f2c0ffe20 2024-09-17T01:43:54.523 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:43:54.523 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:43:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f180384e0 msgr2=0x7f2f1803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f180384e0 0x7f2f1803a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c006fd0 tx=0x7f2f1c006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 msgr2=0x7f2f2c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c074af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005b40 tx=0x7f2f28004740 comp rx=0 tx=0).stop 2024-09-17T01:43:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 shutdown_connections 2024-09-17T01:43:54.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f180384e0 0x7f2f1803a990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 --2- 172.21.15.92:0/1054655274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c0ffe20 0x7f2f2c074af0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.526+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 >> 172.21.15.92:0/1054655274 conn(0x7f2f2c0fb3d0 msgr2=0x7f2f2c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:54.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.527+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 shutdown_connections 2024-09-17T01:43:54.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:54.527+0000 7f2f3385f700 1 -- 172.21.15.92:0/1054655274 wait complete. 2024-09-17T01:43:54.526 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:43:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: Deploying daemon grafana.smithi031 on smithi031 2024-09-17T01:43:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:54 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:43:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:55 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/1054655274' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:43:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:55 smithi031 ceph-mon[27673]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:56.138 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:43:56.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:43:56.340 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:43:56.390 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:43:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 -- 172.21.15.92:0/3439716916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 msgr2=0x7f151c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 --2- 172.21.15.92:0/3439716916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0ff130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f150c009910 tx=0x7f150c009c20 comp rx=0 tx=0).stop 2024-09-17T01:43:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 -- 172.21.15.92:0/3439716916 shutdown_connections 2024-09-17T01:43:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 --2- 172.21.15.92:0/3439716916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0ff130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 -- 172.21.15.92:0/3439716916 >> 172.21.15.92:0/3439716916 conn(0x7f151c0fa2b0 msgr2=0x7f151c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 -- 172.21.15.92:0/3439716916 shutdown_connections 2024-09-17T01:43:57.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.880+0000 7f1520efa700 1 -- 172.21.15.92:0/3439716916 wait complete. 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f1520efa700 1 Processor -- start 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f1520efa700 1 -- start start 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f1520efa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f1520efa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c197cd0 con 0x7f151c0fed20 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f151a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f151a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:35414/0 (socket says 172.21.15.92:35414) 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.881+0000 7f151a59c700 1 -- 172.21.15.92:0/3208397636 learned_addr learned my addr 172.21.15.92:0/3208397636 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f151a59c700 1 -- 172.21.15.92:0/3208397636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0095f0 con 0x7f151c0fed20 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f151a59c700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0693a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f150c005950 tx=0x7f150c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c01d070 con 0x7f151c0fed20 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f150c00be10 con 0x7f151c0fed20 2024-09-17T01:43:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c00f460 con 0x7f151c0fed20 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c197e10 con 0x7f151c0fed20 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.882+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c1982b0 con 0x7f151c0fed20 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.883+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f150c0227c0 con 0x7f151c0fed20 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.883+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c18da00 con 0x7f151c0fed20 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.883+0000 7f150b7fe700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f1504038490 0x7f150403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.883+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f150c04c4b0 con 0x7f151c0fed20 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.883+0000 7f1519d9b700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f1504038490 0x7f150403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:57.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.884+0000 7f1519d9b700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f1504038490 0x7f150403a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1510006fd0 tx=0x7f1510006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:57.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:57.889+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f150c02bba0 con 0x7f151c0fed20 2024-09-17T01:43:58.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.157+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f151c02cc30 con 0x7f151c0fed20 2024-09-17T01:43:58.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.157+0000 7f150b7fe700 1 -- 172.21.15.92:0/3208397636 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f150c027030 con 0x7f151c0fed20 2024-09-17T01:43:58.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:43:58.156 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f1504038490 msgr2=0x7f150403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f1504038490 0x7f150403a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1510006fd0 tx=0x7f1510006e40 comp rx=0 tx=0).stop 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 msgr2=0x7f151c0693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0693a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f150c005950 tx=0x7f150c009e60 comp rx=0 tx=0).stop 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 shutdown_connections 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f1504038490 0x7f150403a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 --2- 172.21.15.92:0/3208397636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0fed20 0x7f151c0693a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 >> 172.21.15.92:0/3208397636 conn(0x7f151c0fa2b0 msgr2=0x7f151c0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 shutdown_connections 2024-09-17T01:43:58.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:43:58.159+0000 7f1520efa700 1 -- 172.21.15.92:0/3208397636 wait complete. 2024-09-17T01:43:58.159 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:43:58.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:57 smithi031 ceph-mon[27673]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:43:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:58 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/3208397636' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:43:59.783 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:43:59.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:43:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:00.023 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:00.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:43:59 smithi031 ceph-mon[27673]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:01.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.518+0000 7f66ce305700 1 -- 172.21.15.92:0/3855000845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 msgr2=0x7f66c8100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.518+0000 7f66ce305700 1 --2- 172.21.15.92:0/3855000845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8100280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009910 tx=0x7f66b8009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:01.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.518+0000 7f66ce305700 1 -- 172.21.15.92:0/3855000845 shutdown_connections 2024-09-17T01:44:01.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.518+0000 7f66ce305700 1 --2- 172.21.15.92:0/3855000845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8100280 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.518+0000 7f66ce305700 1 -- 172.21.15.92:0/3855000845 >> 172.21.15.92:0/3855000845 conn(0x7f66c80fb470 msgr2=0x7f66c80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.519+0000 7f66ce305700 1 -- 172.21.15.92:0/3855000845 shutdown_connections 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.519+0000 7f66ce305700 1 -- 172.21.15.92:0/3855000845 wait complete. 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.519+0000 7f66ce305700 1 Processor -- start 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.519+0000 7f66ce305700 1 -- start start 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.519+0000 7f66ce305700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.519+0000 7f66ce305700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81954e0 con 0x7f66c80ffe70 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:35422/0 (socket says 172.21.15.92:35422) 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c7fff700 1 -- 172.21.15.92:0/1081274700 learned_addr learned my addr 172.21.15.92:0/1081274700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c7fff700 1 -- 172.21.15.92:0/1081274700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80095f0 con 0x7f66c80ffe70 2024-09-17T01:44:01.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c7fff700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8194fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66b8005b40 tx=0x7f66b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:01.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66b801d070 con 0x7f66c80ffe70 2024-09-17T01:44:01.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66b800be10 con 0x7f66c80ffe70 2024-09-17T01:44:01.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c81956e0 con 0x7f66c80ffe70 2024-09-17T01:44:01.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66b800f460 con 0x7f66c80ffe70 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.520+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c8195b80 con 0x7f66c80ffe70 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.521+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f66b800b960 con 0x7f66c80ffe70 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.521+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c818ea70 con 0x7f66c80ffe70 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.521+0000 7f66c57fa700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f66b0038490 0x7f66b003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.521+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f66b804c440 con 0x7f66c80ffe70 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.522+0000 7f66c77fe700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f66b0038490 0x7f66b003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.522+0000 7f66c77fe700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f66b0038490 0x7f66b003a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f66bc006fd0 tx=0x7f66bc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.526+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f66b802a360 con 0x7f66c80ffe70 2024-09-17T01:44:01.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.792+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f66c802cc30 con 0x7f66c80ffe70 2024-09-17T01:44:01.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.793+0000 7f66c57fa700 1 -- 172.21.15.92:0/1081274700 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f66b8027030 con 0x7f66c80ffe70 2024-09-17T01:44:01.792 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:01.792 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f66b0038490 msgr2=0x7f66b003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f66b0038490 0x7f66b003a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f66bc006fd0 tx=0x7f66bc006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 msgr2=0x7f66c8194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8194fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66b8005b40 tx=0x7f66b8004740 comp rx=0 tx=0).stop 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 shutdown_connections 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f66b0038490 0x7f66b003a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 --2- 172.21.15.92:0/1081274700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c80ffe70 0x7f66c8194fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 >> 172.21.15.92:0/1081274700 conn(0x7f66c80fb470 msgr2=0x7f66c80fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 shutdown_connections 2024-09-17T01:44:01.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:01.795+0000 7f66ce305700 1 -- 172.21.15.92:0/1081274700 wait complete. 2024-09-17T01:44:01.795 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:02.153 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:01 smithi031 ceph-mon[27673]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:02.153 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:01 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/1081274700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:03.399 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:03.400 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:03.594 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:03.639 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:04.130 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:03 smithi031 ceph-mon[27673]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 -- 172.21.15.92:0/658449464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 msgr2=0x7fd75c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 --2- 172.21.15.92:0/658449464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c0ff130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009910 tx=0x7fd74c009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 -- 172.21.15.92:0/658449464 shutdown_connections 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 --2- 172.21.15.92:0/658449464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c0ff130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 -- 172.21.15.92:0/658449464 >> 172.21.15.92:0/658449464 conn(0x7fd75c0fa2b0 msgr2=0x7fd75c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 -- 172.21.15.92:0/658449464 shutdown_connections 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.018+0000 7fd761a88700 1 -- 172.21.15.92:0/658449464 wait complete. 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd761a88700 1 Processor -- start 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd761a88700 1 -- start start 2024-09-17T01:44:05.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd761a88700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:05.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd761a88700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c195500 con 0x7fd75c0fed20 2024-09-17T01:44:05.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd75b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:05.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd75b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:35452/0 (socket says 172.21.15.92:35452) 2024-09-17T01:44:05.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd75b7fe700 1 -- 172.21.15.92:0/2278022958 learned_addr learned my addr 172.21.15.92:0/2278022958 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:05.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.019+0000 7fd75b7fe700 1 -- 172.21.15.92:0/2278022958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c0095f0 con 0x7fd75c0fed20 2024-09-17T01:44:05.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.020+0000 7fd75b7fe700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c194fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005b40 tx=0x7fd74c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.020+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd74c01d070 con 0x7fd75c0fed20 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.020+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd74c00be10 con 0x7fd75c0fed20 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.020+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c195700 con 0x7fd75c0fed20 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.020+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd74c00f460 con 0x7fd75c0fed20 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.020+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c195ba0 con 0x7fd75c0fed20 2024-09-17T01:44:05.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.021+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd74c00b960 con 0x7fd75c0fed20 2024-09-17T01:44:05.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.021+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c18ea10 con 0x7fd75c0fed20 2024-09-17T01:44:05.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.021+0000 7fd7597fa700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd748038490 0x7fd74803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:05.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.021+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fd74c04c440 con 0x7fd75c0fed20 2024-09-17T01:44:05.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.021+0000 7fd752ffd700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd748038490 0x7fd74803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:05.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.021+0000 7fd752ffd700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd748038490 0x7fd74803a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd744006fd0 tx=0x7fd744006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:05.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.026+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd74c02a360 con 0x7fd75c0fed20 2024-09-17T01:44:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.291+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd75c02cc30 con 0x7fd75c0fed20 2024-09-17T01:44:05.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.291+0000 7fd7597fa700 1 -- 172.21.15.92:0/2278022958 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd74c027030 con 0x7fd75c0fed20 2024-09-17T01:44:05.290 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:05.290 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd748038490 msgr2=0x7fd74803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd748038490 0x7fd74803a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd744006fd0 tx=0x7fd744006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 msgr2=0x7fd75c194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c194fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005b40 tx=0x7fd74c004740 comp rx=0 tx=0).stop 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 shutdown_connections 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd748038490 0x7fd74803a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 --2- 172.21.15.92:0/2278022958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd75c0fed20 0x7fd75c194fc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 >> 172.21.15.92:0/2278022958 conn(0x7fd75c0fa2b0 msgr2=0x7fd75c0687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 shutdown_connections 2024-09-17T01:44:05.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:05.293+0000 7fd761a88700 1 -- 172.21.15.92:0/2278022958 wait complete. 2024-09-17T01:44:05.293 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:05.917 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:05 smithi031 ceph-mon[27673]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:05.917 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:05 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/2278022958' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:06.918 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:06.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:07.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:06 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:07.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:06 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:07.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:06 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:07.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:06 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:07.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:06 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:07.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:06 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:07.121 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:07.187 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:08.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:07 smithi031 ceph-mon[27673]: Deploying daemon prometheus.smithi031 on smithi031 2024-09-17T01:44:08.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:07 smithi031 ceph-mon[27673]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 -- 172.21.15.92:0/401402732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 msgr2=0x7f38d4101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 --2- 172.21.15.92:0/401402732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4101810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009910 tx=0x7f38c8009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 -- 172.21.15.92:0/401402732 shutdown_connections 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 --2- 172.21.15.92:0/401402732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4101810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 -- 172.21.15.92:0/401402732 >> 172.21.15.92:0/401402732 conn(0x7f38d40f9a50 msgr2=0x7f38d40fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 -- 172.21.15.92:0/401402732 shutdown_connections 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 -- 172.21.15.92:0/401402732 wait complete. 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.630+0000 7f38daff0700 1 Processor -- start 2024-09-17T01:44:08.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38daff0700 1 -- start start 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38daff0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38daff0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41954d0 con 0x7f38d4101400 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38d8d8c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38d8d8c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:50768/0 (socket says 172.21.15.92:50768) 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38d8d8c700 1 -- 172.21.15.92:0/4052776784 learned_addr learned my addr 172.21.15.92:0/4052776784 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38d8d8c700 1 -- 172.21.15.92:0/4052776784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80095f0 con 0x7f38d4101400 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38d8d8c700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4194f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38c8005b40 tx=0x7f38c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38c801d070 con 0x7f38d4101400 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.631+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d41956d0 con 0x7f38d4101400 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.632+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f38c800be10 con 0x7f38d4101400 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.632+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38c800f460 con 0x7f38d4101400 2024-09-17T01:44:08.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.632+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d4195b70 con 0x7f38d4101400 2024-09-17T01:44:08.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.633+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f38c800b960 con 0x7f38d4101400 2024-09-17T01:44:08.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.633+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d418eb00 con 0x7f38d4101400 2024-09-17T01:44:08.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.633+0000 7f38d1ffb700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f38c4038490 0x7f38c403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:08.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.633+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f38c804c390 con 0x7f38d4101400 2024-09-17T01:44:08.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.633+0000 7f38d3fff700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f38c4038490 0x7f38c403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:08.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.633+0000 7f38d3fff700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f38c4038490 0x7f38c403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38c0006fd0 tx=0x7f38c0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:08.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.639+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f38c802a360 con 0x7f38d4101400 2024-09-17T01:44:08.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.907+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f38d402cc30 con 0x7f38d4101400 2024-09-17T01:44:08.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.907+0000 7f38d1ffb700 1 -- 172.21.15.92:0/4052776784 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f38c8027070 con 0x7f38d4101400 2024-09-17T01:44:08.906 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:08.906 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:08.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.909+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f38c4038490 msgr2=0x7f38c403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:08.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.909+0000 7f38daff0700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f38c4038490 0x7f38c403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38c0006fd0 tx=0x7f38c0006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.909+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 msgr2=0x7f38d4194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.909+0000 7f38daff0700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4194f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38c8005b40 tx=0x7f38c8004740 comp rx=0 tx=0).stop 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.910+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 shutdown_connections 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.910+0000 7f38daff0700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f38c4038490 0x7f38c403a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.910+0000 7f38daff0700 1 --2- 172.21.15.92:0/4052776784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d4101400 0x7f38d4194f90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.910+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 >> 172.21.15.92:0/4052776784 conn(0x7f38d40f9a50 msgr2=0x7f38d40fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.910+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 shutdown_connections 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:08.910+0000 7f38daff0700 1 -- 172.21.15.92:0/4052776784 wait complete. 2024-09-17T01:44:08.909 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:09 smithi031 ceph-mon[27673]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:09 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:09 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/4052776784' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:10.538 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:10.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:10.740 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:12.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:11 smithi031 ceph-mon[27673]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.293+0000 7fae78a45700 1 -- 172.21.15.92:0/2786039334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 msgr2=0x7fae741006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.292 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.293+0000 7fae78a45700 1 --2- 172.21.15.92:0/2786039334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae741006c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae68009910 tx=0x7fae68009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 -- 172.21.15.92:0/2786039334 shutdown_connections 2024-09-17T01:44:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 --2- 172.21.15.92:0/2786039334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae741006c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 -- 172.21.15.92:0/2786039334 >> 172.21.15.92:0/2786039334 conn(0x7fae740f9a50 msgr2=0x7fae740fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 -- 172.21.15.92:0/2786039334 shutdown_connections 2024-09-17T01:44:12.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 -- 172.21.15.92:0/2786039334 wait complete. 2024-09-17T01:44:12.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 Processor -- start 2024-09-17T01:44:12.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.294+0000 7fae78a45700 1 -- start start 2024-09-17T01:44:12.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae78a45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae740fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae78a45700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74197c30 con 0x7fae741002b0 2024-09-17T01:44:12.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae7259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae740fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae7259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae740fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:50794/0 (socket says 172.21.15.92:50794) 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae7259c700 1 -- 172.21.15.92:0/651648000 learned_addr learned my addr 172.21.15.92:0/651648000 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae7259c700 1 -- 172.21.15.92:0/651648000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680095f0 con 0x7fae741002b0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae7259c700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae740fea60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae68005b40 tx=0x7fae68004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.295+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae6801d070 con 0x7fae741002b0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.296+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fae6800be10 con 0x7fae741002b0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.296+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74197d70 con 0x7fae741002b0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.296+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae6800f460 con 0x7fae741002b0 2024-09-17T01:44:12.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.296+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae74198210 con 0x7fae741002b0 2024-09-17T01:44:12.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.296+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fae6800f6d0 con 0x7fae741002b0 2024-09-17T01:44:12.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.297+0000 7fae637fe700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fae5c038490 0x7fae5c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.297+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fae6804c490 con 0x7fae741002b0 2024-09-17T01:44:12.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.297+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7418da00 con 0x7fae741002b0 2024-09-17T01:44:12.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.297+0000 7fae71d9b700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fae5c038490 0x7fae5c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.297+0000 7fae71d9b700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fae5c038490 0x7fae5c03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae64006fd0 tx=0x7fae64006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:12.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.302+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fae68027070 con 0x7fae741002b0 2024-09-17T01:44:12.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.566+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fae7402cc30 con 0x7fae741002b0 2024-09-17T01:44:12.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.567+0000 7fae637fe700 1 -- 172.21.15.92:0/651648000 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fae6802c440 con 0x7fae741002b0 2024-09-17T01:44:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:12.566 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:12.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fae5c038490 msgr2=0x7fae5c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fae5c038490 0x7fae5c03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae64006fd0 tx=0x7fae64006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 msgr2=0x7fae740fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae740fea60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae68005b40 tx=0x7fae68004740 comp rx=0 tx=0).stop 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 shutdown_connections 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fae5c038490 0x7fae5c03a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 --2- 172.21.15.92:0/651648000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae741002b0 0x7fae740fea60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 >> 172.21.15.92:0/651648000 conn(0x7fae740f9a50 msgr2=0x7fae740fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 shutdown_connections 2024-09-17T01:44:12.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:12.569+0000 7fae78a45700 1 -- 172.21.15.92:0/651648000 wait complete. 2024-09-17T01:44:12.569 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:13.202 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:12 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/651648000' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:14.116 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:14.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:14.166 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:13 smithi031 ceph-mon[27673]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:14.313 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:14.357 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 -- 172.21.15.92:0/2591610026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 msgr2=0x7f5608100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 --2- 172.21.15.92:0/2591610026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608100230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f55f800b0a0 tx=0x7f55f800b3b0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 -- 172.21.15.92:0/2591610026 shutdown_connections 2024-09-17T01:44:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 --2- 172.21.15.92:0/2591610026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608100230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 -- 172.21.15.92:0/2591610026 >> 172.21.15.92:0/2591610026 conn(0x7f56080fb3d0 msgr2=0x7f56080fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 -- 172.21.15.92:0/2591610026 shutdown_connections 2024-09-17T01:44:15.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.757+0000 7f560c8da700 1 -- 172.21.15.92:0/2591610026 wait complete. 2024-09-17T01:44:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560c8da700 1 Processor -- start 2024-09-17T01:44:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560c8da700 1 -- start start 2024-09-17T01:44:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560c8da700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:15.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560c8da700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608075030 con 0x7f56080ffe20 2024-09-17T01:44:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:50814/0 (socket says 172.21.15.92:50814) 2024-09-17T01:44:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560659c700 1 -- 172.21.15.92:0/2503915482 learned_addr learned my addr 172.21.15.92:0/2503915482 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560659c700 1 -- 172.21.15.92:0/2503915482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009d00 con 0x7f56080ffe20 2024-09-17T01:44:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.758+0000 7f560659c700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608074af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f55f8015040 tx=0x7f55f800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:15.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55f800e040 con 0x7f56080ffe20 2024-09-17T01:44:15.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55f801d930 con 0x7f56080ffe20 2024-09-17T01:44:15.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5608073140 con 0x7f56080ffe20 2024-09-17T01:44:15.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55f80129d0 con 0x7f56080ffe20 2024-09-17T01:44:15.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608073560 con 0x7f56080ffe20 2024-09-17T01:44:15.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f55f8012c90 con 0x7f56080ffe20 2024-09-17T01:44:15.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.759+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608073f70 con 0x7f56080ffe20 2024-09-17T01:44:15.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.760+0000 7f55ff7fe700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f55f4038490 0x7f55f403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:15.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.760+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f55f804c6e0 con 0x7f56080ffe20 2024-09-17T01:44:15.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.760+0000 7f5605d9b700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f55f4038490 0x7f55f403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:15.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.760+0000 7f5605d9b700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f55f4038490 0x7f55f403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006fd0 tx=0x7f55f0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:15.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:15.765+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f55f801c3e0 con 0x7f56080ffe20 2024-09-17T01:44:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.033+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f56081008b0 con 0x7f56080ffe20 2024-09-17T01:44:16.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.034+0000 7f55ff7fe700 1 -- 172.21.15.92:0/2503915482 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f56081008b0 con 0x7f56080ffe20 2024-09-17T01:44:16.031 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:16.031 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f55f4038490 msgr2=0x7f55f403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f55f4038490 0x7f55f403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006fd0 tx=0x7f55f0006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 msgr2=0x7f5608074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608074af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f55f8015040 tx=0x7f55f800bb10 comp rx=0 tx=0).stop 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 shutdown_connections 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f55f4038490 0x7f55f403a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 --2- 172.21.15.92:0/2503915482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56080ffe20 0x7f5608074af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 >> 172.21.15.92:0/2503915482 conn(0x7f56080fb3d0 msgr2=0x7f56080fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:16.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 shutdown_connections 2024-09-17T01:44:16.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:16.036+0000 7f560c8da700 1 -- 172.21.15.92:0/2503915482 wait complete. 2024-09-17T01:44:16.035 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:16.134 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:15 smithi031 ceph-mon[27673]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:17.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:16 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/2503915482' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:17.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:16 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:17.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:16 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:17.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:16 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:17.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:16 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T01:44:17.612 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:17.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:17.824 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:17.869 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:18.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:17 smithi031 ceph-mon[27673]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:18.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:17 smithi031 ceph-mon[27673]: from='mgr.14164 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T01:44:18.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:17 smithi031 ceph-mon[27673]: mgrmap e14: smithi031.ealpiz(active, since 58s) 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 -- 172.21.15.92:0/677443025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 msgr2=0x7f5dc81006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 --2- 172.21.15.92:0/677443025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc81006e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009910 tx=0x7f5db8009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 -- 172.21.15.92:0/677443025 shutdown_connections 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 --2- 172.21.15.92:0/677443025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc81006e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 -- 172.21.15.92:0/677443025 >> 172.21.15.92:0/677443025 conn(0x7f5dc80f9a50 msgr2=0x7f5dc80fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 -- 172.21.15.92:0/677443025 shutdown_connections 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.196+0000 7f5dcdca7700 1 -- 172.21.15.92:0/677443025 wait complete. 2024-09-17T01:44:19.195 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dcdca7700 1 Processor -- start 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dcdca7700 1 -- start start 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dcdca7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc8194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dcdca7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81954c0 con 0x7f5dc81002d0 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dc77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc8194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dc77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc8194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:56742/0 (socket says 172.21.15.92:56742) 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dc77fe700 1 -- 172.21.15.92:0/3033613340 learned_addr learned my addr 172.21.15.92:0/3033613340 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.197+0000 7f5dc77fe700 1 -- 172.21.15.92:0/3033613340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80095f0 con 0x7f5dc81002d0 2024-09-17T01:44:19.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.198+0000 7f5dc77fe700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc8194f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5db8005b40 tx=0x7f5db8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:19.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.198+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5db801d070 con 0x7f5dc81002d0 2024-09-17T01:44:19.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.198+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc81956c0 con 0x7f5dc81002d0 2024-09-17T01:44:19.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.198+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5db800be10 con 0x7f5dc81002d0 2024-09-17T01:44:19.197 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.198+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5db800f460 con 0x7f5dc81002d0 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.198+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc8195b60 con 0x7f5dc81002d0 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.199+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f5db80227e0 con 0x7f5dc81002d0 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.199+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc8104b40 con 0x7f5dc81002d0 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.199+0000 7f5dc57fa700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 0x7f5db403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.199+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f5db804c3c0 con 0x7f5dc81002d0 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.199+0000 7f5dbffff700 1 -- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 msgr2=0x7f5db403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:44:19.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.199+0000 7f5dbffff700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 0x7f5db403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:44:19.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.204+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5db802bba0 con 0x7f5dc81002d0 2024-09-17T01:44:19.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.400+0000 7f5dbffff700 1 -- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 msgr2=0x7f5db403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:44:19.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.400+0000 7f5dbffff700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 0x7f5db403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T01:44:19.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.472+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5dc8198940 con 0x7f5dc81002d0 2024-09-17T01:44:19.470 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.472+0000 7f5dc57fa700 1 -- 172.21.15.92:0/3033613340 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5db8027030 con 0x7f5dc81002d0 2024-09-17T01:44:19.470 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:19.470 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 msgr2=0x7f5db403a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 0x7f5db403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 msgr2=0x7f5dc8194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc8194f80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5db8005b40 tx=0x7f5db8004740 comp rx=0 tx=0).stop 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 shutdown_connections 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f5db40384e0 0x7f5db403a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.472 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 --2- 172.21.15.92:0/3033613340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dc81002d0 0x7f5dc8194f80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 >> 172.21.15.92:0/3033613340 conn(0x7f5dc80f9a50 msgr2=0x7f5dc80fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 shutdown_connections 2024-09-17T01:44:19.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:19.474+0000 7f5dcdca7700 1 -- 172.21.15.92:0/3033613340 wait complete. 2024-09-17T01:44:19.473 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:20.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:19 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/3033613340' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:21.041 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:21.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:21.234 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:21.279 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:22.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 -- 172.21.15.92:0/4132020244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 msgr2=0x7fd17c0ff0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:22.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 --2- 172.21.15.92:0/4132020244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c0ff0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd170009910 tx=0x7fd170009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:22.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 -- 172.21.15.92:0/4132020244 shutdown_connections 2024-09-17T01:44:22.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 --2- 172.21.15.92:0/4132020244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c0ff0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:22.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 -- 172.21.15.92:0/4132020244 >> 172.21.15.92:0/4132020244 conn(0x7fd17c0fa280 msgr2=0x7fd17c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:22.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 -- 172.21.15.92:0/4132020244 shutdown_connections 2024-09-17T01:44:22.796 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.797+0000 7fd18098d700 1 -- 172.21.15.92:0/4132020244 wait complete. 2024-09-17T01:44:22.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.798+0000 7fd18098d700 1 Processor -- start 2024-09-17T01:44:22.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.798+0000 7fd18098d700 1 -- start start 2024-09-17T01:44:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.798+0000 7fd18098d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.798+0000 7fd18098d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c195490 con 0x7fd17c0fecb0 2024-09-17T01:44:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.799+0000 7fd17a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.799+0000 7fd17a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:56758/0 (socket says 172.21.15.92:56758) 2024-09-17T01:44:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.799+0000 7fd17a59c700 1 -- 172.21.15.92:0/3783004029 learned_addr learned my addr 172.21.15.92:0/3783004029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:22.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.799+0000 7fd17a59c700 1 -- 172.21.15.92:0/3783004029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700095f0 con 0x7fd17c0fecb0 2024-09-17T01:44:22.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.799+0000 7fd17a59c700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c194f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd170005b40 tx=0x7fd170004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:22.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.801+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd17001d070 con 0x7fd17c0fecb0 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.801+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd17000be10 con 0x7fd17c0fecb0 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.801+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c195690 con 0x7fd17c0fecb0 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.801+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd17000f460 con 0x7fd17c0fecb0 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.801+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c195b30 con 0x7fd17c0fecb0 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.802+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fd17000f6d0 con 0x7fd17c0fecb0 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.802+0000 7fd16b7fe700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 0x7fd16403a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:22.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.802+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fd17004c650 con 0x7fd17c0fecb0 2024-09-17T01:44:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.802+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c104ae0 con 0x7fd17c0fecb0 2024-09-17T01:44:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.802+0000 7fd179d9b700 1 -- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 msgr2=0x7fd16403a9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:44:22.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.802+0000 7fd179d9b700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 0x7fd16403a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:44:22.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:22.807+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd170027070 con 0x7fd17c0fecb0 2024-09-17T01:44:23.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.003+0000 7fd179d9b700 1 -- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 msgr2=0x7fd16403a9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/2 2024-09-17T01:44:23.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.003+0000 7fd179d9b700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 0x7fd16403a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T01:44:23.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.071+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd17c198910 con 0x7fd17c0fecb0 2024-09-17T01:44:23.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.071+0000 7fd16b7fe700 1 -- 172.21.15.92:0/3783004029 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd17002c440 con 0x7fd17c0fecb0 2024-09-17T01:44:23.069 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:23.069 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 msgr2=0x7fd16403a9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:44:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 0x7fd16403a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 msgr2=0x7fd17c194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c194f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd170005b40 tx=0x7fd170004740 comp rx=0 tx=0).stop 2024-09-17T01:44:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 shutdown_connections 2024-09-17T01:44:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd1640384f0 0x7fd16403a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 --2- 172.21.15.92:0/3783004029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd17c0fecb0 0x7fd17c194f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 >> 172.21.15.92:0/3783004029 conn(0x7fd17c0fa280 msgr2=0x7fd17c0faee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 shutdown_connections 2024-09-17T01:44:23.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:23.073+0000 7fd18098d700 1 -- 172.21.15.92:0/3783004029 wait complete. 2024-09-17T01:44:23.077 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:24.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:23 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/3783004029' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:24.628 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:24.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:24.830 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: Active manager daemon smithi031.ealpiz restarted 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: Activating manager daemon smithi031.ealpiz 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: mgrmap e15: smithi031.ealpiz(active, starting, since 0.00309928s) 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:44:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:44:25.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:44:25.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:25.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:44:25.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:44:25.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 -- 172.21.15.92:0/2339966319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 msgr2=0x7fcf800ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 --2- 172.21.15.92:0/2339966319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf800ff130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800b0a0 tx=0x7fcf7800b3b0 comp rx=0 tx=0).stop 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 -- 172.21.15.92:0/2339966319 shutdown_connections 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 --2- 172.21.15.92:0/2339966319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf800ff130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 -- 172.21.15.92:0/2339966319 >> 172.21.15.92:0/2339966319 conn(0x7fcf800fa2b0 msgr2=0x7fcf800fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 -- 172.21.15.92:0/2339966319 shutdown_connections 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.455+0000 7fcf85d11700 1 -- 172.21.15.92:0/2339966319 wait complete. 2024-09-17T01:44:26.474 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf85d11700 1 Processor -- start 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf85d11700 1 -- start start 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf85d11700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf80193ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf85d11700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80194420 con 0x7fcf800fed20 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf80193ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf7f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf80193ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:52504/0 (socket says 172.21.15.92:52504) 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf7f7fe700 1 -- 172.21.15.92:0/3994081158 learned_addr learned my addr 172.21.15.92:0/3994081158 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.456+0000 7fcf7f7fe700 1 -- 172.21.15.92:0/3994081158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009d00 con 0x7fcf800fed20 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.457+0000 7fcf7f7fe700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf80193ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800b830 tx=0x7fcf7800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.457+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf7800e040 con 0x7fcf800fed20 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.457+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf80194620 con 0x7fcf800fed20 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.457+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf80194a40 con 0x7fcf800fed20 2024-09-17T01:44:26.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.457+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf78012af0 con 0x7fcf800fed20 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.457+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf7801d980 con 0x7fcf800fed20 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.458+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7fcf7801dae0 con 0x7fcf800fed20 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.458+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf60005320 con 0x7fcf800fed20 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.458+0000 7fcf7cff9700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fcf6c038340 0x7fcf6c03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.458+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fcf7804c7e0 con 0x7fcf800fed20 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.458+0000 7fcf7effd700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fcf6c038340 0x7fcf6c03a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.458+0000 7fcf7effd700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fcf6c038340 0x7fcf6c03a7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf68006fd0 tx=0x7fcf68006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:26.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.463+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcf78025770 con 0x7fcf800fed20 2024-09-17T01:44:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: [17/Sep/2024:01:44:24] ENGINE Bus STARTING 2024-09-17T01:44:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: [17/Sep/2024:01:44:24] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:44:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: [17/Sep/2024:01:44:24] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:44:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: [17/Sep/2024:01:44:24] ENGINE Bus STARTED 2024-09-17T01:44:26.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:26.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: mgrmap e16: smithi031.ealpiz(active, since 1.00566s) 2024-09-17T01:44:26.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:26.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.735+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcf60005190 con 0x7fcf800fed20 2024-09-17T01:44:26.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.736+0000 7fcf7cff9700 1 -- 172.21.15.92:0/3994081158 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fcf7801b340 con 0x7fcf800fed20 2024-09-17T01:44:26.735 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:26.735 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fcf6c038340 msgr2=0x7fcf6c03a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fcf6c038340 0x7fcf6c03a7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf68006fd0 tx=0x7fcf68006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 msgr2=0x7fcf80193ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf80193ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800b830 tx=0x7fcf7800bd40 comp rx=0 tx=0).stop 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 shutdown_connections 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fcf6c038340 0x7fcf6c03a7f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 --2- 172.21.15.92:0/3994081158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf800fed20 0x7fcf80193ee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:26.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 >> 172.21.15.92:0/3994081158 conn(0x7fcf800fa2b0 msgr2=0x7fcf800faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:26.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 shutdown_connections 2024-09-17T01:44:26.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:26.738+0000 7fcf85d11700 1 -- 172.21.15.92:0/3994081158 wait complete. 2024-09-17T01:44:26.738 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:27 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:27 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/3994081158' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:27 smithi031 ceph-mon[27673]: mgrmap e17: smithi031.ealpiz(active, since 2s) 2024-09-17T01:44:28.283 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:28.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:28.602 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:29.119 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:44:30.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:30.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:30.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:30.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:30.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi031", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:44:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 -- 172.21.15.92:0/2598601281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 msgr2=0x7fbb78100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 --2- 172.21.15.92:0/2598601281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78100230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009910 tx=0x7fbb6c009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 -- 172.21.15.92:0/2598601281 shutdown_connections 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 --2- 172.21.15.92:0/2598601281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78100230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 -- 172.21.15.92:0/2598601281 >> 172.21.15.92:0/2598601281 conn(0x7fbb780fb3d0 msgr2=0x7fbb780fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 -- 172.21.15.92:0/2598601281 shutdown_connections 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 -- 172.21.15.92:0/2598601281 wait complete. 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.284+0000 7fbb7ee60700 1 Processor -- start 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7ee60700 1 -- start start 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7ee60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7ee60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb781954b0 con 0x7fbb780ffe20 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7cbfc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:31.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7cbfc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:52522/0 (socket says 172.21.15.92:52522) 2024-09-17T01:44:31.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7cbfc700 1 -- 172.21.15.92:0/1336992187 learned_addr learned my addr 172.21.15.92:0/1336992187 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:31.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7cbfc700 1 -- 172.21.15.92:0/1336992187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c0095f0 con 0x7fbb780ffe20 2024-09-17T01:44:31.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.285+0000 7fbb7cbfc700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78194f70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c005b40 tx=0x7fbb6c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.286+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb6c01d070 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.286+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb6c00be10 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.286+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb781956b0 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.286+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb6c00f460 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.286+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb78195b50 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.287+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fbb6c0227e0 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.287+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7818ea80 con 0x7fbb780ffe20 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.287+0000 7fbb75ffb700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbb68038580 0x7fbb6803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:31.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.287+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fbb6c04c3b0 con 0x7fbb780ffe20 2024-09-17T01:44:31.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.287+0000 7fbb77fff700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbb68038580 0x7fbb6803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:31.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.287+0000 7fbb77fff700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbb68038580 0x7fbb6803aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb64006fd0 tx=0x7fbb64006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:31.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.292+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb6c02b590 con 0x7fbb780ffe20 2024-09-17T01:44:31.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.576+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbb781008b0 con 0x7fbb780ffe20 2024-09-17T01:44:31.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.577+0000 7fbb75ffb700 1 -- 172.21.15.92:0/1336992187 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fbb781008b0 con 0x7fbb780ffe20 2024-09-17T01:44:31.576 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbb68038580 msgr2=0x7fbb6803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbb68038580 0x7fbb6803aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb64006fd0 tx=0x7fbb64006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 msgr2=0x7fbb78194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78194f70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c005b40 tx=0x7fbb6c004740 comp rx=0 tx=0).stop 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 shutdown_connections 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbb68038580 0x7fbb6803aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 --2- 172.21.15.92:0/1336992187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb780ffe20 0x7fbb78194f70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 >> 172.21.15.92:0/1336992187 conn(0x7fbb780fb3d0 msgr2=0x7fbb780fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 shutdown_connections 2024-09-17T01:44:31.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:31.579+0000 7fbb7ee60700 1 -- 172.21.15.92:0/1336992187 wait complete. 2024-09-17T01:44:31.579 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:44:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:31 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/1336992187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:33.254 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:33.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:44:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:44:33.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:32 smithi031 ceph-mon[27673]: Deploying daemon ceph-exporter.smithi092 on smithi092 2024-09-17T01:44:33.520 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:44:35.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.271+0000 7f54ae690700 1 -- 172.21.15.92:0/4119528334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 msgr2=0x7f54a81013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.271+0000 7f54ae690700 1 --2- 172.21.15.92:0/4119528334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81013c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f549c009910 tx=0x7f549c009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.271+0000 7f54ae690700 1 -- 172.21.15.92:0/4119528334 shutdown_connections 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.271+0000 7f54ae690700 1 --2- 172.21.15.92:0/4119528334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81013c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.271+0000 7f54ae690700 1 -- 172.21.15.92:0/4119528334 >> 172.21.15.92:0/4119528334 conn(0x7f54a80fa850 msgr2=0x7f54a80fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.271+0000 7f54ae690700 1 -- 172.21.15.92:0/4119528334 shutdown_connections 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.272+0000 7f54ae690700 1 -- 172.21.15.92:0/4119528334 wait complete. 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.272+0000 7f54ae690700 1 Processor -- start 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.272+0000 7f54ae690700 1 -- start start 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.273+0000 7f54ae690700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81953b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:35.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.273+0000 7f54ae690700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a81958f0 con 0x7f54a8100ff0 2024-09-17T01:44:35.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.273+0000 7f54a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:35.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.273+0000 7f54a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81953b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:52544/0 (socket says 172.21.15.92:52544) 2024-09-17T01:44:35.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.273+0000 7f54a7fff700 1 -- 172.21.15.92:0/2273746844 learned_addr learned my addr 172.21.15.92:0/2273746844 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:35.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.273+0000 7f54a7fff700 1 -- 172.21.15.92:0/2273746844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0095f0 con 0x7f54a8100ff0 2024-09-17T01:44:35.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.274+0000 7f54a7fff700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81953b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f549c005b40 tx=0x7f549c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:35.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.274+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549c01d070 con 0x7f54a8100ff0 2024-09-17T01:44:35.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.274+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f549c0044d0 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.274+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a8195af0 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.274+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549c003930 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.274+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a8195eb0 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.275+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8062380 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.275+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f549c003ba0 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.275+0000 7f54a57fa700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54900385d0 0x7f549003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.275+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f549c04c340 con 0x7f54a8100ff0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.275+0000 7f54a77fe700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54900385d0 0x7f549003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:35.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.276+0000 7f54a77fe700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54900385d0 0x7f549003aa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:35.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.281+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f549c02a950 con 0x7f54a8100ff0 2024-09-17T01:44:35.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.561+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f54a8106fb0 con 0x7f54a8100ff0 2024-09-17T01:44:35.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.561+0000 7f54a57fa700 1 -- 172.21.15.92:0/2273746844 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f549c02a360 con 0x7f54a8100ff0 2024-09-17T01:44:35.560 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:35.560 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.563+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54900385d0 msgr2=0x7f549003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.563+0000 7f54ae690700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54900385d0 0x7f549003aa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.563+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 msgr2=0x7f54a81953b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.563+0000 7f54ae690700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81953b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f549c005b40 tx=0x7f549c004c80 comp rx=0 tx=0).stop 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.563+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 shutdown_connections 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.563+0000 7f54ae690700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f54900385d0 0x7f549003aa80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:35.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.564+0000 7f54ae690700 1 --2- 172.21.15.92:0/2273746844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8100ff0 0x7f54a81953b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:35.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.564+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 >> 172.21.15.92:0/2273746844 conn(0x7f54a80fa850 msgr2=0x7f54a8104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:35.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.564+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 shutdown_connections 2024-09-17T01:44:35.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:35.564+0000 7f54ae690700 1 -- 172.21.15.92:0/2273746844 wait complete. 2024-09-17T01:44:35.563 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:35 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/2273746844' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:37.440 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:37.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:37.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:37.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:37.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:37.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:37.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:44:37.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T01:44:37.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:44:37.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:37 smithi031 ceph-mon[27673]: Deploying daemon crash.smithi092 on smithi092 2024-09-17T01:44:37.649 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 -- 172.21.15.92:0/737408273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 msgr2=0x7fc9c40ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 --2- 172.21.15.92:0/737408273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c40ff390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009910 tx=0x7fc9bc009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 -- 172.21.15.92:0/737408273 shutdown_connections 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 --2- 172.21.15.92:0/737408273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c40ff390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 -- 172.21.15.92:0/737408273 >> 172.21.15.92:0/737408273 conn(0x7fc9c4074af0 msgr2=0x7fc9c4074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 -- 172.21.15.92:0/737408273 shutdown_connections 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 -- 172.21.15.92:0/737408273 wait complete. 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 Processor -- start 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.185+0000 7fc9c936b700 1 -- start start 2024-09-17T01:44:39.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c936b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c4195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c936b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41958b0 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c4195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c4195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:34984/0 (socket says 172.21.15.92:34984) 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c2ffd700 1 -- 172.21.15.92:0/321322392 learned_addr learned my addr 172.21.15.92:0/321322392 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c2ffd700 1 -- 172.21.15.92:0/321322392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0095f0 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c2ffd700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c4195370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc005b40 tx=0x7fc9bc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9bc01d070 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c4195ab0 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc0044d0 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9bc003930 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.186+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c4195e70 con 0x7fc9c40fefc0 2024-09-17T01:44:39.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.187+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c4062380 con 0x7fc9c40fefc0 2024-09-17T01:44:39.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.188+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fc9bc003bf0 con 0x7fc9c40fefc0 2024-09-17T01:44:39.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.188+0000 7fc9bbfff700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc9b0038580 0x7fc9b003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.188+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fc9bc04c370 con 0x7fc9c40fefc0 2024-09-17T01:44:39.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.188+0000 7fc9c27fc700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc9b0038580 0x7fc9b003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.188+0000 7fc9c27fc700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc9b0038580 0x7fc9b003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac006fd0 tx=0x7fc9ac006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.193+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc9bc02a540 con 0x7fc9c40fefc0 2024-09-17T01:44:39.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.466+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc9c41966d0 con 0x7fc9c40fefc0 2024-09-17T01:44:39.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.467+0000 7fc9bbfff700 1 -- 172.21.15.92:0/321322392 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc9bc02a360 con 0x7fc9c40fefc0 2024-09-17T01:44:39.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:39.467 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc9b0038580 msgr2=0x7fc9b003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc9b0038580 0x7fc9b003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac006fd0 tx=0x7fc9ac006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 msgr2=0x7fc9c4195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c4195370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc005b40 tx=0x7fc9bc004c80 comp rx=0 tx=0).stop 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 shutdown_connections 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc9b0038580 0x7fc9b003aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 --2- 172.21.15.92:0/321322392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9c40fefc0 0x7fc9c4195370 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 >> 172.21.15.92:0/321322392 conn(0x7fc9c4074af0 msgr2=0x7fc9c4067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 shutdown_connections 2024-09-17T01:44:39.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:39.469+0000 7fc9c936b700 1 -- 172.21.15.92:0/321322392 wait complete. 2024-09-17T01:44:39.469 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:40.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:40.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:44:40.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/321322392' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:40.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:40.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:40.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:40.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:41.108 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:41.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:41.305 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:44:41.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:41 smithi031 ceph-mon[27673]: Deploying daemon node-exporter.smithi092 on smithi092 2024-09-17T01:44:43.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 -- 172.21.15.92:0/211249800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 msgr2=0x7f2ec80ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:43.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 --2- 172.21.15.92:0/211249800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec80ff360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009910 tx=0x7f2eb8009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:43.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 -- 172.21.15.92:0/211249800 shutdown_connections 2024-09-17T01:44:43.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 --2- 172.21.15.92:0/211249800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec80ff360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:43.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 -- 172.21.15.92:0/211249800 >> 172.21.15.92:0/211249800 conn(0x7f2ec80fa850 msgr2=0x7f2ec80fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:43.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 -- 172.21.15.92:0/211249800 shutdown_connections 2024-09-17T01:44:43.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.969+0000 7f2ecca08700 1 -- 172.21.15.92:0/211249800 wait complete. 2024-09-17T01:44:43.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.970+0000 7f2ecca08700 1 Processor -- start 2024-09-17T01:44:43.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.970+0000 7f2ecca08700 1 -- start start 2024-09-17T01:44:43.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ecca08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec8196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:43.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ecca08700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec81966c0 con 0x7f2ec80fef90 2024-09-17T01:44:43.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ec659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec8196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:43.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ec659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec8196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:35014/0 (socket says 172.21.15.92:35014) 2024-09-17T01:44:43.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ec659c700 1 -- 172.21.15.92:0/794068901 learned_addr learned my addr 172.21.15.92:0/794068901 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:43.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ec659c700 1 -- 172.21.15.92:0/794068901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80095f0 con 0x7f2ec80fef90 2024-09-17T01:44:43.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2ec659c700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec8196180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8005b40 tx=0x7f2eb8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:43.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.971+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eb801d070 con 0x7f2ec80fef90 2024-09-17T01:44:43.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.972+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2eb80044d0 con 0x7f2ec80fef90 2024-09-17T01:44:43.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.972+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec81968c0 con 0x7f2ec80fef90 2024-09-17T01:44:43.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.972+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eb8003930 con 0x7f2ec80fef90 2024-09-17T01:44:43.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.972+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec8196c80 con 0x7f2ec80fef90 2024-09-17T01:44:43.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.972+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec8107210 con 0x7f2ec80fef90 2024-09-17T01:44:43.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.973+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f2eb8003bf0 con 0x7f2ec80fef90 2024-09-17T01:44:43.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.973+0000 7f2eb77fe700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2eb0038580 0x7f2eb003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:43.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.973+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f2eb804c370 con 0x7f2ec80fef90 2024-09-17T01:44:43.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.973+0000 7f2ec5d9b700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2eb0038580 0x7f2eb003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:43.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.974+0000 7f2ec5d9b700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2eb0038580 0x7f2eb003aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc006fd0 tx=0x7f2ebc006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:43.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:43.978+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2eb802a540 con 0x7f2ec80fef90 2024-09-17T01:44:44.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.261+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2ec8068dd0 con 0x7f2ec80fef90 2024-09-17T01:44:44.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.262+0000 7f2eb77fe700 1 -- 172.21.15.92:0/794068901 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2eb802a360 con 0x7f2ec80fef90 2024-09-17T01:44:44.261 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:44.261 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2eb0038580 msgr2=0x7f2eb003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2eb0038580 0x7f2eb003aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc006fd0 tx=0x7f2ebc006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 msgr2=0x7f2ec8196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec8196180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8005b40 tx=0x7f2eb8004c80 comp rx=0 tx=0).stop 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 shutdown_connections 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2eb0038580 0x7f2eb003aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 --2- 172.21.15.92:0/794068901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ec80fef90 0x7f2ec8196180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 >> 172.21.15.92:0/794068901 conn(0x7f2ec80fa850 msgr2=0x7f2ec8103170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 shutdown_connections 2024-09-17T01:44:44.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:44.264+0000 7f2ecca08700 1 -- 172.21.15.92:0/794068901 wait complete. 2024-09-17T01:44:44.264 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: Deploying daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/794068901' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:45 smithi031 ceph-mon[27673]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:46.194 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:46.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:44:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:44:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:44:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 -- 172.21.15.92:0/3952519852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 msgr2=0x7f376c100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 --2- 172.21.15.92:0/3952519852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c100460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3760009910 tx=0x7f3760009c20 comp rx=0 tx=0).stop 2024-09-17T01:44:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 -- 172.21.15.92:0/3952519852 shutdown_connections 2024-09-17T01:44:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 --2- 172.21.15.92:0/3952519852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c100460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 -- 172.21.15.92:0/3952519852 >> 172.21.15.92:0/3952519852 conn(0x7f376c0fb930 msgr2=0x7f376c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 -- 172.21.15.92:0/3952519852 shutdown_connections 2024-09-17T01:44:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.145+0000 7f3773215700 1 -- 172.21.15.92:0/3952519852 wait complete. 2024-09-17T01:44:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3773215700 1 Processor -- start 2024-09-17T01:44:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3773215700 1 -- start start 2024-09-17T01:44:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3773215700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:48.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3773215700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c195840 con 0x7f376c100090 2024-09-17T01:44:48.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3770fb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:48.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3770fb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.92:37988/0 (socket says 172.21.15.92:37988) 2024-09-17T01:44:48.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.146+0000 7f3770fb1700 1 -- 172.21.15.92:0/1972775575 learned_addr learned my addr 172.21.15.92:0/1972775575 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:48.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3770fb1700 1 -- 172.21.15.92:0/1972775575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600095f0 con 0x7f376c100090 2024-09-17T01:44:48.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3770fb1700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c195300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3760005b40 tx=0x7f3760004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f376001d070 con 0x7f376c100090 2024-09-17T01:44:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c195a40 con 0x7f376c100090 2024-09-17T01:44:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f37600044d0 con 0x7f376c100090 2024-09-17T01:44:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3760003930 con 0x7f376c100090 2024-09-17T01:44:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.147+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c195e00 con 0x7f376c100090 2024-09-17T01:44:48.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.148+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f3760003bf0 con 0x7f376c100090 2024-09-17T01:44:48.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.148+0000 7f3769ffb700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f375c038580 0x7f375c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:48.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.148+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f376004c340 con 0x7f376c100090 2024-09-17T01:44:48.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.149+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c062380 con 0x7f376c100090 2024-09-17T01:44:48.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.149+0000 7f376bfff700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f375c038580 0x7f375c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:48.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.149+0000 7f376bfff700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f375c038580 0x7f375c03aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3758006fd0 tx=0x7f3758006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.154+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f376002a930 con 0x7f376c100090 2024-09-17T01:44:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.437+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f376c107cf0 con 0x7f376c100090 2024-09-17T01:44:48.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.437+0000 7f3769ffb700 1 -- 172.21.15.92:0/1972775575 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f376002a360 con 0x7f376c100090 2024-09-17T01:44:48.435 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:48.435 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:42:11.634074Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f375c038580 msgr2=0x7f375c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f375c038580 0x7f375c03aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3758006fd0 tx=0x7f3758006e40 comp rx=0 tx=0).stop 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 msgr2=0x7f376c195300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c195300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3760005b40 tx=0x7f3760004c80 comp rx=0 tx=0).stop 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 shutdown_connections 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f375c038580 0x7f375c03aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 --2- 172.21.15.92:0/1972775575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376c100090 0x7f376c195300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 >> 172.21.15.92:0/1972775575 conn(0x7f376c0fb930 msgr2=0x7f376c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:48.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.439+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 shutdown_connections 2024-09-17T01:44:48.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:48.440+0000 7f3773215700 1 -- 172.21.15.92:0/1972775575 wait complete. 2024-09-17T01:44:48.438 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 1 2024-09-17T01:44:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:48 smithi031 ceph-mon[27673]: Deploying daemon mon.smithi092 on smithi092 2024-09-17T01:44:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:48 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/1972775575' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:49 smithi031 ceph-mon[27673]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:51.676 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:51 smithi092 systemd[1]: Started Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:44:51.946 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:44:51.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:44:52.150 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:44:56.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.716+0000 7f034b296700 1 -- 172.21.15.92:0/1636146679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03300035c0 msgr2=0x7f0330005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:56.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.716+0000 7f034b296700 1 --2- 172.21.15.92:0/1636146679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03300035c0 0x7f0330005a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03440ffea0 tx=0x7f034000feb0 comp rx=0 tx=0).stop 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.716+0000 7f034b296700 1 -- 172.21.15.92:0/1636146679 shutdown_connections 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.716+0000 7f034b296700 1 --2- 172.21.15.92:0/1636146679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03300035c0 0x7f0330005a40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.716+0000 7f034b296700 1 -- 172.21.15.92:0/1636146679 >> 172.21.15.92:0/1636146679 conn(0x7f03440fba50 msgr2=0x7f03440fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.716+0000 7f034b296700 1 -- 172.21.15.92:0/1636146679 shutdown_connections 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 -- 172.21.15.92:0/1636146679 wait complete. 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 Processor -- start 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 -- start start 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0344195b40 0x7f0344199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:56.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344196150 con 0x7f0344195b40 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.717+0000 7f034b296700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03441962c0 con 0x7f03300035c0 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44810/0 (socket says 172.21.15.92:44810) 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 -- 172.21.15.92:0/2375956052 learned_addr learned my addr 172.21.15.92:0/2375956052 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0348831700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0344195b40 0x7f0344199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 -- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 msgr2=0x7f0344195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 -- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 msgr2=0x7f0344195600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0349032700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0348831700 1 -- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 msgr2=0x7f0344195600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:44:56.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0348831700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:56.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0348831700 1 -- 172.21.15.92:0/2375956052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034000f900 con 0x7f0344195b40 2024-09-17T01:44:56.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.718+0000 7f0348831700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0344195b40 0x7f0344199fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f033400b500 tx=0x7f033400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:56.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.719+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0334011800 con 0x7f0344195b40 2024-09-17T01:44:56.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.719+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0334011e10 con 0x7f0344195b40 2024-09-17T01:44:56.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.719+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034419a5b0 con 0x7f0344195b40 2024-09-17T01:44:56.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.719+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033400f2e0 con 0x7f0344195b40 2024-09-17T01:44:56.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.719+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034419ab00 con 0x7f0344195b40 2024-09-17T01:44:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.720+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034419ae30 con 0x7f0344195b40 2024-09-17T01:44:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.720+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f0334011960 con 0x7f0344195b40 2024-09-17T01:44:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.721+0000 7f033a7fc700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f032806c750 0x7f032806ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.721+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f0334089c10 con 0x7f0344195b40 2024-09-17T01:44:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.721+0000 7f0349032700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f032806c750 0x7f032806ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:56.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.721+0000 7f0349032700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f032806c750 0x7f032806ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0340005ed0 tx=0x7f0340005e60 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:56.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:56.726+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f03340554a0 con 0x7f0344195b40 2024-09-17T01:44:56.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:44:56.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: mon.smithi031 calling monitor election 2024-09-17T01:44:56.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:56.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: mon.smithi092 calling monitor election 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: mon.smithi031 is new leader, mons smithi031,smithi092 in quorum (ranks 0,1) 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: monmap e2: 2 mons at {smithi031=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],smithi092=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0]} removed_ranks: {} 2024-09-17T01:44:56.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: fsmap 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: mgrmap e17: smithi031.ealpiz(active, since 32s) 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: overall HEALTH_OK 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:56.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:57.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.009+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f03441a0250 con 0x7f0344195b40 2024-09-17T01:44:57.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.009+0000 7f033a7fc700 1 -- 172.21.15.92:0/2375956052 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1018 (secure 0 0 0) 0x7f0334058ac0 con 0x7f0344195b40 2024-09-17T01:44:57.007 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:44:57.007 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":2,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","modified":"2024-09-17T01:44:51.483138Z","created":"2024-09-17T01:42:11.634074Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi031","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi092","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T01:44:57.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f032806c750 msgr2=0x7f032806ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:57.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f032806c750 0x7f032806ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0340005ed0 tx=0x7f0340005e60 comp rx=0 tx=0).stop 2024-09-17T01:44:57.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0344195b40 msgr2=0x7f0344199fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:57.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0344195b40 0x7f0344199fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f033400b500 tx=0x7f033400b8c0 comp rx=0 tx=0).stop 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 shutdown_connections 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f032806c750 0x7f032806ec00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03300035c0 0x7f0344195600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 --2- 172.21.15.92:0/2375956052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0344195b40 0x7f0344199fb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 >> 172.21.15.92:0/2375956052 conn(0x7f03440fba50 msgr2=0x7f034418d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 shutdown_connections 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:44:57.012+0000 7f034b296700 1 -- 172.21.15.92:0/2375956052 wait complete. 2024-09-17T01:44:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:dumped monmap epoch 2 2024-09-17T01:44:57.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:44:57.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: mon.smithi031 calling monitor election 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: mon.smithi092 calling monitor election 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: mon.smithi031 is new leader, mons smithi031,smithi092 in quorum (ranks 0,1) 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: monmap e2: 2 mons at {smithi031=[v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0],smithi092=[v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0]} removed_ranks: {} 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: fsmap 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: mgrmap e17: smithi031.ealpiz(active, since 32s) 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: overall HEALTH_OK 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2380302979' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:57.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:57.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:44:57.631 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:57 smithi092 ceph-mon[33552]: mgrmap e18: smithi031.ealpiz(active, since 32s), standbys: smithi092.tjdpfw 2024-09-17T01:44:57.632 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:44:57.632 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:44:57.632 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:57 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/2375956052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:57.632 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:57.653 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T01:44:57.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T01:44:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:44:57.995 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:57 smithi031 ceph-mon[27673]: mgrmap e18: smithi031.ealpiz(active, since 32s), standbys: smithi092.tjdpfw 2024-09-17T01:44:57.995 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:44:57.995 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:44:57.995 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:57 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/2375956052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:44:57.996 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:44:58.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:44:58 smithi092 ceph-mon[33552]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:59.075 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:44:58 smithi031 ceph-mon[27673]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:44:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 -- 172.21.15.31:0/605684363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 msgr2=0x7f7544073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 --2- 172.21.15.31:0/605684363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544073440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f753400b0a0 tx=0x7f753400b3b0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 -- 172.21.15.31:0/605684363 shutdown_connections 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 --2- 172.21.15.31:0/605684363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544073440 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 -- 172.21.15.31:0/605684363 >> 172.21.15.31:0/605684363 conn(0x7f75440fb940 msgr2=0x7f75440fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 -- 172.21.15.31:0/605684363 shutdown_connections 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.433+0000 7f754b4df700 1 -- 172.21.15.31:0/605684363 wait complete. 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754b4df700 1 Processor -- start 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754b4df700 1 -- start start 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754b4df700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754b4df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7544197b90 0x7f754419c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:59.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754b4df700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75441981a0 con 0x7f7544073070 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754b4df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7544198310 con 0x7f7544197b90 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.434+0000 7f754927b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754927b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35514/0 (socket says 172.21.15.31:35514) 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754927b700 1 -- 172.21.15.31:0/1973598958 learned_addr learned my addr 172.21.15.31:0/1973598958 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f7548a7a700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7544197b90 0x7f754419c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754927b700 1 -- 172.21.15.31:0/1973598958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7544197b90 msgr2=0x7f754419c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754927b700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7544197b90 0x7f754419c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754927b700 1 -- 172.21.15.31:0/1973598958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534009d00 con 0x7f7544073070 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754927b700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544197650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f75340062a0 tx=0x7f7534003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753400e040 con 0x7f7544073070 2024-09-17T01:44:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f753400bdf0 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754419c5a0 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753401daf0 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.435+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754419caf0 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.436+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75441098a0 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.437+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f7534004250 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.437+0000 7f75427fc700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f752c06c760 0x7f752c06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.437+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f753408c2d0 con 0x7f7544073070 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.437+0000 7f7548a7a700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f752c06c760 0x7f752c06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:59.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.438+0000 7f7548a7a700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f752c06c760 0x7f752c06ec10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7538009850 tx=0x7f7538008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:59.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.442+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7534057b40 con 0x7f7544073070 2024-09-17T01:44:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.647+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7544062380 con 0x7f7544073070 2024-09-17T01:44:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.648+0000 7f75427fc700 1 -- 172.21.15.31:0/1973598958 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f75340170f0 con 0x7f7544073070 2024-09-17T01:44:59.645 INFO:teuthology.orchestra.run.smithi031.stdout:# minimal ceph.conf for fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:44:59.645 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-17T01:44:59.645 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:44:59.645 INFO:teuthology.orchestra.run.smithi031.stdout: mon_host = [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] 2024-09-17T01:44:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f752c06c760 msgr2=0x7f752c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f752c06c760 0x7f752c06ec10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7538009850 tx=0x7f7538008040 comp rx=0 tx=0).stop 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 msgr2=0x7f7544197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544197650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f75340062a0 tx=0x7f7534003ce0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 shutdown_connections 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f752c06c760 0x7f752c06ec10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7544073070 0x7f7544197650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 --2- 172.21.15.31:0/1973598958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7544197b90 0x7f754419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 >> 172.21.15.31:0/1973598958 conn(0x7f75440fb940 msgr2=0x7f75441069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 shutdown_connections 2024-09-17T01:44:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:44:59.650+0000 7f754b4df700 1 -- 172.21.15.31:0/1973598958 wait complete. 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:45:00.308 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1973598958' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:45:00.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:00 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:00.310 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T01:45:00.311 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:45:00.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T01:45:00.343 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:45:00.343 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:45:00.410 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:45:00.410 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T01:45:00.438 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:45:00.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:45:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1973598958' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:45:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:00 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:00.503 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T01:45:00.503 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:45:00.503 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:45:00.519 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:45:00.520 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 01:44:15.870783482 +0000 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 01:39:09.441630103 +0000 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 01:39:09.441630103 +0000 2024-09-17T01:45:00.577 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 01:39:09.441630103 +0000 2024-09-17T01:45:00.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:45:00.643 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T01:45:00.643 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T01:45:00.643 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00026696 s, 1.9 MB/s 2024-09-17T01:45:00.644 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:45:00.701 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-09-17T01:45:00.758 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:45:00.758 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:00.758 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T01:45:00.758 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:00.759 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:00.759 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 01:44:15.871783465 +0000 2024-09-17T01:45:00.759 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 01:39:09.785624108 +0000 2024-09-17T01:45:00.759 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 01:39:09.785624108 +0000 2024-09-17T01:45:00.759 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 01:39:09.785624108 +0000 2024-09-17T01:45:00.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:45:00.825 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T01:45:00.826 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T01:45:00.826 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000175897 s, 2.9 MB/s 2024-09-17T01:45:00.827 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:45:00.885 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 01:44:15.871783465 +0000 2024-09-17T01:45:00.941 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 01:39:10.116618339 +0000 2024-09-17T01:45:00.942 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 01:39:10.116618339 +0000 2024-09-17T01:45:00.942 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 01:39:10.116618339 +0000 2024-09-17T01:45:00.942 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:45:01.008 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T01:45:01.009 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T01:45:01.009 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000206587 s, 2.5 MB/s 2024-09-17T01:45:01.009 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:45:01.066 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 01:44:15.872783448 +0000 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 01:39:10.441612674 +0000 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 01:39:10.441612674 +0000 2024-09-17T01:45:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 01:39:10.441612674 +0000 2024-09-17T01:45:01.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:45:01.187 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T01:45:01.187 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T01:45:01.187 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000191148 s, 2.7 MB/s 2024-09-17T01:45:01.188 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:45:01.246 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:45:01.246 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:45:01.264 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:45:01.264 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-17T01:45:01.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:01 smithi031 ceph-mon[27673]: Reconfiguring mon.smithi031 (unknown last config time)... 2024-09-17T01:45:01.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:01 smithi031 ceph-mon[27673]: Reconfiguring daemon mon.smithi031 on smithi031 2024-09-17T01:45:01.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:01 smithi031 ceph-mon[27673]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:01.321 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:45:01.321 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-17 01:44:50.820272628 +0000 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-17 01:39:09.425929776 +0000 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-17 01:39:09.425929776 +0000 2024-09-17T01:45:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-17 01:39:09.425929776 +0000 2024-09-17T01:45:01.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:45:01.386 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-17T01:45:01.387 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-17T01:45:01.387 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000344792 s, 1.5 MB/s 2024-09-17T01:45:01.388 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:45:01.447 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-17T01:45:01.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:01 smithi092 ceph-mon[33552]: Reconfiguring mon.smithi031 (unknown last config time)... 2024-09-17T01:45:01.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:01 smithi092 ceph-mon[33552]: Reconfiguring daemon mon.smithi031 on smithi031 2024-09-17T01:45:01.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:01 smithi092 ceph-mon[33552]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:01.504 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:45:01.504 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:01.504 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T01:45:01.504 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:01.504 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:01.505 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-17 01:44:50.821272598 +0000 2024-09-17T01:45:01.505 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-17 01:39:09.862916551 +0000 2024-09-17T01:45:01.505 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-17 01:39:09.862916551 +0000 2024-09-17T01:45:01.505 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-17 01:39:09.862916551 +0000 2024-09-17T01:45:01.505 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:45:01.569 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-17T01:45:01.569 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-17T01:45:01.569 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000211691 s, 2.4 MB/s 2024-09-17T01:45:01.571 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:45:01.628 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-17T01:45:01.684 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:45:01.684 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:01.684 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T01:45:01.684 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:01.684 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:01.685 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-17 01:44:50.821272598 +0000 2024-09-17T01:45:01.685 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-17 01:39:10.200906321 +0000 2024-09-17T01:45:01.685 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-17 01:39:10.200906321 +0000 2024-09-17T01:45:01.685 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-17 01:39:10.200906321 +0000 2024-09-17T01:45:01.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:45:01.748 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-17T01:45:01.748 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-17T01:45:01.748 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00021693 s, 2.4 MB/s 2024-09-17T01:45:01.749 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:45:01.805 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-17T01:45:01.863 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-17 01:44:50.821272598 +0000 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-17 01:39:10.529896364 +0000 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-17 01:39:10.529896364 +0000 2024-09-17T01:45:01.864 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-17 01:39:10.529896364 +0000 2024-09-17T01:45:01.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:45:01.928 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-17T01:45:01.928 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-17T01:45:01.928 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000190835 s, 2.7 MB/s 2024-09-17T01:45:01.929 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:45:01.985 INFO:tasks.cephadm:Deploying osd.0 on smithi031 with /dev/vg_nvme/lv_4... 2024-09-17T01:45:01.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T01:45:02.932 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:02.932 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:02.932 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: Reconfiguring mgr.smithi031.ealpiz (unknown last config time)... 2024-09-17T01:45:02.932 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:45:02.932 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:45:02.933 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:02.933 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: Reconfiguring daemon mgr.smithi031.ealpiz on smithi031 2024-09-17T01:45:02.933 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:02 smithi031 ceph-mon[27673]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:02.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:02.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:02.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: Reconfiguring mgr.smithi031.ealpiz (unknown last config time)... 2024-09-17T01:45:02.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:45:02.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:45:02.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:02.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: Reconfiguring daemon mgr.smithi031.ealpiz on smithi031 2024-09-17T01:45:02.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:02 smithi092 ceph-mon[33552]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:03.034 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:45:04.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:04.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:04.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:03 smithi031 ceph-mon[27673]: Reconfiguring ceph-exporter.smithi031 (monmap changed)... 2024-09-17T01:45:04.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:45:04.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:04.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:03 smithi031 ceph-mon[27673]: Reconfiguring daemon ceph-exporter.smithi031 on smithi031 2024-09-17T01:45:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:03 smithi092 ceph-mon[33552]: Reconfiguring ceph-exporter.smithi031 (monmap changed)... 2024-09-17T01:45:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:45:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:03 smithi092 ceph-mon[33552]: Reconfiguring daemon ceph-exporter.smithi031 on smithi031 2024-09-17T01:45:05.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:04 smithi031 ceph-mon[27673]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:05.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:04 smithi092 ceph-mon[33552]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:06 smithi092 ceph-mon[33552]: Reconfiguring crash.smithi031 (monmap changed)... 2024-09-17T01:45:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:45:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:06 smithi092 ceph-mon[33552]: Reconfiguring daemon crash.smithi031 on smithi031 2024-09-17T01:45:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:06 smithi031 ceph-mon[27673]: Reconfiguring crash.smithi031 (monmap changed)... 2024-09-17T01:45:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:45:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:06.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:06 smithi031 ceph-mon[27673]: Reconfiguring daemon crash.smithi031 on smithi031 2024-09-17T01:45:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:45:06.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_4 2024-09-17T01:45:07.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:07 smithi031 ceph-mon[27673]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:45:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:07 smithi092 ceph-mon[33552]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:09.006 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:08 smithi031 ceph-mon[27673]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:09.006 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:08 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:09.007 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:08 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 -- 172.21.15.31:0/2049618422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 msgr2=0x7f47e8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 --2- 172.21.15.31:0/2049618422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e8100860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009910 tx=0x7f47d0009c20 comp rx=0 tx=0).stop 2024-09-17T01:45:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 -- 172.21.15.31:0/2049618422 shutdown_connections 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 --2- 172.21.15.31:0/2049618422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e8100860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 --2- 172.21.15.31:0/2049618422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e80ff150 0x7f47e80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 -- 172.21.15.31:0/2049618422 >> 172.21.15.31:0/2049618422 conn(0x7f47e80fa7a0 msgr2=0x7f47e80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 -- 172.21.15.31:0/2049618422 shutdown_connections 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.227+0000 7f47eea19700 1 -- 172.21.15.31:0/2049618422 wait complete. 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.228+0000 7f47eea19700 1 Processor -- start 2024-09-17T01:45:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.228+0000 7f47eea19700 1 -- start start 2024-09-17T01:45:09.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.228+0000 7f47eea19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e80ff150 0x7f47e8103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.228+0000 7f47eea19700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e81017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.228+0000 7f47eea19700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8101d10 con 0x7f47e81003f0 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.228+0000 7f47eea19700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8101e50 con 0x7f47e80ff150 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e81017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e81017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59934/0 (socket says 172.21.15.31:59934) 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 -- 172.21.15.31:0/1713919050 learned_addr learned my addr 172.21.15.31:0/1713919050 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e7fff700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e80ff150 0x7f47e8103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 -- 172.21.15.31:0/1713919050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e80ff150 msgr2=0x7f47e8103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e80ff150 0x7f47e8103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 -- 172.21.15.31:0/1713919050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00095f0 con 0x7f47e81003f0 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e77fe700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e81017d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000c00 tx=0x7f47d000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d001d070 con 0x7f47e81003f0 2024-09-17T01:45:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47d0005dc0 con 0x7f47e81003f0 2024-09-17T01:45:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e81020d0 con 0x7f47e81003f0 2024-09-17T01:45:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d00226a0 con 0x7f47e81003f0 2024-09-17T01:45:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.229+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81025c0 con 0x7f47e81003f0 2024-09-17T01:45:09.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.230+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8068ab0 con 0x7f47e81003f0 2024-09-17T01:45:09.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.231+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f47d00038f0 con 0x7f47e81003f0 2024-09-17T01:45:09.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.231+0000 7f47e57fa700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f47d406c610 0x7f47d406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.231+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f47d008bb90 con 0x7f47e81003f0 2024-09-17T01:45:09.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.231+0000 7f47e7fff700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f47d406c610 0x7f47d406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.232+0000 7f47e7fff700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f47d406c610 0x7f47d406eac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009c60 tx=0x7f47d8009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:09.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.236+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f47d005ae90 con 0x7f47e81003f0 2024-09-17T01:45:09.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:08 smithi092 ceph-mon[33552]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:09.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:08 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:09.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:08 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:09.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:09.450+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e80694e0 con 0x7f47d406c610 2024-09-17T01:45:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: Reconfiguring alertmanager.smithi031 (dependencies changed)... 2024-09-17T01:45:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: Reconfiguring daemon alertmanager.smithi031 on smithi031 2024-09-17T01:45:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:45:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:45:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: Reconfiguring alertmanager.smithi031 (dependencies changed)... 2024-09-17T01:45:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: Reconfiguring daemon alertmanager.smithi031 on smithi031 2024-09-17T01:45:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:45:10.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:45:10.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:10.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:11.004 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:10 smithi031 ceph-mon[27673]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:10 smithi092 ceph-mon[33552]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:13.660 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:13 smithi031 ceph-mon[27673]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:13.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:13 smithi092 ceph-mon[33552]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:15 smithi092 ceph-mon[33552]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:15 smithi031 ceph-mon[27673]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:16.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:16 smithi092 ceph-mon[33552]: Reconfiguring grafana.smithi031 (dependencies changed)... 2024-09-17T01:45:16.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:16 smithi092 ceph-mon[33552]: Reconfiguring daemon grafana.smithi031 on smithi031 2024-09-17T01:45:16.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:16 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1462893875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0670c70-68df-4156-9be7-ac9d3c2bad76"}]: dispatch 2024-09-17T01:45:16.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:16 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1462893875' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0670c70-68df-4156-9be7-ac9d3c2bad76"}]': finished 2024-09-17T01:45:16.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:16 smithi092 ceph-mon[33552]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T01:45:16.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:16 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:16 smithi031 ceph-mon[27673]: Reconfiguring grafana.smithi031 (dependencies changed)... 2024-09-17T01:45:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:16 smithi031 ceph-mon[27673]: Reconfiguring daemon grafana.smithi031 on smithi031 2024-09-17T01:45:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:16 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1462893875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0670c70-68df-4156-9be7-ac9d3c2bad76"}]: dispatch 2024-09-17T01:45:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:16 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1462893875' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0670c70-68df-4156-9be7-ac9d3c2bad76"}]': finished 2024-09-17T01:45:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:16 smithi031 ceph-mon[27673]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T01:45:16.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:16 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:17 smithi092 ceph-mon[33552]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:17 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1624536839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:45:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:17 smithi031 ceph-mon[27673]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:17 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1624536839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:45:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:18 smithi092 ceph-mon[33552]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:19.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:18 smithi031 ceph-mon[27673]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:21.654 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:21 smithi031 ceph-mon[27673]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:21 smithi092 ceph-mon[33552]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:23 smithi092 ceph-mon[33552]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:23 smithi031 ceph-mon[27673]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:24.748 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:25.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:25 smithi031 ceph-mon[27673]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:25.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:25 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:25.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:25 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:25 smithi092 ceph-mon[33552]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:25 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:25 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:26.716 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:26 smithi031 ceph-mon[27673]: Reconfiguring prometheus.smithi031 (dependencies changed)... 2024-09-17T01:45:26.716 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:26 smithi031 ceph-mon[27673]: Reconfiguring daemon prometheus.smithi031 on smithi031 2024-09-17T01:45:26.716 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:45:26.716 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:26.738 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:26 smithi092 ceph-mon[33552]: Reconfiguring prometheus.smithi031 (dependencies changed)... 2024-09-17T01:45:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:26 smithi092 ceph-mon[33552]: Reconfiguring daemon prometheus.smithi031 on smithi031 2024-09-17T01:45:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:45:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:27 smithi092 ceph-mon[33552]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:27 smithi092 ceph-mon[33552]: Deploying daemon osd.0 on smithi031 2024-09-17T01:45:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:27 smithi031 ceph-mon[27673]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:27 smithi031 ceph-mon[27673]: Deploying daemon osd.0 on smithi031 2024-09-17T01:45:28.980 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:28 smithi031 ceph-mon[27673]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:28 smithi092 ceph-mon[33552]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:31 smithi092 ceph-mon[33552]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:31 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:31 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:31 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:45:31.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:31 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:31 smithi031 ceph-mon[27673]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:45:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:31 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:32 smithi092 ceph-mon[33552]: Reconfiguring ceph-exporter.smithi092 (monmap changed)... 2024-09-17T01:45:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:32 smithi092 ceph-mon[33552]: Reconfiguring daemon ceph-exporter.smithi092 on smithi092 2024-09-17T01:45:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:32 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:32 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:32.803 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:32 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:45:32.803 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:32 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:32.804 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:32 smithi031 ceph-mon[27673]: Reconfiguring ceph-exporter.smithi092 (monmap changed)... 2024-09-17T01:45:32.804 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:32 smithi031 ceph-mon[27673]: Reconfiguring daemon ceph-exporter.smithi092 on smithi092 2024-09-17T01:45:32.804 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:32.804 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:32.804 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:45:32.804 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:33.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: Reconfiguring crash.smithi092 (monmap changed)... 2024-09-17T01:45:33.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: Reconfiguring daemon crash.smithi092 on smithi092 2024-09-17T01:45:33.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:33.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:33.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:33.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:45:33.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:45:33.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: Reconfiguring crash.smithi092 (monmap changed)... 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: Reconfiguring daemon crash.smithi092 on smithi092 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:45:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:45:33.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:34.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:34 smithi031 ceph-mon[27673]: Reconfiguring mgr.smithi092.tjdpfw (monmap changed)... 2024-09-17T01:45:34.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:34 smithi031 ceph-mon[27673]: Reconfiguring daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:45:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:34 smithi092 ceph-mon[33552]: Reconfiguring mgr.smithi092.tjdpfw (monmap changed)... 2024-09-17T01:45:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:34 smithi092 ceph-mon[33552]: Reconfiguring daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:45:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:35 smithi031 ceph-mon[27673]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:45:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:45:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:35.556 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:35 smithi092 ceph-mon[33552]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:35.556 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:35.556 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:35.556 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:45:35.556 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:45:35.556 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:36.583 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: Reconfiguring mon.smithi092 (monmap changed)... 2024-09-17T01:45:36.583 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: Reconfiguring daemon mon.smithi092 on smithi092 2024-09-17T01:45:36.583 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.583 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.583 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi031.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.584 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:45:36.585 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi031.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:45:36.585 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.585 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:36 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:45:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: Reconfiguring mon.smithi092 (monmap changed)... 2024-09-17T01:45:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: Reconfiguring daemon mon.smithi092 on smithi092 2024-09-17T01:45:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi031.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi031.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:36.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:36 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:45:37.693 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:45:37.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:45:37.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:45:37.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi031.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:45:37.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:45:37.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi031.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:45:37.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:37 smithi031 ceph-mon[27673]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:45:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi031.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:45:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:45:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi031.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:45:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:45:37.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi031.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:45:37.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:37 smithi092 ceph-mon[33552]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:39.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:39.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:39.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:39 smithi031 ceph-mon[27673]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:39.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:39.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:39.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:39 smithi092 ceph-mon[33552]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:39.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.939+0000 7f47e57fa700 1 -- 172.21.15.31:0/1713919050 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f47e80694e0 con 0x7f47d406c610 2024-09-17T01:45:39.937 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 0 on host 'smithi031' 2024-09-17T01:45:39.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f47d406c610 msgr2=0x7f47d406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f47d406c610 0x7f47d406eac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009c60 tx=0x7f47d8009260 comp rx=0 tx=0).stop 2024-09-17T01:45:39.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 msgr2=0x7f47e81017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e81017d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000c00 tx=0x7f47d000f690 comp rx=0 tx=0).stop 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 shutdown_connections 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f47d406c610 0x7f47d406eac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e80ff150 0x7f47e8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 --2- 172.21.15.31:0/1713919050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47e81003f0 0x7f47e81017d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 >> 172.21.15.31:0/1713919050 conn(0x7f47e80fa7a0 msgr2=0x7f47e8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 shutdown_connections 2024-09-17T01:45:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:39.941+0000 7f47eea19700 1 -- 172.21.15.31:0/1713919050 wait complete. 2024-09-17T01:45:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:40 smithi092 ceph-mon[33552]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:45:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:40 smithi031 ceph-mon[27673]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:45:40.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:40.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:40.886 DEBUG:teuthology.orchestra.run.smithi031:osd.0> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T01:45:40.890 INFO:tasks.cephadm:Deploying osd.1 on smithi031 with /dev/vg_nvme/lv_3... 2024-09-17T01:45:40.890 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T01:45:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:41 smithi092 ceph-mon[33552]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:45:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:41 smithi092 ceph-mon[33552]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T01:45:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:41 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:41 smithi092 ceph-mon[33552]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:45:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:41 smithi092 ceph-mon[33552]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:41.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-mon[27673]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:45:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-mon[27673]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T01:45:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-mon[27673]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:45:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-mon[27673]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:41.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[42705]: 2024-09-17T01:45:41.175+0000 7f50b3f50700 -1 osd.0 0 waiting for initial osdmap 2024-09-17T01:45:41.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:45:41 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[42705]: 2024-09-17T01:45:41.180+0000 7f50ae542700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:45:41.741 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:45:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:42 smithi092 ceph-mon[33552]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-09-17T01:45:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:42 smithi092 ceph-mon[33552]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T01:45:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:42 smithi031 ceph-mon[27673]: from='osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-09-17T01:45:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:42 smithi031 ceph-mon[27673]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T01:45:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:43.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:43 smithi092 ceph-mon[33552]: purged_snaps scrub starts 2024-09-17T01:45:43.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:43 smithi092 ceph-mon[33552]: purged_snaps scrub ok 2024-09-17T01:45:43.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:43 smithi092 ceph-mon[33552]: osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] boot 2024-09-17T01:45:43.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:43 smithi092 ceph-mon[33552]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T01:45:43.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:43.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:43 smithi092 ceph-mon[33552]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:43.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:43 smithi031 ceph-mon[27673]: purged_snaps scrub starts 2024-09-17T01:45:43.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:43 smithi031 ceph-mon[27673]: purged_snaps scrub ok 2024-09-17T01:45:43.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:43 smithi031 ceph-mon[27673]: osd.0 [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] boot 2024-09-17T01:45:43.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:43 smithi031 ceph-mon[27673]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T01:45:43.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:45:43.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:43 smithi031 ceph-mon[27673]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:45:44.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:44 smithi031 ceph-mon[27673]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T01:45:44.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:44 smithi092 ceph-mon[33552]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T01:45:45.370 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:45.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:45.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:45 smithi031 ceph-mon[27673]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:45.682 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:45:45.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_3 2024-09-17T01:45:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:45 smithi092 ceph-mon[33552]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:45:47.703 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:47 smithi031 ceph-mon[27673]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:47 smithi092 ceph-mon[33552]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 -- 172.21.15.31:0/1972101743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 msgr2=0x7f01f0100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 --2- 172.21.15.31:0/1972101743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f0100860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009910 tx=0x7f01ec009c20 comp rx=0 tx=0).stop 2024-09-17T01:45:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 -- 172.21.15.31:0/1972101743 shutdown_connections 2024-09-17T01:45:48.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 --2- 172.21.15.31:0/1972101743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f0100860 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 --2- 172.21.15.31:0/1972101743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 0x7f01f00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 -- 172.21.15.31:0/1972101743 >> 172.21.15.31:0/1972101743 conn(0x7f01f00fa7a0 msgr2=0x7f01f00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 -- 172.21.15.31:0/1972101743 shutdown_connections 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.834+0000 7f01f85de700 1 -- 172.21.15.31:0/1972101743 wait complete. 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f85de700 1 Processor -- start 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f85de700 1 -- start start 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f85de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 0x7f01f0103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f85de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f01017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f85de700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0101d10 con 0x7f01f01003f0 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f85de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0101e50 con 0x7f01f00ff150 2024-09-17T01:45:48.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f5b79700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f01017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f5b79700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f01017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54500/0 (socket says 172.21.15.31:54500) 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f5b79700 1 -- 172.21.15.31:0/783505955 learned_addr learned my addr 172.21.15.31:0/783505955 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f637a700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 0x7f01f0103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.835+0000 7f01f5b79700 1 -- 172.21.15.31:0/783505955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 msgr2=0x7f01f0103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01f5b79700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 0x7f01f0103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01f5b79700 1 -- 172.21.15.31:0/783505955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0095f0 con 0x7f01f01003f0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01f637a700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 0x7f01f0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01f5b79700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f01017d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01ec006010 tx=0x7f01ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01ec01d070 con 0x7f01f01003f0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01ec00f460 con 0x7f01f01003f0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01ec021640 con 0x7f01f01003f0 2024-09-17T01:45:48.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f01020d0 con 0x7f01f01003f0 2024-09-17T01:45:48.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.836+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f0102570 con 0x7f01f01003f0 2024-09-17T01:45:48.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.837+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0068ab0 con 0x7f01f01003f0 2024-09-17T01:45:48.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.838+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f01ec00fab0 con 0x7f01f01003f0 2024-09-17T01:45:48.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.838+0000 7f01e37fe700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f01dc06c600 0x7f01dc06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:48.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.838+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7f01ec08bcf0 con 0x7f01f01003f0 2024-09-17T01:45:48.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.838+0000 7f01f637a700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f01dc06c600 0x7f01dc06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:48.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.838+0000 7f01f637a700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f01dc06c600 0x7f01dc06eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005fd0 tx=0x7f01e4005dc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:48.843+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f01ec090070 con 0x7f01f01003f0 2024-09-17T01:45:49.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:48 smithi031 ceph-mon[27673]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:49.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:45:49.056+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f01f019de80 con 0x7f01dc06c600 2024-09-17T01:45:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:48 smithi092 ceph-mon[33552]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:49.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:49.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:45:49.982 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:45:50.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:51.132 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:50 smithi031 ceph-mon[27673]: Detected new or changed devices on smithi031 2024-09-17T01:45:51.132 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:50 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi031 to 11844M 2024-09-17T01:45:51.132 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:50 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:45:51.132 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:50 smithi031 ceph-mon[27673]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:51.235 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:50 smithi092 ceph-mon[33552]: Detected new or changed devices on smithi031 2024-09-17T01:45:51.235 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:50 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi031 to 11844M 2024-09-17T01:45:51.235 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:50 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:45:51.235 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:50 smithi092 ceph-mon[33552]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3350736371' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b32a3d5d-4862-4f43-8750-f72caf8c68b3"}]: dispatch 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3350736371' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b32a3d5d-4862-4f43-8750-f72caf8c68b3"}]': finished 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:53.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:52 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1694267040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:45:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3350736371' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b32a3d5d-4862-4f43-8750-f72caf8c68b3"}]: dispatch 2024-09-17T01:45:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3350736371' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b32a3d5d-4862-4f43-8750-f72caf8c68b3"}]': finished 2024-09-17T01:45:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T01:45:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:45:53.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:53.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:52 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1694267040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:45:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:45:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:55 smithi031 ceph-mon[27673]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:45:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:55 smithi092 ceph-mon[33552]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:45:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:45:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:45:57.677 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:57 smithi031 ceph-mon[27673]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:57 smithi092 ceph-mon[33552]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:58.983 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:58 smithi031 ceph-mon[27673]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:45:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:58 smithi092 ceph-mon[33552]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:00.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:59 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:46:00.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:59 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:00.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:45:59 smithi031 ceph-mon[27673]: Deploying daemon osd.1 on smithi031 2024-09-17T01:46:00.140 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:59 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:46:00.140 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:59 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:00.140 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:45:59 smithi092 ceph-mon[33552]: Deploying daemon osd.1 on smithi031 2024-09-17T01:46:01.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:00 smithi031 ceph-mon[27673]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:01.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:00 smithi092 ceph-mon[33552]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:03.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:03 smithi092 ceph-mon[33552]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:03.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:03 smithi031 ceph-mon[27673]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:05 smithi092 ceph-mon[33552]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:05 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:05 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:05 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:05 smithi031 ceph-mon[27673]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:05 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:05 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:05 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:07 smithi031 ceph-mon[27673]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:07 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:07 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:07 smithi092 ceph-mon[33552]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:07 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:07 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:08.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.108+0000 7f01e37fe700 1 -- 172.21.15.31:0/783505955 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f01f019de80 con 0x7f01dc06c600 2024-09-17T01:46:08.107 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 1 on host 'smithi031' 2024-09-17T01:46:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f01dc06c600 msgr2=0x7f01dc06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f01dc06c600 0x7f01dc06eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005fd0 tx=0x7f01e4005dc0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 msgr2=0x7f01f01017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f01017d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01ec006010 tx=0x7f01ec00be20 comp rx=0 tx=0).stop 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 shutdown_connections 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f01dc06c600 0x7f01dc06eab0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01f00ff150 0x7f01f0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 --2- 172.21.15.31:0/783505955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01f01003f0 0x7f01f01017d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 >> 172.21.15.31:0/783505955 conn(0x7f01f00fa7a0 msgr2=0x7f01f0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 shutdown_connections 2024-09-17T01:46:08.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:08.111+0000 7f01f85de700 1 -- 172.21.15.31:0/783505955 wait complete. 2024-09-17T01:46:08.732 DEBUG:teuthology.orchestra.run.smithi031:osd.1> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T01:46:08.735 INFO:tasks.cephadm:Deploying osd.2 on smithi031 with /dev/vg_nvme/lv_2... 2024-09-17T01:46:08.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T01:46:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:09 smithi031 ceph-mon[27673]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:46:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:09 smithi031 ceph-mon[27673]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:46:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:09 smithi092 ceph-mon[33552]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:46:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:09 smithi092 ceph-mon[33552]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:10.431 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-mon[27673]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:46:10.431 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-mon[27673]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T01:46:10.432 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:10.432 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-mon[27673]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:46:10.432 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:10.432 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[48238]: 2024-09-17T01:46:10.083+0000 7f91a1243700 -1 osd.1 0 waiting for initial osdmap 2024-09-17T01:46:10.432 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:10 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[48238]: 2024-09-17T01:46:10.087+0000 7f919b034700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:46:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:10 smithi092 ceph-mon[33552]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:46:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:10 smithi092 ceph-mon[33552]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T01:46:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:10 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:10 smithi092 ceph-mon[33552]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:46:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:10 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:11.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:11 smithi031 ceph-mon[27673]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-09-17T01:46:11.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:11 smithi031 ceph-mon[27673]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T01:46:11.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:11 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:11.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:11 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:11.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:11 smithi031 ceph-mon[27673]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:11 smithi092 ceph-mon[33552]: from='osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-09-17T01:46:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:11 smithi092 ceph-mon[33552]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T01:46:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:11 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:11 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:11 smithi092 ceph-mon[33552]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:46:12.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:12 smithi031 ceph-mon[27673]: purged_snaps scrub starts 2024-09-17T01:46:12.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:12 smithi031 ceph-mon[27673]: purged_snaps scrub ok 2024-09-17T01:46:12.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:12 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:12.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:12 smithi031 ceph-mon[27673]: osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] boot 2024-09-17T01:46:12.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:12 smithi031 ceph-mon[27673]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T01:46:12.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:12 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:12 smithi092 ceph-mon[33552]: purged_snaps scrub starts 2024-09-17T01:46:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:12 smithi092 ceph-mon[33552]: purged_snaps scrub ok 2024-09-17T01:46:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:12 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:12 smithi092 ceph-mon[33552]: osd.1 [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] boot 2024-09-17T01:46:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:12 smithi092 ceph-mon[33552]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T01:46:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:12 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:46:13.223 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:13 smithi031 ceph-mon[27673]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T01:46:13.223 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:13 smithi031 ceph-mon[27673]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:13 smithi092 ceph-mon[33552]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T01:46:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:13 smithi092 ceph-mon[33552]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:46:13.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_2 2024-09-17T01:46:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:46:15.116 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:14 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:15.116 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:14 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:15.116 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:14 smithi031 ceph-mon[27673]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:14 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:14 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:14 smithi092 ceph-mon[33552]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 -- 172.21.15.31:0/35279109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41441003d0 msgr2=0x7f4144100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 --2- 172.21.15.31:0/35279109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41441003d0 0x7f4144100840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4134009910 tx=0x7f4134009c20 comp rx=0 tx=0).stop 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 -- 172.21.15.31:0/35279109 shutdown_connections 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 --2- 172.21.15.31:0/35279109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41441003d0 0x7f4144100840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 --2- 172.21.15.31:0/35279109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41440ff130 0x7f41440ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 -- 172.21.15.31:0/35279109 >> 172.21.15.31:0/35279109 conn(0x7f41440fa780 msgr2=0x7f41440fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 -- 172.21.15.31:0/35279109 shutdown_connections 2024-09-17T01:46:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.327+0000 7f414b44f700 1 -- 172.21.15.31:0/35279109 wait complete. 2024-09-17T01:46:16.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f414b44f700 1 Processor -- start 2024-09-17T01:46:16.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f414b44f700 1 -- start start 2024-09-17T01:46:16.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f414b44f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 0x7f4144195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f414b44f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41441003d0 0x7f4144196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f414b44f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144196640 con 0x7f41440ff130 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f414b44f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144196780 con 0x7f41441003d0 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f41491eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 0x7f4144195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f41491eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 0x7f4144195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54720/0 (socket says 172.21.15.31:54720) 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.328+0000 7f41491eb700 1 -- 172.21.15.31:0/105666493 learned_addr learned my addr 172.21.15.31:0/105666493 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f41489ea700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41441003d0 0x7f4144196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f41491eb700 1 -- 172.21.15.31:0/105666493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41441003d0 msgr2=0x7f4144196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f41491eb700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41441003d0 0x7f4144196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f41491eb700 1 -- 172.21.15.31:0/105666493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340095f0 con 0x7f41440ff130 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f41489ea700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41441003d0 0x7f4144196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f41491eb700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 0x7f4144195ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f414000b4b0 tx=0x7f414000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4140011800 con 0x7f41440ff130 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4140011e10 con 0x7f41440ff130 2024-09-17T01:46:16.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414419b230 con 0x7f41440ff130 2024-09-17T01:46:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f414000f2e0 con 0x7f41440ff130 2024-09-17T01:46:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.329+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414419b780 con 0x7f41440ff130 2024-09-17T01:46:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.330+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4144107c90 con 0x7f41440ff130 2024-09-17T01:46:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.331+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f4140010380 con 0x7f41440ff130 2024-09-17T01:46:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.331+0000 7f413a7fc700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f413006c600 0x7f413006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.331+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7f414008a750 con 0x7f41440ff130 2024-09-17T01:46:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.331+0000 7f41489ea700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f413006c600 0x7f413006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.332+0000 7f41489ea700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f413006c600 0x7f413006eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f413400b5c0 tx=0x7f4134005e20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:16.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.336+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4140059630 con 0x7f41440ff130 2024-09-17T01:46:16.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:16.552+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4144068c50 con 0x7f413006c600 2024-09-17T01:46:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:17 smithi092 ceph-mon[33552]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:17 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:46:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:17 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:46:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:17 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:17 smithi031 ceph-mon[27673]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:17 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:46:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:17 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:46:17.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:17 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:18 smithi031 ceph-mon[27673]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:18.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:18 smithi092 ceph-mon[33552]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:19.659 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:19.659 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.659 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.659 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:19.659 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:19.659 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.660 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:19.660 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:19.660 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.660 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:20 smithi092 ceph-mon[33552]: Detected new or changed devices on smithi031 2024-09-17T01:46:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:20 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi031 to 5922M 2024-09-17T01:46:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:20 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/4149691101' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf612577-981f-416a-a098-88f736d7cfe1"}]: dispatch 2024-09-17T01:46:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:20 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/4149691101' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf612577-981f-416a-a098-88f736d7cfe1"}]': finished 2024-09-17T01:46:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:20 smithi092 ceph-mon[33552]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T01:46:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:20 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:20 smithi031 ceph-mon[27673]: Detected new or changed devices on smithi031 2024-09-17T01:46:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:20 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi031 to 5922M 2024-09-17T01:46:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:20 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/4149691101' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf612577-981f-416a-a098-88f736d7cfe1"}]: dispatch 2024-09-17T01:46:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:20 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/4149691101' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf612577-981f-416a-a098-88f736d7cfe1"}]': finished 2024-09-17T01:46:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:20 smithi031 ceph-mon[27673]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T01:46:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:20 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:21 smithi092 ceph-mon[33552]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:21 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2419786743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:46:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:21 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:21 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:21.749 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:21 smithi031 ceph-mon[27673]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:21.749 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:21 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2419786743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:46:21.749 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:21 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:21.750 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:21 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:23 smithi031 ceph-mon[27673]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:23 smithi092 ceph-mon[33552]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:24.981 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:27 smithi092 ceph-mon[33552]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:27.753 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:27 smithi031 ceph-mon[27673]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:28.629 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:28 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:46:28.630 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:28 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:28.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:28 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:46:28.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:28 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:29 smithi092 ceph-mon[33552]: Deploying daemon osd.2 on smithi031 2024-09-17T01:46:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:29 smithi092 ceph-mon[33552]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:29 smithi031 ceph-mon[27673]: Deploying daemon osd.2 on smithi031 2024-09-17T01:46:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:29 smithi031 ceph-mon[27673]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:31 smithi092 ceph-mon[33552]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:31 smithi031 ceph-mon[27673]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:33 smithi092 ceph-mon[33552]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:33.743 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:33 smithi031 ceph-mon[27673]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:33.744 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:33.744 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:33.744 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:35.688 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:35 smithi031 ceph-mon[27673]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:35 smithi092 ceph-mon[33552]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:37.076 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 2 on host 'smithi031' 2024-09-17T01:46:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.078+0000 7f413a7fc700 1 -- 172.21.15.31:0/105666493 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4144068c50 con 0x7f413006c600 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f413006c600 msgr2=0x7f413006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f413006c600 0x7f413006eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f413400b5c0 tx=0x7f4134005e20 comp rx=0 tx=0).stop 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 msgr2=0x7f4144195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 0x7f4144195ae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f414000b4b0 tx=0x7f414000b870 comp rx=0 tx=0).stop 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 shutdown_connections 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f413006c600 0x7f413006eab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41440ff130 0x7f4144195ae0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 --2- 172.21.15.31:0/105666493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41441003d0 0x7f4144196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 >> 172.21.15.31:0/105666493 conn(0x7f41440fa780 msgr2=0x7f4144068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:37.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 shutdown_connections 2024-09-17T01:46:37.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:46:37.079+0000 7f414b44f700 1 -- 172.21.15.31:0/105666493 wait complete. 2024-09-17T01:46:37.674 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:37 smithi031 ceph-mon[27673]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:37.674 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:37 smithi031 ceph-mon[27673]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:46:37.674 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:37.674 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:37.973 DEBUG:teuthology.orchestra.run.smithi031:osd.2> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T01:46:37.976 INFO:tasks.cephadm:Deploying osd.3 on smithi092 with /dev/vg_nvme/lv_4... 2024-09-17T01:46:37.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T01:46:37.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:37 smithi092 ceph-mon[33552]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:37 smithi092 ceph-mon[33552]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:46:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:37 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:37 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:46:38.629 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:38 smithi092 ceph-mon[33552]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:46:38.629 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:38 smithi092 ceph-mon[33552]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T01:46:38.629 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:38 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:38.629 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:38 smithi092 ceph-mon[33552]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:46:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:38 smithi031 ceph-mon[27673]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:46:38.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:38 smithi031 ceph-mon[27673]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T01:46:38.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:38 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:38.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:38 smithi031 ceph-mon[27673]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:46:38.765 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[53713]: 2024-09-17T01:46:38.504+0000 7f439ae76700 -1 osd.2 0 waiting for initial osdmap 2024-09-17T01:46:38.765 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[53713]: 2024-09-17T01:46:38.514+0000 7f4391c61700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:46:39.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:39 smithi092 ceph-mon[33552]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:39.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:39 smithi092 ceph-mon[33552]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-09-17T01:46:39.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:39 smithi092 ceph-mon[33552]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T01:46:39.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:39.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:39.703 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:39.750 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:39 smithi031 ceph-mon[27673]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:39.751 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:39 smithi031 ceph-mon[27673]: from='osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-09-17T01:46:39.751 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:39 smithi031 ceph-mon[27673]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T01:46:39.751 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:39.751 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:39.751 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:40.534 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:46:40.553 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-09-17T01:46:40.786 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:46:41.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: purged_snaps scrub starts 2024-09-17T01:46:41.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: purged_snaps scrub ok 2024-09-17T01:46:41.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:41.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] boot 2024-09-17T01:46:41.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T01:46:41.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:41.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:41.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:40 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: purged_snaps scrub starts 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: purged_snaps scrub ok 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: osd.2 [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] boot 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:40 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:42.174 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:41 smithi092 ceph-mon[33552]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:42.174 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:41 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:46:42.174 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:41 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T01:46:42.174 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:41 smithi092 ceph-mon[33552]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T01:46:42.174 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:41 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:46:42.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:41 smithi031 ceph-mon[27673]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:46:42.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:41 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:46:42.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:41 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T01:46:42.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:41 smithi031 ceph-mon[27673]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T01:46:42.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:41 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 -- 172.21.15.92:0/3509703060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8069b00 msgr2=0x7f67a8102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 --2- 172.21.15.92:0/3509703060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8069b00 0x7f67a8102df0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6798009910 tx=0x7f6798009c20 comp rx=0 tx=0).stop 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 -- 172.21.15.92:0/3509703060 shutdown_connections 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 --2- 172.21.15.92:0/3509703060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67a8103330 0x7f67a81057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 --2- 172.21.15.92:0/3509703060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8069b00 0x7f67a8102df0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 -- 172.21.15.92:0/3509703060 >> 172.21.15.92:0/3509703060 conn(0x7f67a80fa7a0 msgr2=0x7f67a80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 -- 172.21.15.92:0/3509703060 shutdown_connections 2024-09-17T01:46:42.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.407+0000 7f67aea4e700 1 -- 172.21.15.92:0/3509703060 wait complete. 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67aea4e700 1 Processor -- start 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67aea4e700 1 -- start start 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67aea4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67a8103330 0x7f67a8195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67aea4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 0x7f67a819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67aea4e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8196820 con 0x7f67a8103330 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67aea4e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8196990 con 0x7f67a8196320 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f679ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 0x7f67a819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f679ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 0x7f67a819b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49614/0 (socket says 172.21.15.92:49614) 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f679ffff700 1 -- 172.21.15.92:0/4185409974 learned_addr learned my addr 172.21.15.92:0/4185409974 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.408+0000 7f67a7fff700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67a8103330 0x7f67a8195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f679ffff700 1 -- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67a8103330 msgr2=0x7f67a8195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f679ffff700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67a8103330 0x7f67a8195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f679ffff700 1 -- 172.21.15.92:0/4185409974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67980095f0 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f679ffff700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 0x7f67a819b390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f679000d8d0 tx=0x7f679000dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67900098a0 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6790010460 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f679000f5f0 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a819b930 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.409+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a819be50 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.410+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a818fbf0 con 0x7f67a8196320 2024-09-17T01:46:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.410+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f6790009a00 con 0x7f67a8196320 2024-09-17T01:46:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.411+0000 7f67a5ffb700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f679406c600 0x7f679406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.411+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3060+0+0 (secure 0 0 0) 0x7f679008ac20 con 0x7f67a8196320 2024-09-17T01:46:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.411+0000 7f67a7fff700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f679406c600 0x7f679406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.412+0000 7f67a7fff700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f679406c600 0x7f679406eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6798006010 tx=0x7f6798005ec0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:42.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.415+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6790059850 con 0x7f67a8196320 2024-09-17T01:46:42.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.612+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f67a8061190 con 0x7f679406c600 2024-09-17T01:46:42.764 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55970]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:46:42.764 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55970]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:42.764 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55970]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:42.765 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55970]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:42.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:46:42.948+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6790056190 con 0x7f67a8196320 2024-09-17T01:46:43.172 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T01:46:43.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:42 smithi031 ceph-mon[27673]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T01:46:43.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:42 smithi031 ceph-mon[27673]: pgmap v78: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:46:43.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:46:43.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:46:43.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:42 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:43.173 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55986]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:46:43.173 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55986]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:43.173 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55986]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:43.173 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:46:42 smithi031 sudo[55986]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T01:46:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:42 smithi092 ceph-mon[33552]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T01:46:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:42 smithi092 ceph-mon[33552]: pgmap v78: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:46:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:46:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:46:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:42 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:43.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56062]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:46:43.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56062]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:43.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56062]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:43.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56062]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:44.159 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56177]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:46:44.159 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:44.159 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56177]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:44.159 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:46:43 smithi031 sudo[56177]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:44.159 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: mgrmap e19: smithi031.ealpiz(active, since 2m), standbys: smithi092.tjdpfw 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: Detected new or changed devices on smithi031 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi031 to 3948M 2024-09-17T01:46:44.160 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.161 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:44.161 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:44.161 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.161 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: mgrmap e19: smithi031.ealpiz(active, since 2m), standbys: smithi092.tjdpfw 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: Detected new or changed devices on smithi031 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi031 to 3948M 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:44.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56197]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:46:44.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56197]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:44.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56197]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:44.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56197]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:45.162 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56299]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:46:45.162 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:45.162 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56299]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:45.162 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:46:44 smithi031 sudo[56299]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56325]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:46:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56325]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56325]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56325]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56399]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:46:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56399]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56399]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 sudo[56399]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 ceph-mon[27673]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:46:46.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:45 smithi031 ceph-mon[27673]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:46:46.232 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:45 smithi092 sudo[37449]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:46:46.232 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:45 smithi092 sudo[37449]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:46.232 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:45 smithi092 sudo[37449]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:46.232 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:45 smithi092 sudo[37449]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 sudo[37452]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:46:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 sudo[37452]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:46:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 sudo[37452]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-17T01:46:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 sudo[37452]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:46:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: pgmap v80: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:46:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:46:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/4015555826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba"}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba"}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba"}]': finished 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:46:47.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:46:47.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:47.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:46 smithi031 ceph-mon[27673]: pgmap v82: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:46:47.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/4015555826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba"}]: dispatch 2024-09-17T01:46:47.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba"}]: dispatch 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba"}]': finished 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T01:46:47.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:46:47.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:46:47.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:47.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:46 smithi092 ceph-mon[33552]: pgmap v82: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:46:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:47 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/92128380' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:46:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:48.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:47 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/92128380' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:46:48.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:47 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:48.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:47 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:48 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:48 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:48 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:48 smithi092 ceph-mon[33552]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-17T01:46:49.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:48 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:49.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:48 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:46:49.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:48 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:49.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:48 smithi031 ceph-mon[27673]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-17T01:46:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:51 smithi092 ceph-mon[33552]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-09-17T01:46:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:51 smithi031 ceph-mon[27673]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-09-17T01:46:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:53 smithi092 ceph-mon[33552]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-09-17T01:46:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:53 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:46:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:53 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:53.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:53 smithi031 ceph-mon[27673]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-09-17T01:46:53.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:53 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:46:53.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:53 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:46:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:54 smithi031 ceph-mon[27673]: Deploying daemon osd.3 on smithi092 2024-09-17T01:46:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:54.872 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:54 smithi092 ceph-mon[33552]: Deploying daemon osd.3 on smithi092 2024-09-17T01:46:54.872 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:46:55.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:55 smithi092 ceph-mon[33552]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-17T01:46:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:55 smithi031 ceph-mon[27673]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-17T01:46:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:57 smithi092 ceph-mon[33552]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 122 KiB/s wr, 8 op/s 2024-09-17T01:46:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:57 smithi031 ceph-mon[27673]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 122 KiB/s wr, 8 op/s 2024-09-17T01:46:59.155 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:58 smithi092 ceph-mon[33552]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-17T01:46:59.156 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:58 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:59.156 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:58 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:59.156 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:46:58 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:46:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:58 smithi031 ceph-mon[27673]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-17T01:46:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:58 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:58 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:46:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:46:58 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:01.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:01 smithi092 ceph-mon[33552]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:47:01.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:01 smithi031 ceph-mon[27673]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:47:02.335 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 3 on host 'smithi092' 2024-09-17T01:47:02.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.336+0000 7f67a5ffb700 1 -- 172.21.15.92:0/4185409974 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f67a8061190 con 0x7f679406c600 2024-09-17T01:47:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f679406c600 msgr2=0x7f679406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f679406c600 0x7f679406eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6798006010 tx=0x7f6798005ec0 comp rx=0 tx=0).stop 2024-09-17T01:47:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 msgr2=0x7f67a819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 0x7f67a819b390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f679000d8d0 tx=0x7f679000dbe0 comp rx=0 tx=0).stop 2024-09-17T01:47:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 shutdown_connections 2024-09-17T01:47:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f679406c600 0x7f679406eab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67a8103330 0x7f67a8195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 --2- 172.21.15.92:0/4185409974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a8196320 0x7f67a819b390 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 >> 172.21.15.92:0/4185409974 conn(0x7f67a80fa7a0 msgr2=0x7f67a80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 shutdown_connections 2024-09-17T01:47:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:02.339+0000 7f67aea4e700 1 -- 172.21.15.92:0/4185409974 wait complete. 2024-09-17T01:47:02.928 DEBUG:teuthology.orchestra.run.smithi092:osd.3> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T01:47:02.931 INFO:tasks.cephadm:Deploying osd.4 on smithi092 with /dev/vg_nvme/lv_3... 2024-09-17T01:47:02.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: from='osd.3 [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:47:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:03 smithi092 ceph-mon[33552]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:47:03.556 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.557 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.557 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.557 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:03.557 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:47:03.557 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: from='osd.3 [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:47:03.557 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:03 smithi031 ceph-mon[27673]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:47:03.993 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:47:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-mon[33552]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:47:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-mon[33552]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T01:47:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-mon[33552]: from='osd.3 [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-mon[33552]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:04.490 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[39504]: 2024-09-17T01:47:04.425+0000 7f1afa208700 -1 osd.3 0 waiting for initial osdmap 2024-09-17T01:47:04.490 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:47:04 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[39504]: 2024-09-17T01:47:04.431+0000 7f1af57fc700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:47:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:04 smithi031 ceph-mon[27673]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:47:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:04 smithi031 ceph-mon[27673]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T01:47:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:04 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:04.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:04 smithi031 ceph-mon[27673]: from='osd.3 [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:04.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:04 smithi031 ceph-mon[27673]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: osd.3 [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] boot 2024-09-17T01:47:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T01:47:05.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:05 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-17T01:47:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T01:47:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:47:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: osd.3 [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] boot 2024-09-17T01:47:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T01:47:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:05 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:47:06.567 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: purged_snaps scrub starts 2024-09-17T01:47:06.567 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: purged_snaps scrub ok 2024-09-17T01:47:06.567 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.567 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.567 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:06.567 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.568 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:06.568 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:06.568 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.568 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:06 smithi092 ceph-mon[33552]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T01:47:06.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: purged_snaps scrub starts 2024-09-17T01:47:06.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: purged_snaps scrub ok 2024-09-17T01:47:06.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:06 smithi031 ceph-mon[27673]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: Detected new or changed devices on smithi092 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi092 to 14912M 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:07.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:07.681 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:07 smithi092 ceph-mon[33552]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T01:47:07.683 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:47:07.702 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-09-17T01:47:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: Detected new or changed devices on smithi092 2024-09-17T01:47:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi092 to 14912M 2024-09-17T01:47:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:07.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:07 smithi031 ceph-mon[27673]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T01:47:07.898 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:47:09.064 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:08 smithi092 ceph-mon[33552]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T01:47:09.064 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:08 smithi092 ceph-mon[33552]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:08 smithi031 ceph-mon[27673]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T01:47:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:08 smithi031 ceph-mon[27673]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:09.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.323+0000 7f6aa4083700 1 -- 172.21.15.92:0/2218533632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 msgr2=0x7f6a9c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.323+0000 7f6aa4083700 1 --2- 172.21.15.92:0/2218533632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c0ff560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009910 tx=0x7f6a98009c20 comp rx=0 tx=0).stop 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.323+0000 7f6aa4083700 1 -- 172.21.15.92:0/2218533632 shutdown_connections 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.323+0000 7f6aa4083700 1 --2- 172.21.15.92:0/2218533632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c1003f0 0x7f6a9c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.323+0000 7f6aa4083700 1 --2- 172.21.15.92:0/2218533632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c0ff560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.323+0000 7f6aa4083700 1 -- 172.21.15.92:0/2218533632 >> 172.21.15.92:0/2218533632 conn(0x7f6a9c0fa7a0 msgr2=0x7f6a9c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 -- 172.21.15.92:0/2218533632 shutdown_connections 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 -- 172.21.15.92:0/2218533632 wait complete. 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 Processor -- start 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 -- start start 2024-09-17T01:47:09.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c1003f0 0x7f6a9c1951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1957f0 con 0x7f6a9c1003f0 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa4083700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c195960 con 0x7f6a9c0ff150 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa1e1f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa1e1f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48366/0 (socket says 172.21.15.92:48366) 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.324+0000 7f6aa1e1f700 1 -- 172.21.15.92:0/3261254621 learned_addr learned my addr 172.21.15.92:0/3261254621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa161e700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c1003f0 0x7f6a9c1951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa1e1f700 1 -- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c1003f0 msgr2=0x7f6a9c1951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa1e1f700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c1003f0 0x7f6a9c1951f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa1e1f700 1 -- 172.21.15.92:0/3261254621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980095f0 con 0x7f6a9c0ff150 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa1e1f700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c194cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a98006010 tx=0x7f6a9800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:09.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a9801f070 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c068dd0 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a98019610 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a9800f7f0 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.325+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c0692c0 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.326+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c068ab0 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.327+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6a98019c60 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.327+0000 7f6a92ffd700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6a8806c680 0x7f6a8806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.327+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3602+0+0 (secure 0 0 0) 0x7f6a9808e780 con 0x7f6a9c0ff150 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.327+0000 7f6aa161e700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6a8806c680 0x7f6a8806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.328+0000 7f6aa161e700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6a8806c680 0x7f6a8806eb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005fd0 tx=0x7f6a8c00a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:09.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.332+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6a980595a0 con 0x7f6a9c0ff150 2024-09-17T01:47:09.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:09.531+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a9c069a70 con 0x7f6a8806c680 2024-09-17T01:47:10.166 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:09 smithi092 ceph-mon[33552]: osdmap e30: 4 total, 4 up, 4 in 2024-09-17T01:47:10.167 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:10.167 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:47:10.167 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:47:10.167 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:09 smithi031 ceph-mon[27673]: osdmap e30: 4 total, 4 up, 4 in 2024-09-17T01:47:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:47:10.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:47:10.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:11.156 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:10 smithi092 ceph-mon[33552]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:11.156 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:10 smithi092 ceph-mon[33552]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:10 smithi031 ceph-mon[27673]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:10 smithi031 ceph-mon[27673]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:11 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/3559263097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c39144-ebcf-41ca-b250-257837878d64"}]: dispatch 2024-09-17T01:47:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:11 smithi092 ceph-mon[33552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c39144-ebcf-41ca-b250-257837878d64"}]: dispatch 2024-09-17T01:47:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:11 smithi092 ceph-mon[33552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1c39144-ebcf-41ca-b250-257837878d64"}]': finished 2024-09-17T01:47:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:11 smithi092 ceph-mon[33552]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T01:47:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:11 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:12.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:11 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/3559263097' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c39144-ebcf-41ca-b250-257837878d64"}]: dispatch 2024-09-17T01:47:12.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:11 smithi031 ceph-mon[27673]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c39144-ebcf-41ca-b250-257837878d64"}]: dispatch 2024-09-17T01:47:12.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:11 smithi031 ceph-mon[27673]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1c39144-ebcf-41ca-b250-257837878d64"}]': finished 2024-09-17T01:47:12.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:11 smithi031 ceph-mon[27673]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T01:47:12.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:11 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:13.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:12 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/240611990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:47:13.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:12 smithi092 ceph-mon[33552]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-17T01:47:13.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:12 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/240611990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:47:13.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:12 smithi031 ceph-mon[27673]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-17T01:47:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:15 smithi031 ceph-mon[27673]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T01:47:15.976 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:15 smithi092 ceph-mon[33552]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-17T01:47:17.627 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:17 smithi092 ceph-mon[33552]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T01:47:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:17 smithi031 ceph-mon[27673]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T01:47:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:18 smithi092 ceph-mon[33552]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T01:47:19.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:18 smithi031 ceph-mon[27673]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-17T01:47:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:47:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:19 smithi092 ceph-mon[33552]: Deploying daemon osd.4 on smithi092 2024-09-17T01:47:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:47:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:19 smithi031 ceph-mon[27673]: Deploying daemon osd.4 on smithi092 2024-09-17T01:47:21.202 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:20 smithi092 ceph-mon[33552]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T01:47:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:20 smithi031 ceph-mon[27673]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T01:47:23.719 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:23 smithi092 ceph-mon[33552]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T01:47:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:23 smithi031 ceph-mon[27673]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-17T01:47:25.152 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:25.152 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:25.152 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:25.152 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:24 smithi092 ceph-mon[33552]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:25.152 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:24 smithi031 ceph-mon[27673]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:27.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.395+0000 7f6a92ffd700 1 -- 172.21.15.92:0/3261254621 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a9c069a70 con 0x7f6a8806c680 2024-09-17T01:47:27.394 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 4 on host 'smithi092' 2024-09-17T01:47:27.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.397+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6a8806c680 msgr2=0x7f6a8806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.397+0000 7f6aa4083700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6a8806c680 0x7f6a8806eb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005fd0 tx=0x7f6a8c00a560 comp rx=0 tx=0).stop 2024-09-17T01:47:27.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.397+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 msgr2=0x7f6a9c194cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.397+0000 7f6aa4083700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c194cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a98006010 tx=0x7f6a9800be20 comp rx=0 tx=0).stop 2024-09-17T01:47:27.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 shutdown_connections 2024-09-17T01:47:27.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6a8806c680 0x7f6a8806eb30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c0ff150 0x7f6a9c194cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 --2- 172.21.15.92:0/3261254621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a9c1003f0 0x7f6a9c1951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 >> 172.21.15.92:0/3261254621 conn(0x7f6a9c0fa7a0 msgr2=0x7f6a9c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:27.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 shutdown_connections 2024-09-17T01:47:27.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:27.398+0000 7f6aa4083700 1 -- 172.21.15.92:0/3261254621 wait complete. 2024-09-17T01:47:27.693 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:27 smithi092 ceph-mon[33552]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:27.693 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:27 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:27.693 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:27 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:27 smithi031 ceph-mon[27673]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:27 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:27 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:27.997 DEBUG:teuthology.orchestra.run.smithi092:osd.4> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T01:47:28.000 INFO:tasks.cephadm:Deploying osd.5 on smithi092 with /dev/vg_nvme/lv_2... 2024-09-17T01:47:28.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T01:47:28.240 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:47:28.680 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:28 smithi092 ceph-mon[33552]: from='osd.4 [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:47:28.681 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:28 smithi092 ceph-mon[33552]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:47:28.681 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:28 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:28.681 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:28 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:28.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:28 smithi031 ceph-mon[27673]: from='osd.4 [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:47:28.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:28 smithi031 ceph-mon[27673]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:47:28.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:28 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:28.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:28 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:29.536 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-mon[33552]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:29.536 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-mon[33552]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:47:29.536 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-mon[33552]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T01:47:29.536 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:29.536 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-mon[33552]: from='osd.4 [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:29.536 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-mon[33552]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:29.536 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[44136]: 2024-09-17T01:47:29.516+0000 7f127bd8e700 -1 osd.4 0 waiting for initial osdmap 2024-09-17T01:47:29.537 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:47:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[44136]: 2024-09-17T01:47:29.523+0000 7f1274b7d700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:47:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:29 smithi031 ceph-mon[27673]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:29 smithi031 ceph-mon[27673]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:47:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:29 smithi031 ceph-mon[27673]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T01:47:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:29.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:29 smithi031 ceph-mon[27673]: from='osd.4 [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:29.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:29 smithi031 ceph-mon[27673]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: osdmap e33: 5 total, 4 up, 5 in 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: osd.4 [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] boot 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T01:47:30.935 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:30 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:31.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-17T01:47:31.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: osdmap e33: 5 total, 4 up, 5 in 2024-09-17T01:47:31.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:31.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:31.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: osd.4 [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] boot 2024-09-17T01:47:31.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T01:47:31.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:30 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:47:31.341 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-17T01:47:31.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-09-17T01:47:31.799 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:31 smithi092 ceph-mon[33552]: purged_snaps scrub starts 2024-09-17T01:47:31.799 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:31 smithi092 ceph-mon[33552]: purged_snaps scrub ok 2024-09-17T01:47:31.799 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:31 smithi092 ceph-mon[33552]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:31.950 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:47:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:31 smithi031 ceph-mon[27673]: purged_snaps scrub starts 2024-09-17T01:47:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:31 smithi031 ceph-mon[27673]: purged_snaps scrub ok 2024-09-17T01:47:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:31 smithi031 ceph-mon[27673]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-17T01:47:32.645 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:32 smithi092 ceph-mon[33552]: osdmap e35: 5 total, 5 up, 5 in 2024-09-17T01:47:32.946 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:32 smithi031 ceph-mon[27673]: osdmap e35: 5 total, 5 up, 5 in 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:33.880 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:33.881 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:33.881 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:33.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/3473748190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f40ff130 msgr2=0x7fd3f40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/3473748190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f40ff130 0x7fd3f40ff540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009910 tx=0x7fd3dc009c20 comp rx=0 tx=0).stop 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/3473748190 shutdown_connections 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/3473748190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f41003d0 0x7fd3f4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/3473748190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f40ff130 0x7fd3f40ff540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/3473748190 >> 172.21.15.92:0/3473748190 conn(0x7fd3f40fa780 msgr2=0x7fd3f40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/3473748190 shutdown_connections 2024-09-17T01:47:33.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.985+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/3473748190 wait complete. 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f8c0a700 1 Processor -- start 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f8c0a700 1 -- start start 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f8c0a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40ff130 0x7fd3f4103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f8c0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 0x7fd3f41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f8c0a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4101cf0 con 0x7fd3f40ff130 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f8c0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4101e30 con 0x7fd3f41003d0 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f1d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 0x7fd3f41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f1d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 0x7fd3f41017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44674/0 (socket says 172.21.15.92:44674) 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f1d9b700 1 -- 172.21.15.92:0/2233654111 learned_addr learned my addr 172.21.15.92:0/2233654111 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.986+0000 7fd3f259c700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40ff130 0x7fd3f4103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3f1d9b700 1 -- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40ff130 msgr2=0x7fd3f4103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3f1d9b700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40ff130 0x7fd3f4103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3f1d9b700 1 -- 172.21.15.92:0/2233654111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0095f0 con 0x7fd3f41003d0 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3f1d9b700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 0x7fd3f41017b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b4b0 tx=0x7fd3e400b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e4011800 con 0x7fd3f41003d0 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4102110 con 0x7fd3f41003d0 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd3e4011e10 con 0x7fd3f41003d0 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e400f2e0 con 0x7fd3f41003d0 2024-09-17T01:47:33.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.987+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f419db60 con 0x7fd3f41003d0 2024-09-17T01:47:33.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.988+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f4107c90 con 0x7fd3f41003d0 2024-09-17T01:47:33.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.989+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd3e4010380 con 0x7fd3f41003d0 2024-09-17T01:47:33.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.989+0000 7fd3eb7fe700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd3e006c680 0x7fd3e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.989+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4034+0+0 (secure 0 0 0) 0x7fd3e408aec0 con 0x7fd3f41003d0 2024-09-17T01:47:33.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.990+0000 7fd3f259c700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd3e006c680 0x7fd3e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.990+0000 7fd3f259c700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd3e006c680 0x7fd3e006eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc006010 tx=0x7fd3dc00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:33.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:33.994+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd3e40595c0 con 0x7fd3f41003d0 2024-09-17T01:47:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:34.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:34.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:34.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:34.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:34.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:34.188+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3f4068c50 con 0x7fd3e006c680 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: Detected new or changed devices on smithi092 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi092 to 7456M 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:34.856 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:34.857 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:47:34.857 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:47:34.857 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:34.857 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:34 smithi092 ceph-mon[33552]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:35.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: Detected new or changed devices on smithi092 2024-09-17T01:47:35.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi092 to 7456M 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:35.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:34 smithi031 ceph-mon[27673]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/2566003210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f25a6b-25f7-40d7-acc7-0b3c64c1d47b"}]: dispatch 2024-09-17T01:47:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f25a6b-25f7-40d7-acc7-0b3c64c1d47b"}]: dispatch 2024-09-17T01:47:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88f25a6b-25f7-40d7-acc7-0b3c64c1d47b"}]': finished 2024-09-17T01:47:37.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T01:47:37.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:37.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:37 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/505067696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:47:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/2566003210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f25a6b-25f7-40d7-acc7-0b3c64c1d47b"}]: dispatch 2024-09-17T01:47:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88f25a6b-25f7-40d7-acc7-0b3c64c1d47b"}]: dispatch 2024-09-17T01:47:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88f25a6b-25f7-40d7-acc7-0b3c64c1d47b"}]': finished 2024-09-17T01:47:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T01:47:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:37.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:37 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/505067696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:47:39.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:38 smithi092 ceph-mon[33552]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:39.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:38 smithi031 ceph-mon[27673]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:40.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:41.149 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:40 smithi092 ceph-mon[33552]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:41.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:40 smithi031 ceph-mon[27673]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:43 smithi031 ceph-mon[27673]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:43.878 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:43 smithi092 ceph-mon[33552]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:44.689 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:44 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:47:44.689 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:44 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:47:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:44 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:45.553 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:45 smithi092 ceph-mon[33552]: Deploying daemon osd.5 on smithi092 2024-09-17T01:47:45.554 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:45 smithi092 ceph-mon[33552]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:45 smithi031 ceph-mon[27673]: Deploying daemon osd.5 on smithi092 2024-09-17T01:47:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:45 smithi031 ceph-mon[27673]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:47 smithi092 ceph-mon[33552]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:47 smithi031 ceph-mon[27673]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:48 smithi092 ceph-mon[33552]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:49.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:48 smithi031 ceph-mon[27673]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:49 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:49 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:51.191 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:50 smithi092 ceph-mon[33552]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:51.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:50 smithi031 ceph-mon[27673]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:52.302 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 5 on host 'smithi092' 2024-09-17T01:47:52.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.303+0000 7fd3eb7fe700 1 -- 172.21.15.92:0/2233654111 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd3f4068c50 con 0x7fd3e006c680 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd3e006c680 msgr2=0x7fd3e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd3e006c680 0x7fd3e006eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc006010 tx=0x7fd3dc00b540 comp rx=0 tx=0).stop 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 msgr2=0x7fd3f41017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 0x7fd3f41017b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b4b0 tx=0x7fd3e400b7c0 comp rx=0 tx=0).stop 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 shutdown_connections 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd3e006c680 0x7fd3e006eb30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f40ff130 0x7fd3f4103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 --2- 172.21.15.92:0/2233654111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3f41003d0 0x7fd3f41017b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 >> 172.21.15.92:0/2233654111 conn(0x7fd3f40fa780 msgr2=0x7fd3f4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:52.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 shutdown_connections 2024-09-17T01:47:52.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:47:52.305+0000 7fd3f8c0a700 1 -- 172.21.15.92:0/2233654111 wait complete. 2024-09-17T01:47:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:53 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:53 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:53 smithi092 ceph-mon[33552]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:53 smithi092 ceph-mon[33552]: from='osd.5 [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:47:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:53 smithi092 ceph-mon[33552]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:47:53.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:53 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:53.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:53 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:53.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:53 smithi031 ceph-mon[27673]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:53.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:53 smithi031 ceph-mon[27673]: from='osd.5 [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:47:53.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:53 smithi031 ceph-mon[27673]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:47:53.518 DEBUG:teuthology.orchestra.run.smithi092:osd.5> sudo journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T01:47:53.521 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-17T01:47:53.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:47:53.739 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='osd.5 [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:54.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:54.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:47:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T01:47:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='osd.5 [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:47:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:47:55.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[48809]: 2024-09-17T01:47:54.884+0000 7fed43a64700 -1 osd.5 0 waiting for initial osdmap 2024-09-17T01:47:55.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:47:54 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[48809]: 2024-09-17T01:47:54.893+0000 7fed3e056700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/3848886350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 msgr2=0x7f6ef40ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/3848886350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef40ff550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009910 tx=0x7f6ee4009c20 comp rx=0 tx=0).stop 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/3848886350 shutdown_connections 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/3848886350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ef4100340 0x7f6ef4100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/3848886350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef40ff550 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/3848886350 >> 172.21.15.31:0/3848886350 conn(0x7f6ef40fa6d0 msgr2=0x7f6ef40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/3848886350 shutdown_connections 2024-09-17T01:47:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.505+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/3848886350 wait complete. 2024-09-17T01:47:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef8f7a700 1 Processor -- start 2024-09-17T01:47:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef8f7a700 1 -- start start 2024-09-17T01:47:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef8f7a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef4197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:55.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef8f7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ef4100340 0x7f6ef4198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef8f7a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4198840 con 0x7f6ef40ff140 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef8f7a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef419d250 con 0x7f6ef4100340 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef4197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef4197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59252/0 (socket says 172.21.15.31:59252) 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef259c700 1 -- 172.21.15.31:0/536303104 learned_addr learned my addr 172.21.15.31:0/536303104 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef1d9b700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ef4100340 0x7f6ef4198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef259c700 1 -- 172.21.15.31:0/536303104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ef4100340 msgr2=0x7f6ef4198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef259c700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ef4100340 0x7f6ef4198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.506+0000 7f6ef259c700 1 -- 172.21.15.31:0/536303104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40095f0 con 0x7f6ef40ff140 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.507+0000 7f6ef259c700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef4197ce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000c00 tx=0x7f6ee400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.507+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee401d070 con 0x7f6ef40ff140 2024-09-17T01:47:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.507+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6ee4005dc0 con 0x7f6ef40ff140 2024-09-17T01:47:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.507+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee4022470 con 0x7f6ef40ff140 2024-09-17T01:47:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.507+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef419d3f0 con 0x7f6ef40ff140 2024-09-17T01:47:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.507+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef419d860 con 0x7f6ef40ff140 2024-09-17T01:47:55.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.508+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef4107cb0 con 0x7f6ef40ff140 2024-09-17T01:47:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.508+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6ee4003810 con 0x7f6ef40ff140 2024-09-17T01:47:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.509+0000 7f6ee37fe700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6edc06c680 0x7f6edc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.509+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4186+0+0 (secure 0 0 0) 0x7f6ee408c880 con 0x7f6ef40ff140 2024-09-17T01:47:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.509+0000 7f6ef1d9b700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6edc06c680 0x7f6edc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:55.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.509+0000 7f6ef1d9b700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6edc06c680 0x7f6edc06eb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009c60 tx=0x7f6ee8009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.514+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6ee4057460 con 0x7f6ef40ff140 2024-09-17T01:47:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.716+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6ef4107e70 con 0x7f6ef40ff140 2024-09-17T01:47:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.716+0000 7f6ee37fe700 1 -- 172.21.15.31:0/536303104 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6ee405aa80 con 0x7f6ef40ff140 2024-09-17T01:47:55.715 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6edc06c680 msgr2=0x7f6edc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6edc06c680 0x7f6edc06eb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009c60 tx=0x7f6ee8009260 comp rx=0 tx=0).stop 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 msgr2=0x7f6ef4197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef4197ce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000c00 tx=0x7f6ee400f690 comp rx=0 tx=0).stop 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 shutdown_connections 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6edc06c680 0x7f6edc06eb30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ef40ff140 0x7f6ef4197ce0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 --2- 172.21.15.31:0/536303104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ef4100340 0x7f6ef4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 >> 172.21.15.31:0/536303104 conn(0x7f6ef40fa6d0 msgr2=0x7f6ef4068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.718+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 shutdown_connections 2024-09-17T01:47:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:55.719+0000 7f6ef8f7a700 1 -- 172.21.15.31:0/536303104 wait complete. 2024-09-17T01:47:55.945 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: purged_snaps scrub starts 2024-09-17T01:47:55.945 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: purged_snaps scrub ok 2024-09-17T01:47:55.945 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-17T01:47:55.946 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: osdmap e38: 6 total, 5 up, 6 in 2024-09-17T01:47:55.946 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:55.946 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:55.946 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:55 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/536303104' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: purged_snaps scrub starts 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: purged_snaps scrub ok 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: osdmap e38: 6 total, 5 up, 6 in 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:56.008 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:55 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/536303104' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:47:56.422 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1726537650,"num_in_osds":6,"osd_in_since":1726537656,"num_remapped_pgs":0} 2024-09-17T01:47:56.950 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:56 smithi092 ceph-mon[33552]: osd.5 [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] boot 2024-09-17T01:47:56.950 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:56 smithi092 ceph-mon[33552]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T01:47:56.950 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:56 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:56.950 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:56 smithi092 ceph-mon[33552]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:57.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:56 smithi031 ceph-mon[27673]: osd.5 [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] boot 2024-09-17T01:47:57.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:56 smithi031 ceph-mon[27673]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T01:47:57.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:56 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:47:57.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:56 smithi031 ceph-mon[27673]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:47:57.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:47:57.636 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: Detected new or changed devices on smithi092 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi092 to 4970M 2024-09-17T01:47:57.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:57.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: Detected new or changed devices on smithi092 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:47:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi092 to 4970M 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:47:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:47:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:58 smithi031 ceph-mon[27673]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:47:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:58 smithi092 ceph-mon[33552]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:47:59.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.287+0000 7f869d624700 1 -- 172.21.15.31:0/1571148844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 msgr2=0x7f86980ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.287+0000 7f869d624700 1 --2- 172.21.15.31:0/1571148844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f86980ff560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8688009910 tx=0x7f8688009c20 comp rx=0 tx=0).stop 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 -- 172.21.15.31:0/1571148844 shutdown_connections 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 --2- 172.21.15.31:0/1571148844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86981003f0 0x7f8698100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 --2- 172.21.15.31:0/1571148844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f86980ff560 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 -- 172.21.15.31:0/1571148844 >> 172.21.15.31:0/1571148844 conn(0x7f86980fa7a0 msgr2=0x7f86980fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 -- 172.21.15.31:0/1571148844 shutdown_connections 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 -- 172.21.15.31:0/1571148844 wait complete. 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 Processor -- start 2024-09-17T01:47:59.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.288+0000 7f869d624700 1 -- start start 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f869d624700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f8698195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f869d624700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86981003f0 0x7f86981963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f869d624700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86981969c0 con 0x7f86980ff150 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f869d624700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8698196b00 con 0x7f86981003f0 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f8698195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f8698195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59278/0 (socket says 172.21.15.31:59278) 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 -- 172.21.15.31:0/328337723 learned_addr learned my addr 172.21.15.31:0/328337723 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f86967fc700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86981003f0 0x7f86981963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 -- 172.21.15.31:0/328337723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86981003f0 msgr2=0x7f86981963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86981003f0 0x7f86981963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:59.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 -- 172.21.15.31:0/328337723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880095f0 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f8696ffd700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f8698195e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8688006010 tx=0x7f868800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f868801d070 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869819b550 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f868800f460 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.289+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8688021640 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.290+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869819ba40 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.290+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8698068ab0 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.291+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f868800fab0 con 0x7f86980ff150 2024-09-17T01:47:59.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.291+0000 7f867ffff700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f868006c680 0x7f868006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:59.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.292+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f868808c8d0 con 0x7f86980ff150 2024-09-17T01:47:59.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.292+0000 7f86967fc700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f868006c680 0x7f868006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:59.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.292+0000 7f86967fc700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f868006c680 0x7f868006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f868c009a10 tx=0x7f868c009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:59.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.296+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f868805ae20 con 0x7f86980ff150 2024-09-17T01:47:59.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.496+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f869819bd20 con 0x7f86980ff150 2024-09-17T01:47:59.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.496+0000 7f867ffff700 1 -- 172.21.15.31:0/328337723 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f868805a9b0 con 0x7f86980ff150 2024-09-17T01:47:59.497 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:47:59.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f868006c680 msgr2=0x7f868006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:59.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f868006c680 0x7f868006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f868c009a10 tx=0x7f868c009190 comp rx=0 tx=0).stop 2024-09-17T01:47:59.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 msgr2=0x7f8698195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:59.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f8698195e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8688006010 tx=0x7f868800bd70 comp rx=0 tx=0).stop 2024-09-17T01:47:59.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 shutdown_connections 2024-09-17T01:47:59.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f868006c680 0x7f868006eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:59.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86980ff150 0x7f8698195e60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:59.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 --2- 172.21.15.31:0/328337723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86981003f0 0x7f86981963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:59.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 >> 172.21.15.31:0/328337723 conn(0x7f86980fa7a0 msgr2=0x7f8698068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:59.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 shutdown_connections 2024-09-17T01:47:59.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:47:59.498+0000 7f869d624700 1 -- 172.21.15.31:0/328337723 wait complete. 2024-09-17T01:48:00.158 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:47:59 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/328337723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:48:00.180 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726537675,"num_in_osds":6,"osd_in_since":1726537656,"num_remapped_pgs":0} 2024-09-17T01:48:00.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:48:00.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:47:59 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/328337723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:48:00.387 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:01.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:00 smithi031 ceph-mon[27673]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:01.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:00 smithi092 ceph-mon[33552]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 -- 172.21.15.31:0/2966461165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e541004e0 msgr2=0x7f3e541008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 --2- 172.21.15.31:0/2966461165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e541004e0 0x7f3e541008b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400b0a0 tx=0x7f3e4400b3b0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 -- 172.21.15.31:0/2966461165 shutdown_connections 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 --2- 172.21.15.31:0/2966461165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e54100e80 0x7f3e54104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 --2- 172.21.15.31:0/2966461165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e541004e0 0x7f3e541008b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 -- 172.21.15.31:0/2966461165 >> 172.21.15.31:0/2966461165 conn(0x7f3e540fbda0 msgr2=0x7f3e540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:02.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 -- 172.21.15.31:0/2966461165 shutdown_connections 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.094+0000 7f3e59db1700 1 -- 172.21.15.31:0/2966461165 wait complete. 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e59db1700 1 Processor -- start 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e59db1700 1 -- start start 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e59db1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e541004e0 0x7f3e54073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e59db1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 0x7f3e54073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e59db1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e54073ad0 con 0x7f3e54100e80 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e59db1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e54073c10 con 0x7f3e541004e0 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 0x7f3e54073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 0x7f3e54073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59282/0 (socket says 172.21.15.31:59282) 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e52ffd700 1 -- 172.21.15.31:0/1772203789 learned_addr learned my addr 172.21.15.31:0/1772203789 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.095+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e541004e0 0x7f3e54073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e52ffd700 1 -- 172.21.15.31:0/1772203789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e541004e0 msgr2=0x7f3e54073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:02.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e541004e0 0x7f3e54073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e52ffd700 1 -- 172.21.15.31:0/1772203789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44009d00 con 0x7f3e54100e80 2024-09-17T01:48:02.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e52ffd700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 0x7f3e54073590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d900 tx=0x7f3e3c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c009900 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e541a20c0 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e3c010460 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c00f5f0 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.096+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541a24d0 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.097+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e541087f0 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.098+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3e3c0105d0 con 0x7f3e54100e80 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.098+0000 7f3e50ff9700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3e4006c680 0x7f3e4006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:02.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.098+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f3e3c08b040 con 0x7f3e54100e80 2024-09-17T01:48:02.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.098+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3e4006c680 0x7f3e4006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:02.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.099+0000 7f3e537fe700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3e4006c680 0x7f3e4006eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000f80 tx=0x7f3e440060c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:02.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.102+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3e3c055b00 con 0x7f3e54100e80 2024-09-17T01:48:02.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.303+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e541081d0 con 0x7f3e54100e80 2024-09-17T01:48:02.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.304+0000 7f3e50ff9700 1 -- 172.21.15.31:0/1772203789 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11012 (secure 0 0 0) 0x7f3e3c089e60 con 0x7f3e54100e80 2024-09-17T01:48:02.303 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:02.303 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","created":"2024-09-17T01:42:15.955102+0000","modified":"2024-09-17T01:47:56.885369+0000","last_up_change":"2024-09-17T01:47:55.884064+0000","last_in_change":"2024-09-17T01:47:36.610951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:46:40.925991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0670c70-68df-4156-9be7-ac9d3c2bad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6803","nonce":736735920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6805","nonce":736735920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6809","nonce":736735920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6807","nonce":736735920}]},"public_addr":"172.21.15.31:6803/736735920","cluster_addr":"172.21.15.31:6805/736735920","heartbeat_back_addr":"172.21.15.31:6809/736735920","heartbeat_front_addr":"172.21.15.31:6807/736735920","state":["exists","up"]},{"osd":1,"uuid":"b32a3d5d-4862-4f43-8750-f72caf8c68b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6811","nonce":4041806736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6813","nonce":4041806736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6817","nonce":4041806736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6815","nonce":4041806736}]},"public_addr":"172.21.15.31:6811/4041806736","cluster_addr":"172.21.15.31:6813/4041806736","heartbeat_back_addr":"172.21.15.31:6817/4041806736","heartbeat_front_addr":"172.21.15.31:6815/4041806736","state":["exists","up"]},{"osd":2,"uuid":"cf612577-981f-416a-a098-88f736d7cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6819","nonce":3654254818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6821","nonce":3654254818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6825","nonce":3654254818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6823","nonce":3654254818}]},"public_addr":"172.21.15.31:6819/3654254818","cluster_addr":"172.21.15.31:6821/3654254818","heartbeat_back_addr":"172.21.15.31:6825/3654254818","heartbeat_front_addr":"172.21.15.31:6823/3654254818","state":["exists","up"]},{"osd":3,"uuid":"4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6801","nonce":500078270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6803","nonce":500078270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6807","nonce":500078270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6805","nonce":500078270}]},"public_addr":"172.21.15.92:6801/500078270","cluster_addr":"172.21.15.92:6803/500078270","heartbeat_back_addr":"172.21.15.92:6807/500078270","heartbeat_front_addr":"172.21.15.92:6805/500078270","state":["exists","up"]},{"osd":4,"uuid":"f1c39144-ebcf-41ca-b250-257837878d64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6809","nonce":1246708337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6811","nonce":1246708337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6815","nonce":1246708337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6813","nonce":1246708337}]},"public_addr":"172.21.15.92:6809/1246708337","cluster_addr":"172.21.15.92:6811/1246708337","heartbeat_back_addr":"172.21.15.92:6815/1246708337","heartbeat_front_addr":"172.21.15.92:6813/1246708337","state":["exists","up"]},{"osd":5,"uuid":"88f25a6b-25f7-40d7-acc7-0b3c64c1d47b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6817","nonce":2711827424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6819","nonce":2711827424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6823","nonce":2711827424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6821","nonce":2711827424}]},"public_addr":"172.21.15.92:6817/2711827424","cluster_addr":"172.21.15.92:6819/2711827424","heartbeat_back_addr":"172.21.15.92:6823/2711827424","heartbeat_front_addr":"172.21.15.92:6821/2711827424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:45:40.808480+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:46:09.372527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:46:37.986335+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:03.499143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:28.751404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:53.854567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/4262139956":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/3923214510":"2024-09-18T01:43:18.823729+0000","172.21.15.31:0/3469839404":"2024-09-18T01:43:18.823729+0000","172.21.15.31:6801/2":"2024-09-18T01:42:45.749841+0000","172.21.15.31:6800/2":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1648474001":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/3417331215":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1798114852":"2024-09-18T01:43:18.823729+0000","172.21.15.31:0/339238761":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/2073602888":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1660870141":"2024-09-18T01:42:45.749841+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:02.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3e4006c680 msgr2=0x7f3e4006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:02.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3e4006c680 0x7f3e4006eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000f80 tx=0x7f3e440060c0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 msgr2=0x7f3e54073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:02.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 0x7f3e54073590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d900 tx=0x7f3e3c00dc10 comp rx=0 tx=0).stop 2024-09-17T01:48:02.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 shutdown_connections 2024-09-17T01:48:02.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3e4006c680 0x7f3e4006eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e541004e0 0x7f3e54073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 --2- 172.21.15.31:0/1772203789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e54100e80 0x7f3e54073590 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.306+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 >> 172.21.15.31:0/1772203789 conn(0x7f3e540fbda0 msgr2=0x7f3e540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:02.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.307+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 shutdown_connections 2024-09-17T01:48:02.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:02.307+0000 7f3e59db1700 1 -- 172.21.15.31:0/1772203789 wait complete. 2024-09-17T01:48:02.648 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:02 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1772203789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:48:02.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:02 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1772203789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:48:02.989 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:46:40.925991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:48:02.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T01:48:03.201 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:03.567 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:03 smithi031 ceph-mon[27673]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:03.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:03 smithi092 ceph-mon[33552]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 -- 172.21.15.31:0/3211810661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 msgr2=0x7f1050100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 --2- 172.21.15.31:0/3211810661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050100890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1040009910 tx=0x7f1040009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 -- 172.21.15.31:0/3211810661 shutdown_connections 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 --2- 172.21.15.31:0/3211810661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1050100e60 0x7f1050104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 --2- 172.21.15.31:0/3211810661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050100890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 -- 172.21.15.31:0/3211810661 >> 172.21.15.31:0/3211810661 conn(0x7f10500fbd80 msgr2=0x7f10500fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 -- 172.21.15.31:0/3211810661 shutdown_connections 2024-09-17T01:48:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.955+0000 7f10559d7700 1 -- 172.21.15.31:0/3211810661 wait complete. 2024-09-17T01:48:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f10559d7700 1 Processor -- start 2024-09-17T01:48:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f10559d7700 1 -- start start 2024-09-17T01:48:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f10559d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f10559d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1050100e60 0x7f1050196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f10559d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1050196b50 con 0x7f10501004c0 2024-09-17T01:48:04.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f10559d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105019a8e0 con 0x7f1050100e60 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47970/0 (socket says 172.21.15.31:47970) 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104effd700 1 -- 172.21.15.31:0/2196208117 learned_addr learned my addr 172.21.15.31:0/2196208117 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104e7fc700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1050100e60 0x7f1050196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104effd700 1 -- 172.21.15.31:0/2196208117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1050100e60 msgr2=0x7f1050196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104effd700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1050100e60 0x7f1050196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.956+0000 7f104effd700 1 -- 172.21.15.31:0/2196208117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400095f0 con 0x7f10501004c0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.957+0000 7f104effd700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050195f30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1040006010 tx=0x7f104000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.957+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104001d070 con 0x7f10501004c0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.957+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105019ab60 con 0x7f10501004c0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.957+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f104000f460 con 0x7f10501004c0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.957+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1040017630 con 0x7f10501004c0 2024-09-17T01:48:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.957+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105019b050 con 0x7f10501004c0 2024-09-17T01:48:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.958+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10501087d0 con 0x7f10501004c0 2024-09-17T01:48:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.958+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f104000f5d0 con 0x7f10501004c0 2024-09-17T01:48:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.959+0000 7f10549d5700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f103c06c680 0x7f103c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.959+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f104008cac0 con 0x7f10501004c0 2024-09-17T01:48:04.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.959+0000 7f104e7fc700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f103c06c680 0x7f103c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.959+0000 7f104e7fc700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f103c06c680 0x7f103c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1038005fd0 tx=0x7f103800a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:04.964+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1040057580 con 0x7f10501004c0 2024-09-17T01:48:05.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.161+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10501081b0 con 0x7f10501004c0 2024-09-17T01:48:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.161+0000 7f10549d5700 1 -- 172.21.15.31:0/2196208117 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f104005aba0 con 0x7f10501004c0 2024-09-17T01:48:05.160 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f103c06c680 msgr2=0x7f103c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f103c06c680 0x7f103c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1038005fd0 tx=0x7f103800a560 comp rx=0 tx=0).stop 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 msgr2=0x7f1050195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050195f30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1040006010 tx=0x7f104000be20 comp rx=0 tx=0).stop 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 shutdown_connections 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f103c06c680 0x7f103c06eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10501004c0 0x7f1050195f30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 --2- 172.21.15.31:0/2196208117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1050100e60 0x7f1050196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.163+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 >> 172.21.15.31:0/2196208117 conn(0x7f10500fbd80 msgr2=0x7f10500fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.164+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 shutdown_connections 2024-09-17T01:48:05.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:05.164+0000 7f10559d7700 1 -- 172.21.15.31:0/2196208117 wait complete. 2024-09-17T01:48:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:05 smithi031 ceph-mon[27673]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:05 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2196208117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T01:48:05.862 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T01:48:05.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T01:48:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:05 smithi092 ceph-mon[33552]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:05 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2196208117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T01:48:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:07.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 -- 172.21.15.31:0/1963956925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8101440 msgr2=0x7f83b8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 --2- 172.21.15.31:0/1963956925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8101440 0x7f83b8101890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009910 tx=0x7f83ac009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 -- 172.21.15.31:0/1963956925 shutdown_connections 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 --2- 172.21.15.31:0/1963956925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8101440 0x7f83b8101890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 --2- 172.21.15.31:0/1963956925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83b8100240 0x7f83b8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 -- 172.21.15.31:0/1963956925 >> 172.21.15.31:0/1963956925 conn(0x7f83b80fb7f0 msgr2=0x7f83b80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 -- 172.21.15.31:0/1963956925 shutdown_connections 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.713+0000 7f83bc903700 1 -- 172.21.15.31:0/1963956925 wait complete. 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.714+0000 7f83bc903700 1 Processor -- start 2024-09-17T01:48:07.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.714+0000 7f83bc903700 1 -- start start 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.714+0000 7f83bc903700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 0x7f83b8195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.714+0000 7f83bc903700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83b8101440 0x7f83b8196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.714+0000 7f83bc903700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81966b0 con 0x7f83b8100240 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.714+0000 7f83bc903700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81967f0 con 0x7f83b8101440 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 0x7f83b8195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 0x7f83b8195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47986/0 (socket says 172.21.15.31:47986) 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 -- 172.21.15.31:0/3297973295 learned_addr learned my addr 172.21.15.31:0/3297973295 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b5d9b700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83b8101440 0x7f83b8196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:07.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 -- 172.21.15.31:0/3297973295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83b8101440 msgr2=0x7f83b8196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83b8101440 0x7f83b8196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 -- 172.21.15.31:0/3297973295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0095f0 con 0x7f83b8100240 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83b659c700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 0x7f83b8195b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b480 tx=0x7f83a800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a8011800 con 0x7f83b8100240 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83a8011e10 con 0x7f83b8100240 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b819b2a0 con 0x7f83b8100240 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a8010ea0 con 0x7f83b8100240 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.715+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b819b7f0 con 0x7f83b8100240 2024-09-17T01:48:07.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.716+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b8108e30 con 0x7f83b8100240 2024-09-17T01:48:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.717+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f83a8010380 con 0x7f83b8100240 2024-09-17T01:48:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.717+0000 7f83a77fe700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f83a006c680 0x7f83a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.717+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f83a808b000 con 0x7f83b8100240 2024-09-17T01:48:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.717+0000 7f83b5d9b700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f83a006c680 0x7f83a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:07.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.718+0000 7f83b5d9b700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f83a006c680 0x7f83a006eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83ac006010 tx=0x7f83ac00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:07.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:07.722+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f83a8059600 con 0x7f83b8100240 2024-09-17T01:48:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:07 smithi031 ceph-mon[27673]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:07 smithi092 ceph-mon[33552]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.001+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f83b819bef0 con 0x7f83b8100240 2024-09-17T01:48:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.005+0000 7f83a77fe700 1 -- 172.21.15.31:0/3297973295 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f83b819bef0 con 0x7f83b8100240 2024-09-17T01:48:08.003 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T01:48:08.004 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDY3+hmGbctABAAbqhxnhUHemdYne9ArL5OKw== 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f83a006c680 msgr2=0x7f83a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f83a006c680 0x7f83a006eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83ac006010 tx=0x7f83ac00b540 comp rx=0 tx=0).stop 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 msgr2=0x7f83b8195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 0x7f83b8195b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b480 tx=0x7f83a800b790 comp rx=0 tx=0).stop 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 shutdown_connections 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f83a006c680 0x7f83a006eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83b8100240 0x7f83b8195b50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 --2- 172.21.15.31:0/3297973295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83b8101440 0x7f83b8196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 >> 172.21.15.31:0/3297973295 conn(0x7f83b80fb7f0 msgr2=0x7f83b8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 shutdown_connections 2024-09-17T01:48:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:08.007+0000 7f83bc903700 1 -- 172.21.15.31:0/3297973295 wait complete. 2024-09-17T01:48:08.801 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:48:08.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T01:48:08.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T01:48:08.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T01:48:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi092/config 2024-09-17T01:48:09.183 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:08 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3297973295' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:48:09.183 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:08 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3297973295' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:48:09.183 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:08 smithi092 ceph-mon[33552]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:08 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3297973295' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:48:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:08 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3297973295' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:48:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:08 smithi031 ceph-mon[27673]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:10.257 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:10 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:10 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:10.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 -- 172.21.15.92:0/2279948139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa0100240 msgr2=0x7f7aa0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2279948139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa0100240 0x7f7aa0100650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009910 tx=0x7f7a90009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 -- 172.21.15.92:0/2279948139 shutdown_connections 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2279948139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa01014e0 0x7f7aa0101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2279948139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa0100240 0x7f7aa0100650 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 -- 172.21.15.92:0/2279948139 >> 172.21.15.92:0/2279948139 conn(0x7f7aa00fb890 msgr2=0x7f7aa00fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 -- 172.21.15.92:0/2279948139 shutdown_connections 2024-09-17T01:48:10.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.588+0000 7f7aa515a700 1 -- 172.21.15.92:0/2279948139 wait complete. 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7aa515a700 1 Processor -- start 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7aa515a700 1 -- start start 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7aa515a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa0100240 0x7f7aa0195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7aa515a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 0x7f7aa0196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7aa515a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0196680 con 0x7f7aa0100240 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7aa515a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01967c0 con 0x7f7aa01014e0 2024-09-17T01:48:10.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 0x7f7aa0196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 0x7f7aa0196060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54606/0 (socket says 172.21.15.92:54606) 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9e59c700 1 -- 172.21.15.92:0/2990396573 learned_addr learned my addr 172.21.15.92:0/2990396573 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9ed9d700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa0100240 0x7f7aa0195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9e59c700 1 -- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa0100240 msgr2=0x7f7aa0195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9e59c700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa0100240 0x7f7aa0195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.589+0000 7f7a9e59c700 1 -- 172.21.15.92:0/2990396573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900095f0 con 0x7f7aa01014e0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7a9ed9d700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa0100240 0x7f7aa0195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7a9e59c700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 0x7f7aa0196060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400b4b0 tx=0x7f7a9400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a94011800 con 0x7f7aa01014e0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa019b270 con 0x7f7aa01014e0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a94011e10 con 0x7f7aa01014e0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a9400f2e0 con 0x7f7aa01014e0 2024-09-17T01:48:10.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.590+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa019b7c0 con 0x7f7aa01014e0 2024-09-17T01:48:10.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.591+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa0108da0 con 0x7f7aa01014e0 2024-09-17T01:48:10.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.591+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7a94010380 con 0x7f7aa01014e0 2024-09-17T01:48:10.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.592+0000 7f7a87fff700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a88070a90 0x7f7a88072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:10.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.592+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f7a9408b110 con 0x7f7aa01014e0 2024-09-17T01:48:10.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.592+0000 7f7a9ed9d700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a88070a90 0x7f7a88072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:10.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.593+0000 7f7a9ed9d700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a88070a90 0x7f7a88072f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a90005b40 tx=0x7f7a90005ab0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:10.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.596+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7a94059660 con 0x7f7aa01014e0 2024-09-17T01:48:10.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.860+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f7aa0108f90 con 0x7f7aa01014e0 2024-09-17T01:48:10.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.865+0000 7f7a87fff700 1 -- 172.21.15.92:0/2990396573 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f7a940591f0 con 0x7f7aa01014e0 2024-09-17T01:48:10.863 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2024-09-17T01:48:10.863 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDa3+hmreZgMxAAvkmLBQ5JJBIyM2+lLThBFg== 2024-09-17T01:48:10.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a88070a90 msgr2=0x7f7a88072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:10.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a88070a90 0x7f7a88072f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a90005b40 tx=0x7f7a90005ab0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 msgr2=0x7f7aa0196060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 0x7f7aa0196060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400b4b0 tx=0x7f7a9400b870 comp rx=0 tx=0).stop 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 shutdown_connections 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a88070a90 0x7f7a88072f40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa0100240 0x7f7aa0195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 --2- 172.21.15.92:0/2990396573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7aa01014e0 0x7f7aa0196060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 >> 172.21.15.92:0/2990396573 conn(0x7f7aa00fb890 msgr2=0x7f7aa0104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 shutdown_connections 2024-09-17T01:48:10.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:48:10.868+0000 7f7aa515a700 1 -- 172.21.15.92:0/2990396573 wait complete. 2024-09-17T01:48:11.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:11 smithi092 ceph-mon[33552]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:11.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:11 smithi092 ceph-mon[33552]: from='client.? 172.21.15.92:0/2990396573' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:48:11.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:11 smithi092 ceph-mon[33552]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:48:11.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:11 smithi092 ceph-mon[33552]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:48:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:11 smithi031 ceph-mon[27673]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:11 smithi031 ceph-mon[27673]: from='client.? 172.21.15.92:0/2990396573' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:48:11.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:11 smithi031 ceph-mon[27673]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:48:11.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:11 smithi031 ceph-mon[27673]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:48:11.458 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:48:11.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T01:48:11.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T01:48:11.498 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T01:48:11.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T01:48:11.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T01:48:11.720 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:13.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.432+0000 7f8af598b700 1 -- 172.21.15.31:0/1019106091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 msgr2=0x7f8af0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.432+0000 7f8af598b700 1 --2- 172.21.15.31:0/1019106091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af0104e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009910 tx=0x7f8ae4009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.432+0000 7f8af598b700 1 -- 172.21.15.31:0/1019106091 shutdown_connections 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.432+0000 7f8af598b700 1 --2- 172.21.15.31:0/1019106091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af0104e50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.432+0000 7f8af598b700 1 --2- 172.21.15.31:0/1019106091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af01004e0 0x7f8af01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.432+0000 7f8af598b700 1 -- 172.21.15.31:0/1019106091 >> 172.21.15.31:0/1019106091 conn(0x7f8af00fbda0 msgr2=0x7f8af00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.433+0000 7f8af598b700 1 -- 172.21.15.31:0/1019106091 shutdown_connections 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.433+0000 7f8af598b700 1 -- 172.21.15.31:0/1019106091 wait complete. 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.433+0000 7f8af598b700 1 Processor -- start 2024-09-17T01:48:13.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.433+0000 7f8af598b700 1 -- start start 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af598b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af01004e0 0x7f8af0195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af598b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af598b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0196bb0 con 0x7f8af0100e80 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af598b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af019a940 con 0x7f8af01004e0 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af01964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47996/0 (socket says 172.21.15.31:47996) 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 -- 172.21.15.31:0/1519009508 learned_addr learned my addr 172.21.15.31:0/1519009508 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aeeffd700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af01004e0 0x7f8af0195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:13.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 -- 172.21.15.31:0/1519009508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af01004e0 msgr2=0x7f8af0195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af01004e0 0x7f8af0195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 -- 172.21.15.31:0/1519009508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40095f0 con 0x7f8af0100e80 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8aee7fc700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af01964d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40092e0 tx=0x7f8ae400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae401d070 con 0x7f8af0100e80 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ae4004fa0 con 0x7f8af0100e80 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af019abc0 con 0x7f8af0100e80 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.434+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae400f690 con 0x7f8af0100e80 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.435+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af019b0b0 con 0x7f8af0100e80 2024-09-17T01:48:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.435+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af01087a0 con 0x7f8af0100e80 2024-09-17T01:48:13.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.436+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8ae4022470 con 0x7f8af0100e80 2024-09-17T01:48:13.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.437+0000 7f8af4989700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ad806c680 0x7f8ad806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:13.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.437+0000 7f8aeeffd700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ad806c680 0x7f8ad806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:13.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.437+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f8ae408cc40 con 0x7f8af0100e80 2024-09-17T01:48:13.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.437+0000 7f8aeeffd700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ad806c680 0x7f8ad806eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009a10 tx=0x7f8ae0009190 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:13.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.441+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8ae4057700 con 0x7f8af0100e80 2024-09-17T01:48:13.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.703+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8af01972f0 con 0x7f8af0100e80 2024-09-17T01:48:13.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.707+0000 7f8af4989700 1 -- 172.21.15.31:0/1519009508 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172827 (secure 0 0 0) 0x7f8ae405ad20 con 0x7f8af0100e80 2024-09-17T01:48:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ad806c680 msgr2=0x7f8ad806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ad806c680 0x7f8ad806eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009a10 tx=0x7f8ae0009190 comp rx=0 tx=0).stop 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 msgr2=0x7f8af01964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af01964d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40092e0 tx=0x7f8ae400bd70 comp rx=0 tx=0).stop 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 shutdown_connections 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ad806c680 0x7f8ad806eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:13.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8af01004e0 0x7f8af0195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 --2- 172.21.15.31:0/1519009508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8af0100e80 0x7f8af01964d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 >> 172.21.15.31:0/1519009508 conn(0x7f8af00fbda0 msgr2=0x7f8af00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 shutdown_connections 2024-09-17T01:48:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:13.709+0000 7f8af598b700 1 -- 172.21.15.31:0/1519009508 wait complete. 2024-09-17T01:48:13.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:13 smithi031 ceph-mon[27673]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:13 smithi092 ceph-mon[33552]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:14.419 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"active_gid":14213,"active_name":"smithi031.ealpiz","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2},{"type":"v1","addr":"172.21.15.31:6801","nonce":2}]},"active_addr":"172.21.15.31:6801/2","active_change":"2024-09-17T01:44:24.407948+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14236,"name":"smithi092.tjdpfw","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.31:8443/","prometheus":"http://172.21.15.31:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1298770794}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2235134594}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3494934127}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":398316293}]}]} 2024-09-17T01:48:14.423 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T01:48:14.423 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T01:48:14.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:48:14.643 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:14.676 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:14 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1519009508' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T01:48:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:14 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1519009508' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T01:48:15.736 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:15 smithi031 ceph-mon[27673]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:15 smithi092 ceph-mon[33552]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:16.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 -- 172.21.15.31:0/2975677610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c100e80 msgr2=0x7fa90c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 --2- 172.21.15.31:0/2975677610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c100e80 0x7fa90c104e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa900009910 tx=0x7fa900009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 -- 172.21.15.31:0/2975677610 shutdown_connections 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 --2- 172.21.15.31:0/2975677610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c100e80 0x7fa90c104e50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 --2- 172.21.15.31:0/2975677610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa90c1004e0 0x7fa90c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 -- 172.21.15.31:0/2975677610 >> 172.21.15.31:0/2975677610 conn(0x7fa90c0fbda0 msgr2=0x7fa90c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 -- 172.21.15.31:0/2975677610 shutdown_connections 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.255+0000 7fa9136cb700 1 -- 172.21.15.31:0/2975677610 wait complete. 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa9136cb700 1 Processor -- start 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa9136cb700 1 -- start start 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa9136cb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 0x7fa90c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa9136cb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa90c100e80 0x7fa90c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa9136cb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c198d50 con 0x7fa90c1004e0 2024-09-17T01:48:16.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa9136cb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c19cae0 con 0x7fa90c100e80 2024-09-17T01:48:16.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa911467700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 0x7fa90c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:16.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa911467700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 0x7fa90c198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38724/0 (socket says 172.21.15.31:38724) 2024-09-17T01:48:16.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.256+0000 7fa911467700 1 -- 172.21.15.31:0/4293583197 learned_addr learned my addr 172.21.15.31:0/4293583197 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa911467700 1 -- 172.21.15.31:0/4293583197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa90c100e80 msgr2=0x7fa90c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa911467700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa90c100e80 0x7fa90c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa911467700 1 -- 172.21.15.31:0/4293583197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000095f0 con 0x7fa90c1004e0 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa911467700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 0x7fa90c198130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c8a0 tx=0x7fa90800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90800cea0 con 0x7fa90c1004e0 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c19cdc0 con 0x7fa90c1004e0 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa908004830 con 0x7fa90c1004e0 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9080055b0 con 0x7fa90c1004e0 2024-09-17T01:48:16.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.257+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c19d310 con 0x7fa90c1004e0 2024-09-17T01:48:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.258+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c1045d0 con 0x7fa90c1004e0 2024-09-17T01:48:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.259+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa908007ad0 con 0x7fa90c1004e0 2024-09-17T01:48:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.259+0000 7fa8fe7fc700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa8f806c680 0x7fa8f806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.259+0000 7fa910c66700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa8f806c680 0x7fa8f806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.259+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa90808b200 con 0x7fa90c1004e0 2024-09-17T01:48:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.260+0000 7fa910c66700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa8f806c680 0x7fa8f806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa90000b5c0 tx=0x7fa900005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:16.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.264+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa908055cc0 con 0x7fa90c1004e0 2024-09-17T01:48:16.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.464+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa90c199590 con 0x7fa90c1004e0 2024-09-17T01:48:16.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.466+0000 7fa8fe7fc700 1 -- 172.21.15.31:0/4293583197 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11012 (secure 0 0 0) 0x7fa90c199590 con 0x7fa90c1004e0 2024-09-17T01:48:16.464 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:16.464 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","created":"2024-09-17T01:42:15.955102+0000","modified":"2024-09-17T01:47:56.885369+0000","last_up_change":"2024-09-17T01:47:55.884064+0000","last_in_change":"2024-09-17T01:47:36.610951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:46:40.925991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0670c70-68df-4156-9be7-ac9d3c2bad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6803","nonce":736735920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6805","nonce":736735920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6809","nonce":736735920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6807","nonce":736735920}]},"public_addr":"172.21.15.31:6803/736735920","cluster_addr":"172.21.15.31:6805/736735920","heartbeat_back_addr":"172.21.15.31:6809/736735920","heartbeat_front_addr":"172.21.15.31:6807/736735920","state":["exists","up"]},{"osd":1,"uuid":"b32a3d5d-4862-4f43-8750-f72caf8c68b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6811","nonce":4041806736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6813","nonce":4041806736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6817","nonce":4041806736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6815","nonce":4041806736}]},"public_addr":"172.21.15.31:6811/4041806736","cluster_addr":"172.21.15.31:6813/4041806736","heartbeat_back_addr":"172.21.15.31:6817/4041806736","heartbeat_front_addr":"172.21.15.31:6815/4041806736","state":["exists","up"]},{"osd":2,"uuid":"cf612577-981f-416a-a098-88f736d7cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6819","nonce":3654254818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6821","nonce":3654254818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6825","nonce":3654254818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6823","nonce":3654254818}]},"public_addr":"172.21.15.31:6819/3654254818","cluster_addr":"172.21.15.31:6821/3654254818","heartbeat_back_addr":"172.21.15.31:6825/3654254818","heartbeat_front_addr":"172.21.15.31:6823/3654254818","state":["exists","up"]},{"osd":3,"uuid":"4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6801","nonce":500078270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6803","nonce":500078270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6807","nonce":500078270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6805","nonce":500078270}]},"public_addr":"172.21.15.92:6801/500078270","cluster_addr":"172.21.15.92:6803/500078270","heartbeat_back_addr":"172.21.15.92:6807/500078270","heartbeat_front_addr":"172.21.15.92:6805/500078270","state":["exists","up"]},{"osd":4,"uuid":"f1c39144-ebcf-41ca-b250-257837878d64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6809","nonce":1246708337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6811","nonce":1246708337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6815","nonce":1246708337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6813","nonce":1246708337}]},"public_addr":"172.21.15.92:6809/1246708337","cluster_addr":"172.21.15.92:6811/1246708337","heartbeat_back_addr":"172.21.15.92:6815/1246708337","heartbeat_front_addr":"172.21.15.92:6813/1246708337","state":["exists","up"]},{"osd":5,"uuid":"88f25a6b-25f7-40d7-acc7-0b3c64c1d47b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6817","nonce":2711827424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6819","nonce":2711827424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6823","nonce":2711827424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6821","nonce":2711827424}]},"public_addr":"172.21.15.92:6817/2711827424","cluster_addr":"172.21.15.92:6819/2711827424","heartbeat_back_addr":"172.21.15.92:6823/2711827424","heartbeat_front_addr":"172.21.15.92:6821/2711827424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:45:40.808480+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:46:09.372527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:46:37.986335+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:03.499143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:28.751404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:53.854567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/4262139956":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/3923214510":"2024-09-18T01:43:18.823729+0000","172.21.15.31:0/3469839404":"2024-09-18T01:43:18.823729+0000","172.21.15.31:6801/2":"2024-09-18T01:42:45.749841+0000","172.21.15.31:6800/2":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1648474001":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/3417331215":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1798114852":"2024-09-18T01:43:18.823729+0000","172.21.15.31:0/339238761":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/2073602888":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1660870141":"2024-09-18T01:42:45.749841+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:16.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa8f806c680 msgr2=0x7fa8f806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:16.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa8f806c680 0x7fa8f806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa90000b5c0 tx=0x7fa900005960 comp rx=0 tx=0).stop 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 msgr2=0x7fa90c198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 0x7fa90c198130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c8a0 tx=0x7fa90800cc60 comp rx=0 tx=0).stop 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 shutdown_connections 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa8f806c680 0x7fa8f806eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c1004e0 0x7fa90c198130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 --2- 172.21.15.31:0/4293583197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa90c100e80 0x7fa90c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 >> 172.21.15.31:0/4293583197 conn(0x7fa90c0fbda0 msgr2=0x7fa90c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 shutdown_connections 2024-09-17T01:48:16.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:16.468+0000 7fa9136cb700 1 -- 172.21.15.31:0/4293583197 wait complete. 2024-09-17T01:48:16.752 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:16 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/4293583197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:48:16.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:16 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/4293583197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:48:17.042 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T01:48:17.042 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:48:17.248 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:17.620 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:17 smithi031 ceph-mon[27673]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:17.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:17 smithi092 ceph-mon[33552]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/402343470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b0100e80 msgr2=0x7fd9b0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/402343470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b0100e80 0x7fd9b0104e50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009910 tx=0x7fd9a4009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/402343470 shutdown_connections 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/402343470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b0100e80 0x7fd9b0104e50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/402343470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b01004e0 0x7fd9b01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/402343470 >> 172.21.15.31:0/402343470 conn(0x7fd9b00fbda0 msgr2=0x7fd9b00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/402343470 shutdown_connections 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.816+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/402343470 wait complete. 2024-09-17T01:48:18.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9b5cb2700 1 Processor -- start 2024-09-17T01:48:18.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9b5cb2700 1 -- start start 2024-09-17T01:48:18.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9b5cb2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 0x7fd9b0195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9b5cb2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0100e80 0x7fd9b01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9b5cb2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0196bb0 con 0x7fd9b01004e0 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9b5cb2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b019a940 con 0x7fd9b0100e80 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9af7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 0x7fd9b0195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9af7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 0x7fd9b0195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38742/0 (socket says 172.21.15.31:38742) 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9af7fe700 1 -- 172.21.15.31:0/3803638158 learned_addr learned my addr 172.21.15.31:0/3803638158 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9aeffd700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0100e80 0x7fd9b01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.817+0000 7fd9af7fe700 1 -- 172.21.15.31:0/3803638158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0100e80 msgr2=0x7fd9b01964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9af7fe700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0100e80 0x7fd9b01964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9af7fe700 1 -- 172.21.15.31:0/3803638158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40095f0 con 0x7fd9b01004e0 2024-09-17T01:48:18.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9aeffd700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0100e80 0x7fd9b01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9af7fe700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 0x7fd9b0195f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000b4b0 tx=0x7fd9a000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a0011800 con 0x7fd9b01004e0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9a0011e10 con 0x7fd9b01004e0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b019ac20 con 0x7fd9b01004e0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a000f2e0 con 0x7fd9b01004e0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.818+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b019b170 con 0x7fd9b01004e0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.819+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0108780 con 0x7fd9b01004e0 2024-09-17T01:48:18.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.819+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd9a000f440 con 0x7fd9b01004e0 2024-09-17T01:48:18.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.820+0000 7fd9acff9700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd99806c680 0x7fd99806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:18.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.820+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd9a008b030 con 0x7fd9b01004e0 2024-09-17T01:48:18.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.820+0000 7fd9aeffd700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd99806c680 0x7fd99806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:18.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.820+0000 7fd9aeffd700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd99806c680 0x7fd99806eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400b5c0 tx=0x7fd9a4005480 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:18.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:18.824+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd9a0055c50 con 0x7fd9b01004e0 2024-09-17T01:48:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.031+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9b019b440 con 0x7fd9b01004e0 2024-09-17T01:48:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.032+0000 7fd9acff9700 1 -- 172.21.15.31:0/3803638158 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11012 (secure 0 0 0) 0x7fd9a0059270 con 0x7fd9b01004e0 2024-09-17T01:48:19.031 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:19.031 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"fsid":"fb7c6180-7495-11ef-bceb-c7b262605968","created":"2024-09-17T01:42:15.955102+0000","modified":"2024-09-17T01:47:56.885369+0000","last_up_change":"2024-09-17T01:47:55.884064+0000","last_in_change":"2024-09-17T01:47:36.610951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:46:40.925991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b0670c70-68df-4156-9be7-ac9d3c2bad76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6803","nonce":736735920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6805","nonce":736735920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6809","nonce":736735920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":736735920},{"type":"v1","addr":"172.21.15.31:6807","nonce":736735920}]},"public_addr":"172.21.15.31:6803/736735920","cluster_addr":"172.21.15.31:6805/736735920","heartbeat_back_addr":"172.21.15.31:6809/736735920","heartbeat_front_addr":"172.21.15.31:6807/736735920","state":["exists","up"]},{"osd":1,"uuid":"b32a3d5d-4862-4f43-8750-f72caf8c68b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6811","nonce":4041806736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6813","nonce":4041806736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6817","nonce":4041806736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":4041806736},{"type":"v1","addr":"172.21.15.31:6815","nonce":4041806736}]},"public_addr":"172.21.15.31:6811/4041806736","cluster_addr":"172.21.15.31:6813/4041806736","heartbeat_back_addr":"172.21.15.31:6817/4041806736","heartbeat_front_addr":"172.21.15.31:6815/4041806736","state":["exists","up"]},{"osd":2,"uuid":"cf612577-981f-416a-a098-88f736d7cfe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6819","nonce":3654254818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6821","nonce":3654254818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6825","nonce":3654254818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3654254818},{"type":"v1","addr":"172.21.15.31:6823","nonce":3654254818}]},"public_addr":"172.21.15.31:6819/3654254818","cluster_addr":"172.21.15.31:6821/3654254818","heartbeat_back_addr":"172.21.15.31:6825/3654254818","heartbeat_front_addr":"172.21.15.31:6823/3654254818","state":["exists","up"]},{"osd":3,"uuid":"4e5336d1-08a3-4cfa-b6b0-34ca2ceb69ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6801","nonce":500078270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6803","nonce":500078270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6807","nonce":500078270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":500078270},{"type":"v1","addr":"172.21.15.92:6805","nonce":500078270}]},"public_addr":"172.21.15.92:6801/500078270","cluster_addr":"172.21.15.92:6803/500078270","heartbeat_back_addr":"172.21.15.92:6807/500078270","heartbeat_front_addr":"172.21.15.92:6805/500078270","state":["exists","up"]},{"osd":4,"uuid":"f1c39144-ebcf-41ca-b250-257837878d64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6809","nonce":1246708337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6811","nonce":1246708337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6815","nonce":1246708337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1246708337},{"type":"v1","addr":"172.21.15.92:6813","nonce":1246708337}]},"public_addr":"172.21.15.92:6809/1246708337","cluster_addr":"172.21.15.92:6811/1246708337","heartbeat_back_addr":"172.21.15.92:6815/1246708337","heartbeat_front_addr":"172.21.15.92:6813/1246708337","state":["exists","up"]},{"osd":5,"uuid":"88f25a6b-25f7-40d7-acc7-0b3c64c1d47b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6817","nonce":2711827424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6819","nonce":2711827424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6823","nonce":2711827424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2711827424},{"type":"v1","addr":"172.21.15.92:6821","nonce":2711827424}]},"public_addr":"172.21.15.92:6817/2711827424","cluster_addr":"172.21.15.92:6819/2711827424","heartbeat_back_addr":"172.21.15.92:6823/2711827424","heartbeat_front_addr":"172.21.15.92:6821/2711827424","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:45:40.808480+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:46:09.372527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:46:37.986335+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:03.499143+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:28.751404+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:47:53.854567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/4262139956":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/3923214510":"2024-09-18T01:43:18.823729+0000","172.21.15.31:0/3469839404":"2024-09-18T01:43:18.823729+0000","172.21.15.31:6801/2":"2024-09-18T01:42:45.749841+0000","172.21.15.31:6800/2":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1648474001":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/3417331215":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1798114852":"2024-09-18T01:43:18.823729+0000","172.21.15.31:0/339238761":"2024-09-18T01:44:24.407842+0000","172.21.15.31:0/2073602888":"2024-09-18T01:42:45.749841+0000","172.21.15.31:0/1660870141":"2024-09-18T01:42:45.749841+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:19.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd99806c680 msgr2=0x7fd99806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:19.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd99806c680 0x7fd99806eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400b5c0 tx=0x7fd9a4005480 comp rx=0 tx=0).stop 2024-09-17T01:48:19.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 msgr2=0x7fd9b0195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:19.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 0x7fd9b0195f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000b4b0 tx=0x7fd9a000b870 comp rx=0 tx=0).stop 2024-09-17T01:48:19.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 shutdown_connections 2024-09-17T01:48:19.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd99806c680 0x7fd99806eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:19.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9b01004e0 0x7fd9b0195f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:19.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 --2- 172.21.15.31:0/3803638158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0100e80 0x7fd9b01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:19.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 >> 172.21.15.31:0/3803638158 conn(0x7fd9b00fbda0 msgr2=0x7fd9b00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:19.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 shutdown_connections 2024-09-17T01:48:19.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:19.034+0000 7fd9b5cb2700 1 -- 172.21.15.31:0/3803638158 wait complete. 2024-09-17T01:48:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:18 smithi092 ceph-mon[33552]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:19.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:18 smithi031 ceph-mon[27673]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:19.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T01:48:19.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T01:48:19.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T01:48:19.644 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T01:48:19.644 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T01:48:19.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T01:48:19.939 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:19.940 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:20.029 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:20.230 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:19 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3803638158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:48:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:19 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3803638158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:48:21.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:20 smithi092 ceph-mon[33552]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:20 smithi031 ceph-mon[27673]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:23.754 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:23 smithi031 ceph-mon[27673]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:23 smithi092 ceph-mon[33552]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:24.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:25.547 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:25 smithi031 ceph-mon[27673]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:25.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3160680752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc100e80 msgr2=0x7fa1bc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3160680752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc100e80 0x7fa1bc104e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac009910 tx=0x7fa1ac009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:25.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3160680752 shutdown_connections 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3160680752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc100e80 0x7fa1bc104e50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3160680752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3160680752 >> 172.21.15.31:0/3160680752 conn(0x7fa1bc0fbda0 msgr2=0x7fa1bc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3160680752 shutdown_connections 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.741+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3160680752 wait complete. 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c3c7c700 1 Processor -- start 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c3c7c700 1 -- start start 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c3c7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c3c7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100e80 0x7fa1bc1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c3c7c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc196b90 con 0x7fa1bc1004e0 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c3c7c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc19a920 con 0x7fa1bc100e80 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.742+0000 7fa1c1a18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1a18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53638/0 (socket says 172.21.15.31:53638) 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1a18700 1 -- 172.21.15.31:0/3085865245 learned_addr learned my addr 172.21.15.31:0/3085865245 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1217700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100e80 0x7fa1bc1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1a18700 1 -- 172.21.15.31:0/3085865245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100e80 msgr2=0x7fa1bc1964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1a18700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100e80 0x7fa1bc1964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1a18700 1 -- 172.21.15.31:0/3085865245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0095f0 con 0x7fa1bc1004e0 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c1a18700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc195f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800b4b0 tx=0x7fa1b800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1b8011800 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1b8011e10 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc19ac00 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1b800f2e0 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.743+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc19b150 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.744+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1bc10d6d0 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa1b8010380 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1b2ffd700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa1a806c680 0x7fa1a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa1b808aff0 con 0x7fa1bc1004e0 2024-09-17T01:48:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1c1217700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa1a806c680 0x7fa1a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1b2ffd700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] conn(0x7fa1a8072210 0x7fa1a8074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 --> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1a8074cd0 con 0x7fa1a8072210 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.745+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1b808d6c0 con 0x7fa1bc1004e0 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.746+0000 7fa1c2219700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] conn(0x7fa1a8072210 0x7fa1a8074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.746+0000 7fa1c1217700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa1a806c680 0x7fa1a806eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc197590 tx=0x7fa1ac01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.746+0000 7fa1c2219700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] conn(0x7fa1a8072210 0x7fa1a8074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.747+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== osd.1 v2:172.21.15.31:6810/4041806736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa1a8074cd0 con 0x7fa1a8072210 2024-09-17T01:48:25.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 --> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1bc04f2a0 con 0x7fa1a8072210 2024-09-17T01:48:25.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1b2ffd700 1 -- 172.21.15.31:0/3085865245 <== osd.1 v2:172.21.15.31:6810/4041806736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa1bc04f2a0 con 0x7fa1a8072210 2024-09-17T01:48:25.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] conn(0x7fa1a8072210 msgr2=0x7fa1a8074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] conn(0x7fa1a8072210 0x7fa1a8074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa1a806c680 msgr2=0x7fa1a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa1a806c680 0x7fa1a806eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc197590 tx=0x7fa1ac01a040 comp rx=0 tx=0).stop 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 msgr2=0x7fa1bc195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc195f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800b4b0 tx=0x7fa1b800b870 comp rx=0 tx=0).stop 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 shutdown_connections 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6810/4041806736,v1:172.21.15.31:6811/4041806736] conn(0x7fa1a8072210 0x7fa1a8074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa1a806c680 0x7fa1a806eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1bc1004e0 0x7fa1bc195f70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 --2- 172.21.15.31:0/3085865245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1bc100e80 0x7fa1bc1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 >> 172.21.15.31:0/3085865245 conn(0x7fa1bc0fbda0 msgr2=0x7fa1bc0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:25.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 shutdown_connections 2024-09-17T01:48:25.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:25.763+0000 7fa1c3c7c700 1 -- 172.21.15.31:0/3085865245 wait complete. 2024-09-17T01:48:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:25 smithi092 ceph-mon[33552]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:26.368 INFO:teuthology.orchestra.run.smithi031.stdout:60129542174 2024-09-17T01:48:26.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T01:48:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 -- 172.21.15.31:0/355886539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350068540 msgr2=0x7f03500689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 --2- 172.21.15.31:0/355886539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350068540 0x7f03500689b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0338009910 tx=0x7f0338009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 -- 172.21.15.31:0/355886539 shutdown_connections 2024-09-17T01:48:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 --2- 172.21.15.31:0/355886539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350068540 0x7f03500689b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 --2- 172.21.15.31:0/355886539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0350105230 0x7f0350105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 -- 172.21.15.31:0/355886539 >> 172.21.15.31:0/355886539 conn(0x7f0350075130 msgr2=0x7f0350075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 -- 172.21.15.31:0/355886539 shutdown_connections 2024-09-17T01:48:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.530+0000 7f0354b26700 1 -- 172.21.15.31:0/355886539 wait complete. 2024-09-17T01:48:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f0354b26700 1 Processor -- start 2024-09-17T01:48:27.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f0354b26700 1 -- start start 2024-09-17T01:48:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f0354b26700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0350068540 0x7f0350195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f0354b26700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 0x7f0350196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f0354b26700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03501969e0 con 0x7f0350105230 2024-09-17T01:48:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f0354b26700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035019a770 con 0x7f0350068540 2024-09-17T01:48:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f034dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 0x7f0350196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f034dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 0x7f0350196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53650/0 (socket says 172.21.15.31:53650) 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.531+0000 7f034dd9b700 1 -- 172.21.15.31:0/880290138 learned_addr learned my addr 172.21.15.31:0/880290138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f034e59c700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0350068540 0x7f0350195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f034dd9b700 1 -- 172.21.15.31:0/880290138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0350068540 msgr2=0x7f0350195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f034dd9b700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0350068540 0x7f0350195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f034dd9b700 1 -- 172.21.15.31:0/880290138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380095f0 con 0x7f0350105230 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f034dd9b700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 0x7f0350196300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0338006010 tx=0x7f033800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f033801d070 con 0x7f0350105230 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f033800f460 con 0x7f0350105230 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0338017630 con 0x7f0350105230 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035019a9f0 con 0x7f0350105230 2024-09-17T01:48:27.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.532+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035019aee0 con 0x7f0350105230 2024-09-17T01:48:27.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.533+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f035010d690 con 0x7f0350105230 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.534+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f033800f5d0 con 0x7f0350105230 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f03477fe700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f033c06c680 0x7f033c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f033808c7c0 con 0x7f0350105230 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f034e59c700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f033c06c680 0x7f033c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f03477fe700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] conn(0x7f033c072210 0x7f033c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 --> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f033c074cd0 con 0x7f033c072210 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03380912a0 con 0x7f0350105230 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f034ed9d700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] conn(0x7f033c072210 0x7f033c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f034e59c700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f033c06c680 0x7f033c06eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0340007be0 tx=0x7f03400073d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.535+0000 7f034ed9d700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] conn(0x7f033c072210 0x7f033c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.536+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== osd.2 v2:172.21.15.31:6818/3654254818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f033c074cd0 con 0x7f033c072210 2024-09-17T01:48:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.552+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 --> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f035004f2a0 con 0x7f033c072210 2024-09-17T01:48:27.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.552+0000 7f03477fe700 1 -- 172.21.15.31:0/880290138 <== osd.2 v2:172.21.15.31:6818/3654254818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f035004f2a0 con 0x7f033c072210 2024-09-17T01:48:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] conn(0x7f033c072210 msgr2=0x7f033c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] conn(0x7f033c072210 0x7f033c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f033c06c680 msgr2=0x7f033c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f033c06c680 0x7f033c06eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0340007be0 tx=0x7f03400073d0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 msgr2=0x7f0350196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 0x7f0350196300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0338006010 tx=0x7f033800bd70 comp rx=0 tx=0).stop 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 shutdown_connections 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6818/3654254818,v1:172.21.15.31:6819/3654254818] conn(0x7f033c072210 0x7f033c074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f033c06c680 0x7f033c06eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0350068540 0x7f0350195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 --2- 172.21.15.31:0/880290138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0350105230 0x7f0350196300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 >> 172.21.15.31:0/880290138 conn(0x7f0350075130 msgr2=0x7f03500feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 shutdown_connections 2024-09-17T01:48:27.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.553+0000 7f0354b26700 1 -- 172.21.15.31:0/880290138 wait complete. 2024-09-17T01:48:27.754 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:27 smithi031 ceph-mon[27673]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:27.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 -- 172.21.15.31:0/916045252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 msgr2=0x7f35e40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/916045252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e40ff790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009910 tx=0x7f35d4009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:27.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 -- 172.21.15.31:0/916045252 shutdown_connections 2024-09-17T01:48:27.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/916045252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35e40ffd60 0x7f35e4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/916045252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e40ff790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 -- 172.21.15.31:0/916045252 >> 172.21.15.31:0/916045252 conn(0x7f35e40fac80 msgr2=0x7f35e40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 -- 172.21.15.31:0/916045252 shutdown_connections 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.862+0000 7f35eaf7f700 1 -- 172.21.15.31:0/916045252 wait complete. 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35eaf7f700 1 Processor -- start 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35eaf7f700 1 -- start start 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35eaf7f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e4194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35eaf7f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35e40ffd60 0x7f35e41952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35eaf7f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e41959a0 con 0x7f35e40ff3c0 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35eaf7f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4199730 con 0x7f35e40ffd60 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e4194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e4194d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53666/0 (socket says 172.21.15.31:53666) 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 -- 172.21.15.31:0/2682332650 learned_addr learned my addr 172.21.15.31:0/2682332650 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 -- 172.21.15.31:0/2682332650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35e40ffd60 msgr2=0x7f35e41952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35e40ffd60 0x7f35e41952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 -- 172.21.15.31:0/2682332650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40095f0 con 0x7f35e40ff3c0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.863+0000 7f35e8d1b700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e4194d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35d4006010 tx=0x7f35d400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.864+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d401d070 con 0x7f35e40ff3c0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.864+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35d400f460 con 0x7f35e40ff3c0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.864+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d4021640 con 0x7f35e40ff3c0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.864+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e41999b0 con 0x7f35e40ff3c0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.864+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e4199ea0 con 0x7f35e40ff3c0 2024-09-17T01:48:27.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.865+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35e410c520 con 0x7f35e40ff3c0 2024-09-17T01:48:27.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.865+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f35d400faf0 con 0x7f35e40ff3c0 2024-09-17T01:48:27.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e1ffb700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f35d408cd90 con 0x7f35e40ff3c0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e3fff700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e1ffb700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] conn(0x7f35cc072210 0x7f35cc074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 --> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35cc074cd0 con 0x7f35cc072210 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35d408d1f0 con 0x7f35e40ff3c0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e951c700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] conn(0x7f35cc072210 0x7f35cc074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.866+0000 7f35e3fff700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f35e41963a0 tx=0x7f35d8005c80 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.867+0000 7f35e951c700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] conn(0x7f35cc072210 0x7f35cc074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.867+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== osd.0 v2:172.21.15.31:6802/736735920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f35cc074cd0 con 0x7f35cc072210 2024-09-17T01:48:27.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.884+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 --> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35e404f2a0 con 0x7f35cc072210 2024-09-17T01:48:27.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.884+0000 7f35e1ffb700 1 -- 172.21.15.31:0/2682332650 <== osd.0 v2:172.21.15.31:6802/736735920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35e404f2a0 con 0x7f35cc072210 2024-09-17T01:48:27.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] conn(0x7f35cc072210 msgr2=0x7f35cc074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] conn(0x7f35cc072210 0x7f35cc074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f35cc06c680 msgr2=0x7f35cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f35e41963a0 tx=0x7f35d8005c80 comp rx=0 tx=0).stop 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 msgr2=0x7f35e4194d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e4194d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35d4006010 tx=0x7f35d400be20 comp rx=0 tx=0).stop 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 shutdown_connections 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6802/736735920,v1:172.21.15.31:6803/736735920] conn(0x7f35cc072210 0x7f35cc074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35e40ff3c0 0x7f35e4194d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 --2- 172.21.15.31:0/2682332650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35e40ffd60 0x7f35e41952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 >> 172.21.15.31:0/2682332650 conn(0x7f35e40fac80 msgr2=0x7f35e40fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 shutdown_connections 2024-09-17T01:48:27.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:27.885+0000 7f35eaf7f700 1 -- 172.21.15.31:0/2682332650 wait complete. 2024-09-17T01:48:27.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:27 smithi092 ceph-mon[33552]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:28.617 INFO:teuthology.orchestra.run.smithi031.stdout:81604378649 2024-09-17T01:48:28.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T01:48:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:28 smithi092 ceph-mon[33552]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:29.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:28 smithi031 ceph-mon[27673]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:29.371 INFO:teuthology.orchestra.run.smithi031.stdout:38654705699 2024-09-17T01:48:29.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T01:48:30.377 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:30.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 -- 172.21.15.31:0/2340905998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 msgr2=0x7f6c7c09a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 --2- 172.21.15.31:0/2340905998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c09a5c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009910 tx=0x7f6c74009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 -- 172.21.15.31:0/2340905998 shutdown_connections 2024-09-17T01:48:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 --2- 172.21.15.31:0/2340905998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7c094b20 0x7f6c7c094f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 --2- 172.21.15.31:0/2340905998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c09a5c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 -- 172.21.15.31:0/2340905998 >> 172.21.15.31:0/2340905998 conn(0x7f6c7c00a110 msgr2=0x7f6c7c00a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 -- 172.21.15.31:0/2340905998 shutdown_connections 2024-09-17T01:48:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.410+0000 7f6c8995b700 1 -- 172.21.15.31:0/2340905998 wait complete. 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c8995b700 1 Processor -- start 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c8995b700 1 -- start start 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c8995b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7c094b20 0x7f6c7c12ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c8995b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c12b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c8995b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c12b8b0 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c8995b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c12b9f0 con 0x7f6c7c094b20 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c827fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c12b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c827fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c12b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53690/0 (socket says 172.21.15.31:53690) 2024-09-17T01:48:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c827fc700 1 -- 172.21.15.31:0/3393582168 learned_addr learned my addr 172.21.15.31:0/3393582168 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.411+0000 7f6c82ffd700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7c094b20 0x7f6c7c12ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c827fc700 1 -- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7c094b20 msgr2=0x7f6c7c12ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c827fc700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7c094b20 0x7f6c7c12ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c827fc700 1 -- 172.21.15.31:0/3393582168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740095f0 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c827fc700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c12b260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800cc60 tx=0x7f6c7800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c78004a00 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c78007cc0 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c12f840 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c78005650 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.412+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c12fd90 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.413+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c7c0a2670 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.414+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6c78007810 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.414+0000 7f6c88959700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6c6c06c680 0x7f6c6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.414+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6c7808b230 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.414+0000 7f6c82ffd700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6c6c06c680 0x7f6c6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.414+0000 7f6c88959700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] conn(0x7f6c6c072210 0x7f6c6c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.414+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 --> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c6c074cd0 con 0x7f6c6c072210 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.415+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c78055cf0 con 0x7f6c7c09a1f0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.415+0000 7f6c837fe700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] conn(0x7f6c6c072210 0x7f6c6c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.415+0000 7f6c82ffd700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6c6c06c680 0x7f6c6c06eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c74006010 tx=0x7f6c7401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.415+0000 7f6c837fe700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] conn(0x7f6c6c072210 0x7f6c6c074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:30.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.416+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== osd.5 v2:172.21.15.92:6816/2711827424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6c6c074cd0 con 0x7f6c6c072210 2024-09-17T01:48:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.432+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 --> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c7c0055b0 con 0x7f6c6c072210 2024-09-17T01:48:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c88959700 1 -- 172.21.15.31:0/3393582168 <== osd.5 v2:172.21.15.92:6816/2711827424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6c7c0055b0 con 0x7f6c6c072210 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] conn(0x7f6c6c072210 msgr2=0x7f6c6c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] conn(0x7f6c6c072210 0x7f6c6c074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6c6c06c680 msgr2=0x7f6c6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6c6c06c680 0x7f6c6c06eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c74006010 tx=0x7f6c7401a040 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 msgr2=0x7f6c7c12b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c12b260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800cc60 tx=0x7f6c7800cf70 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 shutdown_connections 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:6816/2711827424,v1:172.21.15.92:6817/2711827424] conn(0x7f6c6c072210 0x7f6c6c074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6c6c06c680 0x7f6c6c06eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7c094b20 0x7f6c7c12ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 --2- 172.21.15.31:0/3393582168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c09a1f0 0x7f6c7c12b260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 >> 172.21.15.31:0/3393582168 conn(0x7f6c7c00a110 msgr2=0x7f6c7c0939d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 shutdown_connections 2024-09-17T01:48:30.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:30.433+0000 7f6c8995b700 1 -- 172.21.15.31:0/3393582168 wait complete. 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 -- 172.21.15.31:0/65912780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 msgr2=0x7ff64c0ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 --2- 172.21.15.31:0/65912780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c0ff370 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009910 tx=0x7ff63c009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 -- 172.21.15.31:0/65912780 shutdown_connections 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 --2- 172.21.15.31:0/65912780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff64c0ff8b0 0x7ff64c10c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 --2- 172.21.15.31:0/65912780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c0ff370 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 -- 172.21.15.31:0/65912780 >> 172.21.15.31:0/65912780 conn(0x7ff64c0fac90 msgr2=0x7ff64c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:31.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 -- 172.21.15.31:0/65912780 shutdown_connections 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 -- 172.21.15.31:0/65912780 wait complete. 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 Processor -- start 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.197+0000 7ff652315700 1 -- start start 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff652315700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff652315700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff64c0ff8b0 0x7ff64c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff652315700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c198ba0 con 0x7ff64c0fefa0 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff652315700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c198ce0 con 0x7ff64c0ff8b0 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53732/0 (socket says 172.21.15.31:53732) 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 -- 172.21.15.31:0/3844416276 learned_addr learned my addr 172.21.15.31:0/3844416276 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64b7fe700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff64c0ff8b0 0x7ff64c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 -- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff64c0ff8b0 msgr2=0x7ff64c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff64c0ff8b0 0x7ff64c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 -- 172.21.15.31:0/3844416276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0095f0 con 0x7ff64c0fefa0 2024-09-17T01:48:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.198+0000 7ff64bfff700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c198010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff63c006010 tx=0x7ff63c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.199+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c01d070 con 0x7ff64c0fefa0 2024-09-17T01:48:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.199+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff63c004fa0 con 0x7ff64c0fefa0 2024-09-17T01:48:31.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.199+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c19cb30 con 0x7ff64c0fefa0 2024-09-17T01:48:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.199+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c00f690 con 0x7ff64c0fefa0 2024-09-17T01:48:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.199+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c19d080 con 0x7ff64c0fefa0 2024-09-17T01:48:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.200+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff64c10f7c0 con 0x7ff64c0fefa0 2024-09-17T01:48:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.201+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff63c022470 con 0x7ff64c0fefa0 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.201+0000 7ff6497fa700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff63406c680 0x7ff63406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ff63c08d5e0 con 0x7ff64c0fefa0 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff64b7fe700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff63406c680 0x7ff63406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff6497fa700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] conn(0x7ff634072210 0x7ff634074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 --> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff634074cd0 con 0x7ff634072210 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c08da40 con 0x7ff64c0fefa0 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff6508b2700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] conn(0x7ff634072210 0x7ff634074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff64b7fe700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff63406c680 0x7ff63406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff64c199630 tx=0x7ff64000a380 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.202+0000 7ff6508b2700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] conn(0x7ff634072210 0x7ff634074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.203+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== osd.3 v2:172.21.15.92:6800/500078270 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff634074cd0 con 0x7ff634072210 2024-09-17T01:48:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.219+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 --> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff64c04f2a0 con 0x7ff634072210 2024-09-17T01:48:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.219+0000 7ff6497fa700 1 -- 172.21.15.31:0/3844416276 <== osd.3 v2:172.21.15.92:6800/500078270 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff64c04f2a0 con 0x7ff634072210 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] conn(0x7ff634072210 msgr2=0x7ff634074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] conn(0x7ff634072210 0x7ff634074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff63406c680 msgr2=0x7ff63406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff63406c680 0x7ff63406eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff64c199630 tx=0x7ff64000a380 comp rx=0 tx=0).stop 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 msgr2=0x7ff64c198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c198010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff63c006010 tx=0x7ff63c00bd70 comp rx=0 tx=0).stop 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 shutdown_connections 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:6800/500078270,v1:172.21.15.92:6801/500078270] conn(0x7ff634072210 0x7ff634074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7ff63406c680 0x7ff63406eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff64c0fefa0 0x7ff64c198010 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 --2- 172.21.15.31:0/3844416276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff64c0ff8b0 0x7ff64c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 >> 172.21.15.31:0/3844416276 conn(0x7ff64c0fac90 msgr2=0x7ff64c0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:31.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 shutdown_connections 2024-09-17T01:48:31.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.220+0000 7ff652315700 1 -- 172.21.15.31:0/3844416276 wait complete. 2024-09-17T01:48:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:31 smithi031 ceph-mon[27673]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:31.778 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:31 smithi092 ceph-mon[33552]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:32.202 INFO:teuthology.orchestra.run.smithi031.stdout:167503724554 2024-09-17T01:48:32.203 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T01:48:32.752 INFO:teuthology.orchestra.run.smithi031.stdout:111669149716 2024-09-17T01:48:32.753 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 -- 172.21.15.31:0/4112676899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 msgr2=0x7f9658104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 --2- 172.21.15.31:0/4112676899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f9658104e50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9648009910 tx=0x7f9648009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 -- 172.21.15.31:0/4112676899 shutdown_connections 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 --2- 172.21.15.31:0/4112676899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f9658104e50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 --2- 172.21.15.31:0/4112676899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96581004e0 0x7f96581008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 -- 172.21.15.31:0/4112676899 >> 172.21.15.31:0/4112676899 conn(0x7f96580fbda0 msgr2=0x7f96580fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 -- 172.21.15.31:0/4112676899 shutdown_connections 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.110+0000 7f965f90c700 1 -- 172.21.15.31:0/4112676899 wait complete. 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965f90c700 1 Processor -- start 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965f90c700 1 -- start start 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965f90c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96581004e0 0x7f9658195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965f90c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f96581964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965f90c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9658196bb0 con 0x7f9658100e80 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965f90c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965819a940 con 0x7f96581004e0 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965cea7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f96581964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965cea7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f96581964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53710/0 (socket says 172.21.15.31:53710) 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965cea7700 1 -- 172.21.15.31:0/2332487573 learned_addr learned my addr 172.21.15.31:0/2332487573 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.111+0000 7f965d6a8700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96581004e0 0x7f9658195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:32.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f965cea7700 1 -- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96581004e0 msgr2=0x7f9658195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f965cea7700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96581004e0 0x7f9658195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f965cea7700 1 -- 172.21.15.31:0/2332487573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96480095f0 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f965cea7700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f96581964d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f964800bda0 tx=0x7f964800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f964801d070 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9648022470 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965819abc0 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f964800f690 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.112+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965819b0b0 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.113+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f965810d6d0 con 0x7f9658100e80 2024-09-17T01:48:32.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.114+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9648022b00 con 0x7f9658100e80 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.114+0000 7f964e7fc700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f964406c680 0x7f964406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.114+0000 7f965d6a8700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f964406c680 0x7f964406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f964808d170 con 0x7f9658100e80 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f964e7fc700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] conn(0x7f9644072210 0x7f9644074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 --> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9644074cd0 con 0x7f9644072210 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f964808d5d0 con 0x7f9658100e80 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f965d6a8700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f964406c680 0x7f964406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9654006fd0 tx=0x7f9654008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f965dea9700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] conn(0x7f9644072210 0x7f9644074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.115+0000 7f965dea9700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] conn(0x7f9644072210 0x7f9644074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.116+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== osd.4 v2:172.21.15.92:6808/1246708337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9644074cd0 con 0x7f9644072210 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.132+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 --> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f965804f2a0 con 0x7f9644072210 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f964e7fc700 1 -- 172.21.15.31:0/2332487573 <== osd.4 v2:172.21.15.92:6808/1246708337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f965804f2a0 con 0x7f9644072210 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] conn(0x7f9644072210 msgr2=0x7f9644074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] conn(0x7f9644072210 0x7f9644074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f964406c680 msgr2=0x7f964406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f964406c680 0x7f964406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9654006fd0 tx=0x7f9654008040 comp rx=0 tx=0).stop 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 msgr2=0x7f96581964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f96581964d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f964800bda0 tx=0x7f964800be80 comp rx=0 tx=0).stop 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 shutdown_connections 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:6808/1246708337,v1:172.21.15.92:6809/1246708337] conn(0x7f9644072210 0x7f9644074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f964406c680 0x7f964406eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96581004e0 0x7f9658195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 --2- 172.21.15.31:0/2332487573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9658100e80 0x7f96581964d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 >> 172.21.15.31:0/2332487573 conn(0x7f96580fbda0 msgr2=0x7f96580fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:32.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 shutdown_connections 2024-09-17T01:48:32.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:31.133+0000 7f965f90c700 1 -- 172.21.15.31:0/2332487573 wait complete. 2024-09-17T01:48:33.664 INFO:teuthology.orchestra.run.smithi031.stdout:146028888079 2024-09-17T01:48:33.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T01:48:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:33 smithi092 ceph-mon[33552]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:33.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:33 smithi031 ceph-mon[27673]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:35 smithi031 ceph-mon[27673]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:35 smithi092 ceph-mon[33552]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:37.558 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:37 smithi031 ceph-mon[27673]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 -- 172.21.15.31:0/3168496024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101420 msgr2=0x7fafb81017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 --2- 172.21.15.31:0/3168496024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101420 0x7fafb81017f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fafa800b0a0 tx=0x7fafa800b3b0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 -- 172.21.15.31:0/3168496024 shutdown_connections 2024-09-17T01:48:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 --2- 172.21.15.31:0/3168496024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb8101d30 0x7fafb810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 --2- 172.21.15.31:0/3168496024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101420 0x7fafb81017f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 -- 172.21.15.31:0/3168496024 >> 172.21.15.31:0/3168496024 conn(0x7fafb80fac80 msgr2=0x7fafb80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 -- 172.21.15.31:0/3168496024 shutdown_connections 2024-09-17T01:48:37.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.837+0000 7fafbd076700 1 -- 172.21.15.31:0/3168496024 wait complete. 2024-09-17T01:48:37.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.838+0000 7fafbd076700 1 Processor -- start 2024-09-17T01:48:37.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafbd076700 1 -- start start 2024-09-17T01:48:37.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafbd076700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb8101420 0x7fafb819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafbd076700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 0x7fafb819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafbd076700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb819d1f0 con 0x7fafb8101d30 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafbd076700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81a0f80 con 0x7fafb8101420 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafae59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 0x7fafb819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafae59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 0x7fafb819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43214/0 (socket says 172.21.15.31:43214) 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafae59c700 1 -- 172.21.15.31:0/3815097457 learned_addr learned my addr 172.21.15.31:0/3815097457 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafb6d9d700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb8101420 0x7fafb819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafae59c700 1 -- 172.21.15.31:0/3815097457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb8101420 msgr2=0x7fafb819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.839+0000 7fafae59c700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb8101420 0x7fafb819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafae59c700 1 -- 172.21.15.31:0/3815097457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa8009d00 con 0x7fafb8101d30 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafae59c700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 0x7fafb819cb10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b4b0 tx=0x7fafa000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa0011800 con 0x7fafb8101d30 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafa0011e10 con 0x7fafb8101d30 2024-09-17T01:48:37.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb81a1260 con 0x7fafb8101d30 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa000f2e0 con 0x7fafb8101d30 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.840+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb81a17b0 con 0x7fafb8101d30 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.841+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb81058d0 con 0x7fafb8101d30 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.842+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fafa000f440 con 0x7fafb8101d30 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.842+0000 7fafb4d99700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fafa406c680 0x7fafa406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.842+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fafa008afd0 con 0x7fafb8101d30 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.842+0000 7fafb6d9d700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fafa406c680 0x7fafa406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.843+0000 7fafb6d9d700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fafa406c680 0x7fafa406eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafa800b830 tx=0x7fafa80097c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:37.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:37.847+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fafa0055b10 con 0x7fafb8101d30 2024-09-17T01:48:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:37 smithi092 ceph-mon[33552]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:38.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.051+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafb804f2a0 con 0x7fafb8101d30 2024-09-17T01:48:38.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.051+0000 7fafb4d99700 1 -- 172.21.15.31:0/3815097457 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fafa0059130 con 0x7fafb8101d30 2024-09-17T01:48:38.049 INFO:teuthology.orchestra.run.smithi031.stdout:38654705701 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fafa406c680 msgr2=0x7fafa406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fafa406c680 0x7fafa406eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafa800b830 tx=0x7fafa80097c0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 msgr2=0x7fafb819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 0x7fafb819cb10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b4b0 tx=0x7fafa000b870 comp rx=0 tx=0).stop 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 shutdown_connections 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fafa406c680 0x7fafa406eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fafb8101420 0x7fafb819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 --2- 172.21.15.31:0/3815097457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb8101d30 0x7fafb819cb10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 >> 172.21.15.31:0/3815097457 conn(0x7fafb80fac80 msgr2=0x7fafb8102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 shutdown_connections 2024-09-17T01:48:38.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.053+0000 7fafbd076700 1 -- 172.21.15.31:0/3815097457 wait complete. 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 -- 172.21.15.31:0/686113352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 msgr2=0x7f59740689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 --2- 172.21.15.31:0/686113352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f59740689b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5968009910 tx=0x7f5968009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 -- 172.21.15.31:0/686113352 shutdown_connections 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 --2- 172.21.15.31:0/686113352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f59740689b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 --2- 172.21.15.31:0/686113352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5974106320 0x7f59741066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 -- 172.21.15.31:0/686113352 >> 172.21.15.31:0/686113352 conn(0x7f5974075130 msgr2=0x7f5974075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 -- 172.21.15.31:0/686113352 shutdown_connections 2024-09-17T01:48:38.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.062+0000 7f597a507700 1 -- 172.21.15.31:0/686113352 wait complete. 2024-09-17T01:48:38.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.063+0000 7f597a507700 1 Processor -- start 2024-09-17T01:48:38.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.063+0000 7f597a507700 1 -- start start 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f597a507700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f5974195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f597a507700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5974106320 0x7f59741963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f597a507700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974196a80 con 0x7f5974068540 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f597a507700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597419a810 con 0x7f5974106320 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f5974195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f5974195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43230/0 (socket says 172.21.15.31:43230) 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 -- 172.21.15.31:0/3217663921 learned_addr learned my addr 172.21.15.31:0/3217663921 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f59737fe700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5974106320 0x7f59741963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 -- 172.21.15.31:0/3217663921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5974106320 msgr2=0x7f59741963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5974106320 0x7f59741963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 -- 172.21.15.31:0/3217663921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680095f0 con 0x7f5974068540 2024-09-17T01:48:38.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f5973fff700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f5974195e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f596400e920 tx=0x7f596400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.064+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596400c9d0 con 0x7f5974068540 2024-09-17T01:48:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.065+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5964010430 con 0x7f5974068540 2024-09-17T01:48:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.065+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597419aaf0 con 0x7f5974068540 2024-09-17T01:48:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.065+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5964018650 con 0x7f5974068540 2024-09-17T01:48:38.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.065+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597419b040 con 0x7f5974068540 2024-09-17T01:48:38.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.066+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5974108770 con 0x7f5974068540 2024-09-17T01:48:38.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.067+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f59640105a0 con 0x7f5974068540 2024-09-17T01:48:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.068+0000 7f59717fa700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.068+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5964014070 con 0x7f5974068540 2024-09-17T01:48:38.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.068+0000 7f59737fe700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.068+0000 7f59737fe700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5974197480 tx=0x7f5968005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:38.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.072+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5964056880 con 0x7f5974068540 2024-09-17T01:48:38.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.274+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f597404f2a0 con 0x7f5974068540 2024-09-17T01:48:38.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.274+0000 7f59717fa700 1 -- 172.21.15.31:0/3217663921 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5964026090 con 0x7f5974068540 2024-09-17T01:48:38.272 INFO:teuthology.orchestra.run.smithi031.stdout:81604378651 2024-09-17T01:48:38.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f595c06c680 msgr2=0x7f595c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5974197480 tx=0x7f5968005940 comp rx=0 tx=0).stop 2024-09-17T01:48:38.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 msgr2=0x7f5974195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f5974195e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f596400e920 tx=0x7f596400ec30 comp rx=0 tx=0).stop 2024-09-17T01:48:38.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 shutdown_connections 2024-09-17T01:48:38.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f595c06c680 0x7f595c06eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5974068540 0x7f5974195e60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 --2- 172.21.15.31:0/3217663921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5974106320 0x7f59741963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 >> 172.21.15.31:0/3217663921 conn(0x7f5974075130 msgr2=0x7f59740febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 shutdown_connections 2024-09-17T01:48:38.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:38.276+0000 7f597a507700 1 -- 172.21.15.31:0/3217663921 wait complete. 2024-09-17T01:48:39.050 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-09-17T01:48:39.050 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:39.218 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:38 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3815097457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T01:48:39.218 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:38 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3217663921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T01:48:39.218 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:38 smithi031 ceph-mon[27673]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:39.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:38 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3815097457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T01:48:39.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:38 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3217663921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T01:48:39.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:38 smithi092 ceph-mon[33552]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 -- 172.21.15.31:0/1040169746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c100e80 msgr2=0x7fb00c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 --2- 172.21.15.31:0/1040169746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c100e80 0x7fb00c104e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faffc009910 tx=0x7faffc009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:39.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 -- 172.21.15.31:0/1040169746 shutdown_connections 2024-09-17T01:48:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 --2- 172.21.15.31:0/1040169746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c100e80 0x7fb00c104e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 --2- 172.21.15.31:0/1040169746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c1004e0 0x7fb00c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 -- 172.21.15.31:0/1040169746 >> 172.21.15.31:0/1040169746 conn(0x7fb00c0fbda0 msgr2=0x7fb00c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 -- 172.21.15.31:0/1040169746 shutdown_connections 2024-09-17T01:48:39.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.242+0000 7fb013f45700 1 -- 172.21.15.31:0/1040169746 wait complete. 2024-09-17T01:48:39.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb013f45700 1 Processor -- start 2024-09-17T01:48:39.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb013f45700 1 -- start start 2024-09-17T01:48:39.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb013f45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 0x7fb00c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb013f45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c100e80 0x7fb00c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb013f45700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c196b30 con 0x7fb00c1004e0 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb013f45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c19a8c0 con 0x7fb00c100e80 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb011ce1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 0x7fb00c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb011ce1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 0x7fb00c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43254/0 (socket says 172.21.15.31:43254) 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb011ce1700 1 -- 172.21.15.31:0/1615331480 learned_addr learned my addr 172.21.15.31:0/1615331480 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.243+0000 7fb0114e0700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c100e80 0x7fb00c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb011ce1700 1 -- 172.21.15.31:0/1615331480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c100e80 msgr2=0x7fb00c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb011ce1700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c100e80 0x7fb00c196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb011ce1700 1 -- 172.21.15.31:0/1615331480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc0095f0 con 0x7fb00c1004e0 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb0114e0700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c100e80 0x7fb00c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb011ce1700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 0x7fb00c195f10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c8a0 tx=0x7fb00800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00800cea0 con 0x7fb00c1004e0 2024-09-17T01:48:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb008004830 con 0x7fb00c1004e0 2024-09-17T01:48:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c19aba0 con 0x7fb00c1004e0 2024-09-17T01:48:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0080055b0 con 0x7fb00c1004e0 2024-09-17T01:48:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.244+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c19b0f0 con 0x7fb00c1004e0 2024-09-17T01:48:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.245+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c108850 con 0x7fb00c1004e0 2024-09-17T01:48:39.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.246+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb00800f450 con 0x7fb00c1004e0 2024-09-17T01:48:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.246+0000 7fb002ffd700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faff806c680 0x7faff806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.246+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb00808b200 con 0x7fb00c1004e0 2024-09-17T01:48:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.246+0000 7fb0114e0700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faff806c680 0x7faff806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.247+0000 7fb0114e0700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faff806c680 0x7faff806eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb00c197530 tx=0x7faffc01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.251+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb008055cc0 con 0x7fb00c1004e0 2024-09-17T01:48:39.295 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:39.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.455+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb00c04f2a0 con 0x7fb00c1004e0 2024-09-17T01:48:39.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.455+0000 7fb002ffd700 1 -- 172.21.15.31:0/1615331480 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0080592e0 con 0x7fb00c1004e0 2024-09-17T01:48:39.453 INFO:teuthology.orchestra.run.smithi031.stdout:60129542177 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.457+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faff806c680 msgr2=0x7faff806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.457+0000 7fb013f45700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faff806c680 0x7faff806eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb00c197530 tx=0x7faffc01a040 comp rx=0 tx=0).stop 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.457+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 msgr2=0x7fb00c195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.457+0000 7fb013f45700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 0x7fb00c195f10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c8a0 tx=0x7fb00800cc60 comp rx=0 tx=0).stop 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 shutdown_connections 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faff806c680 0x7faff806eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb00c1004e0 0x7fb00c195f10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 --2- 172.21.15.31:0/1615331480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb00c100e80 0x7fb00c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 >> 172.21.15.31:0/1615331480 conn(0x7fb00c0fbda0 msgr2=0x7fb00c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 shutdown_connections 2024-09-17T01:48:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:39.458+0000 7fb013f45700 1 -- 172.21.15.31:0/1615331480 wait complete. 2024-09-17T01:48:39.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-09-17T01:48:39.732 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:39 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1615331480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T01:48:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:39 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1615331480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T01:48:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:40.617 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:40.996 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:40 smithi031 ceph-mon[27673]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:41.014 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:41.024 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542177 for osd.1 2024-09-17T01:48:41.024 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:40 smithi092 ceph-mon[33552]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.027+0000 7f6e03cce700 1 -- 172.21.15.31:0/1767500873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc100e80 msgr2=0x7f6dfc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.027+0000 7f6e03cce700 1 --2- 172.21.15.31:0/1767500873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc100e80 0x7f6dfc104e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009910 tx=0x7f6dec009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.027+0000 7f6e03cce700 1 -- 172.21.15.31:0/1767500873 shutdown_connections 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 --2- 172.21.15.31:0/1767500873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc100e80 0x7f6dfc104e50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 --2- 172.21.15.31:0/1767500873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 -- 172.21.15.31:0/1767500873 >> 172.21.15.31:0/1767500873 conn(0x7f6dfc0fbda0 msgr2=0x7f6dfc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 -- 172.21.15.31:0/1767500873 shutdown_connections 2024-09-17T01:48:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 -- 172.21.15.31:0/1767500873 wait complete. 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 Processor -- start 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 -- start start 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc100e80 0x7f6dfc198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc198d10 con 0x7f6dfc1004e0 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.028+0000 7f6e03cce700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc19caa0 con 0x7f6dfc100e80 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43264/0 (socket says 172.21.15.31:43264) 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 -- 172.21.15.31:0/2864593409 learned_addr learned my addr 172.21.15.31:0/2864593409 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01269700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc100e80 0x7f6dfc198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 -- 172.21.15.31:0/2864593409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc100e80 msgr2=0x7f6dfc198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc100e80 0x7f6dfc198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 -- 172.21.15.31:0/2864593409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0095f0 con 0x7f6dfc1004e0 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01269700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc100e80 0x7f6dfc198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e01a6a700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1980f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6df800d8d0 tx=0x7f6df800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df8009940 con 0x7f6dfc1004e0 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc19cd80 con 0x7f6dfc1004e0 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6df8010460 con 0x7f6dfc1004e0 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df800f5f0 con 0x7f6dfc1004e0 2024-09-17T01:48:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.029+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc19d2d0 con 0x7f6dfc1004e0 2024-09-17T01:48:42.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.030+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc1045d0 con 0x7f6dfc1004e0 2024-09-17T01:48:42.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.031+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6df80105d0 con 0x7f6dfc1004e0 2024-09-17T01:48:42.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.031+0000 7f6df2ffd700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6de806c680 0x7f6de806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.031+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6df808b540 con 0x7f6dfc1004e0 2024-09-17T01:48:42.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.031+0000 7f6e01269700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6de806c680 0x7f6de806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.032+0000 7f6e01269700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6de806c680 0x7f6de806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc199710 tx=0x7f6dec01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:42.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.036+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6df8055f60 con 0x7f6dfc1004e0 2024-09-17T01:48:42.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.244+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6dfc04f2a0 con 0x7f6dfc1004e0 2024-09-17T01:48:42.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.244+0000 7f6df2ffd700 1 -- 172.21.15.31:0/2864593409 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6df8059580 con 0x7f6dfc1004e0 2024-09-17T01:48:42.242 INFO:teuthology.orchestra.run.smithi031.stdout:146028888080 2024-09-17T01:48:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.246+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6de806c680 msgr2=0x7f6de806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.246+0000 7f6e03cce700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6de806c680 0x7f6de806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc199710 tx=0x7f6dec01a040 comp rx=0 tx=0).stop 2024-09-17T01:48:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 msgr2=0x7f6dfc1980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1980f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6df800d8d0 tx=0x7f6df800dc90 comp rx=0 tx=0).stop 2024-09-17T01:48:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 shutdown_connections 2024-09-17T01:48:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f6de806c680 0x7f6de806eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dfc1004e0 0x7f6dfc1980f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 --2- 172.21.15.31:0/2864593409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dfc100e80 0x7f6dfc198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 >> 172.21.15.31:0/2864593409 conn(0x7f6dfc0fbda0 msgr2=0x7f6dfc0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 shutdown_connections 2024-09-17T01:48:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:42.247+0000 7f6e03cce700 1 -- 172.21.15.31:0/2864593409 wait complete. 2024-09-17T01:48:42.694 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:42 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2864593409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T01:48:42.818 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:42 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2864593409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T01:48:42.885 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888079 got 146028888080 for osd.4 2024-09-17T01:48:42.886 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:43.633 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:43 smithi031 ceph-mon[27673]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:43 smithi092 ceph-mon[33552]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 -- 172.21.15.31:0/1239417180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec100e80 msgr2=0x7f64ec104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 --2- 172.21.15.31:0/1239417180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec100e80 0x7f64ec104e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009910 tx=0x7f64e0009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 -- 172.21.15.31:0/1239417180 shutdown_connections 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 --2- 172.21.15.31:0/1239417180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec100e80 0x7f64ec104e50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 --2- 172.21.15.31:0/1239417180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ec1004e0 0x7f64ec1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 -- 172.21.15.31:0/1239417180 >> 172.21.15.31:0/1239417180 conn(0x7f64ec0fbda0 msgr2=0x7f64ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 -- 172.21.15.31:0/1239417180 shutdown_connections 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 -- 172.21.15.31:0/1239417180 wait complete. 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.453+0000 7f64f1e88700 1 Processor -- start 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64f1e88700 1 -- start start 2024-09-17T01:48:45.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64f1e88700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 0x7f64ec195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64f1e88700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ec100e80 0x7f64ec196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64f1e88700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec196b30 con 0x7f64ec1004e0 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64f1e88700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec19a8c0 con 0x7f64ec100e80 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 0x7f64ec195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 0x7f64ec195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56028/0 (socket says 172.21.15.31:56028) 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eb7fe700 1 -- 172.21.15.31:0/2398199904 learned_addr learned my addr 172.21.15.31:0/2398199904 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eaffd700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ec100e80 0x7f64ec196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eb7fe700 1 -- 172.21.15.31:0/2398199904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ec100e80 msgr2=0x7f64ec196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eb7fe700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ec100e80 0x7f64ec196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.454+0000 7f64eb7fe700 1 -- 172.21.15.31:0/2398199904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00095f0 con 0x7f64ec1004e0 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.455+0000 7f64eb7fe700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 0x7f64ec195f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00d8d0 tx=0x7f64dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.455+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64dc0098a0 con 0x7f64ec1004e0 2024-09-17T01:48:45.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.455+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64dc010460 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.455+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec19aba0 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.455+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64dc00f5f0 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.455+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec19b0c0 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.456+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec108850 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.456+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f64dc009a00 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.457+0000 7f64e8ff9700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f64d406c680 0x7f64d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.457+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f64dc08b2d0 con 0x7f64ec1004e0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.457+0000 7f64eaffd700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f64d406c680 0x7f64d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.457+0000 7f64eaffd700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f64d406c680 0x7f64d406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64e0006010 tx=0x7f64e001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.461+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f64dc055e10 con 0x7f64ec1004e0 2024-09-17T01:48:45.645 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:45 smithi031 ceph-mon[27673]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:45.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 -- 172.21.15.31:0/2353187431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 msgr2=0x7f82fc104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 --2- 172.21.15.31:0/2353187431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc104500 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009910 tx=0x7f82f8009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:45.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 -- 172.21.15.31:0/2353187431 shutdown_connections 2024-09-17T01:48:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 --2- 172.21.15.31:0/2353187431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82fc0ffbd0 0x7f82fc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 --2- 172.21.15.31:0/2353187431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc104500 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 -- 172.21.15.31:0/2353187431 >> 172.21.15.31:0/2353187431 conn(0x7f82fc075130 msgr2=0x7f82fc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 -- 172.21.15.31:0/2353187431 shutdown_connections 2024-09-17T01:48:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 -- 172.21.15.31:0/2353187431 wait complete. 2024-09-17T01:48:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 Processor -- start 2024-09-17T01:48:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.653+0000 7f830379b700 1 -- start start 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f830379b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82fc0ffbd0 0x7f82fc195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f830379b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f830379b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc196af0 con 0x7f82fc104130 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f830379b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc19a880 con 0x7f82fc0ffbd0 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56036/0 (socket says 172.21.15.31:56036) 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 -- 172.21.15.31:0/3692043129 learned_addr learned my addr 172.21.15.31:0/3692043129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8301537700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82fc0ffbd0 0x7f82fc195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 -- 172.21.15.31:0/3692043129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82fc0ffbd0 msgr2=0x7f82fc195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82fc0ffbd0 0x7f82fc195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 -- 172.21.15.31:0/3692043129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80095f0 con 0x7f82fc104130 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.654+0000 7f8300d36700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc196410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00b4b0 tx=0x7f82ec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.655+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82ec011800 con 0x7f82fc104130 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.655+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc19ab60 con 0x7f82fc104130 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.655+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82ec011e10 con 0x7f82fc104130 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.655+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82ec00f2e0 con 0x7f82fc104130 2024-09-17T01:48:45.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.655+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc19b0b0 con 0x7f82fc104130 2024-09-17T01:48:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.656+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc1086a0 con 0x7f82fc104130 2024-09-17T01:48:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.656+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f82ec010380 con 0x7f82fc104130 2024-09-17T01:48:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.657+0000 7f82f27fc700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f82e806c680 0x7f82e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.657+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f82ec08b0f0 con 0x7f82fc104130 2024-09-17T01:48:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.657+0000 7f8301537700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f82e806c680 0x7f82e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.657+0000 7f8301537700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f82e806c680 0x7f82e806eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b5c0 tx=0x7f82f801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.665+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f82ec055bb0 con 0x7f82fc104130 2024-09-17T01:48:45.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.669+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64ec04f2a0 con 0x7f64ec1004e0 2024-09-17T01:48:45.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.670+0000 7f64e8ff9700 1 -- 172.21.15.31:0/2398199904 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64dc059430 con 0x7f64ec1004e0 2024-09-17T01:48:45.667 INFO:teuthology.orchestra.run.smithi031.stdout:111669149718 2024-09-17T01:48:45.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f64d406c680 msgr2=0x7f64d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f64d406c680 0x7f64d406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f64e0006010 tx=0x7f64e001a040 comp rx=0 tx=0).stop 2024-09-17T01:48:45.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 msgr2=0x7f64ec195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 0x7f64ec195f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00d8d0 tx=0x7f64dc00dbe0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 shutdown_connections 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f64d406c680 0x7f64d406eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64ec1004e0 0x7f64ec195f10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 --2- 172.21.15.31:0/2398199904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64ec100e80 0x7f64ec196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 >> 172.21.15.31:0/2398199904 conn(0x7f64ec0fbda0 msgr2=0x7f64ec0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 shutdown_connections 2024-09-17T01:48:45.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.672+0000 7f64f1e88700 1 -- 172.21.15.31:0/2398199904 wait complete. 2024-09-17T01:48:45.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.868+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f82fc1972d0 con 0x7f82fc104130 2024-09-17T01:48:45.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.869+0000 7f82f27fc700 1 -- 172.21.15.31:0/3692043129 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82ec0591d0 con 0x7f82fc104130 2024-09-17T01:48:45.866 INFO:teuthology.orchestra.run.smithi031.stdout:167503724557 2024-09-17T01:48:45.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f82e806c680 msgr2=0x7f82e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f82e806c680 0x7f82e806eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b5c0 tx=0x7f82f801a040 comp rx=0 tx=0).stop 2024-09-17T01:48:45.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 msgr2=0x7f82fc196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc196410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00b4b0 tx=0x7f82ec00b870 comp rx=0 tx=0).stop 2024-09-17T01:48:45.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 shutdown_connections 2024-09-17T01:48:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f82e806c680 0x7f82e806eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82fc0ffbd0 0x7f82fc195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 --2- 172.21.15.31:0/3692043129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82fc104130 0x7f82fc196410 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 >> 172.21.15.31:0/3692043129 conn(0x7f82fc075130 msgr2=0x7f82fc0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 shutdown_connections 2024-09-17T01:48:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:45.871+0000 7f830379b700 1 -- 172.21.15.31:0/3692043129 wait complete. 2024-09-17T01:48:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:45 smithi092 ceph-mon[33552]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:46.490 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149718 for osd.3 2024-09-17T01:48:46.491 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:46 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2398199904' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T01:48:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:46 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3692043129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T01:48:46.894 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:46 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2398199904' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T01:48:46.894 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:46 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3692043129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T01:48:46.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724557 for osd.5 2024-09-17T01:48:46.961 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:46.961 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T01:48:46.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T01:48:47.171 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:47.598 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:47 smithi031 ceph-mon[27673]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:47 smithi092 ceph-mon[33552]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:48.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 -- 172.21.15.31:0/3865509990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75701004c0 msgr2=0x7f7570100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 --2- 172.21.15.31:0/3865509990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75701004c0 0x7f7570100890 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7560009910 tx=0x7f7560009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 -- 172.21.15.31:0/3865509990 shutdown_connections 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 --2- 172.21.15.31:0/3865509990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7570100e60 0x7f7570104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 --2- 172.21.15.31:0/3865509990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75701004c0 0x7f7570100890 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 -- 172.21.15.31:0/3865509990 >> 172.21.15.31:0/3865509990 conn(0x7f75700fbd80 msgr2=0x7f75700fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 -- 172.21.15.31:0/3865509990 shutdown_connections 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 -- 172.21.15.31:0/3865509990 wait complete. 2024-09-17T01:48:48.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.673+0000 7f75754c7700 1 Processor -- start 2024-09-17T01:48:48.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f75754c7700 1 -- start start 2024-09-17T01:48:48.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f75754c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701004c0 0x7f7570073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f75754c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 0x7f7570073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f75754c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570073ad0 con 0x7f7570100e60 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f75754c7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570073c10 con 0x7f75701004c0 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 0x7f7570073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 0x7f7570073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56056/0 (socket says 172.21.15.31:56056) 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756e7fc700 1 -- 172.21.15.31:0/4098338843 learned_addr learned my addr 172.21.15.31:0/4098338843 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756effd700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701004c0 0x7f7570073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756e7fc700 1 -- 172.21.15.31:0/4098338843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701004c0 msgr2=0x7f7570073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756e7fc700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701004c0 0x7f7570073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.674+0000 7f756e7fc700 1 -- 172.21.15.31:0/4098338843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75600095f0 con 0x7f7570100e60 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.675+0000 7f756e7fc700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 0x7f7570073590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f756400d900 tx=0x7f756400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:48.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.675+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7564009900 con 0x7f7570100e60 2024-09-17T01:48:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.675+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75701a2060 con 0x7f7570100e60 2024-09-17T01:48:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.675+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7564010460 con 0x7f7570100e60 2024-09-17T01:48:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.675+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f756400f5f0 con 0x7f7570100e60 2024-09-17T01:48:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.675+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75701a2470 con 0x7f7570100e60 2024-09-17T01:48:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.676+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75701087d0 con 0x7f7570100e60 2024-09-17T01:48:48.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.676+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f75640105d0 con 0x7f7570100e60 2024-09-17T01:48:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.677+0000 7f7557fff700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f755806c680 0x7f755806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.677+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f756408b2d0 con 0x7f7570100e60 2024-09-17T01:48:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.677+0000 7f756effd700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f755806c680 0x7f755806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.677+0000 7f756effd700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f755806c680 0x7f755806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f756000b5c0 tx=0x7f756001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.681+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7564055d90 con 0x7f7570100e60 2024-09-17T01:48:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.877+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7570061190 con 0x7f755806c680 2024-09-17T01:48:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.878+0000 7f7557fff700 1 -- 172.21.15.31:0/4098338843 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28018 (secure 0 0 0) 0x7f7570061190 con 0x7f755806c680 2024-09-17T01:48:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f755806c680 msgr2=0x7f755806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f755806c680 0x7f755806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f756000b5c0 tx=0x7f756001a040 comp rx=0 tx=0).stop 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 msgr2=0x7f7570073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 0x7f7570073590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f756400d900 tx=0x7f756400dcc0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 shutdown_connections 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f755806c680 0x7f755806eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75701004c0 0x7f7570073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 --2- 172.21.15.31:0/4098338843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7570100e60 0x7f7570073590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.880+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 >> 172.21.15.31:0/4098338843 conn(0x7f75700fbd80 msgr2=0x7f75700fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.881+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 shutdown_connections 2024-09-17T01:48:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:48.881+0000 7f75754c7700 1 -- 172.21.15.31:0/4098338843 wait complete. 2024-09-17T01:48:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T01:48:49.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:48 smithi031 ceph-mon[27673]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:48 smithi092 ceph-mon[33552]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:49.653 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-17T01:48:48.457581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165540,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305372,"statfs":{"total":575970213888,"available":575800700928,"internally_reserved":0,"allocated":3919872,"data_stored":2570982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002588"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T01:47:55.887855+0000","last_change":"2024-09-17T01:47:30.512588+0000","last_active":"2024-09-17T01:47:55.887855+0000","last_peered":"2024-09-17T01:47:55.887855+0000","last_clean":"2024-09-17T01:47:55.887855+0000","last_became_active":"2024-09-17T01:47:30.512328+0000","last_became_peered":"2024-09-17T01:47:30.512328+0000","last_unstale":"2024-09-17T01:47:55.887855+0000","last_undegraded":"2024-09-17T01:47:55.887855+0000","last_fullsized":"2024-09-17T01:47:55.887855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:40.926397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:40.926397+0000","last_clean_scrub_stamp":"2024-09-17T01:46:40.926397+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:35.848948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717852,"statfs":{"total":95995035648,"available":95967080448,"internally_reserved":0,"allocated":356352,"data_stored":133313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717852,"statfs":{"total":95995035648,"available":95967080448,"internally_reserved":0,"allocated":356352,"data_stored":133313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.433}]},{"osd":1,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.48199999999999998}]},{"osd":2,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.502}]},{"osd":3,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":723681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.499}]},{"osd":1,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.442},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717852,"statfs":{"total":95995035648,"available":95967080448,"internally_reserved":0,"allocated":356352,"data_stored":133313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54900000000000004,"5min":1.069,"15min":1.069},"last":0.318}]},{"osd":1,"last update":"Tue Sep 17 01:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.378}]},{"osd":3,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Sep 17 01:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":723681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 01:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Sep 17 01:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Sep 17 01:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.752}]},{"osd":4,"last update":"Tue Sep 17 01:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":723681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.32600000000000001,"15min":0.316},"min":{"1min":0.247,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.251},{"interface":"front","average":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.27500000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.23499999999999999}]},{"osd":3,"last update":"Tue Sep 17 01:48:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.753},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Sep 17 01:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:49.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T01:48:49.871 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:50.204 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:49 smithi031 ceph-mon[27673]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:48:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:49 smithi092 ceph-mon[33552]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:48:51.223 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:50 smithi031 ceph-mon[27673]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:50 smithi092 ceph-mon[33552]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 -- 172.21.15.31:0/186090152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 msgr2=0x7fe478103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 --2- 172.21.15.31:0/186090152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478103d30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe460009910 tx=0x7fe460009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 -- 172.21.15.31:0/186090152 shutdown_connections 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 --2- 172.21.15.31:0/186090152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478103d30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 --2- 172.21.15.31:0/186090152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4780ff3c0 0x7fe4780ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 -- 172.21.15.31:0/186090152 >> 172.21.15.31:0/186090152 conn(0x7fe4780fac80 msgr2=0x7fe4780fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 -- 172.21.15.31:0/186090152 shutdown_connections 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 -- 172.21.15.31:0/186090152 wait complete. 2024-09-17T01:48:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.451+0000 7fe47db58700 1 Processor -- start 2024-09-17T01:48:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe47db58700 1 -- start start 2024-09-17T01:48:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe47db58700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4780ff3c0 0x7fe478195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe47db58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe47db58700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe478196ae0 con 0x7fe4780ffd60 2024-09-17T01:48:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe47db58700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47819a870 con 0x7fe4780ff3c0 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56070/0 (socket says 172.21.15.31:56070) 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 -- 172.21.15.31:0/3753956175 learned_addr learned my addr 172.21.15.31:0/3753956175 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe4777fe700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4780ff3c0 0x7fe478195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 -- 172.21.15.31:0/3753956175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4780ff3c0 msgr2=0x7fe478195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4780ff3c0 0x7fe478195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 -- 172.21.15.31:0/3753956175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600095f0 con 0x7fe4780ffd60 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe476ffd700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478196400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe46000bda0 tx=0x7fe46000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.452+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe46001d070 con 0x7fe4780ffd60 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.453+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47819aaf0 con 0x7fe4780ffd60 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.453+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe46000f460 con 0x7fe4780ffd60 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.453+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe460017630 con 0x7fe4780ffd60 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.453+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47819afe0 con 0x7fe4780ffd60 2024-09-17T01:48:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.454+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47804f2a0 con 0x7fe4780ffd60 2024-09-17T01:48:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.454+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe46000fab0 con 0x7fe4780ffd60 2024-09-17T01:48:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.455+0000 7fe474ff9700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe46406c680 0x7fe46406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.455+0000 7fe4777fe700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe46406c680 0x7fe46406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.455+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe46008c8c0 con 0x7fe4780ffd60 2024-09-17T01:48:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.455+0000 7fe4777fe700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe46406c680 0x7fe46406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe468005950 tx=0x7fe46800b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.459+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe460057380 con 0x7fe4780ffd60 2024-09-17T01:48:51.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.653+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe47819b330 con 0x7fe46406c680 2024-09-17T01:48:51.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.655+0000 7fe474ff9700 1 -- 172.21.15.31:0/3753956175 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28032 (secure 0 0 0) 0x7fe47819b330 con 0x7fe46406c680 2024-09-17T01:48:51.653 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:51.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe46406c680 msgr2=0x7fe46406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe46406c680 0x7fe46406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe468005950 tx=0x7fe46800b410 comp rx=0 tx=0).stop 2024-09-17T01:48:51.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 msgr2=0x7fe478196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478196400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe46000bda0 tx=0x7fe46000bdd0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 shutdown_connections 2024-09-17T01:48:51.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe46406c680 0x7fe46406eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4780ff3c0 0x7fe478195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 --2- 172.21.15.31:0/3753956175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4780ffd60 0x7fe478196400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 >> 172.21.15.31:0/3753956175 conn(0x7fe4780fac80 msgr2=0x7fe4780fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 shutdown_connections 2024-09-17T01:48:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:51.657+0000 7fe47db58700 1 -- 172.21.15.31:0/3753956175 wait complete. 2024-09-17T01:48:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T01:48:52.408 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-17T01:48:50.457934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165540,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305372,"statfs":{"total":575970213888,"available":575800700928,"internally_reserved":0,"allocated":3919872,"data_stored":2570982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002422"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T01:47:55.887855+0000","last_change":"2024-09-17T01:47:30.512588+0000","last_active":"2024-09-17T01:47:55.887855+0000","last_peered":"2024-09-17T01:47:55.887855+0000","last_clean":"2024-09-17T01:47:55.887855+0000","last_became_active":"2024-09-17T01:47:30.512328+0000","last_became_peered":"2024-09-17T01:47:30.512328+0000","last_unstale":"2024-09-17T01:47:55.887855+0000","last_undegraded":"2024-09-17T01:47:55.887855+0000","last_fullsized":"2024-09-17T01:47:55.887855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:40.926397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:40.926397+0000","last_clean_scrub_stamp":"2024-09-17T01:46:40.926397+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:35.848948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717852,"statfs":{"total":95995035648,"available":95967080448,"internally_reserved":0,"allocated":356352,"data_stored":133313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717852,"statfs":{"total":95995035648,"available":95967080448,"internally_reserved":0,"allocated":356352,"data_stored":133313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.433}]},{"osd":1,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.48199999999999998}]},{"osd":2,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.502}]},{"osd":3,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":723681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Tue Sep 17 01:48:32 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.309}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717852,"statfs":{"total":95995035648,"available":95967080448,"internally_reserved":0,"allocated":356352,"data_stored":133313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.39500000000000002,"15min":0.40100000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54900000000000004,"5min":1.069,"15min":1.069},"last":0.318}]},{"osd":1,"last update":"Tue Sep 17 01:48:41 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.378}]},{"osd":3,"last update":"Tue Sep 17 01:48:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Sep 17 01:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":723681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 01:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Sep 17 01:48:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.50700000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Sep 17 01:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.752}]},{"osd":4,"last update":"Tue Sep 17 01:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":723681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 01:48:15 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.32600000000000001,"15min":0.316},"min":{"1min":0.247,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.251},{"interface":"front","average":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.25600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.27500000000000002}]},{"osd":2,"last update":"Tue Sep 17 01:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.39500000000000002,"15min":0.40699999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.23499999999999999}]},{"osd":3,"last update":"Tue Sep 17 01:48:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.753},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.71599999999999997}]},{"osd":4,"last update":"Tue Sep 17 01:48:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:52.409 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T01:48:52.409 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T01:48:52.410 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T01:48:52.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T01:48:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:53.711 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:53 smithi031 ceph-mon[27673]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:48:53.712 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:53 smithi031 ceph-mon[27673]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:53 smithi092 ceph-mon[33552]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:48:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:53 smithi092 ceph-mon[33552]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.195+0000 7f86d24be700 1 -- 172.21.15.31:0/1326513254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101420 msgr2=0x7f86cc1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.195+0000 7f86d24be700 1 --2- 172.21.15.31:0/1326513254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101420 0x7f86cc1017f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009910 tx=0x7f86bc009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.195+0000 7f86d24be700 1 -- 172.21.15.31:0/1326513254 shutdown_connections 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.195+0000 7f86d24be700 1 --2- 172.21.15.31:0/1326513254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc101d30 0x7f86cc10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.195+0000 7f86d24be700 1 --2- 172.21.15.31:0/1326513254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101420 0x7f86cc1017f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.195+0000 7f86d24be700 1 -- 172.21.15.31:0/1326513254 >> 172.21.15.31:0/1326513254 conn(0x7f86cc0fac80 msgr2=0x7f86cc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.196+0000 7f86d24be700 1 -- 172.21.15.31:0/1326513254 shutdown_connections 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.196+0000 7f86d24be700 1 -- 172.21.15.31:0/1326513254 wait complete. 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.196+0000 7f86d24be700 1 Processor -- start 2024-09-17T01:48:54.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.196+0000 7f86d24be700 1 -- start start 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86d24be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc101420 0x7f86cc0ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86d24be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 0x7f86cc0ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86d24be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc100e30 con 0x7f86cc101d30 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86d24be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc100fa0 con 0x7f86cc101420 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 0x7f86cc0ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 0x7f86cc0ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38964/0 (socket says 172.21.15.31:38964) 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 -- 172.21.15.31:0/3044779588 learned_addr learned my addr 172.21.15.31:0/3044779588 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cbfff700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc101420 0x7f86cc0ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 -- 172.21.15.31:0/3044779588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc101420 msgr2=0x7f86cc0ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc101420 0x7f86cc0ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 -- 172.21.15.31:0/3044779588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0095f0 con 0x7f86cc101d30 2024-09-17T01:48:54.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86cb7fe700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 0x7f86cc0ff5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b4b0 tx=0x7f86c000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:54.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c0011800 con 0x7f86cc101d30 2024-09-17T01:48:54.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f86c0011e10 con 0x7f86cc101d30 2024-09-17T01:48:54.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc0ffbc0 con 0x7f86cc101d30 2024-09-17T01:48:54.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c000f2e0 con 0x7f86cc101d30 2024-09-17T01:48:54.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.197+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc1a6a40 con 0x7f86cc101d30 2024-09-17T01:48:54.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.198+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc1078e0 con 0x7f86cc101d30 2024-09-17T01:48:54.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.199+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f86c0010380 con 0x7f86cc101d30 2024-09-17T01:48:54.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.199+0000 7f86c97fa700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f86b406c680 0x7f86b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.199+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f86c008b090 con 0x7f86cc101d30 2024-09-17T01:48:54.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.199+0000 7f86cbfff700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f86b406c680 0x7f86b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.200+0000 7f86cbfff700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f86b406c680 0x7f86b406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00b5c0 tx=0x7f86bc01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:54.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.204+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f86c0055be0 con 0x7f86cc101d30 2024-09-17T01:48:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.447+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f86cc1005b0 con 0x7f86cc101d30 2024-09-17T01:48:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.447+0000 7f86c97fa700 1 -- 172.21.15.31:0/3044779588 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f86c0059200 con 0x7f86cc101d30 2024-09-17T01:48:54.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:48:54.446 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:48:54.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f86b406c680 msgr2=0x7f86b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f86b406c680 0x7f86b406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00b5c0 tx=0x7f86bc01a040 comp rx=0 tx=0).stop 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 msgr2=0x7f86cc0ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 0x7f86cc0ff5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b4b0 tx=0x7f86c000b870 comp rx=0 tx=0).stop 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 shutdown_connections 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f86b406c680 0x7f86b406eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc101420 0x7f86cc0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 --2- 172.21.15.31:0/3044779588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86cc101d30 0x7f86cc0ff5c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 >> 172.21.15.31:0/3044779588 conn(0x7f86cc0fac80 msgr2=0x7f86cc104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 shutdown_connections 2024-09-17T01:48:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:54.449+0000 7f86d24be700 1 -- 172.21.15.31:0/3044779588 wait complete. 2024-09-17T01:48:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:54 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3044779588' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T01:48:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:54 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3044779588' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T01:48:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:48:55.007 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T01:48:55.008 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T01:48:55.008 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:48:55.017 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-09-17T01:48:55.017 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:48:55.032 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:48:55.032 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-17T01:48:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:55.613 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:55 smithi031 ceph-mon[27673]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:55 smithi092 ceph-mon[33552]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 -- 172.21.15.31:0/2510266899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 msgr2=0x7f63f8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 --2- 172.21.15.31:0/2510266899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8100650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009910 tx=0x7f63ec009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 -- 172.21.15.31:0/2510266899 shutdown_connections 2024-09-17T01:48:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 --2- 172.21.15.31:0/2510266899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 --2- 172.21.15.31:0/2510266899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8100650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 -- 172.21.15.31:0/2510266899 >> 172.21.15.31:0/2510266899 conn(0x7f63f80fb7f0 msgr2=0x7f63f80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.837+0000 7f63feb59700 1 -- 172.21.15.31:0/2510266899 shutdown_connections 2024-09-17T01:48:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.838+0000 7f63feb59700 1 -- 172.21.15.31:0/2510266899 wait complete. 2024-09-17T01:48:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.838+0000 7f63feb59700 1 Processor -- start 2024-09-17T01:48:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.838+0000 7f63feb59700 1 -- start start 2024-09-17T01:48:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63feb59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63feb59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63feb59700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8196630 con 0x7f63f8100240 2024-09-17T01:48:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63feb59700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8196770 con 0x7f63f8101440 2024-09-17T01:48:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63fc8f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:45020/0 (socket says 172.21.15.31:45020) 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63fc8f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38982/0 (socket says 172.21.15.31:38982) 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63f7fff700 1 -- 172.21.15.31:0/2615790038 learned_addr learned my addr 172.21.15.31:0/2615790038 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63fc8f5700 1 -- 172.21.15.31:0/2615790038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 msgr2=0x7f63f8196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63fc8f5700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63fc8f5700 1 -- 172.21.15.31:0/2615790038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0095f0 con 0x7f63f8100240 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63f7fff700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.839+0000 7f63fc8f5700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8195ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009910 tx=0x7f63ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.840+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63ec01d070 con 0x7f63f8100240 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.840+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f819b1c0 con 0x7f63f8100240 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.840+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f63ec00f460 con 0x7f63f8100240 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.840+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63ec021620 con 0x7f63f8100240 2024-09-17T01:48:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.840+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f819b6b0 con 0x7f63f8100240 2024-09-17T01:48:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.841+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f8108d90 con 0x7f63f8100240 2024-09-17T01:48:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.841+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f63ec02b440 con 0x7f63f8100240 2024-09-17T01:48:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.842+0000 7f63f5ffb700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63e806c680 0x7f63e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:56.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.842+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f63ec08c5b0 con 0x7f63f8100240 2024-09-17T01:48:56.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.842+0000 7f63f7fff700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63e806c680 0x7f63e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:56.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.842+0000 7f63f7fff700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63e806c680 0x7f63e806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63e4005950 tx=0x7f63e400a400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:56.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:56.846+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f63ec05ac60 con 0x7f63f8100240 2024-09-17T01:48:57.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.045+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f63f8108f50 con 0x7f63f8100240 2024-09-17T01:48:57.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.050+0000 7f63f5ffb700 1 -- 172.21.15.31:0/2615790038 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f63ec05a7f0 con 0x7f63f8100240 2024-09-17T01:48:57.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.052+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63e806c680 msgr2=0x7f63e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63e806c680 0x7f63e806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63e4005950 tx=0x7f63e400a400 comp rx=0 tx=0).stop 2024-09-17T01:48:57.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 msgr2=0x7f63f8195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8195ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009910 tx=0x7f63ec00bd70 comp rx=0 tx=0).stop 2024-09-17T01:48:57.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 shutdown_connections 2024-09-17T01:48:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f63e806c680 0x7f63e806eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63f8100240 0x7f63f8195ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 --2- 172.21.15.31:0/2615790038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63f8101440 0x7f63f8196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 >> 172.21.15.31:0/2615790038 conn(0x7f63f80fb7f0 msgr2=0x7f63f8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 shutdown_connections 2024-09-17T01:48:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:57.053+0000 7f63feb59700 1 -- 172.21.15.31:0/2615790038 wait complete. 2024-09-17T01:48:57.743 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:57 smithi031 ceph-mon[27673]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:57.743 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:57 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2615790038' entity='client.admin' 2024-09-17T01:48:57.743 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:57 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:48:57.770 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:48:57.778 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-17T01:48:57.778 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:48:57.815 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:48:57.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T01:48:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:57 smithi092 ceph-mon[33552]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:57 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2615790038' entity='client.admin' 2024-09-17T01:48:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:57 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:48:58.054 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:48:59.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:58 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:48:59.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:58 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:48:59.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:58 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:48:59.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:48:58 smithi031 ceph-mon[27673]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:58 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:48:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:58 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:48:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:58 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:48:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:48:58 smithi092 ceph-mon[33552]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.619+0000 7f723fb52700 1 -- 172.21.15.31:0/2337567951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 msgr2=0x7f7238100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.619+0000 7f723fb52700 1 --2- 172.21.15.31:0/2337567951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238100650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7234009910 tx=0x7f7234009c20 comp rx=0 tx=0).stop 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 -- 172.21.15.31:0/2337567951 shutdown_connections 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 --2- 172.21.15.31:0/2337567951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7238101440 0x7f7238101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 --2- 172.21.15.31:0/2337567951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238100650 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 -- 172.21.15.31:0/2337567951 >> 172.21.15.31:0/2337567951 conn(0x7f72380fb7f0 msgr2=0x7f72380fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 -- 172.21.15.31:0/2337567951 shutdown_connections 2024-09-17T01:48:59.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 -- 172.21.15.31:0/2337567951 wait complete. 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 Processor -- start 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.620+0000 7f723fb52700 1 -- start start 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723fb52700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723fb52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7238101440 0x7f7238073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723fb52700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238073680 con 0x7f7238100240 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723fb52700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380737c0 con 0x7f7238101440 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38990/0 (socket says 172.21.15.31:38990) 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 -- 172.21.15.31:0/3224065903 learned_addr learned my addr 172.21.15.31:0/3224065903 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d0ed700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7238101440 0x7f7238073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 -- 172.21.15.31:0/3224065903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7238101440 msgr2=0x7f7238073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7238101440 0x7f7238073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 -- 172.21.15.31:0/3224065903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340095f0 con 0x7f7238100240 2024-09-17T01:48:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723d8ee700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238074af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f723400bda0 tx=0x7f723400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f723401d070 con 0x7f7238100240 2024-09-17T01:48:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7234004c50 con 0x7f7238100240 2024-09-17T01:48:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7238073a40 con 0x7f7238100240 2024-09-17T01:48:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f723400f690 con 0x7f7238100240 2024-09-17T01:48:59.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.621+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7238073f30 con 0x7f7238100240 2024-09-17T01:48:59.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.622+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238108e10 con 0x7f7238100240 2024-09-17T01:48:59.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.623+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7234022a20 con 0x7f7238100240 2024-09-17T01:48:59.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.623+0000 7f722effd700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f722406c680 0x7f722406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.624+0000 7f723d0ed700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f722406c680 0x7f722406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.624+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f723408cad0 con 0x7f7238100240 2024-09-17T01:48:59.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.624+0000 7f723d0ed700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f722406c680 0x7f722406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7228006fd0 tx=0x7f7228008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:59.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.628+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f723405b150 con 0x7f7238100240 2024-09-17T01:48:59.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.844+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f723819e040 con 0x7f722406c680 2024-09-17T01:48:59.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.845+0000 7f722effd700 1 -- 172.21.15.31:0/3224065903 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f723819e040 con 0x7f722406c680 2024-09-17T01:48:59.844 INFO:teuthology.orchestra.run.smithi031.stdout:Backend: cephadm 2024-09-17T01:48:59.844 INFO:teuthology.orchestra.run.smithi031.stdout:Available: Yes 2024-09-17T01:48:59.844 INFO:teuthology.orchestra.run.smithi031.stdout:Paused: No 2024-09-17T01:48:59.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f722406c680 msgr2=0x7f722406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f722406c680 0x7f722406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7228006fd0 tx=0x7f7228008040 comp rx=0 tx=0).stop 2024-09-17T01:48:59.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 msgr2=0x7f7238074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238074af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f723400bda0 tx=0x7f723400be80 comp rx=0 tx=0).stop 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 shutdown_connections 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f722406c680 0x7f722406eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7238100240 0x7f7238074af0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 --2- 172.21.15.31:0/3224065903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7238101440 0x7f7238073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 >> 172.21.15.31:0/3224065903 conn(0x7f72380fb7f0 msgr2=0x7f7238104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 shutdown_connections 2024-09-17T01:48:59.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:48:59.848+0000 7f723fb52700 1 -- 172.21.15.31:0/3224065903 wait complete. 2024-09-17T01:49:00.437 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T01:49:00.646 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:01.737 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:01 smithi031 ceph-mon[27673]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:01.737 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:01 smithi031 ceph-mon[27673]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:01.942 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:01 smithi092 ceph-mon[33552]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:01.942 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:01 smithi092 ceph-mon[33552]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 -- 172.21.15.31:0/3438421209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 msgr2=0x7f9e50100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3438421209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e50100860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009910 tx=0x7f9e44009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 -- 172.21.15.31:0/3438421209 shutdown_connections 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3438421209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e50100860 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3438421209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e500ff150 0x7f9e500ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 -- 172.21.15.31:0/3438421209 >> 172.21.15.31:0/3438421209 conn(0x7f9e500fa7a0 msgr2=0x7f9e500fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 -- 172.21.15.31:0/3438421209 shutdown_connections 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.294+0000 7f9e5603d700 1 -- 172.21.15.31:0/3438421209 wait complete. 2024-09-17T01:49:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e5603d700 1 Processor -- start 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e5603d700 1 -- start start 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e5603d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e500ff150 0x7f9e50103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e5603d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e501017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e5603d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50101d10 con 0x7f9e501003f0 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e5603d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50101e50 con 0x7f9e500ff150 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e501017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e501017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39006/0 (socket says 172.21.15.31:39006) 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 -- 172.21.15.31:0/3105818408 learned_addr learned my addr 172.21.15.31:0/3105818408 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4f7fe700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e500ff150 0x7f9e50103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 -- 172.21.15.31:0/3105818408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e500ff150 msgr2=0x7f9e50103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e500ff150 0x7f9e50103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 -- 172.21.15.31:0/3105818408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440095f0 con 0x7f9e501003f0 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.295+0000 7f9e4effd700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e501017d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e44000c00 tx=0x7f9e4400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.296+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4401d070 con 0x7f9e501003f0 2024-09-17T01:49:02.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.296+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e501020d0 con 0x7f9e501003f0 2024-09-17T01:49:02.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.296+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e44005dc0 con 0x7f9e501003f0 2024-09-17T01:49:02.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.296+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e440226a0 con 0x7f9e501003f0 2024-09-17T01:49:02.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.296+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e501025c0 con 0x7f9e501003f0 2024-09-17T01:49:02.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.297+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50068ab0 con 0x7f9e501003f0 2024-09-17T01:49:02.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.297+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9e440038f0 con 0x7f9e501003f0 2024-09-17T01:49:02.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.297+0000 7f9e4cff9700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9e3806c680 0x7f9e3806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.298+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f9e4408c900 con 0x7f9e501003f0 2024-09-17T01:49:02.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.298+0000 7f9e4f7fe700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9e3806c680 0x7f9e3806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.298+0000 7f9e4f7fe700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9e3806c680 0x7f9e3806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009c60 tx=0x7f9e40009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:02.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.302+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9e4405ae50 con 0x7f9e501003f0 2024-09-17T01:49:02.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.512+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e500694e0 con 0x7f9e3806c680 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.521+0000 7f9e4cff9700 1 -- 172.21.15.31:0/3105818408 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7f9e500694e0 con 0x7f9e3806c680 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (3m) 2m ago 5m 25.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (5m) 2m ago 5m 6983k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (4m) 68s ago 4m 6941k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (5m) 2m ago 5m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (4m) 68s ago 4m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:49:02.520 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (3m) 2m ago 4m 80.3M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:9283,8765,8443 running (6m) 2m ago 6m 479M - 18.2.0 dc2bc1663786 5a9379d38d8b 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (4m) 68s ago 4m 435M - 18.2.0 dc2bc1663786 274101cf9cf2 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (6m) 2m ago 6m 44.0M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (4m) 68s ago 4m 39.3M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (5m) 2m ago 5m 16.3M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (4m) 68s ago 4m 15.1M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (3m) 2m ago 3m 40.9M 3948M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (2m) 2m ago 2m 45.1M 3948M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (2m) 2m ago 2m 40.2M 3948M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (2m) 68s ago 2m 44.0M 4970M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (99s) 68s ago 98s 38.6M 4970M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (74s) 68s ago 73s 13.9M 4970M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:49:02.521 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (3m) 2m ago 4m 40.4M - 2.43.0 a07b618ecd1d ed28452b08d0 2024-09-17T01:49:02.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.523+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9e3806c680 msgr2=0x7f9e3806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.523+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9e3806c680 0x7f9e3806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009c60 tx=0x7f9e40009260 comp rx=0 tx=0).stop 2024-09-17T01:49:02.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 msgr2=0x7f9e501017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e501017d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e44000c00 tx=0x7f9e4400f690 comp rx=0 tx=0).stop 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 shutdown_connections 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f9e3806c680 0x7f9e3806eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e500ff150 0x7f9e50103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 --2- 172.21.15.31:0/3105818408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e501003f0 0x7f9e501017d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 >> 172.21.15.31:0/3105818408 conn(0x7f9e500fa7a0 msgr2=0x7f9e50068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 shutdown_connections 2024-09-17T01:49:02.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:02.524+0000 7f9e5603d700 1 -- 172.21.15.31:0/3105818408 wait complete. 2024-09-17T01:49:03.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T01:49:03.447 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:03.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:03 smithi031 ceph-mon[27673]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:03.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:03 smithi031 ceph-mon[27673]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:03 smithi092 ceph-mon[33552]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:03 smithi092 ceph-mon[33552]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:05.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 -- 172.21.15.31:0/3828369361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 msgr2=0x7f4dc4102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/3828369361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4102e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009910 tx=0x7f4db4009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 -- 172.21.15.31:0/3828369361 shutdown_connections 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/3828369361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 0x7f4dc41057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/3828369361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4102e10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 -- 172.21.15.31:0/3828369361 >> 172.21.15.31:0/3828369361 conn(0x7f4dc40fa7a0 msgr2=0x7f4dc40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 -- 172.21.15.31:0/3828369361 shutdown_connections 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 -- 172.21.15.31:0/3828369361 wait complete. 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 Processor -- start 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.157+0000 7f4dc89a1700 1 -- start start 2024-09-17T01:49:05.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc89a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc89a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 0x7f4dc40fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc89a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ff2f0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc89a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ff430 con 0x7f4dc4103350 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54228/0 (socket says 172.21.15.31:54228) 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 -- 172.21.15.31:0/2027106994 learned_addr learned my addr 172.21.15.31:0/2027106994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc1d9b700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 0x7f4dc40fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 -- 172.21.15.31:0/2027106994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 msgr2=0x7f4dc40fedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 0x7f4dc40fedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 -- 172.21.15.31:0/2027106994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40095f0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc1d9b700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 0x7f4dc40fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:05.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4dc259c700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4100760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4db400bd70 tx=0x7f4db400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db401d070 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.158+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4db400f460 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.159+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db4021640 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.159+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40ff6b0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.159+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40ffba0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.159+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc418fbf0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.160+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4db400fa40 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.161+0000 7f4db37fe700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4dac06c680 0x7f4dac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.161+0000 7f4dc1d9b700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4dac06c680 0x7f4dac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.161+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f4db408c7a0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.161+0000 7f4dc1d9b700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4dac06c680 0x7f4dac06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005950 tx=0x7f4db80058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:05.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.165+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4db405acf0 con 0x7f4dc4069ae0 2024-09-17T01:49:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.375+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc4061190 con 0x7f4dac06c680 2024-09-17T01:49:05.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.380+0000 7f4db37fe700 1 -- 172.21.15.31:0/2027106994 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1290 (secure 0 0 0) 0x7f4dc4061190 con 0x7f4dac06c680 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:crash 2/2 2m ago 6m * 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:mgr 2/2 2m ago 6m count:2 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:mon 2/2 2m ago 5m smithi031:172.21.15.31=smithi031;smithi092:172.21.15.92=smithi092;count:2 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:osd 6 2m ago - 2024-09-17T01:49:05.379 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-09-17T01:49:05.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4dac06c680 msgr2=0x7f4dac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4dac06c680 0x7f4dac06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005950 tx=0x7f4db80058e0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 msgr2=0x7f4dc4100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4100760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4db400bd70 tx=0x7f4db400be50 comp rx=0 tx=0).stop 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 shutdown_connections 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f4dac06c680 0x7f4dac06eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dc4069ae0 0x7f4dc4100760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 --2- 172.21.15.31:0/2027106994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4dc4103350 0x7f4dc40fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 >> 172.21.15.31:0/2027106994 conn(0x7f4dc40fa7a0 msgr2=0x7f4dc40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 shutdown_connections 2024-09-17T01:49:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:05.382+0000 7f4dc89a1700 1 -- 172.21.15.31:0/2027106994 wait complete. 2024-09-17T01:49:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:05 smithi031 ceph-mon[27673]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:05.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T01:49:05.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:05 smithi092 ceph-mon[33552]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:06.194 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:06.645 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:06 smithi031 ceph-mon[27673]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:06.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:06 smithi092 ceph-mon[33552]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:07.784 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:07 smithi031 ceph-mon[27673]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 -- 172.21.15.31:0/3103405844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8600ff130 msgr2=0x7fe8600ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 --2- 172.21.15.31:0/3103405844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8600ff130 0x7fe8600ff540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe854009910 tx=0x7fe854009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:07.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 -- 172.21.15.31:0/3103405844 shutdown_connections 2024-09-17T01:49:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 --2- 172.21.15.31:0/3103405844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8601003d0 0x7fe860100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 --2- 172.21.15.31:0/3103405844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8600ff130 0x7fe8600ff540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 -- 172.21.15.31:0/3103405844 >> 172.21.15.31:0/3103405844 conn(0x7fe8600fa780 msgr2=0x7fe8600fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 -- 172.21.15.31:0/3103405844 shutdown_connections 2024-09-17T01:49:07.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.796+0000 7fe867789700 1 -- 172.21.15.31:0/3103405844 wait complete. 2024-09-17T01:49:07.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe867789700 1 Processor -- start 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe867789700 1 -- start start 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe867789700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8600ff130 0x7fe860195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe867789700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 0x7fe860195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe867789700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860196600 con 0x7fe8601003d0 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe867789700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860196740 con 0x7fe8600ff130 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 0x7fe860195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 0x7fe860195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54254/0 (socket says 172.21.15.31:54254) 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 -- 172.21.15.31:0/2842171403 learned_addr learned my addr 172.21.15.31:0/2842171403 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe865525700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8600ff130 0x7fe860195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 -- 172.21.15.31:0/2842171403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8600ff130 msgr2=0x7fe860195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8600ff130 0x7fe860195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 -- 172.21.15.31:0/2842171403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540095f0 con 0x7fe8601003d0 2024-09-17T01:49:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.797+0000 7fe864d24700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 0x7fe860195fe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c8a0 tx=0x7fe85c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.798+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85c0078e0 con 0x7fe8601003d0 2024-09-17T01:49:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.798+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe85c00f450 con 0x7fe8601003d0 2024-09-17T01:49:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.798+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86019b1f0 con 0x7fe8601003d0 2024-09-17T01:49:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.798+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85c00e5e0 con 0x7fe8601003d0 2024-09-17T01:49:07.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.798+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86019b740 con 0x7fe8601003d0 2024-09-17T01:49:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.799+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860107c10 con 0x7fe8601003d0 2024-09-17T01:49:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.799+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe85c00f5c0 con 0x7fe8601003d0 2024-09-17T01:49:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.800+0000 7fe8527fc700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe84c06c680 0x7fe84c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.800+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe85c08b320 con 0x7fe8601003d0 2024-09-17T01:49:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.800+0000 7fe865525700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe84c06c680 0x7fe84c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.800+0000 7fe865525700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe84c06c680 0x7fe84c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe854006010 tx=0x7fe85400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:07.804+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe85c0598f0 con 0x7fe8601003d0 2024-09-17T01:49:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:07 smithi092 ceph-mon[33552]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:08.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.011+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe860068c50 con 0x7fe84c06c680 2024-09-17T01:49:08.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.013+0000 7fe8527fc700 1 -- 172.21.15.31:0/2842171403 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7fe860068c50 con 0x7fe84c06c680 2024-09-17T01:49:08.011 INFO:teuthology.orchestra.run.smithi031.stdout:HOST ADDR LABELS STATUS 2024-09-17T01:49:08.011 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031 172.21.15.31 2024-09-17T01:49:08.011 INFO:teuthology.orchestra.run.smithi031.stdout:smithi092 172.21.15.92 2024-09-17T01:49:08.012 INFO:teuthology.orchestra.run.smithi031.stdout:2 hosts in cluster 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe84c06c680 msgr2=0x7fe84c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe84c06c680 0x7fe84c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe854006010 tx=0x7fe85400b540 comp rx=0 tx=0).stop 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 msgr2=0x7fe860195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 0x7fe860195fe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c8a0 tx=0x7fe85c00cbb0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 shutdown_connections 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe84c06c680 0x7fe84c06eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8600ff130 0x7fe860195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 --2- 172.21.15.31:0/2842171403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8601003d0 0x7fe860195fe0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 >> 172.21.15.31:0/2842171403 conn(0x7fe8600fa780 msgr2=0x7fe860068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 shutdown_connections 2024-09-17T01:49:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:08.015+0000 7fe867789700 1 -- 172.21.15.31:0/2842171403 wait complete. 2024-09-17T01:49:08.672 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T01:49:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:09.198 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:08 smithi031 ceph-mon[27673]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:09.199 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:08 smithi031 ceph-mon[27673]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:09.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:08 smithi092 ceph-mon[33552]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:09.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:08 smithi092 ceph-mon[33552]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:10.209 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:10.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 -- 172.21.15.31:0/1115787226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 msgr2=0x7f921c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 --2- 172.21.15.31:0/1115787226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c0ff540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f920c009910 tx=0x7f920c009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 -- 172.21.15.31:0/1115787226 shutdown_connections 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 --2- 172.21.15.31:0/1115787226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c1003d0 0x7f921c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 --2- 172.21.15.31:0/1115787226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c0ff540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 -- 172.21.15.31:0/1115787226 >> 172.21.15.31:0/1115787226 conn(0x7f921c0fa780 msgr2=0x7f921c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 -- 172.21.15.31:0/1115787226 shutdown_connections 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.431+0000 7f9220e78700 1 -- 172.21.15.31:0/1115787226 wait complete. 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f9220e78700 1 Processor -- start 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f9220e78700 1 -- start start 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f9220e78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f9220e78700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c1003d0 0x7f921c196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f9220e78700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c196660 con 0x7f921c0ff130 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f9220e78700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1967a0 con 0x7f921c1003d0 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54266/0 (socket says 172.21.15.31:54266) 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 -- 172.21.15.31:0/1818444357 learned_addr learned my addr 172.21.15.31:0/1818444357 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 -- 172.21.15.31:0/1818444357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c1003d0 msgr2=0x7f921c196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c1003d0 0x7f921c196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 -- 172.21.15.31:0/1818444357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0095f0 con 0x7f921c0ff130 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.432+0000 7f921a59c700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c195b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f920c00bd70 tx=0x7f920c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.433+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920c01d070 con 0x7f921c0ff130 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.433+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f920c022470 con 0x7f921c0ff130 2024-09-17T01:49:10.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.433+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c19b1f0 con 0x7f921c0ff130 2024-09-17T01:49:10.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.433+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920c00f670 con 0x7f921c0ff130 2024-09-17T01:49:10.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.433+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c19b6e0 con 0x7f921c0ff130 2024-09-17T01:49:10.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.434+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c107c90 con 0x7f921c0ff130 2024-09-17T01:49:10.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.434+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f920c00f8e0 con 0x7f921c0ff130 2024-09-17T01:49:10.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.435+0000 7f920b7fe700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f920406c680 0x7f920406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.435+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f920c08cbd0 con 0x7f921c0ff130 2024-09-17T01:49:10.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.435+0000 7f9219d9b700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f920406c680 0x7f920406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:10.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.435+0000 7f9219d9b700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f920406c680 0x7f920406eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f92100097b0 tx=0x7f9210006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:10.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.439+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f920c05b2b0 con 0x7f921c0ff130 2024-09-17T01:49:10.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.648+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f921c068c50 con 0x7f920406c680 2024-09-17T01:49:10.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.649+0000 7f920b7fe700 1 -- 172.21.15.31:0/1818444357 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f921c068c50 con 0x7f920406c680 2024-09-17T01:49:10.648 INFO:teuthology.orchestra.run.smithi031.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T01:49:10.648 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53310008400BGN 372G No 2m ago LVM detected, locked 2024-09-17T01:49:10.648 INFO:teuthology.orchestra.run.smithi031.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 73s ago LVM detected, locked 2024-09-17T01:49:10.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.651+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f920406c680 msgr2=0x7f920406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.651+0000 7f9220e78700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f920406c680 0x7f920406eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f92100097b0 tx=0x7f9210006d20 comp rx=0 tx=0).stop 2024-09-17T01:49:10.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.651+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 msgr2=0x7f921c195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.651+0000 7f9220e78700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c195b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f920c00bd70 tx=0x7f920c00be50 comp rx=0 tx=0).stop 2024-09-17T01:49:10.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 shutdown_connections 2024-09-17T01:49:10.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f920406c680 0x7f920406eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c0ff130 0x7f921c195b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 --2- 172.21.15.31:0/1818444357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c1003d0 0x7f921c196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 >> 172.21.15.31:0/1818444357 conn(0x7f921c0fa780 msgr2=0x7f921c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:10.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 shutdown_connections 2024-09-17T01:49:10.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:10.652+0000 7f9220e78700 1 -- 172.21.15.31:0/1818444357 wait complete. 2024-09-17T01:49:11.216 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:10 smithi031 ceph-mon[27673]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:10 smithi092 ceph-mon[33552]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:11.240 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:49:11.255 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:49:11.255 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-17T01:49:11.463 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:11 smithi092 ceph-mon[33552]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:12.248 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:11 smithi031 ceph-mon[27673]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:12 smithi092 ceph-mon[33552]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 -- 172.21.15.31:0/2989539677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 msgr2=0x7f372c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 --2- 172.21.15.31:0/2989539677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c100650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f371c009910 tx=0x7f371c009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 -- 172.21.15.31:0/2989539677 shutdown_connections 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 --2- 172.21.15.31:0/2989539677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f372c101440 0x7f372c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 --2- 172.21.15.31:0/2989539677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c100650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 -- 172.21.15.31:0/2989539677 >> 172.21.15.31:0/2989539677 conn(0x7f372c0fb7f0 msgr2=0x7f372c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 -- 172.21.15.31:0/2989539677 shutdown_connections 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.101+0000 7f3733056700 1 -- 172.21.15.31:0/2989539677 wait complete. 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3733056700 1 Processor -- start 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3733056700 1 -- start start 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3733056700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3733056700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f372c101440 0x7f372c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3733056700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c196630 con 0x7f372c100240 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3733056700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c196770 con 0x7f372c101440 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54286/0 (socket says 172.21.15.31:54286) 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 -- 172.21.15.31:0/1117423228 learned_addr learned my addr 172.21.15.31:0/1117423228 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f372bfff700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f372c101440 0x7f372c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 -- 172.21.15.31:0/1117423228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f372c101440 msgr2=0x7f372c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f372c101440 0x7f372c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 -- 172.21.15.31:0/1117423228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c0095f0 con 0x7f372c100240 2024-09-17T01:49:13.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.102+0000 7f3730df2700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c195ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f371c00bd70 tx=0x7f371c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:13.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.103+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c01d070 con 0x7f372c100240 2024-09-17T01:49:13.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.103+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f371c022470 con 0x7f372c100240 2024-09-17T01:49:13.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.103+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c19b1c0 con 0x7f372c100240 2024-09-17T01:49:13.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.103+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371c00f690 con 0x7f372c100240 2024-09-17T01:49:13.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.103+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c19b6b0 con 0x7f372c100240 2024-09-17T01:49:13.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.104+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c108d90 con 0x7f372c100240 2024-09-17T01:49:13.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.104+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f371c0225e0 con 0x7f372c100240 2024-09-17T01:49:13.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.105+0000 7f3729ffb700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f371406c680 0x7f371406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.104 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:12 smithi031 ceph-mon[27673]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:13.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.105+0000 7f372bfff700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f371406c680 0x7f371406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.105+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f371c08cc60 con 0x7f372c100240 2024-09-17T01:49:13.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.106+0000 7f372bfff700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f371406c680 0x7f371406eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3720005fd0 tx=0x7f372000a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:13.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.111+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f371c05b230 con 0x7f372c100240 2024-09-17T01:49:13.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:13.340+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f372c105d90 con 0x7f371406c680 2024-09-17T01:49:14.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:13 smithi092 ceph-mon[33552]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:14.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:13 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T01:49:14.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:13 smithi031 ceph-mon[27673]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:14.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:13 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T01:49:14.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.960+0000 7f3729ffb700 1 -- 172.21.15.31:0/1117423228 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f372c105d90 con 0x7f371406c680 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f371406c680 msgr2=0x7f371406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f371406c680 0x7f371406eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3720005fd0 tx=0x7f372000a560 comp rx=0 tx=0).stop 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 msgr2=0x7f372c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c195ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f371c00bd70 tx=0x7f371c00be50 comp rx=0 tx=0).stop 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 shutdown_connections 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f371406c680 0x7f371406eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f372c100240 0x7f372c195ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 --2- 172.21.15.31:0/1117423228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f372c101440 0x7f372c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 >> 172.21.15.31:0/1117423228 conn(0x7f372c0fb7f0 msgr2=0x7f372c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 shutdown_connections 2024-09-17T01:49:14.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:14.964+0000 7f3733056700 1 -- 172.21.15.31:0/1117423228 wait complete. 2024-09-17T01:49:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:14 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T01:49:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:14 smithi092 ceph-mon[33552]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T01:49:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:14 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:49:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:14 smithi092 ceph-mon[33552]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:14 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T01:49:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:14 smithi031 ceph-mon[27673]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T01:49:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:14 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:49:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:14 smithi031 ceph-mon[27673]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:14 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[27669]: 2024-09-17T01:49:14.941+0000 7f06e1bbf700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:49:15.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:49:16.233 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T01:49:16.233 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T01:49:16.233 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:49:16.233 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:49:16.233 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: fsmap cephfs:0 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: Saving service mds.cephfs spec with placement count:4 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:15 smithi031 ceph-mon[27673]: Deploying daemon mds.cephfs.smithi031.menvuk on smithi031 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: fsmap cephfs:0 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: Saving service mds.cephfs spec with placement count:4 2024-09-17T01:49:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:15 smithi092 ceph-mon[33552]: Deploying daemon mds.cephfs.smithi031.menvuk on smithi031 2024-09-17T01:49:16.935 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:16 smithi092 ceph-mon[33552]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T01:49:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:16 smithi092 ceph-mon[33552]: pgmap v178: 65 pgs: 10 creating+peering, 34 unknown, 21 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:17.249 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:16 smithi031 ceph-mon[27673]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T01:49:17.250 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:16 smithi031 ceph-mon[27673]: pgmap v178: 65 pgs: 10 creating+peering, 34 unknown, 21 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:18.226 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:17 smithi031 ceph-mon[27673]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:49:18.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:17 smithi092 ceph-mon[33552]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 -- 172.21.15.31:0/3693195827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc100240 msgr2=0x7f3ebc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 --2- 172.21.15.31:0/3693195827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc100240 0x7f3ebc100650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009910 tx=0x7f3eac009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 -- 172.21.15.31:0/3693195827 shutdown_connections 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 --2- 172.21.15.31:0/3693195827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc101440 0x7f3ebc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 --2- 172.21.15.31:0/3693195827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc100240 0x7f3ebc100650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 -- 172.21.15.31:0/3693195827 >> 172.21.15.31:0/3693195827 conn(0x7f3ebc0fb7f0 msgr2=0x7f3ebc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 -- 172.21.15.31:0/3693195827 shutdown_connections 2024-09-17T01:49:18.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.998+0000 7f3ec1118700 1 -- 172.21.15.31:0/3693195827 wait complete. 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.999+0000 7f3ec1118700 1 Processor -- start 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.999+0000 7f3ec1118700 1 -- start start 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.999+0000 7f3ec1118700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc100240 0x7f3ebc195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.999+0000 7f3ec1118700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 0x7f3ebc196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.999+0000 7f3ec1118700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc196630 con 0x7f3ebc101440 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:18.999+0000 7f3ec1118700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc196770 con 0x7f3ebc100240 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 0x7f3ebc196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 0x7f3ebc196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52190/0 (socket says 172.21.15.31:52190) 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 -- 172.21.15.31:0/1244971003 learned_addr learned my addr 172.21.15.31:0/1244971003 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3ebad9d700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc100240 0x7f3ebc195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 -- 172.21.15.31:0/1244971003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc100240 msgr2=0x7f3ebc195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc100240 0x7f3ebc195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 -- 172.21.15.31:0/1244971003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0095f0 con 0x7f3ebc101440 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3ebad9d700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc100240 0x7f3ebc195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb259c700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 0x7f3ebc196010 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d8d0 tx=0x7f3ea400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea40098a0 con 0x7f3ebc101440 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc19b220 con 0x7f3ebc101440 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ea4010460 con 0x7f3ebc101440 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea400f5f0 con 0x7f3ebc101440 2024-09-17T01:49:19.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.000+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc19b770 con 0x7f3ebc101440 2024-09-17T01:49:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.001+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc108d90 con 0x7f3ebc101440 2024-09-17T01:49:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.002+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3ea4009a00 con 0x7f3ebc101440 2024-09-17T01:49:19.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.002+0000 7f3eb8d99700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3ea806c680 0x7f3ea806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.002+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3ea408b6a0 con 0x7f3ebc101440 2024-09-17T01:49:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.002+0000 7f3ebad9d700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3ea806c680 0x7f3ea806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:19.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.003+0000 7f3ebad9d700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3ea806c680 0x7f3ea806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3eac006010 tx=0x7f3eac00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:19.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.007+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3ea40598c0 con 0x7f3ebc101440 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: pgmap v180: 65 pgs: 10 creating+peering, 55 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.253+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ebc108f80 con 0x7f3ebc101440 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: pgmap v180: 65 pgs: 10 creating+peering, 55 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:19.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.254+0000 7f3eb8d99700 1 -- 172.21.15.31:0/1244971003 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1264 (secure 0 0 0) 0x7f3ea4059450 con 0x7f3ebc101440 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:e4 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 4 2024-09-17T01:49:19.253 INFO:teuthology.orchestra.run.smithi031.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:49:18.961148+0000 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 1 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:in 0 2024-09-17T01:49:19.254 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464} 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 0 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:creating seq 1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:19.255 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3ea806c680 msgr2=0x7f3ea806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3ea806c680 0x7f3ea806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3eac006010 tx=0x7f3eac00b540 comp rx=0 tx=0).stop 2024-09-17T01:49:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 msgr2=0x7f3ebc196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 0x7f3ebc196010 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d8d0 tx=0x7f3ea400dbe0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 shutdown_connections 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f3ea806c680 0x7f3ea806eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ebc100240 0x7f3ebc195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 --2- 172.21.15.31:0/1244971003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ebc101440 0x7f3ebc196010 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 >> 172.21.15.31:0/1244971003 conn(0x7f3ebc0fb7f0 msgr2=0x7f3ebc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 shutdown_connections 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:19.256+0000 7f3ec1118700 1 -- 172.21.15.31:0/1244971003 wait complete. 2024-09-17T01:49:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 4 2024-09-17T01:49:19.900 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:49:19.909 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:49:19.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-17T01:49:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: Deploying daemon mds.cephfs.smithi092.xzgrcs on smithi092 2024-09-17T01:49:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] up:boot 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: daemon mds.cephfs.smithi031.menvuk assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: Cluster is now healthy 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: fsmap cephfs:0 1 up:standby 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:creating} 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: daemon mds.cephfs.smithi031.menvuk is now active in filesystem cephfs as rank 0 2024-09-17T01:49:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:19 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1244971003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: Deploying daemon mds.cephfs.smithi092.xzgrcs on smithi092 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] up:boot 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: daemon mds.cephfs.smithi031.menvuk assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: Cluster is now healthy 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: fsmap cephfs:0 1 up:standby 2024-09-17T01:49:20.243 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:49:20.244 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:creating} 2024-09-17T01:49:20.244 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: daemon mds.cephfs.smithi031.menvuk is now active in filesystem cephfs as rank 0 2024-09-17T01:49:20.244 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:19 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1244971003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:49:20.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:20 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] up:active 2024-09-17T01:49:20.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:20 smithi092 ceph-mon[33552]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2024-09-17T01:49:20.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:20 smithi092 ceph-mon[33552]: pgmap v181: 65 pgs: 4 creating+peering, 61 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 555 B/s wr, 2 op/s 2024-09-17T01:49:21.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:20 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] up:active 2024-09-17T01:49:21.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:20 smithi031 ceph-mon[27673]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2024-09-17T01:49:21.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:20 smithi031 ceph-mon[27673]: pgmap v181: 65 pgs: 4 creating+peering, 61 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 555 B/s wr, 2 op/s 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.739+0000 7faf9844d700 1 -- 172.21.15.31:0/10133655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 msgr2=0x7faf900ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 --2- 172.21.15.31:0/10133655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf900ff540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009910 tx=0x7faf8c009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 -- 172.21.15.31:0/10133655 shutdown_connections 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 --2- 172.21.15.31:0/10133655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 0x7faf90100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 --2- 172.21.15.31:0/10133655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf900ff540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 -- 172.21.15.31:0/10133655 >> 172.21.15.31:0/10133655 conn(0x7faf900fa780 msgr2=0x7faf900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 -- 172.21.15.31:0/10133655 shutdown_connections 2024-09-17T01:49:21.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.740+0000 7faf9844d700 1 -- 172.21.15.31:0/10133655 wait complete. 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf9844d700 1 Processor -- start 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf9844d700 1 -- start start 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf9844d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf90103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf9844d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 0x7faf901017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf9844d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf90101cf0 con 0x7faf900ff130 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf9844d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf90101e30 con 0x7faf901003d0 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf961e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf90103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf959e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 0x7faf901017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf961e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf90103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52210/0 (socket says 172.21.15.31:52210) 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.741+0000 7faf961e9700 1 -- 172.21.15.31:0/2448298148 learned_addr learned my addr 172.21.15.31:0/2448298148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf961e9700 1 -- 172.21.15.31:0/2448298148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 msgr2=0x7faf901017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf961e9700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 0x7faf901017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf961e9700 1 -- 172.21.15.31:0/2448298148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0095f0 con 0x7faf900ff130 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf959e8700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 0x7faf901017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf961e9700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf90103160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00b5c0 tx=0x7faf8c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c01d070 con 0x7faf900ff130 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf901020b0 con 0x7faf900ff130 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf901025a0 con 0x7faf900ff130 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf8c00f460 con 0x7faf900ff130 2024-09-17T01:49:21.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.742+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c021640 con 0x7faf900ff130 2024-09-17T01:49:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.743+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf90107c10 con 0x7faf900ff130 2024-09-17T01:49:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.744+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7faf8c00fa60 con 0x7faf900ff130 2024-09-17T01:49:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.744+0000 7faf877fe700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faf7c06c680 0x7faf7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.745+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7faf8c08c820 con 0x7faf900ff130 2024-09-17T01:49:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.745+0000 7faf959e8700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faf7c06c680 0x7faf7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.745+0000 7faf959e8700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faf7c06c680 0x7faf7c06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf80005950 tx=0x7faf8000b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:21.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:21.749+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faf8c05aac0 con 0x7faf900ff130 2024-09-17T01:49:22.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.002+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7faf9019dfe0 con 0x7faf900ff130 2024-09-17T01:49:22.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:22.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: Deploying daemon mds.cephfs.smithi031.gszbpe on smithi031 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] up:boot 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 1 up:standby 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 1 up:standby 2024-09-17T01:49:22.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:22 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2448298148' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T01:49:22.363 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:22.363 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:22.363 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: Deploying daemon mds.cephfs.smithi031.gszbpe on smithi031 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] up:boot 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 1 up:standby 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 1 up:standby 2024-09-17T01:49:22.364 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:22 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2448298148' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T01:49:22.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.899+0000 7faf877fe700 1 -- 172.21.15.31:0/2448298148 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7faf8c05a650 con 0x7faf900ff130 2024-09-17T01:49:22.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.904+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faf7c06c680 msgr2=0x7faf7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.904+0000 7faf9844d700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faf7c06c680 0x7faf7c06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf80005950 tx=0x7faf8000b410 comp rx=0 tx=0).stop 2024-09-17T01:49:22.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.904+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 msgr2=0x7faf90103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.904+0000 7faf9844d700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf90103160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00b5c0 tx=0x7faf8c00bd70 comp rx=0 tx=0).stop 2024-09-17T01:49:22.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 shutdown_connections 2024-09-17T01:49:22.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faf7c06c680 0x7faf7c06eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf900ff130 0x7faf90103160 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 --2- 172.21.15.31:0/2448298148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf901003d0 0x7faf901017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 >> 172.21.15.31:0/2448298148 conn(0x7faf900fa780 msgr2=0x7faf90068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:22.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 shutdown_connections 2024-09-17T01:49:22.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:22.906+0000 7faf9844d700 1 -- 172.21.15.31:0/2448298148 wait complete. 2024-09-17T01:49:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:23 smithi092 ceph-mon[33552]: pgmap v182: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 817 B/s wr, 4 op/s 2024-09-17T01:49:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:23 smithi092 ceph-mon[33552]: daemon mds.cephfs.smithi092.xzgrcs assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T01:49:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:23 smithi092 ceph-mon[33552]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:49:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:23 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2448298148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T01:49:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:23 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:creating} 2024-09-17T01:49:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:23 smithi092 ceph-mon[33552]: daemon mds.cephfs.smithi092.xzgrcs is now active in filesystem cephfs as rank 1 2024-09-17T01:49:23.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:23 smithi031 ceph-mon[27673]: pgmap v182: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 817 B/s wr, 4 op/s 2024-09-17T01:49:23.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:23 smithi031 ceph-mon[27673]: daemon mds.cephfs.smithi092.xzgrcs assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T01:49:23.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:23 smithi031 ceph-mon[27673]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:49:23.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:23 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2448298148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T01:49:23.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:23 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:creating} 2024-09-17T01:49:23.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:23 smithi031 ceph-mon[27673]: daemon mds.cephfs.smithi092.xzgrcs is now active in filesystem cephfs as rank 1 2024-09-17T01:49:23.636 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:49:23.647 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:49:23.647 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-17T01:49:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] up:active 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:25.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:25.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:25.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: Deploying daemon mds.cephfs.smithi092.hofoma on smithi092 2024-09-17T01:49:25.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-17T01:49:25.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] up:active 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: Deploying daemon mds.cephfs.smithi092.hofoma on smithi092 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:25.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.784+0000 7fd907903700 1 -- 172.21.15.31:0/4161001501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 msgr2=0x7fd9000ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.784+0000 7fd907903700 1 --2- 172.21.15.31:0/4161001501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd9000ff560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009910 tx=0x7fd8fc009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.784+0000 7fd907903700 1 -- 172.21.15.31:0/4161001501 shutdown_connections 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.784+0000 7fd907903700 1 --2- 172.21.15.31:0/4161001501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9001003f0 0x7fd900100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.784+0000 7fd907903700 1 --2- 172.21.15.31:0/4161001501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd9000ff560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.784+0000 7fd907903700 1 -- 172.21.15.31:0/4161001501 >> 172.21.15.31:0/4161001501 conn(0x7fd9000fa7a0 msgr2=0x7fd9000fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 -- 172.21.15.31:0/4161001501 shutdown_connections 2024-09-17T01:49:25.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 -- 172.21.15.31:0/4161001501 wait complete. 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 Processor -- start 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 -- start start 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd900195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9001003f0 0x7fd900196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900196970 con 0x7fd9000ff150 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.785+0000 7fd907903700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900196ab0 con 0x7fd9001003f0 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd900195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd900195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46870/0 (socket says 172.21.15.31:46870) 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 -- 172.21.15.31:0/1774441732 learned_addr learned my addr 172.21.15.31:0/1774441732 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd904e9e700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9001003f0 0x7fd900196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 -- 172.21.15.31:0/1774441732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9001003f0 msgr2=0x7fd900196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9001003f0 0x7fd900196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 -- 172.21.15.31:0/1774441732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0095f0 con 0x7fd9000ff150 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd90569f700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd900195e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc006010 tx=0x7fd8fc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8fc01d070 con 0x7fd9000ff150 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90019b500 con 0x7fd9000ff150 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd8fc00f460 con 0x7fd9000ff150 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8fc021640 con 0x7fd9000ff150 2024-09-17T01:49:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.786+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90019b9f0 con 0x7fd9000ff150 2024-09-17T01:49:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.787+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd900068ab0 con 0x7fd9000ff150 2024-09-17T01:49:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.788+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd8fc00fab0 con 0x7fd9000ff150 2024-09-17T01:49:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.788+0000 7fd8f27fc700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd8ec06c680 0x7fd8ec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.789+0000 7fd904e9e700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd8ec06c680 0x7fd8ec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.789+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd8fc08ca70 con 0x7fd9000ff150 2024-09-17T01:49:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.789+0000 7fd904e9e700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd8ec06c680 0x7fd8ec06eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4005950 tx=0x7fd8f400b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:25.793+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd8fc05ac90 con 0x7fd9000ff150 2024-09-17T01:49:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:25 smithi092 ceph-mon[33552]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:49:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:25 smithi092 ceph-mon[33552]: Cluster is now healthy 2024-09-17T01:49:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:25 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] up:boot 2024-09-17T01:49:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:25 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 1 up:standby 2024-09-17T01:49:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:25 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:49:26.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:25 smithi031 ceph-mon[27673]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:49:26.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:25 smithi031 ceph-mon[27673]: Cluster is now healthy 2024-09-17T01:49:26.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:25 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] up:boot 2024-09-17T01:49:26.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:25 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 1 up:standby 2024-09-17T01:49:26.044 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:25 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:49:26.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.045+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fd90019bcd0 con 0x7fd9000ff150 2024-09-17T01:49:26.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.921+0000 7fd8f27fc700 1 -- 172.21.15.31:0/1774441732 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd8fc05a820 con 0x7fd9000ff150 2024-09-17T01:49:26.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.924+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd8ec06c680 msgr2=0x7fd8ec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.924+0000 7fd907903700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd8ec06c680 0x7fd8ec06eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4005950 tx=0x7fd8f400b410 comp rx=0 tx=0).stop 2024-09-17T01:49:26.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.924+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 msgr2=0x7fd900195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.924+0000 7fd907903700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd900195e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc006010 tx=0x7fd8fc00bd70 comp rx=0 tx=0).stop 2024-09-17T01:49:26.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 shutdown_connections 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd8ec06c680 0x7fd8ec06eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9000ff150 0x7fd900195e10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 --2- 172.21.15.31:0/1774441732 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9001003f0 0x7fd900196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 >> 172.21.15.31:0/1774441732 conn(0x7fd9000fa7a0 msgr2=0x7fd900068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 shutdown_connections 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:26.925+0000 7fd907903700 1 -- 172.21.15.31:0/1774441732 wait complete. 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1774441732' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 6 op/s 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.209 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:26 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1774441732' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 6 op/s 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:26 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:27.612 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:49:27.623 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:49:27.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-17T01:49:27.860 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:28.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1774441732' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T01:49:28.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] up:boot 2024-09-17T01:49:28.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] up:active 2024-09-17T01:49:28.181 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby 2024-09-17T01:49:28.181 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:49:28.181 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:28.181 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:27 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:49:28.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1774441732' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T01:49:28.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] up:boot 2024-09-17T01:49:28.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] up:active 2024-09-17T01:49:28.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby 2024-09-17T01:49:28.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:49:28.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:28.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:27 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:49:29.238 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:28 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] up:active 2024-09-17T01:49:29.238 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:28 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:29.238 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:28 smithi031 ceph-mon[27673]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 533 B/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-17T01:49:29.238 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:28 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:29.238 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:28 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:28 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] up:active 2024-09-17T01:49:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:28 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:28 smithi092 ceph-mon[33552]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 533 B/s rd, 2.3 KiB/s wr, 7 op/s 2024-09-17T01:49:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:28 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:28 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:30.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 -- 172.21.15.31:0/4143951234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80ffb60 msgr2=0x7f36b80fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 --2- 172.21.15.31:0/4143951234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80ffb60 0x7f36b80fffd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00aa20 tx=0x7f36ac00ad30 comp rx=0 tx=0).stop 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 -- 172.21.15.31:0/4143951234 shutdown_connections 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 --2- 172.21.15.31:0/4143951234 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80ffb60 0x7f36b80fffd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 --2- 172.21.15.31:0/4143951234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b80fe8c0 0x7f36b80fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 -- 172.21.15.31:0/4143951234 >> 172.21.15.31:0/4143951234 conn(0x7f36b80f9f10 msgr2=0x7f36b80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 -- 172.21.15.31:0/4143951234 shutdown_connections 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 -- 172.21.15.31:0/4143951234 wait complete. 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 Processor -- start 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.052+0000 7f36bea58700 1 -- start start 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36bea58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 0x7f36b8195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36bea58700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b80ffb60 0x7f36b8196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36bea58700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8196620 con 0x7f36b80fe8c0 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36bea58700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8196760 con 0x7f36b80ffb60 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 0x7f36b8195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 0x7f36b8195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46882/0 (socket says 172.21.15.31:46882) 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 -- 172.21.15.31:0/129406441 learned_addr learned my addr 172.21.15.31:0/129406441 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b77fe700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b80ffb60 0x7f36b8196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 -- 172.21.15.31:0/129406441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b80ffb60 msgr2=0x7f36b8196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b80ffb60 0x7f36b8196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 -- 172.21.15.31:0/129406441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac00a700 con 0x7f36b80fe8c0 2024-09-17T01:49:30.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.053+0000 7f36b7fff700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 0x7f36b8195ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36a800d8d0 tx=0x7f36a800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:30.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.054+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a80098a0 con 0x7f36b80fe8c0 2024-09-17T01:49:30.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.054+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f36a8010460 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.054+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b819b210 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.054+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a800f5f0 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.054+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b819b760 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.055+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b8106b00 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.055+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f36a8009a00 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.056+0000 7f36b57fa700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f36a006c680 0x7f36a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.056+0000 7f36b77fe700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f36a006c680 0x7f36a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.056+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f36a808b6b0 con 0x7f36b80fe8c0 2024-09-17T01:49:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.056+0000 7f36b77fe700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f36a006c680 0x7f36a006eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00c6d0 tx=0x7f36ac005de0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:30.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.060+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f36a80598d0 con 0x7f36b80fe8c0 2024-09-17T01:49:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:29 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] up:standby-replay 2024-09-17T01:49:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:29 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:29 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:30.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:29 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] up:standby-replay 2024-09-17T01:49:30.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:29 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:30.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:29 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.340+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f36b8106cf0 con 0x7f36b80fe8c0 2024-09-17T01:49:30.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.937+0000 7f36b57fa700 1 -- 172.21.15.31:0/129406441 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v15) v1 ==== 133+0+0 (secure 0 0 0) 0x7f36b8106cf0 con 0x7f36b80fe8c0 2024-09-17T01:49:30.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f36a006c680 msgr2=0x7f36a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:30.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f36a006c680 0x7f36a006eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00c6d0 tx=0x7f36ac005de0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 msgr2=0x7f36b8195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:30.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 0x7f36b8195ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36a800d8d0 tx=0x7f36a800dbe0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 shutdown_connections 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f36a006c680 0x7f36a006eb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36b80fe8c0 0x7f36b8195ac0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 --2- 172.21.15.31:0/129406441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b80ffb60 0x7f36b8196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 >> 172.21.15.31:0/129406441 conn(0x7f36b80f9f10 msgr2=0x7f36b80fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 shutdown_connections 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:30.939+0000 7f36bea58700 1 -- 172.21.15.31:0/129406441 wait complete. 2024-09-17T01:49:30.938 INFO:teuthology.orchestra.run.smithi031.stderr:inline data disabled 2024-09-17T01:49:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:30 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/129406441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-17T01:49:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:30 smithi092 ceph-mon[33552]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-17T01:49:31.247 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:30 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/129406441' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-17T01:49:31.247 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:30 smithi031 ceph-mon[27673]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-17T01:49:32.143 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:31 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/129406441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-17T01:49:32.143 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:31 smithi031 ceph-mon[27673]: mds.? [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] up:standby-replay 2024-09-17T01:49:32.143 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:31 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:32.165 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:49:32.175 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:49:32.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:49:32.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:31 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/129406441' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-17T01:49:32.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:31 smithi092 ceph-mon[33552]: mds.? [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] up:standby-replay 2024-09-17T01:49:32.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:31 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:49:32.957 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:33.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:32 smithi092 ceph-mon[33552]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-17T01:49:33.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:32 smithi031 ceph-mon[27673]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-17T01:49:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 -- 172.21.15.31:0/1528922336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638101440 msgr2=0x7f1638101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 --2- 172.21.15.31:0/1528922336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638101440 0x7f1638101890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f162c009910 tx=0x7f162c009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 -- 172.21.15.31:0/1528922336 shutdown_connections 2024-09-17T01:49:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 --2- 172.21.15.31:0/1528922336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638101440 0x7f1638101890 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 --2- 172.21.15.31:0/1528922336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638100240 0x7f1638100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 -- 172.21.15.31:0/1528922336 >> 172.21.15.31:0/1528922336 conn(0x7f16380fb7f0 msgr2=0x7f16380fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 -- 172.21.15.31:0/1528922336 shutdown_connections 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 -- 172.21.15.31:0/1528922336 wait complete. 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.059+0000 7f163ec17700 1 Processor -- start 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163ec17700 1 -- start start 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163ec17700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 0x7f1638074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163ec17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638101440 0x7f1638073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163ec17700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638073680 con 0x7f1638100240 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163ec17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380737c0 con 0x7f1638101440 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 0x7f1638074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 0x7f1638074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40388/0 (socket says 172.21.15.31:40388) 2024-09-17T01:49:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 -- 172.21.15.31:0/3850979800 learned_addr learned my addr 172.21.15.31:0/3850979800 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f1637fff700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638101440 0x7f1638073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 -- 172.21.15.31:0/3850979800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638101440 msgr2=0x7f1638073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638101440 0x7f1638073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 -- 172.21.15.31:0/3850979800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0095f0 con 0x7f1638100240 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f1637fff700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638101440 0x7f1638073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163c9b3700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 0x7f1638074af0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f162800b480 tx=0x7f162800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16280118c0 con 0x7f1638100240 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1628010380 con 0x7f1638100240 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.060+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638073aa0 con 0x7f1638100240 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.061+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f162800f4f0 con 0x7f1638100240 2024-09-17T01:49:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.061+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163819dbe0 con 0x7f1638100240 2024-09-17T01:49:35.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.062+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1638108e30 con 0x7f1638100240 2024-09-17T01:49:35.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.062+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f16280104f0 con 0x7f1638100240 2024-09-17T01:49:35.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.063+0000 7f1635ffb700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f162006c680 0x7f162006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.063+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f162808b360 con 0x7f1638100240 2024-09-17T01:49:35.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.063+0000 7f1637fff700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f162006c680 0x7f162006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.063+0000 7f1637fff700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f162006c680 0x7f162006eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f162c00b5c0 tx=0x7f162c005e20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.067+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1628059600 con 0x7f1638100240 2024-09-17T01:49:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.336+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f163819e190 con 0x7f1638100240 2024-09-17T01:49:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.336+0000 7f1635ffb700 1 -- 172.21.15.31:0/3850979800 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f163819e190 con 0x7f1638100240 2024-09-17T01:49:35.334 INFO:teuthology.orchestra.run.smithi031.stdout:e15 2024-09-17T01:49:35.334 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:49:35.334 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 15 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:49:30.931207+0000 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:49:35.335 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:49:35.336 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.338+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f162006c680 msgr2=0x7f162006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.338+0000 7f163ec17700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f162006c680 0x7f162006eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f162c00b5c0 tx=0x7f162c005e20 comp rx=0 tx=0).stop 2024-09-17T01:49:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.338+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 msgr2=0x7f1638074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.338+0000 7f163ec17700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 0x7f1638074af0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f162800b480 tx=0x7f162800b840 comp rx=0 tx=0).stop 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.338+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 shutdown_connections 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.338+0000 7f163ec17700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f162006c680 0x7f162006eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.339+0000 7f163ec17700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1638100240 0x7f1638074af0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.339+0000 7f163ec17700 1 --2- 172.21.15.31:0/3850979800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1638101440 0x7f1638073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.339+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 >> 172.21.15.31:0/3850979800 conn(0x7f16380fb7f0 msgr2=0x7f1638104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.339+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 shutdown_connections 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:35.339+0000 7f163ec17700 1 -- 172.21.15.31:0/3850979800 wait complete. 2024-09-17T01:49:35.339 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 15 2024-09-17T01:49:35.669 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-17T01:49:35.669 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:35.669 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:35.669 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:35.670 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:49:35.670 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:35.670 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3850979800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:49:35.670 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:35 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3850979800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:49:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:35 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:49:36.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-17T01:49:36.231 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:37 smithi092 ceph-mon[33552]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-17T01:49:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:37 smithi031 ceph-mon[27673]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-17T01:49:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.148+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/222158538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f81003d0 msgr2=0x7fe1f8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.148+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/222158538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f81003d0 0x7fe1f8100840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009910 tx=0x7fe1ec009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/222158538 shutdown_connections 2024-09-17T01:49:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/222158538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f81003d0 0x7fe1f8100840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/222158538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1f80ff130 0x7fe1f80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/222158538 >> 172.21.15.31:0/222158538 conn(0x7fe1f80fa780 msgr2=0x7fe1f80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:38.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/222158538 shutdown_connections 2024-09-17T01:49:38.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/222158538 wait complete. 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.149+0000 7fe1fd0e6700 1 Processor -- start 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1fd0e6700 1 -- start start 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1fd0e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 0x7fe1f8103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1fd0e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1f81003d0 0x7fe1f81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1fd0e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8101cf0 con 0x7fe1f80ff130 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1fd0e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8101e30 con 0x7fe1f81003d0 2024-09-17T01:49:38.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 0x7fe1f8103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 0x7fe1f8103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40402/0 (socket says 172.21.15.31:40402) 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 -- 172.21.15.31:0/4092762216 learned_addr learned my addr 172.21.15.31:0/4092762216 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f659c700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1f81003d0 0x7fe1f81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 -- 172.21.15.31:0/4092762216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1f81003d0 msgr2=0x7fe1f81017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1f81003d0 0x7fe1f81017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 -- 172.21.15.31:0/4092762216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0095f0 con 0x7fe1f80ff130 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.150+0000 7fe1f6d9d700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 0x7fe1f8103160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800e920 tx=0x7fe1e800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.151+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e8009790 con 0x7fe1f80ff130 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.151+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f8102110 con 0x7fe1f80ff130 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.151+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1e800cba0 con 0x7fe1f80ff130 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.151+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e8018630 con 0x7fe1f80ff130 2024-09-17T01:49:38.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.151+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f819dad0 con 0x7fe1f80ff130 2024-09-17T01:49:38.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.152+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f8107c10 con 0x7fe1f80ff130 2024-09-17T01:49:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.152+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe1e800cd10 con 0x7fe1f80ff130 2024-09-17T01:49:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.153+0000 7fe1dffff700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe1e006c680 0x7fe1e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.153+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe1e8014070 con 0x7fe1f80ff130 2024-09-17T01:49:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.153+0000 7fe1f659c700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe1e006c680 0x7fe1e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:38.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.154+0000 7fe1f659c700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe1e006c680 0x7fe1e006eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00b6f0 tx=0x7fe1ec009f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:38.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.158+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe1e8051720 con 0x7fe1f80ff130 2024-09-17T01:49:38.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.415+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1f8107dd0 con 0x7fe1f80ff130 2024-09-17T01:49:38.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.416+0000 7fe1dffff700 1 -- 172.21.15.31:0/4092762216 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4768 (secure 0 0 0) 0x7fe1f8107dd0 con 0x7fe1f80ff130 2024-09-17T01:49:38.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe1e006c680 msgr2=0x7fe1e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe1e006c680 0x7fe1e006eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00b6f0 tx=0x7fe1ec009f90 comp rx=0 tx=0).stop 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 msgr2=0x7fe1f8103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 0x7fe1f8103160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800e920 tx=0x7fe1e800ece0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 shutdown_connections 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe1e006c680 0x7fe1e006eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f80ff130 0x7fe1f8103160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 --2- 172.21.15.31:0/4092762216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1f81003d0 0x7fe1f81017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 >> 172.21.15.31:0/4092762216 conn(0x7fe1f80fa780 msgr2=0x7fe1f8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 shutdown_connections 2024-09-17T01:49:38.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:38.418+0000 7fe1fd0e6700 1 -- 172.21.15.31:0/4092762216 wait complete. 2024-09-17T01:49:38.417 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 15 2024-09-17T01:49:38.426 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:49:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:38 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:38 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:38 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/4092762216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:49:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:38 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:38 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:38 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/4092762216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:49:39.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-17T01:49:39.879 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:39 smithi031 ceph-mon[27673]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-17T01:49:39.879 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:39.879 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:39.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:39 smithi092 ceph-mon[33552]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-17T01:49:39.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:39.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:41.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:41 smithi031 ceph-mon[27673]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-17T01:49:41.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:41 smithi092 ceph-mon[33552]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.124+0000 7fd2bd824700 1 -- 172.21.15.31:0/632423736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 msgr2=0x7fd2b81019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.124+0000 7fd2bd824700 1 --2- 172.21.15.31:0/632423736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b81019f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009910 tx=0x7fd2ac009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.124+0000 7fd2bd824700 1 -- 172.21.15.31:0/632423736 shutdown_connections 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.124+0000 7fd2bd824700 1 --2- 172.21.15.31:0/632423736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b81019f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.125+0000 7fd2bd824700 1 --2- 172.21.15.31:0/632423736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2b80fe520 0x7fd2b80fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.125+0000 7fd2bd824700 1 -- 172.21.15.31:0/632423736 >> 172.21.15.31:0/632423736 conn(0x7fd2b80f9e50 msgr2=0x7fd2b80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.125+0000 7fd2bd824700 1 -- 172.21.15.31:0/632423736 shutdown_connections 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.125+0000 7fd2bd824700 1 -- 172.21.15.31:0/632423736 wait complete. 2024-09-17T01:49:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.125+0000 7fd2bd824700 1 Processor -- start 2024-09-17T01:49:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.125+0000 7fd2bd824700 1 -- start start 2024-09-17T01:49:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bd824700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2b80fe520 0x7fd2b8100f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bd824700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b80ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bd824700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80ffa90 con 0x7fd2b81015a0 2024-09-17T01:49:43.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bd824700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80ffbd0 con 0x7fd2b80fe520 2024-09-17T01:49:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b80ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b80ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40414/0 (socket says 172.21.15.31:40414) 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 -- 172.21.15.31:0/580754103 learned_addr learned my addr 172.21.15.31:0/580754103 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b6ffd700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2b80fe520 0x7fd2b8100f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 -- 172.21.15.31:0/580754103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2b80fe520 msgr2=0x7fd2b8100f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2b80fe520 0x7fd2b8100f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 -- 172.21.15.31:0/580754103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0095f0 con 0x7fd2b81015a0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2b67fc700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b80ff550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac006010 tx=0x7fd2ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac01d070 con 0x7fd2b81015a0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2ac00f460 con 0x7fd2b81015a0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b80ffe50 con 0x7fd2b81015a0 2024-09-17T01:49:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.126+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac021640 con 0x7fd2b81015a0 2024-09-17T01:49:43.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.127+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b8100340 con 0x7fd2b81015a0 2024-09-17T01:49:43.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.127+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8108da0 con 0x7fd2b81015a0 2024-09-17T01:49:43.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.128+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd2ac00fab0 con 0x7fd2b81015a0 2024-09-17T01:49:43.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.129+0000 7fd2bc822700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd2a006c680 0x7fd2a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:43.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.129+0000 7fd2b6ffd700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd2a006c680 0x7fd2a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:43.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.129+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd2ac08cab0 con 0x7fd2b81015a0 2024-09-17T01:49:43.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.129+0000 7fd2b6ffd700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd2a006c680 0x7fd2a006eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005950 tx=0x7fd2a800a300 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.133+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd2ac05ad50 con 0x7fd2b81015a0 2024-09-17T01:49:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.423+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fd2b8108f60 con 0x7fd2b81015a0 2024-09-17T01:49:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.423+0000 7fd2bc822700 1 -- 172.21.15.31:0/580754103 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+83 (secure 0 0 0) 0x7fd2ac05a8e0 con 0x7fd2b81015a0 2024-09-17T01:49:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd2a006c680 msgr2=0x7fd2a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd2a006c680 0x7fd2a006eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005950 tx=0x7fd2a800a300 comp rx=0 tx=0).stop 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 msgr2=0x7fd2b80ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b80ff550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac006010 tx=0x7fd2ac00bd70 comp rx=0 tx=0).stop 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 shutdown_connections 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd2a006c680 0x7fd2a006eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2b80fe520 0x7fd2b8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 --2- 172.21.15.31:0/580754103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b81015a0 0x7fd2b80ff550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 >> 172.21.15.31:0/580754103 conn(0x7fd2b80f9e50 msgr2=0x7fd2b81047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 shutdown_connections 2024-09-17T01:49:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:43.426+0000 7fd2bd824700 1 -- 172.21.15.31:0/580754103 wait complete. 2024-09-17T01:49:43.434 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:49:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:49:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:43.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:49:43.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:43.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:43 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/580754103' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:49:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:43 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/580754103' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T01:49:44.049 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-17T01:49:44.062 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T01:49:44.269 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:45.695 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:45 smithi031 ceph-mon[27673]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:45.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 -- 172.21.15.31:0/3929583104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ff3c0 msgr2=0x7f02ac0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3929583104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ff3c0 0x7f02ac0ff790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009910 tx=0x7f02a8009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 -- 172.21.15.31:0/3929583104 shutdown_connections 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3929583104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02ac0ffd60 0x7f02ac103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3929583104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ff3c0 0x7f02ac0ff790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 -- 172.21.15.31:0/3929583104 >> 172.21.15.31:0/3929583104 conn(0x7f02ac0fac80 msgr2=0x7f02ac0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 -- 172.21.15.31:0/3929583104 shutdown_connections 2024-09-17T01:49:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 -- 172.21.15.31:0/3929583104 wait complete. 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.803+0000 7f02b3db1700 1 Processor -- start 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b3db1700 1 -- start start 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b3db1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02ac0ff3c0 0x7f02ac196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b3db1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 0x7f02ac197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b3db1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac197830 con 0x7f02ac0ffd60 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b3db1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac1979a0 con 0x7f02ac0ff3c0 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 0x7f02ac197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 0x7f02ac197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37166/0 (socket says 172.21.15.31:37166) 2024-09-17T01:49:45.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 -- 172.21.15.31:0/3938539863 learned_addr learned my addr 172.21.15.31:0/3938539863 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b1b4d700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02ac0ff3c0 0x7f02ac196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 -- 172.21.15.31:0/3938539863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02ac0ff3c0 msgr2=0x7f02ac196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02ac0ff3c0 0x7f02ac196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 -- 172.21.15.31:0/3938539863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80095f0 con 0x7f02ac0ffd60 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.804+0000 7f02b134c700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 0x7f02ac197210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f029c00d900 tx=0x7f029c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.805+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c009900 con 0x7f02ac0ffd60 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.805+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f029c010460 con 0x7f02ac0ffd60 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.805+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac19fd40 con 0x7f02ac0ffd60 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.805+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c00f5f0 con 0x7f02ac0ffd60 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.805+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac1a0230 con 0x7f02ac0ffd60 2024-09-17T01:49:45.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.806+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac1076d0 con 0x7f02ac0ffd60 2024-09-17T01:49:45.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.806+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f029c0105d0 con 0x7f02ac0ffd60 2024-09-17T01:49:45.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.807+0000 7f02a2ffd700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f029806c680 0x7f029806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:45.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.807+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f029c08b510 con 0x7f02ac0ffd60 2024-09-17T01:49:45.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.807+0000 7f02b1b4d700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f029806c680 0x7f029806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:45.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.807+0000 7f02b1b4d700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f029806c680 0x7f029806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02a8006010 tx=0x7f02a801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:45.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:45.811+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f029c055d20 con 0x7f02ac0ffd60 2024-09-17T01:49:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:45 smithi092 ceph-mon[33552]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.058+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02ac04f2a0 con 0x7f02ac0ffd60 2024-09-17T01:49:46.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.059+0000 7f02a2ffd700 1 -- 172.21.15.31:0/3938539863 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4768 (secure 0 0 0) 0x7f029c059340 con 0x7f02ac0ffd60 2024-09-17T01:49:46.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:49:46.057 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:49:30.931207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.31:6829/1620553537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1620553537},{"type":"v1","addr":"172.21.15.31:6829","nonce":1620553537}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi092.hofoma","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.92:6827/2865546968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2865546968},{"type":"v1","addr":"172.21.15.92:6827","nonce":2865546968}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T01:49:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f029806c680 msgr2=0x7f029806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f029806c680 0x7f029806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02a8006010 tx=0x7f02a801a040 comp rx=0 tx=0).stop 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 msgr2=0x7f02ac197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 0x7f02ac197210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f029c00d900 tx=0x7f029c00dcc0 comp rx=0 tx=0).stop 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 shutdown_connections 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f029806c680 0x7f029806eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02ac0ff3c0 0x7f02ac196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 --2- 172.21.15.31:0/3938539863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02ac0ffd60 0x7f02ac197210 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 >> 172.21.15.31:0/3938539863 conn(0x7f02ac0fac80 msgr2=0x7f02ac0fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 shutdown_connections 2024-09-17T01:49:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:46.061+0000 7f02b3db1700 1 -- 172.21.15.31:0/3938539863 wait complete. 2024-09-17T01:49:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 15 2024-09-17T01:49:46.622 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:46 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3938539863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:49:46.624 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2024-09-17T01:49:46.624 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T01:49:46.660 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T01:49:46.660 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-17T01:49:46.660 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T01:49:46.660 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:49:46.660 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:46.661 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-17T01:49:46.661 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:49:46.661 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:46.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:46.661 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T01:49:46.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:46.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-17T01:49:46.755 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-09-17T01:49:46.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:49:46.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:46.757 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-17T01:49:46.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:46.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-17T01:49:46.845 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:46 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3938539863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:49:46.853 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2024-09-17T01:49:46.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:49:46.854 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T01:49:46.855 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:49:46.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T01:49:47.072 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:47 smithi092 ceph-mon[33552]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:47 smithi031 ceph-mon[27673]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:48.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 -- 172.21.15.31:0/1229908425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100ed0 msgr2=0x7fd36c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:48.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 --2- 172.21.15.31:0/1229908425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100ed0 0x7fd36c104ea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd354009910 tx=0x7fd354009c20 comp rx=0 tx=0).stop 2024-09-17T01:49:48.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 -- 172.21.15.31:0/1229908425 shutdown_connections 2024-09-17T01:49:48.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 --2- 172.21.15.31:0/1229908425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100ed0 0x7fd36c104ea0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 --2- 172.21.15.31:0/1229908425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd36c100530 0x7fd36c100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 -- 172.21.15.31:0/1229908425 >> 172.21.15.31:0/1229908425 conn(0x7fd36c0fbe10 msgr2=0x7fd36c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:48.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 -- 172.21.15.31:0/1229908425 shutdown_connections 2024-09-17T01:49:48.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.599+0000 7fd3715fb700 1 -- 172.21.15.31:0/1229908425 wait complete. 2024-09-17T01:49:48.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd3715fb700 1 Processor -- start 2024-09-17T01:49:48.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd3715fb700 1 -- start start 2024-09-17T01:49:48.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd3715fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 0x7fd36c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:48.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd3715fb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd36c100ed0 0x7fd36c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:48.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd3715fb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c196b10 con 0x7fd36c100530 2024-09-17T01:49:48.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd3715fb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c19a8a0 con 0x7fd36c100ed0 2024-09-17T01:49:48.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd36affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 0x7fd36c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd36affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 0x7fd36c195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37196/0 (socket says 172.21.15.31:37196) 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd36affd700 1 -- 172.21.15.31:0/877098956 learned_addr learned my addr 172.21.15.31:0/877098956 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.600+0000 7fd36a7fc700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd36c100ed0 0x7fd36c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd36affd700 1 -- 172.21.15.31:0/877098956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd36c100ed0 msgr2=0x7fd36c196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd36affd700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd36c100ed0 0x7fd36c196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd36affd700 1 -- 172.21.15.31:0/877098956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540095f0 con 0x7fd36c100530 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd36affd700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 0x7fd36c195ef0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0060b0 tx=0x7fd35c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35c00dda0 con 0x7fd36c100530 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd35c00f040 con 0x7fd36c100530 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c19ab80 con 0x7fd36c100530 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35c0146f0 con 0x7fd36c100530 2024-09-17T01:49:48.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.601+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c19b0d0 con 0x7fd36c100530 2024-09-17T01:49:48.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.602+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c1088a0 con 0x7fd36c100530 2024-09-17T01:49:48.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.602+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd35c015400 con 0x7fd36c100530 2024-09-17T01:49:48.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.603+0000 7fd363fff700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd35806c680 0x7fd35806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:48.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.603+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd35c08b150 con 0x7fd36c100530 2024-09-17T01:49:48.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.603+0000 7fd36a7fc700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd35806c680 0x7fd35806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:48.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.603+0000 7fd36a7fc700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd35806c680 0x7fd35806eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd36c197510 tx=0x7fd35401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:48.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.607+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd35c04f720 con 0x7fd36c100530 2024-09-17T01:49:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.853+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd36c19b3a0 con 0x7fd36c100530 2024-09-17T01:49:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.854+0000 7fd363fff700 1 -- 172.21.15.31:0/877098956 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd35c055a10 con 0x7fd36c100530 2024-09-17T01:49:48.852 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T01:49:48.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd35806c680 msgr2=0x7fd35806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:48.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd35806c680 0x7fd35806eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd36c197510 tx=0x7fd35401a040 comp rx=0 tx=0).stop 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 msgr2=0x7fd36c195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 0x7fd36c195ef0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0060b0 tx=0x7fd35c00d3b0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 shutdown_connections 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd35806c680 0x7fd35806eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c100530 0x7fd36c195ef0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 --2- 172.21.15.31:0/877098956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd36c100ed0 0x7fd36c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 >> 172.21.15.31:0/877098956 conn(0x7fd36c0fbe10 msgr2=0x7fd36c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 shutdown_connections 2024-09-17T01:49:48.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:48.856+0000 7fd3715fb700 1 -- 172.21.15.31:0/877098956 wait complete. 2024-09-17T01:49:49.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:48 smithi031 ceph-mon[27673]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:49.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:48 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/877098956' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:49:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:48 smithi092 ceph-mon[33552]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:48 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/877098956' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:49:49.475 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:49:49.476 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:49:49.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:49.476 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T01:49:49.493 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:49:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:49:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T01:49:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:49:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42340sec preferred_lft 42340sec 2024-09-17T01:49:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T01:49:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:49.495 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T01:49:49.495 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:49:49.496 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T01:49:49.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:49.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:49.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:49.701 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:49:49.729 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T01:49:49.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:49.731 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T01:49:49.798 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T01:49:49.799 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:49:49.799 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:49:49.799 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:49:49.799 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:49:49.799 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:49.799 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T01:49:49.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:49:49.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:49:49.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:49:49.800 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T01:49:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:50.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:50.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:50.163 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T01:49:50.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:50.179 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-09-17T01:49:50.236 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:50.236 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T01:49:50.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:49:50.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T01:49:50.236 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T01:49:50.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:50.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:50.357 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T01:49:50.358 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T01:49:50.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:50.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:50.492 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:50.493 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T01:49:50.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T01:49:50.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:49:50.493 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T01:49:50.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:50.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:50.572 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T01:49:50.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:49:50.572 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:50.587 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:49:50.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:49:50.588 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:50.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-09-17T01:49:50.710 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:49:50.767 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-09-17T01:49:50.767 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-09-17T01:49:50.767 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-09-17T01:49:50.767 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-09-17T01:49:50.767 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-09-17T01:49:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-09-17T01:49:50.769 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-09-17T01:49:50.769 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:49:50.769 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:49:50.769 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:49:50.769 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:49:50.769 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-09-17T01:49:50.772 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-09-17T01:49:50.772 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:49:50.772 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/5401e9f9aebd6fab16e866b75cb6bb7ad9265d97d486df753a1fe5a46fafbcc8/merged 2024-09-17T01:49:50.772 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/a47834fee2d34610d1498b5892757188fa2dba04dd406c1540a0592548e96cc6/merged 2024-09-17T01:49:50.772 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/0 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7ab736cad811b99f89309d15222ba3e19a5abc6a26554b42d5c19479a562a304/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/dd4cda608ae00e38290d8a7a523ab6ec0276b1738606c09c458844fa8f5a1f73/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/b04e9d23d72852df3772ce672d9ab55e09aead5736c7459c06e093adbf96f991/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/bfd25123faec536f5d758fe19ca42182c0b59222c581af1df9e44412246341e7/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/fd3625b7eab1b431896cf5e9d18ede4ad50b698d749dc585f6194c8d3449220c/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/219e3b95275ed93d8143e34534ad5b6994c92aabd972b8a4a6ca67074b5dffaa/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/d5b11a58042598ae2f9783bdf8a397a1fa9702191ec7269ccddc264838627f3a/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/3af9ded2b5c955123b8699e79969e1dac9a989057b5811384a58a08d7343b1cd/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/236494bb84637428d2ae5c9d35df253f48fc2dc9663e1ae45fddd95db5051d51/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/298becab2f114c7ff91ae97aeb071f01b1dd41683364cfe79f6200ef930de1f9/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/20de22275368f35204cf2068d609ea404f0deedb7b2f36b4c301f523cc893cd1/merged 2024-09-17T01:49:50.773 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-09-17T01:49:50.774 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:49:50.774 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:49:50.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:50.774 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-09-17T01:49:50.823 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:49:50.823 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T01:49:50.866 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-09-17T01:49:50.892 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:49:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-09-17T01:49:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-09-17T01:49:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-09-17T01:49:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-09-17T01:49:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-09-17T01:49:50.949 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-09-17T01:49:50.950 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/5401e9f9aebd6fab16e866b75cb6bb7ad9265d97d486df753a1fe5a46fafbcc8/merged 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/a47834fee2d34610d1498b5892757188fa2dba04dd406c1540a0592548e96cc6/merged 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/0 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7ab736cad811b99f89309d15222ba3e19a5abc6a26554b42d5c19479a562a304/merged 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/dd4cda608ae00e38290d8a7a523ab6ec0276b1738606c09c458844fa8f5a1f73/merged 2024-09-17T01:49:50.951 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/b04e9d23d72852df3772ce672d9ab55e09aead5736c7459c06e093adbf96f991/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/bfd25123faec536f5d758fe19ca42182c0b59222c581af1df9e44412246341e7/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/fd3625b7eab1b431896cf5e9d18ede4ad50b698d749dc585f6194c8d3449220c/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/219e3b95275ed93d8143e34534ad5b6994c92aabd972b8a4a6ca67074b5dffaa/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/d5b11a58042598ae2f9783bdf8a397a1fa9702191ec7269ccddc264838627f3a/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/3af9ded2b5c955123b8699e79969e1dac9a989057b5811384a58a08d7343b1cd/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/236494bb84637428d2ae5c9d35df253f48fc2dc9663e1ae45fddd95db5051d51/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/298becab2f114c7ff91ae97aeb071f01b1dd41683364cfe79f6200ef930de1f9/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/20de22275368f35204cf2068d609ea404f0deedb7b2f36b4c301f523cc893cd1/merged 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:49:50.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:50.953 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-09-17T01:49:50.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:2024-09-17T01:49:50.990+0000 7f1c0071c480 -1 init, newargv = 0x55cd323b8220 newargc=15 2024-09-17T01:49:50.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[65696]: starting ceph client 2024-09-17T01:49:50.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[65696]: starting fuse 2024-09-17T01:49:51.006 INFO:teuthology.orchestra.run.smithi031.stdout:165 2024-09-17T01:49:51.006 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-17T01:49:51.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:49:51.006 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-09-17T01:49:51.006 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-09-17T01:49:51.006 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-09-17T01:49:51.007 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.0")) 2024-09-17T01:49:51.008 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-17T01:49:51.126 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.0.65696.asok 2024-09-17T01:49:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:51.136 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.65696.asok 2024-09-17T01:49:51.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:51.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.65696.asok status 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "0", 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-09-17T01:49:51.274 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "65696", 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 14510, 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 14510 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-09-17T01:49:51.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 168739930 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 168739930 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.14510 192.168.0.1:0/168739930", 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/168739930", 2024-09-17T01:49:51.276 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-09-17T01:49:51.277 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 15, 2024-09-17T01:49:51.277 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 45, 2024-09-17T01:49:51.277 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:49:51.277 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-09-17T01:49:51.277 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-09-17T01:49:51.277 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:49:51.282 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:49:51.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T01:49:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:51.834 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:51 smithi031 ceph-mon[27673]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:51.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:51 smithi092 ceph-mon[33552]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:53.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.123+0000 7f19b713f700 1 -- 172.21.15.31:0/1002837378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ff3c0 msgr2=0x7f19b00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:53.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.123+0000 7f19b713f700 1 --2- 172.21.15.31:0/1002837378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ff3c0 0x7f19b00ff790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f19a000b0a0 tx=0x7f19a000b3b0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.123+0000 7f19b713f700 1 -- 172.21.15.31:0/1002837378 shutdown_connections 2024-09-17T01:49:53.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.123+0000 7f19b713f700 1 --2- 172.21.15.31:0/1002837378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b00ffd60 0x7f19b0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.123+0000 7f19b713f700 1 --2- 172.21.15.31:0/1002837378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ff3c0 0x7f19b00ff790 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.123+0000 7f19b713f700 1 -- 172.21.15.31:0/1002837378 >> 172.21.15.31:0/1002837378 conn(0x7f19b00fac80 msgr2=0x7f19b00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 -- 172.21.15.31:0/1002837378 shutdown_connections 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 -- 172.21.15.31:0/1002837378 wait complete. 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 Processor -- start 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 -- start start 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b00ff3c0 0x7f19b0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 0x7f19b0197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01977c0 con 0x7f19b00ffd60 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.124+0000 7f19b713f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0197900 con 0x7f19b00ff3c0 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 0x7f19b0197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:53.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 0x7f19b0197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37210/0 (socket says 172.21.15.31:37210) 2024-09-17T01:49:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 -- 172.21.15.31:0/2914794598 learned_addr learned my addr 172.21.15.31:0/2914794598 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:49:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19b4edb700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b00ff3c0 0x7f19b0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 -- 172.21.15.31:0/2914794598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b00ff3c0 msgr2=0x7f19b0196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b00ff3c0 0x7f19b0196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 -- 172.21.15.31:0/2914794598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009d00 con 0x7f19b00ffd60 2024-09-17T01:49:53.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19affff700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 0x7f19b0197230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f199800c960 tx=0x7f199800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1998007a70 con 0x7f19b00ffd60 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1998007bd0 con 0x7f19b00ffd60 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1998018630 con 0x7f19b00ffd60 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.125+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b019fd60 con 0x7f19b00ffd60 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.126+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b01a01d0 con 0x7f19b00ffd60 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.126+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b01076d0 con 0x7f19b00ffd60 2024-09-17T01:49:53.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.127+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f199800fa90 con 0x7f19b00ffd60 2024-09-17T01:49:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.127+0000 7f19adffb700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f199c06c680 0x7f199c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.128+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f199808b7e0 con 0x7f19b00ffd60 2024-09-17T01:49:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.128+0000 7f19b4edb700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f199c06c680 0x7f199c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:53.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.128+0000 7f19b4edb700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f199c06c680 0x7f199c06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19a000b830 tx=0x7f19a00097c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:53.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.132+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1998059a00 con 0x7f19b00ffd60 2024-09-17T01:49:53.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.390+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19b004f2a0 con 0x7f19b00ffd60 2024-09-17T01:49:53.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.390+0000 7f19adffb700 1 -- 172.21.15.31:0/2914794598 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1998059590 con 0x7f19b00ffd60 2024-09-17T01:49:53.389 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f199c06c680 msgr2=0x7f199c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f199c06c680 0x7f199c06eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19a000b830 tx=0x7f19a00097c0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 msgr2=0x7f19b0197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 0x7f19b0197230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f199800c960 tx=0x7f199800cd20 comp rx=0 tx=0).stop 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 shutdown_connections 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f199c06c680 0x7f199c06eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19b00ff3c0 0x7f19b0196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 --2- 172.21.15.31:0/2914794598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b00ffd60 0x7f19b0197230 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 >> 172.21.15.31:0/2914794598 conn(0x7f19b00fac80 msgr2=0x7f19b00fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 shutdown_connections 2024-09-17T01:49:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:49:53.392+0000 7f19b713f700 1 -- 172.21.15.31:0/2914794598 wait complete. 2024-09-17T01:49:53.684 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:53 smithi031 ceph-mon[27673]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:49:53.684 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:53 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2914794598' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:49:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:53 smithi092 ceph-mon[33552]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:49:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:53 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2914794598' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:49:53.999 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:49:53.999 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:49:54.000 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:49:54.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:54.000 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:54.020 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42338sec preferred_lft 42338sec 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-17T01:49:54.021 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:54.022 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:49:54.022 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-17T01:49:54.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:54.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:54.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:54.259 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:49:54.285 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-17T01:49:54.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:54.286 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-17T01:49:54.359 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-17T01:49:54.359 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:49:54.359 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:49:54.359 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:49:54.359 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:49:54.360 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:54.360 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-17T01:49:54.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:49:54.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:49:54.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:49:54.360 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-17T01:49:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:54.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:54.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:54.654 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-17T01:49:54.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:54.669 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-17T01:49:54.722 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:54.725 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:54.725 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-17T01:49:54.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:49:54.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T01:49:54.725 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-17T01:49:54.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:54.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:54.844 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T01:49:54.844 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:54.844 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-17T01:49:54.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T01:49:54.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:49:54.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T01:49:54.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T01:49:54.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T01:49:54.845 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-17T01:49:54.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:54.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:54.983 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:54.983 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-17T01:49:54.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-17T01:49:54.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:49:54.984 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-17T01:49:55.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:49:55.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:55.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:55.062 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T01:49:55.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:49:55.063 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:55.077 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:49:55.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:49:55.078 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:55.134 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-17T01:49:55.200 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:49:55.255 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-17T01:49:55.256 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-17T01:49:55.257 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/003710decc41d538e3fb8e73e4cb031735d854bc7599e676f9b3d42fa6ab732c/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c76173324b25ea86216d47d17915d54bb220f388969a7f74279b55aabe38c63f/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/cf97eff8f7431fe26dd4a391dd3ad3ab4b277c00debc0b41a1232b667b27a83b/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/900cb46a53ba7cfed68581049c080327b50c77792d67b4cc24f2ba0fd0bbe8f0/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4a269dfa4ab6d9911e11ba2f505ca030eaca8168adcb8eae4862b34a0b5a0d93/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/bd7f7dbf280cb9277ed106f8294e3884f35fab31d7f74284bbceb51d7e04444b/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/d04ca982292147bcf29c8f66d7f1b81cb110cb509b4330dda881652a3e8ff648/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/0e16e720e3b34f6fddc1c362977b1172d588961d543c738b0a9b6ba0d7865fb1/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/f28637f6baf087424cb3cb83e6d3aafe7c25aeade696a2e41d8977c5606ba9d4/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c2b9e5241e8d1653c2ead86ce1e65befc992f01587366216e1c2ae18af7e8759/merged 2024-09-17T01:49:55.258 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-17T01:49:55.259 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:49:55.259 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:49:55.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.260 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-17T01:49:55.319 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:49:55.320 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T01:49:55.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-09-17T01:49:55.386 DEBUG:teuthology.orchestra.run.smithi092:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:49:55.442 INFO:teuthology.orchestra.run.smithi092.stdout:/proc 2024-09-17T01:49:55.442 INFO:teuthology.orchestra.run.smithi092.stdout:/sys 2024-09-17T01:49:55.442 INFO:teuthology.orchestra.run.smithi092.stdout:/dev 2024-09-17T01:49:55.442 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/security 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/shm 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/pts 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/run 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/cgroup 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/pstore 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/bpf 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/ 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/selinux 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/mqueue 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/dev/hugepages 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/debug 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/tracing 2024-09-17T01:49:55.443 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/fs/fuse/connections 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/sys/kernel/config 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/1000 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/ceph 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/run/user/0 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/003710decc41d538e3fb8e73e4cb031735d854bc7599e676f9b3d42fa6ab732c/merged 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c76173324b25ea86216d47d17915d54bb220f388969a7f74279b55aabe38c63f/merged 2024-09-17T01:49:55.444 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/cf97eff8f7431fe26dd4a391dd3ad3ab4b277c00debc0b41a1232b667b27a83b/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/900cb46a53ba7cfed68581049c080327b50c77792d67b4cc24f2ba0fd0bbe8f0/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/4a269dfa4ab6d9911e11ba2f505ca030eaca8168adcb8eae4862b34a0b5a0d93/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/bd7f7dbf280cb9277ed106f8294e3884f35fab31d7f74284bbceb51d7e04444b/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/d04ca982292147bcf29c8f66d7f1b81cb110cb509b4330dda881652a3e8ff648/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/0e16e720e3b34f6fddc1c362977b1172d588961d543c738b0a9b6ba0d7865fb1/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/f28637f6baf087424cb3cb83e6d3aafe7c25aeade696a2e41d8977c5606ba9d4/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/var/lib/containers/storage/overlay/c2b9e5241e8d1653c2ead86ce1e65befc992f01587366216e1c2ae18af7e8759/merged 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:49:55.445 INFO:teuthology.orchestra.run.smithi092.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:49:55.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.446 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-09-17T01:49:55.480 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:2024-09-17T01:49:55.483+0000 7f3a9922e480 -1 init, newargv = 0x560fb1836530 newargc=15 2024-09-17T01:49:55.480 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[53297]: starting ceph client 2024-09-17T01:49:55.487 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[53297]: starting fuse 2024-09-17T01:49:55.500 INFO:teuthology.orchestra.run.smithi092.stdout:129 2024-09-17T01:49:55.500 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-17T01:49:55.500 DEBUG:teuthology.orchestra.run.smithi092:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:49:55.500 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-09-17T01:49:55.500 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-09-17T01:49:55.500 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-09-17T01:49:55.500 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-09-17T01:49:55.500 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:49:55.501 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.1")) 2024-09-17T01:49:55.502 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-09-17T01:49:55.618 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.1.53297.asok 2024-09-17T01:49:55.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-17T01:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:55.628 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.53297.asok 2024-09-17T01:49:55.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.53297.asok status 2024-09-17T01:49:55.689 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:55 smithi092 ceph-mon[33552]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "1", 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "53297", 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2024-09-17T01:49:55.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24309, 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 24309 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 4037238033 2024-09-17T01:49:55.764 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 4037238033 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.24309 192.168.0.1:0/4037238033", 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/4037238033", 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2024-09-17T01:49:55.765 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 15, 2024-09-17T01:49:55.766 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 45, 2024-09-17T01:49:55.766 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:49:55.766 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-09-17T01:49:55.766 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-09-17T01:49:55.766 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-17T01:49:55.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.771 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-09-17T01:49:55.771 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:55.793 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-09-17T01:49:55.793 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:55.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:55.861 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:55 smithi031 ceph-mon[27673]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:49:55.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.869 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-09-17T01:49:55.869 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:55.885 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-09-17T01:49:55.885 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:55.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:55.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:57 smithi031 ceph-mon[27673]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T01:49:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:57 smithi092 ceph-mon[33552]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T01:49:58.700 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:49:58.713 INFO:teuthology.task.print:**** done client 2024-09-17T01:49:58.713 INFO:teuthology.run_tasks:Running task parallel... 2024-09-17T01:49:58.729 INFO:teuthology.task.parallel:starting parallel... 2024-09-17T01:49:58.729 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:49:58.730 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:49:58.730 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:49:58.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-17T01:49:58.731 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:49:58.731 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-17T01:49:58.736 INFO:tasks.workunit:Pulling workunits from ref e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:49:58.736 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T01:49:58.736 INFO:tasks.workunit:timeout=3h 2024-09-17T01:49:58.736 INFO:tasks.workunit:cleanup=True 2024-09-17T01:49:58.737 DEBUG:teuthology.orchestra.run.smithi031:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:49:58.759 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 01:49:18.966711038 +0000 2024-09-17T01:49:58.760 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 01:49:55.869044418 +0000 2024-09-17T01:49:58.760 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-09-17T01:49:58.760 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:58.760 DEBUG:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T01:49:58.833 DEBUG:teuthology.orchestra.run.smithi092:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:58.855 INFO:teuthology.orchestra.run.smithi092.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:58.855 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:49:58.855 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-17T01:49:58.855 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:49:58.855 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T01:49:58.855 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:49:58.856 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-17 01:49:58.829716213 +0000 2024-09-17T01:49:58.856 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-17 01:49:58.829716213 +0000 2024-09-17T01:49:58.856 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2024-09-17T01:49:58.856 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-17T01:49:58.856 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-17T01:49:58.932 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:49:58.933 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:49:58.950 INFO:tasks.workunit.client.0.smithi031.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T01:49:58.962 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:49:58.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:49:58 smithi092 ceph-mon[33552]: pgmap v200: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:49:58.992 INFO:tasks.workunit.client.1.smithi092.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-17T01:49:59.083 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:49:58 smithi031 ceph-mon[27673]: pgmap v200: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:50:00.329 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:00 smithi031 ceph-mon[27673]: overall HEALTH_OK 2024-09-17T01:50:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:00 smithi092 ceph-mon[33552]: overall HEALTH_OK 2024-09-17T01:50:00.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 -- 172.21.15.31:0/4092953612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 msgr2=0x7fa580100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 --2- 172.21.15.31:0/4092953612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580100650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009910 tx=0x7fa57c009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 -- 172.21.15.31:0/4092953612 shutdown_connections 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 --2- 172.21.15.31:0/4092953612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 0x7fa580101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 --2- 172.21.15.31:0/4092953612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580100650 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 -- 172.21.15.31:0/4092953612 >> 172.21.15.31:0/4092953612 conn(0x7fa5800fb7f0 msgr2=0x7fa5800fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 -- 172.21.15.31:0/4092953612 shutdown_connections 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.660+0000 7fa58772b700 1 -- 172.21.15.31:0/4092953612 wait complete. 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa58772b700 1 Processor -- start 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa58772b700 1 -- start start 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa58772b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa58772b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 0x7fa580196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:00.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa58772b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580196630 con 0x7fa580100240 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa58772b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580196770 con 0x7fa580101440 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59440/0 (socket says 172.21.15.31:59440) 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 -- 172.21.15.31:0/3130535206 learned_addr learned my addr 172.21.15.31:0/3130535206 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa584cc6700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 0x7fa580196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 -- 172.21.15.31:0/3130535206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 msgr2=0x7fa580196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 0x7fa580196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 -- 172.21.15.31:0/3130535206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0095f0 con 0x7fa580100240 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa584cc6700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 0x7fa580196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.661+0000 7fa5854c7700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580195ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00bda0 tx=0x7fa57c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.662+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57c01d070 con 0x7fa580100240 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.662+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58019b1c0 con 0x7fa580100240 2024-09-17T01:50:00.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.662+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa57c004c50 con 0x7fa580100240 2024-09-17T01:50:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.662+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57c00f690 con 0x7fa580100240 2024-09-17T01:50:00.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.662+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58019b6b0 con 0x7fa580100240 2024-09-17T01:50:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.663+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa580108d90 con 0x7fa580100240 2024-09-17T01:50:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.663+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa57c0229b0 con 0x7fa580100240 2024-09-17T01:50:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.664+0000 7fa5767fc700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa56c06c680 0x7fa56c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.664+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa57c08ce50 con 0x7fa580100240 2024-09-17T01:50:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.664+0000 7fa584cc6700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa56c06c680 0x7fa56c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:00.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.664+0000 7fa584cc6700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa56c06c680 0x7fa56c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa570005950 tx=0x7fa570005f50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:00.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.668+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa57c05b120 con 0x7fa580100240 2024-09-17T01:50:00.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.869+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fa58019bdb0 con 0x7fa580100240 2024-09-17T01:50:00.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.874+0000 7fa5767fc700 1 -- 172.21.15.31:0/3130535206 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v22)=0 v22) v1 ==== 126+0+0 (secure 0 0 0) 0x7fa58019bdb0 con 0x7fa580100240 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa56c06c680 msgr2=0x7fa56c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa56c06c680 0x7fa56c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa570005950 tx=0x7fa570005f50 comp rx=0 tx=0).stop 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 msgr2=0x7fa580195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580195ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00bda0 tx=0x7fa57c00be80 comp rx=0 tx=0).stop 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 shutdown_connections 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fa56c06c680 0x7fa56c06eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580100240 0x7fa580195ad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 --2- 172.21.15.31:0/3130535206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580101440 0x7fa580196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 >> 172.21.15.31:0/3130535206 conn(0x7fa5800fb7f0 msgr2=0x7fa580104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 shutdown_connections 2024-09-17T01:50:00.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:00.876+0000 7fa58772b700 1 -- 172.21.15.31:0/3130535206 wait complete. 2024-09-17T01:50:01.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:01 smithi031 ceph-mon[27673]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T01:50:01.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:01 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3130535206' entity='client.admin' 2024-09-17T01:50:01.252 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:01 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:50:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:01 smithi092 ceph-mon[33552]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T01:50:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:01 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3130535206' entity='client.admin' 2024-09-17T01:50:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:01 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:50:01.642 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:50:01.643 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:50:01.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T01:50:01.899 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:50:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:50:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:50:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:02 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:50:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:50:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:02 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:03.275 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:03 smithi031 ceph-mon[27673]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T01:50:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:03 smithi092 ceph-mon[33552]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 -- 172.21.15.31:0/1324037938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8100240 msgr2=0x7f0af8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 --2- 172.21.15.31:0/1324037938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8100240 0x7f0af8100650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009910 tx=0x7f0aec009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 -- 172.21.15.31:0/1324037938 shutdown_connections 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 --2- 172.21.15.31:0/1324037938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0af8101440 0x7f0af8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 --2- 172.21.15.31:0/1324037938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8100240 0x7f0af8100650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 -- 172.21.15.31:0/1324037938 >> 172.21.15.31:0/1324037938 conn(0x7f0af80fb7f0 msgr2=0x7f0af80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 -- 172.21.15.31:0/1324037938 shutdown_connections 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 -- 172.21.15.31:0/1324037938 wait complete. 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 Processor -- start 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.607+0000 7f0afee31700 1 -- start start 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0afee31700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0af8100240 0x7f0af8195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0afee31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 0x7f0af8196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0afee31700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8196630 con 0x7f0af8101440 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0afee31700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8196770 con 0x7f0af8100240 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 0x7f0af8196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 0x7f0af8196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54628/0 (socket says 172.21.15.31:54628) 2024-09-17T01:50:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 -- 172.21.15.31:0/397035814 learned_addr learned my addr 172.21.15.31:0/397035814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0afcbcd700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0af8100240 0x7f0af8195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 -- 172.21.15.31:0/397035814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0af8100240 msgr2=0x7f0af8195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0af8100240 0x7f0af8195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 -- 172.21.15.31:0/397035814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0095f0 con 0x7f0af8101440 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af7fff700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 0x7f0af8196010 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400d8d0 tx=0x7f0ae400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.608+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae40098a0 con 0x7f0af8101440 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.609+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ae4010460 con 0x7f0af8101440 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.609+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af819b220 con 0x7f0af8101440 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.609+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae400f5f0 con 0x7f0af8101440 2024-09-17T01:50:03.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.609+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af819b770 con 0x7f0af8101440 2024-09-17T01:50:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.610+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af8108d90 con 0x7f0af8101440 2024-09-17T01:50:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.610+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0ae4009a00 con 0x7f0af8101440 2024-09-17T01:50:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.611+0000 7f0af5ffb700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0ae806c680 0x7f0ae806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.611+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0ae408b730 con 0x7f0af8101440 2024-09-17T01:50:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.611+0000 7f0afcbcd700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0ae806c680 0x7f0ae806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.611+0000 7f0afcbcd700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0ae806c680 0x7f0ae806eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0aec006010 tx=0x7f0aec00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.615+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0ae40598d0 con 0x7f0af8101440 2024-09-17T01:50:03.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.814+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0af8108f50 con 0x7f0af8101440 2024-09-17T01:50:03.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.814+0000 7f0af5ffb700 1 -- 172.21.15.31:0/397035814 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v22)=0 v22) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0ae4059460 con 0x7f0af8101440 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.816+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0ae806c680 msgr2=0x7f0ae806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.816+0000 7f0afee31700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0ae806c680 0x7f0ae806eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0aec006010 tx=0x7f0aec00b540 comp rx=0 tx=0).stop 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.816+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 msgr2=0x7f0af8196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.816+0000 7f0afee31700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 0x7f0af8196010 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400d8d0 tx=0x7f0ae400dbe0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.816+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 shutdown_connections 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.817+0000 7f0afee31700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0ae806c680 0x7f0ae806eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.817+0000 7f0afee31700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0af8100240 0x7f0af8195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.817+0000 7f0afee31700 1 --2- 172.21.15.31:0/397035814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0af8101440 0x7f0af8196010 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:03.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.817+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 >> 172.21.15.31:0/397035814 conn(0x7f0af80fb7f0 msgr2=0x7f0af8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:03.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.817+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 shutdown_connections 2024-09-17T01:50:03.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:03.817+0000 7f0afee31700 1 -- 172.21.15.31:0/397035814 wait complete. 2024-09-17T01:50:04.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T01:50:04.731 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:50:05.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:05 smithi031 ceph-mon[27673]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-17T01:50:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:05 smithi092 ceph-mon[33552]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-17T01:50:06.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 -- 172.21.15.31:0/3849579817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 msgr2=0x7fc8740ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 --2- 172.21.15.31:0/3849579817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc8740ff450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc870009910 tx=0x7fc870009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 -- 172.21.15.31:0/3849579817 shutdown_connections 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 --2- 172.21.15.31:0/3849579817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 0x7fc874100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 --2- 172.21.15.31:0/3849579817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc8740ff450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 -- 172.21.15.31:0/3849579817 >> 172.21.15.31:0/3849579817 conn(0x7fc8740fa610 msgr2=0x7fc8740fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 -- 172.21.15.31:0/3849579817 shutdown_connections 2024-09-17T01:50:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 -- 172.21.15.31:0/3849579817 wait complete. 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.296+0000 7fc87b78f700 1 Processor -- start 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87b78f700 1 -- start start 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87b78f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc874194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87b78f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 0x7fc874194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87b78f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874195370 con 0x7fc8740ff040 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87b78f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8741954b0 con 0x7fc874100240 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87952b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc874194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87952b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc874194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54640/0 (socket says 172.21.15.31:54640) 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87952b700 1 -- 172.21.15.31:0/1825569188 learned_addr learned my addr 172.21.15.31:0/1825569188 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:06.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc878d2a700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 0x7fc874194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87952b700 1 -- 172.21.15.31:0/1825569188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 msgr2=0x7fc874194d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87952b700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 0x7fc874194d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc87952b700 1 -- 172.21.15.31:0/1825569188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700095f0 con 0x7fc8740ff040 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.297+0000 7fc878d2a700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 0x7fc874194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.298+0000 7fc87952b700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc874194810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc87000bda0 tx=0x7fc87000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.298+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc87001d070 con 0x7fc8740ff040 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.298+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc87000f460 con 0x7fc8740ff040 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.298+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc874068dd0 con 0x7fc8740ff040 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.298+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc870021640 con 0x7fc8740ff040 2024-09-17T01:50:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.298+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc874069320 con 0x7fc8740ff040 2024-09-17T01:50:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.299+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc874107b90 con 0x7fc8740ff040 2024-09-17T01:50:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.300+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc87000fa00 con 0x7fc8740ff040 2024-09-17T01:50:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.300+0000 7fc86a7fc700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc86006c680 0x7fc86006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.300+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc87008ca70 con 0x7fc8740ff040 2024-09-17T01:50:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.300+0000 7fc878d2a700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc86006c680 0x7fc86006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.301+0000 7fc878d2a700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc86006c680 0x7fc86006eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc864005950 tx=0x7fc8640058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.305+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc87005ac90 con 0x7fc8740ff040 2024-09-17T01:50:06.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.504+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc874107d80 con 0x7fc8740ff040 2024-09-17T01:50:06.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.505+0000 7fc86a7fc700 1 -- 172.21.15.31:0/1825569188 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v22)=0 v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc87005a820 con 0x7fc8740ff040 2024-09-17T01:50:06.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc86006c680 msgr2=0x7fc86006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc86006c680 0x7fc86006eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc864005950 tx=0x7fc8640058e0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 msgr2=0x7fc874194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc874194810 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc87000bda0 tx=0x7fc87000be80 comp rx=0 tx=0).stop 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 shutdown_connections 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fc86006c680 0x7fc86006eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8740ff040 0x7fc874194810 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 --2- 172.21.15.31:0/1825569188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc874100240 0x7fc874194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 >> 172.21.15.31:0/1825569188 conn(0x7fc8740fa610 msgr2=0x7fc874103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 shutdown_connections 2024-09-17T01:50:06.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:06.507+0000 7fc87b78f700 1 -- 172.21.15.31:0/1825569188 wait complete. 2024-09-17T01:50:07.213 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T01:50:07.432 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:50:07.789 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:07 smithi031 ceph-mon[27673]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-17T01:50:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:07 smithi092 ceph-mon[33552]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-17T01:50:09.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 -- 172.21.15.31:0/4244198348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 msgr2=0x7f61d41030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:09.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/4244198348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d41030c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009910 tx=0x7f61c4009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:09.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 -- 172.21.15.31:0/4244198348 shutdown_connections 2024-09-17T01:50:09.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/4244198348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d4103600 0x7f61d41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/4244198348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d41030c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 -- 172.21.15.31:0/4244198348 >> 172.21.15.31:0/4244198348 conn(0x7f61d40fa700 msgr2=0x7f61d40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 -- 172.21.15.31:0/4244198348 shutdown_connections 2024-09-17T01:50:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.155+0000 7f61d9f4d700 1 -- 172.21.15.31:0/4244198348 wait complete. 2024-09-17T01:50:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d9f4d700 1 Processor -- start 2024-09-17T01:50:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d9f4d700 1 -- start start 2024-09-17T01:50:09.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d9f4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d4100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:09.156 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:08 smithi031 ceph-mon[27673]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T01:50:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d9f4d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d4103600 0x7f61d40fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d9f4d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40ff1d0 con 0x7f61d4100ce0 2024-09-17T01:50:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d9f4d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40ff310 con 0x7f61d4103600 2024-09-17T01:50:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d4100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d4100640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54656/0 (socket says 172.21.15.31:54656) 2024-09-17T01:50:09.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d37fe700 1 -- 172.21.15.31:0/1355308083 learned_addr learned my addr 172.21.15.31:0/1355308083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.156+0000 7f61d2ffd700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d4103600 0x7f61d40fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d37fe700 1 -- 172.21.15.31:0/1355308083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d4103600 msgr2=0x7f61d40fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d37fe700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d4103600 0x7f61d40fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d37fe700 1 -- 172.21.15.31:0/1355308083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40095f0 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d37fe700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d4100640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61c400bd70 tx=0x7f61c400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61c401d070 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f61c4005940 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d40ff590 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61c4021430 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.157+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d40ffa80 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.158+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d418fc70 con 0x7f61d4100ce0 2024-09-17T01:50:09.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.159+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f61c400f860 con 0x7f61d4100ce0 2024-09-17T01:50:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.159+0000 7f61d0ff9700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f61bc06c680 0x7f61bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.159+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f61c408ca70 con 0x7f61d4100ce0 2024-09-17T01:50:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.159+0000 7f61d2ffd700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f61bc06c680 0x7f61bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:09.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.160+0000 7f61d2ffd700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f61bc06c680 0x7f61bc06eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61c8005950 tx=0x7f61c800a300 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:09.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.164+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f61c405ac90 con 0x7f61d4100ce0 2024-09-17T01:50:09.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:08 smithi092 ceph-mon[33552]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T01:50:09.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.362+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f61d402cc30 con 0x7f61d4100ce0 2024-09-17T01:50:09.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.362+0000 7f61d0ff9700 1 -- 172.21.15.31:0/1355308083 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f61c405a820 con 0x7f61d4100ce0 2024-09-17T01:50:09.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f61bc06c680 msgr2=0x7f61bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f61bc06c680 0x7f61bc06eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61c8005950 tx=0x7f61c800a300 comp rx=0 tx=0).stop 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 msgr2=0x7f61d4100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d4100640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61c400bd70 tx=0x7f61c400bda0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 shutdown_connections 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f61bc06c680 0x7f61bc06eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61d4100ce0 0x7f61d4100640 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 --2- 172.21.15.31:0/1355308083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d4103600 0x7f61d40fec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 >> 172.21.15.31:0/1355308083 conn(0x7f61d40fa700 msgr2=0x7f61d40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 shutdown_connections 2024-09-17T01:50:09.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:09.364+0000 7f61d9f4d700 1 -- 172.21.15.31:0/1355308083 wait complete. 2024-09-17T01:50:09.962 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T01:50:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:50:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:10 smithi092 ceph-mon[33552]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T01:50:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:10 smithi031 ceph-mon[27673]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T01:50:11.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 -- 172.21.15.31:0/2251583721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10401010a0 msgr2=0x7f10400ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:11.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 --2- 172.21.15.31:0/2251583721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10401010a0 0x7f10400ff4b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1030009910 tx=0x7f1030009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:11.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 -- 172.21.15.31:0/2251583721 shutdown_connections 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 --2- 172.21.15.31:0/2251583721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10401010a0 0x7f10400ff4b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 --2- 172.21.15.31:0/2251583721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1040100750 0x7f1040100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 -- 172.21.15.31:0/2251583721 >> 172.21.15.31:0/2251583721 conn(0x7f10400f9f10 msgr2=0x7f10400fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 -- 172.21.15.31:0/2251583721 shutdown_connections 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.813+0000 7f1047dcd700 1 -- 172.21.15.31:0/2251583721 wait complete. 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1047dcd700 1 Processor -- start 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1047dcd700 1 -- start start 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1047dcd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 0x7f10401031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1047dcd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10401010a0 0x7f1040101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1047dcd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040101d80 con 0x7f1040100750 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1047dcd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040101ec0 con 0x7f10401010a0 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 0x7f10401031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:11.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 0x7f10401031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54666/0 (socket says 172.21.15.31:54666) 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 -- 172.21.15.31:0/3529686286 learned_addr learned my addr 172.21.15.31:0/3529686286 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 -- 172.21.15.31:0/3529686286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10401010a0 msgr2=0x7f1040101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10401010a0 0x7f1040101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 -- 172.21.15.31:0/3529686286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300095f0 con 0x7f1040100750 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.814+0000 7f1045b69700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 0x7f10401031f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b9c0 tx=0x7f103c00bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.815+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c00c980 con 0x7f1040100750 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.815+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10401021a0 con 0x7f1040100750 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.815+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f103c014440 con 0x7f1040100750 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.815+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c012550 con 0x7f1040100750 2024-09-17T01:50:11.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.815+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104019dba0 con 0x7f1040100750 2024-09-17T01:50:11.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.816+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104018fb90 con 0x7f1040100750 2024-09-17T01:50:11.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.816+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f103c0145b0 con 0x7f1040100750 2024-09-17T01:50:11.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.817+0000 7f1036ffd700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f102c06c680 0x7f102c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:11.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.817+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f103c006e40 con 0x7f1040100750 2024-09-17T01:50:11.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.817+0000 7f1045368700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f102c06c680 0x7f102c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:11.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.817+0000 7f1045368700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f102c06c680 0x7f102c06eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f103000b5c0 tx=0x7f1030005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:11.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:11.821+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f103c04e720 con 0x7f1040100750 2024-09-17T01:50:12.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.041+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}) v1 -- 0x7f1040061230 con 0x7f102c06c680 2024-09-17T01:50:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.047+0000 7f1036ffd700 1 -- 172.21.15.31:0/3529686286 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f1040061230 con 0x7f102c06c680 2024-09-17T01:50:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:50:12.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f102c06c680 msgr2=0x7f102c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f102c06c680 0x7f102c06eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f103000b5c0 tx=0x7f1030005fd0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 msgr2=0x7f10401031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 0x7f10401031f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b9c0 tx=0x7f103c00bd80 comp rx=0 tx=0).stop 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 shutdown_connections 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f102c06c680 0x7f102c06eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1040100750 0x7f10401031f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 --2- 172.21.15.31:0/3529686286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10401010a0 0x7f1040101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 >> 172.21.15.31:0/3529686286 conn(0x7f10400f9f10 msgr2=0x7f10400fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 shutdown_connections 2024-09-17T01:50:12.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:12.049+0000 7f1047dcd700 1 -- 172.21.15.31:0/3529686286 wait complete. 2024-09-17T01:50:12.838 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:50:12.838 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T01:50:12.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T01:50:13.062 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T01:50:13.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:13.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:50:13.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:13.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:50:13.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:50:13.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:50:13.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:13.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:50:13.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:13 smithi031 ceph-mon[27673]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-17T01:50:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:50:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:50:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:50:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:50:13.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:13.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:50:13.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:13 smithi092 ceph-mon[33552]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 -- 172.21.15.31:0/1999545989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 msgr2=0x7f70bc105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 --2- 172.21.15.31:0/1999545989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc105a60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009910 tx=0x7f70b0009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 -- 172.21.15.31:0/1999545989 shutdown_connections 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 --2- 172.21.15.31:0/1999545989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc105a60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 --2- 172.21.15.31:0/1999545989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc100d60 0x7f70bc103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 -- 172.21.15.31:0/1999545989 >> 172.21.15.31:0/1999545989 conn(0x7f70bc0fa780 msgr2=0x7f70bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 -- 172.21.15.31:0/1999545989 shutdown_connections 2024-09-17T01:50:14.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.846+0000 7f70c17d7700 1 -- 172.21.15.31:0/1999545989 wait complete. 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70c17d7700 1 Processor -- start 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70c17d7700 1 -- start start 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70c17d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc100d60 0x7f70bc195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70c17d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70c17d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc196640 con 0x7f70bc103680 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70c17d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc196780 con 0x7f70bc100d60 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70ba7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35818/0 (socket says 172.21.15.31:35818) 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70ba7fc700 1 -- 172.21.15.31:0/2041124850 learned_addr learned my addr 172.21.15.31:0/2041124850 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.847+0000 7f70baffd700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc100d60 0x7f70bc195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70ba7fc700 1 -- 172.21.15.31:0/2041124850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc100d60 msgr2=0x7f70bc195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70ba7fc700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc100d60 0x7f70bc195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:14.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70ba7fc700 1 -- 172.21.15.31:0/2041124850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00095f0 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70ba7fc700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc196020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70b0006010 tx=0x7f70b000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b001d070 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc19b1d0 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f70b0005dc0 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc19b6c0 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.848+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b0021410 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.849+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70bc18fbe0 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.850+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f70b000f460 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.850+0000 7f70a3fff700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f70a406c680 0x7f70a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.850+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f70b008cac0 con 0x7f70bc103680 2024-09-17T01:50:14.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.850+0000 7f70baffd700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f70a406c680 0x7f70a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:14.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.851+0000 7f70baffd700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f70a406c680 0x7f70a406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f70ac005950 tx=0x7f70ac00b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:14.855+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f70b005ace0 con 0x7f70bc103680 2024-09-17T01:50:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.124+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70bc061190 con 0x7f70a406c680 2024-09-17T01:50:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.125+0000 7f70a3fff700 1 -- 172.21.15.31:0/2041124850 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f70bc061190 con 0x7f70a406c680 2024-09-17T01:50:15.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.127+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f70a406c680 msgr2=0x7f70a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.127+0000 7f70c17d7700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f70a406c680 0x7f70a406eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f70ac005950 tx=0x7f70ac00b410 comp rx=0 tx=0).stop 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 msgr2=0x7f70bc196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc196020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f70b0006010 tx=0x7f70b000bd70 comp rx=0 tx=0).stop 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 shutdown_connections 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f70a406c680 0x7f70a406eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc100d60 0x7f70bc195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 --2- 172.21.15.31:0/2041124850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70bc103680 0x7f70bc196020 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 >> 172.21.15.31:0/2041124850 conn(0x7f70bc0fa780 msgr2=0x7f70bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 shutdown_connections 2024-09-17T01:50:15.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.128+0000 7f70c17d7700 1 -- 172.21.15.31:0/2041124850 wait complete. 2024-09-17T01:50:15.139 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 -- 172.21.15.31:0/899586775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 msgr2=0x7efd94101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/899586775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94101c90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efd88009910 tx=0x7efd88009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 -- 172.21.15.31:0/899586775 shutdown_connections 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/899586775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd941021d0 0x7efd940fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/899586775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94101c90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 -- 172.21.15.31:0/899586775 >> 172.21.15.31:0/899586775 conn(0x7efd940f9f10 msgr2=0x7efd940fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 -- 172.21.15.31:0/899586775 shutdown_connections 2024-09-17T01:50:15.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.259+0000 7efd9b1fd700 1 -- 172.21.15.31:0/899586775 wait complete. 2024-09-17T01:50:15.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd9b1fd700 1 Processor -- start 2024-09-17T01:50:15.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd9b1fd700 1 -- start start 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd9b1fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd9b1fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd941021d0 0x7efd940ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd9b1fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940ffb10 con 0x7efd94101880 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd9b1fd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940ffc50 con 0x7efd941021d0 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd98f99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd98f99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35838/0 (socket says 172.21.15.31:35838) 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd98f99700 1 -- 172.21.15.31:0/2455425669 learned_addr learned my addr 172.21.15.31:0/2455425669 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:15.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd93fff700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd941021d0 0x7efd940ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd98f99700 1 -- 172.21.15.31:0/2455425669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd941021d0 msgr2=0x7efd940ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd98f99700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd941021d0 0x7efd940ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.260+0000 7efd98f99700 1 -- 172.21.15.31:0/2455425669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880095f0 con 0x7efd94101880 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.261+0000 7efd98f99700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94100f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd88000c00 tx=0x7efd8800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.261+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8801d070 con 0x7efd94101880 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.261+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd88005dc0 con 0x7efd94101880 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.261+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd880226a0 con 0x7efd94101880 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.261+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd940ffed0 con 0x7efd94101880 2024-09-17T01:50:15.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.261+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941003c0 con 0x7efd94101880 2024-09-17T01:50:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.263+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd94108d40 con 0x7efd94101880 2024-09-17T01:50:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.263+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efd880038f0 con 0x7efd94101880 2024-09-17T01:50:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.264+0000 7efd91ffb700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7efd8406c680 0x7efd8406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.264+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efd8808cb70 con 0x7efd94101880 2024-09-17T01:50:15.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.264+0000 7efd93fff700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7efd8406c680 0x7efd8406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:15.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.265+0000 7efd93fff700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7efd8406c680 0x7efd8406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd94102600 tx=0x7efd80009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:15.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.269+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd8805ae10 con 0x7efd94101880 2024-09-17T01:50:15.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.536+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd94105f70 con 0x7efd8406c680 2024-09-17T01:50:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.537+0000 7efd91ffb700 1 -- 172.21.15.31:0/2455425669 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7efd94105f70 con 0x7efd8406c680 2024-09-17T01:50:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7efd8406c680 msgr2=0x7efd8406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7efd8406c680 0x7efd8406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd94102600 tx=0x7efd80009260 comp rx=0 tx=0).stop 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 msgr2=0x7efd94100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94100f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd88000c00 tx=0x7efd8800f690 comp rx=0 tx=0).stop 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 shutdown_connections 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7efd8406c680 0x7efd8406eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd94101880 0x7efd94100f80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 --2- 172.21.15.31:0/2455425669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd941021d0 0x7efd940ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 >> 172.21.15.31:0/2455425669 conn(0x7efd940f9f10 msgr2=0x7efd94104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 shutdown_connections 2024-09-17T01:50:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.540+0000 7efd9b1fd700 1 -- 172.21.15.31:0/2455425669 wait complete. 2024-09-17T01:50:15.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 -- 172.21.15.31:0/3995791014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 msgr2=0x7fb0140ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3995791014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb0140ff540 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb004009910 tx=0x7fb004009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:15.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 -- 172.21.15.31:0/3995791014 shutdown_connections 2024-09-17T01:50:15.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3995791014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb014100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3995791014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb0140ff540 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 -- 172.21.15.31:0/3995791014 >> 172.21.15.31:0/3995791014 conn(0x7fb0140fa780 msgr2=0x7fb0140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:15.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 -- 172.21.15.31:0/3995791014 shutdown_connections 2024-09-17T01:50:15.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.669+0000 7fb01a49e700 1 -- 172.21.15.31:0/3995791014 wait complete. 2024-09-17T01:50:15.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.670+0000 7fb01a49e700 1 Processor -- start 2024-09-17T01:50:15.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.670+0000 7fb01a49e700 1 -- start start 2024-09-17T01:50:15.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.670+0000 7fb01a49e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb014197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:15.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.670+0000 7fb01a49e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb0141981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:15.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.670+0000 7fb01a49e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0141987e0 con 0x7fb0140ff130 2024-09-17T01:50:15.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.670+0000 7fb01a49e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014198950 con 0x7fb0141003d0 2024-09-17T01:50:15.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb013fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb014197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:15.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb0141981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:15.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb0141981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:41904/0 (socket says 172.21.15.31:41904) 2024-09-17T01:50:15.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb013fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb014197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35860/0 (socket says 172.21.15.31:35860) 2024-09-17T01:50:15.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 -- 172.21.15.31:0/3082294 learned_addr learned my addr 172.21.15.31:0/3082294 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:15.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 -- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 msgr2=0x7fb014197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb014197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 -- 172.21.15.31:0/3082294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040095f0 con 0x7fb0141003d0 2024-09-17T01:50:15.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0137fe700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb0141981e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e920 tx=0x7fb00800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00800c9d0 con 0x7fb0141003d0 2024-09-17T01:50:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.671+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb008010430 con 0x7fb0141003d0 2024-09-17T01:50:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.672+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01419d3e0 con 0x7fb0141003d0 2024-09-17T01:50:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.672+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb008018650 con 0x7fb0141003d0 2024-09-17T01:50:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.672+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01419d930 con 0x7fb0141003d0 2024-09-17T01:50:15.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.673+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb014107c10 con 0x7fb0141003d0 2024-09-17T01:50:15.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.673+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb00800cb30 con 0x7fb0141003d0 2024-09-17T01:50:15.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.674+0000 7fb0117fa700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faffc06c680 0x7faffc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:15.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.674+0000 7fb013fff700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faffc06c680 0x7faffc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.674+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb008014070 con 0x7fb0141003d0 2024-09-17T01:50:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.674+0000 7fb013fff700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faffc06c680 0x7faffc06eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb014198b80 tx=0x7fb004005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.678+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb008051720 con 0x7fb0141003d0 2024-09-17T01:50:15.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.943+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb014068c50 con 0x7faffc06c680 2024-09-17T01:50:15.942 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:15 smithi031 ceph-mon[27673]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.957+0000 7fb0117fa700 1 -- 172.21.15.31:0/3082294 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7fb014068c50 con 0x7faffc06c680 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (5m) 32s ago 6m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (6m) 32s ago 6m 7512k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (5m) 38s ago 5m 7428k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (6m) 32s ago 6m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (5m) 38s ago 5m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:50:15.956 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (4m) 32s ago 6m 86.8M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (52s) 32s ago 51s 16.7M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (57s) 32s ago 57s 16.2M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (49s) 38s ago 49s 17.0M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (55s) 38s ago 54s 15.5M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:9283,8765,8443 running (7m) 32s ago 7m 487M - 18.2.0 dc2bc1663786 5a9379d38d8b 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (5m) 38s ago 5m 436M - 18.2.0 dc2bc1663786 274101cf9cf2 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (7m) 32s ago 7m 44.2M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (5m) 38s ago 5m 34.7M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (6m) 32s ago 6m 16.0M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:50:15.957 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (5m) 38s ago 5m 14.9M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (4m) 32s ago 4m 48.2M 3948M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (4m) 32s ago 4m 51.9M 3948M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (3m) 32s ago 3m 45.9M 3948M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (3m) 38s ago 3m 49.2M 4970M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (2m) 38s ago 2m 43.2M 4970M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (2m) 38s ago 2m 46.7M 4970M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:50:15.958 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (4m) 32s ago 5m 61.9M - 2.43.0 a07b618ecd1d ed28452b08d0 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faffc06c680 msgr2=0x7faffc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faffc06c680 0x7faffc06eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb014198b80 tx=0x7fb004005a90 comp rx=0 tx=0).stop 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 msgr2=0x7fb0141981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb0141981e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e920 tx=0x7fb00800ec30 comp rx=0 tx=0).stop 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 shutdown_connections 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7faffc06c680 0x7faffc06eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0140ff130 0x7fb014197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 --2- 172.21.15.31:0/3082294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb0141003d0 0x7fb0141981e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.960+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 >> 172.21.15.31:0/3082294 conn(0x7fb0140fa780 msgr2=0x7fb014068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.961+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 shutdown_connections 2024-09-17T01:50:15.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:15.961+0000 7fb01a49e700 1 -- 172.21.15.31:0/3082294 wait complete. 2024-09-17T01:50:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:15 smithi092 ceph-mon[33552]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 -- 172.21.15.31:0/2609578271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 msgr2=0x7f250c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 --2- 172.21.15.31:0/2609578271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c0fe910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009870 tx=0x7f24fc009b80 comp rx=0 tx=0).stop 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 -- 172.21.15.31:0/2609578271 shutdown_connections 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 --2- 172.21.15.31:0/2609578271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f250c0fee50 0x7f250c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 --2- 172.21.15.31:0/2609578271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c0fe910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 -- 172.21.15.31:0/2609578271 >> 172.21.15.31:0/2609578271 conn(0x7f250c0f9f10 msgr2=0x7f250c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 -- 172.21.15.31:0/2609578271 shutdown_connections 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 -- 172.21.15.31:0/2609578271 wait complete. 2024-09-17T01:50:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.088+0000 7f2512379700 1 Processor -- start 2024-09-17T01:50:16.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f2512379700 1 -- start start 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f2512379700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f2512379700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f250c0fee50 0x7f250c0ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f2512379700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0ffa70 con 0x7f250c0fee50 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f2512379700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0ffbb0 con 0x7f250c0fe500 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f250c0fee50 0x7f250c0ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:41934/0 (socket says 172.21.15.31:41934) 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250bfff700 1 -- 172.21.15.31:0/1702425710 learned_addr learned my addr 172.21.15.31:0/1702425710 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:16.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250bfff700 1 -- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f250c0fee50 msgr2=0x7f250c0ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250bfff700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f250c0fee50 0x7f250c0ff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.089+0000 7f250bfff700 1 -- 172.21.15.31:0/1702425710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc009520 con 0x7f250c0fe500 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.090+0000 7f250bfff700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c100ee0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009230 tx=0x7f24fc00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.090+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24fc01c070 con 0x7f250c0fe500 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.090+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24fc00fe40 con 0x7f250c0fe500 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.090+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c0ffe30 con 0x7f250c0fe500 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.090+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24fc0173f0 con 0x7f250c0fe500 2024-09-17T01:50:16.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.090+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c100320 con 0x7f250c0fe500 2024-09-17T01:50:16.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.091+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c108d50 con 0x7f250c0fe500 2024-09-17T01:50:16.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.092+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f24fc020070 con 0x7f250c0fe500 2024-09-17T01:50:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.092+0000 7f25097fa700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f24f406c680 0x7f24f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.092+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f24fc08ca10 con 0x7f250c0fe500 2024-09-17T01:50:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.092+0000 7f250b7fe700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f24f406c680 0x7f24f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.093+0000 7f250b7fe700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f24f406c680 0x7f24f406eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f250c068200 tx=0x7f2500009310 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:16.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.097+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f24fc05acb0 con 0x7f250c0fe500 2024-09-17T01:50:16.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.459+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f250c19e040 con 0x7f250c0fe500 2024-09-17T01:50:16.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.459+0000 7f25097fa700 1 -- 172.21.15.31:0/1702425710 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f24fc027240 con 0x7f250c0fe500 2024-09-17T01:50:16.458 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:50:16.458 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:50:16.458 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:50:16.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:16.458 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:50:16.459 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:50:16.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f24f406c680 msgr2=0x7f24f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f24f406c680 0x7f24f406eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f250c068200 tx=0x7f2500009310 comp rx=0 tx=0).stop 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 msgr2=0x7f250c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c100ee0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009230 tx=0x7f24fc00f740 comp rx=0 tx=0).stop 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 shutdown_connections 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f24f406c680 0x7f24f406eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f250c0fe500 0x7f250c100ee0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 --2- 172.21.15.31:0/1702425710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f250c0fee50 0x7f250c0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 >> 172.21.15.31:0/1702425710 conn(0x7f250c0f9f10 msgr2=0x7f250c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 shutdown_connections 2024-09-17T01:50:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.462+0000 7f2512379700 1 -- 172.21.15.31:0/1702425710 wait complete. 2024-09-17T01:50:16.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 -- 172.21.15.31:0/4111398112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c101440 msgr2=0x7fb23c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 --2- 172.21.15.31:0/4111398112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c101440 0x7fb23c101890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009910 tx=0x7fb22c009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:16.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 -- 172.21.15.31:0/4111398112 shutdown_connections 2024-09-17T01:50:16.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 --2- 172.21.15.31:0/4111398112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c101440 0x7fb23c101890 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 --2- 172.21.15.31:0/4111398112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c100240 0x7fb23c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 -- 172.21.15.31:0/4111398112 >> 172.21.15.31:0/4111398112 conn(0x7fb23c0fb7f0 msgr2=0x7fb23c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:16.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 -- 172.21.15.31:0/4111398112 shutdown_connections 2024-09-17T01:50:16.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.592+0000 7fb2437b3700 1 -- 172.21.15.31:0/4111398112 wait complete. 2024-09-17T01:50:16.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.593+0000 7fb2437b3700 1 Processor -- start 2024-09-17T01:50:16.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.593+0000 7fb2437b3700 1 -- start start 2024-09-17T01:50:16.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.593+0000 7fb2437b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 0x7fb23c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:16.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.593+0000 7fb2437b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c101440 0x7fb23c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:16.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.593+0000 7fb2437b3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c196610 con 0x7fb23c100240 2024-09-17T01:50:16.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.593+0000 7fb2437b3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c196750 con 0x7fb23c101440 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb24154f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 0x7fb23c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb240d4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c101440 0x7fb23c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb24154f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 0x7fb23c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35910/0 (socket says 172.21.15.31:35910) 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb24154f700 1 -- 172.21.15.31:0/270920 learned_addr learned my addr 172.21.15.31:0/270920 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb240d4e700 1 -- 172.21.15.31:0/270920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 msgr2=0x7fb23c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb240d4e700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 0x7fb23c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb240d4e700 1 -- 172.21.15.31:0/270920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0095f0 con 0x7fb23c101440 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb24154f700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 0x7fb23c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.594+0000 7fb240d4e700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c101440 0x7fb23c195ff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009910 tx=0x7fb22c00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.595+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb22c01d070 con 0x7fb23c101440 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.595+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb22c00f460 con 0x7fb23c101440 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.595+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb22c021640 con 0x7fb23c101440 2024-09-17T01:50:16.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.595+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c072f80 con 0x7fb23c101440 2024-09-17T01:50:16.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.595+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c073420 con 0x7fb23c101440 2024-09-17T01:50:16.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.596+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c108d90 con 0x7fb23c101440 2024-09-17T01:50:16.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.596+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb22c003a60 con 0x7fb23c101440 2024-09-17T01:50:16.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.597+0000 7fb2327fc700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fb22806c680 0x7fb22806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:16.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.597+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb22c08c9f0 con 0x7fb23c101440 2024-09-17T01:50:16.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.597+0000 7fb24154f700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fb22806c680 0x7fb22806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:16.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.598+0000 7fb24154f700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fb22806c680 0x7fb22806eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2380096d0 tx=0x7fb23800f850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:16.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.601+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb22c05ab90 con 0x7fb23c101440 2024-09-17T01:50:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:16 smithi031 ceph-mon[27673]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:16 smithi031 ceph-mon[27673]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:16.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:16 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1702425710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:50:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.920+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb23c108f80 con 0x7fb23c101440 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.920+0000 7fb2327fc700 1 -- 172.21.15.31:0/270920 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fb22c026750 con 0x7fb23c101440 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:e15 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:50:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 15 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:49:30.931207+0000 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:50:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:50:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.923+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fb22806c680 msgr2=0x7fb22806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.923+0000 7fb2437b3700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fb22806c680 0x7fb22806eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2380096d0 tx=0x7fb23800f850 comp rx=0 tx=0).stop 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.923+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c101440 msgr2=0x7fb23c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.923+0000 7fb2437b3700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c101440 0x7fb23c195ff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009910 tx=0x7fb22c00bd70 comp rx=0 tx=0).stop 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 shutdown_connections 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fb22806c680 0x7fb22806eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb23c100240 0x7fb23c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 --2- 172.21.15.31:0/270920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb23c101440 0x7fb23c195ff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 >> 172.21.15.31:0/270920 conn(0x7fb23c0fb7f0 msgr2=0x7fb23c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 shutdown_connections 2024-09-17T01:50:16.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:16.924+0000 7fb2437b3700 1 -- 172.21.15.31:0/270920 wait complete. 2024-09-17T01:50:16.924 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 15 2024-09-17T01:50:16.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:16 smithi092 ceph-mon[33552]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:16.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:16 smithi092 ceph-mon[33552]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:16.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:16 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1702425710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 -- 172.21.15.31:0/1414484263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 msgr2=0x7fbd28100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/1414484263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28100790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009910 tx=0x7fbd1c009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 -- 172.21.15.31:0/1414484263 shutdown_connections 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/1414484263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28100790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/1414484263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 0x7fbd280ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 -- 172.21.15.31:0/1414484263 >> 172.21.15.31:0/1414484263 conn(0x7fbd280fa6d0 msgr2=0x7fbd280fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 -- 172.21.15.31:0/1414484263 shutdown_connections 2024-09-17T01:50:17.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.051+0000 7fbd2da1a700 1 -- 172.21.15.31:0/1414484263 wait complete. 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.052+0000 7fbd2da1a700 1 Processor -- start 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.052+0000 7fbd2da1a700 1 -- start start 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.052+0000 7fbd2da1a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 0x7fbd281030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.052+0000 7fbd2da1a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.052+0000 7fbd2da1a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28101c60 con 0x7fbd28100340 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.052+0000 7fbd2da1a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28101da0 con 0x7fbd280ff140 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:17.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35932/0 (socket says 172.21.15.31:35932) 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 -- 172.21.15.31:0/990097184 learned_addr learned my addr 172.21.15.31:0/990097184 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd26ffd700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 0x7fbd281030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 -- 172.21.15.31:0/990097184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 msgr2=0x7fbd281030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 0x7fbd281030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 -- 172.21.15.31:0/990097184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0095f0 con 0x7fbd28100340 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd26ffd700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 0x7fbd281030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd267fc700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28101720 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0092e0 tx=0x7fbd1c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.053+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd1c01d070 con 0x7fbd28100340 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.054+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd28102020 con 0x7fbd28100340 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.054+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd1c005dc0 con 0x7fbd28100340 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.054+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd28102510 con 0x7fbd28100340 2024-09-17T01:50:17.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.054+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd1c02b610 con 0x7fbd28100340 2024-09-17T01:50:17.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.055+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd28107cb0 con 0x7fbd28100340 2024-09-17T01:50:17.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.056+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbd1c003680 con 0x7fbd28100340 2024-09-17T01:50:17.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.056+0000 7fbd2ca18700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbd1006c680 0x7fbd1006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:17.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.056+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbd1c08cbf0 con 0x7fbd28100340 2024-09-17T01:50:17.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.057+0000 7fbd26ffd700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbd1006c680 0x7fbd1006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:17.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.057+0000 7fbd26ffd700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbd1006c680 0x7fbd1006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd281001a0 tx=0x7fbd18009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:17.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.062+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbd1c093080 con 0x7fbd28100340 2024-09-17T01:50:17.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.337+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd280694c0 con 0x7fbd1006c680 2024-09-17T01:50:17.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.339+0000 7fbd2ca18700 1 -- 172.21.15.31:0/990097184 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fbd280694c0 con 0x7fbd1006c680 2024-09-17T01:50:17.337 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:50:17.337 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:50:17.337 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:50:17.337 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:50:17.338 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [], 2024-09-17T01:50:17.338 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "", 2024-09-17T01:50:17.338 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f image", 2024-09-17T01:50:17.338 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:50:17.338 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbd1006c680 msgr2=0x7fbd1006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbd1006c680 0x7fbd1006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd281001a0 tx=0x7fbd18009260 comp rx=0 tx=0).stop 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 msgr2=0x7fbd28101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28101720 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0092e0 tx=0x7fbd1c00f690 comp rx=0 tx=0).stop 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 shutdown_connections 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fbd1006c680 0x7fbd1006eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd280ff140 0x7fbd281030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 --2- 172.21.15.31:0/990097184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd28100340 0x7fbd28101720 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.341+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 >> 172.21.15.31:0/990097184 conn(0x7fbd280fa6d0 msgr2=0x7fbd28068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:17.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.342+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 shutdown_connections 2024-09-17T01:50:17.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.342+0000 7fbd2da1a700 1 -- 172.21.15.31:0/990097184 wait complete. 2024-09-17T01:50:17.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 -- 172.21.15.31:0/2267936482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 msgr2=0x7fdf14100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 --2- 172.21.15.31:0/2267936482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14100840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009910 tx=0x7fdf08009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:17.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 -- 172.21.15.31:0/2267936482 shutdown_connections 2024-09-17T01:50:17.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 --2- 172.21.15.31:0/2267936482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14100840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 --2- 172.21.15.31:0/2267936482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf140ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 -- 172.21.15.31:0/2267936482 >> 172.21.15.31:0/2267936482 conn(0x7fdf140fa780 msgr2=0x7fdf140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:17.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 -- 172.21.15.31:0/2267936482 shutdown_connections 2024-09-17T01:50:17.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.468+0000 7fdf18e66700 1 -- 172.21.15.31:0/2267936482 wait complete. 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.469+0000 7fdf18e66700 1 Processor -- start 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.469+0000 7fdf18e66700 1 -- start start 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf18e66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf14194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf18e66700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf18e66700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf141954c0 con 0x7fdf141003d0 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf18e66700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14195600 con 0x7fdf140ff130 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf11d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf1259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf14194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf11d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14194ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35948/0 (socket says 172.21.15.31:35948) 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf1259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf14194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:41976/0 (socket says 172.21.15.31:41976) 2024-09-17T01:50:17.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf11d9b700 1 -- 172.21.15.31:0/3481083163 learned_addr learned my addr 172.21.15.31:0/3481083163 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf1259c700 1 -- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 msgr2=0x7fdf14194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf1259c700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf1259c700 1 -- 172.21.15.31:0/3481083163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080095f0 con 0x7fdf140ff130 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.470+0000 7fdf1259c700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf14194960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400e970 tx=0x7fdf0400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.471+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0400c9d0 con 0x7fdf140ff130 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.471+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf04010430 con 0x7fdf140ff130 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.471+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf140685a0 con 0x7fdf140ff130 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.471+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf04018650 con 0x7fdf140ff130 2024-09-17T01:50:17.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.471+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf14068af0 con 0x7fdf140ff130 2024-09-17T01:50:17.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.472+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf14107c10 con 0x7fdf140ff130 2024-09-17T01:50:17.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.472+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdf040105a0 con 0x7fdf140ff130 2024-09-17T01:50:17.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.473+0000 7fdf037fe700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdefc06c680 0x7fdefc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:17.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.473+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdf04014070 con 0x7fdf140ff130 2024-09-17T01:50:17.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.473+0000 7fdf11d9b700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdefc06c680 0x7fdefc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:17.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.474+0000 7fdf11d9b700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdefc06c680 0x7fdefc06eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009fd0 tx=0x7fdf08005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:17.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.478+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdf04051720 con 0x7fdf140ff130 2024-09-17T01:50:17.624 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:17 smithi031 ceph-mon[27673]: from='client.24333 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:17.624 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:17 smithi031 ceph-mon[27673]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:50:17.624 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:17 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/270920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:50:17.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.845+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdf14107e00 con 0x7fdf140ff130 2024-09-17T01:50:17.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.845+0000 7fdf037fe700 1 -- 172.21.15.31:0/3481083163 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdf04059d10 con 0x7fdf140ff130 2024-09-17T01:50:17.844 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:50:17.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdefc06c680 msgr2=0x7fdefc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdefc06c680 0x7fdefc06eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009fd0 tx=0x7fdf08005940 comp rx=0 tx=0).stop 2024-09-17T01:50:17.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 msgr2=0x7fdf14194960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:17.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf14194960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400e970 tx=0x7fdf0400ec80 comp rx=0 tx=0).stop 2024-09-17T01:50:17.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 shutdown_connections 2024-09-17T01:50:17.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fdefc06c680 0x7fdefc06eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf140ff130 0x7fdf14194960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 --2- 172.21.15.31:0/3481083163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf141003d0 0x7fdf14194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:17.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 >> 172.21.15.31:0/3481083163 conn(0x7fdf140fa780 msgr2=0x7fdf14103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:17.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 shutdown_connections 2024-09-17T01:50:17.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:17.849+0000 7fdf18e66700 1 -- 172.21.15.31:0/3481083163 wait complete. 2024-09-17T01:50:17.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:17 smithi092 ceph-mon[33552]: from='client.24333 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:17.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:17 smithi092 ceph-mon[33552]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:50:17.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:17 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/270920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:50:18.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:18 smithi092 ceph-mon[33552]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:18.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:18 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3481083163' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:50:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:18 smithi031 ceph-mon[27673]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:18 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3481083163' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:50:19.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:19 smithi092 ceph-mon[33552]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:50:20.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:19 smithi031 ceph-mon[27673]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:50:21.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:21 smithi092 ceph-mon[33552]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:50:22.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:21 smithi031 ceph-mon[27673]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:50:23.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:23 smithi092 ceph-mon[33552]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-17T01:50:24.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:23 smithi031 ceph-mon[27673]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-17T01:50:24.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:25.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:25 smithi092 ceph-mon[33552]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:26.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:25 smithi031 ceph-mon[27673]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:27.848 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:27 smithi092 ceph-mon[33552]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:27 smithi031 ceph-mon[27673]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:28 smithi092 ceph-mon[33552]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:29.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:28 smithi031 ceph-mon[27673]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:31.940 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:31 smithi092 ceph-mon[33552]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:31 smithi031 ceph-mon[27673]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:33.535 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:33 smithi031 ceph-mon[27673]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:33.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:33 smithi092 ceph-mon[33552]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:35.890 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:35 smithi031 ceph-mon[27673]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:35 smithi092 ceph-mon[33552]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:37.902 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:37 smithi031 ceph-mon[27673]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:37.983 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:37 smithi092 ceph-mon[33552]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:39.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:38 smithi092 ceph-mon[33552]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:39.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:38 smithi031 ceph-mon[27673]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:40.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:40 smithi092 ceph-mon[33552]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:41.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:40 smithi031 ceph-mon[27673]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:43 smithi092 ceph-mon[33552]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:43.995 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:43 smithi031 ceph-mon[27673]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:45 smithi092 ceph-mon[33552]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:45 smithi031 ceph-mon[27673]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:47 smithi092 ceph-mon[33552]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:47 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:47 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:50:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:47 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:48.013 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:47 smithi031 ceph-mon[27673]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:50:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:47 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:50:48.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 -- 172.21.15.31:0/1980766842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c1003d0 msgr2=0x7f999c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 --2- 172.21.15.31:0/1980766842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c1003d0 0x7f999c100840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f998c009910 tx=0x7f998c009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 -- 172.21.15.31:0/1980766842 shutdown_connections 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 --2- 172.21.15.31:0/1980766842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c1003d0 0x7f999c100840 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 --2- 172.21.15.31:0/1980766842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f999c0ff130 0x7f999c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 -- 172.21.15.31:0/1980766842 >> 172.21.15.31:0/1980766842 conn(0x7f999c0fa780 msgr2=0x7f999c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 -- 172.21.15.31:0/1980766842 shutdown_connections 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.015+0000 7f99a3619700 1 -- 172.21.15.31:0/1980766842 wait complete. 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a3619700 1 Processor -- start 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a3619700 1 -- start start 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a3619700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 0x7f999c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a3619700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f999c1003d0 0x7f999c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a3619700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c19ad90 con 0x7f999c0ff130 2024-09-17T01:50:48.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a3619700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c19aed0 con 0x7f999c1003d0 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.016+0000 7f99a13b5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 0x7f999c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a13b5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 0x7f999c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53856/0 (socket says 172.21.15.31:53856) 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a13b5700 1 -- 172.21.15.31:0/2548205037 learned_addr learned my addr 172.21.15.31:0/2548205037 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a0bb4700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f999c1003d0 0x7f999c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a13b5700 1 -- 172.21.15.31:0/2548205037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f999c1003d0 msgr2=0x7f999c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a13b5700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f999c1003d0 0x7f999c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a13b5700 1 -- 172.21.15.31:0/2548205037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0095f0 con 0x7f999c0ff130 2024-09-17T01:50:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a13b5700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 0x7f999c0690a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f999800d900 tx=0x7f999800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99980041f0 con 0x7f999c0ff130 2024-09-17T01:50:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9998004ce0 con 0x7f999c0ff130 2024-09-17T01:50:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.017+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c19b1b0 con 0x7f999c0ff130 2024-09-17T01:50:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.018+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c19b6d0 con 0x7f999c0ff130 2024-09-17T01:50:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.018+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f999800b750 con 0x7f999c0ff130 2024-09-17T01:50:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.019+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9980005320 con 0x7f999c0ff130 2024-09-17T01:50:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.020+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9998004e50 con 0x7f999c0ff130 2024-09-17T01:50:48.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.021+0000 7f99927fc700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f998806c680 0x7f998806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:48.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.021+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f999808b570 con 0x7f999c0ff130 2024-09-17T01:50:48.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.021+0000 7f99a0bb4700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f998806c680 0x7f998806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:48.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.022+0000 7f99a0bb4700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f998806c680 0x7f998806eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b5c0 tx=0x7f998c005ee0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:48.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.026+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9998059810 con 0x7f999c0ff130 2024-09-17T01:50:48.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.403+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9980000bf0 con 0x7f998806c680 2024-09-17T01:50:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.405+0000 7f99927fc700 1 -- 172.21.15.31:0/2548205037 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9980000bf0 con 0x7f998806c680 2024-09-17T01:50:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f998806c680 msgr2=0x7f998806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f998806c680 0x7f998806eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b5c0 tx=0x7f998c005ee0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 msgr2=0x7f999c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 0x7f999c0690a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f999800d900 tx=0x7f999800dc10 comp rx=0 tx=0).stop 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 shutdown_connections 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f998806c680 0x7f998806eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f999c0ff130 0x7f999c0690a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 --2- 172.21.15.31:0/2548205037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f999c1003d0 0x7f999c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 >> 172.21.15.31:0/2548205037 conn(0x7f999c0fa780 msgr2=0x7f999c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 shutdown_connections 2024-09-17T01:50:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.408+0000 7f99a3619700 1 -- 172.21.15.31:0/2548205037 wait complete. 2024-09-17T01:50:48.417 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 -- 172.21.15.31:0/3795033179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c100d60 msgr2=0x7f412c103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 --2- 172.21.15.31:0/3795033179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c100d60 0x7f412c103140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f411c009910 tx=0x7f411c009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 -- 172.21.15.31:0/3795033179 shutdown_connections 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 --2- 172.21.15.31:0/3795033179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f412c103680 0x7f412c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 --2- 172.21.15.31:0/3795033179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c100d60 0x7f412c103140 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 -- 172.21.15.31:0/3795033179 >> 172.21.15.31:0/3795033179 conn(0x7f412c0fa780 msgr2=0x7f412c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:48.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 -- 172.21.15.31:0/3795033179 shutdown_connections 2024-09-17T01:50:48.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.534+0000 7f413087d700 1 -- 172.21.15.31:0/3795033179 wait complete. 2024-09-17T01:50:48.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.535+0000 7f413087d700 1 Processor -- start 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.535+0000 7f413087d700 1 -- start start 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.535+0000 7f413087d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f412c103680 0x7f412c1006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.535+0000 7f413087d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 0x7f412c0ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.535+0000 7f413087d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c199950 con 0x7f412c0fed10 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.535+0000 7f413087d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c199ac0 con 0x7f412c103680 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 0x7f412c0ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 0x7f412c0ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53888/0 (socket says 172.21.15.31:53888) 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 -- 172.21.15.31:0/865614123 learned_addr learned my addr 172.21.15.31:0/865614123 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 -- 172.21.15.31:0/865614123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f412c103680 msgr2=0x7f412c1006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f412c103680 0x7f412c1006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 -- 172.21.15.31:0/865614123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0095f0 con 0x7f412c0fed10 2024-09-17T01:50:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.536+0000 7f4129d9b700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 0x7f412c0ff180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f412000e920 tx=0x7f412000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:48.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.537+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4120009790 con 0x7f412c0fed10 2024-09-17T01:50:48.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.537+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c0ff6c0 con 0x7f412c0fed10 2024-09-17T01:50:48.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.537+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f412000cba0 con 0x7f412c0fed10 2024-09-17T01:50:48.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.537+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4120018630 con 0x7f412c0fed10 2024-09-17T01:50:48.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.537+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c1a2550 con 0x7f412c0fed10 2024-09-17T01:50:48.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.538+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f41200188f0 con 0x7f412c0fed10 2024-09-17T01:50:48.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.539+0000 7f411b7fe700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f411406c680 0x7f411406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:48.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.539+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c108ce0 con 0x7f412c0fed10 2024-09-17T01:50:48.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.539+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4120014070 con 0x7f412c0fed10 2024-09-17T01:50:48.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.539+0000 7f412a59c700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f411406c680 0x7f411406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:48.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.540+0000 7f412a59c700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f411406c680 0x7f411406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f411c009fd0 tx=0x7f411c000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:48.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.544+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4120091060 con 0x7f412c0fed10 2024-09-17T01:50:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:48 smithi031 ceph-mon[27673]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:50:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:48 smithi031 ceph-mon[27673]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:50:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:48 smithi031 ceph-mon[27673]: Upgrade: Need to upgrade myself (mgr.smithi031.ealpiz) 2024-09-17T01:50:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:48 smithi031 ceph-mon[27673]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 on smithi092 2024-09-17T01:50:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.844+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f412c1042e0 con 0x7f411406c680 2024-09-17T01:50:48.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.846+0000 7f411b7fe700 1 -- 172.21.15.31:0/865614123 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f412c1042e0 con 0x7f411406c680 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f411406c680 msgr2=0x7f411406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f411406c680 0x7f411406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f411c009fd0 tx=0x7f411c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 msgr2=0x7f412c0ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 0x7f412c0ff180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f412000e920 tx=0x7f412000ece0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 shutdown_connections 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f411406c680 0x7f411406eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f412c103680 0x7f412c1006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 --2- 172.21.15.31:0/865614123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f412c0fed10 0x7f412c0ff180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 >> 172.21.15.31:0/865614123 conn(0x7f412c0fa780 msgr2=0x7f412c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 shutdown_connections 2024-09-17T01:50:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:48.849+0000 7f413087d700 1 -- 172.21.15.31:0/865614123 wait complete. 2024-09-17T01:50:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:48 smithi092 ceph-mon[33552]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:50:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:48 smithi092 ceph-mon[33552]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:50:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:48 smithi092 ceph-mon[33552]: Upgrade: Need to upgrade myself (mgr.smithi031.ealpiz) 2024-09-17T01:50:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:48 smithi092 ceph-mon[33552]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 on smithi092 2024-09-17T01:50:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.019+0000 7f2f57ef0700 1 -- 172.21.15.31:0/2123800504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 msgr2=0x7f2f500ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.019+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/2123800504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 0x7f2f500ff540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009870 tx=0x7f2f4c009b80 comp rx=0 tx=0).stop 2024-09-17T01:50:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.020+0000 7f2f57ef0700 1 -- 172.21.15.31:0/2123800504 shutdown_connections 2024-09-17T01:50:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.020+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/2123800504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f50100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.020+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/2123800504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 0x7f2f500ff540 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.020+0000 7f2f57ef0700 1 -- 172.21.15.31:0/2123800504 >> 172.21.15.31:0/2123800504 conn(0x7f2f500fa780 msgr2=0x7f2f500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.020+0000 7f2f57ef0700 1 -- 172.21.15.31:0/2123800504 shutdown_connections 2024-09-17T01:50:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.020+0000 7f2f57ef0700 1 -- 172.21.15.31:0/2123800504 wait complete. 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.021+0000 7f2f57ef0700 1 Processor -- start 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.021+0000 7f2f57ef0700 1 -- start start 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.021+0000 7f2f57ef0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 0x7f2f50103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.021+0000 7f2f57ef0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f501017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f57ef0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50101cf0 con 0x7f2f501003d0 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f57ef0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50101e30 con 0x7f2f500ff130 2024-09-17T01:50:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f501017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f501017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53918/0 (socket says 172.21.15.31:53918) 2024-09-17T01:50:49.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 -- 172.21.15.31:0/1795463816 learned_addr learned my addr 172.21.15.31:0/1795463816 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:49.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 -- 172.21.15.31:0/1795463816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 msgr2=0x7f2f50103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 0x7f2f50103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 -- 172.21.15.31:0/1795463816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f400095f0 con 0x7f2f501003d0 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.022+0000 7f2f5548b700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f501017b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000eb90 tx=0x7f2f4000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.023+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4000cd70 con 0x7f2f501003d0 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.023+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f400044d0 con 0x7f2f501003d0 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.023+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f40010660 con 0x7f2f501003d0 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.024+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c009520 con 0x7f2f501003d0 2024-09-17T01:50:49.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.024+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f50102450 con 0x7f2f501003d0 2024-09-17T01:50:49.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.025+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f50107c10 con 0x7f2f501003d0 2024-09-17T01:50:49.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.026+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2f40003f40 con 0x7f2f501003d0 2024-09-17T01:50:49.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.027+0000 7f2f46ffd700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f3c06c680 0x7f2f3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.027+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2f40014070 con 0x7f2f501003d0 2024-09-17T01:50:49.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.027+0000 7f2f55c8c700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f3c06c680 0x7f2f3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.028+0000 7f2f55c8c700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f3c06c680 0x7f2f3c06eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009230 tx=0x7f2f4c009ef0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.036+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2f4005a540 con 0x7f2f501003d0 2024-09-17T01:50:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.375+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f5019df20 con 0x7f2f3c06c680 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.394+0000 7f2f46ffd700 1 -- 172.21.15.31:0/1795463816 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f2f5019df20 con 0x7f2f3c06c680 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (5m) 66s ago 6m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (7m) 66s ago 7m 7512k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (6m) 71s ago 6m 7428k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (7m) 66s ago 7m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (6m) 71s ago 6m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (5m) 66s ago 6m 86.8M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (85s) 66s ago 85s 16.7M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:50:49.393 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (91s) 66s ago 90s 16.2M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (83s) 71s ago 82s 17.0M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (88s) 71s ago 88s 15.5M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:9283,8765,8443 running (8m) 66s ago 8m 487M - 18.2.0 dc2bc1663786 5a9379d38d8b 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (6m) 71s ago 6m 436M - 18.2.0 dc2bc1663786 274101cf9cf2 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (8m) 66s ago 8m 44.2M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (5m) 71s ago 5m 34.7M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (7m) 66s ago 7m 16.0M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (6m) 71s ago 6m 14.9M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (5m) 66s ago 5m 48.2M 3948M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (4m) 66s ago 4m 51.9M 3948M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (4m) 66s ago 4m 45.9M 3948M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:50:49.394 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (3m) 71s ago 3m 49.2M 4970M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:50:49.395 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (3m) 71s ago 3m 43.2M 4970M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:50:49.395 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (3m) 71s ago 3m 46.7M 4970M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:50:49.395 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (5m) 66s ago 6m 61.9M - 2.43.0 a07b618ecd1d ed28452b08d0 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f3c06c680 msgr2=0x7f2f3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f3c06c680 0x7f2f3c06eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009230 tx=0x7f2f4c009ef0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 msgr2=0x7f2f501017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f501017b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000eb90 tx=0x7f2f4000ef50 comp rx=0 tx=0).stop 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 shutdown_connections 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f2f3c06c680 0x7f2f3c06eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f500ff130 0x7f2f50103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 --2- 172.21.15.31:0/1795463816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f501003d0 0x7f2f501017b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 >> 172.21.15.31:0/1795463816 conn(0x7f2f500fa780 msgr2=0x7f2f50068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 shutdown_connections 2024-09-17T01:50:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.397+0000 7f2f57ef0700 1 -- 172.21.15.31:0/1795463816 wait complete. 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 -- 172.21.15.31:0/2272175431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8100d60 msgr2=0x7f98c8103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 --2- 172.21.15.31:0/2272175431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8100d60 0x7f98c8103140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009910 tx=0x7f98b8009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 -- 172.21.15.31:0/2272175431 shutdown_connections 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 --2- 172.21.15.31:0/2272175431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8103680 0x7f98c8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 --2- 172.21.15.31:0/2272175431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8100d60 0x7f98c8103140 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 -- 172.21.15.31:0/2272175431 >> 172.21.15.31:0/2272175431 conn(0x7f98c80fa780 msgr2=0x7f98c80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 -- 172.21.15.31:0/2272175431 shutdown_connections 2024-09-17T01:50:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.508+0000 7f98cca66700 1 -- 172.21.15.31:0/2272175431 wait complete. 2024-09-17T01:50:49.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.509+0000 7f98cca66700 1 Processor -- start 2024-09-17T01:50:49.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.509+0000 7f98cca66700 1 -- start start 2024-09-17T01:50:49.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98cca66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 0x7f98c8195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98cca66700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8103680 0x7f98c8195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 0x7f98c8195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 0x7f98c8195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36046/0 (socket says 172.21.15.31:36046) 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c659c700 1 -- 172.21.15.31:0/146759619 learned_addr learned my addr 172.21.15.31:0/146759619 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c81965a0 con 0x7f98c8103680 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c81966e0 con 0x7f98c8100d60 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c5d9b700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8103680 0x7f98c8195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c659c700 1 -- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8103680 msgr2=0x7f98c8195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c659c700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8103680 0x7f98c8195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.510+0000 7f98c659c700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80095f0 con 0x7f98c8100d60 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.511+0000 7f98c659c700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 0x7f98c8195a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98b8005b40 tx=0x7f98b800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.511+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b801d070 con 0x7f98c8100d60 2024-09-17T01:50:49.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.511+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c80feb30 con 0x7f98c8100d60 2024-09-17T01:50:49.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.511+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98b8005dc0 con 0x7f98c8100d60 2024-09-17T01:50:49.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.511+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b8022470 con 0x7f98c8100d60 2024-09-17T01:50:49.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.511+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c80fef60 con 0x7f98c8100d60 2024-09-17T01:50:49.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.513+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c818fbc0 con 0x7f98c8100d60 2024-09-17T01:50:49.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.514+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f98b8003680 con 0x7f98c8100d60 2024-09-17T01:50:49.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.514+0000 7f98b77fe700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f98b006c680 0x7f98b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.514+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f98b808cdc0 con 0x7f98c8100d60 2024-09-17T01:50:49.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.515+0000 7f98c5d9b700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f98b006c680 0x7f98b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.515+0000 7f98c5d9b700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f98b006c680 0x7f98b006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009cb0 tx=0x7f98bc009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.522+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f98b8090030 con 0x7f98c8100d60 2024-09-17T01:50:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:49 smithi031 ceph-mon[27673]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:49 smithi031 ceph-mon[27673]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:49.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.843+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98c802ce90 con 0x7f98c8100d60 2024-09-17T01:50:49.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.844+0000 7f98b77fe700 1 -- 172.21.15.31:0/146759619 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f98b805af60 con 0x7f98c8100d60 2024-09-17T01:50:49.842 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:50:49.842 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:50:49.842 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:50:49.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:50:49.843 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:50:49.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.846+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f98b006c680 msgr2=0x7f98b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.846+0000 7f98cca66700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f98b006c680 0x7f98b006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009cb0 tx=0x7f98bc009260 comp rx=0 tx=0).stop 2024-09-17T01:50:49.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 msgr2=0x7f98c8195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 0x7f98c8195a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98b8005b40 tx=0x7f98b800fa00 comp rx=0 tx=0).stop 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 shutdown_connections 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f98b006c680 0x7f98b006eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8100d60 0x7f98c8195a40 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98b8005b40 tx=0x7f98b800fa00 comp rx=0 tx=0).stop 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 --2- 172.21.15.31:0/146759619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98c8103680 0x7f98c8195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 >> 172.21.15.31:0/146759619 conn(0x7f98c80fa780 msgr2=0x7f98c80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 shutdown_connections 2024-09-17T01:50:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.847+0000 7f98cca66700 1 -- 172.21.15.31:0/146759619 wait complete. 2024-09-17T01:50:49.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:49 smithi092 ceph-mon[33552]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:49.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:49 smithi092 ceph-mon[33552]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 -- 172.21.15.31:0/87221887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc1014e0 msgr2=0x7fd5dc101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 --2- 172.21.15.31:0/87221887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc101930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009910 tx=0x7fd5cc009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 -- 172.21.15.31:0/87221887 shutdown_connections 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 --2- 172.21.15.31:0/87221887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc101930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 --2- 172.21.15.31:0/87221887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc0fe500 0x7fd5dc0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 -- 172.21.15.31:0/87221887 >> 172.21.15.31:0/87221887 conn(0x7fd5dc0f9e50 msgr2=0x7fd5dc0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 -- 172.21.15.31:0/87221887 shutdown_connections 2024-09-17T01:50:49.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.993+0000 7fd5e4087700 1 -- 172.21.15.31:0/87221887 wait complete. 2024-09-17T01:50:49.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.994+0000 7fd5e4087700 1 Processor -- start 2024-09-17T01:50:49.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.994+0000 7fd5e4087700 1 -- start start 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e4087700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc0fe500 0x7fd5dc195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e4087700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e4087700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc196630 con 0x7fd5dc0fe500 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e4087700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc196770 con 0x7fd5dc1014e0 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1e23700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc0fe500 0x7fd5dc195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36066/0 (socket says 172.21.15.31:36066) 2024-09-17T01:50:49.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 -- 172.21.15.31:0/1015846869 learned_addr learned my addr 172.21.15.31:0/1015846869 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 -- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc0fe500 msgr2=0x7fd5dc195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc0fe500 0x7fd5dc195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 -- 172.21.15.31:0/1015846869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0095f0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1e23700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc0fe500 0x7fd5dc195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.995+0000 7fd5e1622700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc196010 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc000c00 tx=0x7fd5cc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.996+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5cc01d070 con 0x7fd5dc1014e0 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.996+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0ff2d0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.996+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc0ff7c0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.996+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd5cc005dc0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.996+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5cc0226a0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.997+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c0005320 con 0x7fd5dc1014e0 2024-09-17T01:50:49.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.998+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd5cc00faf0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.998+0000 7fd5d2ffd700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd5c806c680 0x7fd5c806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.998+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd5cc08cae0 con 0x7fd5dc1014e0 2024-09-17T01:50:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.998+0000 7fd5e1e23700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd5c806c680 0x7fd5c806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:49.999+0000 7fd5e1e23700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd5c806c680 0x7fd5c806eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc068bf0 tx=0x7fd5d8012040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.005+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd5cc05ad80 con 0x7fd5dc1014e0 2024-09-17T01:50:50.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.274+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5c0006200 con 0x7fd5dc1014e0 2024-09-17T01:50:50.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.275+0000 7fd5d2ffd700 1 -- 172.21.15.31:0/1015846869 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fd5cc003e60 con 0x7fd5dc1014e0 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:e15 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 15 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:50:50.274 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:49:30.931207+0000 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:50:50.275 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:50:50.276 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:50:50.277 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:50:50.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd5c806c680 msgr2=0x7fd5c806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd5c806c680 0x7fd5c806eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc068bf0 tx=0x7fd5d8012040 comp rx=0 tx=0).stop 2024-09-17T01:50:50.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 msgr2=0x7fd5dc196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc196010 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc000c00 tx=0x7fd5cc00f690 comp rx=0 tx=0).stop 2024-09-17T01:50:50.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 shutdown_connections 2024-09-17T01:50:50.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd5c806c680 0x7fd5c806eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5dc0fe500 0x7fd5dc195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 --2- 172.21.15.31:0/1015846869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5dc1014e0 0x7fd5dc196010 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.277+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 >> 172.21.15.31:0/1015846869 conn(0x7fd5dc0f9e50 msgr2=0x7fd5dc104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.278+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 shutdown_connections 2024-09-17T01:50:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.278+0000 7fd5e4087700 1 -- 172.21.15.31:0/1015846869 wait complete. 2024-09-17T01:50:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 15 2024-09-17T01:50:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 -- 172.21.15.31:0/2657558586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 msgr2=0x7fd948105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 --2- 172.21.15.31:0/2657558586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948105a60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009910 tx=0x7fd93c009c20 comp rx=0 tx=0).stop 2024-09-17T01:50:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 -- 172.21.15.31:0/2657558586 shutdown_connections 2024-09-17T01:50:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 --2- 172.21.15.31:0/2657558586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948105a60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 --2- 172.21.15.31:0/2657558586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 0x7fd948103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 -- 172.21.15.31:0/2657558586 >> 172.21.15.31:0/2657558586 conn(0x7fd9480fa780 msgr2=0x7fd9480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 -- 172.21.15.31:0/2657558586 shutdown_connections 2024-09-17T01:50:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.391+0000 7fd94cee5700 1 -- 172.21.15.31:0/2657558586 wait complete. 2024-09-17T01:50:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.392+0000 7fd94cee5700 1 Processor -- start 2024-09-17T01:50:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.392+0000 7fd94cee5700 1 -- start start 2024-09-17T01:50:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd94cee5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 0x7fd948195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd94cee5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd94cee5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481965d0 con 0x7fd948103680 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd94cee5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948196710 con 0x7fd948100d60 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd945d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53954/0 (socket says 172.21.15.31:53954) 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd945d9b700 1 -- 172.21.15.31:0/3638375817 learned_addr learned my addr 172.21.15.31:0/3638375817 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd94659c700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 0x7fd948195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd945d9b700 1 -- 172.21.15.31:0/3638375817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 msgr2=0x7fd948195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd945d9b700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 0x7fd948195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd945d9b700 1 -- 172.21.15.31:0/3638375817 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0095f0 con 0x7fd948103680 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.393+0000 7fd94659c700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 0x7fd948195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.394+0000 7fd945d9b700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948195fb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd93c000c00 tx=0x7fd93c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.394+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93c01d070 con 0x7fd948103680 2024-09-17T01:50:50.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.394+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480feb50 con 0x7fd948103680 2024-09-17T01:50:50.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.394+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd93c005dc0 con 0x7fd948103680 2024-09-17T01:50:50.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.394+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93c0226a0 con 0x7fd948103680 2024-09-17T01:50:50.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.394+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9480ff040 con 0x7fd948103680 2024-09-17T01:50:50.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.395+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94818fbe0 con 0x7fd948103680 2024-09-17T01:50:50.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.396+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd93c0038f0 con 0x7fd948103680 2024-09-17T01:50:50.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.397+0000 7fd9377fe700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd93006c680 0x7fd93006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.397+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd93c08cff0 con 0x7fd948103680 2024-09-17T01:50:50.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.397+0000 7fd94659c700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd93006c680 0x7fd93006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.397+0000 7fd94659c700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd93006c680 0x7fd93006eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd948069000 tx=0x7fd938009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.401+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd93c05b290 con 0x7fd948103680 2024-09-17T01:50:50.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.697+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9481005b0 con 0x7fd93006c680 2024-09-17T01:50:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.699+0000 7fd9377fe700 1 -- 172.21.15.31:0/3638375817 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fd9481005b0 con 0x7fd93006c680 2024-09-17T01:50:50.697 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:50:50.697 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [], 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 image on host smithi092", 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:50:50.698 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:50:50.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd93006c680 msgr2=0x7fd93006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd93006c680 0x7fd93006eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd948069000 tx=0x7fd938009260 comp rx=0 tx=0).stop 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 msgr2=0x7fd948195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948195fb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd93c000c00 tx=0x7fd93c00f690 comp rx=0 tx=0).stop 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 shutdown_connections 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fd93006c680 0x7fd93006eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd948100d60 0x7fd948195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 --2- 172.21.15.31:0/3638375817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd948103680 0x7fd948195fb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 >> 172.21.15.31:0/3638375817 conn(0x7fd9480fa780 msgr2=0x7fd9480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 shutdown_connections 2024-09-17T01:50:50.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.702+0000 7fd94cee5700 1 -- 172.21.15.31:0/3638375817 wait complete. 2024-09-17T01:50:50.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 -- 172.21.15.31:0/3848389993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570103680 msgr2=0x7f0570105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 --2- 172.21.15.31:0/3848389993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570103680 0x7f0570105a60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0564009870 tx=0x7f0564009b80 comp rx=0 tx=0).stop 2024-09-17T01:50:50.870 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:50 smithi031 ceph-mon[27673]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:50.870 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:50 smithi031 ceph-mon[27673]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:50.870 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:50 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/146759619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:50:50.871 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:50 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/1015846869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:50:50.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 -- 172.21.15.31:0/3848389993 shutdown_connections 2024-09-17T01:50:50.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 --2- 172.21.15.31:0/3848389993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570103680 0x7f0570105a60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 --2- 172.21.15.31:0/3848389993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0570100d60 0x7f0570103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 -- 172.21.15.31:0/3848389993 >> 172.21.15.31:0/3848389993 conn(0x7f05700fa780 msgr2=0x7f05700fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.871+0000 7f05748e0700 1 -- 172.21.15.31:0/3848389993 shutdown_connections 2024-09-17T01:50:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.872+0000 7f05748e0700 1 -- 172.21.15.31:0/3848389993 wait complete. 2024-09-17T01:50:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.872+0000 7f05748e0700 1 Processor -- start 2024-09-17T01:50:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f05748e0700 1 -- start start 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f05748e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 0x7f0570195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f05748e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0570103680 0x7f0570196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f05748e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570196620 con 0x7f0570103680 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f05748e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570196760 con 0x7f0570100d60 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 0x7f0570195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 0x7f0570195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36100/0 (socket says 172.21.15.31:36100) 2024-09-17T01:50:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056e59c700 1 -- 172.21.15.31:0/652125108 learned_addr learned my addr 172.21.15.31:0/652125108 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056dd9b700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0570103680 0x7f0570196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056e59c700 1 -- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0570103680 msgr2=0x7f0570196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056e59c700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0570103680 0x7f0570196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.873+0000 7f056e59c700 1 -- 172.21.15.31:0/652125108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600095f0 con 0x7f0570100d60 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.874+0000 7f056e59c700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 0x7f0570195ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f056000ebf0 tx=0x7f056000ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.874+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05600099d0 con 0x7f0570100d60 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.874+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0564009520 con 0x7f0570100d60 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.874+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057019b5d0 con 0x7f0570100d60 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.874+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05600044d0 con 0x7f0570100d60 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.875+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0560004830 con 0x7f0570100d60 2024-09-17T01:50:50.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.876+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0550005320 con 0x7f0570100d60 2024-09-17T01:50:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.877+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f056000cd10 con 0x7f0570100d60 2024-09-17T01:50:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.877+0000 7f055f7fe700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f055806c6d0 0x7f055806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.877+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0560014070 con 0x7f0570100d60 2024-09-17T01:50:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.878+0000 7f056dd9b700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f055806c6d0 0x7f055806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.878+0000 7f056dd9b700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f055806c6d0 0x7f055806eb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0564009f50 tx=0x7f0564019040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:50.885+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f056005a0b0 con 0x7f0570100d60 2024-09-17T01:50:50.992 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:50 smithi092 ceph-mon[33552]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:50.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:50 smithi092 ceph-mon[33552]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:50.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:50 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/146759619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:50:50.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:50 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/1015846869' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:50:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.440+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0550005190 con 0x7f0570100d60 2024-09-17T01:50:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.441+0000 7f055f7fe700 1 -- 172.21.15.31:0/652125108 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0560059c40 con 0x7f0570100d60 2024-09-17T01:50:51.439 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:50:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f055806c6d0 msgr2=0x7f055806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f055806c6d0 0x7f055806eb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0564009f50 tx=0x7f0564019040 comp rx=0 tx=0).stop 2024-09-17T01:50:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 msgr2=0x7f0570195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 0x7f0570195ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f056000ebf0 tx=0x7f056000ef00 comp rx=0 tx=0).stop 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 shutdown_connections 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f055806c6d0 0x7f055806eb80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0570100d60 0x7f0570195ac0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 --2- 172.21.15.31:0/652125108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0570103680 0x7f0570196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 >> 172.21.15.31:0/652125108 conn(0x7f05700fa780 msgr2=0x7f05700fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 shutdown_connections 2024-09-17T01:50:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:50:51.444+0000 7f05748e0700 1 -- 172.21.15.31:0/652125108 wait complete. 2024-09-17T01:50:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:51 smithi031 ceph-mon[27673]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:51 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/652125108' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:50:51.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:51 smithi092 ceph-mon[33552]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:51.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:51 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/652125108' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:50:52.946 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:52 smithi031 ceph-mon[27673]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:52.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:52 smithi092 ceph-mon[33552]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:53 smithi092 ceph-mon[33552]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:54.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:53 smithi031 ceph-mon[27673]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:54 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:55.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:54 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:50:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:55 smithi092 ceph-mon[33552]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:56.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:55 smithi031 ceph-mon[27673]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:57.630 INFO:tasks.workunit.client.1.smithi092.stderr:Updating files: 90% (11646/12893) Updating files: 91% (11733/12893) Updating files: 92% (11862/12893) Updating files: 93% (11991/12893) Updating files: 94% (12120/12893) Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T01:50:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:57 smithi092 ceph-mon[33552]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:57 smithi031 ceph-mon[27673]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:50:58.532 INFO:tasks.workunit.client.1.smithi092.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: git switch -c 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr:Or undo this operation with: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: git switch - 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr: 2024-09-17T01:50:58.533 INFO:tasks.workunit.client.1.smithi092.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:50:58.537 DEBUG:teuthology.orchestra.run.smithi092:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-17T01:50:58.620 INFO:tasks.workunit.client.1.smithi092.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:50:58.622 INFO:tasks.workunit.client.1.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:50:58.622 INFO:tasks.workunit.client.1.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:50:59.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:50:58 smithi092 ceph-mon[33552]: pgmap v230: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:50:58 smithi031 ceph-mon[27673]: pgmap v230: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:01.940 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:01 smithi092 ceph-mon[33552]: pgmap v231: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:01 smithi031 ceph-mon[27673]: pgmap v231: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:02.367 INFO:tasks.workunit.client.1.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:51:02.392 INFO:tasks.workunit.client.0.smithi031.stderr:Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T01:51:02.445 INFO:tasks.workunit.client.1.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:51:02.487 INFO:tasks.workunit.client.1.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:51:02.489 INFO:tasks.workunit.client.1.smithi092.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:51:02.489 INFO:tasks.workunit.client.1.smithi092.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:51:02.530 INFO:tasks.workunit.client.1.smithi092.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:51:02.534 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-17T01:51:02.534 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-17T01:51:02.590 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-17T01:51:02.592 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:51:02.593 DEBUG:teuthology.orchestra.run.smithi092:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-17T01:51:02.657 INFO:tasks.workunit.client.1.smithi092.stderr:+ mkdir -p fsstress 2024-09-17T01:51:02.660 INFO:tasks.workunit.client.1.smithi092.stderr:+ pushd fsstress 2024-09-17T01:51:02.661 INFO:tasks.workunit.client.1.smithi092.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:51:02.661 INFO:tasks.workunit.client.1.smithi092.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:51:03.109 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr: git switch -c 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr:Or undo this operation with: 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr: git switch - 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-09-17T01:51:03.110 INFO:tasks.workunit.client.0.smithi031.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:51:03.114 DEBUG:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T01:51:03.143 INFO:tasks.workunit.client.0.smithi031.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:51:03.145 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:51:03.145 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:51:03.200 INFO:tasks.workunit.client.1.smithi092.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:51:03.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:03 smithi092 ceph-mon[33552]: pgmap v232: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:03.844 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:03 smithi031 ceph-mon[27673]: pgmap v232: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:03.931 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:51:04.008 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:51:04.054 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:51:04.056 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:51:04.056 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:51:04.102 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:51:04.106 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T01:51:04.106 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T01:51:04.165 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T01:51:04.166 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:51:04.166 DEBUG:teuthology.orchestra.run.smithi031:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T01:51:04.235 INFO:tasks.workunit.client.0.smithi031.stderr:+ mkdir -p fsstress 2024-09-17T01:51:04.238 INFO:tasks.workunit.client.0.smithi031.stderr:+ pushd fsstress 2024-09-17T01:51:04.239 INFO:tasks.workunit.client.0.smithi031.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:51:04.240 INFO:tasks.workunit.client.0.smithi031.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:51:04.941 INFO:tasks.workunit.client.0.smithi031.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:51:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:05 smithi092 ceph-mon[33552]: pgmap v233: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:05 smithi031 ceph-mon[27673]: pgmap v233: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:07 smithi092 ceph-mon[33552]: pgmap v234: 65 pgs: 65 active+clean; 5.7 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s rd, 455 KiB/s wr, 36 op/s 2024-09-17T01:51:08.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:07 smithi031 ceph-mon[27673]: pgmap v234: 65 pgs: 65 active+clean; 5.7 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s rd, 455 KiB/s wr, 36 op/s 2024-09-17T01:51:09.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:08 smithi092 ceph-mon[33552]: pgmap v235: 65 pgs: 65 active+clean; 28 MiB data, 257 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s rd, 2.4 MiB/s wr, 132 op/s 2024-09-17T01:51:09.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:08 smithi031 ceph-mon[27673]: pgmap v235: 65 pgs: 65 active+clean; 28 MiB data, 257 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s rd, 2.4 MiB/s wr, 132 op/s 2024-09-17T01:51:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:09 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:09 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:10 smithi092 ceph-mon[33552]: pgmap v236: 65 pgs: 65 active+clean; 33 MiB data, 275 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.8 MiB/s wr, 172 op/s 2024-09-17T01:51:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:10 smithi031 ceph-mon[27673]: pgmap v236: 65 pgs: 65 active+clean; 33 MiB data, 275 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.8 MiB/s wr, 172 op/s 2024-09-17T01:51:13.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:13 smithi092 ceph-mon[33552]: pgmap v237: 65 pgs: 65 active+clean; 42 MiB data, 338 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.6 MiB/s wr, 304 op/s 2024-09-17T01:51:13.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:13 smithi031 ceph-mon[27673]: pgmap v237: 65 pgs: 65 active+clean; 42 MiB data, 338 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.6 MiB/s wr, 304 op/s 2024-09-17T01:51:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:15 smithi092 ceph-mon[33552]: pgmap v238: 65 pgs: 65 active+clean; 43 MiB data, 352 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.8 MiB/s wr, 336 op/s 2024-09-17T01:51:16.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:15 smithi031 ceph-mon[27673]: pgmap v238: 65 pgs: 65 active+clean; 43 MiB data, 352 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.8 MiB/s wr, 336 op/s 2024-09-17T01:51:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:17 smithi092 ceph-mon[33552]: pgmap v239: 65 pgs: 65 active+clean; 52 MiB data, 401 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 402 op/s 2024-09-17T01:51:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:17 smithi031 ceph-mon[27673]: pgmap v239: 65 pgs: 65 active+clean; 52 MiB data, 401 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 402 op/s 2024-09-17T01:51:18.717 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: Upgrade: Updating mgr.smithi092.tjdpfw 2024-09-17T01:51:18.717 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:18.718 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:51:18.718 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:51:18.718 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:51:18.718 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: Deploying daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:51:18.718 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:18 smithi092 ceph-mon[33552]: pgmap v240: 65 pgs: 65 active+clean; 64 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 467 op/s 2024-09-17T01:51:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: Upgrade: Updating mgr.smithi092.tjdpfw 2024-09-17T01:51:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:51:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:51:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:51:19.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: Deploying daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:51:19.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:18 smithi031 ceph-mon[27673]: pgmap v240: 65 pgs: 65 active+clean; 64 MiB data, 444 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 467 op/s 2024-09-17T01:51:20.645 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:20 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:51:20.645 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:20 smithi092 ceph-mon[33552]: pgmap v241: 65 pgs: 65 active+clean; 71 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 412 op/s 2024-09-17T01:51:21.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:20 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:51:21.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:20 smithi031 ceph-mon[27673]: pgmap v241: 65 pgs: 65 active+clean; 71 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 412 op/s 2024-09-17T01:51:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 -- 172.21.15.31:0/2939867491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31700ff140 msgr2=0x7f31700ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 --2- 172.21.15.31:0/2939867491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31700ff140 0x7f31700ff550 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3160009910 tx=0x7f3160009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 -- 172.21.15.31:0/2939867491 shutdown_connections 2024-09-17T01:51:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 --2- 172.21.15.31:0/2939867491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3170100340 0x7f3170100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 --2- 172.21.15.31:0/2939867491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31700ff140 0x7f31700ff550 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 -- 172.21.15.31:0/2939867491 >> 172.21.15.31:0/2939867491 conn(0x7f31700fa6d0 msgr2=0x7f31700fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 -- 172.21.15.31:0/2939867491 shutdown_connections 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.587+0000 7f3175271700 1 -- 172.21.15.31:0/2939867491 wait complete. 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.588+0000 7f3175271700 1 Processor -- start 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.588+0000 7f3175271700 1 -- start start 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.588+0000 7f3175271700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 0x7f3170069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f3175271700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170100340 0x7f31701985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f3175271700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3170198be0 con 0x7f3170100340 2024-09-17T01:51:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f3175271700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3170198d20 con 0x7f31700ff140 2024-09-17T01:51:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 0x7f3170069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 0x7f3170069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36468/0 (socket says 172.21.15.31:36468) 2024-09-17T01:51:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316effd700 1 -- 172.21.15.31:0/984667842 learned_addr learned my addr 172.21.15.31:0/984667842 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316e7fc700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170100340 0x7f31701985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316effd700 1 -- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170100340 msgr2=0x7f31701985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316effd700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170100340 0x7f31701985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316effd700 1 -- 172.21.15.31:0/984667842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600095f0 con 0x7f31700ff140 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.589+0000 7f316e7fc700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170100340 0x7f31701985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.590+0000 7f316effd700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 0x7f3170069990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3160005b40 tx=0x7f316000fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.590+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f316001d070 con 0x7f31700ff140 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.590+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3160005dc0 con 0x7f31700ff140 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.590+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3160017630 con 0x7f31700ff140 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.590+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3170198fa0 con 0x7f31700ff140 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.590+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3170199490 con 0x7f31700ff140 2024-09-17T01:51:21.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.591+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3170107c90 con 0x7f31700ff140 2024-09-17T01:51:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.592+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3160003680 con 0x7f31700ff140 2024-09-17T01:51:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.592+0000 7f3157fff700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f315806c680 0x7f315806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.593+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f316008cdd0 con 0x7f31700ff140 2024-09-17T01:51:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.593+0000 7f316e7fc700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f315806c680 0x7f315806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.593+0000 7f316e7fc700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f315806c680 0x7f315806eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3164009be0 tx=0x7f3164009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:21.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.597+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f316005aff0 con 0x7f31700ff140 2024-09-17T01:51:21.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.901+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3170104c90 con 0x7f315806c680 2024-09-17T01:51:21.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.903+0000 7f3157fff700 1 -- 172.21.15.31:0/984667842 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f3170104c90 con 0x7f315806c680 2024-09-17T01:51:21.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f315806c680 msgr2=0x7f315806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f315806c680 0x7f315806eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3164009be0 tx=0x7f3164009260 comp rx=0 tx=0).stop 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 msgr2=0x7f3170069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 0x7f3170069990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3160005b40 tx=0x7f316000fab0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 shutdown_connections 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f315806c680 0x7f315806eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31700ff140 0x7f3170069990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 --2- 172.21.15.31:0/984667842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3170100340 0x7f31701985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 >> 172.21.15.31:0/984667842 conn(0x7f31700fa6d0 msgr2=0x7f3170103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 shutdown_connections 2024-09-17T01:51:21.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:21.906+0000 7f3175271700 1 -- 172.21.15.31:0/984667842 wait complete. 2024-09-17T01:51:21.917 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/1486164672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec100d60 msgr2=0x7f8eec103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/1486164672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec100d60 0x7f8eec103140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009910 tx=0x7f8ee8009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/1486164672 shutdown_connections 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/1486164672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec103680 0x7f8eec105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/1486164672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec100d60 0x7f8eec103140 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/1486164672 >> 172.21.15.31:0/1486164672 conn(0x7f8eec0fa780 msgr2=0x7f8eec0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/1486164672 shutdown_connections 2024-09-17T01:51:22.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.053+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/1486164672 wait complete. 2024-09-17T01:51:22.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef3eb1700 1 Processor -- start 2024-09-17T01:51:22.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef3eb1700 1 -- start start 2024-09-17T01:51:22.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef3eb1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 0x7f8eec191d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef3eb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec103680 0x7f8eec1922d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef3eb1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec18e880 con 0x7f8eec103680 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef3eb1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec18e9f0 con 0x7f8eec100d60 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef1c4d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 0x7f8eec191d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef1c4d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 0x7f8eec191d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36476/0 (socket says 172.21.15.31:36476) 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef144c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec103680 0x7f8eec1922d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.054+0000 7f8ef1c4d700 1 -- 172.21.15.31:0/2813687265 learned_addr learned my addr 172.21.15.31:0/2813687265 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.055+0000 7f8ef1c4d700 1 -- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec103680 msgr2=0x7f8eec1922d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.055+0000 7f8ef1c4d700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec103680 0x7f8eec1922d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.055+0000 7f8ef1c4d700 1 -- 172.21.15.31:0/2813687265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80095f0 con 0x7f8eec100d60 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.055+0000 7f8ef1c4d700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 0x7f8eec191d90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800bda0 tx=0x7f8ee800bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.055+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee801d070 con 0x7f8eec100d60 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.055+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ee800f460 con 0x7f8eec100d60 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.056+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec18ec70 con 0x7f8eec100d60 2024-09-17T01:51:22.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.056+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee8021620 con 0x7f8eec100d60 2024-09-17T01:51:22.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.056+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec18f160 con 0x7f8eec100d60 2024-09-17T01:51:22.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.057+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec0fc340 con 0x7f8eec100d60 2024-09-17T01:51:22.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.057+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8ee800f5d0 con 0x7f8eec100d60 2024-09-17T01:51:22.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.058+0000 7f8ee2ffd700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ed806c680 0x7f8ed806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.058+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8ee808ca50 con 0x7f8eec100d60 2024-09-17T01:51:22.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.058+0000 7f8ef144c700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ed806c680 0x7f8ed806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.058+0000 7f8ef144c700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ed806c680 0x7f8ed806eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8edc005950 tx=0x7f8edc00b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:22.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.062+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8ee805ac70 con 0x7f8eec100d60 2024-09-17T01:51:22.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.352+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eec061190 con 0x7f8ed806c680 2024-09-17T01:51:22.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.354+0000 7f8ee2ffd700 1 -- 172.21.15.31:0/2813687265 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f8eec061190 con 0x7f8ed806c680 2024-09-17T01:51:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ed806c680 msgr2=0x7f8ed806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ed806c680 0x7f8ed806eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8edc005950 tx=0x7f8edc00b410 comp rx=0 tx=0).stop 2024-09-17T01:51:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 msgr2=0x7f8eec191d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 0x7f8eec191d90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800bda0 tx=0x7f8ee800bdd0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 shutdown_connections 2024-09-17T01:51:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f8ed806c680 0x7f8ed806eb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8eec100d60 0x7f8eec191d90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 --2- 172.21.15.31:0/2813687265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eec103680 0x7f8eec1922d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.356+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 >> 172.21.15.31:0/2813687265 conn(0x7f8eec0fa780 msgr2=0x7f8eec1042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.357+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 shutdown_connections 2024-09-17T01:51:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.357+0000 7f8ef3eb1700 1 -- 172.21.15.31:0/2813687265 wait complete. 2024-09-17T01:51:22.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.495+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/2932587395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28103600 msgr2=0x7f7a281059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.495+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/2932587395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28103600 0x7f7a281059e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009870 tx=0x7f7a1c009b80 comp rx=0 tx=0).stop 2024-09-17T01:51:22.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.495+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/2932587395 shutdown_connections 2024-09-17T01:51:22.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.495+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/2932587395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28103600 0x7f7a281059e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.495+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/2932587395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28100ce0 0x7f7a281030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.495+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/2932587395 >> 172.21.15.31:0/2932587395 conn(0x7f7a280fa700 msgr2=0x7f7a280fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:22.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.496+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/2932587395 shutdown_connections 2024-09-17T01:51:22.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.496+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/2932587395 wait complete. 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.496+0000 7f7a2d7fb700 1 Processor -- start 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a2d7fb700 1 -- start start 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a2d7fb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28100ce0 0x7f7a2819c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a2d7fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28103600 0x7f7a2819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a2d7fb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2819cc00 con 0x7f7a28103600 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a2d7fb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2819cd40 con 0x7f7a28100ce0 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a26ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28100ce0 0x7f7a2819c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a267fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28103600 0x7f7a2819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a26ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28100ce0 0x7f7a2819c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36490/0 (socket says 172.21.15.31:36490) 2024-09-17T01:51:22.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.497+0000 7f7a26ffd700 1 -- 172.21.15.31:0/327297193 learned_addr learned my addr 172.21.15.31:0/327297193 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:22.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a267fc700 1 -- 172.21.15.31:0/327297193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28100ce0 msgr2=0x7f7a2819c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a267fc700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28100ce0 0x7f7a2819c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a267fc700 1 -- 172.21.15.31:0/327297193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009520 con 0x7f7a28103600 2024-09-17T01:51:22.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a267fc700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28103600 0x7f7a2819c5e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009f50 tx=0x7f7a1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a1c01c070 con 0x7f7a28103600 2024-09-17T01:51:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a1c00fc90 con 0x7f7a28103600 2024-09-17T01:51:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a281a1790 con 0x7f7a28103600 2024-09-17T01:51:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a1c022de0 con 0x7f7a28103600 2024-09-17T01:51:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.498+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a281a1c50 con 0x7f7a28103600 2024-09-17T01:51:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.500+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a28107940 con 0x7f7a28103600 2024-09-17T01:51:22.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.501+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7a1c020070 con 0x7f7a28103600 2024-09-17T01:51:22.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.502+0000 7f7a0ffff700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a1006c680 0x7f7a1006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.502+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7a1c022590 con 0x7f7a28103600 2024-09-17T01:51:22.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.502+0000 7f7a26ffd700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a1006c680 0x7f7a1006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.503+0000 7f7a26ffd700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a1006c680 0x7f7a1006eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a18005950 tx=0x7f7a18009310 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:22.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.510+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7a1c05abe0 con 0x7f7a28103600 2024-09-17T01:51:22.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.850+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a28061190 con 0x7f7a1006c680 2024-09-17T01:51:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.861+0000 7f7a0ffff700 1 -- 172.21.15.31:0/327297193 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f7a28061190 con 0x7f7a1006c680 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (6m) 99s ago 7m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (7m) 99s ago 7m 7512k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (6m) 105s ago 6m 7428k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (7m) 99s ago 7m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (6m) 105s ago 6m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (5m) 99s ago 7m 86.8M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:51:22.860 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (119s) 99s ago 118s 16.7M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (2m) 99s ago 2m 16.2M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (116s) 105s ago 116s 17.0M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (2m) 105s ago 2m 15.5M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:9283,8765,8443 running (8m) 99s ago 8m 487M - 18.2.0 dc2bc1663786 5a9379d38d8b 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (6m) 105s ago 6m 436M - 18.2.0 dc2bc1663786 274101cf9cf2 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (9m) 99s ago 9m 44.2M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (6m) 105s ago 6m 34.7M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (7m) 99s ago 7m 16.0M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (6m) 105s ago 6m 14.9M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (5m) 99s ago 5m 48.2M 3948M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (5m) 99s ago 5m 51.9M 3948M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (4m) 99s ago 4m 45.9M 3948M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:51:22.861 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (4m) 105s ago 4m 49.2M 4970M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:51:22.862 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (3m) 105s ago 3m 43.2M 4970M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:51:22.862 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (3m) 105s ago 3m 46.7M 4970M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:51:22.862 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (5m) 99s ago 7m 61.9M - 2.43.0 a07b618ecd1d ed28452b08d0 2024-09-17T01:51:22.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.863+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a1006c680 msgr2=0x7f7a1006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.863+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a1006c680 0x7f7a1006eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a18005950 tx=0x7f7a18009310 comp rx=0 tx=0).stop 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.863+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28103600 msgr2=0x7f7a2819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.863+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28103600 0x7f7a2819c5e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009f50 tx=0x7f7a1c004770 comp rx=0 tx=0).stop 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 shutdown_connections 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f7a1006c680 0x7f7a1006eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a28100ce0 0x7f7a2819c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 --2- 172.21.15.31:0/327297193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a28103600 0x7f7a2819c5e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 >> 172.21.15.31:0/327297193 conn(0x7f7a280fa700 msgr2=0x7f7a280fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 shutdown_connections 2024-09-17T01:51:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.864+0000 7f7a2d7fb700 1 -- 172.21.15.31:0/327297193 wait complete. 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 -- 172.21.15.31:0/754643700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fe500 msgr2=0x7f0d100fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 --2- 172.21.15.31:0/754643700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fe500 0x7f0d100fe910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009910 tx=0x7f0d0c009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 -- 172.21.15.31:0/754643700 shutdown_connections 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 --2- 172.21.15.31:0/754643700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d100fee50 0x7f0d10101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 --2- 172.21.15.31:0/754643700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fe500 0x7f0d100fe910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 -- 172.21.15.31:0/754643700 >> 172.21.15.31:0/754643700 conn(0x7f0d100f9f10 msgr2=0x7f0d100fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 -- 172.21.15.31:0/754643700 shutdown_connections 2024-09-17T01:51:22.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.992+0000 7f0d17765700 1 -- 172.21.15.31:0/754643700 wait complete. 2024-09-17T01:51:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d17765700 1 Processor -- start 2024-09-17T01:51:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d17765700 1 -- start start 2024-09-17T01:51:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d17765700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d100fe500 0x7f0d10100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d17765700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 0x7f0d100ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d17765700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100ffa70 con 0x7f0d100fee50 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d17765700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100ffbb0 con 0x7f0d100fe500 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d14d00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 0x7f0d100ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d14d00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 0x7f0d100ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56022/0 (socket says 172.21.15.31:56022) 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d14d00700 1 -- 172.21.15.31:0/2846160311 learned_addr learned my addr 172.21.15.31:0/2846160311 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.993+0000 7f0d15501700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d100fe500 0x7f0d10100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d14d00700 1 -- 172.21.15.31:0/2846160311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d100fe500 msgr2=0x7f0d10100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d14d00700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d100fe500 0x7f0d10100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d14d00700 1 -- 172.21.15.31:0/2846160311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0095f0 con 0x7f0d100fee50 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d14d00700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 0x7f0d100ff530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000d8d0 tx=0x7f0d0000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d000041f0 con 0x7f0d100fee50 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d00004ce0 con 0x7f0d100fee50 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d0000f690 con 0x7f0d100fee50 2024-09-17T01:51:22.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d100ffe90 con 0x7f0d100fee50 2024-09-17T01:51:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.994+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1019db60 con 0x7f0d100fee50 2024-09-17T01:51:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.996+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10108d50 con 0x7f0d100fee50 2024-09-17T01:51:22.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.996+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0d00004e50 con 0x7f0d100fee50 2024-09-17T01:51:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.997+0000 7f0d067fc700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0cfc06c680 0x7f0cfc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.997+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0d0008b6f0 con 0x7f0d100fee50 2024-09-17T01:51:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.997+0000 7f0d15501700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0cfc06c680 0x7f0cfc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:22.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:22.998+0000 7f0d15501700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0cfc06c680 0x7f0cfc06eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b5c0 tx=0x7f0d0c005ee0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:23.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.002+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0d00059910 con 0x7f0d100fee50 2024-09-17T01:51:23.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.450+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d1019e320 con 0x7f0d100fee50 2024-09-17T01:51:23.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.451+0000 7f0d067fc700 1 -- 172.21.15.31:0/2846160311 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f0d000594a0 con 0x7f0d100fee50 2024-09-17T01:51:23.449 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:51:23.449 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:51:23.449 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:51:23.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:51:23.450 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:51:23.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0cfc06c680 msgr2=0x7f0cfc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0cfc06c680 0x7f0cfc06eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b5c0 tx=0x7f0d0c005ee0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 msgr2=0x7f0d100ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 0x7f0d100ff530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000d8d0 tx=0x7f0d0000dbe0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 shutdown_connections 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f0cfc06c680 0x7f0cfc06eb30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d100fe500 0x7f0d10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 --2- 172.21.15.31:0/2846160311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d100fee50 0x7f0d100ff530 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 >> 172.21.15.31:0/2846160311 conn(0x7f0d100f9f10 msgr2=0x7f0d101047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 shutdown_connections 2024-09-17T01:51:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.453+0000 7f0d17765700 1 -- 172.21.15.31:0/2846160311 wait complete. 2024-09-17T01:51:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 -- 172.21.15.31:0/1396075326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740ff420 msgr2=0x7fe9740ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 --2- 172.21.15.31:0/1396075326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740ff420 0x7fe9740ff890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe964009910 tx=0x7fe964009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 -- 172.21.15.31:0/1396075326 shutdown_connections 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 --2- 172.21.15.31:0/1396075326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740ff420 0x7fe9740ff890 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 --2- 172.21.15.31:0/1396075326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740fead0 0x7fe9740feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 -- 172.21.15.31:0/1396075326 >> 172.21.15.31:0/1396075326 conn(0x7fe9740fa700 msgr2=0x7fe9740fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 -- 172.21.15.31:0/1396075326 shutdown_connections 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.578+0000 7fe97c725700 1 -- 172.21.15.31:0/1396075326 wait complete. 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.579+0000 7fe97c725700 1 Processor -- start 2024-09-17T01:51:23.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.579+0000 7fe97c725700 1 -- start start 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.579+0000 7fe97c725700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 0x7fe974197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.579+0000 7fe97c725700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740ff420 0x7fe9741981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.579+0000 7fe97c725700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9741987f0 con 0x7fe9740fead0 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.579+0000 7fe97c725700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974198960 con 0x7fe9740ff420 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe97a4c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 0x7fe974197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe97a4c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 0x7fe974197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41964/0 (socket says 172.21.15.31:41964) 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe97a4c1700 1 -- 172.21.15.31:0/2263473180 learned_addr learned my addr 172.21.15.31:0/2263473180 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:23.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe979cc0700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740ff420 0x7fe9741981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe979cc0700 1 -- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 msgr2=0x7fe974197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe979cc0700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 0x7fe974197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe979cc0700 1 -- 172.21.15.31:0/2263473180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640095f0 con 0x7fe9740ff420 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe97a4c1700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 0x7fe974197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.580+0000 7fe979cc0700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740ff420 0x7fe9741981f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe964000c00 tx=0x7fe96400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.581+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe96401d070 con 0x7fe9740ff420 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.581+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97419d390 con 0x7fe9740ff420 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.581+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97419d880 con 0x7fe9740ff420 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.581+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe964005dc0 con 0x7fe9740ff420 2024-09-17T01:51:23.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.581+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe964017400 con 0x7fe9740ff420 2024-09-17T01:51:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.583+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe958005320 con 0x7fe9740ff420 2024-09-17T01:51:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.583+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe964003680 con 0x7fe9740ff420 2024-09-17T01:51:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.583+0000 7fe96b7fe700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe96006c680 0x7fe96006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.583+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe96408ca60 con 0x7fe9740ff420 2024-09-17T01:51:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.583+0000 7fe97a4c1700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe96006c680 0x7fe96006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:23.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.584+0000 7fe97a4c1700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe96006c680 0x7fe96006eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe974198b90 tx=0x7fe970009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:23.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.591+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe964057270 con 0x7fe9740ff420 2024-09-17T01:51:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:23 smithi031 ceph-mon[27673]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:23 smithi031 ceph-mon[27673]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:23 smithi031 ceph-mon[27673]: pgmap v242: 65 pgs: 65 active+clean; 87 MiB data, 487 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 482 op/s 2024-09-17T01:51:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:23 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2846160311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:51:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.931+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe958006200 con 0x7fe9740ff420 2024-09-17T01:51:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.932+0000 7fe96b7fe700 1 -- 172.21.15.31:0/2263473180 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1863 (secure 0 0 0) 0x7fe964020370 con 0x7fe9740ff420 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:e16 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 16 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:51:23.931 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:51:19.622148+0000 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:51:23.932 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:23.933 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:51:23.934 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:51:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe96006c680 msgr2=0x7fe96006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe96006c680 0x7fe96006eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe974198b90 tx=0x7fe970009260 comp rx=0 tx=0).stop 2024-09-17T01:51:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740ff420 msgr2=0x7fe9741981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740ff420 0x7fe9741981f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe964000c00 tx=0x7fe96400f690 comp rx=0 tx=0).stop 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 shutdown_connections 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7fe96006c680 0x7fe96006eb30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9740fead0 0x7fe974197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 --2- 172.21.15.31:0/2263473180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9740ff420 0x7fe9741981f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 >> 172.21.15.31:0/2263473180 conn(0x7fe9740fa700 msgr2=0x7fe974107100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 shutdown_connections 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:23.934+0000 7fe97c725700 1 -- 172.21.15.31:0/2263473180 wait complete. 2024-09-17T01:51:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2024-09-17T01:51:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:23 smithi092 ceph-mon[33552]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:23 smithi092 ceph-mon[33552]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:23 smithi092 ceph-mon[33552]: pgmap v242: 65 pgs: 65 active+clean; 87 MiB data, 487 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 482 op/s 2024-09-17T01:51:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:23 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2846160311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 -- 172.21.15.31:0/4030793299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 msgr2=0x7f49fc1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 --2- 172.21.15.31:0/4030793299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc1018a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009910 tx=0x7f49f0009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 -- 172.21.15.31:0/4030793299 shutdown_connections 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 --2- 172.21.15.31:0/4030793299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc1018a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 --2- 172.21.15.31:0/4030793299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49fc100250 0x7f49fc100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 -- 172.21.15.31:0/4030793299 >> 172.21.15.31:0/4030793299 conn(0x7f49fc0fb7e0 msgr2=0x7f49fc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 -- 172.21.15.31:0/4030793299 shutdown_connections 2024-09-17T01:51:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.098+0000 7f4a02002700 1 -- 172.21.15.31:0/4030793299 wait complete. 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.099+0000 7f4a02002700 1 Processor -- start 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.099+0000 7f4a02002700 1 -- start start 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f4a02002700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49fc100250 0x7f49fc195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f4a02002700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f4a02002700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc196600 con 0x7f49fc101450 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f4a02002700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc196740 con 0x7f49fc100250 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41978/0 (socket says 172.21.15.31:41978) 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 -- 172.21.15.31:0/2369186957 learned_addr learned my addr 172.21.15.31:0/2369186957 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49fb7fe700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49fc100250 0x7f49fc195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 -- 172.21.15.31:0/2369186957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49fc100250 msgr2=0x7f49fc195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49fc100250 0x7f49fc195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 -- 172.21.15.31:0/2369186957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00095f0 con 0x7f49fc101450 2024-09-17T01:51:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49faffd700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc195fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f49f000bd70 tx=0x7f49f000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.100+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f001d070 con 0x7f49fc101450 2024-09-17T01:51:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.101+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49f0005dc0 con 0x7f49fc101450 2024-09-17T01:51:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.101+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc19b190 con 0x7f49fc101450 2024-09-17T01:51:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.102+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49f0021410 con 0x7f49fc101450 2024-09-17T01:51:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.102+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc19b5c0 con 0x7f49fc101450 2024-09-17T01:51:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.102+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f49f0017400 con 0x7f49fc101450 2024-09-17T01:51:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.103+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc108da0 con 0x7f49fc101450 2024-09-17T01:51:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.103+0000 7f49f8ff9700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f49e406c470 0x7f49e406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.103+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f49f008c640 con 0x7f49fc101450 2024-09-17T01:51:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.103+0000 7f49fb7fe700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f49e406c470 0x7f49e406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.104+0000 7f49fb7fe700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f49e406c470 0x7f49e406e920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f49fc1012b0 tx=0x7f49ec007400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.108+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f49f00c4720 con 0x7f49fc101450 2024-09-17T01:51:24.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.387+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 --> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49fc105da0 con 0x7f49e406c470 2024-09-17T01:51:24.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.389+0000 7f49f8ff9700 1 -- 172.21.15.31:0/2369186957 <== mgr.14213 v2:172.21.15.31:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f49fc105da0 con 0x7f49e406c470 2024-09-17T01:51:24.387 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [], 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:51:24.388 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:51:24.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.392+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f49e406c470 msgr2=0x7f49e406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.392+0000 7f4a02002700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f49e406c470 0x7f49e406e920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f49fc1012b0 tx=0x7f49ec007400 comp rx=0 tx=0).stop 2024-09-17T01:51:24.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.392+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 msgr2=0x7f49fc195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.392+0000 7f4a02002700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc195fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f49f000bd70 tx=0x7f49f000bda0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 shutdown_connections 2024-09-17T01:51:24.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f49e406c470 0x7f49e406e920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49fc100250 0x7f49fc195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 --2- 172.21.15.31:0/2369186957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49fc101450 0x7f49fc195fe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 >> 172.21.15.31:0/2369186957 conn(0x7f49fc0fb7e0 msgr2=0x7f49fc104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:24.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 shutdown_connections 2024-09-17T01:51:24.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.393+0000 7f4a02002700 1 -- 172.21.15.31:0/2369186957 wait complete. 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 -- 172.21.15.31:0/718695519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 msgr2=0x7f1548100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 --2- 172.21.15.31:0/718695519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f1548100860 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1534009910 tx=0x7f1534009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 -- 172.21.15.31:0/718695519 shutdown_connections 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 --2- 172.21.15.31:0/718695519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f1548100860 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 --2- 172.21.15.31:0/718695519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f15480ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 -- 172.21.15.31:0/718695519 >> 172.21.15.31:0/718695519 conn(0x7f15480fa7a0 msgr2=0x7f15480fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 -- 172.21.15.31:0/718695519 shutdown_connections 2024-09-17T01:51:24.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.552+0000 7f154f029700 1 -- 172.21.15.31:0/718695519 wait complete. 2024-09-17T01:51:24.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154f029700 1 Processor -- start 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154f029700 1 -- start start 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154f029700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f1548197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154f029700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f15481984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154f029700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548198b10 con 0x7f15481003f0 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154f029700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548198c50 con 0x7f15480ff150 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f1547fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f15481984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.553+0000 7f154cdc5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f1548197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f154cdc5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f1548197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:45596/0 (socket says 172.21.15.31:45596) 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f154cdc5700 1 -- 172.21.15.31:0/2591210923 learned_addr learned my addr 172.21.15.31:0/2591210923 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f1547fff700 1 -- 172.21.15.31:0/2591210923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 msgr2=0x7f1548197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f1547fff700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f1548197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f1547fff700 1 -- 172.21.15.31:0/2591210923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340095f0 con 0x7f15481003f0 2024-09-17T01:51:24.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f154cdc5700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f1548197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:51:24.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.554+0000 7f1547fff700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f15481984f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f153400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:24.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.555+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f153401d070 con 0x7f15481003f0 2024-09-17T01:51:24.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.555+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1534005dc0 con 0x7f15481003f0 2024-09-17T01:51:24.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.556+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1534017630 con 0x7f15481003f0 2024-09-17T01:51:24.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.556+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154819d6a0 con 0x7f15481003f0 2024-09-17T01:51:24.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.556+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154819db90 con 0x7f15481003f0 2024-09-17T01:51:24.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.557+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1548068ab0 con 0x7f15481003f0 2024-09-17T01:51:24.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.558+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1534003910 con 0x7f15481003f0 2024-09-17T01:51:24.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.559+0000 7f1545ffb700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f153806c680 0x7f153806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:24.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.559+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f153408cc40 con 0x7f15481003f0 2024-09-17T01:51:24.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.559+0000 7f154cdc5700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f153806c680 0x7f153806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:24.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.559+0000 7f154cdc5700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f153806c680 0x7f153806eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f153c009d70 tx=0x7f153c009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.567+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1534092020 con 0x7f15481003f0 2024-09-17T01:51:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:24 smithi092 ceph-mon[33552]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:24 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2263473180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:51:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:24 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:24 smithi031 ceph-mon[27673]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:24 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2263473180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:51:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:24 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:24.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.943+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f154819ddb0 con 0x7f15481003f0 2024-09-17T01:51:24.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.944+0000 7f1545ffb700 1 -- 172.21.15.31:0/2591210923 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f153405ae60 con 0x7f15481003f0 2024-09-17T01:51:24.943 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:51:24.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f153806c680 msgr2=0x7f153806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f153806c680 0x7f153806eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f153c009d70 tx=0x7f153c009260 comp rx=0 tx=0).stop 2024-09-17T01:51:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 msgr2=0x7f15481984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f15481984f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f153400f740 comp rx=0 tx=0).stop 2024-09-17T01:51:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 shutdown_connections 2024-09-17T01:51:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:6800/2,v1:172.21.15.31:6801/2] conn(0x7f153806c680 0x7f153806eb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15480ff150 0x7f1548197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 --2- 172.21.15.31:0/2591210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15481003f0 0x7f15481984f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.946+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 >> 172.21.15.31:0/2591210923 conn(0x7f15480fa7a0 msgr2=0x7f1548068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.947+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 shutdown_connections 2024-09-17T01:51:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:24.947+0000 7f154f029700 1 -- 172.21.15.31:0/2591210923 wait complete. 2024-09-17T01:51:25.843 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:25 smithi092 ceph-mon[33552]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:25.843 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:25 smithi092 ceph-mon[33552]: pgmap v243: 65 pgs: 65 active+clean; 89 MiB data, 507 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 370 op/s 2024-09-17T01:51:25.843 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:25 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2591210923' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:51:25.844 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:25 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:25.844 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:25 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:25.844 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:25 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:51:26.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:25 smithi031 ceph-mon[27673]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:25 smithi031 ceph-mon[27673]: pgmap v243: 65 pgs: 65 active+clean; 89 MiB data, 507 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 370 op/s 2024-09-17T01:51:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:25 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2591210923' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:51:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:25 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:25 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:25 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:51:27.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:27 smithi092 ceph-mon[33552]: pgmap v244: 65 pgs: 65 active+clean; 96 MiB data, 544 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-09-17T01:51:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:27 smithi031 ceph-mon[27673]: pgmap v244: 65 pgs: 65 active+clean; 96 MiB data, 544 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-09-17T01:51:29.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:28 smithi092 ceph-mon[33552]: pgmap v245: 65 pgs: 65 active+clean; 103 MiB data, 557 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 412 op/s 2024-09-17T01:51:29.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:28 smithi031 ceph-mon[27673]: pgmap v245: 65 pgs: 65 active+clean; 103 MiB data, 557 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 412 op/s 2024-09-17T01:51:31.701 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: pgmap v246: 65 pgs: 65 active+clean; 110 MiB data, 573 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 366 op/s 2024-09-17T01:51:31.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw restarted 2024-09-17T01:51:31.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:51:31.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:51:31.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:51:31.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:51:31.702 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:31 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:51:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: pgmap v246: 65 pgs: 65 active+clean; 110 MiB data, 573 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.0 MiB/s wr, 366 op/s 2024-09-17T01:51:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: Standby manager daemon smithi092.tjdpfw restarted 2024-09-17T01:51:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:51:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:51:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:51:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:51:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:31 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:51:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:32 smithi092 ceph-mon[33552]: mgrmap e20: smithi031.ealpiz(active, since 7m), standbys: smithi092.tjdpfw 2024-09-17T01:51:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:32 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:32 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:32.950 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:32 smithi031 ceph-mon[27673]: mgrmap e20: smithi031.ealpiz(active, since 7m), standbys: smithi092.tjdpfw 2024-09-17T01:51:32.951 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:32.951 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:32 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:33.914 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:33 smithi092 ceph-mon[33552]: pgmap v247: 65 pgs: 65 active+clean; 116 MiB data, 614 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 478 op/s 2024-09-17T01:51:33.914 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:33.914 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:33 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:33 smithi031 ceph-mon[27673]: pgmap v247: 65 pgs: 65 active+clean; 116 MiB data, 614 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 478 op/s 2024-09-17T01:51:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:33 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:35 smithi092 ceph-mon[33552]: pgmap v248: 65 pgs: 65 active+clean; 121 MiB data, 635 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 412 op/s 2024-09-17T01:51:36.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:35 smithi031 ceph-mon[27673]: pgmap v248: 65 pgs: 65 active+clean; 121 MiB data, 635 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 412 op/s 2024-09-17T01:51:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:37 smithi092 ceph-mon[33552]: pgmap v249: 65 pgs: 65 active+clean; 130 MiB data, 685 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 474 op/s 2024-09-17T01:51:38.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:37 smithi031 ceph-mon[27673]: pgmap v249: 65 pgs: 65 active+clean; 130 MiB data, 685 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 474 op/s 2024-09-17T01:51:39.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:38 smithi092 ceph-mon[33552]: pgmap v250: 65 pgs: 65 active+clean; 139 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 538 op/s 2024-09-17T01:51:39.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:38 smithi031 ceph-mon[27673]: pgmap v250: 65 pgs: 65 active+clean; 139 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 538 op/s 2024-09-17T01:51:40.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:39 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:40.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:39 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:40 smithi092 ceph-mon[33552]: pgmap v251: 65 pgs: 65 active+clean; 145 MiB data, 737 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 487 op/s 2024-09-17T01:51:41.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:40 smithi031 ceph-mon[27673]: pgmap v251: 65 pgs: 65 active+clean; 145 MiB data, 737 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 487 op/s 2024-09-17T01:51:43.900 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:43 smithi031 ceph-mon[27673]: pgmap v252: 65 pgs: 65 active+clean; 164 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 569 op/s 2024-09-17T01:51:43.916 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:43 smithi092 ceph-mon[33552]: pgmap v252: 65 pgs: 65 active+clean; 164 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 569 op/s 2024-09-17T01:51:45.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: pgmap v253: 65 pgs: 65 active+clean; 166 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 454 op/s 2024-09-17T01:51:45.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:45.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:45.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:51:45.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:51:45.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr fail", "who": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "mgr fail", "who": "smithi031.ealpiz"}]': finished 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: mgrmap e21: smithi092.tjdpfw(active, starting, since 0.00887171s) 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:51:45.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:51:45.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:51:45.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:51:45.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:51:45.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:51:45.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:51:45.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: Manager daemon smithi092.tjdpfw is now available 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: Migrating agent root cert to cert store 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: Migrating agent root key to cert store 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: Checking for cert/key for grafana.smithi031 2024-09-17T01:51:45.743 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: Migrating grafana.smithi031 cert to cert store 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: Migrating grafana.smithi031 key to cert store 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/trash_purge_schedule"}]: dispatch 2024-09-17T01:51:45.744 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:45 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/trash_purge_schedule"}]: dispatch 2024-09-17T01:51:45.757 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: pgmap v253: 65 pgs: 65 active+clean; 166 MiB data, 806 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 454 op/s 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr fail", "who": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.14213 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "mgr fail", "who": "smithi031.ealpiz"}]': finished 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: mgrmap e21: smithi092.tjdpfw(active, starting, since 0.00887171s) 2024-09-17T01:51:45.758 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:51:45.759 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: Manager daemon smithi092.tjdpfw is now available 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: Migrating agent root cert to cert store 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: Migrating agent root key to cert store 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: Checking for cert/key for grafana.smithi031 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: Migrating grafana.smithi031 cert to cert store 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.760 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: Migrating grafana.smithi031 key to cert store 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/trash_purge_schedule"}]: dispatch 2024-09-17T01:51:45.761 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:45 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi092.tjdpfw/trash_purge_schedule"}]: dispatch 2024-09-17T01:51:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:46 smithi092 ceph-mon[33552]: mgrmap e22: smithi092.tjdpfw(active, since 1.01003s) 2024-09-17T01:51:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:46 smithi092 ceph-mon[33552]: pgmap v3: 65 pgs: 65 active+clean; 190 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:51:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:46 smithi092 ceph-mon[33552]: Deploying cephadm binary to smithi092 2024-09-17T01:51:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:46 smithi092 ceph-mon[33552]: Deploying cephadm binary to smithi031 2024-09-17T01:51:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:46 smithi031 ceph-mon[27673]: mgrmap e22: smithi092.tjdpfw(active, since 1.01003s) 2024-09-17T01:51:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:46 smithi031 ceph-mon[27673]: pgmap v3: 65 pgs: 65 active+clean; 190 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:51:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:46 smithi031 ceph-mon[27673]: Deploying cephadm binary to smithi092 2024-09-17T01:51:47.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:46 smithi031 ceph-mon[27673]: Deploying cephadm binary to smithi031 2024-09-17T01:51:47.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:47 smithi092 ceph-mon[33552]: pgmap v4: 65 pgs: 65 active+clean; 190 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:51:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:47 smithi092 ceph-mon[33552]: [17/Sep/2024:01:51:47] ENGINE Bus STARTING 2024-09-17T01:51:48.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:47 smithi031 ceph-mon[27673]: pgmap v4: 65 pgs: 65 active+clean; 190 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:51:48.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:47 smithi031 ceph-mon[27673]: [17/Sep/2024:01:51:47] ENGINE Bus STARTING 2024-09-17T01:51:48.964 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:48 smithi031 ceph-mon[27673]: [17/Sep/2024:01:51:47] ENGINE Serving on https://172.21.15.92:7150 2024-09-17T01:51:48.964 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:48 smithi031 ceph-mon[27673]: [17/Sep/2024:01:51:47] ENGINE Error in HTTPServer.serve 2024-09-17T01:51:48.964 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Traceback (most recent call last): 2024-09-17T01:51:48.964 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._run(expiration_interval) 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: s = self.context.wrap_socket( 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: return self.sslsocket_class._create( 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:51:48.965 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self.do_handshake() 2024-09-17T01:51:48.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:51:48.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._sslobj.do_handshake() 2024-09-17T01:51:48.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:51:48.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:48 smithi031 ceph-mon[27673]: [17/Sep/2024:01:51:47] ENGINE Serving on http://172.21.15.92:8765 2024-09-17T01:51:48.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:48 smithi031 ceph-mon[27673]: [17/Sep/2024:01:51:47] ENGINE Bus STARTED 2024-09-17T01:51:48.966 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:48 smithi031 ceph-mon[27673]: mgrmap e23: smithi092.tjdpfw(active, since 3s) 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:48 smithi092 ceph-mon[33552]: [17/Sep/2024:01:51:47] ENGINE Serving on https://172.21.15.92:7150 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:48 smithi092 ceph-mon[33552]: [17/Sep/2024:01:51:47] ENGINE Error in HTTPServer.serve 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Traceback (most recent call last): 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:51:48.981 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._run(expiration_interval) 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: s = self.context.wrap_socket( 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: return self.sslsocket_class._create( 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self.do_handshake() 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._sslobj.do_handshake() 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:51:48.982 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:48 smithi092 ceph-mon[33552]: [17/Sep/2024:01:51:47] ENGINE Serving on http://172.21.15.92:8765 2024-09-17T01:51:48.983 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:48 smithi092 ceph-mon[33552]: [17/Sep/2024:01:51:47] ENGINE Bus STARTED 2024-09-17T01:51:48.983 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:48 smithi092 ceph-mon[33552]: mgrmap e23: smithi092.tjdpfw(active, since 3s) 2024-09-17T01:51:49.891 INFO:tasks.workunit.client.0.smithi031.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:51:49.897 INFO:tasks.workunit.client.0.smithi031.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:51:49.897 INFO:tasks.workunit.client.0.smithi031.stderr:+ make 2024-09-17T01:51:50.039 INFO:tasks.workunit.client.0.smithi031.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:51:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:49 smithi092 ceph-mon[33552]: pgmap v5: 65 pgs: 65 active+clean; 190 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:51:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:49 smithi031 ceph-mon[27673]: pgmap v5: 65 pgs: 65 active+clean; 190 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:51:51.241 INFO:tasks.workunit.client.0.smithi031.stderr:++ readlink -f fsstress 2024-09-17T01:51:51.243 INFO:tasks.workunit.client.0.smithi031.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:51:51.243 INFO:tasks.workunit.client.0.smithi031.stderr:+ popd 2024-09-17T01:51:51.244 INFO:tasks.workunit.client.0.smithi031.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:51:51.245 INFO:tasks.workunit.client.0.smithi031.stderr:+ popd 2024-09-17T01:51:51.245 INFO:tasks.workunit.client.0.smithi031.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:51:51.246 INFO:tasks.workunit.client.0.smithi031.stderr:++ mktemp -d -p . 2024-09-17T01:51:51.248 INFO:tasks.workunit.client.0.smithi031.stderr:+ T=./tmp.mgE5bhRenx 2024-09-17T01:51:51.248 INFO:tasks.workunit.client.0.smithi031.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.mgE5bhRenx -l 1 -n 1000 -p 10 -v 2024-09-17T01:51:51.252 INFO:tasks.workunit.client.0.smithi031.stdout:seed = 1726679016 2024-09-17T01:51:51.258 INFO:tasks.workunit.client.0.smithi031.stdout:1/0: write - no filename 2024-09-17T01:51:51.259 INFO:tasks.workunit.client.0.smithi031.stdout:0/0: mkdir d0 0 2024-09-17T01:51:51.259 INFO:tasks.workunit.client.0.smithi031.stdout:0/1: write - no filename 2024-09-17T01:51:51.260 INFO:tasks.workunit.client.0.smithi031.stdout:2/0: link - no file 2024-09-17T01:51:51.260 INFO:tasks.workunit.client.0.smithi031.stdout:2/1: read - no filename 2024-09-17T01:51:51.260 INFO:tasks.workunit.client.0.smithi031.stdout:2/2: readlink - no filename 2024-09-17T01:51:51.261 INFO:tasks.workunit.client.0.smithi031.stdout:1/1: mknod c0 0 2024-09-17T01:51:51.261 INFO:tasks.workunit.client.0.smithi031.stdout:1/2: stat c0 0 2024-09-17T01:51:51.261 INFO:tasks.workunit.client.0.smithi031.stdout:1/3: write - no filename 2024-09-17T01:51:51.261 INFO:tasks.workunit.client.0.smithi031.stdout:0/2: symlink d0/l1 0 2024-09-17T01:51:51.262 INFO:tasks.workunit.client.0.smithi031.stdout:0/3: dread - no filename 2024-09-17T01:51:51.262 INFO:tasks.workunit.client.0.smithi031.stdout:3/0: fsync - no filename 2024-09-17T01:51:51.263 INFO:tasks.workunit.client.0.smithi031.stdout:3/1: truncate - no filename 2024-09-17T01:51:51.263 INFO:tasks.workunit.client.0.smithi031.stdout:3/2: write - no filename 2024-09-17T01:51:51.263 INFO:tasks.workunit.client.0.smithi031.stdout:1/4: symlink l1 0 2024-09-17T01:51:51.263 INFO:tasks.workunit.client.0.smithi031.stdout:1/5: dread - no filename 2024-09-17T01:51:51.264 INFO:tasks.workunit.client.0.smithi031.stdout:0/4: creat d0/f2 x:0 0 0 2024-09-17T01:51:51.265 INFO:tasks.workunit.client.0.smithi031.stdout:2/3: symlink l0 0 2024-09-17T01:51:51.265 INFO:tasks.workunit.client.0.smithi031.stdout:0/5: readlink d0/l1 0 2024-09-17T01:51:51.265 INFO:tasks.workunit.client.0.smithi031.stdout:2/4: chown l0 165776186 1 2024-09-17T01:51:51.266 INFO:tasks.workunit.client.0.smithi031.stdout:4/0: fsync - no filename 2024-09-17T01:51:51.268 INFO:tasks.workunit.client.0.smithi031.stdout:2/5: unlink l0 0 2024-09-17T01:51:51.269 INFO:tasks.workunit.client.0.smithi031.stdout:3/3: creat f0 x:0 0 0 2024-09-17T01:51:51.271 INFO:tasks.workunit.client.0.smithi031.stdout:5/0: read - no filename 2024-09-17T01:51:51.271 INFO:tasks.workunit.client.0.smithi031.stdout:5/1: write - no filename 2024-09-17T01:51:51.271 INFO:tasks.workunit.client.0.smithi031.stdout:5/2: dwrite - no filename 2024-09-17T01:51:51.271 INFO:tasks.workunit.client.0.smithi031.stdout:5/3: chown . 18746 1 2024-09-17T01:51:51.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/6: mkdir d1 0 2024-09-17T01:51:51.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/7: readlink - no filename 2024-09-17T01:51:51.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/8: dread - no filename 2024-09-17T01:51:51.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/9: write - no filename 2024-09-17T01:51:51.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/10: chown d1 629234285 1 2024-09-17T01:51:51.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/11: truncate - no filename 2024-09-17T01:51:51.274 INFO:tasks.workunit.client.0.smithi031.stdout:3/4: unlink f0 0 2024-09-17T01:51:51.274 INFO:tasks.workunit.client.0.smithi031.stdout:3/5: write - no filename 2024-09-17T01:51:51.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/0: write - no filename 2024-09-17T01:51:51.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/1: dwrite - no filename 2024-09-17T01:51:51.285 INFO:tasks.workunit.client.0.smithi031.stdout:7/0: unlink - no file 2024-09-17T01:51:51.285 INFO:tasks.workunit.client.0.smithi031.stdout:7/1: write - no filename 2024-09-17T01:51:51.285 INFO:tasks.workunit.client.0.smithi031.stdout:1/6: getdents . 0 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:5/4: mknod c0 0 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:5/5: dread - no filename 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:5/6: dread - no filename 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:5/7: fsync - no filename 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:5/8: dwrite - no filename 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:5/9: fsync - no filename 2024-09-17T01:51:51.286 INFO:tasks.workunit.client.0.smithi031.stdout:0/6: fsync d0/f2 0 2024-09-17T01:51:51.287 INFO:tasks.workunit.client.0.smithi031.stdout:2/12: creat d1/f2 x:0 0 0 2024-09-17T01:51:51.288 INFO:tasks.workunit.client.0.smithi031.stdout:2/13: truncate d1/f2 709997 0 2024-09-17T01:51:51.289 INFO:tasks.workunit.client.0.smithi031.stdout:8/0: dwrite - no filename 2024-09-17T01:51:51.289 INFO:tasks.workunit.client.0.smithi031.stdout:8/1: dwrite - no filename 2024-09-17T01:51:51.289 INFO:tasks.workunit.client.0.smithi031.stdout:8/2: fdatasync - no filename 2024-09-17T01:51:51.289 INFO:tasks.workunit.client.0.smithi031.stdout:8/3: chown . 735 1 2024-09-17T01:51:51.290 INFO:tasks.workunit.client.0.smithi031.stdout:8/4: fsync - no filename 2024-09-17T01:51:51.290 INFO:tasks.workunit.client.0.smithi031.stdout:8/5: dread - no filename 2024-09-17T01:51:51.291 INFO:tasks.workunit.client.0.smithi031.stdout:6/2: mknod c0 0 2024-09-17T01:51:51.293 INFO:tasks.workunit.client.0.smithi031.stdout:1/7: creat f2 x:0 0 0 2024-09-17T01:51:51.294 INFO:tasks.workunit.client.0.smithi031.stdout:5/10: mknod c1 0 2024-09-17T01:51:51.294 INFO:tasks.workunit.client.0.smithi031.stdout:1/8: write f2 [655872,19598] 0 2024-09-17T01:51:51.295 INFO:tasks.workunit.client.0.smithi031.stdout:5/11: chown c1 1440429549 1 2024-09-17T01:51:51.296 INFO:tasks.workunit.client.0.smithi031.stdout:0/7: mkdir d0/d3 0 2024-09-17T01:51:51.301 INFO:tasks.workunit.client.0.smithi031.stdout:9/0: write - no filename 2024-09-17T01:51:51.301 INFO:tasks.workunit.client.0.smithi031.stdout:7/2: symlink l0 0 2024-09-17T01:51:51.304 INFO:tasks.workunit.client.0.smithi031.stdout:6/3: rename c0 to c1 0 2024-09-17T01:51:51.304 INFO:tasks.workunit.client.0.smithi031.stdout:6/4: write - no filename 2024-09-17T01:51:51.304 INFO:tasks.workunit.client.0.smithi031.stdout:6/5: truncate - no filename 2024-09-17T01:51:51.306 INFO:tasks.workunit.client.0.smithi031.stdout:1/9: rename f2 to f3 0 2024-09-17T01:51:51.306 INFO:tasks.workunit.client.0.smithi031.stdout:2/14: rmdir d1 39 2024-09-17T01:51:51.308 INFO:tasks.workunit.client.0.smithi031.stdout:5/12: symlink l2 0 2024-09-17T01:51:51.308 INFO:tasks.workunit.client.0.smithi031.stdout:5/13: chown l2 0 1 2024-09-17T01:51:51.308 INFO:tasks.workunit.client.0.smithi031.stdout:5/14: write - no filename 2024-09-17T01:51:51.310 INFO:tasks.workunit.client.0.smithi031.stdout:7/3: mknod c1 0 2024-09-17T01:51:51.311 INFO:tasks.workunit.client.0.smithi031.stdout:8/6: mkdir d0 0 2024-09-17T01:51:51.313 INFO:tasks.workunit.client.0.smithi031.stdout:6/6: symlink l2 0 2024-09-17T01:51:51.313 INFO:tasks.workunit.client.0.smithi031.stdout:6/7: write - no filename 2024-09-17T01:51:51.317 INFO:tasks.workunit.client.0.smithi031.stdout:0/8: symlink d0/d3/l4 0 2024-09-17T01:51:51.317 INFO:tasks.workunit.client.0.smithi031.stdout:2/15: dread d1/f2 [0,4194304] 0 2024-09-17T01:51:51.318 INFO:tasks.workunit.client.0.smithi031.stdout:0/9: truncate d0/f2 692871 0 2024-09-17T01:51:51.318 INFO:tasks.workunit.client.0.smithi031.stdout:5/15: unlink l2 0 2024-09-17T01:51:51.318 INFO:tasks.workunit.client.0.smithi031.stdout:5/16: write - no filename 2024-09-17T01:51:51.318 INFO:tasks.workunit.client.0.smithi031.stdout:0/10: stat d0/l1 0 2024-09-17T01:51:51.319 INFO:tasks.workunit.client.0.smithi031.stdout:0/11: stat d0/d3 0 2024-09-17T01:51:51.319 INFO:tasks.workunit.client.0.smithi031.stdout:9/1: symlink l0 0 2024-09-17T01:51:51.321 INFO:tasks.workunit.client.0.smithi031.stdout:7/4: rename c1 to c2 0 2024-09-17T01:51:51.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/8: mknod c3 0 2024-09-17T01:51:51.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/9: write - no filename 2024-09-17T01:51:51.326 INFO:tasks.workunit.client.0.smithi031.stdout:5/17: mknod c3 0 2024-09-17T01:51:51.326 INFO:tasks.workunit.client.0.smithi031.stdout:5/18: rmdir - no directory 2024-09-17T01:51:51.327 INFO:tasks.workunit.client.0.smithi031.stdout:5/19: chown c3 5 1 2024-09-17T01:51:51.328 INFO:tasks.workunit.client.0.smithi031.stdout:2/16: mkdir d1/d3 0 2024-09-17T01:51:51.331 INFO:tasks.workunit.client.0.smithi031.stdout:9/2: symlink l1 0 2024-09-17T01:51:51.331 INFO:tasks.workunit.client.0.smithi031.stdout:9/3: dwrite - no filename 2024-09-17T01:51:51.333 INFO:tasks.workunit.client.0.smithi031.stdout:8/7: mkdir d0/d1 0 2024-09-17T01:51:51.333 INFO:tasks.workunit.client.0.smithi031.stdout:8/8: unlink - no file 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/9: chown d0/d1 1154275 1 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/10: write - no filename 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/11: dread - no filename 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/12: dwrite - no filename 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/13: write - no filename 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/14: write - no filename 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/15: fdatasync - no filename 2024-09-17T01:51:51.334 INFO:tasks.workunit.client.0.smithi031.stdout:8/16: write - no filename 2024-09-17T01:51:51.337 INFO:tasks.workunit.client.0.smithi031.stdout:5/20: creat f4 x:0 0 0 2024-09-17T01:51:51.338 INFO:tasks.workunit.client.0.smithi031.stdout:1/10: truncate f3 218063 0 2024-09-17T01:51:51.339 INFO:tasks.workunit.client.0.smithi031.stdout:2/17: fdatasync d1/f2 0 2024-09-17T01:51:51.340 INFO:tasks.workunit.client.0.smithi031.stdout:2/18: write d1/f2 [1450632,114485] 0 2024-09-17T01:51:51.341 INFO:tasks.workunit.client.0.smithi031.stdout:2/19: readlink - no filename 2024-09-17T01:51:51.343 INFO:tasks.workunit.client.0.smithi031.stdout:9/4: rename l1 to l2 0 2024-09-17T01:51:51.344 INFO:tasks.workunit.client.0.smithi031.stdout:7/5: stat c2 0 2024-09-17T01:51:51.347 INFO:tasks.workunit.client.0.smithi031.stdout:5/21: creat f5 x:0 0 0 2024-09-17T01:51:51.348 INFO:tasks.workunit.client.0.smithi031.stdout:5/22: write f4 [869938,51600] 0 2024-09-17T01:51:51.349 INFO:tasks.workunit.client.0.smithi031.stdout:5/23: chown c0 26541410 1 2024-09-17T01:51:51.352 INFO:tasks.workunit.client.0.smithi031.stdout:9/5: mkdir d3 0 2024-09-17T01:51:51.352 INFO:tasks.workunit.client.0.smithi031.stdout:9/6: stat l0 0 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/10: link c3 c4 0 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/11: write - no filename 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/12: rmdir - no directory 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/13: truncate - no filename 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/14: fdatasync - no filename 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/15: fsync - no filename 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/16: write - no filename 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/17: fsync - no filename 2024-09-17T01:51:51.353 INFO:tasks.workunit.client.0.smithi031.stdout:6/18: dwrite - no filename 2024-09-17T01:51:51.355 INFO:tasks.workunit.client.0.smithi031.stdout:5/24: fsync f5 0 2024-09-17T01:51:51.355 INFO:tasks.workunit.client.0.smithi031.stdout:5/25: stat f4 0 2024-09-17T01:51:51.356 INFO:tasks.workunit.client.0.smithi031.stdout:5/26: chown c0 98739305 1 2024-09-17T01:51:51.356 INFO:tasks.workunit.client.0.smithi031.stdout:0/12: getdents d0/d3 0 2024-09-17T01:51:51.358 INFO:tasks.workunit.client.0.smithi031.stdout:2/20: creat d1/d3/f4 x:0 0 0 2024-09-17T01:51:51.359 INFO:tasks.workunit.client.0.smithi031.stdout:2/21: dread - d1/d3/f4 zero size 2024-09-17T01:51:51.360 INFO:tasks.workunit.client.0.smithi031.stdout:6/19: creat f5 x:0 0 0 2024-09-17T01:51:51.361 INFO:tasks.workunit.client.0.smithi031.stdout:5/27: dread f4 [0,4194304] 0 2024-09-17T01:51:51.361 INFO:tasks.workunit.client.0.smithi031.stdout:2/22: truncate d1/d3/f4 702883 0 2024-09-17T01:51:51.364 INFO:tasks.workunit.client.0.smithi031.stdout:5/28: dread f4 [0,4194304] 0 2024-09-17T01:51:51.364 INFO:tasks.workunit.client.0.smithi031.stdout:0/13: mkdir d0/d3/d5 0 2024-09-17T01:51:51.364 INFO:tasks.workunit.client.0.smithi031.stdout:9/7: getdents d3 0 2024-09-17T01:51:51.364 INFO:tasks.workunit.client.0.smithi031.stdout:9/8: read - no filename 2024-09-17T01:51:51.366 INFO:tasks.workunit.client.0.smithi031.stdout:5/29: stat c0 0 2024-09-17T01:51:51.366 INFO:tasks.workunit.client.0.smithi031.stdout:6/20: creat f6 x:0 0 0 2024-09-17T01:51:51.369 INFO:tasks.workunit.client.0.smithi031.stdout:9/9: mkdir d3/d4 0 2024-09-17T01:51:51.369 INFO:tasks.workunit.client.0.smithi031.stdout:1/11: dread f3 [0,4194304] 0 2024-09-17T01:51:51.371 INFO:tasks.workunit.client.0.smithi031.stdout:5/30: mknod c6 0 2024-09-17T01:51:51.371 INFO:tasks.workunit.client.0.smithi031.stdout:6/21: creat f7 x:0 0 0 2024-09-17T01:51:51.372 INFO:tasks.workunit.client.0.smithi031.stdout:0/14: dread d0/f2 [0,4194304] 0 2024-09-17T01:51:51.372 INFO:tasks.workunit.client.0.smithi031.stdout:9/10: chown l0 334 1 2024-09-17T01:51:51.373 INFO:tasks.workunit.client.0.smithi031.stdout:9/11: dread - no filename 2024-09-17T01:51:51.373 INFO:tasks.workunit.client.0.smithi031.stdout:9/12: fsync - no filename 2024-09-17T01:51:51.374 INFO:tasks.workunit.client.0.smithi031.stdout:0/15: chown d0/d3/d5 29145073 1 2024-09-17T01:51:51.374 INFO:tasks.workunit.client.0.smithi031.stdout:1/12: dread f3 [0,4194304] 0 2024-09-17T01:51:51.375 INFO:tasks.workunit.client.0.smithi031.stdout:9/13: readlink l2 0 2024-09-17T01:51:51.376 INFO:tasks.workunit.client.0.smithi031.stdout:2/23: dwrite d1/d3/f4 [0,4194304] 0 2024-09-17T01:51:51.376 INFO:tasks.workunit.client.0.smithi031.stdout:6/22: truncate f7 205186 0 2024-09-17T01:51:51.377 INFO:tasks.workunit.client.0.smithi031.stdout:1/13: mkdir d4 0 2024-09-17T01:51:51.378 INFO:tasks.workunit.client.0.smithi031.stdout:6/23: fdatasync f7 0 2024-09-17T01:51:51.379 INFO:tasks.workunit.client.0.smithi031.stdout:0/16: creat d0/f6 x:0 0 0 2024-09-17T01:51:51.387 INFO:tasks.workunit.client.0.smithi031.stdout:6/24: symlink l8 0 2024-09-17T01:51:51.388 INFO:tasks.workunit.client.0.smithi031.stdout:9/14: creat d3/d4/f5 x:0 0 0 2024-09-17T01:51:51.389 INFO:tasks.workunit.client.0.smithi031.stdout:5/31: dwrite f4 [0,4194304] 0 2024-09-17T01:51:51.389 INFO:tasks.workunit.client.0.smithi031.stdout:9/15: stat d3 0 2024-09-17T01:51:51.391 INFO:tasks.workunit.client.0.smithi031.stdout:1/14: symlink d4/l5 0 2024-09-17T01:51:51.395 INFO:tasks.workunit.client.0.smithi031.stdout:0/17: rename d0/f2 to d0/d3/d5/f7 0 2024-09-17T01:51:51.398 INFO:tasks.workunit.client.0.smithi031.stdout:9/16: mknod d3/c6 0 2024-09-17T01:51:51.398 INFO:tasks.workunit.client.0.smithi031.stdout:0/18: dread d0/d3/d5/f7 [0,4194304] 0 2024-09-17T01:51:51.398 INFO:tasks.workunit.client.0.smithi031.stdout:0/19: stat d0/l1 0 2024-09-17T01:51:51.399 INFO:tasks.workunit.client.0.smithi031.stdout:9/17: write d3/d4/f5 [39286,5512] 0 2024-09-17T01:51:51.403 INFO:tasks.workunit.client.0.smithi031.stdout:1/15: write f3 [366929,59932] 0 2024-09-17T01:51:51.404 INFO:tasks.workunit.client.0.smithi031.stdout:1/16: write f3 [1292893,43498] 0 2024-09-17T01:51:51.408 INFO:tasks.workunit.client.0.smithi031.stdout:0/20: creat d0/f8 x:0 0 0 2024-09-17T01:51:51.409 INFO:tasks.workunit.client.0.smithi031.stdout:0/21: truncate d0/f8 889748 0 2024-09-17T01:51:51.410 INFO:tasks.workunit.client.0.smithi031.stdout:9/18: dread d3/d4/f5 [0,4194304] 0 2024-09-17T01:51:51.411 INFO:tasks.workunit.client.0.smithi031.stdout:2/24: getdents d1 0 2024-09-17T01:51:51.412 INFO:tasks.workunit.client.0.smithi031.stdout:1/17: fdatasync f3 0 2024-09-17T01:51:51.413 INFO:tasks.workunit.client.0.smithi031.stdout:9/19: chown d3/c6 343535 1 2024-09-17T01:51:51.417 INFO:tasks.workunit.client.0.smithi031.stdout:2/25: creat d1/f5 x:0 0 0 2024-09-17T01:51:51.418 INFO:tasks.workunit.client.0.smithi031.stdout:1/18: mknod d4/c6 0 2024-09-17T01:51:51.419 INFO:tasks.workunit.client.0.smithi031.stdout:0/22: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:51.419 INFO:tasks.workunit.client.0.smithi031.stdout:2/26: dread - d1/f5 zero size 2024-09-17T01:51:51.420 INFO:tasks.workunit.client.0.smithi031.stdout:6/25: link c4 c9 0 2024-09-17T01:51:51.421 INFO:tasks.workunit.client.0.smithi031.stdout:6/26: dread - f5 zero size 2024-09-17T01:51:51.422 INFO:tasks.workunit.client.0.smithi031.stdout:9/20: creat d3/d4/f7 x:0 0 0 2024-09-17T01:51:51.423 INFO:tasks.workunit.client.0.smithi031.stdout:6/27: readlink l2 0 2024-09-17T01:51:51.423 INFO:tasks.workunit.client.0.smithi031.stdout:9/21: readlink l0 0 2024-09-17T01:51:51.425 INFO:tasks.workunit.client.0.smithi031.stdout:2/27: creat d1/d3/f6 x:0 0 0 2024-09-17T01:51:51.425 INFO:tasks.workunit.client.0.smithi031.stdout:6/28: dread - f5 zero size 2024-09-17T01:51:51.427 INFO:tasks.workunit.client.0.smithi031.stdout:9/22: creat d3/f8 x:0 0 0 2024-09-17T01:51:51.431 INFO:tasks.workunit.client.0.smithi031.stdout:2/28: creat d1/d3/f7 x:0 0 0 2024-09-17T01:51:51.433 INFO:tasks.workunit.client.0.smithi031.stdout:1/19: dwrite f3 [0,4194304] 0 2024-09-17T01:51:51.433 INFO:tasks.workunit.client.0.smithi031.stdout:6/29: creat fa x:0 0 0 2024-09-17T01:51:51.436 INFO:tasks.workunit.client.0.smithi031.stdout:2/29: write d1/d3/f6 [103962,101686] 0 2024-09-17T01:51:51.436 INFO:tasks.workunit.client.0.smithi031.stdout:6/30: mknod cb 0 2024-09-17T01:51:51.443 INFO:tasks.workunit.client.0.smithi031.stdout:6/31: creat fc x:0 0 0 2024-09-17T01:51:51.445 INFO:tasks.workunit.client.0.smithi031.stdout:1/20: link d4/c6 d4/c7 0 2024-09-17T01:51:51.445 INFO:tasks.workunit.client.0.smithi031.stdout:9/23: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:51:51.446 INFO:tasks.workunit.client.0.smithi031.stdout:2/30: dread d1/d3/f6 [0,4194304] 0 2024-09-17T01:51:51.446 INFO:tasks.workunit.client.0.smithi031.stdout:9/24: stat l0 0 2024-09-17T01:51:51.447 INFO:tasks.workunit.client.0.smithi031.stdout:1/21: write f3 [3518635,89433] 0 2024-09-17T01:51:51.449 INFO:tasks.workunit.client.0.smithi031.stdout:2/31: fdatasync d1/d3/f4 0 2024-09-17T01:51:51.453 INFO:tasks.workunit.client.0.smithi031.stdout:1/22: write f3 [2177397,43526] 0 2024-09-17T01:51:51.454 INFO:tasks.workunit.client.0.smithi031.stdout:9/25: rename d3/c6 to d3/d4/c9 0 2024-09-17T01:51:51.460 INFO:tasks.workunit.client.0.smithi031.stdout:2/32: write d1/f5 [1027171,125040] 0 2024-09-17T01:51:51.460 INFO:tasks.workunit.client.0.smithi031.stdout:9/26: chown l2 76 1 2024-09-17T01:51:51.460 INFO:tasks.workunit.client.0.smithi031.stdout:6/32: dwrite fa [0,4194304] 0 2024-09-17T01:51:51.462 INFO:tasks.workunit.client.0.smithi031.stdout:9/27: dread - d3/d4/f7 zero size 2024-09-17T01:51:51.469 INFO:tasks.workunit.client.0.smithi031.stdout:9/28: symlink d3/d4/la 0 2024-09-17T01:51:51.472 INFO:tasks.workunit.client.0.smithi031.stdout:1/23: fsync f3 0 2024-09-17T01:51:51.473 INFO:tasks.workunit.client.0.smithi031.stdout:9/29: dread - d3/d4/f7 zero size 2024-09-17T01:51:51.475 INFO:tasks.workunit.client.0.smithi031.stdout:1/24: read f3 [1852048,10171] 0 2024-09-17T01:51:51.477 INFO:tasks.workunit.client.0.smithi031.stdout:9/30: fsync d3/d4/f7 0 2024-09-17T01:51:51.479 INFO:tasks.workunit.client.0.smithi031.stdout:6/33: dwrite fc [0,4194304] 0 2024-09-17T01:51:51.483 INFO:tasks.workunit.client.0.smithi031.stdout:1/25: mknod d4/c8 0 2024-09-17T01:51:51.483 INFO:tasks.workunit.client.0.smithi031.stdout:9/31: dread d3/d4/f5 [0,4194304] 0 2024-09-17T01:51:51.484 INFO:tasks.workunit.client.0.smithi031.stdout:1/26: readlink l1 0 2024-09-17T01:51:51.484 INFO:tasks.workunit.client.0.smithi031.stdout:2/33: dwrite d1/d3/f7 [0,4194304] 0 2024-09-17T01:51:51.485 INFO:tasks.workunit.client.0.smithi031.stdout:6/34: rename c4 to cd 0 2024-09-17T01:51:51.487 INFO:tasks.workunit.client.0.smithi031.stdout:1/27: mkdir d4/d9 0 2024-09-17T01:51:51.492 INFO:tasks.workunit.client.0.smithi031.stdout:6/35: creat fe x:0 0 0 2024-09-17T01:51:51.493 INFO:tasks.workunit.client.0.smithi031.stdout:2/34: symlink d1/l8 0 2024-09-17T01:51:51.493 INFO:tasks.workunit.client.0.smithi031.stdout:6/36: dread - fe zero size 2024-09-17T01:51:51.495 INFO:tasks.workunit.client.0.smithi031.stdout:2/35: symlink d1/l9 0 2024-09-17T01:51:51.496 INFO:tasks.workunit.client.0.smithi031.stdout:1/28: truncate f3 3191972 0 2024-09-17T01:51:51.500 INFO:tasks.workunit.client.0.smithi031.stdout:9/32: dwrite d3/d4/f5 [0,4194304] 0 2024-09-17T01:51:51.503 INFO:tasks.workunit.client.0.smithi031.stdout:6/37: link fc ff 0 2024-09-17T01:51:51.518 INFO:tasks.workunit.client.0.smithi031.stdout:2/36: dwrite d1/d3/f7 [0,4194304] 0 2024-09-17T01:51:51.521 INFO:tasks.workunit.client.0.smithi031.stdout:2/37: write d1/f2 [1860627,62762] 0 2024-09-17T01:51:51.522 INFO:tasks.workunit.client.0.smithi031.stdout:6/38: dwrite fc [0,4194304] 0 2024-09-17T01:51:51.522 INFO:tasks.workunit.client.0.smithi031.stdout:9/33: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:51:51.525 INFO:tasks.workunit.client.0.smithi031.stdout:6/39: chown f7 0 1 2024-09-17T01:51:51.525 INFO:tasks.workunit.client.0.smithi031.stdout:6/40: readlink l8 0 2024-09-17T01:51:51.525 INFO:tasks.workunit.client.0.smithi031.stdout:1/29: truncate f3 1894949 0 2024-09-17T01:51:51.528 INFO:tasks.workunit.client.0.smithi031.stdout:2/38: creat d1/d3/fa x:0 0 0 2024-09-17T01:51:51.528 INFO:tasks.workunit.client.0.smithi031.stdout:9/34: creat d3/fb x:0 0 0 2024-09-17T01:51:51.530 INFO:tasks.workunit.client.0.smithi031.stdout:9/35: read - d3/d4/f7 zero size 2024-09-17T01:51:51.531 INFO:tasks.workunit.client.0.smithi031.stdout:6/41: mknod c10 0 2024-09-17T01:51:51.535 INFO:tasks.workunit.client.0.smithi031.stdout:2/39: creat d1/d3/fb x:0 0 0 2024-09-17T01:51:51.536 INFO:tasks.workunit.client.0.smithi031.stdout:6/42: write f5 [442815,13812] 0 2024-09-17T01:51:51.539 INFO:tasks.workunit.client.0.smithi031.stdout:6/43: fdatasync f7 0 2024-09-17T01:51:51.539 INFO:tasks.workunit.client.0.smithi031.stdout:6/44: fsync f6 0 2024-09-17T01:51:51.540 INFO:tasks.workunit.client.0.smithi031.stdout:9/36: creat d3/fc x:0 0 0 2024-09-17T01:51:51.543 INFO:tasks.workunit.client.0.smithi031.stdout:9/37: rename d3 to d3/d4/dd 22 2024-09-17T01:51:51.543 INFO:tasks.workunit.client.0.smithi031.stdout:6/45: mknod c11 0 2024-09-17T01:51:51.544 INFO:tasks.workunit.client.0.smithi031.stdout:9/38: creat d3/d4/fe x:0 0 0 2024-09-17T01:51:51.544 INFO:tasks.workunit.client.0.smithi031.stdout:9/39: fdatasync d3/fc 0 2024-09-17T01:51:51.545 INFO:tasks.workunit.client.0.smithi031.stdout:9/40: fdatasync d3/fc 0 2024-09-17T01:51:51.545 INFO:tasks.workunit.client.0.smithi031.stdout:6/46: unlink fa 0 2024-09-17T01:51:51.547 INFO:tasks.workunit.client.0.smithi031.stdout:6/47: creat f12 x:0 0 0 2024-09-17T01:51:51.549 INFO:tasks.workunit.client.0.smithi031.stdout:9/41: rename d3/d4/la to d3/lf 0 2024-09-17T01:51:51.550 INFO:tasks.workunit.client.0.smithi031.stdout:9/42: chown d3/d4/f5 0 1 2024-09-17T01:51:51.553 INFO:tasks.workunit.client.0.smithi031.stdout:6/48: dread fc [0,4194304] 0 2024-09-17T01:51:51.555 INFO:tasks.workunit.client.0.smithi031.stdout:6/49: fdatasync f12 0 2024-09-17T01:51:51.559 INFO:tasks.workunit.client.0.smithi031.stdout:1/30: fsync f3 0 2024-09-17T01:51:51.559 INFO:tasks.workunit.client.0.smithi031.stdout:9/43: dwrite d3/d4/f5 [4194304,4194304] 0 2024-09-17T01:51:51.560 INFO:tasks.workunit.client.0.smithi031.stdout:6/50: write ff [4588164,102472] 0 2024-09-17T01:51:51.562 INFO:tasks.workunit.client.0.smithi031.stdout:9/44: truncate d3/d4/fe 337336 0 2024-09-17T01:51:51.562 INFO:tasks.workunit.client.0.smithi031.stdout:6/51: write f12 [262313,57370] 0 2024-09-17T01:51:51.564 INFO:tasks.workunit.client.0.smithi031.stdout:2/40: truncate d1/f5 142479 0 2024-09-17T01:51:51.568 INFO:tasks.workunit.client.0.smithi031.stdout:9/45: mkdir d3/d10 0 2024-09-17T01:51:51.571 INFO:tasks.workunit.client.0.smithi031.stdout:2/41: mknod d1/d3/cc 0 2024-09-17T01:51:51.573 INFO:tasks.workunit.client.0.smithi031.stdout:1/31: creat d4/d9/fa x:0 0 0 2024-09-17T01:51:51.576 INFO:tasks.workunit.client.0.smithi031.stdout:1/32: dread f3 [0,4194304] 0 2024-09-17T01:51:51.578 INFO:tasks.workunit.client.0.smithi031.stdout:9/46: link d3/d4/f7 d3/f11 0 2024-09-17T01:51:51.579 INFO:tasks.workunit.client.0.smithi031.stdout:9/47: dread - d3/f11 zero size 2024-09-17T01:51:51.579 INFO:tasks.workunit.client.0.smithi031.stdout:6/52: dread f12 [0,4194304] 0 2024-09-17T01:51:51.580 INFO:tasks.workunit.client.0.smithi031.stdout:2/42: link d1/d3/f7 d1/d3/fd 0 2024-09-17T01:51:51.582 INFO:tasks.workunit.client.0.smithi031.stdout:1/33: creat d4/d9/fb x:0 0 0 2024-09-17T01:51:51.585 INFO:tasks.workunit.client.0.smithi031.stdout:6/53: dread ff [0,4194304] 0 2024-09-17T01:51:51.586 INFO:tasks.workunit.client.0.smithi031.stdout:6/54: dread - f6 zero size 2024-09-17T01:51:51.586 INFO:tasks.workunit.client.0.smithi031.stdout:6/55: chown l8 197 1 2024-09-17T01:51:51.588 INFO:tasks.workunit.client.0.smithi031.stdout:9/48: unlink d3/d4/fe 0 2024-09-17T01:51:51.589 INFO:tasks.workunit.client.0.smithi031.stdout:9/49: write d3/fc [709683,70686] 0 2024-09-17T01:51:51.594 INFO:tasks.workunit.client.0.smithi031.stdout:1/34: rename d4/d9/fb to d4/fc 0 2024-09-17T01:51:51.597 INFO:tasks.workunit.client.0.smithi031.stdout:6/56: write fc [201448,44383] 0 2024-09-17T01:51:51.601 INFO:tasks.workunit.client.0.smithi031.stdout:1/35: write d4/fc [576301,117336] 0 2024-09-17T01:51:51.601 INFO:tasks.workunit.client.0.smithi031.stdout:9/50: mknod d3/d10/c12 0 2024-09-17T01:51:51.603 INFO:tasks.workunit.client.0.smithi031.stdout:1/36: dread - d4/d9/fa zero size 2024-09-17T01:51:51.604 INFO:tasks.workunit.client.0.smithi031.stdout:1/37: truncate d4/d9/fa 289491 0 2024-09-17T01:51:51.605 INFO:tasks.workunit.client.0.smithi031.stdout:1/38: chown f3 3516 1 2024-09-17T01:51:51.608 INFO:tasks.workunit.client.0.smithi031.stdout:9/51: unlink d3/d4/f7 0 2024-09-17T01:51:51.608 INFO:tasks.workunit.client.0.smithi031.stdout:9/52: fdatasync d3/d4/f5 0 2024-09-17T01:51:51.610 INFO:tasks.workunit.client.0.smithi031.stdout:9/53: truncate d3/fc 1116077 0 2024-09-17T01:51:51.611 INFO:tasks.workunit.client.0.smithi031.stdout:2/43: getdents d1/d3 0 2024-09-17T01:51:51.612 INFO:tasks.workunit.client.0.smithi031.stdout:1/39: creat d4/d9/fd x:0 0 0 2024-09-17T01:51:51.613 INFO:tasks.workunit.client.0.smithi031.stdout:1/40: fdatasync f3 0 2024-09-17T01:51:51.614 INFO:tasks.workunit.client.0.smithi031.stdout:6/57: link c10 c13 0 2024-09-17T01:51:51.615 INFO:tasks.workunit.client.0.smithi031.stdout:6/58: dread - f6 zero size 2024-09-17T01:51:51.616 INFO:tasks.workunit.client.0.smithi031.stdout:6/59: dread f12 [0,4194304] 0 2024-09-17T01:51:51.618 INFO:tasks.workunit.client.0.smithi031.stdout:9/54: creat d3/d4/f13 x:0 0 0 2024-09-17T01:51:51.618 INFO:tasks.workunit.client.0.smithi031.stdout:9/55: dread - d3/fb zero size 2024-09-17T01:51:51.619 INFO:tasks.workunit.client.0.smithi031.stdout:1/41: creat d4/d9/fe x:0 0 0 2024-09-17T01:51:51.620 INFO:tasks.workunit.client.0.smithi031.stdout:9/56: write d3/fc [772798,56125] 0 2024-09-17T01:51:51.621 INFO:tasks.workunit.client.0.smithi031.stdout:2/44: getdents d1/d3 0 2024-09-17T01:51:51.629 INFO:tasks.workunit.client.0.smithi031.stdout:2/45: unlink d1/d3/cc 0 2024-09-17T01:51:51.635 INFO:tasks.workunit.client.0.smithi031.stdout:2/46: creat d1/fe x:0 0 0 2024-09-17T01:51:51.639 INFO:tasks.workunit.client.0.smithi031.stdout:2/47: mkdir d1/d3/df 0 2024-09-17T01:51:51.641 INFO:tasks.workunit.client.0.smithi031.stdout:9/57: rename d3/d4/f13 to d3/d10/f14 0 2024-09-17T01:51:51.642 INFO:tasks.workunit.client.0.smithi031.stdout:1/42: getdents d4/d9 0 2024-09-17T01:51:51.645 INFO:tasks.workunit.client.0.smithi031.stdout:1/43: dread f3 [0,4194304] 0 2024-09-17T01:51:51.646 INFO:tasks.workunit.client.0.smithi031.stdout:1/44: stat d4/d9/fa 0 2024-09-17T01:51:51.646 INFO:tasks.workunit.client.0.smithi031.stdout:9/58: rename d3/fc to d3/f15 0 2024-09-17T01:51:51.648 INFO:tasks.workunit.client.0.smithi031.stdout:9/59: read d3/f8 [880267,130265] 0 2024-09-17T01:51:51.657 INFO:tasks.workunit.client.0.smithi031.stdout:9/60: getdents d3/d4 0 2024-09-17T01:51:51.658 INFO:tasks.workunit.client.0.smithi031.stdout:9/61: dread - d3/fb zero size 2024-09-17T01:51:51.663 INFO:tasks.workunit.client.0.smithi031.stdout:9/62: rename l2 to d3/d10/l16 0 2024-09-17T01:51:51.665 INFO:tasks.workunit.client.0.smithi031.stdout:9/63: mknod d3/d4/c17 0 2024-09-17T01:51:51.670 INFO:tasks.workunit.client.0.smithi031.stdout:9/64: write d3/f8 [3388112,56086] 0 2024-09-17T01:51:51.675 INFO:tasks.workunit.client.0.smithi031.stdout:9/65: dread d3/f8 [0,4194304] 0 2024-09-17T01:51:52.196 INFO:tasks.workunit.client.1.smithi092.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:51:52.204 INFO:tasks.workunit.client.1.smithi092.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:51:52.204 INFO:tasks.workunit.client.1.smithi092.stderr:+ make 2024-09-17T01:51:52.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:51 smithi092 ceph-mon[33552]: pgmap v6: 65 pgs: 65 active+clean; 210 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.1 MiB/s wr, 372 op/s 2024-09-17T01:51:52.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:51 smithi031 ceph-mon[27673]: pgmap v6: 65 pgs: 65 active+clean; 210 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.1 MiB/s wr, 372 op/s 2024-09-17T01:51:52.593 INFO:tasks.workunit.client.1.smithi092.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/1: sync 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/2: write - no filename 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/3: rename - no filename 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/4: write - no filename 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/5: truncate - no filename 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/6: truncate - no filename 2024-09-17T01:51:53.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/7: chown . 215625 1 2024-09-17T01:51:53.105 INFO:tasks.workunit.client.0.smithi031.stdout:4/8: creat f0 x:0 0 0 2024-09-17T01:51:53.112 INFO:tasks.workunit.client.0.smithi031.stdout:4/9: dwrite f0 [0,4194304] 0 2024-09-17T01:51:53.176 INFO:tasks.workunit.client.1.smithi092.stderr:++ readlink -f fsstress 2024-09-17T01:51:53.178 INFO:tasks.workunit.client.1.smithi092.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:51:53.178 INFO:tasks.workunit.client.1.smithi092.stderr:+ popd 2024-09-17T01:51:53.179 INFO:tasks.workunit.client.1.smithi092.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:51:53.180 INFO:tasks.workunit.client.1.smithi092.stderr:+ popd 2024-09-17T01:51:53.180 INFO:tasks.workunit.client.1.smithi092.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:51:53.180 INFO:tasks.workunit.client.1.smithi092.stderr:++ mktemp -d -p . 2024-09-17T01:51:53.183 INFO:tasks.workunit.client.0.smithi031.stdout:4/10: dwrite f0 [4194304,4194304] 0 2024-09-17T01:51:53.183 INFO:tasks.workunit.client.1.smithi092.stderr:+ T=./tmp.r0q6yJscA6 2024-09-17T01:51:53.183 INFO:tasks.workunit.client.1.smithi092.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.r0q6yJscA6 -l 1 -n 1000 -p 10 -v 2024-09-17T01:51:53.185 INFO:tasks.workunit.client.0.smithi031.stdout:4/11: symlink l1 0 2024-09-17T01:51:53.188 INFO:tasks.workunit.client.1.smithi092.stdout:seed = 1726614462 2024-09-17T01:51:53.193 INFO:tasks.workunit.client.1.smithi092.stdout:0/0: dread - no filename 2024-09-17T01:51:53.193 INFO:tasks.workunit.client.1.smithi092.stdout:0/1: dwrite - no filename 2024-09-17T01:51:53.193 INFO:tasks.workunit.client.0.smithi031.stdout:4/12: dwrite f0 [4194304,4194304] 0 2024-09-17T01:51:53.193 INFO:tasks.workunit.client.0.smithi031.stdout:4/13: stat f0 0 2024-09-17T01:51:53.193 INFO:tasks.workunit.client.0.smithi031.stdout:4/14: stat l1 0 2024-09-17T01:51:53.195 INFO:tasks.workunit.client.0.smithi031.stdout:4/15: mknod c2 0 2024-09-17T01:51:53.195 INFO:tasks.workunit.client.1.smithi092.stdout:1/0: dwrite - no filename 2024-09-17T01:51:53.195 INFO:tasks.workunit.client.1.smithi092.stdout:1/1: rename - no filename 2024-09-17T01:51:53.197 INFO:tasks.workunit.client.1.smithi092.stdout:0/2: creat f0 x:0 0 0 2024-09-17T01:51:53.199 INFO:tasks.workunit.client.1.smithi092.stdout:2/0: dread - no filename 2024-09-17T01:51:53.200 INFO:tasks.workunit.client.1.smithi092.stdout:2/1: rmdir - no directory 2024-09-17T01:51:53.200 INFO:tasks.workunit.client.1.smithi092.stdout:2/2: dwrite - no filename 2024-09-17T01:51:53.201 INFO:tasks.workunit.client.1.smithi092.stdout:4/0: dread - no filename 2024-09-17T01:51:53.201 INFO:tasks.workunit.client.1.smithi092.stdout:4/1: unlink - no file 2024-09-17T01:51:53.201 INFO:tasks.workunit.client.1.smithi092.stdout:4/2: rmdir - no directory 2024-09-17T01:51:53.201 INFO:tasks.workunit.client.1.smithi092.stdout:4/3: chown . 8 1 2024-09-17T01:51:53.202 INFO:tasks.workunit.client.0.smithi031.stdout:8/17: sync 2024-09-17T01:51:53.202 INFO:tasks.workunit.client.0.smithi031.stdout:0/23: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:9/66: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:8/18: unlink - no file 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:3/6: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:5/32: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:8/19: write - no filename 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:3/7: write - no filename 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:3/8: truncate - no filename 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:6/60: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:1/45: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:7/6: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.0.smithi031.stdout:2/48: sync 2024-09-17T01:51:53.203 INFO:tasks.workunit.client.1.smithi092.stdout:0/3: rename f0 to f1 0 2024-09-17T01:51:53.204 INFO:tasks.workunit.client.1.smithi092.stdout:0/4: rmdir - no directory 2024-09-17T01:51:53.204 INFO:tasks.workunit.client.1.smithi092.stdout:0/5: read - f1 zero size 2024-09-17T01:51:53.204 INFO:tasks.workunit.client.1.smithi092.stdout:1/2: creat f0 x:0 0 0 2024-09-17T01:51:53.204 INFO:tasks.workunit.client.0.smithi031.stdout:6/61: write f6 [993955,41830] 0 2024-09-17T01:51:53.204 INFO:tasks.workunit.client.0.smithi031.stdout:3/9: creat f1 x:0 0 0 2024-09-17T01:51:53.205 INFO:tasks.workunit.client.0.smithi031.stdout:5/33: symlink l7 0 2024-09-17T01:51:53.205 INFO:tasks.workunit.client.0.smithi031.stdout:3/10: chown f1 562705 1 2024-09-17T01:51:53.207 INFO:tasks.workunit.client.0.smithi031.stdout:3/11: write f1 [761281,79811] 0 2024-09-17T01:51:53.207 INFO:tasks.workunit.client.0.smithi031.stdout:7/7: creat f3 x:0 0 0 2024-09-17T01:51:53.207 INFO:tasks.workunit.client.1.smithi092.stdout:0/6: mknod c2 0 2024-09-17T01:51:53.207 INFO:tasks.workunit.client.1.smithi092.stdout:2/3: creat f0 x:0 0 0 2024-09-17T01:51:53.207 INFO:tasks.workunit.client.1.smithi092.stdout:4/4: mknod c0 0 2024-09-17T01:51:53.207 INFO:tasks.workunit.client.1.smithi092.stdout:4/5: write - no filename 2024-09-17T01:51:53.208 INFO:tasks.workunit.client.0.smithi031.stdout:7/8: write f3 [566345,9828] 0 2024-09-17T01:51:53.209 INFO:tasks.workunit.client.1.smithi092.stdout:0/7: chown c2 298163597 1 2024-09-17T01:51:53.209 INFO:tasks.workunit.client.0.smithi031.stdout:1/46: symlink d4/d9/lf 0 2024-09-17T01:51:53.209 INFO:tasks.workunit.client.1.smithi092.stdout:2/4: write f0 [806020,47937] 0 2024-09-17T01:51:53.210 INFO:tasks.workunit.client.1.smithi092.stdout:4/6: creat f1 x:0 0 0 2024-09-17T01:51:53.210 INFO:tasks.workunit.client.1.smithi092.stdout:3/0: mknod c0 0 2024-09-17T01:51:53.211 INFO:tasks.workunit.client.0.smithi031.stdout:9/67: truncate d3/fb 38711 0 2024-09-17T01:51:53.212 INFO:tasks.workunit.client.0.smithi031.stdout:0/24: mknod d0/d3/d5/c9 0 2024-09-17T01:51:53.212 INFO:tasks.workunit.client.1.smithi092.stdout:5/0: dread - no filename 2024-09-17T01:51:53.212 INFO:tasks.workunit.client.1.smithi092.stdout:2/5: chown f0 50619 1 2024-09-17T01:51:53.214 INFO:tasks.workunit.client.1.smithi092.stdout:3/1: mknod c1 0 2024-09-17T01:51:53.214 INFO:tasks.workunit.client.1.smithi092.stdout:3/2: dwrite - no filename 2024-09-17T01:51:53.214 INFO:tasks.workunit.client.1.smithi092.stdout:3/3: truncate - no filename 2024-09-17T01:51:53.214 INFO:tasks.workunit.client.0.smithi031.stdout:1/47: truncate d4/d9/fe 634891 0 2024-09-17T01:51:53.215 INFO:tasks.workunit.client.1.smithi092.stdout:2/6: stat f0 0 2024-09-17T01:51:53.215 INFO:tasks.workunit.client.0.smithi031.stdout:4/16: truncate f0 4110077 0 2024-09-17T01:51:53.216 INFO:tasks.workunit.client.0.smithi031.stdout:6/62: creat f14 x:0 0 0 2024-09-17T01:51:53.218 INFO:tasks.workunit.client.1.smithi092.stdout:7/0: write - no filename 2024-09-17T01:51:53.218 INFO:tasks.workunit.client.1.smithi092.stdout:5/1: mkdir d0 0 2024-09-17T01:51:53.220 INFO:tasks.workunit.client.0.smithi031.stdout:5/34: creat f8 x:0 0 0 2024-09-17T01:51:53.221 INFO:tasks.workunit.client.0.smithi031.stdout:7/9: dwrite f3 [0,4194304] 0 2024-09-17T01:51:53.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/4: symlink l2 0 2024-09-17T01:51:53.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/5: read - no filename 2024-09-17T01:51:53.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/6: dread - no filename 2024-09-17T01:51:53.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/7: dwrite - no filename 2024-09-17T01:51:53.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/8: dread - no filename 2024-09-17T01:51:53.223 INFO:tasks.workunit.client.0.smithi031.stdout:2/49: write d1/d3/fd [3685248,38115] 0 2024-09-17T01:51:53.224 INFO:tasks.workunit.client.0.smithi031.stdout:7/10: chown f3 29455256 1 2024-09-17T01:51:53.224 INFO:tasks.workunit.client.0.smithi031.stdout:7/11: rmdir - no directory 2024-09-17T01:51:53.225 INFO:tasks.workunit.client.0.smithi031.stdout:5/35: write f8 [827336,98090] 0 2024-09-17T01:51:53.226 INFO:tasks.workunit.client.1.smithi092.stdout:7/1: creat f0 x:0 0 0 2024-09-17T01:51:53.226 INFO:tasks.workunit.client.1.smithi092.stdout:7/2: readlink - no filename 2024-09-17T01:51:53.227 INFO:tasks.workunit.client.0.smithi031.stdout:0/25: dread d0/f6 [0,4194304] 0 2024-09-17T01:51:53.228 INFO:tasks.workunit.client.1.smithi092.stdout:1/3: dwrite f0 [0,4194304] 0 2024-09-17T01:51:53.228 INFO:tasks.workunit.client.1.smithi092.stdout:1/4: readlink - no filename 2024-09-17T01:51:53.228 INFO:tasks.workunit.client.1.smithi092.stdout:5/2: creat d0/f1 x:0 0 0 2024-09-17T01:51:53.229 INFO:tasks.workunit.client.0.smithi031.stdout:7/12: chown f3 1221401672 1 2024-09-17T01:51:53.229 INFO:tasks.workunit.client.1.smithi092.stdout:2/7: dread f0 [0,4194304] 0 2024-09-17T01:51:53.231 INFO:tasks.workunit.client.0.smithi031.stdout:6/63: rename f7 to f15 0 2024-09-17T01:51:53.231 INFO:tasks.workunit.client.1.smithi092.stdout:3/9: mknod c3 0 2024-09-17T01:51:53.232 INFO:tasks.workunit.client.1.smithi092.stdout:3/10: dwrite - no filename 2024-09-17T01:51:53.233 INFO:tasks.workunit.client.0.smithi031.stdout:8/20: rmdir d0/d1 0 2024-09-17T01:51:53.233 INFO:tasks.workunit.client.0.smithi031.stdout:4/17: creat f3 x:0 0 0 2024-09-17T01:51:53.237 INFO:tasks.workunit.client.0.smithi031.stdout:2/50: write d1/d3/fd [1608931,116501] 0 2024-09-17T01:51:53.240 INFO:tasks.workunit.client.0.smithi031.stdout:1/48: dwrite d4/fc [0,4194304] 0 2024-09-17T01:51:53.245 INFO:tasks.workunit.client.0.smithi031.stdout:0/26: dread d0/f6 [0,4194304] 0 2024-09-17T01:51:53.249 INFO:tasks.workunit.client.0.smithi031.stdout:7/13: symlink l4 0 2024-09-17T01:51:53.250 INFO:tasks.workunit.client.0.smithi031.stdout:2/51: rmdir d1/d3 39 2024-09-17T01:51:53.250 INFO:tasks.workunit.client.0.smithi031.stdout:5/36: mknod c9 0 2024-09-17T01:51:53.251 INFO:tasks.workunit.client.0.smithi031.stdout:7/14: write f3 [776690,121068] 0 2024-09-17T01:51:53.253 INFO:tasks.workunit.client.0.smithi031.stdout:1/49: creat d4/f10 x:0 0 0 2024-09-17T01:51:53.254 INFO:tasks.workunit.client.0.smithi031.stdout:1/50: write d4/f10 [595976,61065] 0 2024-09-17T01:51:53.254 INFO:tasks.workunit.client.0.smithi031.stdout:0/27: unlink d0/d3/l4 0 2024-09-17T01:51:53.256 INFO:tasks.workunit.client.1.smithi092.stdout:0/8: dwrite f1 [0,4194304] 0 2024-09-17T01:51:53.257 INFO:tasks.workunit.client.1.smithi092.stdout:7/3: mknod c1 0 2024-09-17T01:51:53.258 INFO:tasks.workunit.client.0.smithi031.stdout:3/12: truncate f1 283208 0 2024-09-17T01:51:53.259 INFO:tasks.workunit.client.1.smithi092.stdout:8/0: chown . 7 1 2024-09-17T01:51:53.260 INFO:tasks.workunit.client.0.smithi031.stdout:5/37: mkdir da 0 2024-09-17T01:51:53.261 INFO:tasks.workunit.client.1.smithi092.stdout:7/4: fdatasync f0 0 2024-09-17T01:51:53.261 INFO:tasks.workunit.client.1.smithi092.stdout:3/11: unlink c3 0 2024-09-17T01:51:53.261 INFO:tasks.workunit.client.1.smithi092.stdout:4/7: dwrite f1 [0,4194304] 0 2024-09-17T01:51:53.262 INFO:tasks.workunit.client.0.smithi031.stdout:7/15: rename f3 to f5 0 2024-09-17T01:51:53.263 INFO:tasks.workunit.client.1.smithi092.stdout:5/3: truncate d0/f1 778671 0 2024-09-17T01:51:53.264 INFO:tasks.workunit.client.1.smithi092.stdout:7/5: fdatasync f0 0 2024-09-17T01:51:53.265 INFO:tasks.workunit.client.1.smithi092.stdout:3/12: chown c1 6191849 1 2024-09-17T01:51:53.265 INFO:tasks.workunit.client.1.smithi092.stdout:3/13: truncate - no filename 2024-09-17T01:51:53.265 INFO:tasks.workunit.client.1.smithi092.stdout:2/8: fsync f0 0 2024-09-17T01:51:53.266 INFO:tasks.workunit.client.0.smithi031.stdout:0/28: rename d0/d3/d5/f7 to d0/d3/d5/fa 0 2024-09-17T01:51:53.266 INFO:tasks.workunit.client.0.smithi031.stdout:1/51: dwrite d4/d9/fe [0,4194304] 0 2024-09-17T01:51:53.267 INFO:tasks.workunit.client.0.smithi031.stdout:9/68: link d3/f11 d3/d10/f18 0 2024-09-17T01:51:53.268 INFO:tasks.workunit.client.1.smithi092.stdout:1/5: dread f0 [0,4194304] 0 2024-09-17T01:51:53.271 INFO:tasks.workunit.client.1.smithi092.stdout:2/9: dread f0 [0,4194304] 0 2024-09-17T01:51:53.273 INFO:tasks.workunit.client.1.smithi092.stdout:2/10: truncate f0 1692443 0 2024-09-17T01:51:53.273 INFO:tasks.workunit.client.0.smithi031.stdout:3/13: creat f2 x:0 0 0 2024-09-17T01:51:53.274 INFO:tasks.workunit.client.1.smithi092.stdout:2/11: fsync f0 0 2024-09-17T01:51:53.274 INFO:tasks.workunit.client.1.smithi092.stdout:4/8: dwrite f1 [0,4194304] 0 2024-09-17T01:51:53.276 INFO:tasks.workunit.client.0.smithi031.stdout:2/52: creat d1/d3/f10 x:0 0 0 2024-09-17T01:51:53.277 INFO:tasks.workunit.client.1.smithi092.stdout:4/9: truncate f1 5222092 0 2024-09-17T01:51:53.278 INFO:tasks.workunit.client.1.smithi092.stdout:4/10: write f1 [2866702,49716] 0 2024-09-17T01:51:53.278 INFO:tasks.workunit.client.1.smithi092.stdout:4/11: readlink - no filename 2024-09-17T01:51:53.278 INFO:tasks.workunit.client.1.smithi092.stdout:4/12: stat f1 0 2024-09-17T01:51:53.280 INFO:tasks.workunit.client.0.smithi031.stdout:2/53: chown d1/d3/f6 50 1 2024-09-17T01:51:53.285 INFO:tasks.workunit.client.0.smithi031.stdout:6/64: getdents . 0 2024-09-17T01:51:53.285 INFO:tasks.workunit.client.0.smithi031.stdout:1/52: dwrite d4/f10 [0,4194304] 0 2024-09-17T01:51:53.290 INFO:tasks.workunit.client.0.smithi031.stdout:5/38: symlink da/lb 0 2024-09-17T01:51:53.292 INFO:tasks.workunit.client.0.smithi031.stdout:8/21: getdents d0 0 2024-09-17T01:51:53.293 INFO:tasks.workunit.client.0.smithi031.stdout:8/22: write - no filename 2024-09-17T01:51:53.293 INFO:tasks.workunit.client.0.smithi031.stdout:8/23: truncate - no filename 2024-09-17T01:51:53.294 INFO:tasks.workunit.client.0.smithi031.stdout:6/65: symlink l16 0 2024-09-17T01:51:53.295 INFO:tasks.workunit.client.0.smithi031.stdout:1/53: creat d4/f11 x:0 0 0 2024-09-17T01:51:53.298 INFO:tasks.workunit.client.0.smithi031.stdout:2/54: mkdir d1/d3/df/d11 0 2024-09-17T01:51:53.299 INFO:tasks.workunit.client.0.smithi031.stdout:8/24: symlink d0/l2 0 2024-09-17T01:51:53.301 INFO:tasks.workunit.client.1.smithi092.stdout:0/9: fdatasync f1 0 2024-09-17T01:51:53.301 INFO:tasks.workunit.client.0.smithi031.stdout:6/66: mknod c17 0 2024-09-17T01:51:53.302 INFO:tasks.workunit.client.0.smithi031.stdout:7/16: dwrite f5 [4194304,4194304] 0 2024-09-17T01:51:53.302 INFO:tasks.workunit.client.0.smithi031.stdout:8/25: rename d0 to d0/d3 22 2024-09-17T01:51:53.303 INFO:tasks.workunit.client.1.smithi092.stdout:0/10: dread f1 [0,4194304] 0 2024-09-17T01:51:53.304 INFO:tasks.workunit.client.1.smithi092.stdout:0/11: chown f1 650248 1 2024-09-17T01:51:53.307 INFO:tasks.workunit.client.1.smithi092.stdout:0/12: dread f1 [0,4194304] 0 2024-09-17T01:51:53.308 INFO:tasks.workunit.client.0.smithi031.stdout:6/67: dread ff [4194304,4194304] 0 2024-09-17T01:51:53.308 INFO:tasks.workunit.client.0.smithi031.stdout:9/69: dwrite d3/d10/f14 [0,4194304] 0 2024-09-17T01:51:53.309 INFO:tasks.workunit.client.0.smithi031.stdout:3/14: rename f1 to f3 0 2024-09-17T01:51:53.311 INFO:tasks.workunit.client.1.smithi092.stdout:0/13: dread f1 [0,4194304] 0 2024-09-17T01:51:53.313 INFO:tasks.workunit.client.0.smithi031.stdout:5/39: dwrite f8 [0,4194304] 0 2024-09-17T01:51:53.314 INFO:tasks.workunit.client.0.smithi031.stdout:8/26: symlink d0/l4 0 2024-09-17T01:51:53.315 INFO:tasks.workunit.client.1.smithi092.stdout:0/14: dread f1 [0,4194304] 0 2024-09-17T01:51:53.319 INFO:tasks.workunit.client.0.smithi031.stdout:7/17: rename l0 to l6 0 2024-09-17T01:51:53.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/68: symlink l18 0 2024-09-17T01:51:53.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/69: chown ff 327031 1 2024-09-17T01:51:53.323 INFO:tasks.workunit.client.0.smithi031.stdout:3/15: mknod c4 0 2024-09-17T01:51:53.327 INFO:tasks.workunit.client.0.smithi031.stdout:5/40: mkdir da/dc 0 2024-09-17T01:51:53.329 INFO:tasks.workunit.client.0.smithi031.stdout:8/27: rmdir d0 39 2024-09-17T01:51:53.331 INFO:tasks.workunit.client.0.smithi031.stdout:9/70: mkdir d3/d19 0 2024-09-17T01:51:53.333 INFO:tasks.workunit.client.0.smithi031.stdout:3/16: dwrite f2 [0,4194304] 0 2024-09-17T01:51:53.337 INFO:tasks.workunit.client.0.smithi031.stdout:2/55: getdents d1/d3 0 2024-09-17T01:51:53.337 INFO:tasks.workunit.client.0.smithi031.stdout:2/56: write d1/d3/f4 [4160101,116278] 0 2024-09-17T01:51:53.338 INFO:tasks.workunit.client.0.smithi031.stdout:5/41: rename l7 to da/ld 0 2024-09-17T01:51:53.341 INFO:tasks.workunit.client.0.smithi031.stdout:5/42: read - f5 zero size 2024-09-17T01:51:53.341 INFO:tasks.workunit.client.0.smithi031.stdout:9/71: creat d3/d10/f1a x:0 0 0 2024-09-17T01:51:53.342 INFO:tasks.workunit.client.0.smithi031.stdout:8/28: chown d0/l4 21652098 1 2024-09-17T01:51:53.343 INFO:tasks.workunit.client.0.smithi031.stdout:3/17: creat f5 x:0 0 0 2024-09-17T01:51:53.344 INFO:tasks.workunit.client.0.smithi031.stdout:8/29: chown d0 104 1 2024-09-17T01:51:53.344 INFO:tasks.workunit.client.0.smithi031.stdout:8/30: dwrite - no filename 2024-09-17T01:51:53.345 INFO:tasks.workunit.client.0.smithi031.stdout:8/31: readlink d0/l2 0 2024-09-17T01:51:53.345 INFO:tasks.workunit.client.0.smithi031.stdout:8/32: write - no filename 2024-09-17T01:51:53.345 INFO:tasks.workunit.client.0.smithi031.stdout:6/70: dwrite f12 [0,4194304] 0 2024-09-17T01:51:53.350 INFO:tasks.workunit.client.0.smithi031.stdout:8/33: mkdir d0/d5 0 2024-09-17T01:51:53.352 INFO:tasks.workunit.client.0.smithi031.stdout:1/54: truncate d4/d9/fe 1205369 0 2024-09-17T01:51:53.354 INFO:tasks.workunit.client.0.smithi031.stdout:6/71: creat f19 x:0 0 0 2024-09-17T01:51:53.356 INFO:tasks.workunit.client.0.smithi031.stdout:5/43: creat da/dc/fe x:0 0 0 2024-09-17T01:51:53.356 INFO:tasks.workunit.client.0.smithi031.stdout:3/18: dwrite f5 [0,4194304] 0 2024-09-17T01:51:53.358 INFO:tasks.workunit.client.0.smithi031.stdout:2/57: creat d1/f12 x:0 0 0 2024-09-17T01:51:53.362 INFO:tasks.workunit.client.0.smithi031.stdout:5/44: dread f8 [0,4194304] 0 2024-09-17T01:51:53.363 INFO:tasks.workunit.client.0.smithi031.stdout:1/55: symlink d4/l12 0 2024-09-17T01:51:53.365 INFO:tasks.workunit.client.0.smithi031.stdout:6/72: creat f1a x:0 0 0 2024-09-17T01:51:53.365 INFO:tasks.workunit.client.0.smithi031.stdout:6/73: chown f5 0 1 2024-09-17T01:51:53.369 INFO:tasks.workunit.client.0.smithi031.stdout:9/72: truncate d3/d4/f5 1137733 0 2024-09-17T01:51:53.371 INFO:tasks.workunit.client.0.smithi031.stdout:8/34: getdents d0/d5 0 2024-09-17T01:51:53.372 INFO:tasks.workunit.client.0.smithi031.stdout:5/45: mknod da/dc/cf 0 2024-09-17T01:51:53.372 INFO:tasks.workunit.client.0.smithi031.stdout:5/46: chown da/lb 207576 1 2024-09-17T01:51:53.373 INFO:tasks.workunit.client.0.smithi031.stdout:1/56: creat d4/d9/f13 x:0 0 0 2024-09-17T01:51:53.374 INFO:tasks.workunit.client.0.smithi031.stdout:1/57: dread - d4/d9/fd zero size 2024-09-17T01:51:53.378 INFO:tasks.workunit.client.0.smithi031.stdout:2/58: creat d1/d3/df/d11/f13 x:0 0 0 2024-09-17T01:51:53.379 INFO:tasks.workunit.client.0.smithi031.stdout:2/59: read - d1/f12 zero size 2024-09-17T01:51:53.381 INFO:tasks.workunit.client.0.smithi031.stdout:8/35: creat d0/f6 x:0 0 0 2024-09-17T01:51:53.383 INFO:tasks.workunit.client.0.smithi031.stdout:5/47: fsync f8 0 2024-09-17T01:51:53.385 INFO:tasks.workunit.client.0.smithi031.stdout:5/48: write f4 [1532915,103735] 0 2024-09-17T01:51:53.386 INFO:tasks.workunit.client.0.smithi031.stdout:3/19: truncate f2 500367 0 2024-09-17T01:51:53.388 INFO:tasks.workunit.client.0.smithi031.stdout:9/73: creat d3/d19/f1b x:0 0 0 2024-09-17T01:51:53.390 INFO:tasks.workunit.client.0.smithi031.stdout:8/36: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:53.394 INFO:tasks.workunit.client.0.smithi031.stdout:5/49: chown da/ld 103 1 2024-09-17T01:51:53.399 INFO:tasks.workunit.client.0.smithi031.stdout:6/74: link c9 c1b 0 2024-09-17T01:51:53.400 INFO:tasks.workunit.client.0.smithi031.stdout:6/75: fdatasync f19 0 2024-09-17T01:51:53.402 INFO:tasks.workunit.client.0.smithi031.stdout:1/58: link c0 d4/d9/c14 0 2024-09-17T01:51:53.405 INFO:tasks.workunit.client.0.smithi031.stdout:5/50: mkdir da/dc/d10 0 2024-09-17T01:51:53.405 INFO:tasks.workunit.client.0.smithi031.stdout:1/59: dread - d4/d9/fd zero size 2024-09-17T01:51:53.406 INFO:tasks.workunit.client.0.smithi031.stdout:9/74: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:51:53.406 INFO:tasks.workunit.client.0.smithi031.stdout:3/20: truncate f3 1146455 0 2024-09-17T01:51:53.408 INFO:tasks.workunit.client.0.smithi031.stdout:5/51: truncate da/dc/fe 426999 0 2024-09-17T01:51:53.408 INFO:tasks.workunit.client.0.smithi031.stdout:2/60: creat d1/f14 x:0 0 0 2024-09-17T01:51:53.410 INFO:tasks.workunit.client.0.smithi031.stdout:8/37: fdatasync d0/f6 0 2024-09-17T01:51:53.412 INFO:tasks.workunit.client.0.smithi031.stdout:6/76: creat f1c x:0 0 0 2024-09-17T01:51:53.414 INFO:tasks.workunit.client.0.smithi031.stdout:6/77: write f5 [909266,16510] 0 2024-09-17T01:51:53.415 INFO:tasks.workunit.client.0.smithi031.stdout:8/38: fdatasync d0/f6 0 2024-09-17T01:51:53.420 INFO:tasks.workunit.client.0.smithi031.stdout:5/52: creat da/f11 x:0 0 0 2024-09-17T01:51:53.420 INFO:tasks.workunit.client.0.smithi031.stdout:3/21: creat f6 x:0 0 0 2024-09-17T01:51:53.422 INFO:tasks.workunit.client.0.smithi031.stdout:8/39: unlink d0/l4 0 2024-09-17T01:51:53.422 INFO:tasks.workunit.client.0.smithi031.stdout:6/78: rename fc to f1d 0 2024-09-17T01:51:53.427 INFO:tasks.workunit.client.0.smithi031.stdout:8/40: chown d0/f6 2 1 2024-09-17T01:51:53.427 INFO:tasks.workunit.client.0.smithi031.stdout:2/61: link d1/d3/df/d11/f13 d1/d3/df/d11/f15 0 2024-09-17T01:51:53.428 INFO:tasks.workunit.client.0.smithi031.stdout:6/79: creat f1e x:0 0 0 2024-09-17T01:51:53.428 INFO:tasks.workunit.client.0.smithi031.stdout:1/60: dwrite d4/d9/f13 [0,4194304] 0 2024-09-17T01:51:53.430 INFO:tasks.workunit.client.0.smithi031.stdout:8/41: write d0/f6 [1487485,52214] 0 2024-09-17T01:51:53.432 INFO:tasks.workunit.client.0.smithi031.stdout:6/80: dread - f1c zero size 2024-09-17T01:51:53.433 INFO:tasks.workunit.client.0.smithi031.stdout:9/75: dwrite d3/d10/f1a [0,4194304] 0 2024-09-17T01:51:53.440 INFO:tasks.workunit.client.0.smithi031.stdout:6/81: write f1e [977731,69260] 0 2024-09-17T01:51:53.447 INFO:tasks.workunit.client.0.smithi031.stdout:6/82: write f12 [4544497,126285] 0 2024-09-17T01:51:53.454 INFO:tasks.workunit.client.0.smithi031.stdout:5/53: dwrite da/dc/fe [0,4194304] 0 2024-09-17T01:51:53.458 INFO:tasks.workunit.client.0.smithi031.stdout:2/62: dwrite d1/d3/fb [0,4194304] 0 2024-09-17T01:51:53.461 INFO:tasks.workunit.client.0.smithi031.stdout:8/42: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:53.462 INFO:tasks.workunit.client.0.smithi031.stdout:6/83: mkdir d1f 0 2024-09-17T01:51:53.464 INFO:tasks.workunit.client.1.smithi092.stdout:6/0: getdents . 0 2024-09-17T01:51:53.464 INFO:tasks.workunit.client.1.smithi092.stdout:6/1: chown . 0 1 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/2: rmdir - no directory 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/3: chown . 3114690 1 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/4: fsync - no filename 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/5: readlink - no filename 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/6: truncate - no filename 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/7: dwrite - no filename 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/8: dread - no filename 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/9: chown . 7 1 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/10: chown . 800075 1 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/11: dwrite - no filename 2024-09-17T01:51:53.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/12: chown . 1 1 2024-09-17T01:51:53.466 INFO:tasks.workunit.client.1.smithi092.stdout:9/0: dread - no filename 2024-09-17T01:51:53.466 INFO:tasks.workunit.client.1.smithi092.stdout:9/1: rename - no filename 2024-09-17T01:51:53.467 INFO:tasks.workunit.client.1.smithi092.stdout:9/2: fdatasync - no filename 2024-09-17T01:51:53.467 INFO:tasks.workunit.client.1.smithi092.stdout:5/4: symlink d0/l2 0 2024-09-17T01:51:53.468 INFO:tasks.workunit.client.1.smithi092.stdout:5/5: rename d0 to d0/d3 22 2024-09-17T01:51:53.469 INFO:tasks.workunit.client.1.smithi092.stdout:7/6: mknod c2 0 2024-09-17T01:51:53.470 INFO:tasks.workunit.client.1.smithi092.stdout:3/14: mkdir d4 0 2024-09-17T01:51:53.471 INFO:tasks.workunit.client.0.smithi031.stdout:8/43: write d0/f6 [3943142,97778] 0 2024-09-17T01:51:53.471 INFO:tasks.workunit.client.0.smithi031.stdout:2/63: rmdir d1/d3/df 39 2024-09-17T01:51:53.474 INFO:tasks.workunit.client.1.smithi092.stdout:5/6: dread d0/f1 [0,4194304] 0 2024-09-17T01:51:53.475 INFO:tasks.workunit.client.0.smithi031.stdout:5/54: unlink da/ld 0 2024-09-17T01:51:53.475 INFO:tasks.workunit.client.0.smithi031.stdout:3/22: dwrite f2 [0,4194304] 0 2024-09-17T01:51:53.475 INFO:tasks.workunit.client.0.smithi031.stdout:2/64: dread - d1/fe zero size 2024-09-17T01:51:53.475 INFO:tasks.workunit.client.1.smithi092.stdout:8/1: symlink l0 0 2024-09-17T01:51:53.475 INFO:tasks.workunit.client.1.smithi092.stdout:8/2: write - no filename 2024-09-17T01:51:53.475 INFO:tasks.workunit.client.1.smithi092.stdout:8/3: dread - no filename 2024-09-17T01:51:53.476 INFO:tasks.workunit.client.1.smithi092.stdout:8/4: fdatasync - no filename 2024-09-17T01:51:53.477 INFO:tasks.workunit.client.1.smithi092.stdout:7/7: mkdir d3 0 2024-09-17T01:51:53.477 INFO:tasks.workunit.client.0.smithi031.stdout:3/23: chown f6 1687491801 1 2024-09-17T01:51:53.478 INFO:tasks.workunit.client.0.smithi031.stdout:1/61: getdents d4 0 2024-09-17T01:51:53.479 INFO:tasks.workunit.client.1.smithi092.stdout:3/15: unlink c0 0 2024-09-17T01:51:53.480 INFO:tasks.workunit.client.1.smithi092.stdout:3/16: fdatasync - no filename 2024-09-17T01:51:53.481 INFO:tasks.workunit.client.1.smithi092.stdout:1/6: dwrite f0 [0,4194304] 0 2024-09-17T01:51:53.481 INFO:tasks.workunit.client.1.smithi092.stdout:1/7: rmdir - no directory 2024-09-17T01:51:53.482 INFO:tasks.workunit.client.0.smithi031.stdout:6/84: unlink cd 0 2024-09-17T01:51:53.483 INFO:tasks.workunit.client.1.smithi092.stdout:9/3: getdents . 0 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/4: write - no filename 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/5: dread - no filename 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/6: write - no filename 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:6/13: getdents . 0 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/7: fdatasync - no filename 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/8: stat - no entries 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/9: unlink - no file 2024-09-17T01:51:53.484 INFO:tasks.workunit.client.1.smithi092.stdout:9/10: write - no filename 2024-09-17T01:51:53.486 INFO:tasks.workunit.client.1.smithi092.stdout:8/5: creat f1 x:0 0 0 2024-09-17T01:51:53.487 INFO:tasks.workunit.client.1.smithi092.stdout:7/8: rename c2 to d3/c4 0 2024-09-17T01:51:53.487 INFO:tasks.workunit.client.0.smithi031.stdout:1/62: write d4/d9/f13 [2121326,64544] 0 2024-09-17T01:51:53.488 INFO:tasks.workunit.client.0.smithi031.stdout:3/24: creat f7 x:0 0 0 2024-09-17T01:51:53.488 INFO:tasks.workunit.client.1.smithi092.stdout:5/7: dwrite d0/f1 [0,4194304] 0 2024-09-17T01:51:53.489 INFO:tasks.workunit.client.0.smithi031.stdout:7/18: sync 2024-09-17T01:51:53.489 INFO:tasks.workunit.client.0.smithi031.stdout:0/29: sync 2024-09-17T01:51:53.489 INFO:tasks.workunit.client.0.smithi031.stdout:4/18: sync 2024-09-17T01:51:53.489 INFO:tasks.workunit.client.0.smithi031.stdout:8/44: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:53.491 INFO:tasks.workunit.client.1.smithi092.stdout:8/6: creat f2 x:0 0 0 2024-09-17T01:51:53.496 INFO:tasks.workunit.client.1.smithi092.stdout:2/12: getdents . 0 2024-09-17T01:51:53.497 INFO:tasks.workunit.client.1.smithi092.stdout:7/9: unlink f0 0 2024-09-17T01:51:53.497 INFO:tasks.workunit.client.1.smithi092.stdout:7/10: dwrite - no filename 2024-09-17T01:51:53.497 INFO:tasks.workunit.client.1.smithi092.stdout:7/11: write - no filename 2024-09-17T01:51:53.497 INFO:tasks.workunit.client.1.smithi092.stdout:7/12: read - no filename 2024-09-17T01:51:53.497 INFO:tasks.workunit.client.1.smithi092.stdout:7/13: dwrite - no filename 2024-09-17T01:51:53.497 INFO:tasks.workunit.client.1.smithi092.stdout:7/14: write - no filename 2024-09-17T01:51:53.498 INFO:tasks.workunit.client.1.smithi092.stdout:7/15: truncate - no filename 2024-09-17T01:51:53.498 INFO:tasks.workunit.client.1.smithi092.stdout:9/11: mkdir d0 0 2024-09-17T01:51:53.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/12: rename d0 to d0/d1 22 2024-09-17T01:51:53.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/13: unlink - no file 2024-09-17T01:51:53.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/14: fdatasync - no filename 2024-09-17T01:51:53.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/15: truncate - no filename 2024-09-17T01:51:53.504 INFO:tasks.workunit.client.1.smithi092.stdout:6/14: creat f0 x:0 0 0 2024-09-17T01:51:53.505 INFO:tasks.workunit.client.1.smithi092.stdout:1/8: dwrite f0 [0,4194304] 0 2024-09-17T01:51:53.505 INFO:tasks.workunit.client.0.smithi031.stdout:5/55: mkdir da/dc/d10/d12 0 2024-09-17T01:51:53.507 INFO:tasks.workunit.client.0.smithi031.stdout:2/65: mkdir d1/d3/d16 0 2024-09-17T01:51:53.509 INFO:tasks.workunit.client.1.smithi092.stdout:5/8: dread d0/f1 [0,4194304] 0 2024-09-17T01:51:53.509 INFO:tasks.workunit.client.0.smithi031.stdout:9/76: write d3/d10/f18 [827154,12427] 0 2024-09-17T01:51:53.512 INFO:tasks.workunit.client.0.smithi031.stdout:1/63: creat d4/d9/f15 x:0 0 0 2024-09-17T01:51:53.512 INFO:tasks.workunit.client.0.smithi031.stdout:3/25: dread f5 [0,4194304] 0 2024-09-17T01:51:53.512 INFO:tasks.workunit.client.1.smithi092.stdout:2/13: getdents . 0 2024-09-17T01:51:53.512 INFO:tasks.workunit.client.0.smithi031.stdout:0/30: rmdir d0/d3/d5 39 2024-09-17T01:51:53.513 INFO:tasks.workunit.client.1.smithi092.stdout:6/15: write f0 [198694,82084] 0 2024-09-17T01:51:53.513 INFO:tasks.workunit.client.1.smithi092.stdout:9/16: creat d0/f2 x:0 0 0 2024-09-17T01:51:53.513 INFO:tasks.workunit.client.1.smithi092.stdout:8/7: dwrite f2 [0,4194304] 0 2024-09-17T01:51:53.514 INFO:tasks.workunit.client.0.smithi031.stdout:6/85: rmdir d1f 0 2024-09-17T01:51:53.515 INFO:tasks.workunit.client.0.smithi031.stdout:7/19: dwrite f5 [4194304,4194304] 0 2024-09-17T01:51:53.516 INFO:tasks.workunit.client.1.smithi092.stdout:9/17: dread - d0/f2 zero size 2024-09-17T01:51:53.517 INFO:tasks.workunit.client.1.smithi092.stdout:9/18: readlink - no filename 2024-09-17T01:51:53.517 INFO:tasks.workunit.client.0.smithi031.stdout:0/31: readlink d0/l1 0 2024-09-17T01:51:53.518 INFO:tasks.workunit.client.1.smithi092.stdout:9/19: stat d0/f2 0 2024-09-17T01:51:53.519 INFO:tasks.workunit.client.1.smithi092.stdout:6/16: write f0 [189714,80060] 0 2024-09-17T01:51:53.520 INFO:tasks.workunit.client.0.smithi031.stdout:5/56: rename c9 to da/dc/c13 0 2024-09-17T01:51:53.521 INFO:tasks.workunit.client.1.smithi092.stdout:8/8: creat f3 x:0 0 0 2024-09-17T01:51:53.522 INFO:tasks.workunit.client.0.smithi031.stdout:6/86: rename fe to f20 0 2024-09-17T01:51:53.522 INFO:tasks.workunit.client.0.smithi031.stdout:5/57: chown da 452 1 2024-09-17T01:51:53.523 INFO:tasks.workunit.client.0.smithi031.stdout:4/19: dwrite f3 [0,4194304] 0 2024-09-17T01:51:53.524 INFO:tasks.workunit.client.1.smithi092.stdout:9/20: dread - d0/f2 zero size 2024-09-17T01:51:53.524 INFO:tasks.workunit.client.1.smithi092.stdout:1/9: dwrite f0 [0,4194304] 0 2024-09-17T01:51:53.525 INFO:tasks.workunit.client.0.smithi031.stdout:5/58: readlink da/lb 0 2024-09-17T01:51:53.526 INFO:tasks.workunit.client.0.smithi031.stdout:8/45: dread d0/f6 [0,4194304] 0 2024-09-17T01:51:53.526 INFO:tasks.workunit.client.1.smithi092.stdout:2/14: dread f0 [0,4194304] 0 2024-09-17T01:51:53.528 INFO:tasks.workunit.client.1.smithi092.stdout:6/17: write f0 [1202990,11057] 0 2024-09-17T01:51:53.528 INFO:tasks.workunit.client.1.smithi092.stdout:5/9: dread d0/f1 [0,4194304] 0 2024-09-17T01:51:53.530 INFO:tasks.workunit.client.1.smithi092.stdout:2/15: truncate f0 2432461 0 2024-09-17T01:51:53.531 INFO:tasks.workunit.client.0.smithi031.stdout:7/20: symlink l7 0 2024-09-17T01:51:53.531 INFO:tasks.workunit.client.0.smithi031.stdout:3/26: mknod c8 0 2024-09-17T01:51:53.533 INFO:tasks.workunit.client.1.smithi092.stdout:2/16: write f0 [3009997,93556] 0 2024-09-17T01:51:53.533 INFO:tasks.workunit.client.1.smithi092.stdout:2/17: rmdir - no directory 2024-09-17T01:51:53.534 INFO:tasks.workunit.client.1.smithi092.stdout:9/21: mknod d0/c3 0 2024-09-17T01:51:53.535 INFO:tasks.workunit.client.0.smithi031.stdout:3/27: truncate f6 542986 0 2024-09-17T01:51:53.537 INFO:tasks.workunit.client.1.smithi092.stdout:1/10: dread f0 [0,4194304] 0 2024-09-17T01:51:53.538 INFO:tasks.workunit.client.1.smithi092.stdout:6/18: creat f1 x:0 0 0 2024-09-17T01:51:53.539 INFO:tasks.workunit.client.0.smithi031.stdout:9/77: mknod d3/d10/c1c 0 2024-09-17T01:51:53.540 INFO:tasks.workunit.client.1.smithi092.stdout:8/9: dread f2 [0,4194304] 0 2024-09-17T01:51:53.540 INFO:tasks.workunit.client.1.smithi092.stdout:5/10: dread d0/f1 [0,4194304] 0 2024-09-17T01:51:53.541 INFO:tasks.workunit.client.0.smithi031.stdout:3/28: write f2 [4509614,8038] 0 2024-09-17T01:51:53.541 INFO:tasks.workunit.client.0.smithi031.stdout:6/87: rename cb to c21 0 2024-09-17T01:51:53.542 INFO:tasks.workunit.client.0.smithi031.stdout:1/64: fsync d4/d9/f15 0 2024-09-17T01:51:53.543 INFO:tasks.workunit.client.1.smithi092.stdout:2/18: rename f0 to f1 0 2024-09-17T01:51:53.544 INFO:tasks.workunit.client.0.smithi031.stdout:2/66: creat d1/d3/df/d11/f17 x:0 0 0 2024-09-17T01:51:53.545 INFO:tasks.workunit.client.0.smithi031.stdout:7/21: dwrite f5 [8388608,4194304] 0 2024-09-17T01:51:53.545 INFO:tasks.workunit.client.0.smithi031.stdout:6/88: fdatasync f12 0 2024-09-17T01:51:53.545 INFO:tasks.workunit.client.0.smithi031.stdout:4/20: mknod c4 0 2024-09-17T01:51:53.545 INFO:tasks.workunit.client.1.smithi092.stdout:5/11: dread d0/f1 [0,4194304] 0 2024-09-17T01:51:53.546 INFO:tasks.workunit.client.0.smithi031.stdout:2/67: dread - d1/d3/df/d11/f17 zero size 2024-09-17T01:51:53.547 INFO:tasks.workunit.client.1.smithi092.stdout:1/11: write f0 [1130666,54854] 0 2024-09-17T01:51:53.547 INFO:tasks.workunit.client.0.smithi031.stdout:4/21: read f0 [1604351,19036] 0 2024-09-17T01:51:53.547 INFO:tasks.workunit.client.1.smithi092.stdout:9/22: rename d0/f2 to d0/f4 0 2024-09-17T01:51:53.548 INFO:tasks.workunit.client.0.smithi031.stdout:5/59: unlink da/lb 0 2024-09-17T01:51:53.549 INFO:tasks.workunit.client.0.smithi031.stdout:6/89: chown f14 903 1 2024-09-17T01:51:53.549 INFO:tasks.workunit.client.0.smithi031.stdout:4/22: readlink l1 0 2024-09-17T01:51:53.550 INFO:tasks.workunit.client.1.smithi092.stdout:8/10: creat f4 x:0 0 0 2024-09-17T01:51:53.550 INFO:tasks.workunit.client.0.smithi031.stdout:0/32: mknod d0/d3/d5/cb 0 2024-09-17T01:51:53.551 INFO:tasks.workunit.client.0.smithi031.stdout:5/60: truncate f4 4275404 0 2024-09-17T01:51:53.552 INFO:tasks.workunit.client.1.smithi092.stdout:5/12: dread d0/f1 [0,4194304] 0 2024-09-17T01:51:53.553 INFO:tasks.workunit.client.0.smithi031.stdout:8/46: write d0/f6 [4425122,87821] 0 2024-09-17T01:51:53.553 INFO:tasks.workunit.client.0.smithi031.stdout:3/29: creat f9 x:0 0 0 2024-09-17T01:51:53.553 INFO:tasks.workunit.client.1.smithi092.stdout:1/12: dread f0 [0,4194304] 0 2024-09-17T01:51:53.554 INFO:tasks.workunit.client.0.smithi031.stdout:9/78: write d3/f15 [701728,128098] 0 2024-09-17T01:51:53.554 INFO:tasks.workunit.client.1.smithi092.stdout:1/13: write f0 [305,79718] 0 2024-09-17T01:51:53.554 INFO:tasks.workunit.client.0.smithi031.stdout:7/22: symlink l8 0 2024-09-17T01:51:53.557 INFO:tasks.workunit.client.1.smithi092.stdout:6/19: dread f0 [0,4194304] 0 2024-09-17T01:51:53.557 INFO:tasks.workunit.client.0.smithi031.stdout:2/68: rename d1/d3/d16 to d1/d3/df/d18 0 2024-09-17T01:51:53.559 INFO:tasks.workunit.client.1.smithi092.stdout:9/23: fdatasync d0/f4 0 2024-09-17T01:51:53.559 INFO:tasks.workunit.client.1.smithi092.stdout:6/20: write f1 [902222,114588] 0 2024-09-17T01:51:53.559 INFO:tasks.workunit.client.1.smithi092.stdout:6/21: readlink - no filename 2024-09-17T01:51:53.560 INFO:tasks.workunit.client.0.smithi031.stdout:6/90: symlink l22 0 2024-09-17T01:51:53.560 INFO:tasks.workunit.client.1.smithi092.stdout:6/22: chown f0 1157 1 2024-09-17T01:51:53.561 INFO:tasks.workunit.client.0.smithi031.stdout:8/47: write d0/f6 [5433890,53910] 0 2024-09-17T01:51:53.561 INFO:tasks.workunit.client.0.smithi031.stdout:9/79: truncate d3/fb 857751 0 2024-09-17T01:51:53.561 INFO:tasks.workunit.client.0.smithi031.stdout:5/61: unlink da/dc/cf 0 2024-09-17T01:51:53.562 INFO:tasks.workunit.client.1.smithi092.stdout:9/24: mkdir d0/d5 0 2024-09-17T01:51:53.562 INFO:tasks.workunit.client.0.smithi031.stdout:6/91: fsync f5 0 2024-09-17T01:51:53.563 INFO:tasks.workunit.client.0.smithi031.stdout:1/65: dwrite d4/d9/fa [0,4194304] 0 2024-09-17T01:51:53.564 INFO:tasks.workunit.client.0.smithi031.stdout:4/23: write f0 [1519261,40254] 0 2024-09-17T01:51:53.564 INFO:tasks.workunit.client.0.smithi031.stdout:5/62: chown c1 142496 1 2024-09-17T01:51:53.565 INFO:tasks.workunit.client.1.smithi092.stdout:9/25: creat d0/f6 x:0 0 0 2024-09-17T01:51:53.566 INFO:tasks.workunit.client.0.smithi031.stdout:6/92: truncate f19 750341 0 2024-09-17T01:51:53.567 INFO:tasks.workunit.client.0.smithi031.stdout:3/30: mknod ca 0 2024-09-17T01:51:53.567 INFO:tasks.workunit.client.0.smithi031.stdout:5/63: dread - da/f11 zero size 2024-09-17T01:51:53.569 INFO:tasks.workunit.client.1.smithi092.stdout:9/26: mkdir d0/d7 0 2024-09-17T01:51:53.569 INFO:tasks.workunit.client.0.smithi031.stdout:9/80: dread d3/fb [0,4194304] 0 2024-09-17T01:51:53.570 INFO:tasks.workunit.client.0.smithi031.stdout:5/64: fdatasync da/f11 0 2024-09-17T01:51:53.570 INFO:tasks.workunit.client.1.smithi092.stdout:9/27: chown d0/c3 3843968 1 2024-09-17T01:51:53.573 INFO:tasks.workunit.client.1.smithi092.stdout:9/28: chown d0/f4 0 1 2024-09-17T01:51:53.573 INFO:tasks.workunit.client.1.smithi092.stdout:6/23: dwrite f1 [0,4194304] 0 2024-09-17T01:51:53.574 INFO:tasks.workunit.client.0.smithi031.stdout:3/31: dread f5 [0,4194304] 0 2024-09-17T01:51:53.577 INFO:tasks.workunit.client.1.smithi092.stdout:9/29: write d0/f4 [217747,109500] 0 2024-09-17T01:51:53.580 INFO:tasks.workunit.client.0.smithi031.stdout:4/24: creat f5 x:0 0 0 2024-09-17T01:51:53.581 INFO:tasks.workunit.client.0.smithi031.stdout:4/25: dread - f5 zero size 2024-09-17T01:51:53.582 INFO:tasks.workunit.client.0.smithi031.stdout:4/26: chown l1 619 1 2024-09-17T01:51:53.582 INFO:tasks.workunit.client.0.smithi031.stdout:4/27: rmdir - no directory 2024-09-17T01:51:53.582 INFO:tasks.workunit.client.0.smithi031.stdout:1/66: creat d4/d9/f16 x:0 0 0 2024-09-17T01:51:53.584 INFO:tasks.workunit.client.0.smithi031.stdout:6/93: mkdir d23 0 2024-09-17T01:51:53.588 INFO:tasks.workunit.client.0.smithi031.stdout:0/33: rename d0/d3 to d0/dc 0 2024-09-17T01:51:53.589 INFO:tasks.workunit.client.0.smithi031.stdout:1/67: dwrite d4/f10 [0,4194304] 0 2024-09-17T01:51:53.590 INFO:tasks.workunit.client.0.smithi031.stdout:5/65: mkdir da/d14 0 2024-09-17T01:51:53.590 INFO:tasks.workunit.client.0.smithi031.stdout:1/68: fdatasync d4/d9/fd 0 2024-09-17T01:51:53.592 INFO:tasks.workunit.client.0.smithi031.stdout:0/34: dread d0/f8 [0,4194304] 0 2024-09-17T01:51:53.600 INFO:tasks.workunit.client.0.smithi031.stdout:4/28: rename l1 to l6 0 2024-09-17T01:51:53.601 INFO:tasks.workunit.client.0.smithi031.stdout:5/66: dwrite da/f11 [0,4194304] 0 2024-09-17T01:51:53.602 INFO:tasks.workunit.client.0.smithi031.stdout:8/48: mkdir d0/d5/d7 0 2024-09-17T01:51:53.603 INFO:tasks.workunit.client.0.smithi031.stdout:5/67: write f8 [4691494,73489] 0 2024-09-17T01:51:53.603 INFO:tasks.workunit.client.0.smithi031.stdout:4/29: write f5 [956271,87157] 0 2024-09-17T01:51:53.604 INFO:tasks.workunit.client.0.smithi031.stdout:5/68: chown da 0 1 2024-09-17T01:51:53.604 INFO:tasks.workunit.client.0.smithi031.stdout:6/94: fsync ff 0 2024-09-17T01:51:53.609 INFO:tasks.workunit.client.0.smithi031.stdout:1/69: rename d4/d9/f13 to d4/f17 0 2024-09-17T01:51:53.610 INFO:tasks.workunit.client.0.smithi031.stdout:1/70: truncate f3 2207100 0 2024-09-17T01:51:53.614 INFO:tasks.workunit.client.0.smithi031.stdout:1/71: dread f3 [0,4194304] 0 2024-09-17T01:51:53.615 INFO:tasks.workunit.client.0.smithi031.stdout:1/72: chown d4/d9/lf 14 1 2024-09-17T01:51:53.617 INFO:tasks.workunit.client.0.smithi031.stdout:5/69: mknod da/c15 0 2024-09-17T01:51:53.618 INFO:tasks.workunit.client.0.smithi031.stdout:1/73: dread f3 [0,4194304] 0 2024-09-17T01:51:53.618 INFO:tasks.workunit.client.0.smithi031.stdout:6/95: chown c1b 8698556 1 2024-09-17T01:51:53.619 INFO:tasks.workunit.client.0.smithi031.stdout:7/23: truncate f5 2530041 0 2024-09-17T01:51:53.619 INFO:tasks.workunit.client.0.smithi031.stdout:6/96: stat c9 0 2024-09-17T01:51:53.623 INFO:tasks.workunit.client.0.smithi031.stdout:2/69: getdents d1 0 2024-09-17T01:51:53.629 INFO:tasks.workunit.client.0.smithi031.stdout:5/70: write da/f11 [4736038,6393] 0 2024-09-17T01:51:53.630 INFO:tasks.workunit.client.0.smithi031.stdout:8/49: creat d0/d5/d7/f8 x:0 0 0 2024-09-17T01:51:53.632 INFO:tasks.workunit.client.0.smithi031.stdout:9/81: getdents d3/d19 0 2024-09-17T01:51:53.633 INFO:tasks.workunit.client.0.smithi031.stdout:9/82: stat d3/d19 0 2024-09-17T01:51:53.636 INFO:tasks.workunit.client.0.smithi031.stdout:6/97: rename f12 to d23/f24 0 2024-09-17T01:51:53.638 INFO:tasks.workunit.client.0.smithi031.stdout:4/30: link f0 f7 0 2024-09-17T01:51:53.639 INFO:tasks.workunit.client.0.smithi031.stdout:0/35: write d0/dc/d5/fa [400828,2151] 0 2024-09-17T01:51:53.639 INFO:tasks.workunit.client.0.smithi031.stdout:2/70: mkdir d1/d3/df/d19 0 2024-09-17T01:51:53.641 INFO:tasks.workunit.client.0.smithi031.stdout:9/83: dwrite d3/d10/f14 [4194304,4194304] 0 2024-09-17T01:51:53.643 INFO:tasks.workunit.client.0.smithi031.stdout:8/50: creat d0/f9 x:0 0 0 2024-09-17T01:51:53.643 INFO:tasks.workunit.client.0.smithi031.stdout:9/84: read d3/d10/f1a [2046402,71019] 0 2024-09-17T01:51:53.646 INFO:tasks.workunit.client.0.smithi031.stdout:8/51: truncate d0/d5/d7/f8 265362 0 2024-09-17T01:51:53.646 INFO:tasks.workunit.client.0.smithi031.stdout:8/52: chown d0/d5 281496081 1 2024-09-17T01:51:53.648 INFO:tasks.workunit.client.0.smithi031.stdout:4/31: mkdir d8 0 2024-09-17T01:51:53.649 INFO:tasks.workunit.client.0.smithi031.stdout:8/53: dread d0/d5/d7/f8 [0,4194304] 0 2024-09-17T01:51:53.650 INFO:tasks.workunit.client.0.smithi031.stdout:4/32: read f3 [2543234,88261] 0 2024-09-17T01:51:53.651 INFO:tasks.workunit.client.0.smithi031.stdout:2/71: fdatasync d1/f5 0 2024-09-17T01:51:53.652 INFO:tasks.workunit.client.0.smithi031.stdout:2/72: readlink d1/l9 0 2024-09-17T01:51:53.653 INFO:tasks.workunit.client.0.smithi031.stdout:8/54: write d0/f6 [1797348,120384] 0 2024-09-17T01:51:53.653 INFO:tasks.workunit.client.0.smithi031.stdout:5/71: link f5 da/dc/f16 0 2024-09-17T01:51:53.659 INFO:tasks.workunit.client.0.smithi031.stdout:6/98: dwrite d23/f24 [0,4194304] 0 2024-09-17T01:51:53.659 INFO:tasks.workunit.client.1.smithi092.stdout:4/13: truncate f1 4910927 0 2024-09-17T01:51:53.661 INFO:tasks.workunit.client.1.smithi092.stdout:7/16: getdents d3 0 2024-09-17T01:51:53.662 INFO:tasks.workunit.client.0.smithi031.stdout:6/99: truncate f1e 1726117 0 2024-09-17T01:51:53.662 INFO:tasks.workunit.client.1.smithi092.stdout:4/14: creat f2 x:0 0 0 2024-09-17T01:51:53.662 INFO:tasks.workunit.client.0.smithi031.stdout:4/33: dread f7 [0,4194304] 0 2024-09-17T01:51:53.663 INFO:tasks.workunit.client.1.smithi092.stdout:5/13: write d0/f1 [4609277,116499] 0 2024-09-17T01:51:53.663 INFO:tasks.workunit.client.1.smithi092.stdout:7/17: rmdir d3 39 2024-09-17T01:51:53.663 INFO:tasks.workunit.client.1.smithi092.stdout:7/18: dread - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/19: dread - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/20: dwrite - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/21: read - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/22: dwrite - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/23: dwrite - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/24: write - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/25: fdatasync - no filename 2024-09-17T01:51:53.664 INFO:tasks.workunit.client.1.smithi092.stdout:7/26: dwrite - no filename 2024-09-17T01:51:53.665 INFO:tasks.workunit.client.0.smithi031.stdout:8/55: dwrite d0/f6 [4194304,4194304] 0 2024-09-17T01:51:53.666 INFO:tasks.workunit.client.0.smithi031.stdout:2/73: mknod d1/c1a 0 2024-09-17T01:51:53.669 INFO:tasks.workunit.client.1.smithi092.stdout:5/14: creat d0/f4 x:0 0 0 2024-09-17T01:51:53.671 INFO:tasks.workunit.client.1.smithi092.stdout:6/24: fsync f0 0 2024-09-17T01:51:53.671 INFO:tasks.workunit.client.0.smithi031.stdout:1/74: getdents d4/d9 0 2024-09-17T01:51:53.673 INFO:tasks.workunit.client.1.smithi092.stdout:7/27: creat d3/f5 x:0 0 0 2024-09-17T01:51:53.675 INFO:tasks.workunit.client.1.smithi092.stdout:5/15: creat d0/f5 x:0 0 0 2024-09-17T01:51:53.676 INFO:tasks.workunit.client.0.smithi031.stdout:6/100: dwrite f1d [0,4194304] 0 2024-09-17T01:51:53.676 INFO:tasks.workunit.client.1.smithi092.stdout:7/28: mkdir d3/d6 0 2024-09-17T01:51:53.677 INFO:tasks.workunit.client.0.smithi031.stdout:7/24: write f5 [108996,106860] 0 2024-09-17T01:51:53.679 INFO:tasks.workunit.client.0.smithi031.stdout:9/85: rename d3/d10/f18 to d3/f1d 0 2024-09-17T01:51:53.681 INFO:tasks.workunit.client.0.smithi031.stdout:8/56: creat d0/d5/fa x:0 0 0 2024-09-17T01:51:53.682 INFO:tasks.workunit.client.0.smithi031.stdout:8/57: dread - d0/f9 zero size 2024-09-17T01:51:53.682 INFO:tasks.workunit.client.0.smithi031.stdout:5/72: mknod da/d14/c17 0 2024-09-17T01:51:53.682 INFO:tasks.workunit.client.1.smithi092.stdout:6/25: dwrite f0 [0,4194304] 0 2024-09-17T01:51:53.682 INFO:tasks.workunit.client.1.smithi092.stdout:7/29: mkdir d3/d6/d7 0 2024-09-17T01:51:53.683 INFO:tasks.workunit.client.0.smithi031.stdout:1/75: mkdir d4/d9/d18 0 2024-09-17T01:51:53.685 INFO:tasks.workunit.client.0.smithi031.stdout:8/58: truncate d0/f9 856744 0 2024-09-17T01:51:53.685 INFO:tasks.workunit.client.0.smithi031.stdout:0/36: getdents d0/dc/d5 0 2024-09-17T01:51:53.685 INFO:tasks.workunit.client.0.smithi031.stdout:5/73: read f8 [1728551,65718] 0 2024-09-17T01:51:53.686 INFO:tasks.workunit.client.0.smithi031.stdout:0/37: chown d0/l1 11704 1 2024-09-17T01:51:53.686 INFO:tasks.workunit.client.0.smithi031.stdout:7/25: mknod c9 0 2024-09-17T01:51:53.688 INFO:tasks.workunit.client.1.smithi092.stdout:2/19: rename f1 to f2 0 2024-09-17T01:51:53.688 INFO:tasks.workunit.client.0.smithi031.stdout:4/34: rename f0 to d8/f9 0 2024-09-17T01:51:53.689 INFO:tasks.workunit.client.1.smithi092.stdout:5/16: dwrite d0/f1 [0,4194304] 0 2024-09-17T01:51:53.690 INFO:tasks.workunit.client.0.smithi031.stdout:9/86: mknod d3/d10/c1e 0 2024-09-17T01:51:53.691 INFO:tasks.workunit.client.1.smithi092.stdout:9/30: unlink d0/f4 0 2024-09-17T01:51:53.692 INFO:tasks.workunit.client.1.smithi092.stdout:7/30: mknod d3/c8 0 2024-09-17T01:51:53.693 INFO:tasks.workunit.client.1.smithi092.stdout:9/31: write d0/f6 [827353,80334] 0 2024-09-17T01:51:53.693 INFO:tasks.workunit.client.1.smithi092.stdout:7/31: write d3/f5 [928513,11645] 0 2024-09-17T01:51:53.694 INFO:tasks.workunit.client.1.smithi092.stdout:2/20: symlink l3 0 2024-09-17T01:51:53.695 INFO:tasks.workunit.client.1.smithi092.stdout:7/32: stat d3/d6/d7 0 2024-09-17T01:51:53.695 INFO:tasks.workunit.client.0.smithi031.stdout:1/76: mkdir d4/d9/d19 0 2024-09-17T01:51:53.697 INFO:tasks.workunit.client.1.smithi092.stdout:2/21: write f2 [3682142,98160] 0 2024-09-17T01:51:53.697 INFO:tasks.workunit.client.1.smithi092.stdout:2/22: rmdir - no directory 2024-09-17T01:51:53.697 INFO:tasks.workunit.client.0.smithi031.stdout:7/26: dwrite f5 [0,4194304] 0 2024-09-17T01:51:53.698 INFO:tasks.workunit.client.1.smithi092.stdout:2/23: write f2 [4295017,94933] 0 2024-09-17T01:51:53.699 INFO:tasks.workunit.client.0.smithi031.stdout:4/35: dread f3 [0,4194304] 0 2024-09-17T01:51:53.699 INFO:tasks.workunit.client.0.smithi031.stdout:7/27: write f5 [3506030,71296] 0 2024-09-17T01:51:53.700 INFO:tasks.workunit.client.0.smithi031.stdout:1/77: write d4/d9/fa [3659887,128751] 0 2024-09-17T01:51:53.700 INFO:tasks.workunit.client.0.smithi031.stdout:7/28: rmdir - no directory 2024-09-17T01:51:53.700 INFO:tasks.workunit.client.1.smithi092.stdout:9/32: creat d0/d5/f8 x:0 0 0 2024-09-17T01:51:53.701 INFO:tasks.workunit.client.0.smithi031.stdout:8/59: write d0/d5/d7/f8 [1072853,116364] 0 2024-09-17T01:51:53.702 INFO:tasks.workunit.client.1.smithi092.stdout:4/15: fsync f1 0 2024-09-17T01:51:53.703 INFO:tasks.workunit.client.1.smithi092.stdout:7/33: mkdir d3/d6/d7/d9 0 2024-09-17T01:51:53.703 INFO:tasks.workunit.client.0.smithi031.stdout:7/29: write f5 [3890498,5935] 0 2024-09-17T01:51:53.705 INFO:tasks.workunit.client.0.smithi031.stdout:6/101: rename l16 to d23/l25 0 2024-09-17T01:51:53.706 INFO:tasks.workunit.client.1.smithi092.stdout:9/33: symlink d0/d5/l9 0 2024-09-17T01:51:53.707 INFO:tasks.workunit.client.0.smithi031.stdout:1/78: mkdir d4/d1a 0 2024-09-17T01:51:53.708 INFO:tasks.workunit.client.1.smithi092.stdout:4/16: mknod c3 0 2024-09-17T01:51:53.709 INFO:tasks.workunit.client.1.smithi092.stdout:9/34: write d0/d5/f8 [378686,88827] 0 2024-09-17T01:51:53.710 INFO:tasks.workunit.client.0.smithi031.stdout:8/60: dread d0/f6 [0,4194304] 0 2024-09-17T01:51:53.710 INFO:tasks.workunit.client.0.smithi031.stdout:7/30: mknod ca 0 2024-09-17T01:51:53.710 INFO:tasks.workunit.client.1.smithi092.stdout:9/35: chown d0/f6 1716036755 1 2024-09-17T01:51:53.711 INFO:tasks.workunit.client.1.smithi092.stdout:7/34: mknod d3/ca 0 2024-09-17T01:51:53.712 INFO:tasks.workunit.client.1.smithi092.stdout:7/35: chown d3/ca 1603546 1 2024-09-17T01:51:53.713 INFO:tasks.workunit.client.0.smithi031.stdout:6/102: creat d23/f26 x:0 0 0 2024-09-17T01:51:53.713 INFO:tasks.workunit.client.1.smithi092.stdout:4/17: fsync f1 0 2024-09-17T01:51:53.715 INFO:tasks.workunit.client.1.smithi092.stdout:9/36: creat d0/fa x:0 0 0 2024-09-17T01:51:53.717 INFO:tasks.workunit.client.0.smithi031.stdout:7/31: mkdir db 0 2024-09-17T01:51:53.717 INFO:tasks.workunit.client.0.smithi031.stdout:8/61: mknod d0/d5/cb 0 2024-09-17T01:51:53.719 INFO:tasks.workunit.client.1.smithi092.stdout:9/37: chown d0/d5/f8 14585 1 2024-09-17T01:51:53.720 INFO:tasks.workunit.client.0.smithi031.stdout:1/79: creat d4/d9/d18/f1b x:0 0 0 2024-09-17T01:51:53.722 INFO:tasks.workunit.client.0.smithi031.stdout:7/32: chown l6 13 1 2024-09-17T01:51:53.723 INFO:tasks.workunit.client.1.smithi092.stdout:6/26: truncate f1 2275978 0 2024-09-17T01:51:53.723 INFO:tasks.workunit.client.1.smithi092.stdout:9/38: write d0/f6 [1739099,102225] 0 2024-09-17T01:51:53.724 INFO:tasks.workunit.client.1.smithi092.stdout:7/36: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:51:53.724 INFO:tasks.workunit.client.0.smithi031.stdout:8/62: unlink d0/d5/cb 0 2024-09-17T01:51:53.726 INFO:tasks.workunit.client.1.smithi092.stdout:7/37: chown d3/d6/d7/d9 0 1 2024-09-17T01:51:53.727 INFO:tasks.workunit.client.0.smithi031.stdout:2/74: creat d1/d3/f1b x:0 0 0 2024-09-17T01:51:53.727 INFO:tasks.workunit.client.1.smithi092.stdout:6/27: rename f0 to f2 0 2024-09-17T01:51:53.727 INFO:tasks.workunit.client.1.smithi092.stdout:6/28: rmdir - no directory 2024-09-17T01:51:53.728 INFO:tasks.workunit.client.0.smithi031.stdout:1/80: creat d4/d9/d18/f1c x:0 0 0 2024-09-17T01:51:53.728 INFO:tasks.workunit.client.1.smithi092.stdout:9/39: write d0/d5/f8 [1165997,31432] 0 2024-09-17T01:51:53.729 INFO:tasks.workunit.client.0.smithi031.stdout:0/38: write d0/f8 [1331360,28801] 0 2024-09-17T01:51:53.729 INFO:tasks.workunit.client.1.smithi092.stdout:4/18: dwrite f2 [0,4194304] 0 2024-09-17T01:51:53.730 INFO:tasks.workunit.client.1.smithi092.stdout:7/38: write d3/f5 [941282,46801] 0 2024-09-17T01:51:53.731 INFO:tasks.workunit.client.1.smithi092.stdout:9/40: rename d0/d5 to d0/d5/db 22 2024-09-17T01:51:53.732 INFO:tasks.workunit.client.0.smithi031.stdout:7/33: symlink db/lc 0 2024-09-17T01:51:53.735 INFO:tasks.workunit.client.0.smithi031.stdout:6/103: readlink d23/l25 0 2024-09-17T01:51:53.736 INFO:tasks.workunit.client.0.smithi031.stdout:0/39: write d0/dc/d5/fa [911700,32320] 0 2024-09-17T01:51:53.736 INFO:tasks.workunit.client.1.smithi092.stdout:6/29: mkdir d3 0 2024-09-17T01:51:53.738 INFO:tasks.workunit.client.0.smithi031.stdout:8/63: dwrite d0/d5/d7/f8 [0,4194304] 0 2024-09-17T01:51:53.738 INFO:tasks.workunit.client.1.smithi092.stdout:4/19: mkdir d4 0 2024-09-17T01:51:53.741 INFO:tasks.workunit.client.1.smithi092.stdout:2/24: truncate f2 2923020 0 2024-09-17T01:51:53.742 INFO:tasks.workunit.client.0.smithi031.stdout:7/34: dread f5 [0,4194304] 0 2024-09-17T01:51:53.742 INFO:tasks.workunit.client.0.smithi031.stdout:1/81: getdents d4/d9/d19 0 2024-09-17T01:51:53.743 INFO:tasks.workunit.client.0.smithi031.stdout:7/35: readlink l8 0 2024-09-17T01:51:53.744 INFO:tasks.workunit.client.1.smithi092.stdout:4/20: fsync f1 0 2024-09-17T01:51:53.744 INFO:tasks.workunit.client.1.smithi092.stdout:4/21: stat d4 0 2024-09-17T01:51:53.744 INFO:tasks.workunit.client.1.smithi092.stdout:9/41: getdents d0/d7 0 2024-09-17T01:51:53.746 INFO:tasks.workunit.client.0.smithi031.stdout:8/64: dread d0/f9 [0,4194304] 0 2024-09-17T01:51:53.746 INFO:tasks.workunit.client.0.smithi031.stdout:8/65: chown d0 6683 1 2024-09-17T01:51:53.747 INFO:tasks.workunit.client.1.smithi092.stdout:6/30: mknod d3/c4 0 2024-09-17T01:51:53.749 INFO:tasks.workunit.client.0.smithi031.stdout:1/82: rename d4/fc to d4/d1a/f1d 0 2024-09-17T01:51:53.751 INFO:tasks.workunit.client.0.smithi031.stdout:2/75: rename d1/d3/f10 to d1/d3/f1c 0 2024-09-17T01:51:53.752 INFO:tasks.workunit.client.1.smithi092.stdout:9/42: symlink d0/d7/lc 0 2024-09-17T01:51:53.752 INFO:tasks.workunit.client.1.smithi092.stdout:9/43: chown d0/d5/l9 14765 1 2024-09-17T01:51:53.753 INFO:tasks.workunit.client.1.smithi092.stdout:9/44: write d0/d5/f8 [867518,63355] 0 2024-09-17T01:51:53.754 INFO:tasks.workunit.client.0.smithi031.stdout:8/66: write d0/f9 [231007,65484] 0 2024-09-17T01:51:53.755 INFO:tasks.workunit.client.0.smithi031.stdout:8/67: truncate d0/d5/fa 474242 0 2024-09-17T01:51:53.757 INFO:tasks.workunit.client.1.smithi092.stdout:7/39: fdatasync d3/f5 0 2024-09-17T01:51:53.758 INFO:tasks.workunit.client.1.smithi092.stdout:7/40: stat d3/c8 0 2024-09-17T01:51:53.759 INFO:tasks.workunit.client.0.smithi031.stdout:1/83: rename d4/d9/d19 to d4/d1e 0 2024-09-17T01:51:53.760 INFO:tasks.workunit.client.0.smithi031.stdout:2/76: chown d1/f5 856 1 2024-09-17T01:51:53.761 INFO:tasks.workunit.client.0.smithi031.stdout:2/77: fsync d1/d3/fd 0 2024-09-17T01:51:53.762 INFO:tasks.workunit.client.0.smithi031.stdout:0/40: creat d0/dc/fd x:0 0 0 2024-09-17T01:51:53.763 INFO:tasks.workunit.client.0.smithi031.stdout:6/104: getdents d23 0 2024-09-17T01:51:53.763 INFO:tasks.workunit.client.1.smithi092.stdout:9/45: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:53.763 INFO:tasks.workunit.client.1.smithi092.stdout:7/41: rmdir d3/d6/d7 39 2024-09-17T01:51:53.765 INFO:tasks.workunit.client.0.smithi031.stdout:8/68: creat d0/d5/fc x:0 0 0 2024-09-17T01:51:53.766 INFO:tasks.workunit.client.0.smithi031.stdout:8/69: write d0/f9 [334803,19919] 0 2024-09-17T01:51:53.767 INFO:tasks.workunit.client.0.smithi031.stdout:8/70: chown d0 0 1 2024-09-17T01:51:53.767 INFO:tasks.workunit.client.0.smithi031.stdout:6/105: dread d23/f24 [4194304,4194304] 0 2024-09-17T01:51:53.768 INFO:tasks.workunit.client.0.smithi031.stdout:8/71: read - d0/d5/fc zero size 2024-09-17T01:51:53.769 INFO:tasks.workunit.client.0.smithi031.stdout:6/106: chown l8 64617 1 2024-09-17T01:51:53.769 INFO:tasks.workunit.client.1.smithi092.stdout:2/25: dread f2 [0,4194304] 0 2024-09-17T01:51:53.769 INFO:tasks.workunit.client.1.smithi092.stdout:6/31: dread f1 [0,4194304] 0 2024-09-17T01:51:53.770 INFO:tasks.workunit.client.1.smithi092.stdout:4/22: dwrite f1 [0,4194304] 0 2024-09-17T01:51:53.771 INFO:tasks.workunit.client.1.smithi092.stdout:2/26: truncate f2 3031555 0 2024-09-17T01:51:53.772 INFO:tasks.workunit.client.0.smithi031.stdout:2/78: fdatasync d1/d3/df/d11/f13 0 2024-09-17T01:51:53.772 INFO:tasks.workunit.client.1.smithi092.stdout:9/46: link d0/f6 d0/fd 0 2024-09-17T01:51:53.772 INFO:tasks.workunit.client.0.smithi031.stdout:2/79: chown d1/d3/fd 156142493 1 2024-09-17T01:51:53.773 INFO:tasks.workunit.client.1.smithi092.stdout:7/42: rename d3/d6/d7 to d3/db 0 2024-09-17T01:51:53.774 INFO:tasks.workunit.client.0.smithi031.stdout:0/41: unlink d0/dc/fd 0 2024-09-17T01:51:53.774 INFO:tasks.workunit.client.1.smithi092.stdout:6/32: rmdir d3 39 2024-09-17T01:51:53.774 INFO:tasks.workunit.client.0.smithi031.stdout:0/42: chown d0/dc/d5/cb 437 1 2024-09-17T01:51:53.776 INFO:tasks.workunit.client.1.smithi092.stdout:2/27: write f2 [1176537,66030] 0 2024-09-17T01:51:53.778 INFO:tasks.workunit.client.1.smithi092.stdout:7/43: creat d3/fc x:0 0 0 2024-09-17T01:51:53.778 INFO:tasks.workunit.client.1.smithi092.stdout:4/23: mkdir d4/d5 0 2024-09-17T01:51:53.780 INFO:tasks.workunit.client.1.smithi092.stdout:7/44: write d3/fc [201430,57678] 0 2024-09-17T01:51:53.781 INFO:tasks.workunit.client.1.smithi092.stdout:9/47: link d0/d5/f8 d0/d7/fe 0 2024-09-17T01:51:53.782 INFO:tasks.workunit.client.0.smithi031.stdout:8/72: mkdir d0/d5/d7/dd 0 2024-09-17T01:51:53.783 INFO:tasks.workunit.client.1.smithi092.stdout:6/33: dread f2 [0,4194304] 0 2024-09-17T01:51:53.783 INFO:tasks.workunit.client.0.smithi031.stdout:8/73: truncate d0/d5/fa 1400228 0 2024-09-17T01:51:53.784 INFO:tasks.workunit.client.0.smithi031.stdout:7/36: truncate f5 2967213 0 2024-09-17T01:51:53.784 INFO:tasks.workunit.client.0.smithi031.stdout:6/107: creat d23/f27 x:0 0 0 2024-09-17T01:51:53.785 INFO:tasks.workunit.client.0.smithi031.stdout:8/74: write d0/f9 [1738332,58424] 0 2024-09-17T01:51:53.786 INFO:tasks.workunit.client.0.smithi031.stdout:8/75: dread - d0/d5/fc zero size 2024-09-17T01:51:53.787 INFO:tasks.workunit.client.1.smithi092.stdout:4/24: dread f2 [0,4194304] 0 2024-09-17T01:51:53.787 INFO:tasks.workunit.client.1.smithi092.stdout:7/45: mkdir d3/db/d9/dd 0 2024-09-17T01:51:53.788 INFO:tasks.workunit.client.1.smithi092.stdout:7/46: rename d3 to d3/db/d9/de 22 2024-09-17T01:51:53.788 INFO:tasks.workunit.client.1.smithi092.stdout:6/34: creat d3/f5 x:0 0 0 2024-09-17T01:51:53.790 INFO:tasks.workunit.client.0.smithi031.stdout:7/37: symlink db/ld 0 2024-09-17T01:51:53.790 INFO:tasks.workunit.client.1.smithi092.stdout:4/25: fdatasync f2 0 2024-09-17T01:51:53.790 INFO:tasks.workunit.client.1.smithi092.stdout:4/26: chown f1 12942 1 2024-09-17T01:51:53.792 INFO:tasks.workunit.client.1.smithi092.stdout:7/47: unlink d3/f5 0 2024-09-17T01:51:53.793 INFO:tasks.workunit.client.0.smithi031.stdout:2/80: creat d1/d3/df/d19/f1d x:0 0 0 2024-09-17T01:51:53.794 INFO:tasks.workunit.client.1.smithi092.stdout:9/48: truncate d0/d5/f8 586802 0 2024-09-17T01:51:53.796 INFO:tasks.workunit.client.0.smithi031.stdout:8/76: mkdir d0/d5/d7/dd/de 0 2024-09-17T01:51:53.796 INFO:tasks.workunit.client.0.smithi031.stdout:8/77: fsync d0/d5/d7/f8 0 2024-09-17T01:51:53.797 INFO:tasks.workunit.client.0.smithi031.stdout:1/84: truncate d4/f10 1955022 0 2024-09-17T01:51:53.798 INFO:tasks.workunit.client.0.smithi031.stdout:1/85: write d4/d9/f15 [489383,78574] 0 2024-09-17T01:51:53.798 INFO:tasks.workunit.client.0.smithi031.stdout:2/81: mkdir d1/d3/df/d19/d1e 0 2024-09-17T01:51:53.798 INFO:tasks.workunit.client.1.smithi092.stdout:2/28: truncate f2 2487502 0 2024-09-17T01:51:53.799 INFO:tasks.workunit.client.1.smithi092.stdout:9/49: mkdir d0/df 0 2024-09-17T01:51:53.799 INFO:tasks.workunit.client.0.smithi031.stdout:0/43: rename d0/f6 to d0/dc/fe 0 2024-09-17T01:51:53.800 INFO:tasks.workunit.client.0.smithi031.stdout:0/44: chown d0/f8 0 1 2024-09-17T01:51:53.802 INFO:tasks.workunit.client.0.smithi031.stdout:1/86: write d4/d1a/f1d [4833740,24711] 0 2024-09-17T01:51:53.802 INFO:tasks.workunit.client.1.smithi092.stdout:4/27: dwrite f2 [0,4194304] 0 2024-09-17T01:51:53.803 INFO:tasks.workunit.client.0.smithi031.stdout:2/82: creat d1/d3/df/d19/f1f x:0 0 0 2024-09-17T01:51:53.803 INFO:tasks.workunit.client.0.smithi031.stdout:1/87: chown d4/d9/fd 153461 1 2024-09-17T01:51:53.805 INFO:tasks.workunit.client.1.smithi092.stdout:7/48: dwrite d3/fc [0,4194304] 0 2024-09-17T01:51:53.810 INFO:tasks.workunit.client.1.smithi092.stdout:9/50: rename d0/fa to d0/df/f10 0 2024-09-17T01:51:53.813 INFO:tasks.workunit.client.1.smithi092.stdout:6/35: getdents d3 0 2024-09-17T01:51:53.819 INFO:tasks.workunit.client.1.smithi092.stdout:7/49: unlink d3/ca 0 2024-09-17T01:51:53.822 INFO:tasks.workunit.client.1.smithi092.stdout:2/29: write f2 [3417863,117952] 0 2024-09-17T01:51:53.822 INFO:tasks.workunit.client.1.smithi092.stdout:6/36: creat d3/f6 x:0 0 0 2024-09-17T01:51:53.824 INFO:tasks.workunit.client.1.smithi092.stdout:9/51: truncate d0/d7/fe 991510 0 2024-09-17T01:51:53.827 INFO:tasks.workunit.client.1.smithi092.stdout:7/50: symlink d3/db/d9/lf 0 2024-09-17T01:51:53.828 INFO:tasks.workunit.client.1.smithi092.stdout:2/30: creat f4 x:0 0 0 2024-09-17T01:51:53.832 INFO:tasks.workunit.client.1.smithi092.stdout:7/51: dread d3/fc [0,4194304] 0 2024-09-17T01:51:53.835 INFO:tasks.workunit.client.1.smithi092.stdout:7/52: dread d3/fc [0,4194304] 0 2024-09-17T01:51:53.835 INFO:tasks.workunit.client.1.smithi092.stdout:2/31: rename f2 to f5 0 2024-09-17T01:51:53.840 INFO:tasks.workunit.client.1.smithi092.stdout:7/53: dread d3/fc [0,4194304] 0 2024-09-17T01:51:53.840 INFO:tasks.workunit.client.1.smithi092.stdout:6/37: rmdir d3 39 2024-09-17T01:51:53.848 INFO:tasks.workunit.client.1.smithi092.stdout:7/54: creat d3/f10 x:0 0 0 2024-09-17T01:51:53.851 INFO:tasks.workunit.client.1.smithi092.stdout:6/38: mkdir d3/d7 0 2024-09-17T01:51:53.851 INFO:tasks.workunit.client.1.smithi092.stdout:2/32: link l3 l6 0 2024-09-17T01:51:53.852 INFO:tasks.workunit.client.1.smithi092.stdout:7/55: symlink d3/db/d9/l11 0 2024-09-17T01:51:53.854 INFO:tasks.workunit.client.1.smithi092.stdout:7/56: read d3/fc [2394688,84432] 0 2024-09-17T01:51:53.856 INFO:tasks.workunit.client.1.smithi092.stdout:9/52: dwrite d0/d5/f8 [0,4194304] 0 2024-09-17T01:51:53.856 INFO:tasks.workunit.client.1.smithi092.stdout:6/39: dread f1 [0,4194304] 0 2024-09-17T01:51:53.857 INFO:tasks.workunit.client.1.smithi092.stdout:2/33: rename l3 to l7 0 2024-09-17T01:51:53.858 INFO:tasks.workunit.client.1.smithi092.stdout:2/34: dread - f4 zero size 2024-09-17T01:51:53.858 INFO:tasks.workunit.client.1.smithi092.stdout:2/35: read - f4 zero size 2024-09-17T01:51:53.861 INFO:tasks.workunit.client.1.smithi092.stdout:9/53: creat d0/d7/f11 x:0 0 0 2024-09-17T01:51:53.862 INFO:tasks.workunit.client.1.smithi092.stdout:9/54: chown d0/d7/f11 5 1 2024-09-17T01:51:53.862 INFO:tasks.workunit.client.1.smithi092.stdout:2/36: dread f5 [0,4194304] 0 2024-09-17T01:51:53.862 INFO:tasks.workunit.client.1.smithi092.stdout:9/55: chown d0/df 2 1 2024-09-17T01:51:53.863 INFO:tasks.workunit.client.1.smithi092.stdout:2/37: write f4 [559949,8216] 0 2024-09-17T01:51:53.863 INFO:tasks.workunit.client.1.smithi092.stdout:2/38: rmdir - no directory 2024-09-17T01:51:53.863 INFO:tasks.workunit.client.1.smithi092.stdout:6/40: creat d3/f8 x:0 0 0 2024-09-17T01:51:53.865 INFO:tasks.workunit.client.1.smithi092.stdout:7/57: mknod d3/d6/c12 0 2024-09-17T01:51:53.866 INFO:tasks.workunit.client.1.smithi092.stdout:9/56: unlink d0/df/f10 0 2024-09-17T01:51:53.870 INFO:tasks.workunit.client.1.smithi092.stdout:9/57: write d0/f6 [4807531,117584] 0 2024-09-17T01:51:53.871 INFO:tasks.workunit.client.1.smithi092.stdout:6/41: rmdir d3/d7 0 2024-09-17T01:51:53.873 INFO:tasks.workunit.client.1.smithi092.stdout:7/58: rename d3/db/d9 to d3/d6/d13 0 2024-09-17T01:51:53.874 INFO:tasks.workunit.client.1.smithi092.stdout:6/42: fdatasync d3/f5 0 2024-09-17T01:51:53.875 INFO:tasks.workunit.client.1.smithi092.stdout:7/59: chown d3/c8 6240009 1 2024-09-17T01:51:53.876 INFO:tasks.workunit.client.1.smithi092.stdout:2/39: dwrite f5 [0,4194304] 0 2024-09-17T01:51:53.878 INFO:tasks.workunit.client.1.smithi092.stdout:2/40: read f4 [167256,115659] 0 2024-09-17T01:51:53.879 INFO:tasks.workunit.client.1.smithi092.stdout:6/43: dread f1 [0,4194304] 0 2024-09-17T01:51:53.884 INFO:tasks.workunit.client.1.smithi092.stdout:2/41: creat f8 x:0 0 0 2024-09-17T01:51:53.886 INFO:tasks.workunit.client.1.smithi092.stdout:6/44: fdatasync f2 0 2024-09-17T01:51:53.887 INFO:tasks.workunit.client.1.smithi092.stdout:6/45: fsync d3/f6 0 2024-09-17T01:51:53.888 INFO:tasks.workunit.client.1.smithi092.stdout:7/60: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:51:53.892 INFO:tasks.workunit.client.0.smithi031.stdout:2/83: stat d1/d3/df/d19 0 2024-09-17T01:51:53.892 INFO:tasks.workunit.client.1.smithi092.stdout:6/46: rmdir d3 39 2024-09-17T01:51:53.893 INFO:tasks.workunit.client.0.smithi031.stdout:6/108: getdents d23 0 2024-09-17T01:51:53.893 INFO:tasks.workunit.client.1.smithi092.stdout:2/42: fdatasync f5 0 2024-09-17T01:51:53.893 INFO:tasks.workunit.client.1.smithi092.stdout:9/58: truncate d0/fd 4689051 0 2024-09-17T01:51:53.894 INFO:tasks.workunit.client.0.smithi031.stdout:6/109: write d23/f26 [392651,124965] 0 2024-09-17T01:51:53.895 INFO:tasks.workunit.client.1.smithi092.stdout:2/43: chown f4 65968 1 2024-09-17T01:51:53.895 INFO:tasks.workunit.client.0.smithi031.stdout:6/110: chown d23/f27 179873936 1 2024-09-17T01:51:53.898 INFO:tasks.workunit.client.1.smithi092.stdout:2/44: mknod c9 0 2024-09-17T01:51:53.899 INFO:tasks.workunit.client.1.smithi092.stdout:7/61: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:51:53.901 INFO:tasks.workunit.client.1.smithi092.stdout:6/47: symlink d3/l9 0 2024-09-17T01:51:53.903 INFO:tasks.workunit.client.1.smithi092.stdout:2/45: chown l7 86329 1 2024-09-17T01:51:53.903 INFO:tasks.workunit.client.1.smithi092.stdout:6/48: read - d3/f8 zero size 2024-09-17T01:51:53.904 INFO:tasks.workunit.client.1.smithi092.stdout:2/46: chown f5 2 1 2024-09-17T01:51:53.904 INFO:tasks.workunit.client.1.smithi092.stdout:2/47: chown c9 4280 1 2024-09-17T01:51:53.905 INFO:tasks.workunit.client.1.smithi092.stdout:9/59: fsync d0/f6 0 2024-09-17T01:51:53.906 INFO:tasks.workunit.client.1.smithi092.stdout:7/62: dread d3/f10 [0,4194304] 0 2024-09-17T01:51:53.907 INFO:tasks.workunit.client.1.smithi092.stdout:2/48: creat fa x:0 0 0 2024-09-17T01:51:53.907 INFO:tasks.workunit.client.1.smithi092.stdout:2/49: stat f8 0 2024-09-17T01:51:53.909 INFO:tasks.workunit.client.1.smithi092.stdout:9/60: rmdir d0 39 2024-09-17T01:51:53.911 INFO:tasks.workunit.client.1.smithi092.stdout:7/63: write d3/fc [4150847,84133] 0 2024-09-17T01:51:53.914 INFO:tasks.workunit.client.1.smithi092.stdout:9/61: mkdir d0/d7/d12 0 2024-09-17T01:51:53.916 INFO:tasks.workunit.client.1.smithi092.stdout:9/62: fsync d0/f6 0 2024-09-17T01:51:53.916 INFO:tasks.workunit.client.1.smithi092.stdout:7/64: unlink d3/c8 0 2024-09-17T01:51:53.916 INFO:tasks.workunit.client.1.smithi092.stdout:2/50: dwrite fa [0,4194304] 0 2024-09-17T01:51:53.917 INFO:tasks.workunit.client.1.smithi092.stdout:9/63: fsync d0/d5/f8 0 2024-09-17T01:51:53.918 INFO:tasks.workunit.client.1.smithi092.stdout:2/51: fsync f8 0 2024-09-17T01:51:53.922 INFO:tasks.workunit.client.1.smithi092.stdout:7/65: creat d3/f14 x:0 0 0 2024-09-17T01:51:53.924 INFO:tasks.workunit.client.1.smithi092.stdout:9/64: symlink d0/d5/l13 0 2024-09-17T01:51:53.924 INFO:tasks.workunit.client.1.smithi092.stdout:9/65: stat d0/f6 0 2024-09-17T01:51:53.926 INFO:tasks.workunit.client.1.smithi092.stdout:7/66: creat d3/db/f15 x:0 0 0 2024-09-17T01:51:53.929 INFO:tasks.workunit.client.1.smithi092.stdout:7/67: write d3/db/f15 [336981,13329] 0 2024-09-17T01:51:53.932 INFO:tasks.workunit.client.1.smithi092.stdout:9/66: dwrite d0/d5/f8 [0,4194304] 0 2024-09-17T01:51:53.932 INFO:tasks.workunit.client.1.smithi092.stdout:7/68: write d3/f10 [2216706,73719] 0 2024-09-17T01:51:53.933 INFO:tasks.workunit.client.1.smithi092.stdout:2/52: truncate fa 2804622 0 2024-09-17T01:51:53.934 INFO:tasks.workunit.client.1.smithi092.stdout:9/67: mknod d0/c14 0 2024-09-17T01:51:53.936 INFO:tasks.workunit.client.1.smithi092.stdout:7/69: mknod d3/d6/d13/c16 0 2024-09-17T01:51:53.937 INFO:tasks.workunit.client.1.smithi092.stdout:2/53: mknod cb 0 2024-09-17T01:51:53.938 INFO:tasks.workunit.client.1.smithi092.stdout:9/68: mknod d0/d5/c15 0 2024-09-17T01:51:53.939 INFO:tasks.workunit.client.1.smithi092.stdout:7/70: getdents d3/d6/d13/dd 0 2024-09-17T01:51:53.940 INFO:tasks.workunit.client.1.smithi092.stdout:7/71: stat d3/d6/d13 0 2024-09-17T01:51:53.941 INFO:tasks.workunit.client.1.smithi092.stdout:2/54: dread f4 [0,4194304] 0 2024-09-17T01:51:53.943 INFO:tasks.workunit.client.1.smithi092.stdout:2/55: mknod cc 0 2024-09-17T01:51:53.948 INFO:tasks.workunit.client.1.smithi092.stdout:2/56: creat fd x:0 0 0 2024-09-17T01:51:53.949 INFO:tasks.workunit.client.1.smithi092.stdout:2/57: creat fe x:0 0 0 2024-09-17T01:51:53.949 INFO:tasks.workunit.client.1.smithi092.stdout:7/72: dwrite d3/fc [4194304,4194304] 0 2024-09-17T01:51:53.949 INFO:tasks.workunit.client.1.smithi092.stdout:2/58: write fe [146135,48280] 0 2024-09-17T01:51:53.951 INFO:tasks.workunit.client.1.smithi092.stdout:7/73: creat d3/db/f17 x:0 0 0 2024-09-17T01:51:53.953 INFO:tasks.workunit.client.1.smithi092.stdout:2/59: rename cb to cf 0 2024-09-17T01:51:53.954 INFO:tasks.workunit.client.1.smithi092.stdout:7/74: mkdir d3/db/d18 0 2024-09-17T01:51:53.957 INFO:tasks.workunit.client.1.smithi092.stdout:7/75: getdents d3/d6/d13/dd 0 2024-09-17T01:51:53.958 INFO:tasks.workunit.client.1.smithi092.stdout:2/60: fdatasync fe 0 2024-09-17T01:51:53.958 INFO:tasks.workunit.client.1.smithi092.stdout:7/76: mknod d3/c19 0 2024-09-17T01:51:53.959 INFO:tasks.workunit.client.1.smithi092.stdout:2/61: dread f4 [0,4194304] 0 2024-09-17T01:51:53.959 INFO:tasks.workunit.client.1.smithi092.stdout:9/69: fdatasync d0/d5/f8 0 2024-09-17T01:51:53.960 INFO:tasks.workunit.client.1.smithi092.stdout:7/77: chown d3/d6/c12 844 1 2024-09-17T01:51:53.963 INFO:tasks.workunit.client.1.smithi092.stdout:7/78: symlink d3/db/l1a 0 2024-09-17T01:51:53.969 INFO:tasks.workunit.client.1.smithi092.stdout:7/79: rmdir d3/d6/d13/dd 0 2024-09-17T01:51:54.032 INFO:tasks.workunit.client.0.smithi031.stdout:0/45: mknod d0/dc/cf 0 2024-09-17T01:51:54.034 INFO:tasks.workunit.client.0.smithi031.stdout:6/111: mknod d23/c28 0 2024-09-17T01:51:54.035 INFO:tasks.workunit.client.0.smithi031.stdout:7/38: rename f5 to db/fe 0 2024-09-17T01:51:54.035 INFO:tasks.workunit.client.0.smithi031.stdout:6/112: read f1e [434601,59052] 0 2024-09-17T01:51:54.036 INFO:tasks.workunit.client.0.smithi031.stdout:1/88: rename d4 to d4/d9/d18/d1f 22 2024-09-17T01:51:54.036 INFO:tasks.workunit.client.1.smithi092.stdout:2/62: dwrite fd [0,4194304] 0 2024-09-17T01:51:54.036 INFO:tasks.workunit.client.0.smithi031.stdout:1/89: stat d4/d9/fe 0 2024-09-17T01:51:54.037 INFO:tasks.workunit.client.0.smithi031.stdout:1/90: write d4/d9/f16 [749707,12909] 0 2024-09-17T01:51:54.038 INFO:tasks.workunit.client.1.smithi092.stdout:9/70: dwrite d0/d7/f11 [0,4194304] 0 2024-09-17T01:51:54.038 INFO:tasks.workunit.client.0.smithi031.stdout:1/91: write d4/d9/f15 [1442401,15499] 0 2024-09-17T01:51:54.042 INFO:tasks.workunit.client.1.smithi092.stdout:2/63: mkdir d10 0 2024-09-17T01:51:54.045 INFO:tasks.workunit.client.1.smithi092.stdout:7/80: symlink d3/db/d18/l1b 0 2024-09-17T01:51:54.046 INFO:tasks.workunit.client.1.smithi092.stdout:9/71: getdents d0/d7 0 2024-09-17T01:51:54.047 INFO:tasks.workunit.client.1.smithi092.stdout:2/64: mknod d10/c11 0 2024-09-17T01:51:54.049 INFO:tasks.workunit.client.1.smithi092.stdout:9/72: creat d0/f16 x:0 0 0 2024-09-17T01:51:54.053 INFO:tasks.workunit.client.0.smithi031.stdout:3/32: sync 2024-09-17T01:51:54.053 INFO:tasks.workunit.client.0.smithi031.stdout:0/46: link d0/dc/cf d0/dc/d5/c10 0 2024-09-17T01:51:54.054 INFO:tasks.workunit.client.0.smithi031.stdout:3/33: dread - f7 zero size 2024-09-17T01:51:54.054 INFO:tasks.workunit.client.1.smithi092.stdout:9/73: mkdir d0/df/d17 0 2024-09-17T01:51:54.055 INFO:tasks.workunit.client.0.smithi031.stdout:2/84: link d1/d3/df/d11/f15 d1/f20 0 2024-09-17T01:51:54.057 INFO:tasks.workunit.client.0.smithi031.stdout:7/39: link l4 db/lf 0 2024-09-17T01:51:54.057 INFO:tasks.workunit.client.1.smithi092.stdout:9/74: write d0/d7/f11 [667444,67999] 0 2024-09-17T01:51:54.058 INFO:tasks.workunit.client.1.smithi092.stdout:2/65: dwrite f5 [0,4194304] 0 2024-09-17T01:51:54.059 INFO:tasks.workunit.client.1.smithi092.stdout:9/75: readlink d0/d5/l9 0 2024-09-17T01:51:54.061 INFO:tasks.workunit.client.1.smithi092.stdout:7/81: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:51:54.063 INFO:tasks.workunit.client.0.smithi031.stdout:2/85: fsync d1/d3/df/d11/f17 0 2024-09-17T01:51:54.063 INFO:tasks.workunit.client.0.smithi031.stdout:3/34: dwrite f9 [0,4194304] 0 2024-09-17T01:51:54.064 INFO:tasks.workunit.client.1.smithi092.stdout:7/82: fsync d3/fc 0 2024-09-17T01:51:54.067 INFO:tasks.workunit.client.0.smithi031.stdout:7/40: chown l4 27540230 1 2024-09-17T01:51:54.071 INFO:tasks.workunit.client.0.smithi031.stdout:0/47: creat d0/dc/f11 x:0 0 0 2024-09-17T01:51:54.072 INFO:tasks.workunit.client.0.smithi031.stdout:0/48: dread - d0/dc/f11 zero size 2024-09-17T01:51:54.073 INFO:tasks.workunit.client.0.smithi031.stdout:2/86: dread - d1/d3/df/d11/f15 zero size 2024-09-17T01:51:54.075 INFO:tasks.workunit.client.1.smithi092.stdout:9/76: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:54.079 INFO:tasks.workunit.client.1.smithi092.stdout:2/66: rename f4 to d10/f12 0 2024-09-17T01:51:54.079 INFO:tasks.workunit.client.0.smithi031.stdout:0/49: unlink d0/dc/d5/c10 0 2024-09-17T01:51:54.081 INFO:tasks.workunit.client.0.smithi031.stdout:2/87: mkdir d1/d3/df/d19/d1e/d21 0 2024-09-17T01:51:54.084 INFO:tasks.workunit.client.0.smithi031.stdout:0/50: unlink d0/dc/d5/cb 0 2024-09-17T01:51:54.084 INFO:tasks.workunit.client.1.smithi092.stdout:9/77: dread d0/d7/f11 [0,4194304] 0 2024-09-17T01:51:54.088 INFO:tasks.workunit.client.1.smithi092.stdout:9/78: dread d0/fd [0,4194304] 0 2024-09-17T01:51:54.089 INFO:tasks.workunit.client.1.smithi092.stdout:9/79: write d0/f6 [578118,107268] 0 2024-09-17T01:51:54.089 INFO:tasks.workunit.client.0.smithi031.stdout:0/51: mknod d0/dc/d5/c12 0 2024-09-17T01:51:54.090 INFO:tasks.workunit.client.1.smithi092.stdout:2/67: creat d10/f13 x:0 0 0 2024-09-17T01:51:54.095 INFO:tasks.workunit.client.0.smithi031.stdout:2/88: getdents d1/d3/df/d19 0 2024-09-17T01:51:54.096 INFO:tasks.workunit.client.1.smithi092.stdout:9/80: fdatasync d0/d7/f11 0 2024-09-17T01:51:54.096 INFO:tasks.workunit.client.1.smithi092.stdout:7/83: creat d3/d6/f1c x:0 0 0 2024-09-17T01:51:54.096 INFO:tasks.workunit.client.0.smithi031.stdout:2/89: read - d1/d3/df/d19/f1f zero size 2024-09-17T01:51:54.097 INFO:tasks.workunit.client.1.smithi092.stdout:7/84: truncate d3/f10 4751028 0 2024-09-17T01:51:54.097 INFO:tasks.workunit.client.0.smithi031.stdout:0/52: creat d0/dc/f13 x:0 0 0 2024-09-17T01:51:54.097 INFO:tasks.workunit.client.1.smithi092.stdout:2/68: rename f8 to d10/f14 0 2024-09-17T01:51:54.098 INFO:tasks.workunit.client.0.smithi031.stdout:0/53: chown d0/dc/d5/c12 1429 1 2024-09-17T01:51:54.098 INFO:tasks.workunit.client.1.smithi092.stdout:7/85: write d3/db/f15 [990472,19158] 0 2024-09-17T01:51:54.099 INFO:tasks.workunit.client.1.smithi092.stdout:9/81: creat d0/df/f18 x:0 0 0 2024-09-17T01:51:54.100 INFO:tasks.workunit.client.1.smithi092.stdout:9/82: read - d0/f16 zero size 2024-09-17T01:51:54.102 INFO:tasks.workunit.client.0.smithi031.stdout:0/54: unlink d0/f8 0 2024-09-17T01:51:54.102 INFO:tasks.workunit.client.1.smithi092.stdout:2/69: mkdir d10/d15 0 2024-09-17T01:51:54.103 INFO:tasks.workunit.client.0.smithi031.stdout:0/55: stat d0/dc 0 2024-09-17T01:51:54.104 INFO:tasks.workunit.client.1.smithi092.stdout:7/86: mkdir d3/db/d1d 0 2024-09-17T01:51:54.105 INFO:tasks.workunit.client.0.smithi031.stdout:0/56: rename d0/dc/d5 to d0/dc/d5/d14 22 2024-09-17T01:51:54.105 INFO:tasks.workunit.client.1.smithi092.stdout:7/87: write d3/f10 [4489307,49574] 0 2024-09-17T01:51:54.106 INFO:tasks.workunit.client.0.smithi031.stdout:2/90: dwrite d1/d3/f1c [0,4194304] 0 2024-09-17T01:51:54.109 INFO:tasks.workunit.client.0.smithi031.stdout:2/91: truncate d1/fe 36929 0 2024-09-17T01:51:54.111 INFO:tasks.workunit.client.0.smithi031.stdout:0/57: creat d0/dc/d5/f15 x:0 0 0 2024-09-17T01:51:54.111 INFO:tasks.workunit.client.1.smithi092.stdout:7/88: rmdir d3/db/d1d 0 2024-09-17T01:51:54.111 INFO:tasks.workunit.client.0.smithi031.stdout:2/92: write d1/d3/f4 [3705237,108027] 0 2024-09-17T01:51:54.113 INFO:tasks.workunit.client.1.smithi092.stdout:9/83: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:54.114 INFO:tasks.workunit.client.0.smithi031.stdout:2/93: readlink d1/l8 0 2024-09-17T01:51:54.115 INFO:tasks.workunit.client.1.smithi092.stdout:9/84: write d0/d7/fe [540608,5198] 0 2024-09-17T01:51:54.117 INFO:tasks.workunit.client.0.smithi031.stdout:0/58: stat d0/dc/cf 0 2024-09-17T01:51:54.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/94: dread d1/d3/f7 [0,4194304] 0 2024-09-17T01:51:54.120 INFO:tasks.workunit.client.1.smithi092.stdout:7/89: dwrite d3/f10 [4194304,4194304] 0 2024-09-17T01:51:54.123 INFO:tasks.workunit.client.1.smithi092.stdout:7/90: stat d3/c4 0 2024-09-17T01:51:54.124 INFO:tasks.workunit.client.1.smithi092.stdout:7/91: chown d3/d6/d13/l11 181 1 2024-09-17T01:51:54.126 INFO:tasks.workunit.client.1.smithi092.stdout:7/92: creat d3/db/f1e x:0 0 0 2024-09-17T01:51:54.131 INFO:tasks.workunit.client.1.smithi092.stdout:7/93: link c1 d3/c1f 0 2024-09-17T01:51:54.132 INFO:tasks.workunit.client.1.smithi092.stdout:9/85: rmdir d0/df 39 2024-09-17T01:51:54.135 INFO:tasks.workunit.client.1.smithi092.stdout:7/94: unlink d3/c19 0 2024-09-17T01:51:54.136 INFO:tasks.workunit.client.1.smithi092.stdout:7/95: fdatasync d3/fc 0 2024-09-17T01:51:54.137 INFO:tasks.workunit.client.1.smithi092.stdout:7/96: chown d3/d6/d13/c16 53 1 2024-09-17T01:51:54.138 INFO:tasks.workunit.client.1.smithi092.stdout:9/86: write d0/df/f18 [64251,116716] 0 2024-09-17T01:51:54.139 INFO:tasks.workunit.client.1.smithi092.stdout:9/87: truncate d0/f16 567240 0 2024-09-17T01:51:54.141 INFO:tasks.workunit.client.1.smithi092.stdout:7/97: creat d3/db/d18/f20 x:0 0 0 2024-09-17T01:51:54.142 INFO:tasks.workunit.client.1.smithi092.stdout:7/98: stat d3/db/d18/l1b 0 2024-09-17T01:51:54.144 INFO:tasks.workunit.client.1.smithi092.stdout:7/99: mkdir d3/d6/d13/d21 0 2024-09-17T01:51:54.144 INFO:tasks.workunit.client.1.smithi092.stdout:9/88: dread d0/d7/fe [0,4194304] 0 2024-09-17T01:51:54.147 INFO:tasks.workunit.client.1.smithi092.stdout:7/100: symlink d3/d6/d13/d21/l22 0 2024-09-17T01:51:54.153 INFO:tasks.workunit.client.1.smithi092.stdout:9/89: dwrite d0/d5/f8 [0,4194304] 0 2024-09-17T01:51:54.154 INFO:tasks.workunit.client.1.smithi092.stdout:9/90: write d0/d7/fe [144012,34220] 0 2024-09-17T01:51:54.156 INFO:tasks.workunit.client.1.smithi092.stdout:7/101: dwrite d3/d6/f1c [0,4194304] 0 2024-09-17T01:51:54.161 INFO:tasks.workunit.client.1.smithi092.stdout:9/91: mknod d0/df/d17/c19 0 2024-09-17T01:51:54.164 INFO:tasks.workunit.client.1.smithi092.stdout:9/92: rmdir d0/df/d17 39 2024-09-17T01:51:54.166 INFO:tasks.workunit.client.1.smithi092.stdout:9/93: chown d0/f16 226395946 1 2024-09-17T01:51:54.166 INFO:tasks.workunit.client.1.smithi092.stdout:7/102: dwrite d3/db/f15 [0,4194304] 0 2024-09-17T01:51:54.166 INFO:tasks.workunit.client.1.smithi092.stdout:9/94: chown d0/d5/l9 0 1 2024-09-17T01:51:54.167 INFO:tasks.workunit.client.1.smithi092.stdout:9/95: fdatasync d0/f16 0 2024-09-17T01:51:54.168 INFO:tasks.workunit.client.1.smithi092.stdout:9/96: readlink d0/d5/l9 0 2024-09-17T01:51:54.169 INFO:tasks.workunit.client.1.smithi092.stdout:9/97: fdatasync d0/fd 0 2024-09-17T01:51:54.173 INFO:tasks.workunit.client.1.smithi092.stdout:7/103: dread d3/f10 [4194304,4194304] 0 2024-09-17T01:51:54.174 INFO:tasks.workunit.client.1.smithi092.stdout:9/98: mknod d0/c1a 0 2024-09-17T01:51:54.175 INFO:tasks.workunit.client.1.smithi092.stdout:7/104: mkdir d3/d23 0 2024-09-17T01:51:54.177 INFO:tasks.workunit.client.1.smithi092.stdout:7/105: creat d3/d6/d13/d21/f24 x:0 0 0 2024-09-17T01:51:54.181 INFO:tasks.workunit.client.1.smithi092.stdout:7/106: rename d3/d23 to d3/db/d25 0 2024-09-17T01:51:54.183 INFO:tasks.workunit.client.1.smithi092.stdout:7/107: mkdir d3/db/d26 0 2024-09-17T01:51:54.184 INFO:tasks.workunit.client.1.smithi092.stdout:7/108: chown d3 7362544 1 2024-09-17T01:51:54.185 INFO:tasks.workunit.client.1.smithi092.stdout:7/109: read - d3/d6/d13/d21/f24 zero size 2024-09-17T01:51:54.186 INFO:tasks.workunit.client.1.smithi092.stdout:9/99: truncate d0/d5/f8 4030233 0 2024-09-17T01:51:54.190 INFO:tasks.workunit.client.1.smithi092.stdout:7/110: write d3/db/f15 [4817330,103492] 0 2024-09-17T01:51:54.192 INFO:tasks.workunit.client.1.smithi092.stdout:7/111: mknod d3/c27 0 2024-09-17T01:51:54.193 INFO:tasks.workunit.client.1.smithi092.stdout:9/100: dread d0/d7/fe [0,4194304] 0 2024-09-17T01:51:54.194 INFO:tasks.workunit.client.1.smithi092.stdout:7/112: write d3/db/d18/f20 [763887,55837] 0 2024-09-17T01:51:54.196 INFO:tasks.workunit.client.1.smithi092.stdout:7/113: symlink d3/db/l28 0 2024-09-17T01:51:54.197 INFO:tasks.workunit.client.1.smithi092.stdout:9/101: mknod d0/c1b 0 2024-09-17T01:51:54.198 INFO:tasks.workunit.client.1.smithi092.stdout:7/114: symlink d3/db/l29 0 2024-09-17T01:51:54.198 INFO:tasks.workunit.client.1.smithi092.stdout:7/115: readlink d3/db/l1a 0 2024-09-17T01:51:54.200 INFO:tasks.workunit.client.1.smithi092.stdout:7/116: write d3/d6/d13/d21/f24 [684861,3107] 0 2024-09-17T01:51:54.201 INFO:tasks.workunit.client.1.smithi092.stdout:9/102: dread d0/d5/f8 [0,4194304] 0 2024-09-17T01:51:54.202 INFO:tasks.workunit.client.1.smithi092.stdout:9/103: write d0/fd [1508508,9674] 0 2024-09-17T01:51:54.203 INFO:tasks.workunit.client.1.smithi092.stdout:7/117: rename d3/c27 to d3/db/d18/c2a 0 2024-09-17T01:51:54.204 INFO:tasks.workunit.client.1.smithi092.stdout:9/104: fsync d0/f6 0 2024-09-17T01:51:54.205 INFO:tasks.workunit.client.1.smithi092.stdout:7/118: mkdir d3/d2b 0 2024-09-17T01:51:54.207 INFO:tasks.workunit.client.1.smithi092.stdout:9/105: creat d0/df/d17/f1c x:0 0 0 2024-09-17T01:51:54.208 INFO:tasks.workunit.client.1.smithi092.stdout:7/119: creat d3/db/d18/f2c x:0 0 0 2024-09-17T01:51:54.209 INFO:tasks.workunit.client.1.smithi092.stdout:7/120: write d3/db/d18/f20 [1397055,1634] 0 2024-09-17T01:51:54.262 INFO:tasks.workunit.client.0.smithi031.stdout:7/41: dread db/fe [0,4194304] 0 2024-09-17T01:51:54.263 INFO:tasks.workunit.client.0.smithi031.stdout:6/113: truncate f1d 1309075 0 2024-09-17T01:51:54.264 INFO:tasks.workunit.client.0.smithi031.stdout:7/42: rmdir db 39 2024-09-17T01:51:54.265 INFO:tasks.workunit.client.0.smithi031.stdout:1/92: truncate d4/f17 2788462 0 2024-09-17T01:51:54.265 INFO:tasks.workunit.client.0.smithi031.stdout:1/93: fsync d4/d9/fd 0 2024-09-17T01:51:54.269 INFO:tasks.workunit.client.0.smithi031.stdout:6/114: stat ff 0 2024-09-17T01:51:54.270 INFO:tasks.workunit.client.0.smithi031.stdout:6/115: write f19 [117877,110769] 0 2024-09-17T01:51:54.271 INFO:tasks.workunit.client.0.smithi031.stdout:7/43: creat db/f10 x:0 0 0 2024-09-17T01:51:54.272 INFO:tasks.workunit.client.0.smithi031.stdout:7/44: chown c2 61866160 1 2024-09-17T01:51:54.273 INFO:tasks.workunit.client.0.smithi031.stdout:1/94: dwrite d4/d9/f16 [0,4194304] 0 2024-09-17T01:51:54.276 INFO:tasks.workunit.client.0.smithi031.stdout:1/95: write d4/d9/fd [350229,86830] 0 2024-09-17T01:51:54.277 INFO:tasks.workunit.client.0.smithi031.stdout:7/45: unlink c2 0 2024-09-17T01:51:54.280 INFO:tasks.workunit.client.0.smithi031.stdout:7/46: write db/f10 [258516,67721] 0 2024-09-17T01:51:54.283 INFO:tasks.workunit.client.0.smithi031.stdout:6/116: dwrite f1c [0,4194304] 0 2024-09-17T01:51:54.285 INFO:tasks.workunit.client.0.smithi031.stdout:1/96: creat d4/d9/f20 x:0 0 0 2024-09-17T01:51:54.290 INFO:tasks.workunit.client.0.smithi031.stdout:1/97: mknod d4/c21 0 2024-09-17T01:51:54.293 INFO:tasks.workunit.client.0.smithi031.stdout:6/117: dread f1e [0,4194304] 0 2024-09-17T01:51:54.294 INFO:tasks.workunit.client.0.smithi031.stdout:1/98: fsync d4/f10 0 2024-09-17T01:51:54.294 INFO:tasks.workunit.client.0.smithi031.stdout:7/47: link db/lf db/l11 0 2024-09-17T01:51:54.295 INFO:tasks.workunit.client.0.smithi031.stdout:1/99: stat d4/d9/lf 0 2024-09-17T01:51:54.296 INFO:tasks.workunit.client.0.smithi031.stdout:6/118: write f20 [749762,77712] 0 2024-09-17T01:51:54.300 INFO:tasks.workunit.client.0.smithi031.stdout:1/100: rename d4/d9/f20 to d4/d9/f22 0 2024-09-17T01:51:54.301 INFO:tasks.workunit.client.0.smithi031.stdout:6/119: symlink d23/l29 0 2024-09-17T01:51:54.303 INFO:tasks.workunit.client.0.smithi031.stdout:7/48: chown db/lf 846912 1 2024-09-17T01:51:54.306 INFO:tasks.workunit.client.0.smithi031.stdout:1/101: mknod d4/d1a/c23 0 2024-09-17T01:51:54.306 INFO:tasks.workunit.client.0.smithi031.stdout:1/102: fsync d4/d9/f16 0 2024-09-17T01:51:54.307 INFO:tasks.workunit.client.0.smithi031.stdout:6/120: rmdir d23 39 2024-09-17T01:51:54.307 INFO:tasks.workunit.client.0.smithi031.stdout:1/103: chown d4/c8 471 1 2024-09-17T01:51:54.307 INFO:tasks.workunit.client.0.smithi031.stdout:1/104: stat d4/f11 0 2024-09-17T01:51:54.314 INFO:tasks.workunit.client.0.smithi031.stdout:6/121: symlink d23/l2a 0 2024-09-17T01:51:54.320 INFO:tasks.workunit.client.0.smithi031.stdout:1/105: truncate d4/d9/f16 2783283 0 2024-09-17T01:51:54.322 INFO:tasks.workunit.client.0.smithi031.stdout:6/122: dwrite d23/f27 [0,4194304] 0 2024-09-17T01:51:54.327 INFO:tasks.workunit.client.0.smithi031.stdout:7/49: dwrite db/fe [0,4194304] 0 2024-09-17T01:51:54.328 INFO:tasks.workunit.client.0.smithi031.stdout:7/50: chown db/f10 443 1 2024-09-17T01:51:54.329 INFO:tasks.workunit.client.0.smithi031.stdout:1/106: dread d4/d9/f15 [0,4194304] 0 2024-09-17T01:51:54.332 INFO:tasks.workunit.client.0.smithi031.stdout:1/107: symlink d4/d9/l24 0 2024-09-17T01:51:54.332 INFO:tasks.workunit.client.0.smithi031.stdout:1/108: chown d4/f11 20143247 1 2024-09-17T01:51:54.336 INFO:tasks.workunit.client.0.smithi031.stdout:1/109: rename d4/d9/fd to d4/d1a/f25 0 2024-09-17T01:51:54.337 INFO:tasks.workunit.client.0.smithi031.stdout:1/110: truncate d4/d1a/f25 1291608 0 2024-09-17T01:51:54.345 INFO:tasks.workunit.client.0.smithi031.stdout:1/111: link d4/f17 d4/d9/d18/f26 0 2024-09-17T01:51:54.346 INFO:tasks.workunit.client.0.smithi031.stdout:6/123: dwrite f1d [0,4194304] 0 2024-09-17T01:51:54.347 INFO:tasks.workunit.client.0.smithi031.stdout:1/112: symlink d4/l27 0 2024-09-17T01:51:54.348 INFO:tasks.workunit.client.0.smithi031.stdout:6/124: read f19 [162485,100193] 0 2024-09-17T01:51:54.349 INFO:tasks.workunit.client.0.smithi031.stdout:6/125: read ff [1571919,110598] 0 2024-09-17T01:51:54.356 INFO:tasks.workunit.client.0.smithi031.stdout:6/126: dread f19 [0,4194304] 0 2024-09-17T01:51:54.357 INFO:tasks.workunit.client.0.smithi031.stdout:1/113: dread d4/d9/f16 [0,4194304] 0 2024-09-17T01:51:54.358 INFO:tasks.workunit.client.0.smithi031.stdout:6/127: symlink d23/l2b 0 2024-09-17T01:51:54.359 INFO:tasks.workunit.client.0.smithi031.stdout:1/114: symlink d4/d1a/l28 0 2024-09-17T01:51:54.360 INFO:tasks.workunit.client.0.smithi031.stdout:6/128: mknod d23/c2c 0 2024-09-17T01:51:54.361 INFO:tasks.workunit.client.0.smithi031.stdout:5/74: sync 2024-09-17T01:51:54.361 INFO:tasks.workunit.client.0.smithi031.stdout:1/115: symlink d4/d9/d18/l29 0 2024-09-17T01:51:54.362 INFO:tasks.workunit.client.0.smithi031.stdout:1/116: dread - d4/d9/f22 zero size 2024-09-17T01:51:54.363 INFO:tasks.workunit.client.0.smithi031.stdout:6/129: rename l8 to d23/l2d 0 2024-09-17T01:51:54.366 INFO:tasks.workunit.client.0.smithi031.stdout:6/130: rename ff to d23/f2e 0 2024-09-17T01:51:54.368 INFO:tasks.workunit.client.0.smithi031.stdout:5/75: link c1 da/d14/c18 0 2024-09-17T01:51:54.369 INFO:tasks.workunit.client.0.smithi031.stdout:5/76: fdatasync da/dc/fe 0 2024-09-17T01:51:54.370 INFO:tasks.workunit.client.0.smithi031.stdout:6/131: rename l18 to d23/l2f 0 2024-09-17T01:51:54.372 INFO:tasks.workunit.client.0.smithi031.stdout:1/117: dwrite d4/d9/f22 [0,4194304] 0 2024-09-17T01:51:54.377 INFO:tasks.workunit.client.0.smithi031.stdout:1/118: mknod d4/d9/d18/c2a 0 2024-09-17T01:51:54.379 INFO:tasks.workunit.client.0.smithi031.stdout:1/119: chown d4/d9/fa 4178777 1 2024-09-17T01:51:54.382 INFO:tasks.workunit.client.0.smithi031.stdout:6/132: dwrite f1a [0,4194304] 0 2024-09-17T01:51:54.385 INFO:tasks.workunit.client.0.smithi031.stdout:6/133: creat d23/f30 x:0 0 0 2024-09-17T01:51:54.385 INFO:tasks.workunit.client.0.smithi031.stdout:1/120: dread d4/d9/f22 [0,4194304] 0 2024-09-17T01:51:54.386 INFO:tasks.workunit.client.0.smithi031.stdout:6/134: truncate f1c 4912562 0 2024-09-17T01:51:54.387 INFO:tasks.workunit.client.0.smithi031.stdout:6/135: write d23/f30 [1047491,66086] 0 2024-09-17T01:51:54.387 INFO:tasks.workunit.client.0.smithi031.stdout:1/121: symlink d4/d1e/l2b 0 2024-09-17T01:51:54.389 INFO:tasks.workunit.client.0.smithi031.stdout:5/77: truncate da/dc/fe 3819317 0 2024-09-17T01:51:54.390 INFO:tasks.workunit.client.0.smithi031.stdout:1/122: mknod d4/d9/d18/c2c 0 2024-09-17T01:51:54.391 INFO:tasks.workunit.client.0.smithi031.stdout:1/123: chown d4/d9/d18/c2a 247562 1 2024-09-17T01:51:54.392 INFO:tasks.workunit.client.0.smithi031.stdout:6/136: link f1a d23/f31 0 2024-09-17T01:51:54.395 INFO:tasks.workunit.client.0.smithi031.stdout:1/124: chown d4/c7 7068 1 2024-09-17T01:51:54.396 INFO:tasks.workunit.client.0.smithi031.stdout:5/78: creat da/dc/d10/d12/f19 x:0 0 0 2024-09-17T01:51:54.398 INFO:tasks.workunit.client.0.smithi031.stdout:1/125: fsync d4/d9/d18/f26 0 2024-09-17T01:51:54.406 INFO:tasks.workunit.client.0.smithi031.stdout:6/137: dwrite f1d [4194304,4194304] 0 2024-09-17T01:51:54.407 INFO:tasks.workunit.client.0.smithi031.stdout:5/79: dread f4 [0,4194304] 0 2024-09-17T01:51:54.408 INFO:tasks.workunit.client.0.smithi031.stdout:6/138: write d23/f27 [5198688,82291] 0 2024-09-17T01:51:54.410 INFO:tasks.workunit.client.0.smithi031.stdout:5/80: mknod da/d14/c1a 0 2024-09-17T01:51:54.410 INFO:tasks.workunit.client.0.smithi031.stdout:6/139: chown d23/l2b 418025 1 2024-09-17T01:51:54.411 INFO:tasks.workunit.client.0.smithi031.stdout:5/81: write da/f11 [4275929,19982] 0 2024-09-17T01:51:54.412 INFO:tasks.workunit.client.0.smithi031.stdout:6/140: chown l2 127499089 1 2024-09-17T01:51:54.412 INFO:tasks.workunit.client.0.smithi031.stdout:6/141: rename d23 to d23/d32 22 2024-09-17T01:51:54.413 INFO:tasks.workunit.client.0.smithi031.stdout:6/142: fdatasync f20 0 2024-09-17T01:51:54.414 INFO:tasks.workunit.client.0.smithi031.stdout:5/82: read f8 [2856265,89535] 0 2024-09-17T01:51:54.414 INFO:tasks.workunit.client.0.smithi031.stdout:6/143: read d23/f26 [106728,40850] 0 2024-09-17T01:51:54.418 INFO:tasks.workunit.client.0.smithi031.stdout:5/83: mknod da/dc/d10/d12/c1b 0 2024-09-17T01:51:54.422 INFO:tasks.workunit.client.0.smithi031.stdout:5/84: getdents da/dc/d10 0 2024-09-17T01:51:54.423 INFO:tasks.workunit.client.0.smithi031.stdout:5/85: symlink da/dc/d10/d12/l1c 0 2024-09-17T01:51:54.426 INFO:tasks.workunit.client.0.smithi031.stdout:6/144: write f1e [649146,32896] 0 2024-09-17T01:51:54.428 INFO:tasks.workunit.client.0.smithi031.stdout:6/145: mkdir d23/d33 0 2024-09-17T01:51:54.430 INFO:tasks.workunit.client.0.smithi031.stdout:5/86: dread f8 [0,4194304] 0 2024-09-17T01:51:54.431 INFO:tasks.workunit.client.0.smithi031.stdout:6/146: rename f14 to d23/d33/f34 0 2024-09-17T01:51:54.432 INFO:tasks.workunit.client.0.smithi031.stdout:5/87: creat da/d14/f1d x:0 0 0 2024-09-17T01:51:54.432 INFO:tasks.workunit.client.0.smithi031.stdout:6/147: dread f19 [0,4194304] 0 2024-09-17T01:51:54.433 INFO:tasks.workunit.client.0.smithi031.stdout:6/148: chown d23 494245 1 2024-09-17T01:51:54.433 INFO:tasks.workunit.client.0.smithi031.stdout:6/149: chown f1e 1536837 1 2024-09-17T01:51:54.434 INFO:tasks.workunit.client.0.smithi031.stdout:6/150: chown d23/l25 32247332 1 2024-09-17T01:51:54.436 INFO:tasks.workunit.client.0.smithi031.stdout:6/151: creat d23/f35 x:0 0 0 2024-09-17T01:51:54.436 INFO:tasks.workunit.client.0.smithi031.stdout:6/152: fsync f1e 0 2024-09-17T01:51:54.437 INFO:tasks.workunit.client.0.smithi031.stdout:5/88: rmdir da/dc 39 2024-09-17T01:51:54.439 INFO:tasks.workunit.client.0.smithi031.stdout:5/89: dread - f5 zero size 2024-09-17T01:51:54.440 INFO:tasks.workunit.client.0.smithi031.stdout:5/90: write da/d14/f1d [489385,80970] 0 2024-09-17T01:51:54.441 INFO:tasks.workunit.client.0.smithi031.stdout:6/153: dread d23/f26 [0,4194304] 0 2024-09-17T01:51:54.443 INFO:tasks.workunit.client.0.smithi031.stdout:5/91: stat c1 0 2024-09-17T01:51:54.445 INFO:tasks.workunit.client.0.smithi031.stdout:6/154: dread d23/f31 [0,4194304] 0 2024-09-17T01:51:54.454 INFO:tasks.workunit.client.0.smithi031.stdout:5/92: dwrite da/dc/d10/d12/f19 [0,4194304] 0 2024-09-17T01:51:54.457 INFO:tasks.workunit.client.0.smithi031.stdout:6/155: dwrite f6 [0,4194304] 0 2024-09-17T01:51:54.457 INFO:tasks.workunit.client.0.smithi031.stdout:5/93: read f4 [2218169,84452] 0 2024-09-17T01:51:54.462 INFO:tasks.workunit.client.0.smithi031.stdout:6/156: dread d23/f2e [4194304,4194304] 0 2024-09-17T01:51:54.462 INFO:tasks.workunit.client.0.smithi031.stdout:5/94: getdents da/dc/d10/d12 0 2024-09-17T01:51:54.464 INFO:tasks.workunit.client.0.smithi031.stdout:6/157: rename d23/f27 to d23/f36 0 2024-09-17T01:51:54.466 INFO:tasks.workunit.client.0.smithi031.stdout:5/95: dread f4 [0,4194304] 0 2024-09-17T01:51:54.472 INFO:tasks.workunit.client.0.smithi031.stdout:5/96: getdents da/dc 0 2024-09-17T01:51:54.473 INFO:tasks.workunit.client.0.smithi031.stdout:6/158: dwrite d23/f36 [0,4194304] 0 2024-09-17T01:51:54.475 INFO:tasks.workunit.client.0.smithi031.stdout:5/97: symlink da/l1e 0 2024-09-17T01:51:54.476 INFO:tasks.workunit.client.0.smithi031.stdout:6/159: mknod d23/d33/c37 0 2024-09-17T01:51:54.479 INFO:tasks.workunit.client.0.smithi031.stdout:6/160: creat d23/d33/f38 x:0 0 0 2024-09-17T01:51:54.487 INFO:tasks.workunit.client.0.smithi031.stdout:6/161: dwrite d23/f30 [0,4194304] 0 2024-09-17T01:51:54.487 INFO:tasks.workunit.client.0.smithi031.stdout:5/98: write f5 [984048,18402] 0 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: pgmap v7: 65 pgs: 65 active+clean; 216 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 339 op/s 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: Standby manager daemon smithi031.ealpiz started 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/crt"}]: dispatch 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/key"}]: dispatch 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:51:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:54 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:54.490 INFO:tasks.workunit.client.0.smithi031.stdout:5/99: symlink da/dc/l1f 0 2024-09-17T01:51:54.495 INFO:tasks.workunit.client.0.smithi031.stdout:5/100: fsync f5 0 2024-09-17T01:51:54.498 INFO:tasks.workunit.client.0.smithi031.stdout:5/101: creat da/dc/d10/d12/f20 x:0 0 0 2024-09-17T01:51:54.501 INFO:tasks.workunit.client.0.smithi031.stdout:5/102: link da/l1e da/dc/l21 0 2024-09-17T01:51:54.502 INFO:tasks.workunit.client.0.smithi031.stdout:5/103: mkdir da/dc/d10/d22 0 2024-09-17T01:51:54.504 INFO:tasks.workunit.client.0.smithi031.stdout:5/104: rename da/dc/fe to da/dc/d10/d12/f23 0 2024-09-17T01:51:54.505 INFO:tasks.workunit.client.0.smithi031.stdout:5/105: chown da/d14/f1d 21674259 1 2024-09-17T01:51:54.507 INFO:tasks.workunit.client.0.smithi031.stdout:5/106: mknod da/c24 0 2024-09-17T01:51:54.507 INFO:tasks.workunit.client.0.smithi031.stdout:8/78: sync 2024-09-17T01:51:54.508 INFO:tasks.workunit.client.0.smithi031.stdout:4/36: sync 2024-09-17T01:51:54.508 INFO:tasks.workunit.client.0.smithi031.stdout:9/87: sync 2024-09-17T01:51:54.509 INFO:tasks.workunit.client.0.smithi031.stdout:9/88: chown d3/d19/f1b 1642 1 2024-09-17T01:51:54.512 INFO:tasks.workunit.client.0.smithi031.stdout:8/79: rename d0/d5/d7 to d0/df 0 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: pgmap v7: 65 pgs: 65 active+clean; 216 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 339 op/s 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: Standby manager daemon smithi031.ealpiz started 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/crt"}]: dispatch 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/key"}]: dispatch 2024-09-17T01:51:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/2' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:51:54.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:54 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:54.515 INFO:tasks.workunit.client.0.smithi031.stdout:8/80: mknod d0/d5/c10 0 2024-09-17T01:51:54.518 INFO:tasks.workunit.client.0.smithi031.stdout:4/37: dread d8/f9 [0,4194304] 0 2024-09-17T01:51:54.520 INFO:tasks.workunit.client.0.smithi031.stdout:9/89: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:51:54.520 INFO:tasks.workunit.client.0.smithi031.stdout:8/81: rename d0/d5/fc to d0/d5/f11 0 2024-09-17T01:51:54.523 INFO:tasks.workunit.client.0.smithi031.stdout:4/38: truncate f7 4689799 0 2024-09-17T01:51:54.525 INFO:tasks.workunit.client.0.smithi031.stdout:9/90: mkdir d3/d19/d1f 0 2024-09-17T01:51:54.527 INFO:tasks.workunit.client.0.smithi031.stdout:4/39: mknod d8/ca 0 2024-09-17T01:51:54.528 INFO:tasks.workunit.client.0.smithi031.stdout:9/91: rename d3/d10/c12 to d3/d19/c20 0 2024-09-17T01:51:54.529 INFO:tasks.workunit.client.0.smithi031.stdout:5/107: write da/dc/d10/d12/f23 [4680561,125170] 0 2024-09-17T01:51:54.530 INFO:tasks.workunit.client.0.smithi031.stdout:4/40: creat d8/fb x:0 0 0 2024-09-17T01:51:54.534 INFO:tasks.workunit.client.0.smithi031.stdout:5/108: dread f8 [0,4194304] 0 2024-09-17T01:51:54.536 INFO:tasks.workunit.client.0.smithi031.stdout:5/109: mkdir da/dc/d25 0 2024-09-17T01:51:54.541 INFO:tasks.workunit.client.0.smithi031.stdout:5/110: getdents da 0 2024-09-17T01:51:54.543 INFO:tasks.workunit.client.0.smithi031.stdout:5/111: mkdir da/dc/d10/d26 0 2024-09-17T01:51:54.547 INFO:tasks.workunit.client.0.smithi031.stdout:9/92: write d3/d4/f5 [819990,25241] 0 2024-09-17T01:51:54.547 INFO:tasks.workunit.client.0.smithi031.stdout:4/41: write f7 [4705149,120499] 0 2024-09-17T01:51:54.549 INFO:tasks.workunit.client.0.smithi031.stdout:5/112: write da/d14/f1d [1399339,98511] 0 2024-09-17T01:51:54.549 INFO:tasks.workunit.client.0.smithi031.stdout:4/42: chown f3 14 1 2024-09-17T01:51:54.550 INFO:tasks.workunit.client.0.smithi031.stdout:9/93: write d3/f1d [137222,65298] 0 2024-09-17T01:51:54.552 INFO:tasks.workunit.client.0.smithi031.stdout:4/43: creat d8/fc x:0 0 0 2024-09-17T01:51:54.559 INFO:tasks.workunit.client.0.smithi031.stdout:5/113: dread da/dc/d10/d12/f23 [0,4194304] 0 2024-09-17T01:51:54.564 INFO:tasks.workunit.client.0.smithi031.stdout:9/94: dwrite d3/f11 [0,4194304] 0 2024-09-17T01:51:54.569 INFO:tasks.workunit.client.0.smithi031.stdout:4/44: dwrite d8/fb [0,4194304] 0 2024-09-17T01:51:54.575 INFO:tasks.workunit.client.0.smithi031.stdout:5/114: dwrite da/f11 [0,4194304] 0 2024-09-17T01:51:54.576 INFO:tasks.workunit.client.0.smithi031.stdout:9/95: dread d3/f11 [0,4194304] 0 2024-09-17T01:51:54.577 INFO:tasks.workunit.client.0.smithi031.stdout:4/45: dread d8/f9 [0,4194304] 0 2024-09-17T01:51:54.578 INFO:tasks.workunit.client.0.smithi031.stdout:5/115: creat da/dc/f27 x:0 0 0 2024-09-17T01:51:54.581 INFO:tasks.workunit.client.0.smithi031.stdout:9/96: rename d3/d19/f1b to d3/d19/d1f/f21 0 2024-09-17T01:51:54.582 INFO:tasks.workunit.client.0.smithi031.stdout:9/97: write d3/d4/f5 [6611,120562] 0 2024-09-17T01:51:54.584 INFO:tasks.workunit.client.0.smithi031.stdout:4/46: rename f3 to d8/fd 0 2024-09-17T01:51:54.587 INFO:tasks.workunit.client.0.smithi031.stdout:9/98: creat d3/d19/f22 x:0 0 0 2024-09-17T01:51:54.590 INFO:tasks.workunit.client.0.smithi031.stdout:5/116: getdents da/dc/d10 0 2024-09-17T01:51:54.592 INFO:tasks.workunit.client.0.smithi031.stdout:9/99: creat d3/d19/d1f/f23 x:0 0 0 2024-09-17T01:51:54.593 INFO:tasks.workunit.client.0.smithi031.stdout:5/117: mknod da/dc/c28 0 2024-09-17T01:51:54.594 INFO:tasks.workunit.client.0.smithi031.stdout:9/100: creat d3/d10/f24 x:0 0 0 2024-09-17T01:51:54.596 INFO:tasks.workunit.client.0.smithi031.stdout:9/101: write d3/d19/d1f/f23 [1044866,80418] 0 2024-09-17T01:51:54.596 INFO:tasks.workunit.client.0.smithi031.stdout:5/118: mknod da/dc/d10/d26/c29 0 2024-09-17T01:51:54.596 INFO:tasks.workunit.client.0.smithi031.stdout:9/102: fdatasync d3/d10/f24 0 2024-09-17T01:51:54.597 INFO:tasks.workunit.client.0.smithi031.stdout:9/103: chown d3/d10/f14 309 1 2024-09-17T01:51:54.598 INFO:tasks.workunit.client.0.smithi031.stdout:5/119: mknod da/dc/d10/d12/c2a 0 2024-09-17T01:51:54.600 INFO:tasks.workunit.client.0.smithi031.stdout:5/120: symlink da/dc/l2b 0 2024-09-17T01:51:54.601 INFO:tasks.workunit.client.0.smithi031.stdout:9/104: creat d3/f25 x:0 0 0 2024-09-17T01:51:54.601 INFO:tasks.workunit.client.0.smithi031.stdout:9/105: readlink l0 0 2024-09-17T01:51:54.602 INFO:tasks.workunit.client.0.smithi031.stdout:0/59: sync 2024-09-17T01:51:54.602 INFO:tasks.workunit.client.0.smithi031.stdout:3/35: sync 2024-09-17T01:51:54.605 INFO:tasks.workunit.client.0.smithi031.stdout:3/36: mkdir db 0 2024-09-17T01:51:54.605 INFO:tasks.workunit.client.0.smithi031.stdout:4/47: fdatasync d8/fb 0 2024-09-17T01:51:54.608 INFO:tasks.workunit.client.0.smithi031.stdout:9/106: rmdir d3/d4 39 2024-09-17T01:51:54.608 INFO:tasks.workunit.client.0.smithi031.stdout:0/60: write d0/dc/d5/f15 [262068,38325] 0 2024-09-17T01:51:54.609 INFO:tasks.workunit.client.0.smithi031.stdout:3/37: fdatasync f5 0 2024-09-17T01:51:54.610 INFO:tasks.workunit.client.0.smithi031.stdout:3/38: readlink - no filename 2024-09-17T01:51:54.611 INFO:tasks.workunit.client.0.smithi031.stdout:4/48: rmdir d8 39 2024-09-17T01:51:54.611 INFO:tasks.workunit.client.0.smithi031.stdout:0/61: stat d0/l1 0 2024-09-17T01:51:54.615 INFO:tasks.workunit.client.0.smithi031.stdout:5/121: dwrite da/dc/f27 [0,4194304] 0 2024-09-17T01:51:54.619 INFO:tasks.workunit.client.0.smithi031.stdout:4/49: creat d8/fe x:0 0 0 2024-09-17T01:51:54.620 INFO:tasks.workunit.client.0.smithi031.stdout:4/50: chown f5 314 1 2024-09-17T01:51:54.621 INFO:tasks.workunit.client.0.smithi031.stdout:4/51: stat d8 0 2024-09-17T01:51:54.623 INFO:tasks.workunit.client.0.smithi031.stdout:4/52: stat c4 0 2024-09-17T01:51:54.625 INFO:tasks.workunit.client.0.smithi031.stdout:0/62: creat d0/dc/f16 x:0 0 0 2024-09-17T01:51:54.626 INFO:tasks.workunit.client.0.smithi031.stdout:9/107: getdents d3 0 2024-09-17T01:51:54.627 INFO:tasks.workunit.client.0.smithi031.stdout:3/39: truncate f9 1078896 0 2024-09-17T01:51:54.627 INFO:tasks.workunit.client.0.smithi031.stdout:5/122: dwrite da/d14/f1d [0,4194304] 0 2024-09-17T01:51:54.628 INFO:tasks.workunit.client.0.smithi031.stdout:3/40: fdatasync f5 0 2024-09-17T01:51:54.629 INFO:tasks.workunit.client.0.smithi031.stdout:4/53: link d8/fc d8/ff 0 2024-09-17T01:51:54.634 INFO:tasks.workunit.client.0.smithi031.stdout:4/54: fsync f7 0 2024-09-17T01:51:54.635 INFO:tasks.workunit.client.0.smithi031.stdout:0/63: mkdir d0/dc/d17 0 2024-09-17T01:51:54.636 INFO:tasks.workunit.client.0.smithi031.stdout:0/64: stat d0/dc/d5/fa 0 2024-09-17T01:51:54.637 INFO:tasks.workunit.client.0.smithi031.stdout:3/41: mkdir db/dc 0 2024-09-17T01:51:54.640 INFO:tasks.workunit.client.0.smithi031.stdout:0/65: creat d0/f18 x:0 0 0 2024-09-17T01:51:54.641 INFO:tasks.workunit.client.0.smithi031.stdout:9/108: link d3/d10/l16 d3/d10/l26 0 2024-09-17T01:51:54.643 INFO:tasks.workunit.client.0.smithi031.stdout:0/66: creat d0/f19 x:0 0 0 2024-09-17T01:51:54.644 INFO:tasks.workunit.client.0.smithi031.stdout:3/42: truncate f3 439110 0 2024-09-17T01:51:54.646 INFO:tasks.workunit.client.0.smithi031.stdout:4/55: rmdir d8 39 2024-09-17T01:51:54.646 INFO:tasks.workunit.client.0.smithi031.stdout:9/109: write d3/f11 [3238319,93296] 0 2024-09-17T01:51:54.648 INFO:tasks.workunit.client.0.smithi031.stdout:5/123: write f8 [2654212,8314] 0 2024-09-17T01:51:54.648 INFO:tasks.workunit.client.0.smithi031.stdout:9/110: truncate d3/d19/f22 580440 0 2024-09-17T01:51:54.649 INFO:tasks.workunit.client.0.smithi031.stdout:0/67: mkdir d0/dc/d1a 0 2024-09-17T01:51:54.649 INFO:tasks.workunit.client.0.smithi031.stdout:9/111: read d3/f1d [3667864,87078] 0 2024-09-17T01:51:54.650 INFO:tasks.workunit.client.0.smithi031.stdout:0/68: stat d0/dc/d5/fa 0 2024-09-17T01:51:54.651 INFO:tasks.workunit.client.0.smithi031.stdout:4/56: creat d8/f10 x:0 0 0 2024-09-17T01:51:54.654 INFO:tasks.workunit.client.0.smithi031.stdout:9/112: rmdir d3/d19 39 2024-09-17T01:51:54.657 INFO:tasks.workunit.client.0.smithi031.stdout:0/69: write d0/dc/fe [2084669,89710] 0 2024-09-17T01:51:54.657 INFO:tasks.workunit.client.0.smithi031.stdout:0/70: rename d0/dc/d17 to d0/dc/d17/d1b 22 2024-09-17T01:51:54.660 INFO:tasks.workunit.client.0.smithi031.stdout:0/71: creat d0/dc/d5/f1c x:0 0 0 2024-09-17T01:51:54.663 INFO:tasks.workunit.client.0.smithi031.stdout:4/57: rmdir d8 39 2024-09-17T01:51:54.663 INFO:tasks.workunit.client.0.smithi031.stdout:9/113: write d3/d19/d1f/f21 [334712,9408] 0 2024-09-17T01:51:54.667 INFO:tasks.workunit.client.0.smithi031.stdout:9/114: truncate d3/d19/d1f/f21 1235690 0 2024-09-17T01:51:54.669 INFO:tasks.workunit.client.0.smithi031.stdout:4/58: creat d8/f11 x:0 0 0 2024-09-17T01:51:54.669 INFO:tasks.workunit.client.0.smithi031.stdout:9/115: fsync d3/d19/d1f/f23 0 2024-09-17T01:51:54.670 INFO:tasks.workunit.client.0.smithi031.stdout:0/72: dwrite d0/f18 [0,4194304] 0 2024-09-17T01:51:54.670 INFO:tasks.workunit.client.0.smithi031.stdout:9/116: readlink l0 0 2024-09-17T01:51:54.670 INFO:tasks.workunit.client.0.smithi031.stdout:0/73: stat d0/f18 0 2024-09-17T01:51:54.671 INFO:tasks.workunit.client.0.smithi031.stdout:4/59: write f5 [549015,31909] 0 2024-09-17T01:51:54.673 INFO:tasks.workunit.client.0.smithi031.stdout:0/74: mknod d0/c1d 0 2024-09-17T01:51:54.674 INFO:tasks.workunit.client.0.smithi031.stdout:0/75: truncate d0/dc/f13 294774 0 2024-09-17T01:51:54.675 INFO:tasks.workunit.client.0.smithi031.stdout:0/76: truncate d0/dc/f11 198306 0 2024-09-17T01:51:54.675 INFO:tasks.workunit.client.0.smithi031.stdout:4/60: dread d8/f9 [0,4194304] 0 2024-09-17T01:51:54.678 INFO:tasks.workunit.client.0.smithi031.stdout:4/61: mknod d8/c12 0 2024-09-17T01:51:54.680 INFO:tasks.workunit.client.0.smithi031.stdout:0/77: link d0/dc/f16 d0/dc/d1a/f1e 0 2024-09-17T01:51:54.681 INFO:tasks.workunit.client.0.smithi031.stdout:4/62: write d8/fd [545178,81695] 0 2024-09-17T01:51:54.682 INFO:tasks.workunit.client.0.smithi031.stdout:0/78: creat d0/f1f x:0 0 0 2024-09-17T01:51:54.683 INFO:tasks.workunit.client.0.smithi031.stdout:0/79: fdatasync d0/dc/d5/f15 0 2024-09-17T01:51:54.685 INFO:tasks.workunit.client.0.smithi031.stdout:0/80: write d0/dc/d5/f15 [85352,52993] 0 2024-09-17T01:51:54.688 INFO:tasks.workunit.client.0.smithi031.stdout:0/81: rename d0/c1d to d0/dc/d1a/c20 0 2024-09-17T01:51:54.692 INFO:tasks.workunit.client.0.smithi031.stdout:0/82: rmdir d0/dc/d17 0 2024-09-17T01:51:54.693 INFO:tasks.workunit.client.0.smithi031.stdout:0/83: dread - d0/dc/d1a/f1e zero size 2024-09-17T01:51:54.693 INFO:tasks.workunit.client.0.smithi031.stdout:0/84: chown d0/dc/d5 1240228056 1 2024-09-17T01:51:54.694 INFO:tasks.workunit.client.0.smithi031.stdout:0/85: read - d0/f1f zero size 2024-09-17T01:51:54.697 INFO:tasks.workunit.client.0.smithi031.stdout:0/86: unlink d0/dc/f16 0 2024-09-17T01:51:54.704 INFO:tasks.workunit.client.0.smithi031.stdout:4/63: dwrite d8/ff [0,4194304] 0 2024-09-17T01:51:54.713 INFO:tasks.workunit.client.0.smithi031.stdout:4/64: link l6 d8/l13 0 2024-09-17T01:51:54.716 INFO:tasks.workunit.client.0.smithi031.stdout:0/87: write d0/dc/d1a/f1e [365401,40933] 0 2024-09-17T01:51:54.718 INFO:tasks.workunit.client.0.smithi031.stdout:0/88: write d0/f18 [3642627,80935] 0 2024-09-17T01:51:54.720 INFO:tasks.workunit.client.0.smithi031.stdout:4/65: dwrite d8/fb [0,4194304] 0 2024-09-17T01:51:54.726 INFO:tasks.workunit.client.0.smithi031.stdout:4/66: unlink d8/fe 0 2024-09-17T01:51:54.727 INFO:tasks.workunit.client.0.smithi031.stdout:4/67: chown d8/f11 6 1 2024-09-17T01:51:54.727 INFO:tasks.workunit.client.0.smithi031.stdout:0/89: chown d0/dc/d1a/c20 10 1 2024-09-17T01:51:54.727 INFO:tasks.workunit.client.0.smithi031.stdout:4/68: fdatasync f5 0 2024-09-17T01:51:54.729 INFO:tasks.workunit.client.0.smithi031.stdout:0/90: write d0/dc/d5/f15 [1334842,97978] 0 2024-09-17T01:51:54.730 INFO:tasks.workunit.client.0.smithi031.stdout:4/69: creat d8/f14 x:0 0 0 2024-09-17T01:51:54.730 INFO:tasks.workunit.client.0.smithi031.stdout:4/70: chown d8/f9 198438 1 2024-09-17T01:51:54.736 INFO:tasks.workunit.client.0.smithi031.stdout:0/91: dwrite d0/f1f [0,4194304] 0 2024-09-17T01:51:54.736 INFO:tasks.workunit.client.0.smithi031.stdout:4/71: fdatasync d8/fb 0 2024-09-17T01:51:54.740 INFO:tasks.workunit.client.0.smithi031.stdout:4/72: symlink d8/l15 0 2024-09-17T01:51:54.742 INFO:tasks.workunit.client.0.smithi031.stdout:4/73: chown l6 2405 1 2024-09-17T01:51:54.747 INFO:tasks.workunit.client.0.smithi031.stdout:0/92: dwrite d0/dc/fe [0,4194304] 0 2024-09-17T01:51:54.748 INFO:tasks.workunit.client.0.smithi031.stdout:0/93: fdatasync d0/dc/d5/fa 0 2024-09-17T01:51:54.748 INFO:tasks.workunit.client.0.smithi031.stdout:4/74: dread f7 [0,4194304] 0 2024-09-17T01:51:54.750 INFO:tasks.workunit.client.0.smithi031.stdout:4/75: chown d8/f9 144285 1 2024-09-17T01:51:54.750 INFO:tasks.workunit.client.0.smithi031.stdout:4/76: dread - d8/f11 zero size 2024-09-17T01:51:54.751 INFO:tasks.workunit.client.0.smithi031.stdout:0/94: rename d0/f18 to d0/f21 0 2024-09-17T01:51:54.751 INFO:tasks.workunit.client.0.smithi031.stdout:4/77: chown d8/f9 0 1 2024-09-17T01:51:54.753 INFO:tasks.workunit.client.0.smithi031.stdout:4/78: creat d8/f16 x:0 0 0 2024-09-17T01:51:54.756 INFO:tasks.workunit.client.0.smithi031.stdout:4/79: mknod d8/c17 0 2024-09-17T01:51:54.756 INFO:tasks.workunit.client.0.smithi031.stdout:0/95: dread d0/f1f [0,4194304] 0 2024-09-17T01:51:54.758 INFO:tasks.workunit.client.0.smithi031.stdout:4/80: mkdir d8/d18 0 2024-09-17T01:51:54.760 INFO:tasks.workunit.client.0.smithi031.stdout:0/96: rename d0/l1 to d0/dc/d5/l22 0 2024-09-17T01:51:54.760 INFO:tasks.workunit.client.0.smithi031.stdout:2/95: sync 2024-09-17T01:51:54.761 INFO:tasks.workunit.client.0.smithi031.stdout:0/97: chown d0/dc/d1a/c20 71117066 1 2024-09-17T01:51:54.762 INFO:tasks.workunit.client.0.smithi031.stdout:2/96: mknod d1/d3/df/c22 0 2024-09-17T01:51:54.764 INFO:tasks.workunit.client.0.smithi031.stdout:2/97: chown d1/d3/df/c22 159522 1 2024-09-17T01:51:54.769 INFO:tasks.workunit.client.0.smithi031.stdout:2/98: link d1/d3/f1b d1/f23 0 2024-09-17T01:51:54.769 INFO:tasks.workunit.client.0.smithi031.stdout:0/98: dwrite d0/dc/f11 [0,4194304] 0 2024-09-17T01:51:54.773 INFO:tasks.workunit.client.0.smithi031.stdout:2/99: dread d1/d3/fb [0,4194304] 0 2024-09-17T01:51:54.785 INFO:tasks.workunit.client.0.smithi031.stdout:0/99: unlink d0/dc/cf 0 2024-09-17T01:51:54.786 INFO:tasks.workunit.client.0.smithi031.stdout:2/100: truncate d1/d3/df/d11/f15 696930 0 2024-09-17T01:51:54.789 INFO:tasks.workunit.client.0.smithi031.stdout:0/100: rename d0/dc/fe to d0/dc/d1a/f23 0 2024-09-17T01:51:54.790 INFO:tasks.workunit.client.0.smithi031.stdout:2/101: creat d1/d3/df/d19/d1e/d21/f24 x:0 0 0 2024-09-17T01:51:54.794 INFO:tasks.workunit.client.0.smithi031.stdout:2/102: rename d1/fe to d1/d3/f25 0 2024-09-17T01:51:54.795 INFO:tasks.workunit.client.0.smithi031.stdout:0/101: dread d0/dc/d5/f15 [0,4194304] 0 2024-09-17T01:51:54.800 INFO:tasks.workunit.client.0.smithi031.stdout:2/103: truncate d1/d3/f7 3073810 0 2024-09-17T01:51:54.803 INFO:tasks.workunit.client.0.smithi031.stdout:0/102: dwrite d0/f1f [0,4194304] 0 2024-09-17T01:51:54.806 INFO:tasks.workunit.client.0.smithi031.stdout:2/104: rename d1/f2 to d1/d3/df/d11/f26 0 2024-09-17T01:51:54.807 INFO:tasks.workunit.client.0.smithi031.stdout:2/105: dread d1/d3/f6 [0,4194304] 0 2024-09-17T01:51:54.810 INFO:tasks.workunit.client.0.smithi031.stdout:2/106: truncate d1/f20 794281 0 2024-09-17T01:51:54.817 INFO:tasks.workunit.client.0.smithi031.stdout:2/107: dwrite d1/d3/df/d19/f1d [0,4194304] 0 2024-09-17T01:51:54.830 INFO:tasks.workunit.client.0.smithi031.stdout:2/108: dwrite d1/d3/fb [0,4194304] 0 2024-09-17T01:51:54.833 INFO:tasks.workunit.client.0.smithi031.stdout:2/109: mknod d1/d3/df/d19/d1e/d21/c27 0 2024-09-17T01:51:54.835 INFO:tasks.workunit.client.0.smithi031.stdout:2/110: dread - d1/f14 zero size 2024-09-17T01:51:54.842 INFO:tasks.workunit.client.0.smithi031.stdout:2/111: dwrite d1/d3/f4 [0,4194304] 0 2024-09-17T01:51:54.844 INFO:tasks.workunit.client.0.smithi031.stdout:2/112: creat d1/d3/df/d19/f28 x:0 0 0 2024-09-17T01:51:54.845 INFO:tasks.workunit.client.0.smithi031.stdout:2/113: chown d1/f14 67576 1 2024-09-17T01:51:54.868 INFO:tasks.workunit.client.0.smithi031.stdout:2/114: truncate d1/d3/df/d11/f26 902739 0 2024-09-17T01:51:54.869 INFO:tasks.workunit.client.0.smithi031.stdout:2/115: write d1/f14 [176215,66098] 0 2024-09-17T01:51:54.873 INFO:tasks.workunit.client.0.smithi031.stdout:2/116: link d1/d3/df/d11/f13 d1/d3/df/d19/d1e/f29 0 2024-09-17T01:51:54.874 INFO:tasks.workunit.client.0.smithi031.stdout:2/117: mkdir d1/d3/df/d19/d1e/d2a 0 2024-09-17T01:51:54.911 INFO:tasks.workunit.client.0.smithi031.stdout:7/51: sync 2024-09-17T01:51:54.912 INFO:tasks.workunit.client.0.smithi031.stdout:7/52: chown db/f10 453 1 2024-09-17T01:51:54.950 INFO:tasks.workunit.client.0.smithi031.stdout:2/118: unlink d1/c1a 0 2024-09-17T01:51:54.957 INFO:tasks.workunit.client.0.smithi031.stdout:2/119: dwrite d1/d3/fa [0,4194304] 0 2024-09-17T01:51:54.963 INFO:tasks.workunit.client.0.smithi031.stdout:2/120: dread d1/d3/df/d19/f1d [0,4194304] 0 2024-09-17T01:51:54.963 INFO:tasks.workunit.client.0.smithi031.stdout:2/121: readlink d1/l8 0 2024-09-17T01:51:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.065+0000 7f0d37c46700 1 -- 172.21.15.31:0/3072762207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30103310 msgr2=0x7f0d30105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:55.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.065+0000 7f0d37c46700 1 --2- 172.21.15.31:0/3072762207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30103310 0x7f0d30105790 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009910 tx=0x7f0d20009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.065+0000 7f0d37c46700 1 -- 172.21.15.31:0/3072762207 shutdown_connections 2024-09-17T01:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.065+0000 7f0d37c46700 1 --2- 172.21.15.31:0/3072762207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30103310 0x7f0d30105790 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.065+0000 7f0d37c46700 1 --2- 172.21.15.31:0/3072762207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d30069270 0x7f0d30102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.065+0000 7f0d37c46700 1 -- 172.21.15.31:0/3072762207 >> 172.21.15.31:0/3072762207 conn(0x7f0d300fa780 msgr2=0x7f0d300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.066+0000 7f0d37c46700 1 -- 172.21.15.31:0/3072762207 shutdown_connections 2024-09-17T01:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.066+0000 7f0d37c46700 1 -- 172.21.15.31:0/3072762207 wait complete. 2024-09-17T01:51:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.066+0000 7f0d37c46700 1 Processor -- start 2024-09-17T01:51:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.066+0000 7f0d37c46700 1 -- start start 2024-09-17T01:51:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d37c46700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d30103310 0x7f0d30195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d37c46700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 0x7f0d3019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d37c46700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30196510 con 0x7f0d30196010 2024-09-17T01:51:55.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d37c46700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30196680 con 0x7f0d30103310 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 0x7f0d3019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 0x7f0d3019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39508/0 (socket says 172.21.15.31:39508) 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 -- 172.21.15.31:0/1395023312 learned_addr learned my addr 172.21.15.31:0/1395023312 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d359e2700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d30103310 0x7f0d30195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 -- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d30103310 msgr2=0x7f0d30195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d30103310 0x7f0d30195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 -- 172.21.15.31:0/1395023312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200095f0 con 0x7f0d30196010 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.067+0000 7f0d351e1700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 0x7f0d3019b080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000bd70 tx=0x7f0d2000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.068+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d2001d070 con 0x7f0d30196010 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.068+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3019b5c0 con 0x7f0d30196010 2024-09-17T01:51:55.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.068+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d20005dc0 con 0x7f0d30196010 2024-09-17T01:51:55.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.068+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d20021410 con 0x7f0d30196010 2024-09-17T01:51:55.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.068+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3019ba80 con 0x7f0d30196010 2024-09-17T01:51:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.069+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3018fbf0 con 0x7f0d30196010 2024-09-17T01:51:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.070+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f0d2000f7d0 con 0x7f0d30196010 2024-09-17T01:51:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.071+0000 7f0d26ffd700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f0d1c06d600 0x7f0d1c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.071+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0d2008e130 con 0x7f0d30196010 2024-09-17T01:51:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.071+0000 7f0d359e2700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f0d1c06d600 0x7f0d1c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.071+0000 7f0d359e2700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f0d1c06d600 0x7f0d1c06fab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0d30068fa0 tx=0x7f0d2c0073d0 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.076+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f0d2005b2c0 con 0x7f0d30196010 2024-09-17T01:51:55.151 INFO:tasks.workunit.client.0.smithi031.stdout:7/53: rename db/l11 to db/l12 0 2024-09-17T01:51:55.153 INFO:tasks.workunit.client.0.smithi031.stdout:2/122: link d1/d3/df/d19/f1f d1/d3/df/f2b 0 2024-09-17T01:51:55.154 INFO:tasks.workunit.client.0.smithi031.stdout:6/162: sync 2024-09-17T01:51:55.154 INFO:tasks.workunit.client.0.smithi031.stdout:1/126: sync 2024-09-17T01:51:55.154 INFO:tasks.workunit.client.0.smithi031.stdout:8/82: sync 2024-09-17T01:51:55.156 INFO:tasks.workunit.client.0.smithi031.stdout:2/123: chown d1/d3/df/d19/f1d 7 1 2024-09-17T01:51:55.156 INFO:tasks.workunit.client.0.smithi031.stdout:6/163: chown d23/l2b 23975 1 2024-09-17T01:51:55.156 INFO:tasks.workunit.client.0.smithi031.stdout:7/54: symlink db/l13 0 2024-09-17T01:51:55.156 INFO:tasks.workunit.client.0.smithi031.stdout:6/164: dread - d23/d33/f38 zero size 2024-09-17T01:51:55.160 INFO:tasks.workunit.client.0.smithi031.stdout:8/83: write d0/d5/f11 [343350,34401] 0 2024-09-17T01:51:55.161 INFO:tasks.workunit.client.0.smithi031.stdout:6/165: fsync f19 0 2024-09-17T01:51:55.166 INFO:tasks.workunit.client.0.smithi031.stdout:8/84: link d0/d5/c10 d0/d5/c12 0 2024-09-17T01:51:55.168 INFO:tasks.workunit.client.0.smithi031.stdout:8/85: fdatasync d0/df/f8 0 2024-09-17T01:51:55.170 INFO:tasks.workunit.client.0.smithi031.stdout:6/166: dwrite f20 [0,4194304] 0 2024-09-17T01:51:55.171 INFO:tasks.workunit.client.0.smithi031.stdout:6/167: read f19 [23915,66247] 0 2024-09-17T01:51:55.172 INFO:tasks.workunit.client.0.smithi031.stdout:8/86: fdatasync d0/f6 0 2024-09-17T01:51:55.173 INFO:tasks.workunit.client.0.smithi031.stdout:8/87: read d0/df/f8 [2017376,7133] 0 2024-09-17T01:51:55.177 INFO:tasks.workunit.client.0.smithi031.stdout:6/168: creat d23/f39 x:0 0 0 2024-09-17T01:51:55.177 INFO:tasks.workunit.client.0.smithi031.stdout:8/88: write d0/f6 [6544052,62966] 0 2024-09-17T01:51:55.177 INFO:tasks.workunit.client.0.smithi031.stdout:8/89: mknod d0/c13 0 2024-09-17T01:51:55.181 INFO:tasks.workunit.client.0.smithi031.stdout:8/90: mknod d0/df/dd/de/c14 0 2024-09-17T01:51:55.224 INFO:tasks.workunit.client.0.smithi031.stdout:7/55: rmdir db 39 2024-09-17T01:51:55.226 INFO:tasks.workunit.client.0.smithi031.stdout:7/56: stat db/l13 0 2024-09-17T01:51:55.227 INFO:tasks.workunit.client.0.smithi031.stdout:7/57: chown ca 204077 1 2024-09-17T01:51:55.229 INFO:tasks.workunit.client.0.smithi031.stdout:6/169: getdents d23 0 2024-09-17T01:51:55.231 INFO:tasks.workunit.client.0.smithi031.stdout:7/58: creat db/f14 x:0 0 0 2024-09-17T01:51:55.231 INFO:tasks.workunit.client.0.smithi031.stdout:8/91: truncate d0/d5/fa 1263034 0 2024-09-17T01:51:55.233 INFO:tasks.workunit.client.0.smithi031.stdout:6/170: symlink d23/l3a 0 2024-09-17T01:51:55.233 INFO:tasks.workunit.client.0.smithi031.stdout:1/127: dwrite d4/d9/f16 [0,4194304] 0 2024-09-17T01:51:55.235 INFO:tasks.workunit.client.0.smithi031.stdout:8/92: symlink d0/l15 0 2024-09-17T01:51:55.239 INFO:tasks.workunit.client.0.smithi031.stdout:1/128: rename d4/d9 to d4/d1a/d2d 0 2024-09-17T01:51:55.242 INFO:tasks.workunit.client.0.smithi031.stdout:8/93: creat d0/df/dd/f16 x:0 0 0 2024-09-17T01:51:55.243 INFO:tasks.workunit.client.0.smithi031.stdout:6/171: dwrite f5 [0,4194304] 0 2024-09-17T01:51:55.243 INFO:tasks.workunit.client.0.smithi031.stdout:1/129: truncate d4/f11 345428 0 2024-09-17T01:51:55.244 INFO:tasks.workunit.client.0.smithi031.stdout:8/94: rename d0 to d0/df/dd/d17 22 2024-09-17T01:51:55.245 INFO:tasks.workunit.client.0.smithi031.stdout:7/59: fsync db/f14 0 2024-09-17T01:51:55.248 INFO:tasks.workunit.client.0.smithi031.stdout:8/95: write d0/df/dd/f16 [80230,41553] 0 2024-09-17T01:51:55.251 INFO:tasks.workunit.client.0.smithi031.stdout:6/172: link f6 d23/f3b 0 2024-09-17T01:51:55.253 INFO:tasks.workunit.client.0.smithi031.stdout:1/130: chown d4/d1a/d2d/c14 29034738 1 2024-09-17T01:51:55.257 INFO:tasks.workunit.client.0.smithi031.stdout:7/60: dwrite db/f14 [0,4194304] 0 2024-09-17T01:51:55.258 INFO:tasks.workunit.client.0.smithi031.stdout:1/131: dread - d4/d1a/d2d/d18/f1c zero size 2024-09-17T01:51:55.260 INFO:tasks.workunit.client.0.smithi031.stdout:7/61: write db/fe [2640073,5061] 0 2024-09-17T01:51:55.263 INFO:tasks.workunit.client.0.smithi031.stdout:7/62: write db/f10 [1236863,69200] 0 2024-09-17T01:51:55.264 INFO:tasks.workunit.client.0.smithi031.stdout:8/96: dwrite d0/df/f8 [0,4194304] 0 2024-09-17T01:51:55.270 INFO:tasks.workunit.client.0.smithi031.stdout:7/63: unlink l8 0 2024-09-17T01:51:55.271 INFO:tasks.workunit.client.0.smithi031.stdout:7/64: write db/f14 [670724,97477] 0 2024-09-17T01:51:55.272 INFO:tasks.workunit.client.0.smithi031.stdout:7/65: stat db/f10 0 2024-09-17T01:51:55.274 INFO:tasks.workunit.client.0.smithi031.stdout:3/43: sync 2024-09-17T01:51:55.274 INFO:tasks.workunit.client.0.smithi031.stdout:9/117: sync 2024-09-17T01:51:55.274 INFO:tasks.workunit.client.0.smithi031.stdout:5/124: sync 2024-09-17T01:51:55.278 INFO:tasks.workunit.client.0.smithi031.stdout:6/173: truncate d23/f2e 2220940 0 2024-09-17T01:51:55.282 INFO:tasks.workunit.client.0.smithi031.stdout:1/132: write d4/d1a/d2d/d18/f26 [509620,98450] 0 2024-09-17T01:51:55.283 INFO:tasks.workunit.client.0.smithi031.stdout:3/44: rmdir db 39 2024-09-17T01:51:55.283 INFO:tasks.workunit.client.0.smithi031.stdout:7/66: dread db/f10 [0,4194304] 0 2024-09-17T01:51:55.287 INFO:tasks.workunit.client.0.smithi031.stdout:6/174: rename d23/f24 to d23/d33/f3c 0 2024-09-17T01:51:55.287 INFO:tasks.workunit.client.0.smithi031.stdout:8/97: write d0/d5/fa [2304048,4656] 0 2024-09-17T01:51:55.288 INFO:tasks.workunit.client.0.smithi031.stdout:9/118: truncate d3/f1d 3961695 0 2024-09-17T01:51:55.291 INFO:tasks.workunit.client.0.smithi031.stdout:7/67: creat db/f15 x:0 0 0 2024-09-17T01:51:55.292 INFO:tasks.workunit.client.0.smithi031.stdout:1/133: dwrite d4/d1a/d2d/fa [0,4194304] 0 2024-09-17T01:51:55.292 INFO:tasks.workunit.client.0.smithi031.stdout:5/125: rmdir da/dc/d10/d22 0 2024-09-17T01:51:55.294 INFO:tasks.workunit.client.0.smithi031.stdout:1/134: fdatasync d4/d1a/d2d/d18/f1b 0 2024-09-17T01:51:55.295 INFO:tasks.workunit.client.0.smithi031.stdout:6/175: creat d23/f3d x:0 0 0 2024-09-17T01:51:55.295 INFO:tasks.workunit.client.0.smithi031.stdout:9/119: write d3/d10/f14 [8222189,56897] 0 2024-09-17T01:51:55.295 INFO:tasks.workunit.client.0.smithi031.stdout:1/135: stat d4 0 2024-09-17T01:51:55.296 INFO:tasks.workunit.client.0.smithi031.stdout:8/98: mknod d0/c18 0 2024-09-17T01:51:55.300 INFO:tasks.workunit.client.0.smithi031.stdout:6/176: chown c10 23601036 1 2024-09-17T01:51:55.302 INFO:tasks.workunit.client.0.smithi031.stdout:1/136: creat d4/d1a/d2d/d18/f2e x:0 0 0 2024-09-17T01:51:55.305 INFO:tasks.workunit.client.0.smithi031.stdout:7/68: dwrite db/f15 [0,4194304] 0 2024-09-17T01:51:55.306 INFO:tasks.workunit.client.0.smithi031.stdout:7/69: read db/f14 [1700619,63479] 0 2024-09-17T01:51:55.307 INFO:tasks.workunit.client.0.smithi031.stdout:8/99: rename d0/df/dd/de to d0/df/d19 0 2024-09-17T01:51:55.308 INFO:tasks.workunit.client.0.smithi031.stdout:9/120: unlink d3/d10/l16 0 2024-09-17T01:51:55.309 INFO:tasks.workunit.client.0.smithi031.stdout:9/121: chown l0 9238 1 2024-09-17T01:51:55.309 INFO:tasks.workunit.client.0.smithi031.stdout:1/137: dread d4/d1a/d2d/f16 [0,4194304] 0 2024-09-17T01:51:55.312 INFO:tasks.workunit.client.0.smithi031.stdout:3/45: rmdir db/dc 0 2024-09-17T01:51:55.324 INFO:tasks.workunit.client.0.smithi031.stdout:8/100: mknod d0/df/d19/c1a 0 2024-09-17T01:51:55.326 INFO:tasks.workunit.client.0.smithi031.stdout:1/138: mknod d4/d1a/c2f 0 2024-09-17T01:51:55.327 INFO:tasks.workunit.client.0.smithi031.stdout:3/46: mkdir db/dd 0 2024-09-17T01:51:55.330 INFO:tasks.workunit.client.0.smithi031.stdout:8/101: dwrite d0/df/f8 [0,4194304] 0 2024-09-17T01:51:55.330 INFO:tasks.workunit.client.0.smithi031.stdout:5/126: getdents da/dc 0 2024-09-17T01:51:55.333 INFO:tasks.workunit.client.0.smithi031.stdout:0/103: sync 2024-09-17T01:51:55.333 INFO:tasks.workunit.client.0.smithi031.stdout:4/81: sync 2024-09-17T01:51:55.333 INFO:tasks.workunit.client.0.smithi031.stdout:2/124: sync 2024-09-17T01:51:55.335 INFO:tasks.workunit.client.0.smithi031.stdout:2/125: chown d1/d3/f1b 1032511 1 2024-09-17T01:51:55.336 INFO:tasks.workunit.client.0.smithi031.stdout:2/126: dread - d1/d3/df/d11/f17 zero size 2024-09-17T01:51:55.338 INFO:tasks.workunit.client.0.smithi031.stdout:7/70: unlink db/lf 0 2024-09-17T01:51:55.341 INFO:tasks.workunit.client.0.smithi031.stdout:9/122: creat d3/d4/f27 x:0 0 0 2024-09-17T01:51:55.342 INFO:tasks.workunit.client.0.smithi031.stdout:5/127: dread da/dc/f16 [0,4194304] 0 2024-09-17T01:51:55.342 INFO:tasks.workunit.client.0.smithi031.stdout:1/139: mknod d4/d1e/c30 0 2024-09-17T01:51:55.345 INFO:tasks.workunit.client.0.smithi031.stdout:3/47: creat db/fe x:0 0 0 2024-09-17T01:51:55.346 INFO:tasks.workunit.client.0.smithi031.stdout:6/177: dwrite d23/f3b [4194304,4194304] 0 2024-09-17T01:51:55.353 INFO:tasks.workunit.client.0.smithi031.stdout:5/128: dwrite da/dc/d10/d12/f20 [0,4194304] 0 2024-09-17T01:51:55.356 INFO:tasks.workunit.client.0.smithi031.stdout:7/71: creat db/f16 x:0 0 0 2024-09-17T01:51:55.356 INFO:tasks.workunit.client.0.smithi031.stdout:2/127: chown d1/d3/df/d19/d1e/f29 236 1 2024-09-17T01:51:55.360 INFO:tasks.workunit.client.0.smithi031.stdout:0/104: mknod d0/dc/d1a/c24 0 2024-09-17T01:51:55.362 INFO:tasks.workunit.client.0.smithi031.stdout:5/129: mknod da/dc/c2c 0 2024-09-17T01:51:55.363 INFO:tasks.workunit.client.0.smithi031.stdout:7/72: write db/f10 [22532,98993] 0 2024-09-17T01:51:55.367 INFO:tasks.workunit.client.0.smithi031.stdout:1/140: link d4/d1a/d2d/f15 d4/d1a/d2d/d18/f31 0 2024-09-17T01:51:55.371 INFO:tasks.workunit.client.0.smithi031.stdout:2/128: dread d1/f5 [0,4194304] 0 2024-09-17T01:51:55.372 INFO:tasks.workunit.client.0.smithi031.stdout:5/130: dwrite da/dc/f27 [0,4194304] 0 2024-09-17T01:51:55.373 INFO:tasks.workunit.client.0.smithi031.stdout:9/123: chown d3/f1d 184664030 1 2024-09-17T01:51:55.377 INFO:tasks.workunit.client.0.smithi031.stdout:0/105: mkdir d0/dc/d1a/d25 0 2024-09-17T01:51:55.377 INFO:tasks.workunit.client.0.smithi031.stdout:8/102: truncate d0/d5/fa 1920702 0 2024-09-17T01:51:55.379 INFO:tasks.workunit.client.0.smithi031.stdout:0/106: write d0/dc/d5/f1c [176122,90830] 0 2024-09-17T01:51:55.380 INFO:tasks.workunit.client.0.smithi031.stdout:8/103: chown d0/d5/f11 1653648929 1 2024-09-17T01:51:55.381 INFO:tasks.workunit.client.0.smithi031.stdout:6/178: write d23/d33/f3c [3526169,41573] 0 2024-09-17T01:51:55.385 INFO:tasks.workunit.client.0.smithi031.stdout:8/104: write d0/f6 [4557634,80065] 0 2024-09-17T01:51:55.385 INFO:tasks.workunit.client.0.smithi031.stdout:2/129: dwrite d1/d3/df/d11/f17 [0,4194304] 0 2024-09-17T01:51:55.386 INFO:tasks.workunit.client.0.smithi031.stdout:5/131: chown da/dc/l21 365 1 2024-09-17T01:51:55.390 INFO:tasks.workunit.client.0.smithi031.stdout:6/179: write d23/d33/f3c [435473,48638] 0 2024-09-17T01:51:55.390 INFO:tasks.workunit.client.0.smithi031.stdout:2/130: dread - d1/d3/df/d19/f1f zero size 2024-09-17T01:51:55.390 INFO:tasks.workunit.client.0.smithi031.stdout:9/124: symlink d3/d19/d1f/l28 0 2024-09-17T01:51:55.393 INFO:tasks.workunit.client.0.smithi031.stdout:8/105: truncate d0/d5/f11 608371 0 2024-09-17T01:51:55.394 INFO:tasks.workunit.client.0.smithi031.stdout:7/73: link db/lc db/l17 0 2024-09-17T01:51:55.394 INFO:tasks.workunit.client.0.smithi031.stdout:5/132: mknod da/dc/d10/d12/c2d 0 2024-09-17T01:51:55.395 INFO:tasks.workunit.client.0.smithi031.stdout:8/106: fdatasync d0/f9 0 2024-09-17T01:51:55.397 INFO:tasks.workunit.client.0.smithi031.stdout:0/107: write d0/dc/d1a/f1e [1447775,36915] 0 2024-09-17T01:51:55.399 INFO:tasks.workunit.client.0.smithi031.stdout:9/125: chown d3/f8 2061166 1 2024-09-17T01:51:55.400 INFO:tasks.workunit.client.0.smithi031.stdout:2/131: symlink d1/d3/df/d19/d1e/d21/l2c 0 2024-09-17T01:51:55.403 INFO:tasks.workunit.client.0.smithi031.stdout:7/74: dread db/f10 [0,4194304] 0 2024-09-17T01:51:55.404 INFO:tasks.workunit.client.0.smithi031.stdout:6/180: dread f6 [4194304,4194304] 0 2024-09-17T01:51:55.405 INFO:tasks.workunit.client.0.smithi031.stdout:3/48: dwrite f9 [0,4194304] 0 2024-09-17T01:51:55.407 INFO:tasks.workunit.client.0.smithi031.stdout:9/126: chown d3/f25 33 1 2024-09-17T01:51:55.408 INFO:tasks.workunit.client.0.smithi031.stdout:8/107: creat d0/df/d19/f1b x:0 0 0 2024-09-17T01:51:55.408 INFO:tasks.workunit.client.0.smithi031.stdout:7/75: dread db/f10 [0,4194304] 0 2024-09-17T01:51:55.410 INFO:tasks.workunit.client.0.smithi031.stdout:1/141: getdents d4/d1a/d2d 0 2024-09-17T01:51:55.410 INFO:tasks.workunit.client.0.smithi031.stdout:8/108: chown d0/df/d19/c14 29263 1 2024-09-17T01:51:55.412 INFO:tasks.workunit.client.0.smithi031.stdout:3/49: mkdir db/df 0 2024-09-17T01:51:55.413 INFO:tasks.workunit.client.0.smithi031.stdout:3/50: fdatasync db/fe 0 2024-09-17T01:51:55.416 INFO:tasks.workunit.client.0.smithi031.stdout:2/132: mkdir d1/d3/d2d 0 2024-09-17T01:51:55.419 INFO:tasks.workunit.client.0.smithi031.stdout:6/181: fdatasync f1d 0 2024-09-17T01:51:55.419 INFO:tasks.workunit.client.0.smithi031.stdout:0/108: dwrite d0/dc/d1a/f23 [0,4194304] 0 2024-09-17T01:51:55.423 INFO:tasks.workunit.client.0.smithi031.stdout:7/76: write db/f10 [608424,98680] 0 2024-09-17T01:51:55.423 INFO:tasks.workunit.client.0.smithi031.stdout:1/142: write f3 [1895539,101152] 0 2024-09-17T01:51:55.425 INFO:tasks.workunit.client.0.smithi031.stdout:9/127: chown d3/d10/l26 23019 1 2024-09-17T01:51:55.425 INFO:tasks.workunit.client.0.smithi031.stdout:5/133: truncate da/d14/f1d 3958944 0 2024-09-17T01:51:55.429 INFO:tasks.workunit.client.0.smithi031.stdout:3/51: dwrite f7 [0,4194304] 0 2024-09-17T01:51:55.429 INFO:tasks.workunit.client.0.smithi031.stdout:6/182: stat c21 0 2024-09-17T01:51:55.432 INFO:tasks.workunit.client.0.smithi031.stdout:6/183: write d23/f30 [1996733,106997] 0 2024-09-17T01:51:55.432 INFO:tasks.workunit.client.0.smithi031.stdout:2/133: dread d1/d3/fb [0,4194304] 0 2024-09-17T01:51:55.435 INFO:tasks.workunit.client.0.smithi031.stdout:1/143: write d4/d1a/d2d/f22 [2233961,98802] 0 2024-09-17T01:51:55.435 INFO:tasks.workunit.client.0.smithi031.stdout:5/134: mkdir da/dc/d2e 0 2024-09-17T01:51:55.438 INFO:tasks.workunit.client.0.smithi031.stdout:7/77: dread db/f14 [0,4194304] 0 2024-09-17T01:51:55.439 INFO:tasks.workunit.client.0.smithi031.stdout:0/109: link d0/dc/d1a/f23 d0/dc/d1a/d25/f26 0 2024-09-17T01:51:55.443 INFO:tasks.workunit.client.0.smithi031.stdout:8/109: getdents d0/df 0 2024-09-17T01:51:55.444 INFO:tasks.workunit.client.0.smithi031.stdout:8/110: fdatasync d0/df/dd/f16 0 2024-09-17T01:51:55.445 INFO:tasks.workunit.client.0.smithi031.stdout:2/134: dread d1/d3/f7 [0,4194304] 0 2024-09-17T01:51:55.448 INFO:tasks.workunit.client.0.smithi031.stdout:8/111: dread d0/f9 [0,4194304] 0 2024-09-17T01:51:55.448 INFO:tasks.workunit.client.0.smithi031.stdout:1/144: rename l1 to d4/l32 0 2024-09-17T01:51:55.451 INFO:tasks.workunit.client.0.smithi031.stdout:8/112: dread d0/d5/f11 [0,4194304] 0 2024-09-17T01:51:55.452 INFO:tasks.workunit.client.0.smithi031.stdout:9/128: write d3/d10/f1a [2822969,82742] 0 2024-09-17T01:51:55.455 INFO:tasks.workunit.client.0.smithi031.stdout:2/135: truncate d1/f12 883549 0 2024-09-17T01:51:55.455 INFO:tasks.workunit.client.0.smithi031.stdout:3/52: rmdir db/dd 0 2024-09-17T01:51:55.456 INFO:tasks.workunit.client.0.smithi031.stdout:2/136: fsync d1/d3/f4 0 2024-09-17T01:51:55.458 INFO:tasks.workunit.client.0.smithi031.stdout:1/145: creat d4/d1a/f33 x:0 0 0 2024-09-17T01:51:55.458 INFO:tasks.workunit.client.0.smithi031.stdout:1/146: chown d4/d1a/l28 26 1 2024-09-17T01:51:55.459 INFO:tasks.workunit.client.0.smithi031.stdout:7/78: unlink db/lc 0 2024-09-17T01:51:55.460 INFO:tasks.workunit.client.0.smithi031.stdout:7/79: chown db/ld 3 1 2024-09-17T01:51:55.461 INFO:tasks.workunit.client.0.smithi031.stdout:7/80: write db/f16 [567901,70541] 0 2024-09-17T01:51:55.461 INFO:tasks.workunit.client.0.smithi031.stdout:9/129: chown d3/d10/f24 29 1 2024-09-17T01:51:55.462 INFO:tasks.workunit.client.0.smithi031.stdout:7/81: chown db/l13 9 1 2024-09-17T01:51:55.463 INFO:tasks.workunit.client.0.smithi031.stdout:0/110: creat d0/dc/d1a/d25/f27 x:0 0 0 2024-09-17T01:51:55.470 INFO:tasks.workunit.client.0.smithi031.stdout:2/137: rename d1/d3/df/d19/d1e/d21/l2c to d1/d3/df/d19/d1e/d2a/l2e 0 2024-09-17T01:51:55.471 INFO:tasks.workunit.client.0.smithi031.stdout:1/147: creat d4/d1a/f34 x:0 0 0 2024-09-17T01:51:55.473 INFO:tasks.workunit.client.0.smithi031.stdout:6/184: getdents d23 0 2024-09-17T01:51:55.474 INFO:tasks.workunit.client.0.smithi031.stdout:1/148: truncate d4/d1a/d2d/d18/f2e 76691 0 2024-09-17T01:51:55.475 INFO:tasks.workunit.client.0.smithi031.stdout:9/130: mkdir d3/d4/d29 0 2024-09-17T01:51:55.478 INFO:tasks.workunit.client.0.smithi031.stdout:3/53: getdents db/df 0 2024-09-17T01:51:55.479 INFO:tasks.workunit.client.0.smithi031.stdout:5/135: getdents da/dc 0 2024-09-17T01:51:55.480 INFO:tasks.workunit.client.0.smithi031.stdout:1/149: dread d4/d1a/f25 [0,4194304] 0 2024-09-17T01:51:55.482 INFO:tasks.workunit.client.0.smithi031.stdout:2/138: write d1/d3/f25 [199008,24984] 0 2024-09-17T01:51:55.483 INFO:tasks.workunit.client.0.smithi031.stdout:6/185: rmdir d23/d33 39 2024-09-17T01:51:55.489 INFO:tasks.workunit.client.0.smithi031.stdout:7/82: dwrite db/f14 [0,4194304] 0 2024-09-17T01:51:55.490 INFO:tasks.workunit.client.0.smithi031.stdout:7/83: chown ca 64450 1 2024-09-17T01:51:55.491 INFO:tasks.workunit.client.0.smithi031.stdout:8/113: link d0/l15 d0/df/l1c 0 2024-09-17T01:51:55.492 INFO:tasks.workunit.client.0.smithi031.stdout:8/114: chown d0/df/dd 17204601 1 2024-09-17T01:51:55.494 INFO:tasks.workunit.client.0.smithi031.stdout:1/150: symlink d4/l35 0 2024-09-17T01:51:55.495 INFO:tasks.workunit.client.0.smithi031.stdout:0/111: truncate d0/dc/d5/f15 1182197 0 2024-09-17T01:51:55.496 INFO:tasks.workunit.client.0.smithi031.stdout:1/151: truncate d4/d1a/f34 1010525 0 2024-09-17T01:51:55.497 INFO:tasks.workunit.client.0.smithi031.stdout:2/139: creat d1/d3/df/d11/f2f x:0 0 0 2024-09-17T01:51:55.498 INFO:tasks.workunit.client.0.smithi031.stdout:6/186: chown d23/f2e 5 1 2024-09-17T01:51:55.501 INFO:tasks.workunit.client.0.smithi031.stdout:3/54: creat db/df/f10 x:0 0 0 2024-09-17T01:51:55.503 INFO:tasks.workunit.client.0.smithi031.stdout:3/55: dread - db/df/f10 zero size 2024-09-17T01:51:55.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.506+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d3002cef0 con 0x7f0d1c06d600 2024-09-17T01:51:55.505 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:55 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:55.505 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:55 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:51:55.505 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:55 smithi031 ceph-mon[27673]: mgrmap e24: smithi092.tjdpfw(active, since 9s), standbys: smithi031.ealpiz 2024-09-17T01:51:55.505 INFO:tasks.workunit.client.0.smithi031.stdout:8/115: unlink d0/df/d19/c1a 0 2024-09-17T01:51:55.506 INFO:tasks.workunit.client.0.smithi031.stdout:0/112: dwrite d0/dc/d5/f1c [0,4194304] 0 2024-09-17T01:51:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.508+0000 7f0d26ffd700 1 -- 172.21.15.31:0/1395023312 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0d3002cef0 con 0x7f0d1c06d600 2024-09-17T01:51:55.508 INFO:tasks.workunit.client.0.smithi031.stdout:9/131: truncate d3/d10/f1a 2271240 0 2024-09-17T01:51:55.510 INFO:tasks.workunit.client.0.smithi031.stdout:5/136: link da/dc/d10/d12/c2d da/dc/d10/d12/c2f 0 2024-09-17T01:51:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f0d1c06d600 msgr2=0x7f0d1c06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f0d1c06d600 0x7f0d1c06fab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0d30068fa0 tx=0x7f0d2c0073d0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 msgr2=0x7f0d3019b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 0x7f0d3019b080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000bd70 tx=0x7f0d2000bda0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 shutdown_connections 2024-09-17T01:51:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f0d1c06d600 0x7f0d1c06fab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d30103310 0x7f0d30195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 --2- 172.21.15.31:0/1395023312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30196010 0x7f0d3019b080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 >> 172.21.15.31:0/1395023312 conn(0x7f0d300fa780 msgr2=0x7f0d300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 shutdown_connections 2024-09-17T01:51:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.513+0000 7f0d37c46700 1 -- 172.21.15.31:0/1395023312 wait complete. 2024-09-17T01:51:55.513 INFO:tasks.workunit.client.0.smithi031.stdout:7/84: dread db/f10 [0,4194304] 0 2024-09-17T01:51:55.517 INFO:tasks.workunit.client.0.smithi031.stdout:2/140: getdents d1/d3/d2d 0 2024-09-17T01:51:55.521 INFO:tasks.workunit.client.0.smithi031.stdout:0/113: dwrite d0/dc/f11 [0,4194304] 0 2024-09-17T01:51:55.521 INFO:tasks.workunit.client.0.smithi031.stdout:9/132: dread d3/d19/d1f/f23 [0,4194304] 0 2024-09-17T01:51:55.521 INFO:tasks.workunit.client.0.smithi031.stdout:2/141: dread d1/d3/f6 [0,4194304] 0 2024-09-17T01:51:55.522 INFO:tasks.workunit.client.0.smithi031.stdout:0/114: fdatasync d0/dc/f13 0 2024-09-17T01:51:55.523 INFO:tasks.workunit.client.0.smithi031.stdout:5/137: rename c0 to da/d14/c30 0 2024-09-17T01:51:55.525 INFO:tasks.workunit.client.0.smithi031.stdout:2/142: dread d1/f14 [0,4194304] 0 2024-09-17T01:51:55.526 INFO:tasks.workunit.client.0.smithi031.stdout:2/143: read - d1/f23 zero size 2024-09-17T01:51:55.528 INFO:tasks.workunit.client.0.smithi031.stdout:2/144: dread d1/d3/f6 [0,4194304] 0 2024-09-17T01:51:55.528 INFO:tasks.workunit.client.0.smithi031.stdout:7/85: write db/f15 [2342619,111363] 0 2024-09-17T01:51:55.530 INFO:tasks.workunit.client.0.smithi031.stdout:3/56: truncate f2 4391597 0 2024-09-17T01:51:55.531 INFO:tasks.workunit.client.0.smithi031.stdout:9/133: truncate d3/f1d 3613592 0 2024-09-17T01:51:55.531 INFO:tasks.workunit.client.0.smithi031.stdout:8/116: write d0/d5/fa [1090897,127056] 0 2024-09-17T01:51:55.532 INFO:tasks.workunit.client.0.smithi031.stdout:5/138: symlink da/dc/d10/l31 0 2024-09-17T01:51:55.532 INFO:tasks.workunit.client.0.smithi031.stdout:6/187: link c21 d23/c3e 0 2024-09-17T01:51:55.533 INFO:tasks.workunit.client.0.smithi031.stdout:5/139: write da/dc/f27 [2352340,49120] 0 2024-09-17T01:51:55.535 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:51:55.546 INFO:tasks.workunit.client.0.smithi031.stdout:8/117: symlink d0/d5/l1d 0 2024-09-17T01:51:55.549 INFO:tasks.workunit.client.0.smithi031.stdout:7/86: mkdir db/d18 0 2024-09-17T01:51:55.550 INFO:tasks.workunit.client.0.smithi031.stdout:8/118: dread d0/f9 [0,4194304] 0 2024-09-17T01:51:55.554 INFO:tasks.workunit.client.0.smithi031.stdout:0/115: creat d0/dc/f28 x:0 0 0 2024-09-17T01:51:55.556 INFO:tasks.workunit.client.0.smithi031.stdout:5/140: symlink da/dc/d25/l32 0 2024-09-17T01:51:55.560 INFO:tasks.workunit.client.0.smithi031.stdout:8/119: chown d0/d5/c10 1652807306 1 2024-09-17T01:51:55.562 INFO:tasks.workunit.client.0.smithi031.stdout:3/57: write f2 [4640128,41499] 0 2024-09-17T01:51:55.562 INFO:tasks.workunit.client.0.smithi031.stdout:0/116: dread d0/dc/f11 [0,4194304] 0 2024-09-17T01:51:55.562 INFO:tasks.workunit.client.0.smithi031.stdout:9/134: creat d3/f2a x:0 0 0 2024-09-17T01:51:55.563 INFO:tasks.workunit.client.0.smithi031.stdout:8/120: dread - d0/df/d19/f1b zero size 2024-09-17T01:51:55.564 INFO:tasks.workunit.client.0.smithi031.stdout:6/188: dwrite d23/f3b [4194304,4194304] 0 2024-09-17T01:51:55.565 INFO:tasks.workunit.client.0.smithi031.stdout:3/58: chown db/df/f10 0 1 2024-09-17T01:51:55.565 INFO:tasks.workunit.client.0.smithi031.stdout:5/141: symlink da/d14/l33 0 2024-09-17T01:51:55.567 INFO:tasks.workunit.client.0.smithi031.stdout:2/145: write d1/d3/df/d11/f26 [1061157,311] 0 2024-09-17T01:51:55.567 INFO:tasks.workunit.client.0.smithi031.stdout:7/87: mknod db/d18/c19 0 2024-09-17T01:51:55.567 INFO:tasks.workunit.client.0.smithi031.stdout:5/142: fdatasync da/dc/d10/d12/f19 0 2024-09-17T01:51:55.571 INFO:tasks.workunit.client.0.smithi031.stdout:0/117: mkdir d0/d29 0 2024-09-17T01:51:55.575 INFO:tasks.workunit.client.0.smithi031.stdout:8/121: dwrite d0/df/d19/f1b [0,4194304] 0 2024-09-17T01:51:55.576 INFO:tasks.workunit.client.0.smithi031.stdout:3/59: rename f5 to db/f11 0 2024-09-17T01:51:55.577 INFO:tasks.workunit.client.0.smithi031.stdout:7/88: read db/f14 [358374,67784] 0 2024-09-17T01:51:55.579 INFO:tasks.workunit.client.0.smithi031.stdout:5/143: creat da/dc/d10/d26/f34 x:0 0 0 2024-09-17T01:51:55.582 INFO:tasks.workunit.client.0.smithi031.stdout:9/135: link d3/f25 d3/d4/d29/f2b 0 2024-09-17T01:51:55.585 INFO:tasks.workunit.client.0.smithi031.stdout:8/122: creat d0/df/d19/f1e x:0 0 0 2024-09-17T01:51:55.585 INFO:tasks.workunit.client.0.smithi031.stdout:8/123: readlink d0/df/l1c 0 2024-09-17T01:51:55.590 INFO:tasks.workunit.client.0.smithi031.stdout:5/144: creat da/d14/f35 x:0 0 0 2024-09-17T01:51:55.591 INFO:tasks.workunit.client.0.smithi031.stdout:9/136: stat d3/lf 0 2024-09-17T01:51:55.594 INFO:tasks.workunit.client.0.smithi031.stdout:7/89: dwrite db/fe [0,4194304] 0 2024-09-17T01:51:55.594 INFO:tasks.workunit.client.0.smithi031.stdout:8/124: symlink d0/df/d19/l1f 0 2024-09-17T01:51:55.599 INFO:tasks.workunit.client.0.smithi031.stdout:5/145: dread da/dc/d10/d12/f19 [0,4194304] 0 2024-09-17T01:51:55.601 INFO:tasks.workunit.client.0.smithi031.stdout:9/137: mknod d3/d4/c2c 0 2024-09-17T01:51:55.602 INFO:tasks.workunit.client.0.smithi031.stdout:6/189: link d23/l3a d23/l3f 0 2024-09-17T01:51:55.603 INFO:tasks.workunit.client.0.smithi031.stdout:9/138: dread - d3/d4/d29/f2b zero size 2024-09-17T01:51:55.604 INFO:tasks.workunit.client.0.smithi031.stdout:8/125: rename d0/d5/l1d to d0/df/d19/l20 0 2024-09-17T01:51:55.605 INFO:tasks.workunit.client.0.smithi031.stdout:2/146: dwrite d1/f23 [0,4194304] 0 2024-09-17T01:51:55.606 INFO:tasks.workunit.client.0.smithi031.stdout:5/146: mknod da/dc/c36 0 2024-09-17T01:51:55.606 INFO:tasks.workunit.client.0.smithi031.stdout:6/190: rename d23 to d23/d33/d40 22 2024-09-17T01:51:55.613 INFO:tasks.workunit.client.0.smithi031.stdout:8/126: symlink d0/df/d19/l21 0 2024-09-17T01:51:55.613 INFO:tasks.workunit.client.0.smithi031.stdout:2/147: dread - d1/d3/df/d19/f28 zero size 2024-09-17T01:51:55.616 INFO:tasks.workunit.client.0.smithi031.stdout:7/90: creat db/f1a x:0 0 0 2024-09-17T01:51:55.617 INFO:tasks.workunit.client.0.smithi031.stdout:6/191: chown d23/c2c 20380 1 2024-09-17T01:51:55.619 INFO:tasks.workunit.client.0.smithi031.stdout:9/139: rename d3/d19/d1f/l28 to d3/d4/d29/l2d 0 2024-09-17T01:51:55.619 INFO:tasks.workunit.client.0.smithi031.stdout:2/148: write d1/d3/df/d11/f2f [827313,114295] 0 2024-09-17T01:51:55.620 INFO:tasks.workunit.client.0.smithi031.stdout:6/192: dread - d23/d33/f34 zero size 2024-09-17T01:51:55.620 INFO:tasks.workunit.client.0.smithi031.stdout:5/147: dwrite da/dc/d10/d26/f34 [0,4194304] 0 2024-09-17T01:51:55.621 INFO:tasks.workunit.client.0.smithi031.stdout:8/127: mkdir d0/df/d22 0 2024-09-17T01:51:55.628 INFO:tasks.workunit.client.0.smithi031.stdout:7/91: readlink db/l13 0 2024-09-17T01:51:55.629 INFO:tasks.workunit.client.0.smithi031.stdout:6/193: stat d23/l2a 0 2024-09-17T01:51:55.632 INFO:tasks.workunit.client.0.smithi031.stdout:5/148: creat da/dc/d10/f37 x:0 0 0 2024-09-17T01:51:55.632 INFO:tasks.workunit.client.0.smithi031.stdout:7/92: chown db/f15 3 1 2024-09-17T01:51:55.635 INFO:tasks.workunit.client.0.smithi031.stdout:5/149: readlink da/dc/d25/l32 0 2024-09-17T01:51:55.637 INFO:tasks.workunit.client.0.smithi031.stdout:8/128: dwrite d0/df/d19/f1e [0,4194304] 0 2024-09-17T01:51:55.638 INFO:tasks.workunit.client.0.smithi031.stdout:2/149: dread d1/d3/fb [0,4194304] 0 2024-09-17T01:51:55.639 INFO:tasks.workunit.client.0.smithi031.stdout:9/140: dwrite d3/f2a [0,4194304] 0 2024-09-17T01:51:55.647 INFO:tasks.workunit.client.0.smithi031.stdout:2/150: chown d1/d3/df/d19/d1e 142 1 2024-09-17T01:51:55.649 INFO:tasks.workunit.client.0.smithi031.stdout:6/194: dwrite f1c [4194304,4194304] 0 2024-09-17T01:51:55.649 INFO:tasks.workunit.client.0.smithi031.stdout:9/141: rmdir d3/d19 39 2024-09-17T01:51:55.651 INFO:tasks.workunit.client.0.smithi031.stdout:7/93: dread db/f15 [0,4194304] 0 2024-09-17T01:51:55.651 INFO:tasks.workunit.client.0.smithi031.stdout:8/129: mknod d0/df/c23 0 2024-09-17T01:51:55.654 INFO:tasks.workunit.client.0.smithi031.stdout:5/150: symlink da/dc/l38 0 2024-09-17T01:51:55.657 INFO:tasks.workunit.client.0.smithi031.stdout:8/130: truncate d0/d5/fa 2165345 0 2024-09-17T01:51:55.666 INFO:tasks.workunit.client.0.smithi031.stdout:6/195: dwrite d23/d33/f3c [4194304,4194304] 0 2024-09-17T01:51:55.666 INFO:tasks.workunit.client.0.smithi031.stdout:7/94: dread db/f15 [0,4194304] 0 2024-09-17T01:51:55.670 INFO:tasks.workunit.client.0.smithi031.stdout:7/95: write db/f1a [764796,19968] 0 2024-09-17T01:51:55.673 INFO:tasks.workunit.client.0.smithi031.stdout:9/142: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:51:55.676 INFO:tasks.workunit.client.0.smithi031.stdout:5/151: dread da/d14/f1d [0,4194304] 0 2024-09-17T01:51:55.678 INFO:tasks.workunit.client.0.smithi031.stdout:8/131: dwrite d0/d5/fa [0,4194304] 0 2024-09-17T01:51:55.678 INFO:tasks.workunit.client.0.smithi031.stdout:2/151: write d1/f14 [160728,15663] 0 2024-09-17T01:51:55.681 INFO:tasks.workunit.client.0.smithi031.stdout:8/132: chown d0/df/d19/f1b 1722 1 2024-09-17T01:51:55.681 INFO:tasks.workunit.client.0.smithi031.stdout:5/152: write da/dc/d10/d12/f20 [1466934,29300] 0 2024-09-17T01:51:55.682 INFO:tasks.workunit.client.0.smithi031.stdout:8/133: stat d0/f9 0 2024-09-17T01:51:55.684 INFO:tasks.workunit.client.0.smithi031.stdout:8/134: truncate d0/df/f8 4251193 0 2024-09-17T01:51:55.686 INFO:tasks.workunit.client.0.smithi031.stdout:2/152: mkdir d1/d3/df/d11/d30 0 2024-09-17T01:51:55.687 INFO:tasks.workunit.client.0.smithi031.stdout:9/143: symlink d3/d19/d1f/l2e 0 2024-09-17T01:51:55.688 INFO:tasks.workunit.client.0.smithi031.stdout:9/144: readlink d3/d19/d1f/l2e 0 2024-09-17T01:51:55.690 INFO:tasks.workunit.client.0.smithi031.stdout:6/196: rename d23/c3e to d23/c41 0 2024-09-17T01:51:55.691 INFO:tasks.workunit.client.0.smithi031.stdout:7/96: creat db/f1b x:0 0 0 2024-09-17T01:51:55.693 INFO:tasks.workunit.client.0.smithi031.stdout:2/153: mknod d1/d3/df/d11/c31 0 2024-09-17T01:51:55.695 INFO:tasks.workunit.client.0.smithi031.stdout:2/154: stat d1/d3/f6 0 2024-09-17T01:51:55.696 INFO:tasks.workunit.client.0.smithi031.stdout:7/97: write db/f16 [1495031,3037] 0 2024-09-17T01:51:55.698 INFO:tasks.workunit.client.0.smithi031.stdout:9/145: dwrite d3/d10/f24 [0,4194304] 0 2024-09-17T01:51:55.704 INFO:tasks.workunit.client.0.smithi031.stdout:7/98: mkdir db/d1c 0 2024-09-17T01:51:55.704 INFO:tasks.workunit.client.0.smithi031.stdout:2/155: dread d1/d3/df/d11/f17 [0,4194304] 0 2024-09-17T01:51:55.706 INFO:tasks.workunit.client.0.smithi031.stdout:9/146: creat d3/d4/f2f x:0 0 0 2024-09-17T01:51:55.707 INFO:tasks.workunit.client.0.smithi031.stdout:5/153: write da/d14/f1d [1009964,10005] 0 2024-09-17T01:51:55.709 INFO:tasks.workunit.client.0.smithi031.stdout:8/135: truncate d0/df/d19/f1b 3000264 0 2024-09-17T01:51:55.710 INFO:tasks.workunit.client.0.smithi031.stdout:6/197: truncate f1c 915387 0 2024-09-17T01:51:55.716 INFO:tasks.workunit.client.0.smithi031.stdout:9/147: dread d3/d19/d1f/f21 [0,4194304] 0 2024-09-17T01:51:55.717 INFO:tasks.workunit.client.0.smithi031.stdout:5/154: truncate da/dc/d10/d12/f19 4267519 0 2024-09-17T01:51:55.717 INFO:tasks.workunit.client.0.smithi031.stdout:7/99: dwrite db/fe [0,4194304] 0 2024-09-17T01:51:55.718 INFO:tasks.workunit.client.0.smithi031.stdout:6/198: creat d23/f42 x:0 0 0 2024-09-17T01:51:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.721+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3266293911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe0100cd0 msgr2=0x7f3fe01030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.721+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3266293911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe0100cd0 0x7f3fe01030b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009910 tx=0x7f3fd4009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:55.721 INFO:tasks.workunit.client.0.smithi031.stdout:8/136: rmdir d0/df/d22 0 2024-09-17T01:51:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.722+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3266293911 shutdown_connections 2024-09-17T01:51:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.722+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3266293911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe01035f0 0x7f3fe01059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.722+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3266293911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe0100cd0 0x7f3fe01030b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.722+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3266293911 >> 172.21.15.31:0/3266293911 conn(0x7f3fe00fa6d0 msgr2=0x7f3fe00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.722+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3266293911 shutdown_connections 2024-09-17T01:51:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.722+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3266293911 wait complete. 2024-09-17T01:51:55.722 INFO:tasks.workunit.client.0.smithi031.stdout:2/156: dwrite d1/d3/fb [0,4194304] 0 2024-09-17T01:51:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.724+0000 7f3fe71ed700 1 Processor -- start 2024-09-17T01:51:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.725+0000 7f3fe71ed700 1 -- start start 2024-09-17T01:51:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.725+0000 7f3fe71ed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0100cd0 0x7f3fe0197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.725+0000 7f3fe71ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 0x7f3fe0198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.725+0000 7f3fe71ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01987b0 con 0x7f3fe01035f0 2024-09-17T01:51:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fe71ed700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe019d1c0 con 0x7f3fe0100cd0 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 0x7f3fe0198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 0x7f3fe0198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39524/0 (socket says 172.21.15.31:39524) 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fdffff700 1 -- 172.21.15.31:0/3887566169 learned_addr learned my addr 172.21.15.31:0/3887566169 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fdffff700 1 -- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0100cd0 msgr2=0x7f3fe0197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fdffff700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0100cd0 0x7f3fe0197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.726+0000 7f3fdffff700 1 -- 172.21.15.31:0/3887566169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40095f0 con 0x7f3fe01035f0 2024-09-17T01:51:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.727+0000 7f3fdffff700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 0x7f3fe0198190 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00e920 tx=0x7f3fcc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.727+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fcc009790 con 0x7f3fe01035f0 2024-09-17T01:51:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.727+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe019d3c0 con 0x7f3fe01035f0 2024-09-17T01:51:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.727+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3fcc00cba0 con 0x7f3fe01035f0 2024-09-17T01:51:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.728+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe019d820 con 0x7f3fe01035f0 2024-09-17T01:51:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.728+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fcc018630 con 0x7f3fe01035f0 2024-09-17T01:51:55.729 INFO:tasks.workunit.client.0.smithi031.stdout:5/155: creat da/dc/d10/d26/f39 x:0 0 0 2024-09-17T01:51:55.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.730+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f3fcc0188a0 con 0x7f3fe01035f0 2024-09-17T01:51:55.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.731+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe00ffe70 con 0x7f3fe01035f0 2024-09-17T01:51:55.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.731+0000 7f3fddffb700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f3fd006d600 0x7f3fd006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:55.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.732+0000 7f3fe4f89700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f3fd006d600 0x7f3fd006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:55.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.732+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3fcc014070 con 0x7f3fe01035f0 2024-09-17T01:51:55.731 INFO:tasks.workunit.client.0.smithi031.stdout:2/157: symlink d1/d3/df/d11/l32 0 2024-09-17T01:51:55.732 INFO:tasks.workunit.client.0.smithi031.stdout:6/199: dwrite d23/f3b [8388608,4194304] 0 2024-09-17T01:51:55.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.734+0000 7f3fe4f89700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f3fd006d600 0x7f3fd006fab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400b6a0 tx=0x7f3fd4005fd0 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:55.735 INFO:tasks.workunit.client.0.smithi031.stdout:5/156: creat da/dc/f3a x:0 0 0 2024-09-17T01:51:55.737 INFO:tasks.workunit.client.0.smithi031.stdout:7/100: fdatasync db/fe 0 2024-09-17T01:51:55.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:55.740+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3fcc0539d0 con 0x7f3fe01035f0 2024-09-17T01:51:55.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:55 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:51:55.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:55 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:51:55.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:55 smithi092 ceph-mon[33552]: mgrmap e24: smithi092.tjdpfw(active, since 9s), standbys: smithi031.ealpiz 2024-09-17T01:51:55.739 INFO:tasks.workunit.client.0.smithi031.stdout:8/137: dread d0/d5/fa [0,4194304] 0 2024-09-17T01:51:55.739 INFO:tasks.workunit.client.0.smithi031.stdout:2/158: rename d1/d3/fb to d1/d3/df/d19/f33 0 2024-09-17T01:51:55.741 INFO:tasks.workunit.client.0.smithi031.stdout:8/138: write d0/df/d19/f1e [3099316,56359] 0 2024-09-17T01:51:55.743 INFO:tasks.workunit.client.0.smithi031.stdout:7/101: rename db/f14 to db/d1c/f1d 0 2024-09-17T01:51:55.744 INFO:tasks.workunit.client.0.smithi031.stdout:7/102: write db/fe [4930474,126993] 0 2024-09-17T01:51:55.745 INFO:tasks.workunit.client.0.smithi031.stdout:2/159: fsync d1/d3/df/d19/f1f 0 2024-09-17T01:51:55.748 INFO:tasks.workunit.client.0.smithi031.stdout:6/200: getdents d23/d33 0 2024-09-17T01:51:55.748 INFO:tasks.workunit.client.0.smithi031.stdout:8/139: symlink d0/d5/l24 0 2024-09-17T01:51:55.749 INFO:tasks.workunit.client.0.smithi031.stdout:2/160: write d1/d3/df/d11/f2f [976490,11153] 0 2024-09-17T01:51:55.755 INFO:tasks.workunit.client.0.smithi031.stdout:7/103: dwrite db/f1a [0,4194304] 0 2024-09-17T01:51:55.757 INFO:tasks.workunit.client.0.smithi031.stdout:7/104: write db/f1a [2622992,104409] 0 2024-09-17T01:51:55.758 INFO:tasks.workunit.client.0.smithi031.stdout:6/201: creat d23/f43 x:0 0 0 2024-09-17T01:51:55.758 INFO:tasks.workunit.client.0.smithi031.stdout:8/140: dread d0/df/d19/f1e [0,4194304] 0 2024-09-17T01:51:55.759 INFO:tasks.workunit.client.0.smithi031.stdout:7/105: dread - db/f1b zero size 2024-09-17T01:51:55.760 INFO:tasks.workunit.client.0.smithi031.stdout:2/161: mkdir d1/d3/df/d19/d1e/d21/d34 0 2024-09-17T01:51:55.763 INFO:tasks.workunit.client.0.smithi031.stdout:2/162: read d1/d3/df/d11/f26 [502840,32462] 0 2024-09-17T01:51:55.765 INFO:tasks.workunit.client.0.smithi031.stdout:8/141: dread d0/d5/fa [0,4194304] 0 2024-09-17T01:51:55.767 INFO:tasks.workunit.client.0.smithi031.stdout:5/157: rmdir da/dc/d10 39 2024-09-17T01:51:55.770 INFO:tasks.workunit.client.0.smithi031.stdout:8/142: dread d0/df/d19/f1e [0,4194304] 0 2024-09-17T01:51:55.775 INFO:tasks.workunit.client.0.smithi031.stdout:8/143: creat d0/df/dd/f25 x:0 0 0 2024-09-17T01:51:55.776 INFO:tasks.workunit.client.0.smithi031.stdout:8/144: write d0/f6 [2822038,73369] 0 2024-09-17T01:51:55.782 INFO:tasks.workunit.client.0.smithi031.stdout:7/106: truncate db/d1c/f1d 2200738 0 2024-09-17T01:51:55.783 INFO:tasks.workunit.client.0.smithi031.stdout:5/158: truncate f5 54034 0 2024-09-17T01:51:55.788 INFO:tasks.workunit.client.0.smithi031.stdout:7/107: symlink db/l1e 0 2024-09-17T01:51:55.796 INFO:tasks.workunit.client.0.smithi031.stdout:5/159: dwrite da/dc/d10/d12/f23 [0,4194304] 0 2024-09-17T01:51:55.799 INFO:tasks.workunit.client.0.smithi031.stdout:2/163: dwrite d1/d3/df/d19/f1d [0,4194304] 0 2024-09-17T01:51:55.806 INFO:tasks.workunit.client.0.smithi031.stdout:8/145: dwrite d0/d5/f11 [0,4194304] 0 2024-09-17T01:51:55.806 INFO:tasks.workunit.client.0.smithi031.stdout:8/146: read d0/d5/fa [1640538,30454] 0 2024-09-17T01:51:55.806 INFO:tasks.workunit.client.0.smithi031.stdout:2/164: truncate d1/d3/df/f2b 372956 0 2024-09-17T01:51:55.807 INFO:tasks.workunit.client.0.smithi031.stdout:5/160: dread da/dc/d10/d12/f23 [0,4194304] 0 2024-09-17T01:51:55.808 INFO:tasks.workunit.client.0.smithi031.stdout:8/147: read d0/d5/fa [2167954,16050] 0 2024-09-17T01:51:55.814 INFO:tasks.workunit.client.0.smithi031.stdout:2/165: truncate d1/d3/df/d11/f26 1259171 0 2024-09-17T01:51:55.815 INFO:tasks.workunit.client.0.smithi031.stdout:5/161: creat da/d14/f3b x:0 0 0 2024-09-17T01:51:55.817 INFO:tasks.workunit.client.0.smithi031.stdout:2/166: read - d1/d3/df/d19/d1e/d21/f24 zero size 2024-09-17T01:51:55.819 INFO:tasks.workunit.client.0.smithi031.stdout:8/148: getdents d0/d5 0 2024-09-17T01:51:55.821 INFO:tasks.workunit.client.0.smithi031.stdout:2/167: symlink d1/d3/df/d19/d1e/d21/l35 0 2024-09-17T01:51:55.826 INFO:tasks.workunit.client.0.smithi031.stdout:5/162: dwrite da/d14/f35 [0,4194304] 0 2024-09-17T01:51:55.826 INFO:tasks.workunit.client.0.smithi031.stdout:2/168: symlink d1/d3/df/l36 0 2024-09-17T01:51:55.828 INFO:tasks.workunit.client.0.smithi031.stdout:5/163: fdatasync da/dc/d10/d12/f19 0 2024-09-17T01:51:55.829 INFO:tasks.workunit.client.0.smithi031.stdout:8/149: dwrite d0/d5/f11 [0,4194304] 0 2024-09-17T01:51:55.830 INFO:tasks.workunit.client.0.smithi031.stdout:2/169: rmdir d1/d3/df/d19/d1e/d2a 39 2024-09-17T01:51:55.831 INFO:tasks.workunit.client.0.smithi031.stdout:5/164: chown da/dc/c13 38100 1 2024-09-17T01:51:55.832 INFO:tasks.workunit.client.0.smithi031.stdout:2/170: chown d1/d3/f25 152177 1 2024-09-17T01:51:55.832 INFO:tasks.workunit.client.0.smithi031.stdout:8/150: write d0/df/dd/f25 [66526,116322] 0 2024-09-17T01:51:55.837 INFO:tasks.workunit.client.0.smithi031.stdout:8/151: symlink d0/l26 0 2024-09-17T01:51:55.840 INFO:tasks.workunit.client.0.smithi031.stdout:5/165: rename da/d14/f35 to da/d14/f3c 0 2024-09-17T01:51:55.841 INFO:tasks.workunit.client.0.smithi031.stdout:5/166: readlink da/dc/l1f 0 2024-09-17T01:51:55.843 INFO:tasks.workunit.client.0.smithi031.stdout:2/171: rename d1/d3/df/d11/f17 to d1/d3/df/d11/d30/f37 0 2024-09-17T01:51:55.846 INFO:tasks.workunit.client.0.smithi031.stdout:5/167: mknod da/d14/c3d 0 2024-09-17T01:51:55.847 INFO:tasks.workunit.client.0.smithi031.stdout:4/82: sync 2024-09-17T01:51:55.848 INFO:tasks.workunit.client.0.smithi031.stdout:2/172: creat d1/d3/d2d/f38 x:0 0 0 2024-09-17T01:51:55.849 INFO:tasks.workunit.client.0.smithi031.stdout:4/83: fdatasync d8/f14 0 2024-09-17T01:51:55.851 INFO:tasks.workunit.client.0.smithi031.stdout:2/173: dread - d1/d3/df/d19/f28 zero size 2024-09-17T01:51:55.852 INFO:tasks.workunit.client.0.smithi031.stdout:8/152: dwrite d0/df/d19/f1e [0,4194304] 0 2024-09-17T01:51:55.853 INFO:tasks.workunit.client.0.smithi031.stdout:2/174: dread d1/f5 [0,4194304] 0 2024-09-17T01:51:55.853 INFO:tasks.workunit.client.0.smithi031.stdout:5/168: dread f4 [0,4194304] 0 2024-09-17T01:51:55.855 INFO:tasks.workunit.client.0.smithi031.stdout:4/84: mknod d8/d18/c19 0 2024-09-17T01:51:55.855 INFO:tasks.workunit.client.0.smithi031.stdout:8/153: write d0/df/dd/f25 [492734,14433] 0 2024-09-17T01:51:55.861 INFO:tasks.workunit.client.0.smithi031.stdout:2/175: truncate d1/d3/df/d19/d1e/d21/f24 830127 0 2024-09-17T01:51:55.861 INFO:tasks.workunit.client.0.smithi031.stdout:8/154: read d0/df/dd/f16 [31756,129138] 0 2024-09-17T01:51:55.862 INFO:tasks.workunit.client.0.smithi031.stdout:5/169: write f4 [151669,126643] 0 2024-09-17T01:51:55.865 INFO:tasks.workunit.client.0.smithi031.stdout:5/170: read - da/dc/f3a zero size 2024-09-17T01:51:55.866 INFO:tasks.workunit.client.0.smithi031.stdout:4/85: dwrite d8/f16 [0,4194304] 0 2024-09-17T01:51:55.868 INFO:tasks.workunit.client.0.smithi031.stdout:4/86: write d8/f11 [95423,130141] 0 2024-09-17T01:51:55.870 INFO:tasks.workunit.client.0.smithi031.stdout:5/171: fdatasync da/dc/d10/d12/f23 0 2024-09-17T01:51:55.870 INFO:tasks.workunit.client.0.smithi031.stdout:5/172: fsync da/dc/d10/d12/f20 0 2024-09-17T01:51:55.872 INFO:tasks.workunit.client.0.smithi031.stdout:2/176: creat d1/d3/df/d19/d1e/f39 x:0 0 0 2024-09-17T01:51:55.874 INFO:tasks.workunit.client.0.smithi031.stdout:8/155: truncate d0/f6 7422233 0 2024-09-17T01:51:55.876 INFO:tasks.workunit.client.0.smithi031.stdout:2/177: symlink d1/d3/df/d11/d30/l3a 0 2024-09-17T01:51:55.878 INFO:tasks.workunit.client.0.smithi031.stdout:8/156: dread d0/df/dd/f25 [0,4194304] 0 2024-09-17T01:51:55.879 INFO:tasks.workunit.client.0.smithi031.stdout:8/157: read d0/df/d19/f1e [2286594,120207] 0 2024-09-17T01:51:55.879 INFO:tasks.workunit.client.0.smithi031.stdout:2/178: creat d1/d3/df/d18/f3b x:0 0 0 2024-09-17T01:51:55.880 INFO:tasks.workunit.client.0.smithi031.stdout:5/173: creat da/dc/f3e x:0 0 0 2024-09-17T01:51:55.881 INFO:tasks.workunit.client.0.smithi031.stdout:4/87: getdents d8/d18 0 2024-09-17T01:51:55.882 INFO:tasks.workunit.client.0.smithi031.stdout:5/174: chown da/dc/d10/d12/f19 3189147 1 2024-09-17T01:51:55.883 INFO:tasks.workunit.client.0.smithi031.stdout:8/158: creat d0/df/d19/f27 x:0 0 0 2024-09-17T01:51:55.883 INFO:tasks.workunit.client.0.smithi031.stdout:2/179: creat d1/d3/d2d/f3c x:0 0 0 2024-09-17T01:51:55.883 INFO:tasks.workunit.client.0.smithi031.stdout:4/88: write d8/fc [2818360,40394] 0 2024-09-17T01:51:55.890 INFO:tasks.workunit.client.0.smithi031.stdout:2/180: symlink d1/d3/df/d19/d1e/d21/l3d 0 2024-09-17T01:51:55.891 INFO:tasks.workunit.client.0.smithi031.stdout:5/175: dread da/f11 [0,4194304] 0 2024-09-17T01:51:55.894 INFO:tasks.workunit.client.0.smithi031.stdout:4/89: dwrite d8/fd [0,4194304] 0 2024-09-17T01:51:55.894 INFO:tasks.workunit.client.0.smithi031.stdout:4/90: fsync f7 0 2024-09-17T01:51:55.896 INFO:tasks.workunit.client.0.smithi031.stdout:4/91: dread - d8/f14 zero size 2024-09-17T01:51:55.897 INFO:tasks.workunit.client.0.smithi031.stdout:8/159: getdents d0/df/d19 0 2024-09-17T01:51:55.901 INFO:tasks.workunit.client.0.smithi031.stdout:4/92: dread d8/fd [0,4194304] 0 2024-09-17T01:51:55.902 INFO:tasks.workunit.client.0.smithi031.stdout:8/160: write d0/df/dd/f25 [1028989,34263] 0 2024-09-17T01:51:55.902 INFO:tasks.workunit.client.0.smithi031.stdout:4/93: stat d8/ff 0 2024-09-17T01:51:55.903 INFO:tasks.workunit.client.0.smithi031.stdout:4/94: readlink d8/l13 0 2024-09-17T01:51:55.909 INFO:tasks.workunit.client.0.smithi031.stdout:2/181: rename d1/d3/f1b to d1/d3/df/d19/d1e/f3e 0 2024-09-17T01:51:55.909 INFO:tasks.workunit.client.0.smithi031.stdout:4/95: mknod d8/d18/c1a 0 2024-09-17T01:51:55.910 INFO:tasks.workunit.client.0.smithi031.stdout:2/182: chown d1/d3/f4 5453520 1 2024-09-17T01:51:55.913 INFO:tasks.workunit.client.0.smithi031.stdout:8/161: rename d0/df/dd/f25 to d0/f28 0 2024-09-17T01:51:55.914 INFO:tasks.workunit.client.0.smithi031.stdout:8/162: dread d0/df/dd/f16 [0,4194304] 0 2024-09-17T01:51:55.917 INFO:tasks.workunit.client.0.smithi031.stdout:4/96: link c4 d8/c1b 0 2024-09-17T01:51:55.920 INFO:tasks.workunit.client.0.smithi031.stdout:4/97: mknod d8/c1c 0 2024-09-17T01:51:55.922 INFO:tasks.workunit.client.0.smithi031.stdout:2/183: getdents d1/d3/d2d 0 2024-09-17T01:51:55.923 INFO:tasks.workunit.client.0.smithi031.stdout:8/163: getdents d0/df/dd 0 2024-09-17T01:51:55.924 INFO:tasks.workunit.client.0.smithi031.stdout:4/98: dread d8/ff [0,4194304] 0 2024-09-17T01:51:55.926 INFO:tasks.workunit.client.0.smithi031.stdout:2/184: symlink d1/d3/df/d19/l3f 0 2024-09-17T01:51:55.929 INFO:tasks.workunit.client.0.smithi031.stdout:4/99: rename d8/f9 to d8/f1d 0 2024-09-17T01:51:55.930 INFO:tasks.workunit.client.0.smithi031.stdout:8/164: getdents d0/df/dd 0 2024-09-17T01:51:55.931 INFO:tasks.workunit.client.0.smithi031.stdout:2/185: dread d1/f23 [0,4194304] 0 2024-09-17T01:51:55.932 INFO:tasks.workunit.client.0.smithi031.stdout:2/186: chown d1/d3/df/d11/f15 1938446 1 2024-09-17T01:51:55.932 INFO:tasks.workunit.client.0.smithi031.stdout:8/165: creat d0/df/d19/f29 x:0 0 0 2024-09-17T01:51:55.933 INFO:tasks.workunit.client.0.smithi031.stdout:2/187: dread - d1/d3/d2d/f3c zero size 2024-09-17T01:51:55.934 INFO:tasks.workunit.client.0.smithi031.stdout:4/100: dread d8/f1d [0,4194304] 0 2024-09-17T01:51:55.935 INFO:tasks.workunit.client.0.smithi031.stdout:8/166: mknod d0/df/d19/c2a 0 2024-09-17T01:51:55.944 INFO:tasks.workunit.client.0.smithi031.stdout:8/167: write d0/f6 [5465772,9494] 0 2024-09-17T01:51:55.944 INFO:tasks.workunit.client.0.smithi031.stdout:4/101: dwrite d8/f11 [0,4194304] 0 2024-09-17T01:51:55.946 INFO:tasks.workunit.client.0.smithi031.stdout:2/188: dwrite d1/f23 [0,4194304] 0 2024-09-17T01:51:55.948 INFO:tasks.workunit.client.0.smithi031.stdout:8/168: truncate d0/d5/fa 4737260 0 2024-09-17T01:51:55.951 INFO:tasks.workunit.client.0.smithi031.stdout:8/169: fsync d0/df/d19/f27 0 2024-09-17T01:51:55.951 INFO:tasks.workunit.client.0.smithi031.stdout:8/170: chown d0/df/dd 107759 1 2024-09-17T01:51:55.951 INFO:tasks.workunit.client.0.smithi031.stdout:4/102: unlink d8/f1d 0 2024-09-17T01:51:55.952 INFO:tasks.workunit.client.0.smithi031.stdout:2/189: mkdir d1/d3/df/d18/d40 0 2024-09-17T01:51:55.953 INFO:tasks.workunit.client.0.smithi031.stdout:8/171: write d0/df/dd/f16 [93580,46463] 0 2024-09-17T01:51:55.956 INFO:tasks.workunit.client.0.smithi031.stdout:4/103: rename c2 to d8/d18/c1e 0 2024-09-17T01:51:55.956 INFO:tasks.workunit.client.0.smithi031.stdout:2/190: creat d1/d3/d2d/f41 x:0 0 0 2024-09-17T01:51:55.958 INFO:tasks.workunit.client.0.smithi031.stdout:8/172: creat d0/df/f2b x:0 0 0 2024-09-17T01:51:55.959 INFO:tasks.workunit.client.0.smithi031.stdout:2/191: mkdir d1/d3/d2d/d42 0 2024-09-17T01:51:55.962 INFO:tasks.workunit.client.0.smithi031.stdout:2/192: write d1/d3/d2d/f38 [223545,62659] 0 2024-09-17T01:51:55.964 INFO:tasks.workunit.client.0.smithi031.stdout:8/173: getdents d0 0 2024-09-17T01:51:55.965 INFO:tasks.workunit.client.0.smithi031.stdout:4/104: dwrite d8/fd [0,4194304] 0 2024-09-17T01:51:55.967 INFO:tasks.workunit.client.0.smithi031.stdout:4/105: chown d8/d18/c19 2 1 2024-09-17T01:51:55.967 INFO:tasks.workunit.client.0.smithi031.stdout:2/193: mkdir d1/d3/df/d18/d40/d43 0 2024-09-17T01:51:55.970 INFO:tasks.workunit.client.0.smithi031.stdout:4/106: mkdir d8/d1f 0 2024-09-17T01:51:55.971 INFO:tasks.workunit.client.0.smithi031.stdout:2/194: fsync d1/d3/f7 0 2024-09-17T01:51:55.972 INFO:tasks.workunit.client.0.smithi031.stdout:8/174: dread d0/df/d19/f1b [0,4194304] 0 2024-09-17T01:51:55.974 INFO:tasks.workunit.client.0.smithi031.stdout:2/195: mkdir d1/d3/df/d11/d44 0 2024-09-17T01:51:55.975 INFO:tasks.workunit.client.0.smithi031.stdout:8/175: dread d0/f28 [0,4194304] 0 2024-09-17T01:51:55.977 INFO:tasks.workunit.client.0.smithi031.stdout:8/176: mkdir d0/d2c 0 2024-09-17T01:51:55.980 INFO:tasks.workunit.client.0.smithi031.stdout:2/196: mkdir d1/d3/d45 0 2024-09-17T01:51:55.980 INFO:tasks.workunit.client.0.smithi031.stdout:4/107: fsync d8/fd 0 2024-09-17T01:51:55.983 INFO:tasks.workunit.client.0.smithi031.stdout:4/108: dread - d8/f10 zero size 2024-09-17T01:51:55.986 INFO:tasks.workunit.client.0.smithi031.stdout:8/177: dwrite d0/df/f8 [0,4194304] 0 2024-09-17T01:51:55.988 INFO:tasks.workunit.client.0.smithi031.stdout:2/197: creat d1/d3/d2d/f46 x:0 0 0 2024-09-17T01:51:55.991 INFO:tasks.workunit.client.0.smithi031.stdout:4/109: dread - d8/f14 zero size 2024-09-17T01:51:55.993 INFO:tasks.workunit.client.0.smithi031.stdout:8/178: rename d0/df/dd/f16 to d0/df/dd/f2d 0 2024-09-17T01:51:55.997 INFO:tasks.workunit.client.0.smithi031.stdout:4/110: stat c4 0 2024-09-17T01:51:55.998 INFO:tasks.workunit.client.0.smithi031.stdout:8/179: symlink d0/l2e 0 2024-09-17T01:51:55.999 INFO:tasks.workunit.client.0.smithi031.stdout:8/180: chown d0/f6 1160 1 2024-09-17T01:51:55.999 INFO:tasks.workunit.client.0.smithi031.stdout:2/198: symlink d1/d3/df/d11/d44/l47 0 2024-09-17T01:51:56.001 INFO:tasks.workunit.client.0.smithi031.stdout:4/111: symlink d8/l20 0 2024-09-17T01:51:56.002 INFO:tasks.workunit.client.0.smithi031.stdout:4/112: chown d8 950507619 1 2024-09-17T01:51:56.006 INFO:tasks.workunit.client.0.smithi031.stdout:8/181: creat d0/d5/f2f x:0 0 0 2024-09-17T01:51:56.007 INFO:tasks.workunit.client.0.smithi031.stdout:4/113: dread d8/fd [0,4194304] 0 2024-09-17T01:51:56.008 INFO:tasks.workunit.client.0.smithi031.stdout:2/199: symlink d1/d3/df/d19/d1e/l48 0 2024-09-17T01:51:56.010 INFO:tasks.workunit.client.0.smithi031.stdout:2/200: write d1/d3/df/d19/d1e/d21/f24 [1293568,2546] 0 2024-09-17T01:51:56.011 INFO:tasks.workunit.client.0.smithi031.stdout:8/182: rename d0/l15 to d0/df/dd/l30 0 2024-09-17T01:51:56.016 INFO:tasks.workunit.client.0.smithi031.stdout:1/152: sync 2024-09-17T01:51:56.019 INFO:tasks.workunit.client.0.smithi031.stdout:8/183: dwrite d0/df/f8 [0,4194304] 0 2024-09-17T01:51:56.020 INFO:tasks.workunit.client.0.smithi031.stdout:8/184: truncate d0/f9 2237707 0 2024-09-17T01:51:56.021 INFO:tasks.workunit.client.0.smithi031.stdout:1/153: mknod d4/d1a/d2d/d18/c36 0 2024-09-17T01:51:56.022 INFO:tasks.workunit.client.0.smithi031.stdout:4/114: rmdir d8/d1f 0 2024-09-17T01:51:56.026 INFO:tasks.workunit.client.0.smithi031.stdout:2/201: dread d1/d3/df/d11/f26 [0,4194304] 0 2024-09-17T01:51:56.028 INFO:tasks.workunit.client.0.smithi031.stdout:8/185: dread d0/d5/f11 [0,4194304] 0 2024-09-17T01:51:56.029 INFO:tasks.workunit.client.0.smithi031.stdout:1/154: mknod d4/c37 0 2024-09-17T01:51:56.029 INFO:tasks.workunit.client.0.smithi031.stdout:4/115: creat d8/d18/f21 x:0 0 0 2024-09-17T01:51:56.030 INFO:tasks.workunit.client.0.smithi031.stdout:2/202: symlink d1/d3/df/d19/l49 0 2024-09-17T01:51:56.031 INFO:tasks.workunit.client.0.smithi031.stdout:8/186: dread d0/df/dd/f2d [0,4194304] 0 2024-09-17T01:51:56.032 INFO:tasks.workunit.client.0.smithi031.stdout:4/116: mkdir d8/d22 0 2024-09-17T01:51:56.032 INFO:tasks.workunit.client.0.smithi031.stdout:2/203: read - d1/d3/d2d/f46 zero size 2024-09-17T01:51:56.033 INFO:tasks.workunit.client.0.smithi031.stdout:4/117: chown d8/c1b 7217 1 2024-09-17T01:51:56.033 INFO:tasks.workunit.client.0.smithi031.stdout:4/118: stat d8/c1b 0 2024-09-17T01:51:56.034 INFO:tasks.workunit.client.0.smithi031.stdout:8/187: creat d0/df/d19/f31 x:0 0 0 2024-09-17T01:51:56.034 INFO:tasks.workunit.client.0.smithi031.stdout:2/204: write d1/d3/f1c [3429700,94110] 0 2024-09-17T01:51:56.036 INFO:tasks.workunit.client.0.smithi031.stdout:4/119: chown d8/f11 462940 1 2024-09-17T01:51:56.040 INFO:tasks.workunit.client.0.smithi031.stdout:2/205: dread d1/f20 [0,4194304] 0 2024-09-17T01:51:56.040 INFO:tasks.workunit.client.0.smithi031.stdout:4/120: truncate d8/f14 732675 0 2024-09-17T01:51:56.043 INFO:tasks.workunit.client.0.smithi031.stdout:4/121: fsync d8/f10 0 2024-09-17T01:51:56.049 INFO:tasks.workunit.client.0.smithi031.stdout:1/155: dwrite d4/d1a/f25 [0,4194304] 0 2024-09-17T01:51:56.050 INFO:tasks.workunit.client.0.smithi031.stdout:8/188: dwrite d0/d5/f2f [0,4194304] 0 2024-09-17T01:51:56.051 INFO:tasks.workunit.client.0.smithi031.stdout:1/156: chown c0 11520 1 2024-09-17T01:51:56.058 INFO:tasks.workunit.client.0.smithi031.stdout:2/206: dread d1/d3/df/d19/f33 [0,4194304] 0 2024-09-17T01:51:56.060 INFO:tasks.workunit.client.0.smithi031.stdout:8/189: symlink d0/df/l32 0 2024-09-17T01:51:56.060 INFO:tasks.workunit.client.0.smithi031.stdout:4/122: dwrite f7 [0,4194304] 0 2024-09-17T01:51:56.064 INFO:tasks.workunit.client.0.smithi031.stdout:8/190: write d0/df/d19/f29 [96610,84969] 0 2024-09-17T01:51:56.129 INFO:tasks.workunit.client.0.smithi031.stdout:0/118: sync 2024-09-17T01:51:56.131 INFO:tasks.workunit.client.0.smithi031.stdout:4/123: mknod d8/d22/c23 0 2024-09-17T01:51:56.132 INFO:tasks.workunit.client.0.smithi031.stdout:1/157: truncate d4/d1a/d2d/f15 353498 0 2024-09-17T01:51:56.134 INFO:tasks.workunit.client.0.smithi031.stdout:8/191: rename d0/f6 to d0/df/d19/f33 0 2024-09-17T01:51:56.135 INFO:tasks.workunit.client.0.smithi031.stdout:2/207: write d1/d3/df/d11/f26 [2066145,128980] 0 2024-09-17T01:51:56.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.137+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fe0105260 con 0x7f3fd006d600 2024-09-17T01:51:56.136 INFO:tasks.workunit.client.0.smithi031.stdout:8/192: fdatasync d0/df/d19/f31 0 2024-09-17T01:51:56.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.138+0000 7f3fddffb700 1 -- 172.21.15.31:0/3887566169 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3fe0105260 con 0x7f3fd006d600 2024-09-17T01:51:56.139 INFO:tasks.workunit.client.0.smithi031.stdout:2/208: write d1/d3/df/d11/d30/f37 [818580,128650] 0 2024-09-17T01:51:56.140 INFO:tasks.workunit.client.0.smithi031.stdout:8/193: mknod d0/d5/c34 0 2024-09-17T01:51:56.141 INFO:tasks.workunit.client.0.smithi031.stdout:0/119: dread d0/dc/d1a/d25/f26 [0,4194304] 0 2024-09-17T01:51:56.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.143+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f3fd006d600 msgr2=0x7f3fd006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.143+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f3fd006d600 0x7f3fd006fab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400b6a0 tx=0x7f3fd4005fd0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.143+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 msgr2=0x7f3fe0198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.143+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 0x7f3fe0198190 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00e920 tx=0x7f3fcc00ece0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.144 INFO:tasks.workunit.client.0.smithi031.stdout:4/124: dread d8/ff [0,4194304] 0 2024-09-17T01:51:56.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 shutdown_connections 2024-09-17T01:51:56.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f3fd006d600 0x7f3fd006fab0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fe0100cd0 0x7f3fe0197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 --2- 172.21.15.31:0/3887566169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fe01035f0 0x7f3fe0198190 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 >> 172.21.15.31:0/3887566169 conn(0x7f3fe00fa6d0 msgr2=0x7f3fe00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 shutdown_connections 2024-09-17T01:51:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.144+0000 7f3fe71ed700 1 -- 172.21.15.31:0/3887566169 wait complete. 2024-09-17T01:51:56.146 INFO:tasks.workunit.client.0.smithi031.stdout:8/194: dread d0/f28 [0,4194304] 0 2024-09-17T01:51:56.146 INFO:tasks.workunit.client.0.smithi031.stdout:4/125: creat d8/d18/f24 x:0 0 0 2024-09-17T01:51:56.147 INFO:tasks.workunit.client.0.smithi031.stdout:8/195: mknod d0/df/d19/c35 0 2024-09-17T01:51:56.149 INFO:tasks.workunit.client.0.smithi031.stdout:4/126: dread d8/fb [0,4194304] 0 2024-09-17T01:51:56.150 INFO:tasks.workunit.client.0.smithi031.stdout:4/127: mkdir d8/d22/d25 0 2024-09-17T01:51:56.151 INFO:tasks.workunit.client.0.smithi031.stdout:4/128: fdatasync d8/d18/f24 0 2024-09-17T01:51:56.152 INFO:tasks.workunit.client.0.smithi031.stdout:4/129: write d8/f11 [1512228,93957] 0 2024-09-17T01:51:56.154 INFO:tasks.workunit.client.0.smithi031.stdout:4/130: creat d8/d22/d25/f26 x:0 0 0 2024-09-17T01:51:56.155 INFO:tasks.workunit.client.0.smithi031.stdout:4/131: read d8/f11 [3132669,100318] 0 2024-09-17T01:51:56.155 INFO:tasks.workunit.client.0.smithi031.stdout:4/132: stat c4 0 2024-09-17T01:51:56.157 INFO:tasks.workunit.client.0.smithi031.stdout:4/133: fsync d8/fc 0 2024-09-17T01:51:56.204 INFO:tasks.workunit.client.0.smithi031.stdout:0/120: write d0/dc/d1a/f23 [628977,112959] 0 2024-09-17T01:51:56.205 INFO:tasks.workunit.client.0.smithi031.stdout:0/121: read d0/dc/d1a/f23 [1428806,57846] 0 2024-09-17T01:51:56.206 INFO:tasks.workunit.client.0.smithi031.stdout:8/196: truncate d0/df/dd/f2d 114186 0 2024-09-17T01:51:56.213 INFO:tasks.workunit.client.0.smithi031.stdout:4/134: truncate f7 3256352 0 2024-09-17T01:51:56.214 INFO:tasks.workunit.client.0.smithi031.stdout:1/158: write d4/d1a/d2d/f15 [965558,102714] 0 2024-09-17T01:51:56.219 INFO:tasks.workunit.client.0.smithi031.stdout:0/122: rename d0/dc/d1a to d0/dc/d2a 0 2024-09-17T01:51:56.219 INFO:tasks.workunit.client.0.smithi031.stdout:8/197: dwrite d0/df/d19/f33 [4194304,4194304] 0 2024-09-17T01:51:56.220 INFO:tasks.workunit.client.0.smithi031.stdout:4/135: creat d8/f27 x:0 0 0 2024-09-17T01:51:56.221 INFO:tasks.workunit.client.0.smithi031.stdout:8/198: truncate d0/df/d19/f1e 5026472 0 2024-09-17T01:51:56.223 INFO:tasks.workunit.client.0.smithi031.stdout:1/159: creat d4/d1a/d2d/f38 x:0 0 0 2024-09-17T01:51:56.225 INFO:tasks.workunit.client.0.smithi031.stdout:1/160: write d4/d1a/d2d/fa [4325010,73617] 0 2024-09-17T01:51:56.227 INFO:tasks.workunit.client.0.smithi031.stdout:1/161: chown d4/d1a/d2d/fe 8534 1 2024-09-17T01:51:56.227 INFO:tasks.workunit.client.0.smithi031.stdout:8/199: dread d0/df/d19/f33 [4194304,4194304] 0 2024-09-17T01:51:56.229 INFO:tasks.workunit.client.0.smithi031.stdout:4/136: write d8/f11 [194855,121432] 0 2024-09-17T01:51:56.231 INFO:tasks.workunit.client.0.smithi031.stdout:1/162: dread d4/d1a/f34 [0,4194304] 0 2024-09-17T01:51:56.231 INFO:tasks.workunit.client.0.smithi031.stdout:0/123: symlink d0/dc/l2b 0 2024-09-17T01:51:56.234 INFO:tasks.workunit.client.0.smithi031.stdout:8/200: symlink d0/l36 0 2024-09-17T01:51:56.235 INFO:tasks.workunit.client.0.smithi031.stdout:1/163: creat d4/d1a/d2d/d18/f39 x:0 0 0 2024-09-17T01:51:56.238 INFO:tasks.workunit.client.0.smithi031.stdout:1/164: dread d4/d1a/d2d/d18/f2e [0,4194304] 0 2024-09-17T01:51:56.238 INFO:tasks.workunit.client.0.smithi031.stdout:8/201: unlink d0/df/c23 0 2024-09-17T01:51:56.239 INFO:tasks.workunit.client.0.smithi031.stdout:1/165: chown d4/d1a/d2d/f38 487 1 2024-09-17T01:51:56.240 INFO:tasks.workunit.client.0.smithi031.stdout:0/124: dread d0/dc/d5/f15 [0,4194304] 0 2024-09-17T01:51:56.241 INFO:tasks.workunit.client.0.smithi031.stdout:0/125: fdatasync d0/dc/f13 0 2024-09-17T01:51:56.246 INFO:tasks.workunit.client.0.smithi031.stdout:8/202: link d0/df/l32 d0/d5/l37 0 2024-09-17T01:51:56.247 INFO:tasks.workunit.client.0.smithi031.stdout:8/203: stat d0/df/dd 0 2024-09-17T01:51:56.247 INFO:tasks.workunit.client.0.smithi031.stdout:0/126: mknod d0/dc/d2a/c2c 0 2024-09-17T01:51:56.247 INFO:tasks.workunit.client.0.smithi031.stdout:1/166: dwrite d4/d1a/d2d/fa [4194304,4194304] 0 2024-09-17T01:51:56.249 INFO:tasks.workunit.client.0.smithi031.stdout:8/204: mknod d0/df/c38 0 2024-09-17T01:51:56.251 INFO:tasks.workunit.client.0.smithi031.stdout:0/127: symlink d0/l2d 0 2024-09-17T01:51:56.252 INFO:tasks.workunit.client.0.smithi031.stdout:1/167: mknod d4/c3a 0 2024-09-17T01:51:56.254 INFO:tasks.workunit.client.0.smithi031.stdout:0/128: mknod d0/c2e 0 2024-09-17T01:51:56.256 INFO:tasks.workunit.client.0.smithi031.stdout:0/129: write d0/dc/d5/f1c [275775,32154] 0 2024-09-17T01:51:56.256 INFO:tasks.workunit.client.0.smithi031.stdout:8/205: rmdir d0/d2c 0 2024-09-17T01:51:56.258 INFO:tasks.workunit.client.0.smithi031.stdout:8/206: write d0/df/d19/f27 [401999,73600] 0 2024-09-17T01:51:56.261 INFO:tasks.workunit.client.0.smithi031.stdout:8/207: creat d0/df/f39 x:0 0 0 2024-09-17T01:51:56.261 INFO:tasks.workunit.client.0.smithi031.stdout:0/130: dread d0/dc/d5/fa [0,4194304] 0 2024-09-17T01:51:56.263 INFO:tasks.workunit.client.0.smithi031.stdout:8/208: creat d0/df/f3a x:0 0 0 2024-09-17T01:51:56.264 INFO:tasks.workunit.client.0.smithi031.stdout:0/131: write d0/f21 [2912334,30803] 0 2024-09-17T01:51:56.266 INFO:tasks.workunit.client.0.smithi031.stdout:8/209: mknod d0/d5/c3b 0 2024-09-17T01:51:56.268 INFO:tasks.workunit.client.0.smithi031.stdout:0/132: rename d0/dc/d2a/c20 to d0/d29/c2f 0 2024-09-17T01:51:56.278 INFO:tasks.workunit.client.0.smithi031.stdout:8/210: getdents d0/d5 0 2024-09-17T01:51:56.279 INFO:tasks.workunit.client.0.smithi031.stdout:8/211: chown d0/f9 9 1 2024-09-17T01:51:56.281 INFO:tasks.workunit.client.0.smithi031.stdout:8/212: rename d0/df/c38 to d0/d5/c3c 0 2024-09-17T01:51:56.283 INFO:tasks.workunit.client.0.smithi031.stdout:8/213: dread d0/df/d19/f29 [0,4194304] 0 2024-09-17T01:51:56.285 INFO:tasks.workunit.client.0.smithi031.stdout:8/214: mkdir d0/df/d19/d3d 0 2024-09-17T01:51:56.285 INFO:tasks.workunit.client.0.smithi031.stdout:8/215: write d0/df/d19/f31 [605752,86607] 0 2024-09-17T01:51:56.286 INFO:tasks.workunit.client.0.smithi031.stdout:8/216: stat d0/d5/c12 0 2024-09-17T01:51:56.288 INFO:tasks.workunit.client.0.smithi031.stdout:8/217: creat d0/df/d19/d3d/f3e x:0 0 0 2024-09-17T01:51:56.288 INFO:tasks.workunit.client.0.smithi031.stdout:8/218: readlink d0/df/d19/l20 0 2024-09-17T01:51:56.290 INFO:tasks.workunit.client.0.smithi031.stdout:8/219: write d0/df/d19/f29 [300699,110605] 0 2024-09-17T01:51:56.294 INFO:tasks.workunit.client.0.smithi031.stdout:8/220: rename d0/df/d19/c14 to d0/d5/c3f 0 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 -- 172.21.15.31:0/524844969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fee50 msgr2=0x7f2f48101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 --2- 172.21.15.31:0/524844969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fee50 0x7f2f48101580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009910 tx=0x7f2f34009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 -- 172.21.15.31:0/524844969 shutdown_connections 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 --2- 172.21.15.31:0/524844969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fee50 0x7f2f48101580 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 --2- 172.21.15.31:0/524844969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f480fe500 0x7f2f480fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 -- 172.21.15.31:0/524844969 >> 172.21.15.31:0/524844969 conn(0x7f2f480f9f10 msgr2=0x7f2f480fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 -- 172.21.15.31:0/524844969 shutdown_connections 2024-09-17T01:51:56.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.299+0000 7f2f4f161700 1 -- 172.21.15.31:0/524844969 wait complete. 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4f161700 1 Processor -- start 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4f161700 1 -- start start 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4f161700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 0x7f2f48195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4f161700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f480fee50 0x7f2f48196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4f161700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48196690 con 0x7f2f480fe500 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4f161700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f481967d0 con 0x7f2f480fee50 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4cefd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 0x7f2f48195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:56.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4cefd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 0x7f2f48195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39538/0 (socket says 172.21.15.31:39538) 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4cefd700 1 -- 172.21.15.31:0/1600013340 learned_addr learned my addr 172.21.15.31:0/1600013340 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f47fff700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f480fee50 0x7f2f48196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4cefd700 1 -- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f480fee50 msgr2=0x7f2f48196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4cefd700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f480fee50 0x7f2f48196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.300+0000 7f2f4cefd700 1 -- 172.21.15.31:0/1600013340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340095f0 con 0x7f2f480fe500 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.301+0000 7f2f4cefd700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 0x7f2f48195b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e920 tx=0x7f2f3c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.301+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c00c9d0 con 0x7f2f480fe500 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.301+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4819b280 con 0x7f2f480fe500 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.301+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f3c010430 con 0x7f2f480fe500 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.301+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c018650 con 0x7f2f480fe500 2024-09-17T01:51:56.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.301+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4819b7d0 con 0x7f2f480fe500 2024-09-17T01:51:56.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.302+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f48108d10 con 0x7f2f480fe500 2024-09-17T01:51:56.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.302+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f2f3c0105a0 con 0x7f2f480fe500 2024-09-17T01:51:56.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.303+0000 7f2f45ffb700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f2f3806d600 0x7f2f3806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:56.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.303+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2f3c014070 con 0x7f2f480fe500 2024-09-17T01:51:56.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.303+0000 7f2f47fff700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f2f3806d600 0x7f2f3806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:56.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.304+0000 7f2f47fff700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f2f3806d600 0x7f2f3806fab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f340059d0 tx=0x7f2f34005940 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:56.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.308+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f2f3c0539d0 con 0x7f2f480fe500 2024-09-17T01:51:56.438 INFO:tasks.workunit.client.0.smithi031.stdout:3/60: sync 2024-09-17T01:51:56.439 INFO:tasks.workunit.client.0.smithi031.stdout:3/61: fdatasync db/f11 0 2024-09-17T01:51:56.441 INFO:tasks.workunit.client.0.smithi031.stdout:3/62: rename db/df/f10 to db/f12 0 2024-09-17T01:51:56.442 INFO:tasks.workunit.client.0.smithi031.stdout:3/63: chown db/df 12 1 2024-09-17T01:51:56.444 INFO:tasks.workunit.client.0.smithi031.stdout:3/64: link c8 db/c13 0 2024-09-17T01:51:56.451 INFO:tasks.workunit.client.0.smithi031.stdout:3/65: dwrite f9 [0,4194304] 0 2024-09-17T01:51:56.455 INFO:tasks.workunit.client.0.smithi031.stdout:3/66: dread f7 [0,4194304] 0 2024-09-17T01:51:56.456 INFO:tasks.workunit.client.0.smithi031.stdout:3/67: fsync db/f11 0 2024-09-17T01:51:56.456 INFO:tasks.workunit.client.0.smithi031.stdout:3/68: fsync f6 0 2024-09-17T01:51:56.468 INFO:tasks.workunit.client.0.smithi031.stdout:3/69: write f3 [497307,60177] 0 2024-09-17T01:51:56.470 INFO:tasks.workunit.client.0.smithi031.stdout:3/70: symlink db/l14 0 2024-09-17T01:51:56.470 INFO:tasks.workunit.client.0.smithi031.stdout:3/71: dread - db/fe zero size 2024-09-17T01:51:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:56 smithi031 ceph-mon[27673]: pgmap v8: 65 pgs: 65 active+clean; 216 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 973 KiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-17T01:51:56.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.536+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f48105ed0 con 0x7f2f3806d600 2024-09-17T01:51:56.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.546+0000 7f2f45ffb700 1 -- 172.21.15.31:0/1600013340 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f2f48105ed0 con 0x7f2f3806d600 2024-09-17T01:51:56.544 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (6m) 2m ago 8m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (8m) 2m ago 8m 7512k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (7m) 3s ago 7m 7646k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (8m) 2m ago 8m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (7m) 3s ago 7m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (6m) 2m ago 7m 86.8M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (2m) 2m ago 2m 16.7M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (2m) 2m ago 2m 16.2M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (2m) 3s ago 2m 64.6M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (2m) 3s ago 2m 111M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.0 dc2bc1663786 5a9379d38d8b 2024-09-17T01:51:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (35s) 3s ago 7m 481M - 19.1.1-330-gc2ddf972 ebb0615149de d8e0fe42865a 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (9m) 2m ago 9m 44.2M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (7m) 3s ago 7m 38.7M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (8m) 2m ago 8m 16.0M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (7m) 3s ago 7m 15.4M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (6m) 2m ago 6m 48.2M 3948M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (5m) 2m ago 5m 51.9M 3948M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (5m) 2m ago 5m 45.9M 3948M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (4m) 3s ago 4m 139M 4970M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (4m) 3s ago 4m 129M 4970M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (4m) 3s ago 4m 120M 4970M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:51:56.546 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (6m) 2m ago 7m 61.9M - 2.43.0 a07b618ecd1d ed28452b08d0 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f2f3806d600 msgr2=0x7f2f3806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f2f3806d600 0x7f2f3806fab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f340059d0 tx=0x7f2f34005940 comp rx=0 tx=0).stop 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 msgr2=0x7f2f48195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 0x7f2f48195b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e920 tx=0x7f2f3c00ec30 comp rx=0 tx=0).stop 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 shutdown_connections 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f2f3806d600 0x7f2f3806fab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480fe500 0x7f2f48195b30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 --2- 172.21.15.31:0/1600013340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f480fee50 0x7f2f48196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 >> 172.21.15.31:0/1600013340 conn(0x7f2f480f9f10 msgr2=0x7f2f481047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:56.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 shutdown_connections 2024-09-17T01:51:56.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.548+0000 7f2f4f161700 1 -- 172.21.15.31:0/1600013340 wait complete. 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:2/209: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:6/202: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:8/221: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:9/148: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:0/133: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:7/108: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:5/176: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:3/72: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:4/137: sync 2024-09-17T01:51:56.600 INFO:tasks.workunit.client.0.smithi031.stdout:1/168: sync 2024-09-17T01:51:56.601 INFO:tasks.workunit.client.0.smithi031.stdout:0/134: chown d0/dc/d2a/d25 273821935 1 2024-09-17T01:51:56.602 INFO:tasks.workunit.client.0.smithi031.stdout:4/138: creat d8/f28 x:0 0 0 2024-09-17T01:51:56.603 INFO:tasks.workunit.client.0.smithi031.stdout:3/73: creat db/df/f15 x:0 0 0 2024-09-17T01:51:56.603 INFO:tasks.workunit.client.0.smithi031.stdout:8/222: rmdir d0/df/dd 39 2024-09-17T01:51:56.603 INFO:tasks.workunit.client.0.smithi031.stdout:6/203: read d23/f31 [3370757,12491] 0 2024-09-17T01:51:56.609 INFO:tasks.workunit.client.0.smithi031.stdout:5/177: rename da/d14/c3d to da/d14/c3f 0 2024-09-17T01:51:56.609 INFO:tasks.workunit.client.0.smithi031.stdout:5/178: write da/dc/d10/d12/f23 [5154933,9027] 0 2024-09-17T01:51:56.609 INFO:tasks.workunit.client.0.smithi031.stdout:3/74: creat db/f16 x:0 0 0 2024-09-17T01:51:56.609 INFO:tasks.workunit.client.0.smithi031.stdout:6/204: readlink d23/l2f 0 2024-09-17T01:51:56.610 INFO:tasks.workunit.client.0.smithi031.stdout:1/169: write d4/d1a/d2d/f16 [1120006,48559] 0 2024-09-17T01:51:56.611 INFO:tasks.workunit.client.0.smithi031.stdout:2/210: mkdir d1/d3/d45/d4a 0 2024-09-17T01:51:56.613 INFO:tasks.workunit.client.0.smithi031.stdout:2/211: chown d1/d3/df/d19/d1e/d21/f24 214007 1 2024-09-17T01:51:56.614 INFO:tasks.workunit.client.0.smithi031.stdout:4/139: link d8/f28 d8/d18/f29 0 2024-09-17T01:51:56.616 INFO:tasks.workunit.client.0.smithi031.stdout:4/140: read - d8/f27 zero size 2024-09-17T01:51:56.618 INFO:tasks.workunit.client.0.smithi031.stdout:6/205: rename l22 to d23/l44 0 2024-09-17T01:51:56.621 INFO:tasks.workunit.client.0.smithi031.stdout:4/141: write f5 [670477,121800] 0 2024-09-17T01:51:56.621 INFO:tasks.workunit.client.0.smithi031.stdout:1/170: dwrite d4/d1a/d2d/f16 [0,4194304] 0 2024-09-17T01:51:56.623 INFO:tasks.workunit.client.0.smithi031.stdout:5/179: rename da/dc/l2b to da/dc/d2e/l40 0 2024-09-17T01:51:56.625 INFO:tasks.workunit.client.0.smithi031.stdout:5/180: stat da/dc/d2e 0 2024-09-17T01:51:56.630 INFO:tasks.workunit.client.0.smithi031.stdout:1/171: creat d4/d1e/f3b x:0 0 0 2024-09-17T01:51:56.630 INFO:tasks.workunit.client.0.smithi031.stdout:3/75: truncate f7 3209672 0 2024-09-17T01:51:56.632 INFO:tasks.workunit.client.0.smithi031.stdout:4/142: mknod d8/d22/c2a 0 2024-09-17T01:51:56.634 INFO:tasks.workunit.client.0.smithi031.stdout:2/212: rename d1/d3/df/d19/d1e/l48 to d1/d3/df/d18/d40/l4b 0 2024-09-17T01:51:56.636 INFO:tasks.workunit.client.0.smithi031.stdout:2/213: readlink d1/d3/df/d11/d30/l3a 0 2024-09-17T01:51:56.638 INFO:tasks.workunit.client.0.smithi031.stdout:6/206: link d23/f35 d23/f45 0 2024-09-17T01:51:56.642 INFO:tasks.workunit.client.0.smithi031.stdout:2/214: mkdir d1/d4c 0 2024-09-17T01:51:56.644 INFO:tasks.workunit.client.0.smithi031.stdout:1/172: dread d4/f10 [0,4194304] 0 2024-09-17T01:51:56.645 INFO:tasks.workunit.client.0.smithi031.stdout:3/76: dwrite f3 [0,4194304] 0 2024-09-17T01:51:56.649 INFO:tasks.workunit.client.0.smithi031.stdout:3/77: write db/fe [296805,62922] 0 2024-09-17T01:51:56.649 INFO:tasks.workunit.client.0.smithi031.stdout:5/181: dwrite da/d14/f3c [0,4194304] 0 2024-09-17T01:51:56.650 INFO:tasks.workunit.client.0.smithi031.stdout:6/207: rename c1b to d23/c46 0 2024-09-17T01:51:56.652 INFO:tasks.workunit.client.0.smithi031.stdout:4/143: dwrite d8/f27 [0,4194304] 0 2024-09-17T01:51:56.653 INFO:tasks.workunit.client.0.smithi031.stdout:4/144: dread - d8/d18/f24 zero size 2024-09-17T01:51:56.653 INFO:tasks.workunit.client.0.smithi031.stdout:2/215: creat d1/d3/df/d11/d30/f4d x:0 0 0 2024-09-17T01:51:56.655 INFO:tasks.workunit.client.0.smithi031.stdout:1/173: creat d4/d1a/f3c x:0 0 0 2024-09-17T01:51:56.656 INFO:tasks.workunit.client.0.smithi031.stdout:2/216: rename d1/d4c to d1/d4c/d4e 22 2024-09-17T01:51:56.661 INFO:tasks.workunit.client.0.smithi031.stdout:4/145: dread d8/f11 [0,4194304] 0 2024-09-17T01:51:56.662 INFO:tasks.workunit.client.0.smithi031.stdout:1/174: mkdir d4/d3d 0 2024-09-17T01:51:56.663 INFO:tasks.workunit.client.0.smithi031.stdout:4/146: write f5 [1495724,94754] 0 2024-09-17T01:51:56.672 INFO:tasks.workunit.client.0.smithi031.stdout:2/217: mkdir d1/d3/df/d19/d1e/d4f 0 2024-09-17T01:51:56.672 INFO:tasks.workunit.client.0.smithi031.stdout:1/175: dwrite d4/f11 [0,4194304] 0 2024-09-17T01:51:56.681 INFO:tasks.workunit.client.0.smithi031.stdout:6/208: getdents d23 0 2024-09-17T01:51:56.683 INFO:tasks.workunit.client.0.smithi031.stdout:1/176: dwrite d4/d1a/f1d [0,4194304] 0 2024-09-17T01:51:56.685 INFO:tasks.workunit.client.0.smithi031.stdout:6/209: rmdir d23 39 2024-09-17T01:51:56.685 INFO:tasks.workunit.client.0.smithi031.stdout:1/177: fdatasync d4/f17 0 2024-09-17T01:51:56.692 INFO:tasks.workunit.client.0.smithi031.stdout:3/78: truncate f9 1983323 0 2024-09-17T01:51:56.694 INFO:tasks.workunit.client.0.smithi031.stdout:6/210: rmdir d23 39 2024-09-17T01:51:56.697 INFO:tasks.workunit.client.0.smithi031.stdout:2/218: rmdir d1/d3 39 2024-09-17T01:51:56.701 INFO:tasks.workunit.client.0.smithi031.stdout:4/147: truncate f7 1285986 0 2024-09-17T01:51:56.702 INFO:tasks.workunit.client.0.smithi031.stdout:6/211: mkdir d23/d33/d47 0 2024-09-17T01:51:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.705+0000 7fb5ec33f700 1 -- 172.21.15.31:0/1069135516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 msgr2=0x7fb5e40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.705+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/1069135516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e40ff540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009910 tx=0x7fb5e0009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.705+0000 7fb5ec33f700 1 -- 172.21.15.31:0/1069135516 shutdown_connections 2024-09-17T01:51:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.705+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/1069135516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5e41003d0 0x7fb5e4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.705+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/1069135516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e40ff540 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.705+0000 7fb5ec33f700 1 -- 172.21.15.31:0/1069135516 >> 172.21.15.31:0/1069135516 conn(0x7fb5e40fa780 msgr2=0x7fb5e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.706+0000 7fb5ec33f700 1 -- 172.21.15.31:0/1069135516 shutdown_connections 2024-09-17T01:51:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.706+0000 7fb5ec33f700 1 -- 172.21.15.31:0/1069135516 wait complete. 2024-09-17T01:51:56.705 INFO:tasks.workunit.client.0.smithi031.stdout:1/178: getdents d4/d1a/d2d 0 2024-09-17T01:51:56.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.706+0000 7fb5ec33f700 1 Processor -- start 2024-09-17T01:51:56.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ec33f700 1 -- start start 2024-09-17T01:51:56.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ec33f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e4193860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:56.706 INFO:tasks.workunit.client.0.smithi031.stdout:4/148: creat d8/f2b x:0 0 0 2024-09-17T01:51:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ec33f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5e41003d0 0x7fb5e4193da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ea0db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e4193860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ea0db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e4193860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:55272/0 (socket says 172.21.15.31:55272) 2024-09-17T01:51:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ea0db700 1 -- 172.21.15.31:0/2608041405 learned_addr learned my addr 172.21.15.31:0/2608041405 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5e98da700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5e41003d0 0x7fb5e4193da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41943c0 con 0x7fb5e41003d0 2024-09-17T01:51:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e4194500 con 0x7fb5e40ff130 2024-09-17T01:51:56.708 INFO:tasks.workunit.client.0.smithi031.stdout:1/179: fdatasync d4/d1a/d2d/fa 0 2024-09-17T01:51:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ea0db700 1 -- 172.21.15.31:0/2608041405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5e41003d0 msgr2=0x7fb5e4193da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ea0db700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5e41003d0 0x7fb5e4193da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.707+0000 7fb5ea0db700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00095f0 con 0x7fb5e40ff130 2024-09-17T01:51:56.709 INFO:tasks.workunit.client.0.smithi031.stdout:1/180: stat d4/f17 0 2024-09-17T01:51:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.708+0000 7fb5ea0db700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e4193860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00092e0 tx=0x7fb5e001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.708+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e0021070 con 0x7fb5e40ff130 2024-09-17T01:51:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.708+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e4198f50 con 0x7fb5e40ff130 2024-09-17T01:51:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.708+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5e001ce70 con 0x7fb5e40ff130 2024-09-17T01:51:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.708+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e41993c0 con 0x7fb5e40ff130 2024-09-17T01:51:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.708+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e0028660 con 0x7fb5e40ff130 2024-09-17T01:51:56.710 INFO:tasks.workunit.client.0.smithi031.stdout:6/212: fdatasync d23/d33/f34 0 2024-09-17T01:51:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.709+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8005320 con 0x7fb5e40ff130 2024-09-17T01:51:56.711 INFO:tasks.workunit.client.0.smithi031.stdout:6/213: dread - d23/d33/f38 zero size 2024-09-17T01:51:56.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.711+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7fb5e0025070 con 0x7fb5e40ff130 2024-09-17T01:51:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.711+0000 7fb5db7fe700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fb5d006d5f0 0x7fb5d006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.712+0000 7fb5e98da700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fb5d006d5f0 0x7fb5d006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.712+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb5e0092400 con 0x7fb5e40ff130 2024-09-17T01:51:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.713+0000 7fb5e98da700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fb5d006d5f0 0x7fb5d006faa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009c60 tx=0x7fb5d4009260 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:56.712 INFO:tasks.workunit.client.0.smithi031.stdout:1/181: mknod d4/c3e 0 2024-09-17T01:51:56.715 INFO:tasks.workunit.client.0.smithi031.stdout:1/182: write d4/d1a/d2d/d18/f39 [724852,66778] 0 2024-09-17T01:51:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:56.717+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fb5e005f570 con 0x7fb5e40ff130 2024-09-17T01:51:56.718 INFO:tasks.workunit.client.0.smithi031.stdout:6/214: dwrite d23/d33/f38 [0,4194304] 0 2024-09-17T01:51:56.718 INFO:tasks.workunit.client.0.smithi031.stdout:3/79: write f7 [4248761,44020] 0 2024-09-17T01:51:56.720 INFO:tasks.workunit.client.0.smithi031.stdout:1/183: write d4/d1a/d2d/d18/f39 [928016,51387] 0 2024-09-17T01:51:56.723 INFO:tasks.workunit.client.0.smithi031.stdout:6/215: creat d23/f48 x:0 0 0 2024-09-17T01:51:56.724 INFO:tasks.workunit.client.0.smithi031.stdout:3/80: rename f3 to db/df/f17 0 2024-09-17T01:51:56.725 INFO:tasks.workunit.client.0.smithi031.stdout:3/81: chown db/f12 313684 1 2024-09-17T01:51:56.725 INFO:tasks.workunit.client.0.smithi031.stdout:3/82: chown f2 724 1 2024-09-17T01:51:56.726 INFO:tasks.workunit.client.0.smithi031.stdout:1/184: mkdir d4/d1e/d3f 0 2024-09-17T01:51:56.730 INFO:tasks.workunit.client.0.smithi031.stdout:4/149: dwrite f7 [0,4194304] 0 2024-09-17T01:51:56.730 INFO:tasks.workunit.client.0.smithi031.stdout:1/185: mkdir d4/d1e/d40 0 2024-09-17T01:51:56.731 INFO:tasks.workunit.client.0.smithi031.stdout:4/150: readlink d8/l20 0 2024-09-17T01:51:56.732 INFO:tasks.workunit.client.0.smithi031.stdout:1/186: dread - d4/d1a/d2d/d18/f1c zero size 2024-09-17T01:51:56.733 INFO:tasks.workunit.client.0.smithi031.stdout:4/151: write f7 [1961792,105865] 0 2024-09-17T01:51:56.735 INFO:tasks.workunit.client.0.smithi031.stdout:1/187: symlink d4/d1e/d3f/l41 0 2024-09-17T01:51:56.736 INFO:tasks.workunit.client.0.smithi031.stdout:4/152: creat d8/d22/d25/f2c x:0 0 0 2024-09-17T01:51:56.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:56 smithi092 ceph-mon[33552]: pgmap v8: 65 pgs: 65 active+clean; 216 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 973 KiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-17T01:51:56.739 INFO:tasks.workunit.client.0.smithi031.stdout:1/188: rename d4/d1a/f34 to d4/d1e/f42 0 2024-09-17T01:51:56.740 INFO:tasks.workunit.client.0.smithi031.stdout:4/153: creat d8/d18/f2d x:0 0 0 2024-09-17T01:51:56.743 INFO:tasks.workunit.client.0.smithi031.stdout:4/154: creat d8/d22/f2e x:0 0 0 2024-09-17T01:51:56.743 INFO:tasks.workunit.client.0.smithi031.stdout:1/189: dread d4/d1a/d2d/d18/f39 [0,4194304] 0 2024-09-17T01:51:56.744 INFO:tasks.workunit.client.0.smithi031.stdout:4/155: chown d8/d18/c19 6044 1 2024-09-17T01:51:56.748 INFO:tasks.workunit.client.0.smithi031.stdout:6/216: dread - d23/f45 zero size 2024-09-17T01:51:56.751 INFO:tasks.workunit.client.0.smithi031.stdout:3/83: truncate f2 3189708 0 2024-09-17T01:51:56.757 INFO:tasks.workunit.client.0.smithi031.stdout:1/190: dwrite d4/d1a/d2d/f16 [4194304,4194304] 0 2024-09-17T01:51:56.759 INFO:tasks.workunit.client.0.smithi031.stdout:4/156: dwrite d8/f2b [0,4194304] 0 2024-09-17T01:51:56.764 INFO:tasks.workunit.client.0.smithi031.stdout:1/191: chown d4/d1a/d2d/d18/f26 10978577 1 2024-09-17T01:51:56.765 INFO:tasks.workunit.client.0.smithi031.stdout:3/84: dread f9 [0,4194304] 0 2024-09-17T01:51:56.765 INFO:tasks.workunit.client.0.smithi031.stdout:3/85: chown f7 2233320 1 2024-09-17T01:51:56.766 INFO:tasks.workunit.client.0.smithi031.stdout:3/86: chown db/df 197916 1 2024-09-17T01:51:56.767 INFO:tasks.workunit.client.0.smithi031.stdout:6/217: dwrite f1a [0,4194304] 0 2024-09-17T01:51:56.770 INFO:tasks.workunit.client.0.smithi031.stdout:1/192: rmdir d4/d1a/d2d 39 2024-09-17T01:51:56.772 INFO:tasks.workunit.client.0.smithi031.stdout:3/87: symlink db/df/l18 0 2024-09-17T01:51:56.774 INFO:tasks.workunit.client.0.smithi031.stdout:6/218: creat d23/d33/f49 x:0 0 0 2024-09-17T01:51:56.775 INFO:tasks.workunit.client.0.smithi031.stdout:6/219: fdatasync f1e 0 2024-09-17T01:51:56.776 INFO:tasks.workunit.client.0.smithi031.stdout:1/193: dread - d4/d1a/d2d/d18/f1c zero size 2024-09-17T01:51:56.776 INFO:tasks.workunit.client.0.smithi031.stdout:6/220: read d23/d33/f3c [7840253,77390] 0 2024-09-17T01:51:56.777 INFO:tasks.workunit.client.0.smithi031.stdout:3/88: creat db/f19 x:0 0 0 2024-09-17T01:51:56.777 INFO:tasks.workunit.client.0.smithi031.stdout:4/157: write d8/f28 [24310,84358] 0 2024-09-17T01:51:56.778 INFO:tasks.workunit.client.0.smithi031.stdout:3/89: fdatasync db/df/f15 0 2024-09-17T01:51:56.780 INFO:tasks.workunit.client.0.smithi031.stdout:6/221: dread - d23/f39 zero size 2024-09-17T01:51:56.782 INFO:tasks.workunit.client.0.smithi031.stdout:4/158: truncate d8/fc 3930495 0 2024-09-17T01:51:56.783 INFO:tasks.workunit.client.0.smithi031.stdout:1/194: mkdir d4/d1a/d43 0 2024-09-17T01:51:56.783 INFO:tasks.workunit.client.0.smithi031.stdout:4/159: write d8/f27 [3562835,63118] 0 2024-09-17T01:51:56.785 INFO:tasks.workunit.client.0.smithi031.stdout:3/90: mknod db/c1a 0 2024-09-17T01:51:56.787 INFO:tasks.workunit.client.0.smithi031.stdout:6/222: rename d23/f48 to d23/d33/f4a 0 2024-09-17T01:51:56.789 INFO:tasks.workunit.client.0.smithi031.stdout:1/195: creat d4/d1e/d3f/f44 x:0 0 0 2024-09-17T01:51:56.790 INFO:tasks.workunit.client.0.smithi031.stdout:3/91: write db/f12 [84978,113714] 0 2024-09-17T01:51:56.793 INFO:tasks.workunit.client.0.smithi031.stdout:4/160: dwrite d8/d22/f2e [0,4194304] 0 2024-09-17T01:51:56.793 INFO:tasks.workunit.client.0.smithi031.stdout:4/161: fsync d8/f16 0 2024-09-17T01:51:56.795 INFO:tasks.workunit.client.0.smithi031.stdout:3/92: fdatasync f9 0 2024-09-17T01:51:56.799 INFO:tasks.workunit.client.0.smithi031.stdout:1/196: link d4/l5 d4/d1e/l45 0 2024-09-17T01:51:56.800 INFO:tasks.workunit.client.0.smithi031.stdout:1/197: write d4/d1e/f3b [795278,60842] 0 2024-09-17T01:51:56.802 INFO:tasks.workunit.client.0.smithi031.stdout:1/198: stat d4/d1a/d2d/d18/c2a 0 2024-09-17T01:51:56.808 INFO:tasks.workunit.client.0.smithi031.stdout:3/93: link f7 db/df/f1b 0 2024-09-17T01:51:56.814 INFO:tasks.workunit.client.0.smithi031.stdout:6/223: mknod d23/c4b 0 2024-09-17T01:51:56.814 INFO:tasks.workunit.client.0.smithi031.stdout:1/199: dwrite d4/d1a/d2d/d18/f1b [0,4194304] 0 2024-09-17T01:51:56.817 INFO:tasks.workunit.client.0.smithi031.stdout:1/200: mknod d4/d1e/d3f/c46 0 2024-09-17T01:51:56.817 INFO:tasks.workunit.client.0.smithi031.stdout:4/162: truncate d8/f27 3715709 0 2024-09-17T01:51:56.818 INFO:tasks.workunit.client.0.smithi031.stdout:4/163: chown d8/d18/f29 120161 1 2024-09-17T01:51:56.821 INFO:tasks.workunit.client.0.smithi031.stdout:3/94: truncate f6 48281 0 2024-09-17T01:51:56.824 INFO:tasks.workunit.client.0.smithi031.stdout:1/201: rename d4/f11 to d4/d1e/f47 0 2024-09-17T01:51:56.825 INFO:tasks.workunit.client.0.smithi031.stdout:1/202: stat d4/d1a/d2d/l24 0 2024-09-17T01:51:56.825 INFO:tasks.workunit.client.0.smithi031.stdout:6/224: creat d23/d33/d47/f4c x:0 0 0 2024-09-17T01:51:56.827 INFO:tasks.workunit.client.0.smithi031.stdout:3/95: mkdir db/df/d1c 0 2024-09-17T01:51:56.827 INFO:tasks.workunit.client.0.smithi031.stdout:4/164: dwrite d8/d18/f21 [0,4194304] 0 2024-09-17T01:51:56.833 INFO:tasks.workunit.client.0.smithi031.stdout:6/225: rmdir d23 39 2024-09-17T01:51:56.833 INFO:tasks.workunit.client.0.smithi031.stdout:3/96: mkdir db/df/d1d 0 2024-09-17T01:51:56.833 INFO:tasks.workunit.client.0.smithi031.stdout:3/97: chown db/f11 109182 1 2024-09-17T01:51:56.834 INFO:tasks.workunit.client.0.smithi031.stdout:4/165: dread d8/d18/f21 [0,4194304] 0 2024-09-17T01:51:56.836 INFO:tasks.workunit.client.0.smithi031.stdout:4/166: write d8/d18/f29 [903893,60919] 0 2024-09-17T01:51:56.840 INFO:tasks.workunit.client.0.smithi031.stdout:3/98: fdatasync db/df/f1b 0 2024-09-17T01:51:56.841 INFO:tasks.workunit.client.0.smithi031.stdout:3/99: readlink db/df/l18 0 2024-09-17T01:51:56.844 INFO:tasks.workunit.client.0.smithi031.stdout:1/203: link d4/d1a/c23 d4/d1e/d3f/c48 0 2024-09-17T01:51:56.844 INFO:tasks.workunit.client.0.smithi031.stdout:1/204: stat c0 0 2024-09-17T01:51:56.845 INFO:tasks.workunit.client.0.smithi031.stdout:1/205: stat d4/d1a/d2d/d18 0 2024-09-17T01:51:56.848 INFO:tasks.workunit.client.0.smithi031.stdout:3/100: creat db/df/f1e x:0 0 0 2024-09-17T01:51:56.849 INFO:tasks.workunit.client.0.smithi031.stdout:3/101: fdatasync db/df/f1e 0 2024-09-17T01:51:56.850 INFO:tasks.workunit.client.0.smithi031.stdout:1/206: unlink d4/d1a/d2d/d18/c2a 0 2024-09-17T01:51:56.853 INFO:tasks.workunit.client.0.smithi031.stdout:6/226: dread f20 [0,4194304] 0 2024-09-17T01:51:56.854 INFO:tasks.workunit.client.0.smithi031.stdout:1/207: rename d4/d1a/d2d/f15 to d4/d1e/f49 0 2024-09-17T01:51:56.858 INFO:tasks.workunit.client.0.smithi031.stdout:6/227: fsync d23/f26 0 2024-09-17T01:51:56.863 INFO:tasks.workunit.client.0.smithi031.stdout:1/208: dwrite d4/d1a/d2d/f16 [0,4194304] 0 2024-09-17T01:51:56.864 INFO:tasks.workunit.client.0.smithi031.stdout:6/228: symlink d23/d33/d47/l4d 0 2024-09-17T01:51:56.865 INFO:tasks.workunit.client.0.smithi031.stdout:1/209: creat d4/f4a x:0 0 0 2024-09-17T01:51:56.865 INFO:tasks.workunit.client.0.smithi031.stdout:3/102: dread db/f11 [0,4194304] 0 2024-09-17T01:51:56.866 INFO:tasks.workunit.client.0.smithi031.stdout:6/229: symlink d23/l4e 0 2024-09-17T01:51:56.867 INFO:tasks.workunit.client.0.smithi031.stdout:9/149: sync 2024-09-17T01:51:56.868 INFO:tasks.workunit.client.0.smithi031.stdout:7/109: sync 2024-09-17T01:51:56.869 INFO:tasks.workunit.client.0.smithi031.stdout:9/150: chown l0 11 1 2024-09-17T01:51:56.870 INFO:tasks.workunit.client.0.smithi031.stdout:9/151: write d3/d19/f22 [951943,46866] 0 2024-09-17T01:51:56.873 INFO:tasks.workunit.client.0.smithi031.stdout:1/210: unlink d4/d1a/d2d/f16 0 2024-09-17T01:51:56.875 INFO:tasks.workunit.client.0.smithi031.stdout:9/152: unlink d3/f25 0 2024-09-17T01:51:56.877 INFO:tasks.workunit.client.0.smithi031.stdout:6/230: unlink d23/l2f 0 2024-09-17T01:51:56.877 INFO:tasks.workunit.client.0.smithi031.stdout:6/231: read - d23/d33/f34 zero size 2024-09-17T01:51:56.879 INFO:tasks.workunit.client.0.smithi031.stdout:9/153: creat d3/d19/f30 x:0 0 0 2024-09-17T01:51:56.881 INFO:tasks.workunit.client.0.smithi031.stdout:7/110: link db/fe db/f1f 0 2024-09-17T01:51:56.882 INFO:tasks.workunit.client.0.smithi031.stdout:6/232: creat d23/d33/f4f x:0 0 0 2024-09-17T01:51:56.883 INFO:tasks.workunit.client.0.smithi031.stdout:7/111: fsync db/f15 0 2024-09-17T01:51:56.885 INFO:tasks.workunit.client.0.smithi031.stdout:1/211: getdents d4/d1e 0 2024-09-17T01:51:56.889 INFO:tasks.workunit.client.0.smithi031.stdout:1/212: write d4/d1a/d2d/d18/f26 [1234058,47739] 0 2024-09-17T01:51:56.889 INFO:tasks.workunit.client.0.smithi031.stdout:9/154: dwrite d3/d19/f30 [0,4194304] 0 2024-09-17T01:51:56.891 INFO:tasks.workunit.client.0.smithi031.stdout:6/233: unlink d23/d33/f38 0 2024-09-17T01:51:56.891 INFO:tasks.workunit.client.0.smithi031.stdout:1/213: chown d4/d1e/f49 2190 1 2024-09-17T01:51:56.897 INFO:tasks.workunit.client.0.smithi031.stdout:6/234: chown d23/f30 42661414 1 2024-09-17T01:51:56.899 INFO:tasks.workunit.client.0.smithi031.stdout:7/112: dwrite db/f15 [4194304,4194304] 0 2024-09-17T01:51:56.901 INFO:tasks.workunit.client.0.smithi031.stdout:7/113: write db/f15 [4808181,115182] 0 2024-09-17T01:51:56.904 INFO:tasks.workunit.client.0.smithi031.stdout:6/235: truncate d23/f39 963940 0 2024-09-17T01:51:56.912 INFO:tasks.workunit.client.0.smithi031.stdout:7/114: rename ca to db/d18/c20 0 2024-09-17T01:51:56.913 INFO:tasks.workunit.client.0.smithi031.stdout:7/115: truncate db/f1f 5573744 0 2024-09-17T01:51:56.914 INFO:tasks.workunit.client.0.smithi031.stdout:1/214: dread d4/d1a/d2d/fa [0,4194304] 0 2024-09-17T01:51:56.914 INFO:tasks.workunit.client.0.smithi031.stdout:7/116: fsync db/f1a 0 2024-09-17T01:51:56.917 INFO:tasks.workunit.client.0.smithi031.stdout:6/236: mkdir d23/d50 0 2024-09-17T01:51:56.919 INFO:tasks.workunit.client.0.smithi031.stdout:7/117: chown db/ld 15 1 2024-09-17T01:51:56.921 INFO:tasks.workunit.client.0.smithi031.stdout:1/215: truncate d4/f10 588950 0 2024-09-17T01:51:56.921 INFO:tasks.workunit.client.0.smithi031.stdout:1/216: fsync f3 0 2024-09-17T01:51:56.923 INFO:tasks.workunit.client.0.smithi031.stdout:1/217: read f3 [166056,9002] 0 2024-09-17T01:51:56.924 INFO:tasks.workunit.client.0.smithi031.stdout:7/118: dread db/f1a [0,4194304] 0 2024-09-17T01:51:56.924 INFO:tasks.workunit.client.0.smithi031.stdout:7/119: fsync db/f1a 0 2024-09-17T01:51:56.929 INFO:tasks.workunit.client.0.smithi031.stdout:9/155: link d3/d4/d29/f2b d3/d4/d29/f31 0 2024-09-17T01:51:56.930 INFO:tasks.workunit.client.0.smithi031.stdout:1/218: fdatasync d4/d1e/f47 0 2024-09-17T01:51:56.931 INFO:tasks.workunit.client.0.smithi031.stdout:7/120: dwrite db/f1b [0,4194304] 0 2024-09-17T01:51:56.932 INFO:tasks.workunit.client.0.smithi031.stdout:9/156: chown d3/d19/f22 1697613968 1 2024-09-17T01:51:56.934 INFO:tasks.workunit.client.0.smithi031.stdout:9/157: write d3/d19/f30 [1997952,23343] 0 2024-09-17T01:51:56.935 INFO:tasks.workunit.client.0.smithi031.stdout:1/219: creat d4/d1e/f4b x:0 0 0 2024-09-17T01:51:56.936 INFO:tasks.workunit.client.0.smithi031.stdout:9/158: readlink d3/d10/l26 0 2024-09-17T01:51:56.937 INFO:tasks.workunit.client.0.smithi031.stdout:7/121: creat db/d1c/f21 x:0 0 0 2024-09-17T01:51:56.939 INFO:tasks.workunit.client.0.smithi031.stdout:7/122: write db/f1b [3880428,86115] 0 2024-09-17T01:51:56.947 INFO:tasks.workunit.client.0.smithi031.stdout:7/123: dread db/f1b [0,4194304] 0 2024-09-17T01:51:56.947 INFO:tasks.workunit.client.0.smithi031.stdout:6/237: dwrite f19 [0,4194304] 0 2024-09-17T01:51:56.950 INFO:tasks.workunit.client.0.smithi031.stdout:9/159: dread - d3/d4/d29/f31 zero size 2024-09-17T01:51:56.955 INFO:tasks.workunit.client.0.smithi031.stdout:1/220: write d4/d1a/d2d/fe [243310,23360] 0 2024-09-17T01:51:56.956 INFO:tasks.workunit.client.0.smithi031.stdout:7/124: dread db/f16 [0,4194304] 0 2024-09-17T01:51:56.956 INFO:tasks.workunit.client.0.smithi031.stdout:6/238: chown d23/f35 0 1 2024-09-17T01:51:56.959 INFO:tasks.workunit.client.0.smithi031.stdout:7/125: rmdir db 39 2024-09-17T01:51:56.961 INFO:tasks.workunit.client.0.smithi031.stdout:9/160: symlink d3/l32 0 2024-09-17T01:51:56.963 INFO:tasks.workunit.client.0.smithi031.stdout:7/126: chown db/fe 1040429 1 2024-09-17T01:51:56.965 INFO:tasks.workunit.client.0.smithi031.stdout:9/161: read d3/d10/f1a [909771,73756] 0 2024-09-17T01:51:56.966 INFO:tasks.workunit.client.0.smithi031.stdout:6/239: getdents d23/d33 0 2024-09-17T01:51:56.968 INFO:tasks.workunit.client.0.smithi031.stdout:9/162: write d3/d19/f30 [4262633,124209] 0 2024-09-17T01:51:56.969 INFO:tasks.workunit.client.0.smithi031.stdout:6/240: mknod d23/c51 0 2024-09-17T01:51:56.971 INFO:tasks.workunit.client.0.smithi031.stdout:7/127: dwrite db/f15 [0,4194304] 0 2024-09-17T01:51:56.971 INFO:tasks.workunit.client.0.smithi031.stdout:9/163: stat d3/d10/f14 0 2024-09-17T01:51:56.972 INFO:tasks.workunit.client.0.smithi031.stdout:6/241: readlink d23/l2d 0 2024-09-17T01:51:56.973 INFO:tasks.workunit.client.0.smithi031.stdout:6/242: chown d23/d33/f34 120511599 1 2024-09-17T01:51:56.976 INFO:tasks.workunit.client.0.smithi031.stdout:9/164: getdents d3/d4 0 2024-09-17T01:51:56.980 INFO:tasks.workunit.client.0.smithi031.stdout:6/243: write f1c [244009,5229] 0 2024-09-17T01:51:56.988 INFO:tasks.workunit.client.0.smithi031.stdout:6/244: dwrite d23/f3d [0,4194304] 0 2024-09-17T01:51:56.996 INFO:tasks.workunit.client.0.smithi031.stdout:9/165: dread d3/d10/f14 [4194304,4194304] 0 2024-09-17T01:51:56.997 INFO:tasks.workunit.client.0.smithi031.stdout:6/245: dwrite d23/f39 [0,4194304] 0 2024-09-17T01:51:57.019 INFO:tasks.workunit.client.0.smithi031.stdout:6/246: dread f5 [0,4194304] 0 2024-09-17T01:51:57.020 INFO:tasks.workunit.client.0.smithi031.stdout:6/247: fsync f20 0 2024-09-17T01:51:57.024 INFO:tasks.workunit.client.0.smithi031.stdout:9/166: dread d3/f8 [0,4194304] 0 2024-09-17T01:51:57.025 INFO:tasks.workunit.client.0.smithi031.stdout:6/248: link c9 d23/d50/c52 0 2024-09-17T01:51:57.025 INFO:tasks.workunit.client.0.smithi031.stdout:9/167: dread d3/fb [0,4194304] 0 2024-09-17T01:51:57.026 INFO:tasks.workunit.client.0.smithi031.stdout:9/168: readlink d3/l32 0 2024-09-17T01:51:57.031 INFO:tasks.workunit.client.0.smithi031.stdout:9/169: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:51:57.039 INFO:tasks.workunit.client.0.smithi031.stdout:9/170: dwrite d3/d4/f2f [0,4194304] 0 2024-09-17T01:51:57.050 INFO:tasks.workunit.client.0.smithi031.stdout:9/171: symlink d3/d4/d29/l33 0 2024-09-17T01:51:57.050 INFO:tasks.workunit.client.0.smithi031.stdout:9/172: chown d3/d4/f5 22407366 1 2024-09-17T01:51:57.050 INFO:tasks.workunit.client.0.smithi031.stdout:9/173: unlink d3/d10/c1c 0 2024-09-17T01:51:57.051 INFO:tasks.workunit.client.0.smithi031.stdout:9/174: dread d3/d19/f30 [0,4194304] 0 2024-09-17T01:51:57.147 INFO:tasks.workunit.client.0.smithi031.stdout:0/135: sync 2024-09-17T01:51:57.148 INFO:tasks.workunit.client.0.smithi031.stdout:8/223: sync 2024-09-17T01:51:57.148 INFO:tasks.workunit.client.0.smithi031.stdout:5/182: sync 2024-09-17T01:51:57.148 INFO:tasks.workunit.client.0.smithi031.stdout:2/219: sync 2024-09-17T01:51:57.149 INFO:tasks.workunit.client.0.smithi031.stdout:2/220: write d1/f23 [980800,24157] 0 2024-09-17T01:51:57.150 INFO:tasks.workunit.client.0.smithi031.stdout:2/221: read d1/f23 [1537367,33533] 0 2024-09-17T01:51:57.152 INFO:tasks.workunit.client.0.smithi031.stdout:0/136: mkdir d0/dc/d2a/d25/d30 0 2024-09-17T01:51:57.153 INFO:tasks.workunit.client.0.smithi031.stdout:8/224: dread d0/d5/f2f [0,4194304] 0 2024-09-17T01:51:57.154 INFO:tasks.workunit.client.0.smithi031.stdout:5/183: creat da/dc/d10/d12/f41 x:0 0 0 2024-09-17T01:51:57.155 INFO:tasks.workunit.client.0.smithi031.stdout:5/184: read f4 [2556027,87871] 0 2024-09-17T01:51:57.159 INFO:tasks.workunit.client.0.smithi031.stdout:8/225: write d0/f28 [170251,73015] 0 2024-09-17T01:51:57.162 INFO:tasks.workunit.client.0.smithi031.stdout:5/185: stat da/dc/d10/d12/c2f 0 2024-09-17T01:51:57.166 INFO:tasks.workunit.client.0.smithi031.stdout:8/226: creat d0/d5/f40 x:0 0 0 2024-09-17T01:51:57.167 INFO:tasks.workunit.client.0.smithi031.stdout:0/137: dread d0/f21 [0,4194304] 0 2024-09-17T01:51:57.167 INFO:tasks.workunit.client.0.smithi031.stdout:2/222: creat d1/d3/df/d18/d40/d43/f50 x:0 0 0 2024-09-17T01:51:57.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.171+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5c8005cc0 con 0x7fb5e40ff130 2024-09-17T01:51:57.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.172+0000 7fb5db7fe700 1 -- 172.21.15.31:0/2608041405 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7fb5e005f100 con 0x7fb5e40ff130 2024-09-17T01:51:57.171 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:51:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:51:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:51:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-17T01:51:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:51:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:51:57.173 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:51:57.173 INFO:tasks.workunit.client.0.smithi031.stdout:8/227: creat d0/df/d19/d3d/f41 x:0 0 0 2024-09-17T01:51:57.173 INFO:tasks.workunit.client.0.smithi031.stdout:2/223: symlink d1/d3/d2d/l51 0 2024-09-17T01:51:57.173 INFO:tasks.workunit.client.0.smithi031.stdout:5/186: dwrite da/dc/f3a [0,4194304] 0 2024-09-17T01:51:57.174 INFO:tasks.workunit.client.0.smithi031.stdout:8/228: dread - d0/df/d19/d3d/f3e zero size 2024-09-17T01:51:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.175+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fb5d006d5f0 msgr2=0x7fb5d006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.175+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fb5d006d5f0 0x7fb5d006faa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009c60 tx=0x7fb5d4009260 comp rx=0 tx=0).stop 2024-09-17T01:51:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.175+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 msgr2=0x7fb5e4193860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.175+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e4193860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00092e0 tx=0x7fb5e001ca50 comp rx=0 tx=0).stop 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 shutdown_connections 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fb5d006d5f0 0x7fb5d006faa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e40ff130 0x7fb5e4193860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 --2- 172.21.15.31:0/2608041405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5e41003d0 0x7fb5e4193da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 >> 172.21.15.31:0/2608041405 conn(0x7fb5e40fa780 msgr2=0x7fb5e4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 shutdown_connections 2024-09-17T01:51:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.176+0000 7fb5ec33f700 1 -- 172.21.15.31:0/2608041405 wait complete. 2024-09-17T01:51:57.177 INFO:tasks.workunit.client.0.smithi031.stdout:2/224: mknod d1/d3/df/c52 0 2024-09-17T01:51:57.177 INFO:tasks.workunit.client.0.smithi031.stdout:8/229: dread d0/df/d19/f29 [0,4194304] 0 2024-09-17T01:51:57.179 INFO:tasks.workunit.client.0.smithi031.stdout:5/187: unlink da/d14/c1a 0 2024-09-17T01:51:57.180 INFO:tasks.workunit.client.0.smithi031.stdout:5/188: read - da/dc/d10/f37 zero size 2024-09-17T01:51:57.182 INFO:tasks.workunit.client.0.smithi031.stdout:0/138: link d0/d29/c2f d0/dc/d2a/d25/d30/c31 0 2024-09-17T01:51:57.183 INFO:tasks.workunit.client.0.smithi031.stdout:5/189: read da/dc/d10/d12/f19 [508358,44775] 0 2024-09-17T01:51:57.183 INFO:tasks.workunit.client.0.smithi031.stdout:2/225: mknod d1/d3/df/d11/c53 0 2024-09-17T01:51:57.190 INFO:tasks.workunit.client.0.smithi031.stdout:5/190: dwrite da/d14/f3c [0,4194304] 0 2024-09-17T01:51:57.192 INFO:tasks.workunit.client.0.smithi031.stdout:0/139: rename d0/dc/d5/l22 to d0/dc/d5/l32 0 2024-09-17T01:51:57.198 INFO:tasks.workunit.client.0.smithi031.stdout:5/191: unlink da/dc/d10/f37 0 2024-09-17T01:51:57.200 INFO:tasks.workunit.client.0.smithi031.stdout:0/140: dwrite d0/dc/d2a/d25/f27 [0,4194304] 0 2024-09-17T01:51:57.202 INFO:tasks.workunit.client.0.smithi031.stdout:5/192: truncate da/dc/d10/d26/f39 133751 0 2024-09-17T01:51:57.203 INFO:tasks.workunit.client.0.smithi031.stdout:5/193: chown c6 30 1 2024-09-17T01:51:57.205 INFO:tasks.workunit.client.0.smithi031.stdout:5/194: fdatasync da/f11 0 2024-09-17T01:51:57.207 INFO:tasks.workunit.client.0.smithi031.stdout:4/167: sync 2024-09-17T01:51:57.212 INFO:tasks.workunit.client.0.smithi031.stdout:4/168: creat d8/d18/f2f x:0 0 0 2024-09-17T01:51:57.212 INFO:tasks.workunit.client.0.smithi031.stdout:2/226: dwrite d1/d3/fd [0,4194304] 0 2024-09-17T01:51:57.213 INFO:tasks.workunit.client.0.smithi031.stdout:5/195: truncate da/f11 290926 0 2024-09-17T01:51:57.214 INFO:tasks.workunit.client.0.smithi031.stdout:0/141: rename d0/dc to d0/d29/d33 0 2024-09-17T01:51:57.220 INFO:tasks.workunit.client.0.smithi031.stdout:4/169: unlink f7 0 2024-09-17T01:51:57.221 INFO:tasks.workunit.client.0.smithi031.stdout:8/230: write d0/df/dd/f2d [530973,37277] 0 2024-09-17T01:51:57.221 INFO:tasks.workunit.client.0.smithi031.stdout:2/227: mknod d1/d3/d45/c54 0 2024-09-17T01:51:57.221 INFO:tasks.workunit.client.0.smithi031.stdout:4/170: dread - d8/d22/d25/f26 zero size 2024-09-17T01:51:57.221 INFO:tasks.workunit.client.0.smithi031.stdout:4/171: chown d8/d18/f24 7579 1 2024-09-17T01:51:57.223 INFO:tasks.workunit.client.0.smithi031.stdout:5/196: rename da/dc/d10 to da/d42 0 2024-09-17T01:51:57.225 INFO:tasks.workunit.client.0.smithi031.stdout:0/142: creat d0/f34 x:0 0 0 2024-09-17T01:51:57.227 INFO:tasks.workunit.client.0.smithi031.stdout:2/228: chown d1/d3/df/f2b 13 1 2024-09-17T01:51:57.228 INFO:tasks.workunit.client.0.smithi031.stdout:4/172: creat d8/d22/f30 x:0 0 0 2024-09-17T01:51:57.230 INFO:tasks.workunit.client.0.smithi031.stdout:0/143: write d0/f21 [4868412,105404] 0 2024-09-17T01:51:57.231 INFO:tasks.workunit.client.0.smithi031.stdout:5/197: dread da/d14/f3c [0,4194304] 0 2024-09-17T01:51:57.233 INFO:tasks.workunit.client.0.smithi031.stdout:2/229: creat d1/d3/d2d/f55 x:0 0 0 2024-09-17T01:51:57.235 INFO:tasks.workunit.client.0.smithi031.stdout:8/231: dwrite d0/d5/fa [0,4194304] 0 2024-09-17T01:51:57.237 INFO:tasks.workunit.client.0.smithi031.stdout:0/144: dread d0/d29/d33/d5/f15 [0,4194304] 0 2024-09-17T01:51:57.239 INFO:tasks.workunit.client.0.smithi031.stdout:0/145: chown d0/d29/d33/f11 372 1 2024-09-17T01:51:57.243 INFO:tasks.workunit.client.0.smithi031.stdout:5/198: dwrite da/d14/f1d [0,4194304] 0 2024-09-17T01:51:57.243 INFO:tasks.workunit.client.0.smithi031.stdout:2/230: mkdir d1/d3/df/d11/d44/d56 0 2024-09-17T01:51:57.246 INFO:tasks.workunit.client.0.smithi031.stdout:5/199: write da/dc/f3a [4513352,32150] 0 2024-09-17T01:51:57.246 INFO:tasks.workunit.client.0.smithi031.stdout:8/232: creat d0/f42 x:0 0 0 2024-09-17T01:51:57.249 INFO:tasks.workunit.client.0.smithi031.stdout:4/173: rmdir d8 39 2024-09-17T01:51:57.250 INFO:tasks.workunit.client.0.smithi031.stdout:3/103: sync 2024-09-17T01:51:57.253 INFO:tasks.workunit.client.0.smithi031.stdout:8/233: truncate d0/df/f39 464965 0 2024-09-17T01:51:57.260 INFO:tasks.workunit.client.0.smithi031.stdout:2/231: dwrite d1/d3/d2d/f41 [0,4194304] 0 2024-09-17T01:51:57.260 INFO:tasks.workunit.client.0.smithi031.stdout:8/234: creat d0/d5/f43 x:0 0 0 2024-09-17T01:51:57.260 INFO:tasks.workunit.client.0.smithi031.stdout:4/174: fsync d8/f11 0 2024-09-17T01:51:57.261 INFO:tasks.workunit.client.0.smithi031.stdout:0/146: link d0/f34 d0/d29/d33/f35 0 2024-09-17T01:51:57.264 INFO:tasks.workunit.client.0.smithi031.stdout:3/104: dwrite db/f19 [0,4194304] 0 2024-09-17T01:51:57.268 INFO:tasks.workunit.client.0.smithi031.stdout:3/105: creat db/f1f x:0 0 0 2024-09-17T01:51:57.272 INFO:tasks.workunit.client.0.smithi031.stdout:0/147: rename d0/l2d to d0/d29/l36 0 2024-09-17T01:51:57.275 INFO:tasks.workunit.client.0.smithi031.stdout:2/232: creat d1/d3/d45/d4a/f57 x:0 0 0 2024-09-17T01:51:57.275 INFO:tasks.workunit.client.0.smithi031.stdout:0/148: stat d0/d29/d33/d5/c12 0 2024-09-17T01:51:57.276 INFO:tasks.workunit.client.0.smithi031.stdout:5/200: dwrite f5 [0,4194304] 0 2024-09-17T01:51:57.279 INFO:tasks.workunit.client.0.smithi031.stdout:2/233: dread d1/d3/df/d11/f13 [0,4194304] 0 2024-09-17T01:51:57.281 INFO:tasks.workunit.client.0.smithi031.stdout:8/235: getdents d0/df/d19/d3d 0 2024-09-17T01:51:57.282 INFO:tasks.workunit.client.0.smithi031.stdout:0/149: mkdir d0/d37 0 2024-09-17T01:51:57.284 INFO:tasks.workunit.client.0.smithi031.stdout:5/201: symlink da/dc/d25/l43 0 2024-09-17T01:51:57.285 INFO:tasks.workunit.client.0.smithi031.stdout:5/202: write f8 [1561315,73216] 0 2024-09-17T01:51:57.285 INFO:tasks.workunit.client.0.smithi031.stdout:8/236: mknod d0/df/dd/c44 0 2024-09-17T01:51:57.288 INFO:tasks.workunit.client.0.smithi031.stdout:0/150: chown d0/d29/d33/d5/l32 164477982 1 2024-09-17T01:51:57.289 INFO:tasks.workunit.client.0.smithi031.stdout:2/234: symlink d1/d3/df/d19/d1e/d4f/l58 0 2024-09-17T01:51:57.291 INFO:tasks.workunit.client.0.smithi031.stdout:3/106: write db/df/f1b [3006152,106271] 0 2024-09-17T01:51:57.293 INFO:tasks.workunit.client.0.smithi031.stdout:8/237: unlink d0/df/d19/f1e 0 2024-09-17T01:51:57.294 INFO:tasks.workunit.client.0.smithi031.stdout:4/175: truncate d8/d18/f21 2544385 0 2024-09-17T01:51:57.294 INFO:tasks.workunit.client.0.smithi031.stdout:0/151: fsync d0/d29/d33/d2a/d25/f26 0 2024-09-17T01:51:57.295 INFO:tasks.workunit.client.0.smithi031.stdout:4/176: readlink d8/l20 0 2024-09-17T01:51:57.295 INFO:tasks.workunit.client.0.smithi031.stdout:3/107: mknod db/c20 0 2024-09-17T01:51:57.297 INFO:tasks.workunit.client.0.smithi031.stdout:3/108: write db/f12 [1013328,98141] 0 2024-09-17T01:51:57.297 INFO:tasks.workunit.client.0.smithi031.stdout:0/152: dread d0/d29/d33/f13 [0,4194304] 0 2024-09-17T01:51:57.298 INFO:tasks.workunit.client.0.smithi031.stdout:3/109: fdatasync f7 0 2024-09-17T01:51:57.299 INFO:tasks.workunit.client.0.smithi031.stdout:0/153: dread - d0/f34 zero size 2024-09-17T01:51:57.299 INFO:tasks.workunit.client.0.smithi031.stdout:5/203: creat da/dc/f44 x:0 0 0 2024-09-17T01:51:57.301 INFO:tasks.workunit.client.0.smithi031.stdout:5/204: chown da/d42/d26 16499715 1 2024-09-17T01:51:57.308 INFO:tasks.workunit.client.0.smithi031.stdout:0/154: rmdir d0 39 2024-09-17T01:51:57.308 INFO:tasks.workunit.client.0.smithi031.stdout:5/205: dwrite da/d42/d26/f39 [0,4194304] 0 2024-09-17T01:51:57.316 INFO:tasks.workunit.client.0.smithi031.stdout:8/238: write d0/df/d19/f29 [1384675,127374] 0 2024-09-17T01:51:57.317 INFO:tasks.workunit.client.0.smithi031.stdout:4/177: dread d8/f16 [0,4194304] 0 2024-09-17T01:51:57.319 INFO:tasks.workunit.client.0.smithi031.stdout:5/206: dwrite da/d42/d12/f20 [0,4194304] 0 2024-09-17T01:51:57.320 INFO:tasks.workunit.client.0.smithi031.stdout:8/239: truncate d0/df/f2b 1019637 0 2024-09-17T01:51:57.321 INFO:tasks.workunit.client.0.smithi031.stdout:2/235: truncate d1/d3/f1c 2949392 0 2024-09-17T01:51:57.322 INFO:tasks.workunit.client.0.smithi031.stdout:0/155: chown d0/d29/d33/d5/l32 9 1 2024-09-17T01:51:57.324 INFO:tasks.workunit.client.0.smithi031.stdout:2/236: write d1/d3/d2d/f46 [334979,46950] 0 2024-09-17T01:51:57.324 INFO:tasks.workunit.client.0.smithi031.stdout:5/207: chown da/d42/d26/f39 54 1 2024-09-17T01:51:57.325 INFO:tasks.workunit.client.0.smithi031.stdout:5/208: chown c6 0 1 2024-09-17T01:51:57.326 INFO:tasks.workunit.client.0.smithi031.stdout:3/110: getdents db/df 0 2024-09-17T01:51:57.327 INFO:tasks.workunit.client.0.smithi031.stdout:0/156: rmdir d0/d29/d33/d2a/d25/d30 39 2024-09-17T01:51:57.329 INFO:tasks.workunit.client.0.smithi031.stdout:3/111: write db/fe [464792,40759] 0 2024-09-17T01:51:57.330 INFO:tasks.workunit.client.0.smithi031.stdout:0/157: chown d0/d29/d33/d2a/d25/f26 1378 1 2024-09-17T01:51:57.330 INFO:tasks.workunit.client.0.smithi031.stdout:4/178: getdents d8/d22 0 2024-09-17T01:51:57.332 INFO:tasks.workunit.client.0.smithi031.stdout:2/237: mknod d1/d3/df/d19/d1e/d4f/c59 0 2024-09-17T01:51:57.333 INFO:tasks.workunit.client.0.smithi031.stdout:2/238: readlink d1/d3/df/d19/l3f 0 2024-09-17T01:51:57.335 INFO:tasks.workunit.client.0.smithi031.stdout:0/158: mkdir d0/d29/d33/d2a/d25/d38 0 2024-09-17T01:51:57.336 INFO:tasks.workunit.client.0.smithi031.stdout:3/112: dread db/f11 [0,4194304] 0 2024-09-17T01:51:57.337 INFO:tasks.workunit.client.0.smithi031.stdout:2/239: creat d1/d3/df/f5a x:0 0 0 2024-09-17T01:51:57.337 INFO:tasks.workunit.client.0.smithi031.stdout:5/209: getdents da/dc/d2e 0 2024-09-17T01:51:57.338 INFO:tasks.workunit.client.0.smithi031.stdout:3/113: write db/f19 [4050753,71835] 0 2024-09-17T01:51:57.340 INFO:tasks.workunit.client.0.smithi031.stdout:2/240: fdatasync d1/f23 0 2024-09-17T01:51:57.343 INFO:tasks.workunit.client.0.smithi031.stdout:0/159: creat d0/d29/d33/d2a/f39 x:0 0 0 2024-09-17T01:51:57.344 INFO:tasks.workunit.client.0.smithi031.stdout:3/114: truncate f9 1468369 0 2024-09-17T01:51:57.345 INFO:tasks.workunit.client.0.smithi031.stdout:2/241: creat d1/d3/df/f5b x:0 0 0 2024-09-17T01:51:57.346 INFO:tasks.workunit.client.0.smithi031.stdout:2/242: chown d1/d3/df/d19/d1e/d4f 11819034 1 2024-09-17T01:51:57.346 INFO:tasks.workunit.client.0.smithi031.stdout:5/210: link da/d14/f3b da/d42/d26/f45 0 2024-09-17T01:51:57.348 INFO:tasks.workunit.client.0.smithi031.stdout:0/160: rename d0/d29/d33/l2b to d0/d29/d33/d2a/d25/d38/l3a 0 2024-09-17T01:51:57.348 INFO:tasks.workunit.client.0.smithi031.stdout:5/211: read da/d42/d12/f19 [2204108,92017] 0 2024-09-17T01:51:57.348 INFO:tasks.workunit.client.0.smithi031.stdout:2/243: rmdir d1/d3/df/d11 39 2024-09-17T01:51:57.350 INFO:tasks.workunit.client.0.smithi031.stdout:5/212: mknod da/dc/d2e/c46 0 2024-09-17T01:51:57.352 INFO:tasks.workunit.client.0.smithi031.stdout:0/161: rename d0/d29/d33/d5/f1c to d0/d29/d33/d5/f3b 0 2024-09-17T01:51:57.353 INFO:tasks.workunit.client.0.smithi031.stdout:5/213: rmdir da/d42 39 2024-09-17T01:51:57.354 INFO:tasks.workunit.client.0.smithi031.stdout:2/244: symlink d1/d3/df/d19/d1e/l5c 0 2024-09-17T01:51:57.355 INFO:tasks.workunit.client.0.smithi031.stdout:0/162: creat d0/d29/d33/d5/f3c x:0 0 0 2024-09-17T01:51:57.356 INFO:tasks.workunit.client.0.smithi031.stdout:0/163: write d0/f1f [1846747,76792] 0 2024-09-17T01:51:57.357 INFO:tasks.workunit.client.0.smithi031.stdout:2/245: mkdir d1/d3/df/d18/d5d 0 2024-09-17T01:51:57.359 INFO:tasks.workunit.client.0.smithi031.stdout:0/164: write d0/d29/d33/d2a/d25/f26 [118976,73900] 0 2024-09-17T01:51:57.359 INFO:tasks.workunit.client.0.smithi031.stdout:5/214: getdents da 0 2024-09-17T01:51:57.360 INFO:tasks.workunit.client.0.smithi031.stdout:5/215: dread - da/dc/f3e zero size 2024-09-17T01:51:57.360 INFO:tasks.workunit.client.0.smithi031.stdout:2/246: creat d1/d3/df/d19/f5e x:0 0 0 2024-09-17T01:51:57.362 INFO:tasks.workunit.client.0.smithi031.stdout:0/165: symlink d0/d29/d33/d2a/d25/l3d 0 2024-09-17T01:51:57.364 INFO:tasks.workunit.client.0.smithi031.stdout:5/216: mknod da/d42/d12/c47 0 2024-09-17T01:51:57.365 INFO:tasks.workunit.client.0.smithi031.stdout:2/247: truncate d1/d3/df/d11/f13 1008508 0 2024-09-17T01:51:57.367 INFO:tasks.workunit.client.0.smithi031.stdout:0/166: link d0/d29/d33/d5/fa d0/d29/f3e 0 2024-09-17T01:51:57.368 INFO:tasks.workunit.client.0.smithi031.stdout:2/248: symlink d1/d3/df/d19/d1e/d21/d34/l5f 0 2024-09-17T01:51:57.370 INFO:tasks.workunit.client.0.smithi031.stdout:0/167: creat d0/d29/d33/d2a/d25/f3f x:0 0 0 2024-09-17T01:51:57.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 -- 172.21.15.31:0/2932929780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4103640 msgr2=0x7fc0f4103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2932929780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4103640 0x7fc0f4103a90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009910 tx=0x7fc0dc009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 -- 172.21.15.31:0/2932929780 shutdown_connections 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2932929780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4103640 0x7fc0f4103a90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2932929780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0f4102490 0x7fc0f41028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 -- 172.21.15.31:0/2932929780 >> 172.21.15.31:0/2932929780 conn(0x7fc0f40fda60 msgr2=0x7fc0f40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 -- 172.21.15.31:0/2932929780 shutdown_connections 2024-09-17T01:51:57.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.373+0000 7fc0fa759700 1 -- 172.21.15.31:0/2932929780 wait complete. 2024-09-17T01:51:57.372 INFO:tasks.workunit.client.0.smithi031.stdout:0/168: fdatasync d0/f34 0 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0fa759700 1 Processor -- start 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0fa759700 1 -- start start 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0fa759700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 0x7fc0f4197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0fa759700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0f4103640 0x7fc0f41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0fa759700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f41987f0 con 0x7fc0f4102490 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0fa759700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4198960 con 0x7fc0f4103640 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.374+0000 7fc0f3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 0x7fc0f4197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 0x7fc0f4197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39578/0 (socket says 172.21.15.31:39578) 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f3fff700 1 -- 172.21.15.31:0/2845510448 learned_addr learned my addr 172.21.15.31:0/2845510448 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:57.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0ebfff700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0f4103640 0x7fc0f41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f3fff700 1 -- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0f4103640 msgr2=0x7fc0f41981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f3fff700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0f4103640 0x7fc0f41981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f3fff700 1 -- 172.21.15.31:0/2845510448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0095f0 con 0x7fc0f4102490 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f3fff700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 0x7fc0f4197cb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400e8f0 tx=0x7fc0e400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e4009790 con 0x7fc0f4102490 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f419d3f0 con 0x7fc0f4102490 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.375+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0e400c810 con 0x7fc0f4102490 2024-09-17T01:51:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.376+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e4003c50 con 0x7fc0f4102490 2024-09-17T01:51:57.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.376+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f419d8b0 con 0x7fc0f4102490 2024-09-17T01:51:57.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.377+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f410af90 con 0x7fc0f4102490 2024-09-17T01:51:57.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.378+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7fc0e4018430 con 0x7fc0f4102490 2024-09-17T01:51:57.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.378+0000 7fc0f1ffb700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc0e006d600 0x7fc0e006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:57.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.378+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc0e4014070 con 0x7fc0f4102490 2024-09-17T01:51:57.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.378+0000 7fc0ebfff700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc0e006d600 0x7fc0e006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:57.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.379+0000 7fc0ebfff700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc0e006d600 0x7fc0e006fab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009fd0 tx=0x7fc0dc005940 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:57.379 INFO:tasks.workunit.client.0.smithi031.stdout:0/169: link d0/d29/c2f d0/d29/d33/d5/c40 0 2024-09-17T01:51:57.380 INFO:tasks.workunit.client.0.smithi031.stdout:0/170: truncate d0/d29/d33/d2a/f39 659508 0 2024-09-17T01:51:57.381 INFO:tasks.workunit.client.0.smithi031.stdout:0/171: dread d0/d29/d33/f13 [0,4194304] 0 2024-09-17T01:51:57.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.383+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc0e4056950 con 0x7fc0f4102490 2024-09-17T01:51:57.384 INFO:tasks.workunit.client.0.smithi031.stdout:0/172: creat d0/d29/d33/d2a/d25/d38/f41 x:0 0 0 2024-09-17T01:51:57.385 INFO:tasks.workunit.client.0.smithi031.stdout:0/173: write d0/d29/d33/d2a/f1e [1077275,63594] 0 2024-09-17T01:51:57.388 INFO:tasks.workunit.client.0.smithi031.stdout:0/174: symlink d0/l42 0 2024-09-17T01:51:57.390 INFO:tasks.workunit.client.0.smithi031.stdout:0/175: symlink d0/l43 0 2024-09-17T01:51:57.390 INFO:tasks.workunit.client.0.smithi031.stdout:0/176: dread - d0/f34 zero size 2024-09-17T01:51:57.405 INFO:tasks.workunit.client.0.smithi031.stdout:0/177: dread d0/d29/d33/f11 [0,4194304] 0 2024-09-17T01:51:57.408 INFO:tasks.workunit.client.0.smithi031.stdout:0/178: mkdir d0/d29/d44 0 2024-09-17T01:51:57.408 INFO:tasks.workunit.client.0.smithi031.stdout:0/179: dread - d0/f34 zero size 2024-09-17T01:51:57.410 INFO:tasks.workunit.client.0.smithi031.stdout:0/180: symlink d0/l45 0 2024-09-17T01:51:57.412 INFO:tasks.workunit.client.0.smithi031.stdout:0/181: symlink d0/d29/d33/l46 0 2024-09-17T01:51:57.413 INFO:tasks.workunit.client.0.smithi031.stdout:0/182: rmdir d0/d29 39 2024-09-17T01:51:57.414 INFO:tasks.workunit.client.0.smithi031.stdout:0/183: dread - d0/d29/d33/d5/f3c zero size 2024-09-17T01:51:57.415 INFO:tasks.workunit.client.0.smithi031.stdout:0/184: chown d0/d29/d33/d2a/f23 1 1 2024-09-17T01:51:57.418 INFO:tasks.workunit.client.0.smithi031.stdout:0/185: symlink d0/d29/d33/d2a/d25/l47 0 2024-09-17T01:51:57.419 INFO:tasks.workunit.client.0.smithi031.stdout:0/186: mkdir d0/d29/d33/d5/d48 0 2024-09-17T01:51:57.419 INFO:tasks.workunit.client.0.smithi031.stdout:0/187: stat d0/d29/d33/d5/f3c 0 2024-09-17T01:51:57.420 INFO:tasks.workunit.client.0.smithi031.stdout:0/188: chown d0/d29/d33 6 1 2024-09-17T01:51:57.425 INFO:tasks.workunit.client.0.smithi031.stdout:0/189: write d0/d29/f3e [1431328,87081] 0 2024-09-17T01:51:57.425 INFO:tasks.workunit.client.0.smithi031.stdout:0/190: dread - d0/f34 zero size 2024-09-17T01:51:57.429 INFO:tasks.workunit.client.0.smithi031.stdout:0/191: dwrite d0/d29/d33/d2a/f23 [0,4194304] 0 2024-09-17T01:51:57.434 INFO:tasks.workunit.client.0.smithi031.stdout:0/192: dwrite d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:51:57.436 INFO:tasks.workunit.client.0.smithi031.stdout:0/193: dread - d0/d29/d33/d2a/d25/d38/f41 zero size 2024-09-17T01:51:57.443 INFO:tasks.workunit.client.0.smithi031.stdout:0/194: dwrite d0/f19 [0,4194304] 0 2024-09-17T01:51:57.444 INFO:tasks.workunit.client.0.smithi031.stdout:0/195: read - d0/d29/d33/f35 zero size 2024-09-17T01:51:57.446 INFO:tasks.workunit.client.0.smithi031.stdout:0/196: unlink d0/d29/d33/d5/f15 0 2024-09-17T01:51:57.449 INFO:tasks.workunit.client.0.smithi031.stdout:0/197: chown d0/d29/d33/d5/c40 54126 1 2024-09-17T01:51:57.453 INFO:tasks.workunit.client.0.smithi031.stdout:0/198: dread d0/d29/d33/d2a/f23 [0,4194304] 0 2024-09-17T01:51:57.454 INFO:tasks.workunit.client.0.smithi031.stdout:0/199: read d0/d29/d33/d2a/d25/f27 [786762,51853] 0 2024-09-17T01:51:57.477 INFO:tasks.workunit.client.0.smithi031.stdout:6/249: sync 2024-09-17T01:51:57.477 INFO:tasks.workunit.client.0.smithi031.stdout:7/128: sync 2024-09-17T01:51:57.478 INFO:tasks.workunit.client.0.smithi031.stdout:9/175: sync 2024-09-17T01:51:57.478 INFO:tasks.workunit.client.0.smithi031.stdout:1/221: sync 2024-09-17T01:51:57.478 INFO:tasks.workunit.client.0.smithi031.stdout:1/222: readlink d4/d1a/d2d/lf 0 2024-09-17T01:51:57.479 INFO:tasks.workunit.client.0.smithi031.stdout:7/129: symlink db/d18/l22 0 2024-09-17T01:51:57.480 INFO:tasks.workunit.client.0.smithi031.stdout:6/250: fdatasync d23/f26 0 2024-09-17T01:51:57.485 INFO:tasks.workunit.client.0.smithi031.stdout:6/251: rename f6 to d23/d50/f53 0 2024-09-17T01:51:57.486 INFO:tasks.workunit.client.0.smithi031.stdout:7/130: symlink db/l23 0 2024-09-17T01:51:57.487 INFO:tasks.workunit.client.0.smithi031.stdout:1/223: truncate d4/f10 1189193 0 2024-09-17T01:51:57.489 INFO:tasks.workunit.client.0.smithi031.stdout:5/217: fsync da/d42/d12/f20 0 2024-09-17T01:51:57.504 INFO:tasks.workunit.client.0.smithi031.stdout:6/252: mknod d23/d50/c54 0 2024-09-17T01:51:57.504 INFO:tasks.workunit.client.0.smithi031.stdout:7/131: mknod db/d1c/c24 0 2024-09-17T01:51:57.506 INFO:tasks.workunit.client.0.smithi031.stdout:1/224: dread d4/d1a/f1d [0,4194304] 0 2024-09-17T01:51:57.506 INFO:tasks.workunit.client.0.smithi031.stdout:0/200: getdents d0/d29/d33/d2a 0 2024-09-17T01:51:57.506 INFO:tasks.workunit.client.0.smithi031.stdout:7/132: read db/f15 [3512024,109485] 0 2024-09-17T01:51:57.508 INFO:tasks.workunit.client.0.smithi031.stdout:6/253: readlink d23/l25 0 2024-09-17T01:51:57.514 INFO:tasks.workunit.client.0.smithi031.stdout:7/133: creat db/d18/f25 x:0 0 0 2024-09-17T01:51:57.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:57 smithi031 ceph-mon[27673]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:57.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:57 smithi031 ceph-mon[27673]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:57.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:57 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2608041405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:51:57.515 INFO:tasks.workunit.client.0.smithi031.stdout:6/254: dwrite d23/f3d [0,4194304] 0 2024-09-17T01:51:57.519 INFO:tasks.workunit.client.0.smithi031.stdout:0/201: mknod d0/d29/d33/c49 0 2024-09-17T01:51:57.521 INFO:tasks.workunit.client.0.smithi031.stdout:1/225: creat d4/d1a/d43/f4c x:0 0 0 2024-09-17T01:51:57.522 INFO:tasks.workunit.client.0.smithi031.stdout:1/226: readlink d4/l35 0 2024-09-17T01:51:57.525 INFO:tasks.workunit.client.0.smithi031.stdout:0/202: dread d0/d29/d33/d2a/f23 [0,4194304] 0 2024-09-17T01:51:57.526 INFO:tasks.workunit.client.0.smithi031.stdout:6/255: unlink f15 0 2024-09-17T01:51:57.529 INFO:tasks.workunit.client.0.smithi031.stdout:1/227: unlink d4/d1a/d2d/d18/f26 0 2024-09-17T01:51:57.533 INFO:tasks.workunit.client.0.smithi031.stdout:7/134: dread db/f1f [0,4194304] 0 2024-09-17T01:51:57.533 INFO:tasks.workunit.client.0.smithi031.stdout:1/228: read d4/d1a/d2d/f22 [988989,81179] 0 2024-09-17T01:51:57.537 INFO:tasks.workunit.client.0.smithi031.stdout:7/135: fsync db/f10 0 2024-09-17T01:51:57.538 INFO:tasks.workunit.client.0.smithi031.stdout:0/203: dwrite d0/d29/d33/d5/f3b [0,4194304] 0 2024-09-17T01:51:57.544 INFO:tasks.workunit.client.0.smithi031.stdout:7/136: write db/f15 [842477,57633] 0 2024-09-17T01:51:57.546 INFO:tasks.workunit.client.0.smithi031.stdout:7/137: symlink db/d18/l26 0 2024-09-17T01:51:57.554 INFO:tasks.workunit.client.0.smithi031.stdout:6/256: dread d23/d33/f3c [0,4194304] 0 2024-09-17T01:51:57.555 INFO:tasks.workunit.client.0.smithi031.stdout:7/138: dwrite db/f1a [4194304,4194304] 0 2024-09-17T01:51:57.560 INFO:tasks.workunit.client.0.smithi031.stdout:6/257: mkdir d23/d33/d47/d55 0 2024-09-17T01:51:57.563 INFO:tasks.workunit.client.0.smithi031.stdout:7/139: dwrite db/f15 [0,4194304] 0 2024-09-17T01:51:57.566 INFO:tasks.workunit.client.0.smithi031.stdout:5/218: truncate da/d42/d12/f23 2694661 0 2024-09-17T01:51:57.581 INFO:tasks.workunit.client.0.smithi031.stdout:1/229: dwrite d4/d1e/f42 [0,4194304] 0 2024-09-17T01:51:57.584 INFO:tasks.workunit.client.0.smithi031.stdout:5/219: truncate da/d42/d26/f34 3891154 0 2024-09-17T01:51:57.586 INFO:tasks.workunit.client.0.smithi031.stdout:5/220: write da/dc/f16 [783539,113564] 0 2024-09-17T01:51:57.587 INFO:tasks.workunit.client.0.smithi031.stdout:6/258: dwrite d23/f26 [0,4194304] 0 2024-09-17T01:51:57.594 INFO:tasks.workunit.client.0.smithi031.stdout:5/221: rename da/d14/c3f to da/d42/d12/c48 0 2024-09-17T01:51:57.596 INFO:tasks.workunit.client.0.smithi031.stdout:5/222: creat da/f49 x:0 0 0 2024-09-17T01:51:57.608 INFO:tasks.workunit.client.0.smithi031.stdout:6/259: dread f1d [0,4194304] 0 2024-09-17T01:51:57.614 INFO:tasks.workunit.client.0.smithi031.stdout:6/260: rename d23/f45 to d23/d33/f56 0 2024-09-17T01:51:57.619 INFO:tasks.workunit.client.0.smithi031.stdout:5/223: getdents da/dc 0 2024-09-17T01:51:57.621 INFO:tasks.workunit.client.0.smithi031.stdout:6/261: write d23/f2e [2720626,55712] 0 2024-09-17T01:51:57.623 INFO:tasks.workunit.client.0.smithi031.stdout:5/224: mkdir da/d42/d12/d4a 0 2024-09-17T01:51:57.624 INFO:tasks.workunit.client.0.smithi031.stdout:6/262: mknod d23/d33/c57 0 2024-09-17T01:51:57.625 INFO:tasks.workunit.client.0.smithi031.stdout:5/225: mkdir da/d4b 0 2024-09-17T01:51:57.627 INFO:tasks.workunit.client.0.smithi031.stdout:5/226: chown da/dc/l38 111 1 2024-09-17T01:51:57.629 INFO:tasks.workunit.client.0.smithi031.stdout:6/263: link d23/d33/d47/f4c d23/d50/f58 0 2024-09-17T01:51:57.630 INFO:tasks.workunit.client.0.smithi031.stdout:5/227: readlink da/l1e 0 2024-09-17T01:51:57.633 INFO:tasks.workunit.client.0.smithi031.stdout:5/228: creat da/dc/d2e/f4c x:0 0 0 2024-09-17T01:51:57.635 INFO:tasks.workunit.client.0.smithi031.stdout:6/264: rmdir d23/d33/d47/d55 0 2024-09-17T01:51:57.636 INFO:tasks.workunit.client.0.smithi031.stdout:5/229: creat da/d4b/f4d x:0 0 0 2024-09-17T01:51:57.638 INFO:tasks.workunit.client.0.smithi031.stdout:6/265: creat d23/d33/f59 x:0 0 0 2024-09-17T01:51:57.639 INFO:tasks.workunit.client.0.smithi031.stdout:5/230: rename da/dc/d2e/l40 to da/dc/l4e 0 2024-09-17T01:51:57.645 INFO:tasks.workunit.client.0.smithi031.stdout:6/266: rmdir d23 39 2024-09-17T01:51:57.648 INFO:tasks.workunit.client.0.smithi031.stdout:6/267: creat d23/d50/f5a x:0 0 0 2024-09-17T01:51:57.648 INFO:tasks.workunit.client.0.smithi031.stdout:6/268: stat f1d 0 2024-09-17T01:51:57.649 INFO:tasks.workunit.client.0.smithi031.stdout:6/269: dread - d23/d50/f5a zero size 2024-09-17T01:51:57.651 INFO:tasks.workunit.client.0.smithi031.stdout:6/270: unlink c21 0 2024-09-17T01:51:57.652 INFO:tasks.workunit.client.0.smithi031.stdout:6/271: truncate d23/f42 720882 0 2024-09-17T01:51:57.652 INFO:tasks.workunit.client.0.smithi031.stdout:6/272: dread - d23/d50/f5a zero size 2024-09-17T01:51:57.658 INFO:tasks.workunit.client.0.smithi031.stdout:6/273: dwrite d23/f26 [0,4194304] 0 2024-09-17T01:51:57.671 INFO:tasks.workunit.client.0.smithi031.stdout:6/274: dwrite d23/d33/f4a [0,4194304] 0 2024-09-17T01:51:57.675 INFO:tasks.workunit.client.0.smithi031.stdout:6/275: unlink d23/f43 0 2024-09-17T01:51:57.679 INFO:tasks.workunit.client.0.smithi031.stdout:6/276: creat d23/f5b x:0 0 0 2024-09-17T01:51:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:57 smithi092 ceph-mon[33552]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:57 smithi092 ceph-mon[33552]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:57 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2608041405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:51:57.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.747+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0f419dfb0 con 0x7fc0f4102490 2024-09-17T01:51:57.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.748+0000 7fc0f1ffb700 1 -- 172.21.15.31:0/2845510448 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1863 (secure 0 0 0) 0x7fc0e405a010 con 0x7fc0f4102490 2024-09-17T01:51:57.746 INFO:teuthology.orchestra.run.smithi031.stdout:e16 2024-09-17T01:51:57.746 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:51:57.746 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:51:57.746 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:51:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 16 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:51:19.622148+0000 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:51:57.747 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:51:57.748 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:57.749 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:57.749 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:57.749 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:51:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:51:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc0e006d600 msgr2=0x7fc0e006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc0e006d600 0x7fc0e006fab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009fd0 tx=0x7fc0dc005940 comp rx=0 tx=0).stop 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 msgr2=0x7fc0f4197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 0x7fc0f4197cb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400e8f0 tx=0x7fc0e400ec00 comp rx=0 tx=0).stop 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 shutdown_connections 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc0e006d600 0x7fc0e006fab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f4102490 0x7fc0f4197cb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 --2- 172.21.15.31:0/2845510448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0f4103640 0x7fc0f41981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 >> 172.21.15.31:0/2845510448 conn(0x7fc0f40fda60 msgr2=0x7fc0f4106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:57.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 shutdown_connections 2024-09-17T01:51:57.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.751+0000 7fc0fa759700 1 -- 172.21.15.31:0/2845510448 wait complete. 2024-09-17T01:51:57.751 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2024-09-17T01:51:57.832 INFO:tasks.workunit.client.0.smithi031.stdout:8/240: sync 2024-09-17T01:51:57.833 INFO:tasks.workunit.client.0.smithi031.stdout:8/241: creat d0/df/dd/f45 x:0 0 0 2024-09-17T01:51:57.834 INFO:tasks.workunit.client.0.smithi031.stdout:8/242: readlink d0/df/dd/l30 0 2024-09-17T01:51:57.835 INFO:tasks.workunit.client.0.smithi031.stdout:8/243: write d0/f42 [676020,78410] 0 2024-09-17T01:51:57.836 INFO:tasks.workunit.client.0.smithi031.stdout:8/244: dread - d0/df/dd/f45 zero size 2024-09-17T01:51:57.837 INFO:tasks.workunit.client.0.smithi031.stdout:8/245: fsync d0/df/f8 0 2024-09-17T01:51:57.839 INFO:tasks.workunit.client.0.smithi031.stdout:8/246: unlink d0/df/f39 0 2024-09-17T01:51:57.842 INFO:tasks.workunit.client.0.smithi031.stdout:8/247: creat d0/df/f46 x:0 0 0 2024-09-17T01:51:57.848 INFO:tasks.workunit.client.0.smithi031.stdout:8/248: dwrite d0/d5/f11 [0,4194304] 0 2024-09-17T01:51:57.851 INFO:tasks.workunit.client.0.smithi031.stdout:8/249: dread d0/d5/f2f [0,4194304] 0 2024-09-17T01:51:57.852 INFO:tasks.workunit.client.0.smithi031.stdout:8/250: chown d0/df/f8 1 1 2024-09-17T01:51:57.854 INFO:tasks.workunit.client.0.smithi031.stdout:8/251: symlink d0/df/d19/l47 0 2024-09-17T01:51:57.856 INFO:tasks.workunit.client.0.smithi031.stdout:8/252: symlink d0/l48 0 2024-09-17T01:51:57.856 INFO:tasks.workunit.client.0.smithi031.stdout:8/253: truncate d0/d5/fa 5037170 0 2024-09-17T01:51:57.858 INFO:tasks.workunit.client.0.smithi031.stdout:8/254: chown d0/df/l32 417 1 2024-09-17T01:51:57.861 INFO:tasks.workunit.client.0.smithi031.stdout:8/255: creat d0/df/d19/d3d/f49 x:0 0 0 2024-09-17T01:51:57.863 INFO:tasks.workunit.client.0.smithi031.stdout:8/256: symlink d0/df/d19/l4a 0 2024-09-17T01:51:57.867 INFO:tasks.workunit.client.0.smithi031.stdout:8/257: dread d0/d5/fa [0,4194304] 0 2024-09-17T01:51:57.869 INFO:tasks.workunit.client.0.smithi031.stdout:8/258: fdatasync d0/d5/fa 0 2024-09-17T01:51:57.869 INFO:tasks.workunit.client.0.smithi031.stdout:8/259: stat d0/df/d19/d3d/f3e 0 2024-09-17T01:51:57.870 INFO:tasks.workunit.client.0.smithi031.stdout:8/260: stat d0/d5/l24 0 2024-09-17T01:51:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.872+0000 7f3464378700 1 -- 172.21.15.31:0/740689707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fe500 msgr2=0x7f345c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.872+0000 7f3464378700 1 --2- 172.21.15.31:0/740689707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fe500 0x7f345c0fe910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3458009910 tx=0x7f3458009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 -- 172.21.15.31:0/740689707 shutdown_connections 2024-09-17T01:51:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 --2- 172.21.15.31:0/740689707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fee50 0x7f345c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 --2- 172.21.15.31:0/740689707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fe500 0x7f345c0fe910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 -- 172.21.15.31:0/740689707 >> 172.21.15.31:0/740689707 conn(0x7f345c0f9f10 msgr2=0x7f345c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 -- 172.21.15.31:0/740689707 shutdown_connections 2024-09-17T01:51:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 -- 172.21.15.31:0/740689707 wait complete. 2024-09-17T01:51:57.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 Processor -- start 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.873+0000 7f3464378700 1 -- start start 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3464378700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fe500 0x7f345c195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3464378700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 0x7f345c196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3464378700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c196690 con 0x7f345c0fee50 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3464378700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1967d0 con 0x7f345c0fe500 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3461913700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 0x7f345c196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3461913700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 0x7f345c196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39598/0 (socket says 172.21.15.31:39598) 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3461913700 1 -- 172.21.15.31:0/2562096425 learned_addr learned my addr 172.21.15.31:0/2562096425 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3462114700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fe500 0x7f345c195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3461913700 1 -- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fe500 msgr2=0x7f345c195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3461913700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fe500 0x7f345c195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3461913700 1 -- 172.21.15.31:0/2562096425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580095f0 con 0x7f345c0fee50 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.874+0000 7f3462114700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fe500 0x7f345c195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.875+0000 7f3461913700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 0x7f345c196070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c840 tx=0x7f344c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.875+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f344c0041f0 con 0x7f345c0fee50 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.875+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f344c004ce0 con 0x7f345c0fee50 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.875+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c19b280 con 0x7f345c0fee50 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.875+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f344c0076d0 con 0x7f345c0fee50 2024-09-17T01:51:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.875+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c19b7d0 con 0x7f345c0fee50 2024-09-17T01:51:57.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.876+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c108d50 con 0x7f345c0fee50 2024-09-17T01:51:57.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.877+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f344c004830 con 0x7f345c0fee50 2024-09-17T01:51:57.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.878+0000 7f34537fe700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f344806d600 0x7f344806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:57.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.878+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f344c08ca30 con 0x7f345c0fee50 2024-09-17T01:51:57.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.878+0000 7f3462114700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f344806d600 0x7f344806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:57.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.878+0000 7f3462114700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f344806d600 0x7f344806fab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f345800b5c0 tx=0x7f3458005690 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:57.877 INFO:tasks.workunit.client.0.smithi031.stdout:8/261: dwrite d0/d5/f2f [4194304,4194304] 0 2024-09-17T01:51:57.880 INFO:tasks.workunit.client.0.smithi031.stdout:8/262: creat d0/df/d19/d3d/f4b x:0 0 0 2024-09-17T01:51:57.881 INFO:tasks.workunit.client.0.smithi031.stdout:8/263: symlink d0/l4c 0 2024-09-17T01:51:57.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:57.885+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f344c059bc0 con 0x7f345c0fee50 2024-09-17T01:51:57.885 INFO:tasks.workunit.client.0.smithi031.stdout:8/264: mknod d0/df/c4d 0 2024-09-17T01:51:57.888 INFO:tasks.workunit.client.0.smithi031.stdout:8/265: unlink d0/df/f8 0 2024-09-17T01:51:57.894 INFO:tasks.workunit.client.0.smithi031.stdout:8/266: dwrite d0/df/d19/f33 [4194304,4194304] 0 2024-09-17T01:51:57.895 INFO:tasks.workunit.client.0.smithi031.stdout:8/267: truncate d0/d5/f43 319700 0 2024-09-17T01:51:57.902 INFO:tasks.workunit.client.0.smithi031.stdout:8/268: dwrite d0/df/d19/d3d/f49 [0,4194304] 0 2024-09-17T01:51:57.905 INFO:tasks.workunit.client.0.smithi031.stdout:8/269: mknod d0/d5/c4e 0 2024-09-17T01:51:57.956 INFO:tasks.workunit.client.0.smithi031.stdout:3/115: sync 2024-09-17T01:51:57.956 INFO:tasks.workunit.client.0.smithi031.stdout:4/179: sync 2024-09-17T01:51:57.964 INFO:tasks.workunit.client.0.smithi031.stdout:4/180: fdatasync d8/f16 0 2024-09-17T01:51:57.965 INFO:tasks.workunit.client.0.smithi031.stdout:8/270: mknod d0/d5/c4f 0 2024-09-17T01:51:57.968 INFO:tasks.workunit.client.0.smithi031.stdout:3/116: symlink db/df/d1d/l21 0 2024-09-17T01:51:57.969 INFO:tasks.workunit.client.0.smithi031.stdout:3/117: write db/f16 [162634,1720] 0 2024-09-17T01:51:57.970 INFO:tasks.workunit.client.0.smithi031.stdout:4/181: getdents d8/d18 0 2024-09-17T01:51:57.973 INFO:tasks.workunit.client.0.smithi031.stdout:3/118: chown db/l14 78 1 2024-09-17T01:51:57.973 INFO:tasks.workunit.client.0.smithi031.stdout:4/182: mknod d8/c31 0 2024-09-17T01:51:57.975 INFO:tasks.workunit.client.0.smithi031.stdout:8/271: dwrite d0/df/d19/d3d/f41 [0,4194304] 0 2024-09-17T01:51:57.976 INFO:tasks.workunit.client.0.smithi031.stdout:3/119: creat db/df/f22 x:0 0 0 2024-09-17T01:51:57.980 INFO:tasks.workunit.client.0.smithi031.stdout:4/183: rename d8/ca to d8/d22/d25/c32 0 2024-09-17T01:51:57.981 INFO:tasks.workunit.client.0.smithi031.stdout:4/184: dread - d8/d18/f2f zero size 2024-09-17T01:51:57.982 INFO:tasks.workunit.client.0.smithi031.stdout:4/185: write d8/d18/f24 [1234,75354] 0 2024-09-17T01:51:57.984 INFO:tasks.workunit.client.0.smithi031.stdout:3/120: unlink f7 0 2024-09-17T01:51:57.987 INFO:tasks.workunit.client.0.smithi031.stdout:4/186: creat d8/d22/d25/f33 x:0 0 0 2024-09-17T01:51:57.988 INFO:tasks.workunit.client.0.smithi031.stdout:4/187: truncate d8/fb 5221120 0 2024-09-17T01:51:57.990 INFO:tasks.workunit.client.0.smithi031.stdout:3/121: creat db/df/f23 x:0 0 0 2024-09-17T01:51:57.992 INFO:tasks.workunit.client.0.smithi031.stdout:4/188: unlink d8/d18/c19 0 2024-09-17T01:51:57.996 INFO:tasks.workunit.client.0.smithi031.stdout:4/189: symlink d8/d22/d25/l34 0 2024-09-17T01:51:58.000 INFO:tasks.workunit.client.0.smithi031.stdout:3/122: dwrite db/df/f15 [0,4194304] 0 2024-09-17T01:51:58.000 INFO:tasks.workunit.client.0.smithi031.stdout:8/272: truncate d0/df/d19/d3d/f49 3092635 0 2024-09-17T01:51:58.002 INFO:tasks.workunit.client.0.smithi031.stdout:4/190: dread d8/f14 [0,4194304] 0 2024-09-17T01:51:58.002 INFO:tasks.workunit.client.0.smithi031.stdout:4/191: readlink d8/d22/d25/l34 0 2024-09-17T01:51:58.008 INFO:tasks.workunit.client.0.smithi031.stdout:8/273: creat d0/d5/f50 x:0 0 0 2024-09-17T01:51:58.009 INFO:tasks.workunit.client.0.smithi031.stdout:8/274: chown d0/df/d19/d3d/f4b 93508 1 2024-09-17T01:51:58.012 INFO:tasks.workunit.client.0.smithi031.stdout:8/275: creat d0/df/dd/f51 x:0 0 0 2024-09-17T01:51:58.013 INFO:tasks.workunit.client.0.smithi031.stdout:4/192: link d8/d22/c2a d8/d18/c35 0 2024-09-17T01:51:58.020 INFO:tasks.workunit.client.0.smithi031.stdout:8/276: rename d0/df/f3a to d0/f52 0 2024-09-17T01:51:58.027 INFO:tasks.workunit.client.0.smithi031.stdout:3/123: mknod db/df/d1c/c24 0 2024-09-17T01:51:58.032 INFO:tasks.workunit.client.0.smithi031.stdout:4/193: truncate d8/f2b 1642177 0 2024-09-17T01:51:58.033 INFO:tasks.workunit.client.0.smithi031.stdout:4/194: write d8/d18/f2f [775680,80021] 0 2024-09-17T01:51:58.037 INFO:tasks.workunit.client.0.smithi031.stdout:4/195: dread - d8/f10 zero size 2024-09-17T01:51:58.037 INFO:tasks.workunit.client.0.smithi031.stdout:3/124: dwrite db/df/f1e [0,4194304] 0 2024-09-17T01:51:58.039 INFO:tasks.workunit.client.0.smithi031.stdout:4/196: mkdir d8/d22/d25/d36 0 2024-09-17T01:51:58.039 INFO:tasks.workunit.client.0.smithi031.stdout:4/197: chown d8/f10 31 1 2024-09-17T01:51:58.044 INFO:tasks.workunit.client.0.smithi031.stdout:3/125: rename db/df/d1d/l21 to db/df/d1d/l25 0 2024-09-17T01:51:58.047 INFO:tasks.workunit.client.0.smithi031.stdout:4/198: rename d8/d22/d25/f33 to d8/d22/f37 0 2024-09-17T01:51:58.049 INFO:tasks.workunit.client.0.smithi031.stdout:4/199: truncate d8/d22/d25/f2c 20899 0 2024-09-17T01:51:58.050 INFO:tasks.workunit.client.0.smithi031.stdout:3/126: truncate f2 1724517 0 2024-09-17T01:51:58.052 INFO:tasks.workunit.client.0.smithi031.stdout:4/200: mknod d8/d22/d25/c38 0 2024-09-17T01:51:58.053 INFO:tasks.workunit.client.0.smithi031.stdout:2/249: sync 2024-09-17T01:51:58.053 INFO:tasks.workunit.client.0.smithi031.stdout:9/176: sync 2024-09-17T01:51:58.055 INFO:tasks.workunit.client.0.smithi031.stdout:4/201: unlink d8/l15 0 2024-09-17T01:51:58.057 INFO:tasks.workunit.client.0.smithi031.stdout:9/177: creat d3/d19/f34 x:0 0 0 2024-09-17T01:51:58.061 INFO:tasks.workunit.client.0.smithi031.stdout:3/127: link db/df/f1e db/df/d1c/f26 0 2024-09-17T01:51:58.061 INFO:tasks.workunit.client.0.smithi031.stdout:3/128: chown db 41 1 2024-09-17T01:51:58.064 INFO:tasks.workunit.client.0.smithi031.stdout:4/202: rename d8/f10 to d8/d18/f39 0 2024-09-17T01:51:58.066 INFO:tasks.workunit.client.0.smithi031.stdout:2/250: symlink d1/d4c/l60 0 2024-09-17T01:51:58.068 INFO:tasks.workunit.client.0.smithi031.stdout:3/129: symlink db/df/d1c/l27 0 2024-09-17T01:51:58.077 INFO:tasks.workunit.client.0.smithi031.stdout:4/203: mkdir d8/d3a 0 2024-09-17T01:51:58.081 INFO:tasks.workunit.client.0.smithi031.stdout:3/130: write db/df/d1c/f26 [657847,61066] 0 2024-09-17T01:51:58.082 INFO:tasks.workunit.client.0.smithi031.stdout:3/131: write db/f16 [800886,69443] 0 2024-09-17T01:51:58.087 INFO:tasks.workunit.client.0.smithi031.stdout:2/251: truncate d1/d3/df/d11/f13 375090 0 2024-09-17T01:51:58.090 INFO:tasks.workunit.client.0.smithi031.stdout:9/178: getdents d3/d10 0 2024-09-17T01:51:58.093 INFO:tasks.workunit.client.0.smithi031.stdout:4/204: link d8/d22/f37 d8/f3b 0 2024-09-17T01:51:58.095 INFO:tasks.workunit.client.0.smithi031.stdout:3/132: dread db/df/f15 [0,4194304] 0 2024-09-17T01:51:58.099 INFO:tasks.workunit.client.0.smithi031.stdout:4/205: dread d8/d18/f2f [0,4194304] 0 2024-09-17T01:51:58.099 INFO:tasks.workunit.client.0.smithi031.stdout:9/179: fdatasync d3/d19/d1f/f21 0 2024-09-17T01:51:58.099 INFO:tasks.workunit.client.0.smithi031.stdout:4/206: chown d8/c17 1638058 1 2024-09-17T01:51:58.102 INFO:tasks.workunit.client.0.smithi031.stdout:3/133: rmdir db 39 2024-09-17T01:51:58.105 INFO:tasks.workunit.client.0.smithi031.stdout:9/180: rmdir d3/d19/d1f 39 2024-09-17T01:51:58.112 INFO:tasks.workunit.client.0.smithi031.stdout:4/207: creat d8/d22/f3c x:0 0 0 2024-09-17T01:51:58.112 INFO:tasks.workunit.client.0.smithi031.stdout:4/208: stat d8/f16 0 2024-09-17T01:51:58.114 INFO:tasks.workunit.client.0.smithi031.stdout:3/134: chown db/c20 2 1 2024-09-17T01:51:58.116 INFO:tasks.workunit.client.0.smithi031.stdout:2/252: getdents d1/d3/df 0 2024-09-17T01:51:58.118 INFO:tasks.workunit.client.0.smithi031.stdout:3/135: mknod db/c28 0 2024-09-17T01:51:58.119 INFO:tasks.workunit.client.0.smithi031.stdout:9/181: truncate d3/f11 3762402 0 2024-09-17T01:51:58.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/253: chown d1/d3/f1c 2381654 1 2024-09-17T01:51:58.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/254: chown d1/d3/df 11590731 1 2024-09-17T01:51:58.121 INFO:tasks.workunit.client.0.smithi031.stdout:2/255: stat d1/d3/df/d19/d1e/d21/l35 0 2024-09-17T01:51:58.124 INFO:tasks.workunit.client.0.smithi031.stdout:9/182: symlink d3/d19/l35 0 2024-09-17T01:51:58.128 INFO:tasks.workunit.client.0.smithi031.stdout:9/183: fsync d3/d10/f1a 0 2024-09-17T01:51:58.130 INFO:tasks.workunit.client.0.smithi031.stdout:2/256: getdents d1/d3 0 2024-09-17T01:51:58.131 INFO:tasks.workunit.client.0.smithi031.stdout:4/209: truncate d8/d22/f2e 3911613 0 2024-09-17T01:51:58.132 INFO:tasks.workunit.client.0.smithi031.stdout:2/257: creat d1/d3/df/d18/f61 x:0 0 0 2024-09-17T01:51:58.133 INFO:tasks.workunit.client.0.smithi031.stdout:2/258: chown d1/d3/f7 0 1 2024-09-17T01:51:58.134 INFO:tasks.workunit.client.0.smithi031.stdout:3/136: dread f2 [0,4194304] 0 2024-09-17T01:51:58.136 INFO:tasks.workunit.client.0.smithi031.stdout:2/259: creat d1/d3/df/d18/f62 x:0 0 0 2024-09-17T01:51:58.137 INFO:tasks.workunit.client.0.smithi031.stdout:4/210: dread d8/d18/f29 [0,4194304] 0 2024-09-17T01:51:58.137 INFO:tasks.workunit.client.0.smithi031.stdout:3/137: mkdir db/d29 0 2024-09-17T01:51:58.138 INFO:tasks.workunit.client.0.smithi031.stdout:2/260: chown d1/d3/df/d19/d1e/d21/c27 3999578 1 2024-09-17T01:51:58.138 INFO:tasks.workunit.client.0.smithi031.stdout:4/211: chown d8/d18/f39 103 1 2024-09-17T01:51:58.138 INFO:tasks.workunit.client.0.smithi031.stdout:3/138: write db/f12 [615122,19759] 0 2024-09-17T01:51:58.139 INFO:tasks.workunit.client.0.smithi031.stdout:3/139: fsync db/f1f 0 2024-09-17T01:51:58.141 INFO:tasks.workunit.client.0.smithi031.stdout:4/212: mknod d8/d22/d25/d36/c3d 0 2024-09-17T01:51:58.142 INFO:tasks.workunit.client.0.smithi031.stdout:3/140: readlink db/df/d1d/l25 0 2024-09-17T01:51:58.143 INFO:tasks.workunit.client.0.smithi031.stdout:4/213: mknod d8/d22/d25/c3e 0 2024-09-17T01:51:58.144 INFO:tasks.workunit.client.0.smithi031.stdout:4/214: readlink d8/l13 0 2024-09-17T01:51:58.144 INFO:tasks.workunit.client.0.smithi031.stdout:4/215: stat d8/l13 0 2024-09-17T01:51:58.145 INFO:tasks.workunit.client.0.smithi031.stdout:4/216: write d8/f11 [4231923,8458] 0 2024-09-17T01:51:58.145 INFO:tasks.workunit.client.0.smithi031.stdout:2/261: link d1/d3/fa d1/d3/df/d19/f63 0 2024-09-17T01:51:58.147 INFO:tasks.workunit.client.0.smithi031.stdout:3/141: rename db/l14 to db/df/d1d/l2a 0 2024-09-17T01:51:58.147 INFO:tasks.workunit.client.0.smithi031.stdout:4/217: rmdir d8/d22/d25/d36 39 2024-09-17T01:51:58.149 INFO:tasks.workunit.client.0.smithi031.stdout:2/262: symlink d1/d3/df/d19/d1e/d4f/l64 0 2024-09-17T01:51:58.149 INFO:tasks.workunit.client.0.smithi031.stdout:4/218: write d8/d22/f3c [644611,62755] 0 2024-09-17T01:51:58.150 INFO:tasks.workunit.client.0.smithi031.stdout:2/263: write d1/d3/df/f5b [204989,43207] 0 2024-09-17T01:51:58.151 INFO:tasks.workunit.client.0.smithi031.stdout:2/264: chown d1/d3/f4 17 1 2024-09-17T01:51:58.153 INFO:tasks.workunit.client.0.smithi031.stdout:3/142: link db/df/f1b db/df/d1c/f2b 0 2024-09-17T01:51:58.155 INFO:tasks.workunit.client.0.smithi031.stdout:2/265: rename d1/d3/df/d18/d40/d43/f50 to d1/d3/df/d18/f65 0 2024-09-17T01:51:58.161 INFO:tasks.workunit.client.0.smithi031.stdout:3/143: rename c8 to db/df/c2c 0 2024-09-17T01:51:58.161 INFO:tasks.workunit.client.0.smithi031.stdout:3/144: fdatasync db/fe 0 2024-09-17T01:51:58.169 INFO:tasks.workunit.client.0.smithi031.stdout:2/266: dread d1/d3/df/d19/f63 [0,4194304] 0 2024-09-17T01:51:58.170 INFO:tasks.workunit.client.0.smithi031.stdout:2/267: write d1/d3/df/d18/f61 [837914,21300] 0 2024-09-17T01:51:58.173 INFO:tasks.workunit.client.0.smithi031.stdout:2/268: mkdir d1/d3/df/d66 0 2024-09-17T01:51:58.174 INFO:tasks.workunit.client.0.smithi031.stdout:2/269: fsync d1/d3/df/d19/d1e/f39 0 2024-09-17T01:51:58.177 INFO:tasks.workunit.client.0.smithi031.stdout:2/270: dread d1/d3/d2d/f38 [0,4194304] 0 2024-09-17T01:51:58.182 INFO:tasks.workunit.client.0.smithi031.stdout:3/145: dwrite f6 [0,4194304] 0 2024-09-17T01:51:58.183 INFO:tasks.workunit.client.0.smithi031.stdout:2/271: rmdir d1/d3/df/d11/d44/d56 0 2024-09-17T01:51:58.185 INFO:tasks.workunit.client.0.smithi031.stdout:3/146: rmdir db 39 2024-09-17T01:51:58.190 INFO:tasks.workunit.client.0.smithi031.stdout:2/272: dread d1/d3/d2d/f41 [0,4194304] 0 2024-09-17T01:51:58.191 INFO:tasks.workunit.client.0.smithi031.stdout:3/147: dread f6 [0,4194304] 0 2024-09-17T01:51:58.195 INFO:tasks.workunit.client.0.smithi031.stdout:2/273: creat d1/d3/df/d19/d1e/d2a/f67 x:0 0 0 2024-09-17T01:51:58.196 INFO:tasks.workunit.client.0.smithi031.stdout:3/148: unlink db/df/f17 0 2024-09-17T01:51:58.198 INFO:tasks.workunit.client.0.smithi031.stdout:2/274: mknod d1/d4c/c68 0 2024-09-17T01:51:58.199 INFO:tasks.workunit.client.0.smithi031.stdout:3/149: mknod db/c2d 0 2024-09-17T01:51:58.201 INFO:tasks.workunit.client.0.smithi031.stdout:3/150: unlink f2 0 2024-09-17T01:51:58.204 INFO:tasks.workunit.client.0.smithi031.stdout:2/275: getdents d1/d3/df/d19/d1e 0 2024-09-17T01:51:58.206 INFO:tasks.workunit.client.0.smithi031.stdout:3/151: dread db/df/d1c/f26 [0,4194304] 0 2024-09-17T01:51:58.209 INFO:tasks.workunit.client.0.smithi031.stdout:3/152: creat db/d29/f2e x:0 0 0 2024-09-17T01:51:58.210 INFO:tasks.workunit.client.0.smithi031.stdout:2/276: dwrite d1/d3/f7 [0,4194304] 0 2024-09-17T01:51:58.211 INFO:tasks.workunit.client.0.smithi031.stdout:2/277: readlink d1/l8 0 2024-09-17T01:51:58.212 INFO:tasks.workunit.client.0.smithi031.stdout:3/153: mkdir db/d29/d2f 0 2024-09-17T01:51:58.215 INFO:tasks.workunit.client.0.smithi031.stdout:3/154: creat db/f30 x:0 0 0 2024-09-17T01:51:58.217 INFO:tasks.workunit.client.0.smithi031.stdout:2/278: write d1/d3/df/d19/f1f [781998,3829] 0 2024-09-17T01:51:58.218 INFO:tasks.workunit.client.0.smithi031.stdout:3/155: creat db/df/f31 x:0 0 0 2024-09-17T01:51:58.219 INFO:tasks.workunit.client.0.smithi031.stdout:2/279: write d1/d3/f4 [5118416,122328] 0 2024-09-17T01:51:58.219 INFO:tasks.workunit.client.0.smithi031.stdout:3/156: chown db/df/d1d 49477836 1 2024-09-17T01:51:58.220 INFO:tasks.workunit.client.0.smithi031.stdout:2/280: mknod d1/d3/df/d19/c69 0 2024-09-17T01:51:58.223 INFO:tasks.workunit.client.0.smithi031.stdout:2/281: creat d1/d3/df/d18/d40/d43/f6a x:0 0 0 2024-09-17T01:51:58.226 INFO:tasks.workunit.client.0.smithi031.stdout:3/157: dwrite db/fe [0,4194304] 0 2024-09-17T01:51:58.228 INFO:tasks.workunit.client.0.smithi031.stdout:3/158: chown db/d29 87753 1 2024-09-17T01:51:58.228 INFO:tasks.workunit.client.0.smithi031.stdout:2/282: creat d1/d3/d45/f6b x:0 0 0 2024-09-17T01:51:58.228 INFO:tasks.workunit.client.0.smithi031.stdout:3/159: stat db/f11 0 2024-09-17T01:51:58.231 INFO:tasks.workunit.client.0.smithi031.stdout:3/160: symlink db/df/l32 0 2024-09-17T01:51:58.231 INFO:tasks.workunit.client.0.smithi031.stdout:3/161: chown db/c28 7 1 2024-09-17T01:51:58.233 INFO:tasks.workunit.client.0.smithi031.stdout:3/162: write db/df/f1e [4893545,68425] 0 2024-09-17T01:51:58.236 INFO:tasks.workunit.client.0.smithi031.stdout:0/204: sync 2024-09-17T01:51:58.236 INFO:tasks.workunit.client.0.smithi031.stdout:7/140: sync 2024-09-17T01:51:58.236 INFO:tasks.workunit.client.0.smithi031.stdout:1/230: sync 2024-09-17T01:51:58.236 INFO:tasks.workunit.client.0.smithi031.stdout:3/163: creat db/d29/d2f/f33 x:0 0 0 2024-09-17T01:51:58.239 INFO:tasks.workunit.client.0.smithi031.stdout:0/205: truncate d0/d29/d33/d2a/d25/d38/f41 415486 0 2024-09-17T01:51:58.240 INFO:tasks.workunit.client.0.smithi031.stdout:7/141: read db/d1c/f1d [1334638,17369] 0 2024-09-17T01:51:58.240 INFO:tasks.workunit.client.0.smithi031.stdout:0/206: write d0/d29/d33/f13 [567022,15384] 0 2024-09-17T01:51:58.241 INFO:tasks.workunit.client.0.smithi031.stdout:0/207: chown d0/d29/d33/d2a/d25/f26 8 1 2024-09-17T01:51:58.244 INFO:tasks.workunit.client.0.smithi031.stdout:0/208: mkdir d0/d29/d33/d2a/d25/d30/d4a 0 2024-09-17T01:51:58.244 INFO:tasks.workunit.client.0.smithi031.stdout:7/142: getdents db/d18 0 2024-09-17T01:51:58.245 INFO:tasks.workunit.client.0.smithi031.stdout:0/209: readlink d0/d29/l36 0 2024-09-17T01:51:58.246 INFO:tasks.workunit.client.0.smithi031.stdout:7/143: fsync db/fe 0 2024-09-17T01:51:58.247 INFO:tasks.workunit.client.0.smithi031.stdout:1/231: write d4/d1a/d2d/d18/f2e [399901,66205] 0 2024-09-17T01:51:58.249 INFO:tasks.workunit.client.0.smithi031.stdout:7/144: creat db/d18/f27 x:0 0 0 2024-09-17T01:51:58.249 INFO:tasks.workunit.client.0.smithi031.stdout:0/210: mknod d0/d29/d33/c4b 0 2024-09-17T01:51:58.251 INFO:tasks.workunit.client.0.smithi031.stdout:1/232: dread d4/d1a/d2d/d18/f2e [0,4194304] 0 2024-09-17T01:51:58.252 INFO:tasks.workunit.client.0.smithi031.stdout:1/233: write f3 [1348263,112664] 0 2024-09-17T01:51:58.255 INFO:tasks.workunit.client.0.smithi031.stdout:1/234: rmdir d4/d1e/d3f 39 2024-09-17T01:51:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.257+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f345c105ed0 con 0x7f344806d600 2024-09-17T01:51:58.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.259+0000 7f34537fe700 1 -- 172.21.15.31:0/2562096425 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f345c105ed0 con 0x7f344806d600 2024-09-17T01:51:58.257 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:51:58.257 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:51:58.257 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:51:58.258 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:51:58.258 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [], 2024-09-17T01:51:58.258 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:51:58.258 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "", 2024-09-17T01:51:58.258 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:51:58.258 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:51:58.260 INFO:tasks.workunit.client.0.smithi031.stdout:0/211: truncate d0/d29/d33/d2a/f1e 1474125 0 2024-09-17T01:51:58.260 INFO:tasks.workunit.client.0.smithi031.stdout:7/145: dread db/d1c/f1d [0,4194304] 0 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f344806d600 msgr2=0x7f344806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f344806d600 0x7f344806fab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f345800b5c0 tx=0x7f3458005690 comp rx=0 tx=0).stop 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 msgr2=0x7f345c196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 0x7f345c196070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c840 tx=0x7f344c00cb50 comp rx=0 tx=0).stop 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 shutdown_connections 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f344806d600 0x7f344806fab0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f345c0fe500 0x7f345c195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 --2- 172.21.15.31:0/2562096425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f345c0fee50 0x7f345c196070 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 >> 172.21.15.31:0/2562096425 conn(0x7f345c0f9f10 msgr2=0x7f345c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:58.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 shutdown_connections 2024-09-17T01:51:58.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.262+0000 7f3464378700 1 -- 172.21.15.31:0/2562096425 wait complete. 2024-09-17T01:51:58.262 INFO:tasks.workunit.client.0.smithi031.stdout:7/146: dread - db/d18/f25 zero size 2024-09-17T01:51:58.262 INFO:tasks.workunit.client.0.smithi031.stdout:1/235: dwrite d4/d1e/f3b [0,4194304] 0 2024-09-17T01:51:58.264 INFO:tasks.workunit.client.0.smithi031.stdout:0/212: creat d0/d29/d44/f4c x:0 0 0 2024-09-17T01:51:58.270 INFO:tasks.workunit.client.0.smithi031.stdout:7/147: truncate db/fe 2724455 0 2024-09-17T01:51:58.271 INFO:tasks.workunit.client.0.smithi031.stdout:0/213: creat d0/d29/d33/d5/d48/f4d x:0 0 0 2024-09-17T01:51:58.275 INFO:tasks.workunit.client.0.smithi031.stdout:1/236: dwrite d4/d1a/d2d/d18/f31 [0,4194304] 0 2024-09-17T01:51:58.279 INFO:tasks.workunit.client.0.smithi031.stdout:0/214: rename d0/d29/d33/c4b to d0/d29/d33/d2a/c4e 0 2024-09-17T01:51:58.285 INFO:tasks.workunit.client.0.smithi031.stdout:7/148: link db/l1e db/d18/l28 0 2024-09-17T01:51:58.285 INFO:tasks.workunit.client.0.smithi031.stdout:1/237: dwrite d4/d1a/d43/f4c [0,4194304] 0 2024-09-17T01:51:58.287 INFO:tasks.workunit.client.0.smithi031.stdout:1/238: truncate d4/d1a/f3c 313760 0 2024-09-17T01:51:58.294 INFO:tasks.workunit.client.0.smithi031.stdout:7/149: rmdir db/d18 39 2024-09-17T01:51:58.297 INFO:tasks.workunit.client.0.smithi031.stdout:7/150: mkdir db/d29 0 2024-09-17T01:51:58.299 INFO:tasks.workunit.client.0.smithi031.stdout:7/151: mknod db/d29/c2a 0 2024-09-17T01:51:58.305 INFO:tasks.workunit.client.0.smithi031.stdout:7/152: truncate db/f16 328881 0 2024-09-17T01:51:58.311 INFO:tasks.workunit.client.0.smithi031.stdout:7/153: write db/fe [2413793,24655] 0 2024-09-17T01:51:58.312 INFO:tasks.workunit.client.0.smithi031.stdout:1/239: dread d4/d1a/d2d/f22 [0,4194304] 0 2024-09-17T01:51:58.314 INFO:tasks.workunit.client.0.smithi031.stdout:1/240: write d4/d1a/d2d/f38 [719755,4290] 0 2024-09-17T01:51:58.314 INFO:tasks.workunit.client.0.smithi031.stdout:7/154: dread - db/d18/f25 zero size 2024-09-17T01:51:58.318 INFO:tasks.workunit.client.0.smithi031.stdout:1/241: mkdir d4/d1e/d3f/d4d 0 2024-09-17T01:51:58.326 INFO:tasks.workunit.client.0.smithi031.stdout:7/155: dwrite db/f10 [0,4194304] 0 2024-09-17T01:51:58.327 INFO:tasks.workunit.client.0.smithi031.stdout:1/242: dwrite d4/d1a/d2d/d18/f39 [0,4194304] 0 2024-09-17T01:51:58.327 INFO:tasks.workunit.client.0.smithi031.stdout:7/156: fsync db/fe 0 2024-09-17T01:51:58.333 INFO:tasks.workunit.client.0.smithi031.stdout:1/243: rename d4/d1a/c2f to d4/d1e/d3f/d4d/c4e 0 2024-09-17T01:51:58.334 INFO:tasks.workunit.client.0.smithi031.stdout:1/244: write d4/f4a [933444,30167] 0 2024-09-17T01:51:58.339 INFO:tasks.workunit.client.0.smithi031.stdout:7/157: dwrite db/d1c/f1d [0,4194304] 0 2024-09-17T01:51:58.347 INFO:tasks.workunit.client.0.smithi031.stdout:7/158: dwrite db/f1b [0,4194304] 0 2024-09-17T01:51:58.348 INFO:tasks.workunit.client.0.smithi031.stdout:7/159: truncate db/d18/f27 588997 0 2024-09-17T01:51:58.351 INFO:tasks.workunit.client.0.smithi031.stdout:7/160: symlink db/d1c/l2b 0 2024-09-17T01:51:58.352 INFO:tasks.workunit.client.0.smithi031.stdout:7/161: stat db/d1c/l2b 0 2024-09-17T01:51:58.357 INFO:tasks.workunit.client.0.smithi031.stdout:7/162: unlink db/d18/l28 0 2024-09-17T01:51:58.357 INFO:tasks.workunit.client.0.smithi031.stdout:7/163: chown db/f10 16 1 2024-09-17T01:51:58.360 INFO:tasks.workunit.client.0.smithi031.stdout:7/164: chown l4 2 1 2024-09-17T01:51:58.363 INFO:tasks.workunit.client.0.smithi031.stdout:7/165: getdents db/d29 0 2024-09-17T01:51:58.365 INFO:tasks.workunit.client.0.smithi031.stdout:7/166: symlink db/d18/l2c 0 2024-09-17T01:51:58.365 INFO:tasks.workunit.client.0.smithi031.stdout:7/167: dread - db/d18/f25 zero size 2024-09-17T01:51:58.367 INFO:tasks.workunit.client.0.smithi031.stdout:7/168: symlink db/d1c/l2d 0 2024-09-17T01:51:58.370 INFO:tasks.workunit.client.0.smithi031.stdout:7/169: truncate db/fe 1958141 0 2024-09-17T01:51:58.372 INFO:tasks.workunit.client.0.smithi031.stdout:7/170: creat db/d29/f2e x:0 0 0 2024-09-17T01:51:58.374 INFO:tasks.workunit.client.0.smithi031.stdout:7/171: dread db/d18/f27 [0,4194304] 0 2024-09-17T01:51:58.375 INFO:tasks.workunit.client.0.smithi031.stdout:7/172: stat db/d18/c19 0 2024-09-17T01:51:58.378 INFO:tasks.workunit.client.0.smithi031.stdout:7/173: creat db/d18/f2f x:0 0 0 2024-09-17T01:51:58.382 INFO:tasks.workunit.client.0.smithi031.stdout:7/174: rename db/d1c/c24 to db/c30 0 2024-09-17T01:51:58.382 INFO:tasks.workunit.client.0.smithi031.stdout:7/175: stat db/f1a 0 2024-09-17T01:51:58.384 INFO:tasks.workunit.client.0.smithi031.stdout:7/176: symlink db/d18/l31 0 2024-09-17T01:51:58.386 INFO:tasks.workunit.client.0.smithi031.stdout:7/177: mknod db/d29/c32 0 2024-09-17T01:51:58.401 INFO:tasks.workunit.client.0.smithi031.stdout:7/178: dwrite db/f1f [0,4194304] 0 2024-09-17T01:51:58.406 INFO:tasks.workunit.client.0.smithi031.stdout:7/179: rename db/d18/c20 to db/d1c/c33 0 2024-09-17T01:51:58.410 INFO:tasks.workunit.client.0.smithi031.stdout:7/180: rename db/d18/l2c to db/d1c/l34 0 2024-09-17T01:51:58.411 INFO:tasks.workunit.client.0.smithi031.stdout:7/181: chown db/f16 31287000 1 2024-09-17T01:51:58.418 INFO:tasks.workunit.client.0.smithi031.stdout:7/182: dwrite db/f1f [0,4194304] 0 2024-09-17T01:51:58.418 INFO:tasks.workunit.client.0.smithi031.stdout:7/183: readlink l7 0 2024-09-17T01:51:58.420 INFO:tasks.workunit.client.0.smithi031.stdout:7/184: read db/d18/f27 [364168,54699] 0 2024-09-17T01:51:58.421 INFO:tasks.workunit.client.0.smithi031.stdout:7/185: truncate db/f15 8925732 0 2024-09-17T01:51:58.428 INFO:tasks.workunit.client.0.smithi031.stdout:7/186: link db/l12 db/l35 0 2024-09-17T01:51:58.429 INFO:tasks.workunit.client.0.smithi031.stdout:7/187: mknod db/d1c/c36 0 2024-09-17T01:51:58.432 INFO:tasks.workunit.client.0.smithi031.stdout:7/188: getdents db/d29 0 2024-09-17T01:51:58.434 INFO:tasks.workunit.client.0.smithi031.stdout:7/189: write db/d1c/f1d [1363494,28217] 0 2024-09-17T01:51:58.437 INFO:tasks.workunit.client.0.smithi031.stdout:7/190: rename db/d1c/c33 to db/d18/c37 0 2024-09-17T01:51:58.439 INFO:tasks.workunit.client.0.smithi031.stdout:7/191: write db/f10 [3751306,6933] 0 2024-09-17T01:51:58.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 -- 172.21.15.31:0/4205607508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3100ff150 msgr2=0x7fa3100ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 --2- 172.21.15.31:0/4205607508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3100ff150 0x7fa3100ff560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa300009910 tx=0x7fa300009c20 comp rx=0 tx=0).stop 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 -- 172.21.15.31:0/4205607508 shutdown_connections 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 --2- 172.21.15.31:0/4205607508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa310100350 0x7fa3101007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 --2- 172.21.15.31:0/4205607508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3100ff150 0x7fa3100ff560 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 -- 172.21.15.31:0/4205607508 >> 172.21.15.31:0/4205607508 conn(0x7fa3100fa700 msgr2=0x7fa3100fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 -- 172.21.15.31:0/4205607508 shutdown_connections 2024-09-17T01:51:58.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.442+0000 7fa31675a700 1 -- 172.21.15.31:0/4205607508 wait complete. 2024-09-17T01:51:58.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.443+0000 7fa31675a700 1 Processor -- start 2024-09-17T01:51:58.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.443+0000 7fa31675a700 1 -- start start 2024-09-17T01:51:58.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa31675a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 0x7fa3101030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:58.443 INFO:tasks.workunit.client.0.smithi031.stdout:7/192: dread db/f16 [0,4194304] 0 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa31675a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 0x7fa310101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa31675a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310101c70 con 0x7fa310100350 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa31675a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310101db0 con 0x7fa3100ff150 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 0x7fa310101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 0x7fa3101030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 0x7fa310101730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39622/0 (socket says 172.21.15.31:39622) 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30f7fe700 1 -- 172.21.15.31:0/184188583 learned_addr learned my addr 172.21.15.31:0/184188583 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:51:58.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30ffff700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 0x7fa3101030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:55314/0 (socket says 172.21.15.31:55314) 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30ffff700 1 -- 172.21.15.31:0/184188583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 msgr2=0x7fa310101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30ffff700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 0x7fa310101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30ffff700 1 -- 172.21.15.31:0/184188583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009520 con 0x7fa3100ff150 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.444+0000 7fa30f7fe700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 0x7fa310101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.445+0000 7fa30ffff700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 0x7fa3101030e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa300009910 tx=0x7fa30000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.445+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30001d070 con 0x7fa3100ff150 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.445+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa300005dc0 con 0x7fa3100ff150 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.445+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa300017630 con 0x7fa3100ff150 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.445+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000095f0 con 0x7fa3100ff150 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.445+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa310102390 con 0x7fa3100ff150 2024-09-17T01:51:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.446+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310107ca0 con 0x7fa3100ff150 2024-09-17T01:51:58.447 INFO:tasks.workunit.client.0.smithi031.stdout:7/193: unlink db/d18/l26 0 2024-09-17T01:51:58.447 INFO:tasks.workunit.client.0.smithi031.stdout:7/194: readlink db/d18/l31 0 2024-09-17T01:51:58.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.447+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7fa30000fa40 con 0x7fa3100ff150 2024-09-17T01:51:58.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.448+0000 7fa30d7fa700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fa2f806d650 0x7fa2f806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:58.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.448+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa30008e100 con 0x7fa3100ff150 2024-09-17T01:51:58.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.448+0000 7fa30f7fe700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fa2f806d650 0x7fa2f806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:58.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.449+0000 7fa30f7fe700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fa2f806d650 0x7fa2f806fb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa304009fd0 tx=0x7fa304009260 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:58.448 INFO:tasks.workunit.client.0.smithi031.stdout:7/195: link l7 db/d29/l38 0 2024-09-17T01:51:58.451 INFO:tasks.workunit.client.0.smithi031.stdout:7/196: rename db/d29/c32 to db/c39 0 2024-09-17T01:51:58.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.453+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fa30005b270 con 0x7fa3100ff150 2024-09-17T01:51:58.452 INFO:tasks.workunit.client.0.smithi031.stdout:7/197: fsync db/d1c/f1d 0 2024-09-17T01:51:58.453 INFO:tasks.workunit.client.0.smithi031.stdout:7/198: write db/f15 [5038610,78592] 0 2024-09-17T01:51:58.453 INFO:tasks.workunit.client.0.smithi031.stdout:7/199: write db/d18/f25 [349262,44732] 0 2024-09-17T01:51:58.454 INFO:tasks.workunit.client.0.smithi031.stdout:7/200: write db/fe [2289981,127488] 0 2024-09-17T01:51:58.455 INFO:tasks.workunit.client.0.smithi031.stdout:7/201: write db/f15 [1683797,107412] 0 2024-09-17T01:51:58.459 INFO:tasks.workunit.client.0.smithi031.stdout:7/202: dread db/fe [0,4194304] 0 2024-09-17T01:51:58.462 INFO:tasks.workunit.client.0.smithi031.stdout:7/203: creat db/f3a x:0 0 0 2024-09-17T01:51:58.464 INFO:tasks.workunit.client.0.smithi031.stdout:7/204: rename c9 to db/d1c/c3b 0 2024-09-17T01:51:58.474 INFO:tasks.workunit.client.0.smithi031.stdout:7/205: truncate db/f10 3982187 0 2024-09-17T01:51:58.476 INFO:tasks.workunit.client.0.smithi031.stdout:8/277: sync 2024-09-17T01:51:58.477 INFO:tasks.workunit.client.0.smithi031.stdout:6/277: sync 2024-09-17T01:51:58.477 INFO:tasks.workunit.client.0.smithi031.stdout:5/231: sync 2024-09-17T01:51:58.477 INFO:tasks.workunit.client.0.smithi031.stdout:7/206: creat db/d29/f3c x:0 0 0 2024-09-17T01:51:58.480 INFO:tasks.workunit.client.0.smithi031.stdout:5/232: symlink da/d42/l4f 0 2024-09-17T01:51:58.481 INFO:tasks.workunit.client.0.smithi031.stdout:6/278: creat d23/f5c x:0 0 0 2024-09-17T01:51:58.483 INFO:tasks.workunit.client.0.smithi031.stdout:5/233: write da/d42/d12/f41 [872603,8558] 0 2024-09-17T01:51:58.484 INFO:tasks.workunit.client.0.smithi031.stdout:8/278: dwrite d0/f42 [0,4194304] 0 2024-09-17T01:51:58.485 INFO:tasks.workunit.client.0.smithi031.stdout:6/279: creat d23/d33/f5d x:0 0 0 2024-09-17T01:51:58.486 INFO:tasks.workunit.client.0.smithi031.stdout:5/234: mkdir da/d4b/d50 0 2024-09-17T01:51:58.490 INFO:tasks.workunit.client.0.smithi031.stdout:5/235: truncate da/d14/f3b 522044 0 2024-09-17T01:51:58.490 INFO:tasks.workunit.client.0.smithi031.stdout:6/280: dread d23/d33/f4a [0,4194304] 0 2024-09-17T01:51:58.491 INFO:tasks.workunit.client.0.smithi031.stdout:6/281: fdatasync d23/d33/f4f 0 2024-09-17T01:51:58.493 INFO:tasks.workunit.client.0.smithi031.stdout:5/236: creat da/d42/f51 x:0 0 0 2024-09-17T01:51:58.499 INFO:tasks.workunit.client.0.smithi031.stdout:6/282: creat d23/d50/f5e x:0 0 0 2024-09-17T01:51:58.499 INFO:tasks.workunit.client.0.smithi031.stdout:6/283: read - d23/d50/f5e zero size 2024-09-17T01:51:58.502 INFO:tasks.workunit.client.0.smithi031.stdout:6/284: fdatasync d23/d33/f3c 0 2024-09-17T01:51:58.506 INFO:tasks.workunit.client.0.smithi031.stdout:6/285: mknod d23/d50/c5f 0 2024-09-17T01:51:58.507 INFO:tasks.workunit.client.0.smithi031.stdout:6/286: write f19 [3556290,124310] 0 2024-09-17T01:51:58.512 INFO:tasks.workunit.client.0.smithi031.stdout:6/287: creat d23/d33/d47/f60 x:0 0 0 2024-09-17T01:51:58.512 INFO:tasks.workunit.client.0.smithi031.stdout:5/237: link da/dc/l21 da/dc/d2e/l52 0 2024-09-17T01:51:58.513 INFO:tasks.workunit.client.0.smithi031.stdout:6/288: write d23/d33/f4f [216784,114199] 0 2024-09-17T01:51:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:58 smithi031 ceph-mon[27673]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:58 smithi031 ceph-mon[27673]: pgmap v9: 65 pgs: 65 active+clean; 596 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 57 MiB/s wr, 337 op/s 2024-09-17T01:51:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:58 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2845510448' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:51:58.516 INFO:tasks.workunit.client.0.smithi031.stdout:6/289: rename d23/d50/c54 to d23/d33/d47/c61 0 2024-09-17T01:51:58.521 INFO:tasks.workunit.client.0.smithi031.stdout:6/290: dwrite d23/f31 [0,4194304] 0 2024-09-17T01:51:58.534 INFO:tasks.workunit.client.0.smithi031.stdout:6/291: dwrite d23/d50/f58 [0,4194304] 0 2024-09-17T01:51:58.537 INFO:tasks.workunit.client.0.smithi031.stdout:6/292: symlink d23/l62 0 2024-09-17T01:51:58.539 INFO:tasks.workunit.client.0.smithi031.stdout:6/293: write d23/f3d [3550884,7293] 0 2024-09-17T01:51:58.541 INFO:tasks.workunit.client.0.smithi031.stdout:6/294: rmdir d23/d33/d47 39 2024-09-17T01:51:58.545 INFO:tasks.workunit.client.0.smithi031.stdout:6/295: rename d23/d33 to d23/d63 0 2024-09-17T01:51:58.551 INFO:tasks.workunit.client.0.smithi031.stdout:6/296: dwrite d23/d63/f4f [0,4194304] 0 2024-09-17T01:51:58.554 INFO:tasks.workunit.client.0.smithi031.stdout:6/297: mkdir d23/d50/d64 0 2024-09-17T01:51:58.556 INFO:tasks.workunit.client.0.smithi031.stdout:6/298: unlink c13 0 2024-09-17T01:51:58.560 INFO:tasks.workunit.client.0.smithi031.stdout:6/299: mknod d23/d63/d47/c65 0 2024-09-17T01:51:58.564 INFO:tasks.workunit.client.0.smithi031.stdout:6/300: rename c9 to d23/d50/c66 0 2024-09-17T01:51:58.566 INFO:tasks.workunit.client.0.smithi031.stdout:6/301: unlink d23/f26 0 2024-09-17T01:51:58.568 INFO:tasks.workunit.client.0.smithi031.stdout:6/302: mkdir d23/d50/d64/d67 0 2024-09-17T01:51:58.569 INFO:tasks.workunit.client.0.smithi031.stdout:6/303: chown d23/d63/f56 148876 1 2024-09-17T01:51:58.570 INFO:tasks.workunit.client.0.smithi031.stdout:6/304: chown f19 1882 1 2024-09-17T01:51:58.571 INFO:tasks.workunit.client.0.smithi031.stdout:6/305: symlink d23/d63/l68 0 2024-09-17T01:51:58.573 INFO:tasks.workunit.client.0.smithi031.stdout:6/306: chown c10 0 1 2024-09-17T01:51:58.574 INFO:tasks.workunit.client.0.smithi031.stdout:6/307: chown d23/c51 12 1 2024-09-17T01:51:58.579 INFO:tasks.workunit.client.0.smithi031.stdout:6/308: dwrite d23/f31 [0,4194304] 0 2024-09-17T01:51:58.581 INFO:tasks.workunit.client.0.smithi031.stdout:6/309: creat d23/d50/f69 x:0 0 0 2024-09-17T01:51:58.581 INFO:tasks.workunit.client.0.smithi031.stdout:6/310: fsync d23/f5c 0 2024-09-17T01:51:58.583 INFO:tasks.workunit.client.0.smithi031.stdout:6/311: mkdir d23/d50/d6a 0 2024-09-17T01:51:58.605 INFO:tasks.workunit.client.0.smithi031.stdout:6/312: dread d23/d50/f53 [0,4194304] 0 2024-09-17T01:51:58.609 INFO:tasks.workunit.client.0.smithi031.stdout:6/313: rename d23/l2a to d23/d50/l6b 0 2024-09-17T01:51:58.609 INFO:tasks.workunit.client.0.smithi031.stdout:6/314: chown d23/d63/f4f 2 1 2024-09-17T01:51:58.610 INFO:tasks.workunit.client.0.smithi031.stdout:6/315: write d23/f5b [244646,114649] 0 2024-09-17T01:51:58.621 INFO:tasks.workunit.client.0.smithi031.stdout:6/316: getdents d23/d50 0 2024-09-17T01:51:58.622 INFO:tasks.workunit.client.0.smithi031.stdout:6/317: mknod d23/d50/d6a/c6c 0 2024-09-17T01:51:58.623 INFO:tasks.workunit.client.0.smithi031.stdout:6/318: dread - d23/d63/d47/f60 zero size 2024-09-17T01:51:58.625 INFO:tasks.workunit.client.0.smithi031.stdout:6/319: rename d23/d63/l68 to d23/d63/l6d 0 2024-09-17T01:51:58.626 INFO:tasks.workunit.client.0.smithi031.stdout:6/320: readlink d23/l25 0 2024-09-17T01:51:58.648 INFO:tasks.workunit.client.1.smithi092.stdout:3/17: sync 2024-09-17T01:51:58.649 INFO:tasks.workunit.client.1.smithi092.stdout:0/15: sync 2024-09-17T01:51:58.649 INFO:tasks.workunit.client.1.smithi092.stdout:3/18: fdatasync - no filename 2024-09-17T01:51:58.649 INFO:tasks.workunit.client.1.smithi092.stdout:3/19: dread - no filename 2024-09-17T01:51:58.651 INFO:tasks.workunit.client.1.smithi092.stdout:0/16: mkdir d3 0 2024-09-17T01:51:58.651 INFO:tasks.workunit.client.1.smithi092.stdout:3/20: symlink d4/l5 0 2024-09-17T01:51:58.652 INFO:tasks.workunit.client.1.smithi092.stdout:3/21: unlink c1 0 2024-09-17T01:51:58.653 INFO:tasks.workunit.client.1.smithi092.stdout:3/22: truncate - no filename 2024-09-17T01:51:58.653 INFO:tasks.workunit.client.1.smithi092.stdout:3/23: chown l2 1727376096 1 2024-09-17T01:51:58.653 INFO:tasks.workunit.client.1.smithi092.stdout:3/24: read - no filename 2024-09-17T01:51:58.655 INFO:tasks.workunit.client.1.smithi092.stdout:0/17: dwrite f1 [0,4194304] 0 2024-09-17T01:51:58.655 INFO:tasks.workunit.client.1.smithi092.stdout:0/18: stat f1 0 2024-09-17T01:51:58.658 INFO:tasks.workunit.client.1.smithi092.stdout:0/19: creat d3/f4 x:0 0 0 2024-09-17T01:51:58.658 INFO:tasks.workunit.client.1.smithi092.stdout:0/20: chown d3/f4 7396 1 2024-09-17T01:51:58.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:58 smithi092 ceph-mon[33552]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:58.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:58 smithi092 ceph-mon[33552]: pgmap v9: 65 pgs: 65 active+clean; 596 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 57 MiB/s wr, 337 op/s 2024-09-17T01:51:58.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:58 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2845510448' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:51:58.794 INFO:tasks.workunit.client.1.smithi092.stdout:0/21: rmdir d3 39 2024-09-17T01:51:58.798 INFO:tasks.workunit.client.1.smithi092.stdout:0/22: dwrite f1 [4194304,4194304] 0 2024-09-17T01:51:58.800 INFO:tasks.workunit.client.1.smithi092.stdout:0/23: stat d3/f4 0 2024-09-17T01:51:58.800 INFO:tasks.workunit.client.1.smithi092.stdout:0/24: stat d3/f4 0 2024-09-17T01:51:58.809 INFO:tasks.workunit.client.1.smithi092.stdout:0/25: dwrite f1 [8388608,4194304] 0 2024-09-17T01:51:58.812 INFO:tasks.workunit.client.1.smithi092.stdout:0/26: link d3/f4 d3/f5 0 2024-09-17T01:51:58.814 INFO:tasks.workunit.client.1.smithi092.stdout:0/27: creat d3/f6 x:0 0 0 2024-09-17T01:51:58.816 INFO:tasks.workunit.client.1.smithi092.stdout:0/28: fdatasync d3/f4 0 2024-09-17T01:51:58.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.818+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa31019e1e0 con 0x7fa3100ff150 2024-09-17T01:51:58.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.819+0000 7fa30d7fa700 1 -- 172.21.15.31:0/184188583 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa30005ae00 con 0x7fa3100ff150 2024-09-17T01:51:58.818 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:51:58.818 INFO:tasks.workunit.client.1.smithi092.stdout:0/29: creat d3/f7 x:0 0 0 2024-09-17T01:51:58.820 INFO:tasks.workunit.client.1.smithi092.stdout:0/30: symlink d3/l8 0 2024-09-17T01:51:58.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.823+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fa2f806d650 msgr2=0x7fa2f806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:58.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.823+0000 7fa31675a700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fa2f806d650 0x7fa2f806fb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa304009fd0 tx=0x7fa304009260 comp rx=0 tx=0).stop 2024-09-17T01:51:58.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.823+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 msgr2=0x7fa3101030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:58.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.823+0000 7fa31675a700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 0x7fa3101030e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa300009910 tx=0x7fa30000f690 comp rx=0 tx=0).stop 2024-09-17T01:51:58.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 shutdown_connections 2024-09-17T01:51:58.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fa2f806d650 0x7fa2f806fb00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3100ff150 0x7fa3101030e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 --2- 172.21.15.31:0/184188583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa310100350 0x7fa310101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:58.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 >> 172.21.15.31:0/184188583 conn(0x7fa3100fa700 msgr2=0x7fa310068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:58.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 shutdown_connections 2024-09-17T01:51:58.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:51:58.824+0000 7fa31675a700 1 -- 172.21.15.31:0/184188583 wait complete. 2024-09-17T01:51:58.823 INFO:tasks.workunit.client.1.smithi092.stdout:0/31: dread f1 [8388608,4194304] 0 2024-09-17T01:51:58.829 INFO:tasks.workunit.client.1.smithi092.stdout:0/32: rmdir d3 39 2024-09-17T01:51:58.831 INFO:tasks.workunit.client.1.smithi092.stdout:0/33: write d3/f5 [145267,77381] 0 2024-09-17T01:51:58.834 INFO:tasks.workunit.client.1.smithi092.stdout:0/34: link d3/l8 d3/l9 0 2024-09-17T01:51:58.835 INFO:tasks.workunit.client.1.smithi092.stdout:0/35: truncate d3/f5 389637 0 2024-09-17T01:51:58.837 INFO:tasks.workunit.client.1.smithi092.stdout:0/36: mkdir d3/da 0 2024-09-17T01:51:58.837 INFO:tasks.workunit.client.1.smithi092.stdout:0/37: chown d3/f5 15789 1 2024-09-17T01:51:58.838 INFO:tasks.workunit.client.1.smithi092.stdout:0/38: write d3/f4 [243811,97547] 0 2024-09-17T01:51:58.845 INFO:tasks.workunit.client.1.smithi092.stdout:0/39: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:51:58.845 INFO:tasks.workunit.client.1.smithi092.stdout:1/14: sync 2024-09-17T01:51:58.846 INFO:tasks.workunit.client.1.smithi092.stdout:4/28: sync 2024-09-17T01:51:58.846 INFO:tasks.workunit.client.1.smithi092.stdout:8/11: sync 2024-09-17T01:51:58.846 INFO:tasks.workunit.client.1.smithi092.stdout:5/17: sync 2024-09-17T01:51:58.848 INFO:tasks.workunit.client.1.smithi092.stdout:1/15: mknod c1 0 2024-09-17T01:51:58.850 INFO:tasks.workunit.client.1.smithi092.stdout:4/29: mknod d4/c6 0 2024-09-17T01:51:58.851 INFO:tasks.workunit.client.1.smithi092.stdout:4/30: chown d4/c6 109 1 2024-09-17T01:51:58.853 INFO:tasks.workunit.client.1.smithi092.stdout:4/31: write f1 [1199978,119911] 0 2024-09-17T01:51:58.853 INFO:tasks.workunit.client.1.smithi092.stdout:5/18: rename d0/f1 to d0/f6 0 2024-09-17T01:51:58.855 INFO:tasks.workunit.client.1.smithi092.stdout:1/16: mknod c2 0 2024-09-17T01:51:58.856 INFO:tasks.workunit.client.1.smithi092.stdout:5/19: write d0/f5 [33047,15868] 0 2024-09-17T01:51:58.857 INFO:tasks.workunit.client.1.smithi092.stdout:8/12: dwrite f4 [0,4194304] 0 2024-09-17T01:51:58.858 INFO:tasks.workunit.client.1.smithi092.stdout:5/20: read d0/f6 [2426759,25251] 0 2024-09-17T01:51:58.858 INFO:tasks.workunit.client.1.smithi092.stdout:8/13: chown l0 32139780 1 2024-09-17T01:51:58.858 INFO:tasks.workunit.client.1.smithi092.stdout:5/21: stat d0/f6 0 2024-09-17T01:51:58.860 INFO:tasks.workunit.client.1.smithi092.stdout:5/22: write d0/f4 [403545,65591] 0 2024-09-17T01:51:58.860 INFO:tasks.workunit.client.1.smithi092.stdout:1/17: fdatasync f0 0 2024-09-17T01:51:58.861 INFO:tasks.workunit.client.1.smithi092.stdout:4/32: mknod d4/d5/c7 0 2024-09-17T01:51:58.861 INFO:tasks.workunit.client.1.smithi092.stdout:5/23: chown d0/f5 221235 1 2024-09-17T01:51:58.861 INFO:tasks.workunit.client.1.smithi092.stdout:8/14: write f2 [3757678,36119] 0 2024-09-17T01:51:58.863 INFO:tasks.workunit.client.1.smithi092.stdout:4/33: chown d4/c6 180074608 1 2024-09-17T01:51:58.863 INFO:tasks.workunit.client.1.smithi092.stdout:0/40: fdatasync d3/f5 0 2024-09-17T01:51:58.863 INFO:tasks.workunit.client.1.smithi092.stdout:5/24: write d0/f5 [591990,23219] 0 2024-09-17T01:51:58.867 INFO:tasks.workunit.client.1.smithi092.stdout:4/34: write f1 [708363,45630] 0 2024-09-17T01:51:58.871 INFO:tasks.workunit.client.1.smithi092.stdout:5/25: rmdir d0 39 2024-09-17T01:51:58.871 INFO:tasks.workunit.client.1.smithi092.stdout:1/18: dread f0 [0,4194304] 0 2024-09-17T01:51:58.876 INFO:tasks.workunit.client.1.smithi092.stdout:8/15: dwrite f1 [0,4194304] 0 2024-09-17T01:51:58.877 INFO:tasks.workunit.client.1.smithi092.stdout:6/49: sync 2024-09-17T01:51:58.878 INFO:tasks.workunit.client.1.smithi092.stdout:2/70: sync 2024-09-17T01:51:58.878 INFO:tasks.workunit.client.1.smithi092.stdout:7/121: sync 2024-09-17T01:51:58.878 INFO:tasks.workunit.client.1.smithi092.stdout:9/106: sync 2024-09-17T01:51:58.878 INFO:tasks.workunit.client.1.smithi092.stdout:1/19: unlink f0 0 2024-09-17T01:51:58.878 INFO:tasks.workunit.client.1.smithi092.stdout:5/26: write d0/f4 [652195,65651] 0 2024-09-17T01:51:58.880 INFO:tasks.workunit.client.1.smithi092.stdout:6/50: chown d3/f5 103 1 2024-09-17T01:51:58.882 INFO:tasks.workunit.client.1.smithi092.stdout:1/20: mknod c3 0 2024-09-17T01:51:58.882 INFO:tasks.workunit.client.1.smithi092.stdout:6/51: rmdir d3 39 2024-09-17T01:51:58.885 INFO:tasks.workunit.client.1.smithi092.stdout:9/107: write d0/d7/f11 [1854447,129796] 0 2024-09-17T01:51:58.885 INFO:tasks.workunit.client.1.smithi092.stdout:0/41: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:51:58.885 INFO:tasks.workunit.client.1.smithi092.stdout:8/16: link f2 f5 0 2024-09-17T01:51:58.886 INFO:tasks.workunit.client.1.smithi092.stdout:4/35: dwrite f1 [0,4194304] 0 2024-09-17T01:51:58.887 INFO:tasks.workunit.client.1.smithi092.stdout:8/17: fdatasync f4 0 2024-09-17T01:51:58.888 INFO:tasks.workunit.client.1.smithi092.stdout:1/21: symlink l4 0 2024-09-17T01:51:58.888 INFO:tasks.workunit.client.1.smithi092.stdout:1/22: truncate - no filename 2024-09-17T01:51:58.888 INFO:tasks.workunit.client.1.smithi092.stdout:1/23: write - no filename 2024-09-17T01:51:58.888 INFO:tasks.workunit.client.1.smithi092.stdout:1/24: write - no filename 2024-09-17T01:51:58.890 INFO:tasks.workunit.client.1.smithi092.stdout:5/27: rename d0/f4 to d0/f7 0 2024-09-17T01:51:58.893 INFO:tasks.workunit.client.1.smithi092.stdout:7/122: dread d3/db/f15 [4194304,4194304] 0 2024-09-17T01:51:58.895 INFO:tasks.workunit.client.1.smithi092.stdout:7/123: fsync d3/f14 0 2024-09-17T01:51:58.895 INFO:tasks.workunit.client.1.smithi092.stdout:2/71: link f5 d10/d15/f16 0 2024-09-17T01:51:58.896 INFO:tasks.workunit.client.1.smithi092.stdout:8/18: mknod c6 0 2024-09-17T01:51:58.899 INFO:tasks.workunit.client.1.smithi092.stdout:1/25: rename c2 to c5 0 2024-09-17T01:51:58.900 INFO:tasks.workunit.client.1.smithi092.stdout:5/28: dread d0/f5 [0,4194304] 0 2024-09-17T01:51:58.901 INFO:tasks.workunit.client.1.smithi092.stdout:8/19: fdatasync f1 0 2024-09-17T01:51:58.902 INFO:tasks.workunit.client.1.smithi092.stdout:9/108: rename d0/d5/l9 to d0/d7/l1d 0 2024-09-17T01:51:58.909 INFO:tasks.workunit.client.1.smithi092.stdout:1/26: creat f6 x:0 0 0 2024-09-17T01:51:58.910 INFO:tasks.workunit.client.1.smithi092.stdout:0/42: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:51:58.910 INFO:tasks.workunit.client.1.smithi092.stdout:4/36: dwrite f2 [0,4194304] 0 2024-09-17T01:51:58.912 INFO:tasks.workunit.client.1.smithi092.stdout:7/124: unlink d3/db/d18/c2a 0 2024-09-17T01:51:58.912 INFO:tasks.workunit.client.0.smithi031.stdout:1/245: sync 2024-09-17T01:51:58.913 INFO:tasks.workunit.client.0.smithi031.stdout:2/283: sync 2024-09-17T01:51:58.913 INFO:tasks.workunit.client.0.smithi031.stdout:8/279: sync 2024-09-17T01:51:58.913 INFO:tasks.workunit.client.0.smithi031.stdout:9/184: sync 2024-09-17T01:51:58.913 INFO:tasks.workunit.client.0.smithi031.stdout:0/215: sync 2024-09-17T01:51:58.913 INFO:tasks.workunit.client.0.smithi031.stdout:3/164: sync 2024-09-17T01:51:58.914 INFO:tasks.workunit.client.0.smithi031.stdout:5/238: sync 2024-09-17T01:51:58.914 INFO:tasks.workunit.client.0.smithi031.stdout:7/207: sync 2024-09-17T01:51:58.914 INFO:tasks.workunit.client.0.smithi031.stdout:4/219: sync 2024-09-17T01:51:58.914 INFO:tasks.workunit.client.0.smithi031.stdout:6/321: sync 2024-09-17T01:51:58.915 INFO:tasks.workunit.client.1.smithi092.stdout:1/27: write f6 [1023586,12475] 0 2024-09-17T01:51:58.916 INFO:tasks.workunit.client.0.smithi031.stdout:0/216: fdatasync d0/d29/f3e 0 2024-09-17T01:51:58.916 INFO:tasks.workunit.client.0.smithi031.stdout:2/284: chown d1/d3/fd 1850870 1 2024-09-17T01:51:58.917 INFO:tasks.workunit.client.1.smithi092.stdout:5/29: write d0/f6 [4170022,2436] 0 2024-09-17T01:51:58.917 INFO:tasks.workunit.client.0.smithi031.stdout:8/280: mknod d0/df/dd/c53 0 2024-09-17T01:51:58.917 INFO:tasks.workunit.client.1.smithi092.stdout:9/109: unlink d0/d7/fe 0 2024-09-17T01:51:58.919 INFO:tasks.workunit.client.0.smithi031.stdout:9/185: mkdir d3/d10/d36 0 2024-09-17T01:51:58.919 INFO:tasks.workunit.client.0.smithi031.stdout:3/165: write db/df/f22 [405566,80672] 0 2024-09-17T01:51:58.920 INFO:tasks.workunit.client.1.smithi092.stdout:2/72: dwrite d10/f13 [0,4194304] 0 2024-09-17T01:51:58.920 INFO:tasks.workunit.client.0.smithi031.stdout:6/322: symlink d23/d63/d47/l6e 0 2024-09-17T01:51:58.921 INFO:tasks.workunit.client.1.smithi092.stdout:4/37: mkdir d4/d5/d8 0 2024-09-17T01:51:58.922 INFO:tasks.workunit.client.1.smithi092.stdout:6/52: write f1 [2671842,119780] 0 2024-09-17T01:51:58.923 INFO:tasks.workunit.client.0.smithi031.stdout:9/186: readlink d3/d4/d29/l33 0 2024-09-17T01:51:58.923 INFO:tasks.workunit.client.0.smithi031.stdout:1/246: creat d4/d1e/f4f x:0 0 0 2024-09-17T01:51:58.924 INFO:tasks.workunit.client.0.smithi031.stdout:4/220: write d8/d18/f29 [754141,106093] 0 2024-09-17T01:51:58.925 INFO:tasks.workunit.client.0.smithi031.stdout:8/281: mkdir d0/d5/d54 0 2024-09-17T01:51:58.925 INFO:tasks.workunit.client.1.smithi092.stdout:2/73: mknod d10/c17 0 2024-09-17T01:51:58.926 INFO:tasks.workunit.client.0.smithi031.stdout:9/187: stat d3/d4/f27 0 2024-09-17T01:51:58.926 INFO:tasks.workunit.client.0.smithi031.stdout:0/217: rmdir d0/d29/d33/d5 39 2024-09-17T01:51:58.927 INFO:tasks.workunit.client.1.smithi092.stdout:8/20: dread f4 [0,4194304] 0 2024-09-17T01:51:58.928 INFO:tasks.workunit.client.1.smithi092.stdout:8/21: stat l0 0 2024-09-17T01:51:58.928 INFO:tasks.workunit.client.1.smithi092.stdout:4/38: rename d4/d5/d8 to d4/d5/d8/d9 22 2024-09-17T01:51:58.928 INFO:tasks.workunit.client.0.smithi031.stdout:7/208: dwrite db/d18/f2f [0,4194304] 0 2024-09-17T01:51:58.929 INFO:tasks.workunit.client.0.smithi031.stdout:3/166: write db/f19 [2975521,27522] 0 2024-09-17T01:51:58.929 INFO:tasks.workunit.client.0.smithi031.stdout:4/221: chown d8/d18 52947 1 2024-09-17T01:51:58.931 INFO:tasks.workunit.client.0.smithi031.stdout:6/323: creat d23/d63/d47/f6f x:0 0 0 2024-09-17T01:51:58.931 INFO:tasks.workunit.client.1.smithi092.stdout:3/25: sync 2024-09-17T01:51:58.932 INFO:tasks.workunit.client.1.smithi092.stdout:3/26: dread - no filename 2024-09-17T01:51:58.933 INFO:tasks.workunit.client.0.smithi031.stdout:2/285: dread d1/d3/df/d19/d1e/f29 [0,4194304] 0 2024-09-17T01:51:58.933 INFO:tasks.workunit.client.1.smithi092.stdout:3/27: chown d4/l5 654122 1 2024-09-17T01:51:58.933 INFO:tasks.workunit.client.1.smithi092.stdout:3/28: fsync - no filename 2024-09-17T01:51:58.934 INFO:tasks.workunit.client.1.smithi092.stdout:5/30: rename d0/f6 to d0/f8 0 2024-09-17T01:51:58.935 INFO:tasks.workunit.client.0.smithi031.stdout:4/222: readlink d8/d22/d25/l34 0 2024-09-17T01:51:58.935 INFO:tasks.workunit.client.0.smithi031.stdout:8/282: mkdir d0/d5/d55 0 2024-09-17T01:51:58.935 INFO:tasks.workunit.client.1.smithi092.stdout:5/31: readlink d0/l2 0 2024-09-17T01:51:58.936 INFO:tasks.workunit.client.1.smithi092.stdout:9/110: dwrite d0/f16 [0,4194304] 0 2024-09-17T01:51:58.937 INFO:tasks.workunit.client.0.smithi031.stdout:6/324: mkdir d23/d50/d6a/d70 0 2024-09-17T01:51:58.939 INFO:tasks.workunit.client.0.smithi031.stdout:3/167: creat db/f34 x:0 0 0 2024-09-17T01:51:58.942 INFO:tasks.workunit.client.1.smithi092.stdout:8/22: rename f4 to f7 0 2024-09-17T01:51:58.942 INFO:tasks.workunit.client.1.smithi092.stdout:9/111: chown d0/fd 932119 1 2024-09-17T01:51:58.942 INFO:tasks.workunit.client.1.smithi092.stdout:1/28: link l4 l7 0 2024-09-17T01:51:58.943 INFO:tasks.workunit.client.0.smithi031.stdout:2/286: dread d1/f14 [0,4194304] 0 2024-09-17T01:51:58.943 INFO:tasks.workunit.client.0.smithi031.stdout:4/223: rename d8/d22/c23 to d8/d3a/c3f 0 2024-09-17T01:51:58.943 INFO:tasks.workunit.client.0.smithi031.stdout:6/325: write d23/d63/f59 [394910,108113] 0 2024-09-17T01:51:58.944 INFO:tasks.workunit.client.1.smithi092.stdout:6/53: creat d3/fa x:0 0 0 2024-09-17T01:51:58.944 INFO:tasks.workunit.client.1.smithi092.stdout:7/125: getdents d3/db/d18 0 2024-09-17T01:51:58.946 INFO:tasks.workunit.client.1.smithi092.stdout:6/54: dread - d3/fa zero size 2024-09-17T01:51:58.947 INFO:tasks.workunit.client.1.smithi092.stdout:2/74: dwrite d10/f13 [0,4194304] 0 2024-09-17T01:51:58.947 INFO:tasks.workunit.client.1.smithi092.stdout:9/112: truncate d0/df/f18 681157 0 2024-09-17T01:51:58.947 INFO:tasks.workunit.client.1.smithi092.stdout:0/43: truncate f1 10993249 0 2024-09-17T01:51:58.949 INFO:tasks.workunit.client.1.smithi092.stdout:4/39: mknod d4/d5/d8/ca 0 2024-09-17T01:51:58.950 INFO:tasks.workunit.client.0.smithi031.stdout:0/218: dwrite d0/d29/d44/f4c [0,4194304] 0 2024-09-17T01:51:58.950 INFO:tasks.workunit.client.1.smithi092.stdout:6/55: write d3/f6 [728449,75801] 0 2024-09-17T01:51:58.950 INFO:tasks.workunit.client.1.smithi092.stdout:9/113: chown d0/df/d17/c19 19129 1 2024-09-17T01:51:58.951 INFO:tasks.workunit.client.1.smithi092.stdout:1/29: rename c1 to c8 0 2024-09-17T01:51:58.952 INFO:tasks.workunit.client.0.smithi031.stdout:3/168: write db/df/f31 [57327,7141] 0 2024-09-17T01:51:58.952 INFO:tasks.workunit.client.0.smithi031.stdout:6/326: truncate d23/d63/f4f 5214572 0 2024-09-17T01:51:58.953 INFO:tasks.workunit.client.0.smithi031.stdout:8/283: rename d0/df/d19/l1f to d0/d5/d54/l56 0 2024-09-17T01:51:58.953 INFO:tasks.workunit.client.0.smithi031.stdout:7/209: link db/c39 db/d1c/c3d 0 2024-09-17T01:51:58.954 INFO:tasks.workunit.client.0.smithi031.stdout:8/284: fdatasync d0/df/dd/f51 0 2024-09-17T01:51:58.954 INFO:tasks.workunit.client.0.smithi031.stdout:9/188: symlink d3/d10/d36/l37 0 2024-09-17T01:51:58.956 INFO:tasks.workunit.client.0.smithi031.stdout:2/287: truncate d1/d3/fa 2896675 0 2024-09-17T01:51:58.957 INFO:tasks.workunit.client.1.smithi092.stdout:2/75: mknod d10/c18 0 2024-09-17T01:51:58.957 INFO:tasks.workunit.client.1.smithi092.stdout:2/76: readlink l7 0 2024-09-17T01:51:58.957 INFO:tasks.workunit.client.1.smithi092.stdout:1/30: symlink l9 0 2024-09-17T01:51:58.958 INFO:tasks.workunit.client.1.smithi092.stdout:1/31: fsync f6 0 2024-09-17T01:51:58.959 INFO:tasks.workunit.client.0.smithi031.stdout:3/169: unlink db/df/d1c/f26 0 2024-09-17T01:51:58.959 INFO:tasks.workunit.client.1.smithi092.stdout:6/56: symlink d3/lb 0 2024-09-17T01:51:58.961 INFO:tasks.workunit.client.1.smithi092.stdout:1/32: readlink l9 0 2024-09-17T01:51:58.961 INFO:tasks.workunit.client.1.smithi092.stdout:9/114: dread d0/fd [0,4194304] 0 2024-09-17T01:51:58.961 INFO:tasks.workunit.client.1.smithi092.stdout:4/40: dwrite f2 [0,4194304] 0 2024-09-17T01:51:58.961 INFO:tasks.workunit.client.0.smithi031.stdout:3/170: chown db/df/d1c/c24 9 1 2024-09-17T01:51:58.962 INFO:tasks.workunit.client.1.smithi092.stdout:2/77: creat d10/f19 x:0 0 0 2024-09-17T01:51:58.963 INFO:tasks.workunit.client.1.smithi092.stdout:3/29: getdents d4 0 2024-09-17T01:51:58.963 INFO:tasks.workunit.client.1.smithi092.stdout:2/78: chown d10/f19 97557398 1 2024-09-17T01:51:58.964 INFO:tasks.workunit.client.1.smithi092.stdout:6/57: symlink d3/lc 0 2024-09-17T01:51:58.965 INFO:tasks.workunit.client.1.smithi092.stdout:6/58: read - d3/fa zero size 2024-09-17T01:51:58.969 INFO:tasks.workunit.client.0.smithi031.stdout:1/247: dread d4/f17 [0,4194304] 0 2024-09-17T01:51:58.970 INFO:tasks.workunit.client.1.smithi092.stdout:2/79: creat d10/f1a x:0 0 0 2024-09-17T01:51:58.972 INFO:tasks.workunit.client.0.smithi031.stdout:8/285: creat d0/d5/d55/f57 x:0 0 0 2024-09-17T01:51:58.972 INFO:tasks.workunit.client.1.smithi092.stdout:3/30: link l2 d4/l6 0 2024-09-17T01:51:58.972 INFO:tasks.workunit.client.1.smithi092.stdout:3/31: dwrite - no filename 2024-09-17T01:51:58.972 INFO:tasks.workunit.client.1.smithi092.stdout:3/32: read - no filename 2024-09-17T01:51:58.973 INFO:tasks.workunit.client.1.smithi092.stdout:9/115: write d0/f16 [4682280,94543] 0 2024-09-17T01:51:58.973 INFO:tasks.workunit.client.0.smithi031.stdout:3/171: creat db/d29/d2f/f35 x:0 0 0 2024-09-17T01:51:58.973 INFO:tasks.workunit.client.0.smithi031.stdout:6/327: link c17 d23/d50/d6a/d70/c71 0 2024-09-17T01:51:58.974 INFO:tasks.workunit.client.0.smithi031.stdout:1/248: write d4/d1a/f25 [1329473,17945] 0 2024-09-17T01:51:58.974 INFO:tasks.workunit.client.0.smithi031.stdout:2/288: dwrite d1/d3/df/f2b [0,4194304] 0 2024-09-17T01:51:58.974 INFO:tasks.workunit.client.1.smithi092.stdout:6/59: dwrite d3/fa [0,4194304] 0 2024-09-17T01:51:58.974 INFO:tasks.workunit.client.1.smithi092.stdout:4/41: getdents d4/d5 0 2024-09-17T01:51:58.975 INFO:tasks.workunit.client.0.smithi031.stdout:4/224: getdents d8/d22/d25 0 2024-09-17T01:51:58.976 INFO:tasks.workunit.client.1.smithi092.stdout:4/42: stat c0 0 2024-09-17T01:51:58.976 INFO:tasks.workunit.client.0.smithi031.stdout:0/219: creat d0/d29/d33/d2a/d25/f4f x:0 0 0 2024-09-17T01:51:58.976 INFO:tasks.workunit.client.1.smithi092.stdout:2/80: write fa [215449,23590] 0 2024-09-17T01:51:58.977 INFO:tasks.workunit.client.0.smithi031.stdout:1/249: chown d4/d1a/d2d 599415 1 2024-09-17T01:51:58.978 INFO:tasks.workunit.client.1.smithi092.stdout:6/60: mkdir d3/dd 0 2024-09-17T01:51:58.978 INFO:tasks.workunit.client.1.smithi092.stdout:9/116: read d0/fd [1225201,170] 0 2024-09-17T01:51:58.978 INFO:tasks.workunit.client.1.smithi092.stdout:2/81: fdatasync fe 0 2024-09-17T01:51:58.979 INFO:tasks.workunit.client.0.smithi031.stdout:6/328: write d23/d63/f4a [2255535,312] 0 2024-09-17T01:51:58.979 INFO:tasks.workunit.client.0.smithi031.stdout:4/225: write d8/d18/f2d [487513,4270] 0 2024-09-17T01:51:58.980 INFO:tasks.workunit.client.0.smithi031.stdout:9/189: dwrite d3/d10/f24 [0,4194304] 0 2024-09-17T01:51:58.980 INFO:tasks.workunit.client.0.smithi031.stdout:2/289: dread - d1/d3/df/d19/d1e/f39 zero size 2024-09-17T01:51:58.981 INFO:tasks.workunit.client.0.smithi031.stdout:3/172: unlink db/d29/d2f/f35 0 2024-09-17T01:51:58.985 INFO:tasks.workunit.client.0.smithi031.stdout:3/173: mknod db/c36 0 2024-09-17T01:51:58.986 INFO:tasks.workunit.client.1.smithi092.stdout:4/43: symlink d4/d5/d8/lb 0 2024-09-17T01:51:58.987 INFO:tasks.workunit.client.1.smithi092.stdout:4/44: stat d4/d5 0 2024-09-17T01:51:58.989 INFO:tasks.workunit.client.1.smithi092.stdout:9/117: dwrite d0/f6 [4194304,4194304] 0 2024-09-17T01:51:58.989 INFO:tasks.workunit.client.1.smithi092.stdout:8/23: truncate f7 1350027 0 2024-09-17T01:51:58.990 INFO:tasks.workunit.client.1.smithi092.stdout:8/24: fdatasync f1 0 2024-09-17T01:51:58.991 INFO:tasks.workunit.client.1.smithi092.stdout:8/25: dread - f3 zero size 2024-09-17T01:51:58.992 INFO:tasks.workunit.client.0.smithi031.stdout:0/220: mkdir d0/d29/d33/d5/d50 0 2024-09-17T01:51:58.994 INFO:tasks.workunit.client.1.smithi092.stdout:3/33: link d4/l5 d4/l7 0 2024-09-17T01:51:58.994 INFO:tasks.workunit.client.1.smithi092.stdout:3/34: write - no filename 2024-09-17T01:51:58.994 INFO:tasks.workunit.client.0.smithi031.stdout:8/286: dwrite d0/d5/f40 [0,4194304] 0 2024-09-17T01:51:58.994 INFO:tasks.workunit.client.0.smithi031.stdout:9/190: read d3/d10/f14 [3536865,60598] 0 2024-09-17T01:51:58.995 INFO:tasks.workunit.client.1.smithi092.stdout:1/33: truncate f6 881929 0 2024-09-17T01:51:58.996 INFO:tasks.workunit.client.0.smithi031.stdout:6/329: mkdir d23/d50/d6a/d72 0 2024-09-17T01:51:58.997 INFO:tasks.workunit.client.1.smithi092.stdout:2/82: creat d10/d15/f1b x:0 0 0 2024-09-17T01:51:58.998 INFO:tasks.workunit.client.0.smithi031.stdout:1/250: dread d4/d1e/f49 [0,4194304] 0 2024-09-17T01:51:58.998 INFO:tasks.workunit.client.0.smithi031.stdout:8/287: truncate d0/df/dd/f51 415615 0 2024-09-17T01:51:58.999 INFO:tasks.workunit.client.0.smithi031.stdout:4/226: creat d8/d3a/f40 x:0 0 0 2024-09-17T01:51:59.000 INFO:tasks.workunit.client.1.smithi092.stdout:2/83: truncate d10/f19 784252 0 2024-09-17T01:51:59.000 INFO:tasks.workunit.client.1.smithi092.stdout:6/61: truncate f2 2201890 0 2024-09-17T01:51:59.001 INFO:tasks.workunit.client.0.smithi031.stdout:2/290: fdatasync d1/d3/f1c 0 2024-09-17T01:51:59.002 INFO:tasks.workunit.client.1.smithi092.stdout:6/62: write d3/fa [3735005,43275] 0 2024-09-17T01:51:59.002 INFO:tasks.workunit.client.1.smithi092.stdout:2/84: truncate d10/d15/f1b 507846 0 2024-09-17T01:51:59.003 INFO:tasks.workunit.client.1.smithi092.stdout:6/63: fsync d3/f6 0 2024-09-17T01:51:59.004 INFO:tasks.workunit.client.1.smithi092.stdout:3/35: mknod d4/c8 0 2024-09-17T01:51:59.004 INFO:tasks.workunit.client.0.smithi031.stdout:3/174: mkdir db/df/d1d/d37 0 2024-09-17T01:51:59.006 INFO:tasks.workunit.client.0.smithi031.stdout:3/175: stat db/df/f31 0 2024-09-17T01:51:59.007 INFO:tasks.workunit.client.1.smithi092.stdout:9/118: rename d0/d7/l1d to d0/d7/l1e 0 2024-09-17T01:51:59.008 INFO:tasks.workunit.client.0.smithi031.stdout:0/221: chown d0/d29/d33/d2a/f39 0 1 2024-09-17T01:51:59.010 INFO:tasks.workunit.client.1.smithi092.stdout:3/36: symlink d4/l9 0 2024-09-17T01:51:59.010 INFO:tasks.workunit.client.1.smithi092.stdout:3/37: dwrite - no filename 2024-09-17T01:51:59.010 INFO:tasks.workunit.client.1.smithi092.stdout:3/38: write - no filename 2024-09-17T01:51:59.010 INFO:tasks.workunit.client.1.smithi092.stdout:3/39: dwrite - no filename 2024-09-17T01:51:59.011 INFO:tasks.workunit.client.1.smithi092.stdout:1/34: rename l4 to la 0 2024-09-17T01:51:59.012 INFO:tasks.workunit.client.1.smithi092.stdout:1/35: chown l9 136290237 1 2024-09-17T01:51:59.012 INFO:tasks.workunit.client.1.smithi092.stdout:9/119: mkdir d0/df/d17/d1f 0 2024-09-17T01:51:59.013 INFO:tasks.workunit.client.0.smithi031.stdout:6/330: dread d23/d63/d47/f4c [0,4194304] 0 2024-09-17T01:51:59.015 INFO:tasks.workunit.client.1.smithi092.stdout:3/40: mknod d4/ca 0 2024-09-17T01:51:59.016 INFO:tasks.workunit.client.1.smithi092.stdout:3/41: chown d4/l9 879 1 2024-09-17T01:51:59.017 INFO:tasks.workunit.client.0.smithi031.stdout:8/288: dread d0/f28 [0,4194304] 0 2024-09-17T01:51:59.017 INFO:tasks.workunit.client.1.smithi092.stdout:6/64: link d3/l9 d3/le 0 2024-09-17T01:51:59.018 INFO:tasks.workunit.client.0.smithi031.stdout:2/291: link d1/d3/fd d1/d3/d45/d4a/f6c 0 2024-09-17T01:51:59.018 INFO:tasks.workunit.client.1.smithi092.stdout:3/42: symlink d4/lb 0 2024-09-17T01:51:59.019 INFO:tasks.workunit.client.0.smithi031.stdout:9/191: truncate d3/d4/d29/f2b 149199 0 2024-09-17T01:51:59.020 INFO:tasks.workunit.client.0.smithi031.stdout:8/289: chown d0/df 7046355 1 2024-09-17T01:51:59.020 INFO:tasks.workunit.client.1.smithi092.stdout:6/65: mkdir d3/dd/df 0 2024-09-17T01:51:59.020 INFO:tasks.workunit.client.0.smithi031.stdout:4/227: dwrite d8/fb [0,4194304] 0 2024-09-17T01:51:59.021 INFO:tasks.workunit.client.1.smithi092.stdout:3/43: symlink d4/lc 0 2024-09-17T01:51:59.021 INFO:tasks.workunit.client.0.smithi031.stdout:0/222: rename d0/l45 to d0/d29/d33/d2a/d25/d38/l51 0 2024-09-17T01:51:59.023 INFO:tasks.workunit.client.0.smithi031.stdout:1/251: dwrite d4/d1e/f3b [0,4194304] 0 2024-09-17T01:51:59.023 INFO:tasks.workunit.client.1.smithi092.stdout:0/44: write f1 [8078766,1532] 0 2024-09-17T01:51:59.023 INFO:tasks.workunit.client.1.smithi092.stdout:9/120: dread d0/d5/f8 [0,4194304] 0 2024-09-17T01:51:59.025 INFO:tasks.workunit.client.0.smithi031.stdout:8/290: chown d0/df/d19/f31 3384 1 2024-09-17T01:51:59.026 INFO:tasks.workunit.client.0.smithi031.stdout:4/228: truncate d8/d3a/f40 494098 0 2024-09-17T01:51:59.028 INFO:tasks.workunit.client.0.smithi031.stdout:8/291: stat d0/df/d19/f33 0 2024-09-17T01:51:59.028 INFO:tasks.workunit.client.0.smithi031.stdout:7/210: dwrite db/f10 [0,4194304] 0 2024-09-17T01:51:59.028 INFO:tasks.workunit.client.0.smithi031.stdout:6/331: creat d23/d50/d6a/d72/f73 x:0 0 0 2024-09-17T01:51:59.029 INFO:tasks.workunit.client.0.smithi031.stdout:7/211: stat db/l13 0 2024-09-17T01:51:59.031 INFO:tasks.workunit.client.0.smithi031.stdout:6/332: truncate f1c 1904390 0 2024-09-17T01:51:59.031 INFO:tasks.workunit.client.0.smithi031.stdout:1/252: creat d4/d1a/d43/f50 x:0 0 0 2024-09-17T01:51:59.031 INFO:tasks.workunit.client.0.smithi031.stdout:8/292: truncate d0/df/dd/f51 1062773 0 2024-09-17T01:51:59.031 INFO:tasks.workunit.client.0.smithi031.stdout:3/176: link db/df/d1c/l27 db/df/d1d/d37/l38 0 2024-09-17T01:51:59.032 INFO:tasks.workunit.client.0.smithi031.stdout:6/333: stat l2 0 2024-09-17T01:51:59.033 INFO:tasks.workunit.client.1.smithi092.stdout:0/45: dwrite f1 [8388608,4194304] 0 2024-09-17T01:51:59.034 INFO:tasks.workunit.client.0.smithi031.stdout:8/293: chown d0/l2e 123392 1 2024-09-17T01:51:59.035 INFO:tasks.workunit.client.0.smithi031.stdout:4/229: mkdir d8/d3a/d41 0 2024-09-17T01:51:59.037 INFO:tasks.workunit.client.1.smithi092.stdout:9/121: dread d0/d5/f8 [0,4194304] 0 2024-09-17T01:51:59.037 INFO:tasks.workunit.client.0.smithi031.stdout:7/212: mknod db/d1c/c3e 0 2024-09-17T01:51:59.038 INFO:tasks.workunit.client.1.smithi092.stdout:9/122: chown d0/c1a 68 1 2024-09-17T01:51:59.039 INFO:tasks.workunit.client.1.smithi092.stdout:4/45: truncate f2 1045344 0 2024-09-17T01:51:59.039 INFO:tasks.workunit.client.0.smithi031.stdout:0/223: symlink d0/d29/d33/d2a/d25/l52 0 2024-09-17T01:51:59.040 INFO:tasks.workunit.client.0.smithi031.stdout:0/224: write d0/d29/d33/f28 [430427,81644] 0 2024-09-17T01:51:59.046 INFO:tasks.workunit.client.0.smithi031.stdout:9/192: creat d3/d10/f38 x:0 0 0 2024-09-17T01:51:59.047 INFO:tasks.workunit.client.0.smithi031.stdout:4/230: symlink d8/d22/l42 0 2024-09-17T01:51:59.047 INFO:tasks.workunit.client.0.smithi031.stdout:9/193: read - d3/d4/f27 zero size 2024-09-17T01:51:59.049 INFO:tasks.workunit.client.1.smithi092.stdout:0/46: link d3/f4 d3/da/fb 0 2024-09-17T01:51:59.049 INFO:tasks.workunit.client.1.smithi092.stdout:8/26: dwrite f5 [0,4194304] 0 2024-09-17T01:51:59.049 INFO:tasks.workunit.client.0.smithi031.stdout:9/194: write d3/d19/f22 [47510,116739] 0 2024-09-17T01:51:59.050 INFO:tasks.workunit.client.1.smithi092.stdout:2/85: write d10/d15/f16 [333139,11330] 0 2024-09-17T01:51:59.051 INFO:tasks.workunit.client.0.smithi031.stdout:7/213: symlink db/l3f 0 2024-09-17T01:51:59.052 INFO:tasks.workunit.client.1.smithi092.stdout:3/44: link l2 d4/ld 0 2024-09-17T01:51:59.052 INFO:tasks.workunit.client.1.smithi092.stdout:3/45: write - no filename 2024-09-17T01:51:59.052 INFO:tasks.workunit.client.1.smithi092.stdout:1/36: dwrite f6 [0,4194304] 0 2024-09-17T01:51:59.052 INFO:tasks.workunit.client.0.smithi031.stdout:4/231: mknod d8/d18/c43 0 2024-09-17T01:51:59.053 INFO:tasks.workunit.client.1.smithi092.stdout:4/46: creat d4/fc x:0 0 0 2024-09-17T01:51:59.054 INFO:tasks.workunit.client.0.smithi031.stdout:3/177: creat db/df/f39 x:0 0 0 2024-09-17T01:51:59.056 INFO:tasks.workunit.client.1.smithi092.stdout:3/46: chown d4 62 1 2024-09-17T01:51:59.056 INFO:tasks.workunit.client.1.smithi092.stdout:3/47: write - no filename 2024-09-17T01:51:59.056 INFO:tasks.workunit.client.0.smithi031.stdout:3/178: fsync db/f11 0 2024-09-17T01:51:59.056 INFO:tasks.workunit.client.0.smithi031.stdout:0/225: mknod d0/d29/d33/d2a/c53 0 2024-09-17T01:51:59.057 INFO:tasks.workunit.client.1.smithi092.stdout:3/48: rename d4 to d4/de 22 2024-09-17T01:51:59.057 INFO:tasks.workunit.client.1.smithi092.stdout:1/37: write f6 [803448,27552] 0 2024-09-17T01:51:59.058 INFO:tasks.workunit.client.0.smithi031.stdout:1/253: truncate d4/d1a/d2d/fa 4745038 0 2024-09-17T01:51:59.058 INFO:tasks.workunit.client.1.smithi092.stdout:2/86: dread d10/f19 [0,4194304] 0 2024-09-17T01:51:59.059 INFO:tasks.workunit.client.0.smithi031.stdout:1/254: chown d4/d1a/d2d/fe 11721 1 2024-09-17T01:51:59.059 INFO:tasks.workunit.client.0.smithi031.stdout:1/255: fsync d4/d1a/f25 0 2024-09-17T01:51:59.060 INFO:tasks.workunit.client.0.smithi031.stdout:1/256: dread - d4/d1e/d3f/f44 zero size 2024-09-17T01:51:59.061 INFO:tasks.workunit.client.1.smithi092.stdout:8/27: unlink f2 0 2024-09-17T01:51:59.062 INFO:tasks.workunit.client.0.smithi031.stdout:4/232: truncate d8/d18/f2f 433232 0 2024-09-17T01:51:59.062 INFO:tasks.workunit.client.0.smithi031.stdout:7/214: creat db/d1c/f40 x:0 0 0 2024-09-17T01:51:59.064 INFO:tasks.workunit.client.0.smithi031.stdout:9/195: mkdir d3/d10/d39 0 2024-09-17T01:51:59.065 INFO:tasks.workunit.client.1.smithi092.stdout:6/66: getdents d3/dd 0 2024-09-17T01:51:59.066 INFO:tasks.workunit.client.0.smithi031.stdout:2/292: dread d1/d3/df/d11/f2f [0,4194304] 0 2024-09-17T01:51:59.067 INFO:tasks.workunit.client.0.smithi031.stdout:2/293: chown d1/d4c/l60 912 1 2024-09-17T01:51:59.069 INFO:tasks.workunit.client.0.smithi031.stdout:7/215: fdatasync db/fe 0 2024-09-17T01:51:59.070 INFO:tasks.workunit.client.1.smithi092.stdout:3/49: symlink d4/lf 0 2024-09-17T01:51:59.070 INFO:tasks.workunit.client.1.smithi092.stdout:3/50: truncate - no filename 2024-09-17T01:51:59.070 INFO:tasks.workunit.client.0.smithi031.stdout:7/216: dread db/f16 [0,4194304] 0 2024-09-17T01:51:59.071 INFO:tasks.workunit.client.0.smithi031.stdout:0/226: creat d0/d29/d33/d2a/d25/d30/d4a/f54 x:0 0 0 2024-09-17T01:51:59.071 INFO:tasks.workunit.client.0.smithi031.stdout:7/217: fdatasync db/f15 0 2024-09-17T01:51:59.071 INFO:tasks.workunit.client.1.smithi092.stdout:4/47: dwrite d4/fc [0,4194304] 0 2024-09-17T01:51:59.072 INFO:tasks.workunit.client.1.smithi092.stdout:8/28: mknod c8 0 2024-09-17T01:51:59.073 INFO:tasks.workunit.client.0.smithi031.stdout:2/294: creat d1/d3/d45/d4a/f6d x:0 0 0 2024-09-17T01:51:59.073 INFO:tasks.workunit.client.0.smithi031.stdout:7/218: truncate db/d29/f2e 369565 0 2024-09-17T01:51:59.075 INFO:tasks.workunit.client.1.smithi092.stdout:1/38: dwrite f6 [0,4194304] 0 2024-09-17T01:51:59.075 INFO:tasks.workunit.client.1.smithi092.stdout:2/87: mknod d10/d15/c1c 0 2024-09-17T01:51:59.076 INFO:tasks.workunit.client.0.smithi031.stdout:7/219: write db/f3a [258600,51446] 0 2024-09-17T01:51:59.078 INFO:tasks.workunit.client.0.smithi031.stdout:2/295: creat d1/d3/df/d11/d30/f6e x:0 0 0 2024-09-17T01:51:59.078 INFO:tasks.workunit.client.1.smithi092.stdout:6/67: mkdir d3/d10 0 2024-09-17T01:51:59.079 INFO:tasks.workunit.client.0.smithi031.stdout:9/196: rmdir d3/d10/d39 0 2024-09-17T01:51:59.080 INFO:tasks.workunit.client.0.smithi031.stdout:0/227: mknod d0/d29/d33/c55 0 2024-09-17T01:51:59.081 INFO:tasks.workunit.client.1.smithi092.stdout:3/51: symlink d4/l10 0 2024-09-17T01:51:59.081 INFO:tasks.workunit.client.1.smithi092.stdout:6/68: read d3/fa [1928089,112044] 0 2024-09-17T01:51:59.082 INFO:tasks.workunit.client.0.smithi031.stdout:7/220: mkdir db/d1c/d41 0 2024-09-17T01:51:59.082 INFO:tasks.workunit.client.0.smithi031.stdout:7/221: fsync db/f1f 0 2024-09-17T01:51:59.083 INFO:tasks.workunit.client.1.smithi092.stdout:6/69: rename d3/dd to d3/dd/d11 22 2024-09-17T01:51:59.083 INFO:tasks.workunit.client.1.smithi092.stdout:8/29: rename f3 to f9 0 2024-09-17T01:51:59.083 INFO:tasks.workunit.client.1.smithi092.stdout:8/30: chown l0 8 1 2024-09-17T01:51:59.084 INFO:tasks.workunit.client.1.smithi092.stdout:2/88: mkdir d10/d1d 0 2024-09-17T01:51:59.084 INFO:tasks.workunit.client.1.smithi092.stdout:2/89: readlink l6 0 2024-09-17T01:51:59.085 INFO:tasks.workunit.client.0.smithi031.stdout:9/197: chown d3/d10/l26 324211 1 2024-09-17T01:51:59.085 INFO:tasks.workunit.client.1.smithi092.stdout:2/90: chown d10/d1d 26045 1 2024-09-17T01:51:59.085 INFO:tasks.workunit.client.1.smithi092.stdout:1/39: dread f6 [0,4194304] 0 2024-09-17T01:51:59.086 INFO:tasks.workunit.client.1.smithi092.stdout:2/91: dread - d10/f14 zero size 2024-09-17T01:51:59.086 INFO:tasks.workunit.client.1.smithi092.stdout:4/48: creat d4/d5/fd x:0 0 0 2024-09-17T01:51:59.087 INFO:tasks.workunit.client.1.smithi092.stdout:2/92: readlink l7 0 2024-09-17T01:51:59.088 INFO:tasks.workunit.client.0.smithi031.stdout:9/198: mknod d3/d10/d36/c3a 0 2024-09-17T01:51:59.089 INFO:tasks.workunit.client.1.smithi092.stdout:9/123: getdents d0/df/d17 0 2024-09-17T01:51:59.089 INFO:tasks.workunit.client.1.smithi092.stdout:8/31: unlink c8 0 2024-09-17T01:51:59.090 INFO:tasks.workunit.client.0.smithi031.stdout:0/228: dwrite d0/d29/d33/d5/f3b [0,4194304] 0 2024-09-17T01:51:59.090 INFO:tasks.workunit.client.0.smithi031.stdout:9/199: write d3/d19/f22 [1413262,8788] 0 2024-09-17T01:51:59.090 INFO:tasks.workunit.client.1.smithi092.stdout:6/70: mknod d3/c12 0 2024-09-17T01:51:59.094 INFO:tasks.workunit.client.0.smithi031.stdout:0/229: fsync d0/d29/d33/d2a/d25/f26 0 2024-09-17T01:51:59.096 INFO:tasks.workunit.client.0.smithi031.stdout:5/239: sync 2024-09-17T01:51:59.096 INFO:tasks.workunit.client.1.smithi092.stdout:3/52: chown d4/l6 7460985 1 2024-09-17T01:51:59.096 INFO:tasks.workunit.client.0.smithi031.stdout:5/240: chown f5 1301 1 2024-09-17T01:51:59.097 INFO:tasks.workunit.client.0.smithi031.stdout:0/230: mkdir d0/d29/d33/d5/d48/d56 0 2024-09-17T01:51:59.098 INFO:tasks.workunit.client.0.smithi031.stdout:4/233: rmdir d8/d3a 39 2024-09-17T01:51:59.098 INFO:tasks.workunit.client.1.smithi092.stdout:6/71: readlink d3/le 0 2024-09-17T01:51:59.099 INFO:tasks.workunit.client.1.smithi092.stdout:9/124: dwrite d0/df/d17/f1c [0,4194304] 0 2024-09-17T01:51:59.100 INFO:tasks.workunit.client.0.smithi031.stdout:5/241: fsync da/dc/f27 0 2024-09-17T01:51:59.101 INFO:tasks.workunit.client.1.smithi092.stdout:9/125: chown d0/df/d17/c19 1539507 1 2024-09-17T01:51:59.101 INFO:tasks.workunit.client.0.smithi031.stdout:5/242: dread - da/dc/d2e/f4c zero size 2024-09-17T01:51:59.102 INFO:tasks.workunit.client.0.smithi031.stdout:5/243: chown da/f49 183318564 1 2024-09-17T01:51:59.103 INFO:tasks.workunit.client.0.smithi031.stdout:9/200: rename d3/d10/c1e to d3/d19/c3b 0 2024-09-17T01:51:59.103 INFO:tasks.workunit.client.1.smithi092.stdout:6/72: creat d3/f13 x:0 0 0 2024-09-17T01:51:59.104 INFO:tasks.workunit.client.1.smithi092.stdout:0/47: truncate d3/da/fb 194502 0 2024-09-17T01:51:59.105 INFO:tasks.workunit.client.1.smithi092.stdout:4/49: link d4/c6 d4/ce 0 2024-09-17T01:51:59.105 INFO:tasks.workunit.client.1.smithi092.stdout:4/50: stat d4/d5/d8/ca 0 2024-09-17T01:51:59.107 INFO:tasks.workunit.client.0.smithi031.stdout:4/234: rename d8/d22/d25/c32 to d8/d22/d25/c44 0 2024-09-17T01:51:59.107 INFO:tasks.workunit.client.0.smithi031.stdout:7/222: read db/f3a [154235,10552] 0 2024-09-17T01:51:59.108 INFO:tasks.workunit.client.1.smithi092.stdout:4/51: symlink d4/lf 0 2024-09-17T01:51:59.109 INFO:tasks.workunit.client.1.smithi092.stdout:4/52: readlink d4/d5/d8/lb 0 2024-09-17T01:51:59.110 INFO:tasks.workunit.client.1.smithi092.stdout:9/126: mkdir d0/df/d17/d1f/d20 0 2024-09-17T01:51:59.114 INFO:tasks.workunit.client.1.smithi092.stdout:9/127: dread d0/fd [4194304,4194304] 0 2024-09-17T01:51:59.116 INFO:tasks.workunit.client.0.smithi031.stdout:6/334: dwrite d23/d63/f56 [0,4194304] 0 2024-09-17T01:51:59.117 INFO:tasks.workunit.client.0.smithi031.stdout:8/294: dwrite d0/df/d19/f1b [0,4194304] 0 2024-09-17T01:51:59.118 INFO:tasks.workunit.client.1.smithi092.stdout:9/128: unlink d0/d7/l1e 0 2024-09-17T01:51:59.119 INFO:tasks.workunit.client.0.smithi031.stdout:7/223: symlink db/d1c/l42 0 2024-09-17T01:51:59.119 INFO:tasks.workunit.client.1.smithi092.stdout:9/129: write d0/f16 [2280962,19736] 0 2024-09-17T01:51:59.120 INFO:tasks.workunit.client.1.smithi092.stdout:9/130: chown d0/c14 69932431 1 2024-09-17T01:51:59.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/296: dread d1/d3/df/d19/f63 [0,4194304] 0 2024-09-17T01:51:59.124 INFO:tasks.workunit.client.0.smithi031.stdout:0/231: link d0/d29/d33/d2a/d25/f26 d0/d29/d33/d2a/d25/d30/f57 0 2024-09-17T01:51:59.127 INFO:tasks.workunit.client.0.smithi031.stdout:6/335: write f5 [2404155,122529] 0 2024-09-17T01:51:59.128 INFO:tasks.workunit.client.1.smithi092.stdout:8/32: dread f7 [0,4194304] 0 2024-09-17T01:51:59.129 INFO:tasks.workunit.client.1.smithi092.stdout:1/40: truncate f6 1584524 0 2024-09-17T01:51:59.129 INFO:tasks.workunit.client.0.smithi031.stdout:8/295: mknod d0/d5/d54/c58 0 2024-09-17T01:51:59.133 INFO:tasks.workunit.client.0.smithi031.stdout:2/297: creat d1/d3/df/d18/d40/d43/f6f x:0 0 0 2024-09-17T01:51:59.134 INFO:tasks.workunit.client.1.smithi092.stdout:9/131: dwrite d0/f6 [4194304,4194304] 0 2024-09-17T01:51:59.137 INFO:tasks.workunit.client.0.smithi031.stdout:8/296: dwrite d0/d5/f2f [4194304,4194304] 0 2024-09-17T01:51:59.138 INFO:tasks.workunit.client.1.smithi092.stdout:9/132: mkdir d0/d7/d21 0 2024-09-17T01:51:59.139 INFO:tasks.workunit.client.0.smithi031.stdout:5/244: link da/dc/f16 da/d14/f53 0 2024-09-17T01:51:59.139 INFO:tasks.workunit.client.0.smithi031.stdout:8/297: chown d0/df/d19/f33 263969 1 2024-09-17T01:51:59.142 INFO:tasks.workunit.client.0.smithi031.stdout:7/224: getdents db/d1c/d41 0 2024-09-17T01:51:59.142 INFO:tasks.workunit.client.0.smithi031.stdout:5/245: truncate da/f49 694832 0 2024-09-17T01:51:59.143 INFO:tasks.workunit.client.0.smithi031.stdout:3/179: dwrite db/df/f1b [0,4194304] 0 2024-09-17T01:51:59.146 INFO:tasks.workunit.client.1.smithi092.stdout:2/93: dwrite d10/f12 [0,4194304] 0 2024-09-17T01:51:59.146 INFO:tasks.workunit.client.0.smithi031.stdout:2/298: mknod d1/d3/d45/c70 0 2024-09-17T01:51:59.147 INFO:tasks.workunit.client.0.smithi031.stdout:1/257: truncate d4/d1a/d2d/d18/f39 2175388 0 2024-09-17T01:51:59.148 INFO:tasks.workunit.client.0.smithi031.stdout:9/201: link d3/d10/l26 d3/d19/d1f/l3c 0 2024-09-17T01:51:59.148 INFO:tasks.workunit.client.1.smithi092.stdout:2/94: truncate d10/f14 733052 0 2024-09-17T01:51:59.148 INFO:tasks.workunit.client.1.smithi092.stdout:0/48: truncate f1 11558971 0 2024-09-17T01:51:59.152 INFO:tasks.workunit.client.0.smithi031.stdout:8/298: chown d0/df/d19/d3d/f49 603 1 2024-09-17T01:51:59.152 INFO:tasks.workunit.client.1.smithi092.stdout:9/133: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:59.152 INFO:tasks.workunit.client.1.smithi092.stdout:2/95: mknod d10/d1d/c1e 0 2024-09-17T01:51:59.153 INFO:tasks.workunit.client.0.smithi031.stdout:3/180: rmdir db/df/d1d 39 2024-09-17T01:51:59.153 INFO:tasks.workunit.client.1.smithi092.stdout:2/96: chown cc 4 1 2024-09-17T01:51:59.158 INFO:tasks.workunit.client.0.smithi031.stdout:5/246: rename da/d42/d12/l1c to da/d42/d26/l54 0 2024-09-17T01:51:59.159 INFO:tasks.workunit.client.1.smithi092.stdout:9/134: unlink d0/f16 0 2024-09-17T01:51:59.159 INFO:tasks.workunit.client.0.smithi031.stdout:2/299: mkdir d1/d3/d2d/d71 0 2024-09-17T01:51:59.160 INFO:tasks.workunit.client.1.smithi092.stdout:2/97: creat d10/f1f x:0 0 0 2024-09-17T01:51:59.162 INFO:tasks.workunit.client.0.smithi031.stdout:2/300: read d1/d3/f25 [8010,102376] 0 2024-09-17T01:51:59.163 INFO:tasks.workunit.client.1.smithi092.stdout:9/135: unlink d0/d5/c15 0 2024-09-17T01:51:59.164 INFO:tasks.workunit.client.1.smithi092.stdout:2/98: symlink d10/d1d/l20 0 2024-09-17T01:51:59.165 INFO:tasks.workunit.client.1.smithi092.stdout:2/99: truncate d10/d15/f1b 1065707 0 2024-09-17T01:51:59.167 INFO:tasks.workunit.client.1.smithi092.stdout:9/136: dread d0/d7/f11 [0,4194304] 0 2024-09-17T01:51:59.169 INFO:tasks.workunit.client.1.smithi092.stdout:9/137: mknod d0/d7/d21/c22 0 2024-09-17T01:51:59.170 INFO:tasks.workunit.client.0.smithi031.stdout:4/235: getdents d8/d22/d25/d36 0 2024-09-17T01:51:59.170 INFO:tasks.workunit.client.1.smithi092.stdout:9/138: readlink d0/d7/lc 0 2024-09-17T01:51:59.170 INFO:tasks.workunit.client.0.smithi031.stdout:4/236: read f5 [194568,8208] 0 2024-09-17T01:51:59.171 INFO:tasks.workunit.client.0.smithi031.stdout:8/299: mkdir d0/df/dd/d59 0 2024-09-17T01:51:59.173 INFO:tasks.workunit.client.0.smithi031.stdout:3/181: unlink db/f30 0 2024-09-17T01:51:59.173 INFO:tasks.workunit.client.0.smithi031.stdout:3/182: readlink db/df/l32 0 2024-09-17T01:51:59.176 INFO:tasks.workunit.client.1.smithi092.stdout:9/139: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:51:59.177 INFO:tasks.workunit.client.0.smithi031.stdout:0/232: getdents d0/d29/d33/d2a 0 2024-09-17T01:51:59.179 INFO:tasks.workunit.client.0.smithi031.stdout:5/247: symlink da/d14/l55 0 2024-09-17T01:51:59.179 INFO:tasks.workunit.client.1.smithi092.stdout:9/140: getdents d0/df 0 2024-09-17T01:51:59.180 INFO:tasks.workunit.client.1.smithi092.stdout:9/141: fsync d0/df/f18 0 2024-09-17T01:51:59.182 INFO:tasks.workunit.client.1.smithi092.stdout:9/142: creat d0/d7/f23 x:0 0 0 2024-09-17T01:51:59.183 INFO:tasks.workunit.client.1.smithi092.stdout:9/143: stat d0/df/d17/c19 0 2024-09-17T01:51:59.184 INFO:tasks.workunit.client.0.smithi031.stdout:2/301: mknod d1/d3/df/d19/d1e/d21/d34/c72 0 2024-09-17T01:51:59.187 INFO:tasks.workunit.client.0.smithi031.stdout:6/336: getdents d23/d50 0 2024-09-17T01:51:59.187 INFO:tasks.workunit.client.0.smithi031.stdout:5/248: dread da/d42/d12/f41 [0,4194304] 0 2024-09-17T01:51:59.188 INFO:tasks.workunit.client.1.smithi092.stdout:1/41: write f6 [1350526,43341] 0 2024-09-17T01:51:59.190 INFO:tasks.workunit.client.0.smithi031.stdout:4/237: truncate d8/d3a/f40 1372546 0 2024-09-17T01:51:59.190 INFO:tasks.workunit.client.0.smithi031.stdout:6/337: dread - d23/d50/d6a/d72/f73 zero size 2024-09-17T01:51:59.191 INFO:tasks.workunit.client.0.smithi031.stdout:5/249: write da/d42/d26/f39 [3280087,9938] 0 2024-09-17T01:51:59.192 INFO:tasks.workunit.client.1.smithi092.stdout:1/42: mkdir db 0 2024-09-17T01:51:59.193 INFO:tasks.workunit.client.0.smithi031.stdout:6/338: chown d23/d50/l6b 627908 1 2024-09-17T01:51:59.193 INFO:tasks.workunit.client.0.smithi031.stdout:4/238: truncate d8/d3a/f40 1663423 0 2024-09-17T01:51:59.197 INFO:tasks.workunit.client.0.smithi031.stdout:8/300: mknod d0/df/dd/d59/c5a 0 2024-09-17T01:51:59.198 INFO:tasks.workunit.client.0.smithi031.stdout:1/258: rmdir d4/d1a/d2d/d18 39 2024-09-17T01:51:59.198 INFO:tasks.workunit.client.0.smithi031.stdout:1/259: stat d4/d1e/f49 0 2024-09-17T01:51:59.199 INFO:tasks.workunit.client.0.smithi031.stdout:8/301: dread d0/d5/f43 [0,4194304] 0 2024-09-17T01:51:59.199 INFO:tasks.workunit.client.0.smithi031.stdout:2/302: truncate d1/d3/df/d11/f15 857405 0 2024-09-17T01:51:59.200 INFO:tasks.workunit.client.0.smithi031.stdout:8/302: readlink d0/d5/l24 0 2024-09-17T01:51:59.200 INFO:tasks.workunit.client.1.smithi092.stdout:8/33: getdents . 0 2024-09-17T01:51:59.205 INFO:tasks.workunit.client.0.smithi031.stdout:7/225: truncate db/f1a 3318190 0 2024-09-17T01:51:59.207 INFO:tasks.workunit.client.1.smithi092.stdout:0/49: dwrite d3/da/fb [0,4194304] 0 2024-09-17T01:51:59.209 INFO:tasks.workunit.client.1.smithi092.stdout:9/144: truncate d0/d5/f8 2591507 0 2024-09-17T01:51:59.210 INFO:tasks.workunit.client.1.smithi092.stdout:9/145: chown d0/f6 10374 1 2024-09-17T01:51:59.211 INFO:tasks.workunit.client.1.smithi092.stdout:8/34: dwrite f5 [0,4194304] 0 2024-09-17T01:51:59.212 INFO:tasks.workunit.client.0.smithi031.stdout:1/260: creat d4/d1a/d43/f51 x:0 0 0 2024-09-17T01:51:59.214 INFO:tasks.workunit.client.1.smithi092.stdout:1/43: truncate f6 842418 0 2024-09-17T01:51:59.217 INFO:tasks.workunit.client.0.smithi031.stdout:1/261: dread d4/d1a/f3c [0,4194304] 0 2024-09-17T01:51:59.219 INFO:tasks.workunit.client.0.smithi031.stdout:9/202: dwrite d3/f1d [0,4194304] 0 2024-09-17T01:51:59.221 INFO:tasks.workunit.client.0.smithi031.stdout:3/183: mkdir db/df/d1d/d37/d3a 0 2024-09-17T01:51:59.222 INFO:tasks.workunit.client.0.smithi031.stdout:5/250: symlink da/d42/d12/d4a/l56 0 2024-09-17T01:51:59.227 INFO:tasks.workunit.client.0.smithi031.stdout:2/303: dread d1/d3/df/d11/d30/f37 [0,4194304] 0 2024-09-17T01:51:59.229 INFO:tasks.workunit.client.0.smithi031.stdout:7/226: rmdir db/d29 39 2024-09-17T01:51:59.231 INFO:tasks.workunit.client.1.smithi092.stdout:1/44: write f6 [1600000,78920] 0 2024-09-17T01:51:59.232 INFO:tasks.workunit.client.0.smithi031.stdout:6/339: mkdir d23/d50/d6a/d70/d74 0 2024-09-17T01:51:59.232 INFO:tasks.workunit.client.1.smithi092.stdout:0/50: write f1 [2529345,128215] 0 2024-09-17T01:51:59.233 INFO:tasks.workunit.client.0.smithi031.stdout:4/239: rename d8/d22/d25/c44 to d8/d22/c45 0 2024-09-17T01:51:59.233 INFO:tasks.workunit.client.1.smithi092.stdout:0/51: dread - d3/f6 zero size 2024-09-17T01:51:59.234 INFO:tasks.workunit.client.1.smithi092.stdout:8/35: truncate f5 855745 0 2024-09-17T01:51:59.234 INFO:tasks.workunit.client.1.smithi092.stdout:8/36: chown f9 678787838 1 2024-09-17T01:51:59.236 INFO:tasks.workunit.client.0.smithi031.stdout:3/184: dwrite db/df/f39 [0,4194304] 0 2024-09-17T01:51:59.237 INFO:tasks.workunit.client.1.smithi092.stdout:1/45: creat db/fc x:0 0 0 2024-09-17T01:51:59.239 INFO:tasks.workunit.client.0.smithi031.stdout:0/233: getdents d0 0 2024-09-17T01:51:59.240 INFO:tasks.workunit.client.1.smithi092.stdout:1/46: chown c8 7469973 1 2024-09-17T01:51:59.241 INFO:tasks.workunit.client.1.smithi092.stdout:0/52: creat d3/da/fc x:0 0 0 2024-09-17T01:51:59.242 INFO:tasks.workunit.client.1.smithi092.stdout:1/47: creat db/fd x:0 0 0 2024-09-17T01:51:59.243 INFO:tasks.workunit.client.1.smithi092.stdout:1/48: write db/fc [628986,127674] 0 2024-09-17T01:51:59.243 INFO:tasks.workunit.client.0.smithi031.stdout:9/203: mknod d3/d19/d1f/c3d 0 2024-09-17T01:51:59.243 INFO:tasks.workunit.client.1.smithi092.stdout:1/49: dread - db/fd zero size 2024-09-17T01:51:59.245 INFO:tasks.workunit.client.1.smithi092.stdout:1/50: mknod db/ce 0 2024-09-17T01:51:59.246 INFO:tasks.workunit.client.1.smithi092.stdout:0/53: fdatasync f1 0 2024-09-17T01:51:59.247 INFO:tasks.workunit.client.0.smithi031.stdout:7/227: symlink db/d18/l43 0 2024-09-17T01:51:59.249 INFO:tasks.workunit.client.0.smithi031.stdout:4/240: dwrite d8/d18/f2d [0,4194304] 0 2024-09-17T01:51:59.251 INFO:tasks.workunit.client.1.smithi092.stdout:1/51: link la db/lf 0 2024-09-17T01:51:59.253 INFO:tasks.workunit.client.0.smithi031.stdout:4/241: dread d8/d18/f29 [0,4194304] 0 2024-09-17T01:51:59.253 INFO:tasks.workunit.client.1.smithi092.stdout:1/52: write f6 [870717,12805] 0 2024-09-17T01:51:59.254 INFO:tasks.workunit.client.1.smithi092.stdout:0/54: dwrite f1 [8388608,4194304] 0 2024-09-17T01:51:59.255 INFO:tasks.workunit.client.1.smithi092.stdout:1/53: chown db/ce 19866579 1 2024-09-17T01:51:59.256 INFO:tasks.workunit.client.1.smithi092.stdout:0/55: fsync d3/f7 0 2024-09-17T01:51:59.257 INFO:tasks.workunit.client.0.smithi031.stdout:8/303: link d0/l36 d0/d5/d54/l5b 0 2024-09-17T01:51:59.258 INFO:tasks.workunit.client.1.smithi092.stdout:8/37: dwrite f7 [0,4194304] 0 2024-09-17T01:51:59.258 INFO:tasks.workunit.client.0.smithi031.stdout:3/185: symlink db/d29/d2f/l3b 0 2024-09-17T01:51:59.260 INFO:tasks.workunit.client.1.smithi092.stdout:8/38: truncate f9 691442 0 2024-09-17T01:51:59.260 INFO:tasks.workunit.client.0.smithi031.stdout:6/340: dwrite d23/d50/f53 [4194304,4194304] 0 2024-09-17T01:51:59.261 INFO:tasks.workunit.client.0.smithi031.stdout:1/262: mkdir d4/d1a/d2d/d18/d52 0 2024-09-17T01:51:59.263 INFO:tasks.workunit.client.1.smithi092.stdout:0/56: unlink d3/da/fc 0 2024-09-17T01:51:59.264 INFO:tasks.workunit.client.1.smithi092.stdout:1/54: stat la 0 2024-09-17T01:51:59.265 INFO:tasks.workunit.client.0.smithi031.stdout:6/341: dread - d23/d50/d6a/d72/f73 zero size 2024-09-17T01:51:59.267 INFO:tasks.workunit.client.1.smithi092.stdout:0/57: chown d3/l9 0 1 2024-09-17T01:51:59.268 INFO:tasks.workunit.client.1.smithi092.stdout:8/39: dwrite f7 [0,4194304] 0 2024-09-17T01:51:59.270 INFO:tasks.workunit.client.1.smithi092.stdout:1/55: rename c3 to db/c10 0 2024-09-17T01:51:59.271 INFO:tasks.workunit.client.1.smithi092.stdout:8/40: read f9 [624568,47303] 0 2024-09-17T01:51:59.273 INFO:tasks.workunit.client.0.smithi031.stdout:3/186: dwrite db/f12 [0,4194304] 0 2024-09-17T01:51:59.274 INFO:tasks.workunit.client.1.smithi092.stdout:0/58: dread f1 [4194304,4194304] 0 2024-09-17T01:51:59.276 INFO:tasks.workunit.client.0.smithi031.stdout:3/187: write db/f11 [4431270,51255] 0 2024-09-17T01:51:59.278 INFO:tasks.workunit.client.1.smithi092.stdout:8/41: link f7 fa 0 2024-09-17T01:51:59.278 INFO:tasks.workunit.client.0.smithi031.stdout:7/228: creat db/d1c/d41/f44 x:0 0 0 2024-09-17T01:51:59.279 INFO:tasks.workunit.client.0.smithi031.stdout:1/263: mkdir d4/d1a/d43/d53 0 2024-09-17T01:51:59.279 INFO:tasks.workunit.client.1.smithi092.stdout:0/59: symlink d3/da/ld 0 2024-09-17T01:51:59.280 INFO:tasks.workunit.client.0.smithi031.stdout:8/304: write d0/f52 [510081,108131] 0 2024-09-17T01:51:59.280 INFO:tasks.workunit.client.0.smithi031.stdout:5/251: dread da/d14/f1d [0,4194304] 0 2024-09-17T01:51:59.281 INFO:tasks.workunit.client.0.smithi031.stdout:6/342: mkdir d23/d50/d6a/d72/d75 0 2024-09-17T01:51:59.282 INFO:tasks.workunit.client.0.smithi031.stdout:8/305: chown d0/df/dd/d59/c5a 1754107585 1 2024-09-17T01:51:59.285 INFO:tasks.workunit.client.0.smithi031.stdout:0/234: link d0/d29/d33/d2a/c2c d0/d29/d44/c58 0 2024-09-17T01:51:59.286 INFO:tasks.workunit.client.0.smithi031.stdout:9/204: creat d3/d19/f3e x:0 0 0 2024-09-17T01:51:59.286 INFO:tasks.workunit.client.0.smithi031.stdout:2/304: getdents d1/d3/df/d18/d40/d43 0 2024-09-17T01:51:59.288 INFO:tasks.workunit.client.0.smithi031.stdout:3/188: rmdir db/df/d1d/d37 39 2024-09-17T01:51:59.289 INFO:tasks.workunit.client.1.smithi092.stdout:8/42: dwrite f5 [0,4194304] 0 2024-09-17T01:51:59.289 INFO:tasks.workunit.client.1.smithi092.stdout:0/60: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:51:59.290 INFO:tasks.workunit.client.1.smithi092.stdout:0/61: fsync d3/f6 0 2024-09-17T01:51:59.290 INFO:tasks.workunit.client.0.smithi031.stdout:1/264: fsync d4/d1a/d2d/f22 0 2024-09-17T01:51:59.290 INFO:tasks.workunit.client.0.smithi031.stdout:7/229: chown db/d1c/c3b 103266758 1 2024-09-17T01:51:59.290 INFO:tasks.workunit.client.0.smithi031.stdout:3/189: fdatasync db/df/d1c/f2b 0 2024-09-17T01:51:59.291 INFO:tasks.workunit.client.0.smithi031.stdout:9/205: symlink d3/d10/d36/l3f 0 2024-09-17T01:51:59.292 INFO:tasks.workunit.client.1.smithi092.stdout:8/43: write f9 [1240913,111828] 0 2024-09-17T01:51:59.292 INFO:tasks.workunit.client.0.smithi031.stdout:2/305: rmdir d1/d3/df/d11 39 2024-09-17T01:51:59.294 INFO:tasks.workunit.client.0.smithi031.stdout:8/306: dwrite d0/df/d19/f33 [0,4194304] 0 2024-09-17T01:51:59.294 INFO:tasks.workunit.client.1.smithi092.stdout:0/62: symlink d3/le 0 2024-09-17T01:51:59.294 INFO:tasks.workunit.client.0.smithi031.stdout:0/235: mknod d0/d29/d44/c59 0 2024-09-17T01:51:59.296 INFO:tasks.workunit.client.0.smithi031.stdout:5/252: mknod da/dc/c57 0 2024-09-17T01:51:59.298 INFO:tasks.workunit.client.1.smithi092.stdout:0/63: unlink f1 0 2024-09-17T01:51:59.301 INFO:tasks.workunit.client.0.smithi031.stdout:6/343: creat d23/d63/f76 x:0 0 0 2024-09-17T01:51:59.302 INFO:tasks.workunit.client.0.smithi031.stdout:8/307: creat d0/df/d19/d3d/f5c x:0 0 0 2024-09-17T01:51:59.303 INFO:tasks.workunit.client.0.smithi031.stdout:0/236: creat d0/d29/d33/d5/d48/f5a x:0 0 0 2024-09-17T01:51:59.304 INFO:tasks.workunit.client.0.smithi031.stdout:3/190: dwrite db/f1f [0,4194304] 0 2024-09-17T01:51:59.305 INFO:tasks.workunit.client.0.smithi031.stdout:8/308: read d0/f9 [803151,12786] 0 2024-09-17T01:51:59.305 INFO:tasks.workunit.client.1.smithi092.stdout:1/56: unlink db/c10 0 2024-09-17T01:51:59.306 INFO:tasks.workunit.client.0.smithi031.stdout:7/230: symlink db/l45 0 2024-09-17T01:51:59.306 INFO:tasks.workunit.client.0.smithi031.stdout:3/191: dread - db/d29/d2f/f33 zero size 2024-09-17T01:51:59.313 INFO:tasks.workunit.client.0.smithi031.stdout:2/306: getdents d1/d3/d2d/d71 0 2024-09-17T01:51:59.315 INFO:tasks.workunit.client.0.smithi031.stdout:3/192: unlink db/f16 0 2024-09-17T01:51:59.316 INFO:tasks.workunit.client.0.smithi031.stdout:6/344: read d23/f35 [2802364,58140] 0 2024-09-17T01:51:59.319 INFO:tasks.workunit.client.0.smithi031.stdout:7/231: dwrite db/d1c/d41/f44 [0,4194304] 0 2024-09-17T01:51:59.320 INFO:tasks.workunit.client.0.smithi031.stdout:3/193: write db/d29/d2f/f33 [1010196,5575] 0 2024-09-17T01:51:59.322 INFO:tasks.workunit.client.0.smithi031.stdout:5/253: rename da/f11 to da/f58 0 2024-09-17T01:51:59.327 INFO:tasks.workunit.client.0.smithi031.stdout:6/345: write d23/f36 [3517613,47289] 0 2024-09-17T01:51:59.330 INFO:tasks.workunit.client.0.smithi031.stdout:8/309: dwrite d0/df/d19/f31 [0,4194304] 0 2024-09-17T01:51:59.333 INFO:tasks.workunit.client.0.smithi031.stdout:5/254: truncate da/d14/f53 186505 0 2024-09-17T01:51:59.334 INFO:tasks.workunit.client.1.smithi092.stdout:8/44: getdents . 0 2024-09-17T01:51:59.337 INFO:tasks.workunit.client.1.smithi092.stdout:8/45: unlink c6 0 2024-09-17T01:51:59.338 INFO:tasks.workunit.client.0.smithi031.stdout:6/346: mknod d23/d50/d6a/d70/c77 0 2024-09-17T01:51:59.339 INFO:tasks.workunit.client.0.smithi031.stdout:4/242: write d8/f27 [1885991,111636] 0 2024-09-17T01:51:59.342 INFO:tasks.workunit.client.1.smithi092.stdout:1/57: truncate f6 1556680 0 2024-09-17T01:51:59.343 INFO:tasks.workunit.client.0.smithi031.stdout:9/206: getdents d3/d10/d36 0 2024-09-17T01:51:59.343 INFO:tasks.workunit.client.1.smithi092.stdout:8/46: link l0 lb 0 2024-09-17T01:51:59.343 INFO:tasks.workunit.client.0.smithi031.stdout:2/307: dwrite d1/d3/df/d11/f2f [0,4194304] 0 2024-09-17T01:51:59.343 INFO:tasks.workunit.client.0.smithi031.stdout:3/194: dwrite db/df/f1b [0,4194304] 0 2024-09-17T01:51:59.345 INFO:tasks.workunit.client.1.smithi092.stdout:8/47: mkdir dc 0 2024-09-17T01:51:59.345 INFO:tasks.workunit.client.0.smithi031.stdout:4/243: stat l6 0 2024-09-17T01:51:59.346 INFO:tasks.workunit.client.0.smithi031.stdout:6/347: creat d23/d50/d64/f78 x:0 0 0 2024-09-17T01:51:59.347 INFO:tasks.workunit.client.1.smithi092.stdout:1/58: rename db/fc to db/f11 0 2024-09-17T01:51:59.348 INFO:tasks.workunit.client.1.smithi092.stdout:8/48: readlink lb 0 2024-09-17T01:51:59.349 INFO:tasks.workunit.client.0.smithi031.stdout:1/265: write d4/d1a/d2d/d18/f31 [484521,24289] 0 2024-09-17T01:51:59.349 INFO:tasks.workunit.client.1.smithi092.stdout:8/49: fdatasync f5 0 2024-09-17T01:51:59.351 INFO:tasks.workunit.client.0.smithi031.stdout:4/244: chown d8/d22/f2e 18241 1 2024-09-17T01:51:59.353 INFO:tasks.workunit.client.0.smithi031.stdout:7/232: rmdir db 39 2024-09-17T01:51:59.355 INFO:tasks.workunit.client.0.smithi031.stdout:3/195: truncate db/df/f1e 5063163 0 2024-09-17T01:51:59.357 INFO:tasks.workunit.client.0.smithi031.stdout:3/196: dread - db/f34 zero size 2024-09-17T01:51:59.358 INFO:tasks.workunit.client.0.smithi031.stdout:3/197: readlink db/df/d1d/l25 0 2024-09-17T01:51:59.359 INFO:tasks.workunit.client.0.smithi031.stdout:6/348: dread d23/d63/f56 [0,4194304] 0 2024-09-17T01:51:59.359 INFO:tasks.workunit.client.1.smithi092.stdout:1/59: dwrite db/f11 [0,4194304] 0 2024-09-17T01:51:59.360 INFO:tasks.workunit.client.0.smithi031.stdout:0/237: write d0/f34 [763943,22063] 0 2024-09-17T01:51:59.362 INFO:tasks.workunit.client.1.smithi092.stdout:8/50: dwrite f9 [0,4194304] 0 2024-09-17T01:51:59.362 INFO:tasks.workunit.client.1.smithi092.stdout:1/60: write db/fd [913921,4463] 0 2024-09-17T01:51:59.363 INFO:tasks.workunit.client.1.smithi092.stdout:8/51: chown f1 74925 1 2024-09-17T01:51:59.364 INFO:tasks.workunit.client.1.smithi092.stdout:8/52: chown f9 200081 1 2024-09-17T01:51:59.365 INFO:tasks.workunit.client.0.smithi031.stdout:1/266: dread d4/d1a/d2d/fe [0,4194304] 0 2024-09-17T01:51:59.367 INFO:tasks.workunit.client.1.smithi092.stdout:1/61: symlink db/l12 0 2024-09-17T01:51:59.367 INFO:tasks.workunit.client.0.smithi031.stdout:3/198: readlink db/df/d1d/l2a 0 2024-09-17T01:51:59.371 INFO:tasks.workunit.client.0.smithi031.stdout:6/349: dwrite f5 [4194304,4194304] 0 2024-09-17T01:51:59.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:59 smithi031 ceph-mon[27673]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:59.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:51:59 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/184188583' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:51:59.372 INFO:tasks.workunit.client.0.smithi031.stdout:1/267: truncate d4/d1e/f4f 140966 0 2024-09-17T01:51:59.372 INFO:tasks.workunit.client.0.smithi031.stdout:1/268: stat d4/d1e/c30 0 2024-09-17T01:51:59.373 INFO:tasks.workunit.client.1.smithi092.stdout:8/53: rmdir dc 0 2024-09-17T01:51:59.373 INFO:tasks.workunit.client.1.smithi092.stdout:1/62: link c8 db/c13 0 2024-09-17T01:51:59.375 INFO:tasks.workunit.client.1.smithi092.stdout:1/63: chown c5 638817 1 2024-09-17T01:51:59.376 INFO:tasks.workunit.client.0.smithi031.stdout:9/207: link d3/d4/d29/l2d d3/d19/l40 0 2024-09-17T01:51:59.376 INFO:tasks.workunit.client.1.smithi092.stdout:1/64: stat c5 0 2024-09-17T01:51:59.376 INFO:tasks.workunit.client.0.smithi031.stdout:0/238: mkdir d0/d29/d33/d5b 0 2024-09-17T01:51:59.377 INFO:tasks.workunit.client.1.smithi092.stdout:8/54: rename l0 to ld 0 2024-09-17T01:51:59.378 INFO:tasks.workunit.client.0.smithi031.stdout:5/255: dread da/d14/f3c [0,4194304] 0 2024-09-17T01:51:59.378 INFO:tasks.workunit.client.0.smithi031.stdout:0/239: chown d0/d29/d44/f4c 2003 1 2024-09-17T01:51:59.378 INFO:tasks.workunit.client.0.smithi031.stdout:3/199: mknod db/df/d1d/d37/c3c 0 2024-09-17T01:51:59.379 INFO:tasks.workunit.client.0.smithi031.stdout:0/240: readlink d0/l43 0 2024-09-17T01:51:59.380 INFO:tasks.workunit.client.1.smithi092.stdout:8/55: creat fe x:0 0 0 2024-09-17T01:51:59.381 INFO:tasks.workunit.client.0.smithi031.stdout:1/269: creat d4/d1e/d40/f54 x:0 0 0 2024-09-17T01:51:59.383 INFO:tasks.workunit.client.0.smithi031.stdout:9/208: mkdir d3/d4/d41 0 2024-09-17T01:51:59.385 INFO:tasks.workunit.client.1.smithi092.stdout:1/65: dwrite db/fd [0,4194304] 0 2024-09-17T01:51:59.389 INFO:tasks.workunit.client.0.smithi031.stdout:1/270: write d4/d1e/f4b [700430,26350] 0 2024-09-17T01:51:59.390 INFO:tasks.workunit.client.1.smithi092.stdout:1/66: creat db/f14 x:0 0 0 2024-09-17T01:51:59.391 INFO:tasks.workunit.client.1.smithi092.stdout:8/56: dwrite fe [0,4194304] 0 2024-09-17T01:51:59.394 INFO:tasks.workunit.client.1.smithi092.stdout:8/57: creat ff x:0 0 0 2024-09-17T01:51:59.396 INFO:tasks.workunit.client.0.smithi031.stdout:3/200: dwrite db/df/f31 [0,4194304] 0 2024-09-17T01:51:59.399 INFO:tasks.workunit.client.0.smithi031.stdout:5/256: dwrite da/f49 [0,4194304] 0 2024-09-17T01:51:59.399 INFO:tasks.workunit.client.0.smithi031.stdout:1/271: creat d4/d1a/d43/d53/f55 x:0 0 0 2024-09-17T01:51:59.401 INFO:tasks.workunit.client.0.smithi031.stdout:9/209: dwrite d3/d19/f22 [0,4194304] 0 2024-09-17T01:51:59.403 INFO:tasks.workunit.client.1.smithi092.stdout:8/58: dwrite fa [0,4194304] 0 2024-09-17T01:51:59.405 INFO:tasks.workunit.client.1.smithi092.stdout:8/59: mknod c10 0 2024-09-17T01:51:59.406 INFO:tasks.workunit.client.0.smithi031.stdout:1/272: fdatasync d4/d1a/f1d 0 2024-09-17T01:51:59.409 INFO:tasks.workunit.client.1.smithi092.stdout:8/60: chown lb 86052026 1 2024-09-17T01:51:59.416 INFO:tasks.workunit.client.0.smithi031.stdout:9/210: creat d3/f42 x:0 0 0 2024-09-17T01:51:59.417 INFO:tasks.workunit.client.0.smithi031.stdout:1/273: truncate d4/d1a/f3c 1016461 0 2024-09-17T01:51:59.420 INFO:tasks.workunit.client.0.smithi031.stdout:4/245: dwrite d8/d18/f29 [0,4194304] 0 2024-09-17T01:51:59.426 INFO:tasks.workunit.client.0.smithi031.stdout:9/211: creat d3/d19/d1f/f43 x:0 0 0 2024-09-17T01:51:59.429 INFO:tasks.workunit.client.0.smithi031.stdout:3/201: link db/df/d1c/l27 db/df/d1d/d37/l3d 0 2024-09-17T01:51:59.430 INFO:tasks.workunit.client.0.smithi031.stdout:1/274: mknod d4/d1a/c56 0 2024-09-17T01:51:59.433 INFO:tasks.workunit.client.0.smithi031.stdout:6/350: truncate d23/d50/f53 2297088 0 2024-09-17T01:51:59.435 INFO:tasks.workunit.client.0.smithi031.stdout:0/241: dread d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:51:59.436 INFO:tasks.workunit.client.0.smithi031.stdout:7/233: dwrite db/f16 [0,4194304] 0 2024-09-17T01:51:59.437 INFO:tasks.workunit.client.0.smithi031.stdout:4/246: dwrite d8/d22/f3c [0,4194304] 0 2024-09-17T01:51:59.438 INFO:tasks.workunit.client.0.smithi031.stdout:6/351: chown d23/d63/f4f 59 1 2024-09-17T01:51:59.438 INFO:tasks.workunit.client.0.smithi031.stdout:3/202: creat db/f3e x:0 0 0 2024-09-17T01:51:59.440 INFO:tasks.workunit.client.0.smithi031.stdout:7/234: fsync db/d29/f2e 0 2024-09-17T01:51:59.441 INFO:tasks.workunit.client.0.smithi031.stdout:3/203: truncate db/fe 4361648 0 2024-09-17T01:51:59.442 INFO:tasks.workunit.client.0.smithi031.stdout:0/242: rename d0/f19 to d0/f5c 0 2024-09-17T01:51:59.443 INFO:tasks.workunit.client.0.smithi031.stdout:7/235: write db/d29/f3c [875286,130801] 0 2024-09-17T01:51:59.443 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:59 smithi092 ceph-mon[33552]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:59.443 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:51:59 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/184188583' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:51:59.449 INFO:tasks.workunit.client.0.smithi031.stdout:3/204: creat db/df/d1d/d37/f3f x:0 0 0 2024-09-17T01:51:59.449 INFO:tasks.workunit.client.0.smithi031.stdout:6/352: dwrite d23/f3d [0,4194304] 0 2024-09-17T01:51:59.451 INFO:tasks.workunit.client.0.smithi031.stdout:1/275: rmdir d4/d1a/d43 39 2024-09-17T01:51:59.451 INFO:tasks.workunit.client.1.smithi092.stdout:8/61: readlink ld 0 2024-09-17T01:51:59.452 INFO:tasks.workunit.client.0.smithi031.stdout:6/353: read d23/d63/f56 [1425908,83852] 0 2024-09-17T01:51:59.453 INFO:tasks.workunit.client.1.smithi092.stdout:8/62: mknod c11 0 2024-09-17T01:51:59.453 INFO:tasks.workunit.client.0.smithi031.stdout:5/257: truncate da/f49 2208199 0 2024-09-17T01:51:59.454 INFO:tasks.workunit.client.0.smithi031.stdout:5/258: chown da/d42/l4f 577 1 2024-09-17T01:51:59.458 INFO:tasks.workunit.client.0.smithi031.stdout:0/243: mknod d0/d29/d33/d2a/d25/d38/c5d 0 2024-09-17T01:51:59.459 INFO:tasks.workunit.client.1.smithi092.stdout:8/63: unlink ld 0 2024-09-17T01:51:59.459 INFO:tasks.workunit.client.1.smithi092.stdout:1/67: fsync db/f14 0 2024-09-17T01:51:59.460 INFO:tasks.workunit.client.0.smithi031.stdout:1/276: dread - d4/d1a/d43/d53/f55 zero size 2024-09-17T01:51:59.461 INFO:tasks.workunit.client.1.smithi092.stdout:8/64: creat f12 x:0 0 0 2024-09-17T01:51:59.461 INFO:tasks.workunit.client.0.smithi031.stdout:1/277: stat d4/d1a/d2d/d18/f31 0 2024-09-17T01:51:59.462 INFO:tasks.workunit.client.1.smithi092.stdout:1/68: stat db/c13 0 2024-09-17T01:51:59.464 INFO:tasks.workunit.client.1.smithi092.stdout:8/65: symlink l13 0 2024-09-17T01:51:59.464 INFO:tasks.workunit.client.1.smithi092.stdout:8/66: truncate f12 111343 0 2024-09-17T01:51:59.465 INFO:tasks.workunit.client.1.smithi092.stdout:1/69: mknod db/c15 0 2024-09-17T01:51:59.467 INFO:tasks.workunit.client.1.smithi092.stdout:1/70: symlink db/l16 0 2024-09-17T01:51:59.469 INFO:tasks.workunit.client.0.smithi031.stdout:9/212: write d3/d19/d1f/f21 [1599958,41300] 0 2024-09-17T01:51:59.470 INFO:tasks.workunit.client.0.smithi031.stdout:0/244: creat d0/d29/d33/d2a/d25/d38/f5e x:0 0 0 2024-09-17T01:51:59.471 INFO:tasks.workunit.client.1.smithi092.stdout:8/67: dwrite f9 [0,4194304] 0 2024-09-17T01:51:59.472 INFO:tasks.workunit.client.1.smithi092.stdout:8/68: chown f7 0 1 2024-09-17T01:51:59.472 INFO:tasks.workunit.client.1.smithi092.stdout:8/69: chown c11 45788 1 2024-09-17T01:51:59.473 INFO:tasks.workunit.client.0.smithi031.stdout:4/247: getdents d8/d3a 0 2024-09-17T01:51:59.475 INFO:tasks.workunit.client.0.smithi031.stdout:3/205: link db/df/d1c/l27 db/df/d1d/d37/d3a/l40 0 2024-09-17T01:51:59.475 INFO:tasks.workunit.client.1.smithi092.stdout:8/70: creat f14 x:0 0 0 2024-09-17T01:51:59.476 INFO:tasks.workunit.client.0.smithi031.stdout:9/213: mkdir d3/d19/d1f/d44 0 2024-09-17T01:51:59.477 INFO:tasks.workunit.client.0.smithi031.stdout:1/278: creat d4/d3d/f57 x:0 0 0 2024-09-17T01:51:59.478 INFO:tasks.workunit.client.0.smithi031.stdout:1/279: chown d4/c8 1 1 2024-09-17T01:51:59.478 INFO:tasks.workunit.client.1.smithi092.stdout:8/71: mkdir d15 0 2024-09-17T01:51:59.478 INFO:tasks.workunit.client.0.smithi031.stdout:4/248: rmdir d8/d3a 39 2024-09-17T01:51:59.482 INFO:tasks.workunit.client.0.smithi031.stdout:5/259: rmdir da/d4b/d50 0 2024-09-17T01:51:59.483 INFO:tasks.workunit.client.0.smithi031.stdout:3/206: chown f9 533641696 1 2024-09-17T01:51:59.483 INFO:tasks.workunit.client.0.smithi031.stdout:5/260: read da/d14/f3b [23674,128745] 0 2024-09-17T01:51:59.485 INFO:tasks.workunit.client.1.smithi092.stdout:8/72: dwrite f9 [0,4194304] 0 2024-09-17T01:51:59.490 INFO:tasks.workunit.client.1.smithi092.stdout:8/73: dread f9 [0,4194304] 0 2024-09-17T01:51:59.491 INFO:tasks.workunit.client.0.smithi031.stdout:6/354: dread f5 [0,4194304] 0 2024-09-17T01:51:59.492 INFO:tasks.workunit.client.0.smithi031.stdout:5/261: stat da/dc/l1f 0 2024-09-17T01:51:59.493 INFO:tasks.workunit.client.0.smithi031.stdout:5/262: read da/d14/f3c [2901290,102209] 0 2024-09-17T01:51:59.495 INFO:tasks.workunit.client.0.smithi031.stdout:4/249: unlink d8/ff 0 2024-09-17T01:51:59.496 INFO:tasks.workunit.client.0.smithi031.stdout:7/236: dread db/f15 [4194304,4194304] 0 2024-09-17T01:51:59.497 INFO:tasks.workunit.client.0.smithi031.stdout:0/245: link d0/d29/d33/c49 d0/d29/d33/c5f 0 2024-09-17T01:51:59.498 INFO:tasks.workunit.client.0.smithi031.stdout:5/263: readlink da/dc/d2e/l52 0 2024-09-17T01:51:59.501 INFO:tasks.workunit.client.0.smithi031.stdout:0/246: chown d0/d29/d33/f35 14 1 2024-09-17T01:51:59.501 INFO:tasks.workunit.client.0.smithi031.stdout:1/280: rename d4/d1a/d2d/d18/c36 to d4/d1a/d2d/c58 0 2024-09-17T01:51:59.502 INFO:tasks.workunit.client.1.smithi092.stdout:8/74: dread fe [0,4194304] 0 2024-09-17T01:51:59.505 INFO:tasks.workunit.client.1.smithi092.stdout:1/71: dwrite f6 [0,4194304] 0 2024-09-17T01:51:59.505 INFO:tasks.workunit.client.0.smithi031.stdout:4/250: write d8/d3a/f40 [1990611,25855] 0 2024-09-17T01:51:59.505 INFO:tasks.workunit.client.0.smithi031.stdout:7/237: dwrite db/f10 [0,4194304] 0 2024-09-17T01:51:59.506 INFO:tasks.workunit.client.1.smithi092.stdout:8/75: write f14 [603533,72956] 0 2024-09-17T01:51:59.508 INFO:tasks.workunit.client.0.smithi031.stdout:5/264: creat da/dc/d2e/f59 x:0 0 0 2024-09-17T01:51:59.510 INFO:tasks.workunit.client.1.smithi092.stdout:1/72: rmdir db 39 2024-09-17T01:51:59.510 INFO:tasks.workunit.client.0.smithi031.stdout:3/207: getdents db 0 2024-09-17T01:51:59.511 INFO:tasks.workunit.client.1.smithi092.stdout:8/76: dread fe [0,4194304] 0 2024-09-17T01:51:59.513 INFO:tasks.workunit.client.1.smithi092.stdout:8/77: write f5 [3768013,58279] 0 2024-09-17T01:51:59.514 INFO:tasks.workunit.client.0.smithi031.stdout:4/251: symlink d8/d18/l46 0 2024-09-17T01:51:59.518 INFO:tasks.workunit.client.0.smithi031.stdout:9/214: dwrite d3/d4/d29/f31 [0,4194304] 0 2024-09-17T01:51:59.519 INFO:tasks.workunit.client.0.smithi031.stdout:3/208: creat db/f41 x:0 0 0 2024-09-17T01:51:59.520 INFO:tasks.workunit.client.0.smithi031.stdout:3/209: chown db/f1f 176819289 1 2024-09-17T01:51:59.521 INFO:tasks.workunit.client.0.smithi031.stdout:1/281: symlink d4/d1e/l59 0 2024-09-17T01:51:59.522 INFO:tasks.workunit.client.1.smithi092.stdout:8/78: dwrite f1 [0,4194304] 0 2024-09-17T01:51:59.526 INFO:tasks.workunit.client.0.smithi031.stdout:5/265: fdatasync da/d42/d12/f23 0 2024-09-17T01:51:59.527 INFO:tasks.workunit.client.1.smithi092.stdout:8/79: creat d15/f16 x:0 0 0 2024-09-17T01:51:59.527 INFO:tasks.workunit.client.0.smithi031.stdout:9/215: symlink d3/d19/d1f/l45 0 2024-09-17T01:51:59.528 INFO:tasks.workunit.client.0.smithi031.stdout:3/210: creat db/f42 x:0 0 0 2024-09-17T01:51:59.529 INFO:tasks.workunit.client.0.smithi031.stdout:0/247: link d0/d29/d33/d2a/d25/l47 d0/d29/l60 0 2024-09-17T01:51:59.529 INFO:tasks.workunit.client.1.smithi092.stdout:8/80: creat d15/f17 x:0 0 0 2024-09-17T01:51:59.533 INFO:tasks.workunit.client.1.smithi092.stdout:8/81: dread f7 [0,4194304] 0 2024-09-17T01:51:59.533 INFO:tasks.workunit.client.0.smithi031.stdout:5/266: symlink da/d42/d12/l5a 0 2024-09-17T01:51:59.534 INFO:tasks.workunit.client.1.smithi092.stdout:8/82: read f9 [1301420,14436] 0 2024-09-17T01:51:59.535 INFO:tasks.workunit.client.1.smithi092.stdout:8/83: chown ff 252002 1 2024-09-17T01:51:59.537 INFO:tasks.workunit.client.0.smithi031.stdout:1/282: link d4/f4a d4/d3d/f5a 0 2024-09-17T01:51:59.537 INFO:tasks.workunit.client.0.smithi031.stdout:7/238: getdents db/d1c/d41 0 2024-09-17T01:51:59.537 INFO:tasks.workunit.client.0.smithi031.stdout:3/211: dwrite db/df/f1b [0,4194304] 0 2024-09-17T01:51:59.538 INFO:tasks.workunit.client.1.smithi092.stdout:8/84: dread f1 [0,4194304] 0 2024-09-17T01:51:59.538 INFO:tasks.workunit.client.0.smithi031.stdout:3/212: stat db/c1a 0 2024-09-17T01:51:59.544 INFO:tasks.workunit.client.0.smithi031.stdout:6/355: truncate d23/f2e 1385218 0 2024-09-17T01:51:59.545 INFO:tasks.workunit.client.0.smithi031.stdout:5/267: read da/dc/f3a [3897519,58767] 0 2024-09-17T01:51:59.545 INFO:tasks.workunit.client.0.smithi031.stdout:7/239: mkdir db/d1c/d46 0 2024-09-17T01:51:59.547 INFO:tasks.workunit.client.0.smithi031.stdout:3/213: dwrite db/fe [0,4194304] 0 2024-09-17T01:51:59.547 INFO:tasks.workunit.client.1.smithi092.stdout:8/85: getdents d15 0 2024-09-17T01:51:59.547 INFO:tasks.workunit.client.0.smithi031.stdout:7/240: fdatasync db/fe 0 2024-09-17T01:51:59.547 INFO:tasks.workunit.client.0.smithi031.stdout:1/283: mknod d4/d1e/d3f/c5b 0 2024-09-17T01:51:59.548 INFO:tasks.workunit.client.1.smithi092.stdout:8/86: mknod d15/c18 0 2024-09-17T01:51:59.549 INFO:tasks.workunit.client.1.smithi092.stdout:8/87: write f5 [2691999,32548] 0 2024-09-17T01:51:59.550 INFO:tasks.workunit.client.0.smithi031.stdout:4/252: link d8/d22/f37 d8/d22/d25/f47 0 2024-09-17T01:51:59.552 INFO:tasks.workunit.client.1.smithi092.stdout:8/88: dread f14 [0,4194304] 0 2024-09-17T01:51:59.553 INFO:tasks.workunit.client.0.smithi031.stdout:7/241: dread db/f15 [4194304,4194304] 0 2024-09-17T01:51:59.554 INFO:tasks.workunit.client.0.smithi031.stdout:0/248: rename d0/c2e to d0/d29/d33/d5/d50/c61 0 2024-09-17T01:51:59.554 INFO:tasks.workunit.client.1.smithi092.stdout:8/89: fdatasync f12 0 2024-09-17T01:51:59.555 INFO:tasks.workunit.client.0.smithi031.stdout:4/253: dread d8/d18/f2d [0,4194304] 0 2024-09-17T01:51:59.557 INFO:tasks.workunit.client.1.smithi092.stdout:8/90: creat d15/f19 x:0 0 0 2024-09-17T01:51:59.558 INFO:tasks.workunit.client.0.smithi031.stdout:1/284: readlink d4/d1e/l45 0 2024-09-17T01:51:59.559 INFO:tasks.workunit.client.1.smithi092.stdout:8/91: rename f5 to d15/f1a 0 2024-09-17T01:51:59.563 INFO:tasks.workunit.client.0.smithi031.stdout:7/242: unlink db/d1c/l42 0 2024-09-17T01:51:59.563 INFO:tasks.workunit.client.0.smithi031.stdout:7/243: readlink db/d1c/l2b 0 2024-09-17T01:51:59.565 INFO:tasks.workunit.client.0.smithi031.stdout:6/356: mkdir d23/d50/d6a/d72/d75/d79 0 2024-09-17T01:51:59.566 INFO:tasks.workunit.client.0.smithi031.stdout:9/216: write d3/d10/f1a [2300655,59094] 0 2024-09-17T01:51:59.566 INFO:tasks.workunit.client.0.smithi031.stdout:4/254: readlink d8/d22/d25/l34 0 2024-09-17T01:51:59.568 INFO:tasks.workunit.client.0.smithi031.stdout:6/357: write d23/d63/d47/f60 [754548,70499] 0 2024-09-17T01:51:59.568 INFO:tasks.workunit.client.0.smithi031.stdout:6/358: stat d23/f5b 0 2024-09-17T01:51:59.569 INFO:tasks.workunit.client.1.smithi092.stdout:8/92: truncate f14 134322 0 2024-09-17T01:51:59.570 INFO:tasks.workunit.client.0.smithi031.stdout:0/249: rename d0/d29/d33/d2a/d25/f4f to d0/d29/d33/d5/f62 0 2024-09-17T01:51:59.571 INFO:tasks.workunit.client.0.smithi031.stdout:5/268: symlink da/l5b 0 2024-09-17T01:51:59.573 INFO:tasks.workunit.client.0.smithi031.stdout:5/269: dread - da/d42/f51 zero size 2024-09-17T01:51:59.575 INFO:tasks.workunit.client.0.smithi031.stdout:9/217: dwrite d3/d19/d1f/f23 [0,4194304] 0 2024-09-17T01:51:59.575 INFO:tasks.workunit.client.0.smithi031.stdout:3/214: link db/df/f31 db/d29/d2f/f43 0 2024-09-17T01:51:59.575 INFO:tasks.workunit.client.1.smithi092.stdout:8/93: dwrite fe [4194304,4194304] 0 2024-09-17T01:51:59.575 INFO:tasks.workunit.client.0.smithi031.stdout:3/215: chown db/df/d1d 25656907 1 2024-09-17T01:51:59.580 INFO:tasks.workunit.client.1.smithi092.stdout:8/94: link c11 d15/c1b 0 2024-09-17T01:51:59.581 INFO:tasks.workunit.client.0.smithi031.stdout:4/255: mknod d8/d22/d25/d36/c48 0 2024-09-17T01:51:59.581 INFO:tasks.workunit.client.1.smithi092.stdout:8/95: chown f1 818052 1 2024-09-17T01:51:59.585 INFO:tasks.workunit.client.1.smithi092.stdout:8/96: rename d15/f16 to d15/f1c 0 2024-09-17T01:51:59.586 INFO:tasks.workunit.client.1.smithi092.stdout:8/97: write ff [84486,93486] 0 2024-09-17T01:51:59.588 INFO:tasks.workunit.client.0.smithi031.stdout:0/250: link d0/d29/d33/f35 d0/d29/f63 0 2024-09-17T01:51:59.589 INFO:tasks.workunit.client.1.smithi092.stdout:8/98: unlink d15/f17 0 2024-09-17T01:51:59.590 INFO:tasks.workunit.client.0.smithi031.stdout:1/285: creat d4/d1a/d2d/f5c x:0 0 0 2024-09-17T01:51:59.591 INFO:tasks.workunit.client.0.smithi031.stdout:9/218: symlink d3/d19/l46 0 2024-09-17T01:51:59.595 INFO:tasks.workunit.client.0.smithi031.stdout:4/256: getdents d8/d3a/d41 0 2024-09-17T01:51:59.596 INFO:tasks.workunit.client.0.smithi031.stdout:0/251: dwrite d0/d29/d33/d2a/d25/f3f [0,4194304] 0 2024-09-17T01:51:59.599 INFO:tasks.workunit.client.0.smithi031.stdout:5/270: link da/dc/f44 da/d42/f5c 0 2024-09-17T01:51:59.600 INFO:tasks.workunit.client.0.smithi031.stdout:5/271: chown da/dc/f44 50748 1 2024-09-17T01:51:59.601 INFO:tasks.workunit.client.0.smithi031.stdout:7/244: getdents db/d29 0 2024-09-17T01:51:59.602 INFO:tasks.workunit.client.1.smithi092.stdout:8/99: getdents d15 0 2024-09-17T01:51:59.602 INFO:tasks.workunit.client.0.smithi031.stdout:6/359: write d23/d63/f56 [4478343,41223] 0 2024-09-17T01:51:59.603 INFO:tasks.workunit.client.0.smithi031.stdout:3/216: creat db/df/f44 x:0 0 0 2024-09-17T01:51:59.604 INFO:tasks.workunit.client.0.smithi031.stdout:3/217: chown db/d29/d2f 1 1 2024-09-17T01:51:59.604 INFO:tasks.workunit.client.1.smithi092.stdout:8/100: creat d15/f1d x:0 0 0 2024-09-17T01:51:59.604 INFO:tasks.workunit.client.0.smithi031.stdout:1/286: mkdir d4/d1e/d5d 0 2024-09-17T01:51:59.606 INFO:tasks.workunit.client.0.smithi031.stdout:3/218: truncate db/df/d1d/d37/f3f 795001 0 2024-09-17T01:51:59.606 INFO:tasks.workunit.client.1.smithi092.stdout:8/101: creat d15/f1e x:0 0 0 2024-09-17T01:51:59.606 INFO:tasks.workunit.client.0.smithi031.stdout:9/219: mkdir d3/d47 0 2024-09-17T01:51:59.607 INFO:tasks.workunit.client.0.smithi031.stdout:9/220: stat l0 0 2024-09-17T01:51:59.608 INFO:tasks.workunit.client.1.smithi092.stdout:8/102: unlink l13 0 2024-09-17T01:51:59.609 INFO:tasks.workunit.client.0.smithi031.stdout:0/252: chown d0/f1f 0 1 2024-09-17T01:51:59.613 INFO:tasks.workunit.client.0.smithi031.stdout:7/245: rename db/ld to db/d18/l47 0 2024-09-17T01:51:59.614 INFO:tasks.workunit.client.0.smithi031.stdout:3/219: dwrite db/f19 [0,4194304] 0 2024-09-17T01:51:59.614 INFO:tasks.workunit.client.1.smithi092.stdout:8/103: getdents d15 0 2024-09-17T01:51:59.615 INFO:tasks.workunit.client.0.smithi031.stdout:4/257: symlink d8/l49 0 2024-09-17T01:51:59.615 INFO:tasks.workunit.client.0.smithi031.stdout:7/246: write db/d18/f2f [473266,22231] 0 2024-09-17T01:51:59.616 INFO:tasks.workunit.client.1.smithi092.stdout:8/104: getdents d15 0 2024-09-17T01:51:59.618 INFO:tasks.workunit.client.1.smithi092.stdout:8/105: creat d15/f1f x:0 0 0 2024-09-17T01:51:59.618 INFO:tasks.workunit.client.0.smithi031.stdout:4/258: write d8/fd [3614625,45165] 0 2024-09-17T01:51:59.620 INFO:tasks.workunit.client.0.smithi031.stdout:5/272: write da/dc/f44 [956758,105212] 0 2024-09-17T01:51:59.621 INFO:tasks.workunit.client.0.smithi031.stdout:0/253: creat d0/d29/d33/d2a/d25/d30/d4a/f64 x:0 0 0 2024-09-17T01:51:59.623 INFO:tasks.workunit.client.0.smithi031.stdout:1/287: mknod d4/d1a/d2d/c5e 0 2024-09-17T01:51:59.624 INFO:tasks.workunit.client.0.smithi031.stdout:1/288: chown d4/d1a/d2d/d18/c2c 4024 1 2024-09-17T01:51:59.626 INFO:tasks.workunit.client.0.smithi031.stdout:5/273: fsync da/d42/d12/f23 0 2024-09-17T01:51:59.626 INFO:tasks.workunit.client.1.smithi092.stdout:8/106: dwrite d15/f19 [0,4194304] 0 2024-09-17T01:51:59.628 INFO:tasks.workunit.client.1.smithi092.stdout:8/107: symlink d15/l20 0 2024-09-17T01:51:59.628 INFO:tasks.workunit.client.0.smithi031.stdout:3/220: link db/d29/f2e db/d29/f45 0 2024-09-17T01:51:59.633 INFO:tasks.workunit.client.1.smithi092.stdout:8/108: dread d15/f1a [0,4194304] 0 2024-09-17T01:51:59.633 INFO:tasks.workunit.client.0.smithi031.stdout:9/221: creat d3/d10/f48 x:0 0 0 2024-09-17T01:51:59.634 INFO:tasks.workunit.client.1.smithi092.stdout:8/109: dread f14 [0,4194304] 0 2024-09-17T01:51:59.636 INFO:tasks.workunit.client.1.smithi092.stdout:8/110: write d15/f1f [868262,48314] 0 2024-09-17T01:51:59.636 INFO:tasks.workunit.client.0.smithi031.stdout:4/259: creat d8/d3a/d41/f4a x:0 0 0 2024-09-17T01:51:59.636 INFO:tasks.workunit.client.0.smithi031.stdout:9/222: truncate d3/d4/d29/f31 5090560 0 2024-09-17T01:51:59.637 INFO:tasks.workunit.client.1.smithi092.stdout:8/111: chown lb 229961669 1 2024-09-17T01:51:59.637 INFO:tasks.workunit.client.1.smithi092.stdout:8/112: write fe [6893086,98209] 0 2024-09-17T01:51:59.637 INFO:tasks.workunit.client.1.smithi092.stdout:8/113: stat fe 0 2024-09-17T01:51:59.638 INFO:tasks.workunit.client.1.smithi092.stdout:8/114: creat d15/f21 x:0 0 0 2024-09-17T01:51:59.639 INFO:tasks.workunit.client.1.smithi092.stdout:8/115: fdatasync d15/f1c 0 2024-09-17T01:51:59.640 INFO:tasks.workunit.client.1.smithi092.stdout:8/116: stat d15/f21 0 2024-09-17T01:51:59.641 INFO:tasks.workunit.client.0.smithi031.stdout:6/360: truncate d23/f39 3334616 0 2024-09-17T01:51:59.642 INFO:tasks.workunit.client.1.smithi092.stdout:8/117: dread f7 [0,4194304] 0 2024-09-17T01:51:59.643 INFO:tasks.workunit.client.1.smithi092.stdout:8/118: write ff [247133,92332] 0 2024-09-17T01:51:59.643 INFO:tasks.workunit.client.0.smithi031.stdout:3/221: truncate db/df/f31 3403162 0 2024-09-17T01:51:59.645 INFO:tasks.workunit.client.0.smithi031.stdout:4/260: symlink d8/d18/l4b 0 2024-09-17T01:51:59.645 INFO:tasks.workunit.client.0.smithi031.stdout:7/247: truncate db/f10 2956982 0 2024-09-17T01:51:59.647 INFO:tasks.workunit.client.0.smithi031.stdout:9/223: mknod d3/d4/d41/c49 0 2024-09-17T01:51:59.649 INFO:tasks.workunit.client.0.smithi031.stdout:7/248: readlink db/d1c/l34 0 2024-09-17T01:51:59.650 INFO:tasks.workunit.client.0.smithi031.stdout:5/274: getdents da/d42/d12/d4a 0 2024-09-17T01:51:59.651 INFO:tasks.workunit.client.0.smithi031.stdout:4/261: mkdir d8/d22/d25/d36/d4c 0 2024-09-17T01:51:59.652 INFO:tasks.workunit.client.0.smithi031.stdout:6/361: dwrite d23/d50/f69 [0,4194304] 0 2024-09-17T01:51:59.652 INFO:tasks.workunit.client.1.smithi092.stdout:8/119: dwrite d15/f1e [0,4194304] 0 2024-09-17T01:51:59.653 INFO:tasks.workunit.client.1.smithi092.stdout:8/120: fdatasync d15/f1c 0 2024-09-17T01:51:59.654 INFO:tasks.workunit.client.1.smithi092.stdout:8/121: fdatasync d15/f1a 0 2024-09-17T01:51:59.656 INFO:tasks.workunit.client.1.smithi092.stdout:8/122: fsync fa 0 2024-09-17T01:51:59.659 INFO:tasks.workunit.client.0.smithi031.stdout:3/222: dread f9 [0,4194304] 0 2024-09-17T01:51:59.661 INFO:tasks.workunit.client.0.smithi031.stdout:7/249: creat db/d18/f48 x:0 0 0 2024-09-17T01:51:59.661 INFO:tasks.workunit.client.0.smithi031.stdout:1/289: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:51:59.662 INFO:tasks.workunit.client.1.smithi092.stdout:8/123: dwrite f7 [0,4194304] 0 2024-09-17T01:51:59.662 INFO:tasks.workunit.client.0.smithi031.stdout:3/223: fdatasync db/df/f1b 0 2024-09-17T01:51:59.663 INFO:tasks.workunit.client.1.smithi092.stdout:8/124: write fe [801771,20796] 0 2024-09-17T01:51:59.666 INFO:tasks.workunit.client.1.smithi092.stdout:8/125: mknod d15/c22 0 2024-09-17T01:51:59.667 INFO:tasks.workunit.client.1.smithi092.stdout:8/126: readlink d15/l20 0 2024-09-17T01:51:59.670 INFO:tasks.workunit.client.0.smithi031.stdout:7/250: read db/d18/f27 [578353,63617] 0 2024-09-17T01:51:59.672 INFO:tasks.workunit.client.0.smithi031.stdout:4/262: unlink d8/d22/d25/f2c 0 2024-09-17T01:51:59.672 INFO:tasks.workunit.client.0.smithi031.stdout:5/275: dwrite da/dc/f27 [4194304,4194304] 0 2024-09-17T01:51:59.673 INFO:tasks.workunit.client.0.smithi031.stdout:1/290: symlink d4/d1e/d40/l5f 0 2024-09-17T01:51:59.676 INFO:tasks.workunit.client.1.smithi092.stdout:8/127: dwrite d15/f1e [0,4194304] 0 2024-09-17T01:51:59.677 INFO:tasks.workunit.client.1.smithi092.stdout:8/128: chown d15/f1c 437 1 2024-09-17T01:51:59.677 INFO:tasks.workunit.client.1.smithi092.stdout:8/129: chown f14 112 1 2024-09-17T01:51:59.677 INFO:tasks.workunit.client.1.smithi092.stdout:8/130: truncate f12 685844 0 2024-09-17T01:51:59.678 INFO:tasks.workunit.client.0.smithi031.stdout:7/251: read db/f15 [79888,128177] 0 2024-09-17T01:51:59.679 INFO:tasks.workunit.client.1.smithi092.stdout:8/131: creat d15/f23 x:0 0 0 2024-09-17T01:51:59.680 INFO:tasks.workunit.client.1.smithi092.stdout:8/132: fsync ff 0 2024-09-17T01:51:59.681 INFO:tasks.workunit.client.1.smithi092.stdout:8/133: creat d15/f24 x:0 0 0 2024-09-17T01:51:59.682 INFO:tasks.workunit.client.1.smithi092.stdout:8/134: mkdir d15/d25 0 2024-09-17T01:51:59.685 INFO:tasks.workunit.client.1.smithi092.stdout:8/135: rename fe to d15/f26 0 2024-09-17T01:51:59.686 INFO:tasks.workunit.client.1.smithi092.stdout:8/136: mkdir d15/d25/d27 0 2024-09-17T01:51:59.687 INFO:tasks.workunit.client.1.smithi092.stdout:8/137: truncate d15/f19 4594344 0 2024-09-17T01:51:59.687 INFO:tasks.workunit.client.1.smithi092.stdout:8/138: fsync d15/f1f 0 2024-09-17T01:51:59.689 INFO:tasks.workunit.client.1.smithi092.stdout:8/139: write d15/f1d [84008,27651] 0 2024-09-17T01:51:59.689 INFO:tasks.workunit.client.0.smithi031.stdout:3/224: rename db/d29/f45 to db/f46 0 2024-09-17T01:51:59.689 INFO:tasks.workunit.client.1.smithi092.stdout:8/140: fdatasync f12 0 2024-09-17T01:51:59.692 INFO:tasks.workunit.client.1.smithi092.stdout:8/141: mknod d15/c28 0 2024-09-17T01:51:59.692 INFO:tasks.workunit.client.1.smithi092.stdout:8/142: fsync d15/f1f 0 2024-09-17T01:51:59.695 INFO:tasks.workunit.client.0.smithi031.stdout:9/224: getdents d3/d4/d29 0 2024-09-17T01:51:59.697 INFO:tasks.workunit.client.0.smithi031.stdout:1/291: creat d4/d1e/d3f/f60 x:0 0 0 2024-09-17T01:51:59.699 INFO:tasks.workunit.client.1.smithi092.stdout:8/143: dwrite d15/f1e [0,4194304] 0 2024-09-17T01:51:59.699 INFO:tasks.workunit.client.0.smithi031.stdout:7/252: unlink db/f1b 0 2024-09-17T01:51:59.700 INFO:tasks.workunit.client.0.smithi031.stdout:9/225: dread d3/d19/d1f/f23 [0,4194304] 0 2024-09-17T01:51:59.704 INFO:tasks.workunit.client.0.smithi031.stdout:6/362: getdents d23/d63/d47 0 2024-09-17T01:51:59.711 INFO:tasks.workunit.client.0.smithi031.stdout:1/292: truncate d4/f10 1531278 0 2024-09-17T01:51:59.712 INFO:tasks.workunit.client.1.smithi092.stdout:8/144: read d15/f1d [58471,26759] 0 2024-09-17T01:51:59.712 INFO:tasks.workunit.client.1.smithi092.stdout:8/145: chown d15 1481991 1 2024-09-17T01:51:59.714 INFO:tasks.workunit.client.0.smithi031.stdout:6/363: rename f19 to d23/d50/d64/d67/f7a 0 2024-09-17T01:51:59.714 INFO:tasks.workunit.client.1.smithi092.stdout:8/146: dread ff [0,4194304] 0 2024-09-17T01:51:59.715 INFO:tasks.workunit.client.0.smithi031.stdout:7/253: dwrite db/d18/f25 [0,4194304] 0 2024-09-17T01:51:59.715 INFO:tasks.workunit.client.1.smithi092.stdout:8/147: write d15/f23 [223496,46254] 0 2024-09-17T01:51:59.717 INFO:tasks.workunit.client.0.smithi031.stdout:9/226: dwrite d3/d19/d1f/f43 [0,4194304] 0 2024-09-17T01:51:59.718 INFO:tasks.workunit.client.1.smithi092.stdout:8/148: dread d15/f1a [0,4194304] 0 2024-09-17T01:51:59.719 INFO:tasks.workunit.client.0.smithi031.stdout:3/225: truncate db/df/f1b 367194 0 2024-09-17T01:51:59.719 INFO:tasks.workunit.client.0.smithi031.stdout:7/254: chown db/d18/l22 219 1 2024-09-17T01:51:59.721 INFO:tasks.workunit.client.0.smithi031.stdout:6/364: chown d23/c46 187715 1 2024-09-17T01:51:59.722 INFO:tasks.workunit.client.0.smithi031.stdout:7/255: write db/fe [2395656,46030] 0 2024-09-17T01:51:59.722 INFO:tasks.workunit.client.0.smithi031.stdout:9/227: write d3/d19/f3e [456086,91197] 0 2024-09-17T01:51:59.728 INFO:tasks.workunit.client.0.smithi031.stdout:1/293: creat d4/d1a/d2d/f61 x:0 0 0 2024-09-17T01:51:59.728 INFO:tasks.workunit.client.1.smithi092.stdout:8/149: dwrite f1 [0,4194304] 0 2024-09-17T01:51:59.729 INFO:tasks.workunit.client.0.smithi031.stdout:5/276: dread da/d42/d26/f34 [0,4194304] 0 2024-09-17T01:51:59.730 INFO:tasks.workunit.client.0.smithi031.stdout:9/228: mknod d3/d19/d1f/c4a 0 2024-09-17T01:51:59.734 INFO:tasks.workunit.client.0.smithi031.stdout:6/365: symlink d23/d63/l7b 0 2024-09-17T01:51:59.741 INFO:tasks.workunit.client.0.smithi031.stdout:4/263: dwrite d8/f2b [0,4194304] 0 2024-09-17T01:51:59.743 INFO:tasks.workunit.client.0.smithi031.stdout:1/294: symlink d4/d1e/l62 0 2024-09-17T01:51:59.743 INFO:tasks.workunit.client.0.smithi031.stdout:1/295: fdatasync f3 0 2024-09-17T01:51:59.745 INFO:tasks.workunit.client.0.smithi031.stdout:3/226: link db/df/c2c db/d29/d2f/c47 0 2024-09-17T01:51:59.749 INFO:tasks.workunit.client.0.smithi031.stdout:4/264: truncate d8/d18/f2d 115140 0 2024-09-17T01:51:59.752 INFO:tasks.workunit.client.0.smithi031.stdout:6/366: getdents d23/d50/d64 0 2024-09-17T01:51:59.753 INFO:tasks.workunit.client.0.smithi031.stdout:4/265: mkdir d8/d18/d4d 0 2024-09-17T01:51:59.758 INFO:tasks.workunit.client.0.smithi031.stdout:1/296: dwrite d4/d1a/d43/d53/f55 [0,4194304] 0 2024-09-17T01:51:59.758 INFO:tasks.workunit.client.0.smithi031.stdout:1/297: readlink d4/l5 0 2024-09-17T01:51:59.759 INFO:tasks.workunit.client.0.smithi031.stdout:1/298: dread - d4/d1a/d43/f50 zero size 2024-09-17T01:51:59.761 INFO:tasks.workunit.client.0.smithi031.stdout:4/266: mknod d8/c4e 0 2024-09-17T01:51:59.768 INFO:tasks.workunit.client.0.smithi031.stdout:9/229: dread d3/f15 [0,4194304] 0 2024-09-17T01:51:59.770 INFO:tasks.workunit.client.0.smithi031.stdout:1/299: getdents d4/d1e/d3f/d4d 0 2024-09-17T01:51:59.771 INFO:tasks.workunit.client.0.smithi031.stdout:6/367: dread f1c [0,4194304] 0 2024-09-17T01:51:59.774 INFO:tasks.workunit.client.0.smithi031.stdout:7/256: dread db/fe [0,4194304] 0 2024-09-17T01:51:59.777 INFO:tasks.workunit.client.0.smithi031.stdout:1/300: dread d4/d1a/d2d/d18/f2e [0,4194304] 0 2024-09-17T01:51:59.780 INFO:tasks.workunit.client.0.smithi031.stdout:1/301: dread - d4/d1a/d2d/d18/f1c zero size 2024-09-17T01:51:59.782 INFO:tasks.workunit.client.0.smithi031.stdout:6/368: dwrite d23/d63/f4f [0,4194304] 0 2024-09-17T01:51:59.783 INFO:tasks.workunit.client.0.smithi031.stdout:9/230: truncate d3/d19/f30 3027150 0 2024-09-17T01:51:59.787 INFO:tasks.workunit.client.0.smithi031.stdout:9/231: fdatasync d3/fb 0 2024-09-17T01:51:59.790 INFO:tasks.workunit.client.0.smithi031.stdout:1/302: rename d4/d1a/d43/f50 to d4/d1a/d2d/d18/d52/f63 0 2024-09-17T01:51:59.791 INFO:tasks.workunit.client.0.smithi031.stdout:4/267: dwrite d8/d18/f2d [0,4194304] 0 2024-09-17T01:51:59.793 INFO:tasks.workunit.client.0.smithi031.stdout:1/303: write d4/d1a/d2d/d18/f31 [4773273,3579] 0 2024-09-17T01:51:59.802 INFO:tasks.workunit.client.0.smithi031.stdout:9/232: write d3/f8 [3459989,51502] 0 2024-09-17T01:51:59.803 INFO:tasks.workunit.client.0.smithi031.stdout:7/257: dwrite db/f10 [0,4194304] 0 2024-09-17T01:51:59.805 INFO:tasks.workunit.client.0.smithi031.stdout:4/268: mkdir d8/d18/d4f 0 2024-09-17T01:51:59.806 INFO:tasks.workunit.client.0.smithi031.stdout:4/269: write d8/f27 [587489,123012] 0 2024-09-17T01:51:59.806 INFO:tasks.workunit.client.0.smithi031.stdout:1/304: unlink d4/c21 0 2024-09-17T01:51:59.807 INFO:tasks.workunit.client.0.smithi031.stdout:4/270: chown d8/d18/c1e 110046 1 2024-09-17T01:51:59.808 INFO:tasks.workunit.client.0.smithi031.stdout:6/369: rename d23/c41 to d23/d63/d47/c7c 0 2024-09-17T01:51:59.810 INFO:tasks.workunit.client.0.smithi031.stdout:7/258: creat db/d29/f49 x:0 0 0 2024-09-17T01:51:59.810 INFO:tasks.workunit.client.0.smithi031.stdout:6/370: write d23/d63/f4a [4932343,119521] 0 2024-09-17T01:51:59.812 INFO:tasks.workunit.client.0.smithi031.stdout:9/233: creat d3/d4/d29/f4b x:0 0 0 2024-09-17T01:51:59.815 INFO:tasks.workunit.client.0.smithi031.stdout:7/259: creat db/d29/f4a x:0 0 0 2024-09-17T01:51:59.816 INFO:tasks.workunit.client.0.smithi031.stdout:6/371: readlink d23/l4e 0 2024-09-17T01:51:59.819 INFO:tasks.workunit.client.0.smithi031.stdout:6/372: dread - d23/d50/f5a zero size 2024-09-17T01:51:59.821 INFO:tasks.workunit.client.0.smithi031.stdout:7/260: creat db/d1c/d41/f4b x:0 0 0 2024-09-17T01:51:59.821 INFO:tasks.workunit.client.0.smithi031.stdout:9/234: dwrite d3/f42 [0,4194304] 0 2024-09-17T01:51:59.822 INFO:tasks.workunit.client.0.smithi031.stdout:6/373: unlink d23/d63/f3c 0 2024-09-17T01:51:59.823 INFO:tasks.workunit.client.0.smithi031.stdout:9/235: write d3/d19/d1f/f43 [2308081,126359] 0 2024-09-17T01:51:59.824 INFO:tasks.workunit.client.0.smithi031.stdout:6/374: chown c3 5118565 1 2024-09-17T01:51:59.824 INFO:tasks.workunit.client.0.smithi031.stdout:9/236: fdatasync d3/d4/f2f 0 2024-09-17T01:51:59.827 INFO:tasks.workunit.client.0.smithi031.stdout:7/261: creat db/d1c/d46/f4c x:0 0 0 2024-09-17T01:51:59.831 INFO:tasks.workunit.client.0.smithi031.stdout:6/375: symlink d23/d50/d6a/d72/l7d 0 2024-09-17T01:51:59.833 INFO:tasks.workunit.client.0.smithi031.stdout:6/376: write d23/d63/d47/f60 [935985,54715] 0 2024-09-17T01:51:59.833 INFO:tasks.workunit.client.0.smithi031.stdout:7/262: creat db/d1c/d41/f4d x:0 0 0 2024-09-17T01:51:59.835 INFO:tasks.workunit.client.0.smithi031.stdout:9/237: fsync d3/d4/d29/f4b 0 2024-09-17T01:51:59.836 INFO:tasks.workunit.client.0.smithi031.stdout:7/263: creat db/d29/f4e x:0 0 0 2024-09-17T01:51:59.837 INFO:tasks.workunit.client.0.smithi031.stdout:6/377: fsync d23/d63/d47/f60 0 2024-09-17T01:51:59.838 INFO:tasks.workunit.client.0.smithi031.stdout:1/305: write d4/f10 [1450841,50098] 0 2024-09-17T01:51:59.839 INFO:tasks.workunit.client.0.smithi031.stdout:7/264: creat db/d1c/d46/f4f x:0 0 0 2024-09-17T01:51:59.839 INFO:tasks.workunit.client.0.smithi031.stdout:4/271: write d8/d22/d25/f47 [733342,82973] 0 2024-09-17T01:51:59.841 INFO:tasks.workunit.client.0.smithi031.stdout:7/265: dread - db/d1c/d46/f4f zero size 2024-09-17T01:51:59.842 INFO:tasks.workunit.client.0.smithi031.stdout:9/238: mkdir d3/d4c 0 2024-09-17T01:51:59.846 INFO:tasks.workunit.client.0.smithi031.stdout:6/378: unlink d23/l2d 0 2024-09-17T01:51:59.847 INFO:tasks.workunit.client.0.smithi031.stdout:6/379: truncate d23/d50/f5e 79225 0 2024-09-17T01:51:59.849 INFO:tasks.workunit.client.0.smithi031.stdout:4/272: fdatasync d8/fc 0 2024-09-17T01:51:59.850 INFO:tasks.workunit.client.0.smithi031.stdout:7/266: mknod db/c50 0 2024-09-17T01:51:59.853 INFO:tasks.workunit.client.0.smithi031.stdout:9/239: symlink d3/d19/l4d 0 2024-09-17T01:51:59.853 INFO:tasks.workunit.client.0.smithi031.stdout:6/380: dread d23/f42 [0,4194304] 0 2024-09-17T01:51:59.853 INFO:tasks.workunit.client.0.smithi031.stdout:6/381: write d23/f36 [1874874,105110] 0 2024-09-17T01:51:59.855 INFO:tasks.workunit.client.0.smithi031.stdout:1/306: write d4/f4a [1898200,129250] 0 2024-09-17T01:51:59.857 INFO:tasks.workunit.client.0.smithi031.stdout:1/307: write d4/d1e/f3b [503747,24604] 0 2024-09-17T01:51:59.861 INFO:tasks.workunit.client.0.smithi031.stdout:4/273: rename d8/d18/c35 to d8/d22/c50 0 2024-09-17T01:51:59.863 INFO:tasks.workunit.client.0.smithi031.stdout:7/267: dwrite db/f1f [0,4194304] 0 2024-09-17T01:51:59.863 INFO:tasks.workunit.client.0.smithi031.stdout:9/240: symlink d3/d10/l4e 0 2024-09-17T01:51:59.864 INFO:tasks.workunit.client.0.smithi031.stdout:1/308: mknod d4/d1a/d2d/d18/d52/c64 0 2024-09-17T01:51:59.865 INFO:tasks.workunit.client.0.smithi031.stdout:7/268: chown l6 0 1 2024-09-17T01:51:59.868 INFO:tasks.workunit.client.0.smithi031.stdout:7/269: dread - db/d29/f4e zero size 2024-09-17T01:51:59.868 INFO:tasks.workunit.client.0.smithi031.stdout:6/382: dwrite d23/d50/f58 [0,4194304] 0 2024-09-17T01:51:59.869 INFO:tasks.workunit.client.0.smithi031.stdout:1/309: mkdir d4/d3d/d65 0 2024-09-17T01:51:59.873 INFO:tasks.workunit.client.0.smithi031.stdout:9/241: creat d3/d4c/f4f x:0 0 0 2024-09-17T01:51:59.873 INFO:tasks.workunit.client.0.smithi031.stdout:1/310: mknod d4/d1a/d2d/d18/d52/c66 0 2024-09-17T01:51:59.900 INFO:tasks.workunit.client.0.smithi031.stdout:6/383: dwrite d23/d63/d47/f4c [4194304,4194304] 0 2024-09-17T01:51:59.902 INFO:tasks.workunit.client.1.smithi092.stdout:7/126: sync 2024-09-17T01:51:59.902 INFO:tasks.workunit.client.1.smithi092.stdout:5/32: sync 2024-09-17T01:51:59.902 INFO:tasks.workunit.client.1.smithi092.stdout:3/53: sync 2024-09-17T01:51:59.902 INFO:tasks.workunit.client.1.smithi092.stdout:3/54: dread - no filename 2024-09-17T01:51:59.902 INFO:tasks.workunit.client.1.smithi092.stdout:3/55: dread - no filename 2024-09-17T01:51:59.903 INFO:tasks.workunit.client.1.smithi092.stdout:7/127: chown d3/d6/d13/d21 404 1 2024-09-17T01:51:59.904 INFO:tasks.workunit.client.0.smithi031.stdout:7/270: creat db/f51 x:0 0 0 2024-09-17T01:51:59.905 INFO:tasks.workunit.client.1.smithi092.stdout:3/56: chown d4/ld 58885 1 2024-09-17T01:51:59.906 INFO:tasks.workunit.client.1.smithi092.stdout:7/128: symlink d3/l2d 0 2024-09-17T01:51:59.908 INFO:tasks.workunit.client.1.smithi092.stdout:3/57: rename d4/ca to d4/c11 0 2024-09-17T01:51:59.908 INFO:tasks.workunit.client.1.smithi092.stdout:3/58: dwrite - no filename 2024-09-17T01:51:59.908 INFO:tasks.workunit.client.1.smithi092.stdout:3/59: dwrite - no filename 2024-09-17T01:51:59.909 INFO:tasks.workunit.client.1.smithi092.stdout:5/33: getdents d0 0 2024-09-17T01:51:59.909 INFO:tasks.workunit.client.1.smithi092.stdout:5/34: chown d0/f5 1565 1 2024-09-17T01:51:59.910 INFO:tasks.workunit.client.0.smithi031.stdout:6/384: dwrite d23/d63/f59 [0,4194304] 0 2024-09-17T01:51:59.911 INFO:tasks.workunit.client.1.smithi092.stdout:3/60: rmdir d4 39 2024-09-17T01:51:59.911 INFO:tasks.workunit.client.1.smithi092.stdout:3/61: dread - no filename 2024-09-17T01:51:59.911 INFO:tasks.workunit.client.1.smithi092.stdout:5/35: fdatasync d0/f8 0 2024-09-17T01:51:59.911 INFO:tasks.workunit.client.0.smithi031.stdout:4/274: truncate d8/d18/f2d 2797671 0 2024-09-17T01:51:59.913 INFO:tasks.workunit.client.1.smithi092.stdout:3/62: mknod d4/c12 0 2024-09-17T01:51:59.913 INFO:tasks.workunit.client.1.smithi092.stdout:3/63: write - no filename 2024-09-17T01:51:59.914 INFO:tasks.workunit.client.1.smithi092.stdout:5/36: mkdir d0/d9 0 2024-09-17T01:51:59.916 INFO:tasks.workunit.client.1.smithi092.stdout:3/64: mkdir d4/d13 0 2024-09-17T01:51:59.917 INFO:tasks.workunit.client.0.smithi031.stdout:7/271: dwrite db/d29/f2e [0,4194304] 0 2024-09-17T01:51:59.917 INFO:tasks.workunit.client.1.smithi092.stdout:5/37: mknod d0/ca 0 2024-09-17T01:51:59.917 INFO:tasks.workunit.client.1.smithi092.stdout:7/129: dwrite d3/db/f15 [4194304,4194304] 0 2024-09-17T01:51:59.919 INFO:tasks.workunit.client.1.smithi092.stdout:7/130: write d3/db/f15 [7921814,47753] 0 2024-09-17T01:51:59.920 INFO:tasks.workunit.client.1.smithi092.stdout:5/38: rmdir d0 39 2024-09-17T01:51:59.922 INFO:tasks.workunit.client.0.smithi031.stdout:4/275: dwrite d8/f28 [0,4194304] 0 2024-09-17T01:51:59.923 INFO:tasks.workunit.client.0.smithi031.stdout:4/276: chown d8/f27 125269 1 2024-09-17T01:51:59.924 INFO:tasks.workunit.client.1.smithi092.stdout:3/65: creat d4/d13/f14 x:0 0 0 2024-09-17T01:51:59.925 INFO:tasks.workunit.client.1.smithi092.stdout:7/131: mkdir d3/d6/d13/d21/d2e 0 2024-09-17T01:51:59.927 INFO:tasks.workunit.client.0.smithi031.stdout:6/385: dread d23/f2e [0,4194304] 0 2024-09-17T01:51:59.929 INFO:tasks.workunit.client.0.smithi031.stdout:6/386: truncate d23/d63/f49 923874 0 2024-09-17T01:51:59.930 INFO:tasks.workunit.client.1.smithi092.stdout:5/39: creat d0/d9/fb x:0 0 0 2024-09-17T01:51:59.932 INFO:tasks.workunit.client.0.smithi031.stdout:4/277: creat d8/d22/d25/d36/d4c/f51 x:0 0 0 2024-09-17T01:51:59.932 INFO:tasks.workunit.client.1.smithi092.stdout:5/40: write d0/d9/fb [280534,38047] 0 2024-09-17T01:51:59.934 INFO:tasks.workunit.client.1.smithi092.stdout:3/66: dwrite d4/d13/f14 [0,4194304] 0 2024-09-17T01:51:59.934 INFO:tasks.workunit.client.0.smithi031.stdout:1/311: dread d4/d1a/d2d/d18/f39 [0,4194304] 0 2024-09-17T01:51:59.936 INFO:tasks.workunit.client.0.smithi031.stdout:6/387: creat d23/d63/f7e x:0 0 0 2024-09-17T01:51:59.936 INFO:tasks.workunit.client.1.smithi092.stdout:5/41: rename d0/f8 to d0/fc 0 2024-09-17T01:51:59.937 INFO:tasks.workunit.client.0.smithi031.stdout:1/312: rmdir d4/d3d 39 2024-09-17T01:51:59.938 INFO:tasks.workunit.client.0.smithi031.stdout:1/313: write d4/d1a/d2d/f61 [984986,3833] 0 2024-09-17T01:51:59.939 INFO:tasks.workunit.client.1.smithi092.stdout:3/67: dread d4/d13/f14 [0,4194304] 0 2024-09-17T01:51:59.941 INFO:tasks.workunit.client.0.smithi031.stdout:6/388: creat d23/d50/d6a/d70/f7f x:0 0 0 2024-09-17T01:51:59.943 INFO:tasks.workunit.client.1.smithi092.stdout:3/68: write d4/d13/f14 [1824058,7657] 0 2024-09-17T01:51:59.946 INFO:tasks.workunit.client.1.smithi092.stdout:3/69: creat d4/f15 x:0 0 0 2024-09-17T01:51:59.946 INFO:tasks.workunit.client.1.smithi092.stdout:5/42: dwrite d0/f7 [0,4194304] 0 2024-09-17T01:51:59.949 INFO:tasks.workunit.client.0.smithi031.stdout:1/314: dread d4/f4a [0,4194304] 0 2024-09-17T01:51:59.950 INFO:tasks.workunit.client.1.smithi092.stdout:3/70: mkdir d4/d16 0 2024-09-17T01:51:59.951 INFO:tasks.workunit.client.1.smithi092.stdout:5/43: dread d0/fc [0,4194304] 0 2024-09-17T01:51:59.952 INFO:tasks.workunit.client.0.smithi031.stdout:1/315: symlink d4/d1e/l67 0 2024-09-17T01:51:59.954 INFO:tasks.workunit.client.0.smithi031.stdout:1/316: getdents d4/d1e/d40 0 2024-09-17T01:51:59.955 INFO:tasks.workunit.client.0.smithi031.stdout:1/317: readlink d4/l12 0 2024-09-17T01:51:59.958 INFO:tasks.workunit.client.0.smithi031.stdout:4/278: fdatasync d8/f28 0 2024-09-17T01:51:59.958 INFO:tasks.workunit.client.0.smithi031.stdout:1/318: truncate d4/d1a/d2d/d18/d52/f63 858608 0 2024-09-17T01:51:59.958 INFO:tasks.workunit.client.1.smithi092.stdout:6/73: sync 2024-09-17T01:51:59.958 INFO:tasks.workunit.client.0.smithi031.stdout:1/319: fsync f3 0 2024-09-17T01:51:59.960 INFO:tasks.workunit.client.0.smithi031.stdout:4/279: rmdir d8/d22/d25/d36/d4c 39 2024-09-17T01:51:59.961 INFO:tasks.workunit.client.1.smithi092.stdout:3/71: dwrite d4/f15 [0,4194304] 0 2024-09-17T01:51:59.962 INFO:tasks.workunit.client.1.smithi092.stdout:7/132: write d3/d6/f1c [3913407,13244] 0 2024-09-17T01:51:59.963 INFO:tasks.workunit.client.1.smithi092.stdout:5/44: fsync d0/d9/fb 0 2024-09-17T01:51:59.964 INFO:tasks.workunit.client.0.smithi031.stdout:1/320: read d4/d1e/f42 [2666438,6919] 0 2024-09-17T01:51:59.967 INFO:tasks.workunit.client.1.smithi092.stdout:3/72: dread d4/f15 [0,4194304] 0 2024-09-17T01:51:59.971 INFO:tasks.workunit.client.0.smithi031.stdout:4/280: mkdir d8/d22/d25/d36/d4c/d52 0 2024-09-17T01:51:59.971 INFO:tasks.workunit.client.1.smithi092.stdout:3/73: read d4/d13/f14 [3731620,107264] 0 2024-09-17T01:51:59.971 INFO:tasks.workunit.client.1.smithi092.stdout:5/45: rename d0/f5 to d0/fd 0 2024-09-17T01:51:59.972 INFO:tasks.workunit.client.1.smithi092.stdout:6/74: link d3/lc d3/dd/l14 0 2024-09-17T01:51:59.972 INFO:tasks.workunit.client.0.smithi031.stdout:6/389: dread d23/f39 [0,4194304] 0 2024-09-17T01:51:59.972 INFO:tasks.workunit.client.0.smithi031.stdout:4/281: chown d8/d18/f24 975 1 2024-09-17T01:51:59.973 INFO:tasks.workunit.client.1.smithi092.stdout:6/75: chown d3/le 260698 1 2024-09-17T01:51:59.973 INFO:tasks.workunit.client.1.smithi092.stdout:6/76: stat d3/lb 0 2024-09-17T01:51:59.973 INFO:tasks.workunit.client.1.smithi092.stdout:5/46: write d0/fc [2177166,87817] 0 2024-09-17T01:51:59.975 INFO:tasks.workunit.client.0.smithi031.stdout:1/321: dread d4/d1a/d2d/f38 [0,4194304] 0 2024-09-17T01:51:59.976 INFO:tasks.workunit.client.1.smithi092.stdout:3/74: write d4/f15 [3380393,104473] 0 2024-09-17T01:51:59.976 INFO:tasks.workunit.client.1.smithi092.stdout:7/133: link d3/d6/d13/l11 d3/d6/d13/d21/d2e/l2f 0 2024-09-17T01:51:59.976 INFO:tasks.workunit.client.1.smithi092.stdout:3/75: readlink d4/l6 0 2024-09-17T01:51:59.976 INFO:tasks.workunit.client.0.smithi031.stdout:4/282: symlink d8/d22/d25/d36/d4c/d52/l53 0 2024-09-17T01:51:59.977 INFO:tasks.workunit.client.0.smithi031.stdout:6/390: dread d23/d50/f69 [0,4194304] 0 2024-09-17T01:51:59.977 INFO:tasks.workunit.client.1.smithi092.stdout:6/77: fsync d3/f8 0 2024-09-17T01:51:59.978 INFO:tasks.workunit.client.0.smithi031.stdout:1/322: dread d4/d1e/f4f [0,4194304] 0 2024-09-17T01:51:59.978 INFO:tasks.workunit.client.1.smithi092.stdout:5/47: write d0/fd [62286,13595] 0 2024-09-17T01:51:59.978 INFO:tasks.workunit.client.1.smithi092.stdout:6/78: write f1 [1664773,80927] 0 2024-09-17T01:51:59.979 INFO:tasks.workunit.client.1.smithi092.stdout:3/76: rename d4/lb to d4/l17 0 2024-09-17T01:51:59.979 INFO:tasks.workunit.client.0.smithi031.stdout:4/283: creat d8/d22/f54 x:0 0 0 2024-09-17T01:51:59.982 INFO:tasks.workunit.client.0.smithi031.stdout:4/284: mkdir d8/d3a/d41/d55 0 2024-09-17T01:51:59.983 INFO:tasks.workunit.client.0.smithi031.stdout:4/285: chown d8/d22/d25/d36/c48 224929388 1 2024-09-17T01:51:59.984 INFO:tasks.workunit.client.1.smithi092.stdout:6/79: creat d3/f15 x:0 0 0 2024-09-17T01:51:59.984 INFO:tasks.workunit.client.0.smithi031.stdout:6/391: mknod d23/d50/d6a/d70/d74/c80 0 2024-09-17T01:51:59.986 INFO:tasks.workunit.client.1.smithi092.stdout:3/77: write d4/d13/f14 [5088210,74403] 0 2024-09-17T01:51:59.986 INFO:tasks.workunit.client.0.smithi031.stdout:1/323: getdents d4/d3d 0 2024-09-17T01:51:59.987 INFO:tasks.workunit.client.0.smithi031.stdout:6/392: mkdir d23/d63/d47/d81 0 2024-09-17T01:51:59.987 INFO:tasks.workunit.client.0.smithi031.stdout:4/286: creat d8/d18/d4f/f56 x:0 0 0 2024-09-17T01:51:59.988 INFO:tasks.workunit.client.1.smithi092.stdout:7/134: write d3/d6/d13/d21/f24 [1143406,80353] 0 2024-09-17T01:51:59.988 INFO:tasks.workunit.client.0.smithi031.stdout:6/393: fsync d23/f30 0 2024-09-17T01:51:59.989 INFO:tasks.workunit.client.0.smithi031.stdout:6/394: fsync d23/f31 0 2024-09-17T01:51:59.990 INFO:tasks.workunit.client.1.smithi092.stdout:6/80: mknod d3/d10/c16 0 2024-09-17T01:51:59.990 INFO:tasks.workunit.client.0.smithi031.stdout:6/395: chown d23/d50/d6a/d70 0 1 2024-09-17T01:51:59.991 INFO:tasks.workunit.client.0.smithi031.stdout:4/287: symlink d8/d22/d25/d36/d4c/l57 0 2024-09-17T01:51:59.992 INFO:tasks.workunit.client.1.smithi092.stdout:5/48: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:51:59.992 INFO:tasks.workunit.client.0.smithi031.stdout:1/324: rename d4/d1a/d2d/f22 to d4/d1a/d2d/f68 0 2024-09-17T01:51:59.994 INFO:tasks.workunit.client.1.smithi092.stdout:3/78: dread d4/d13/f14 [0,4194304] 0 2024-09-17T01:51:59.996 INFO:tasks.workunit.client.0.smithi031.stdout:1/325: symlink d4/d1a/d43/d53/l69 0 2024-09-17T01:51:59.996 INFO:tasks.workunit.client.1.smithi092.stdout:6/81: link d3/f15 d3/f17 0 2024-09-17T01:51:59.997 INFO:tasks.workunit.client.1.smithi092.stdout:3/79: creat d4/f18 x:0 0 0 2024-09-17T01:51:59.998 INFO:tasks.workunit.client.0.smithi031.stdout:6/396: dwrite d23/d63/f4f [0,4194304] 0 2024-09-17T01:51:59.998 INFO:tasks.workunit.client.1.smithi092.stdout:6/82: chown f1 290 1 2024-09-17T01:52:00.000 INFO:tasks.workunit.client.0.smithi031.stdout:4/288: link d8/d22/c2a d8/d3a/d41/d55/c58 0 2024-09-17T01:52:00.000 INFO:tasks.workunit.client.0.smithi031.stdout:4/289: readlink d8/l49 0 2024-09-17T01:52:00.001 INFO:tasks.workunit.client.0.smithi031.stdout:6/397: symlink d23/d50/d64/d67/l82 0 2024-09-17T01:52:00.002 INFO:tasks.workunit.client.1.smithi092.stdout:3/80: rename d4/lc to d4/d16/l19 0 2024-09-17T01:52:00.002 INFO:tasks.workunit.client.1.smithi092.stdout:7/135: dwrite d3/db/f1e [0,4194304] 0 2024-09-17T01:52:00.003 INFO:tasks.workunit.client.0.smithi031.stdout:1/326: creat d4/f6a x:0 0 0 2024-09-17T01:52:00.005 INFO:tasks.workunit.client.0.smithi031.stdout:6/398: creat d23/d63/d47/f83 x:0 0 0 2024-09-17T01:52:00.005 INFO:tasks.workunit.client.0.smithi031.stdout:6/399: chown d23/d50/d6a/d72/f73 260506465 1 2024-09-17T01:52:00.007 INFO:tasks.workunit.client.0.smithi031.stdout:4/290: symlink d8/l59 0 2024-09-17T01:52:00.007 INFO:tasks.workunit.client.1.smithi092.stdout:3/81: rename d4/c12 to d4/c1a 0 2024-09-17T01:52:00.007 INFO:tasks.workunit.client.1.smithi092.stdout:3/82: write d4/f15 [3015582,57221] 0 2024-09-17T01:52:00.010 INFO:tasks.workunit.client.0.smithi031.stdout:4/291: write d8/d22/f54 [152646,107717] 0 2024-09-17T01:52:00.012 INFO:tasks.workunit.client.0.smithi031.stdout:4/292: truncate d8/d18/f24 434427 0 2024-09-17T01:52:00.012 INFO:tasks.workunit.client.0.smithi031.stdout:6/400: rmdir d23/d50/d6a/d72/d75/d79 0 2024-09-17T01:52:00.012 INFO:tasks.workunit.client.1.smithi092.stdout:3/83: mkdir d4/d16/d1b 0 2024-09-17T01:52:00.013 INFO:tasks.workunit.client.0.smithi031.stdout:4/293: truncate d8/d18/f39 394008 0 2024-09-17T01:52:00.015 INFO:tasks.workunit.client.0.smithi031.stdout:4/294: stat d8/d22/d25/f26 0 2024-09-17T01:52:00.015 INFO:tasks.workunit.client.1.smithi092.stdout:3/84: creat d4/d16/f1c x:0 0 0 2024-09-17T01:52:00.016 INFO:tasks.workunit.client.0.smithi031.stdout:4/295: stat d8/f14 0 2024-09-17T01:52:00.016 INFO:tasks.workunit.client.1.smithi092.stdout:6/83: truncate f1 2408332 0 2024-09-17T01:52:00.019 INFO:tasks.workunit.client.0.smithi031.stdout:4/296: mkdir d8/d18/d4d/d5a 0 2024-09-17T01:52:00.020 INFO:tasks.workunit.client.1.smithi092.stdout:6/84: mkdir d3/dd/d18 0 2024-09-17T01:52:00.021 INFO:tasks.workunit.client.0.smithi031.stdout:6/401: dwrite d23/d50/d6a/d70/f7f [0,4194304] 0 2024-09-17T01:52:00.024 INFO:tasks.workunit.client.0.smithi031.stdout:4/297: rename d8/d22/f2e to d8/d22/d25/d36/d4c/d52/f5b 0 2024-09-17T01:52:00.026 INFO:tasks.workunit.client.0.smithi031.stdout:6/402: write d23/d50/d64/d67/f7a [236744,46928] 0 2024-09-17T01:52:00.027 INFO:tasks.workunit.client.0.smithi031.stdout:6/403: write f1a [3472102,1769] 0 2024-09-17T01:52:00.027 INFO:tasks.workunit.client.1.smithi092.stdout:6/85: rename d3/dd/df to d3/dd/d19 0 2024-09-17T01:52:00.028 INFO:tasks.workunit.client.0.smithi031.stdout:6/404: stat d23/d63/f4f 0 2024-09-17T01:52:00.029 INFO:tasks.workunit.client.0.smithi031.stdout:6/405: write d23/f5b [1303559,15228] 0 2024-09-17T01:52:00.030 INFO:tasks.workunit.client.0.smithi031.stdout:1/327: dread f3 [0,4194304] 0 2024-09-17T01:52:00.031 INFO:tasks.workunit.client.1.smithi092.stdout:3/85: dwrite d4/d13/f14 [4194304,4194304] 0 2024-09-17T01:52:00.031 INFO:tasks.workunit.client.0.smithi031.stdout:6/406: dread - d23/d63/f5d zero size 2024-09-17T01:52:00.033 INFO:tasks.workunit.client.1.smithi092.stdout:7/136: dwrite d3/db/d18/f20 [0,4194304] 0 2024-09-17T01:52:00.035 INFO:tasks.workunit.client.1.smithi092.stdout:6/86: mkdir d3/d10/d1a 0 2024-09-17T01:52:00.035 INFO:tasks.workunit.client.0.smithi031.stdout:1/328: mknod d4/d1a/d2d/d18/c6b 0 2024-09-17T01:52:00.038 INFO:tasks.workunit.client.0.smithi031.stdout:6/407: dwrite d23/d50/d6a/d70/f7f [0,4194304] 0 2024-09-17T01:52:00.038 INFO:tasks.workunit.client.1.smithi092.stdout:3/86: rename d4/f15 to d4/d13/f1d 0 2024-09-17T01:52:00.040 INFO:tasks.workunit.client.0.smithi031.stdout:6/408: write d23/f30 [5059074,46514] 0 2024-09-17T01:52:00.041 INFO:tasks.workunit.client.0.smithi031.stdout:6/409: dread - d23/d63/f5d zero size 2024-09-17T01:52:00.043 INFO:tasks.workunit.client.1.smithi092.stdout:3/87: creat d4/d16/f1e x:0 0 0 2024-09-17T01:52:00.044 INFO:tasks.workunit.client.1.smithi092.stdout:7/137: rmdir d3/db/d25 0 2024-09-17T01:52:00.045 INFO:tasks.workunit.client.1.smithi092.stdout:3/88: write d4/f18 [1034406,111852] 0 2024-09-17T01:52:00.045 INFO:tasks.workunit.client.1.smithi092.stdout:7/138: chown d3/d6/d13/d21 2 1 2024-09-17T01:52:00.047 INFO:tasks.workunit.client.1.smithi092.stdout:3/89: write d4/d16/f1c [299628,79412] 0 2024-09-17T01:52:00.049 INFO:tasks.workunit.client.1.smithi092.stdout:7/139: rmdir d3/d6 39 2024-09-17T01:52:00.050 INFO:tasks.workunit.client.0.smithi031.stdout:6/410: dwrite d23/d50/d64/d67/f7a [0,4194304] 0 2024-09-17T01:52:00.050 INFO:tasks.workunit.client.0.smithi031.stdout:6/411: chown d23/d50 267894904 1 2024-09-17T01:52:00.053 INFO:tasks.workunit.client.1.smithi092.stdout:7/140: write d3/d6/f1c [1722385,118391] 0 2024-09-17T01:52:00.056 INFO:tasks.workunit.client.1.smithi092.stdout:3/90: dwrite d4/d13/f14 [0,4194304] 0 2024-09-17T01:52:00.059 INFO:tasks.workunit.client.1.smithi092.stdout:7/141: getdents d3 0 2024-09-17T01:52:00.060 INFO:tasks.workunit.client.1.smithi092.stdout:3/91: mknod d4/c1f 0 2024-09-17T01:52:00.060 INFO:tasks.workunit.client.0.smithi031.stdout:4/298: dwrite d8/d18/f21 [0,4194304] 0 2024-09-17T01:52:00.061 INFO:tasks.workunit.client.1.smithi092.stdout:7/142: mknod d3/db/d26/c30 0 2024-09-17T01:52:00.061 INFO:tasks.workunit.client.0.smithi031.stdout:4/299: chown d8/d22/d25 109665586 1 2024-09-17T01:52:00.061 INFO:tasks.workunit.client.1.smithi092.stdout:3/92: fdatasync d4/d13/f1d 0 2024-09-17T01:52:00.065 INFO:tasks.workunit.client.1.smithi092.stdout:7/143: dread d3/db/d18/f20 [0,4194304] 0 2024-09-17T01:52:00.071 INFO:tasks.workunit.client.0.smithi031.stdout:4/300: dwrite d8/f2b [0,4194304] 0 2024-09-17T01:52:00.071 INFO:tasks.workunit.client.1.smithi092.stdout:7/144: dread d3/db/f1e [0,4194304] 0 2024-09-17T01:52:00.073 INFO:tasks.workunit.client.0.smithi031.stdout:1/329: rmdir d4/d1a/d2d 39 2024-09-17T01:52:00.078 INFO:tasks.workunit.client.0.smithi031.stdout:4/301: link d8/c31 d8/d18/d4d/c5c 0 2024-09-17T01:52:00.080 INFO:tasks.workunit.client.0.smithi031.stdout:6/412: dwrite d23/f39 [0,4194304] 0 2024-09-17T01:52:00.081 INFO:tasks.workunit.client.0.smithi031.stdout:6/413: write d23/d63/f56 [278755,96535] 0 2024-09-17T01:52:00.082 INFO:tasks.workunit.client.1.smithi092.stdout:6/87: dwrite d3/fa [0,4194304] 0 2024-09-17T01:52:00.083 INFO:tasks.workunit.client.0.smithi031.stdout:4/302: mknod d8/d22/d25/c5d 0 2024-09-17T01:52:00.084 INFO:tasks.workunit.client.1.smithi092.stdout:6/88: mkdir d3/dd/d19/d1b 0 2024-09-17T01:52:00.086 INFO:tasks.workunit.client.0.smithi031.stdout:6/414: unlink d23/d63/d47/c65 0 2024-09-17T01:52:00.088 INFO:tasks.workunit.client.0.smithi031.stdout:6/415: fdatasync d23/d50/d6a/d70/f7f 0 2024-09-17T01:52:00.090 INFO:tasks.workunit.client.1.smithi092.stdout:6/89: dread d3/fa [0,4194304] 0 2024-09-17T01:52:00.090 INFO:tasks.workunit.client.0.smithi031.stdout:6/416: write d23/d63/d47/f60 [505864,19039] 0 2024-09-17T01:52:00.092 INFO:tasks.workunit.client.0.smithi031.stdout:4/303: dwrite d8/d22/f37 [0,4194304] 0 2024-09-17T01:52:00.092 INFO:tasks.workunit.client.1.smithi092.stdout:6/90: mknod d3/dd/d19/c1c 0 2024-09-17T01:52:00.094 INFO:tasks.workunit.client.0.smithi031.stdout:4/304: dread - d8/d18/d4f/f56 zero size 2024-09-17T01:52:00.096 INFO:tasks.workunit.client.0.smithi031.stdout:6/417: symlink d23/d63/l84 0 2024-09-17T01:52:00.098 INFO:tasks.workunit.client.0.smithi031.stdout:6/418: creat d23/d50/d6a/d72/d75/f85 x:0 0 0 2024-09-17T01:52:00.099 INFO:tasks.workunit.client.0.smithi031.stdout:4/305: link d8/d22/d25/d36/c48 d8/d3a/d41/d55/c5e 0 2024-09-17T01:52:00.112 INFO:tasks.workunit.client.1.smithi092.stdout:7/145: truncate d3/db/d18/f20 1484826 0 2024-09-17T01:52:00.113 INFO:tasks.workunit.client.1.smithi092.stdout:7/146: read d3/d6/f1c [3241882,53461] 0 2024-09-17T01:52:00.117 INFO:tasks.workunit.client.1.smithi092.stdout:7/147: creat d3/d2b/f31 x:0 0 0 2024-09-17T01:52:00.117 INFO:tasks.workunit.client.1.smithi092.stdout:7/148: dread - d3/d2b/f31 zero size 2024-09-17T01:52:00.118 INFO:tasks.workunit.client.1.smithi092.stdout:7/149: write d3/f14 [369411,68045] 0 2024-09-17T01:52:00.119 INFO:tasks.workunit.client.1.smithi092.stdout:7/150: chown d3/db/d26 248210 1 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:7/151: mknod d3/d6/d13/c32 0 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:6/91: dwrite f1 [0,4194304] 0 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:0/64: sync 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:1/73: sync 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:8/150: sync 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:4/53: sync 2024-09-17T01:52:00.121 INFO:tasks.workunit.client.1.smithi092.stdout:2/100: sync 2024-09-17T01:52:00.122 INFO:tasks.workunit.client.1.smithi092.stdout:9/146: sync 2024-09-17T01:52:00.123 INFO:tasks.workunit.client.1.smithi092.stdout:0/65: fsync d3/f7 0 2024-09-17T01:52:00.123 INFO:tasks.workunit.client.1.smithi092.stdout:6/92: chown d3/l9 188940 1 2024-09-17T01:52:00.124 INFO:tasks.workunit.client.1.smithi092.stdout:1/74: chown db/ce 1 1 2024-09-17T01:52:00.125 INFO:tasks.workunit.client.1.smithi092.stdout:9/147: write d0/d7/f23 [749034,58306] 0 2024-09-17T01:52:00.125 INFO:tasks.workunit.client.1.smithi092.stdout:7/152: mknod d3/db/d18/c33 0 2024-09-17T01:52:00.126 INFO:tasks.workunit.client.1.smithi092.stdout:8/151: fsync d15/f26 0 2024-09-17T01:52:00.127 INFO:tasks.workunit.client.1.smithi092.stdout:4/54: dread f2 [0,4194304] 0 2024-09-17T01:52:00.128 INFO:tasks.workunit.client.1.smithi092.stdout:0/66: mknod d3/cf 0 2024-09-17T01:52:00.128 INFO:tasks.workunit.client.0.smithi031.stdout:4/306: dread d8/f11 [0,4194304] 0 2024-09-17T01:52:00.128 INFO:tasks.workunit.client.1.smithi092.stdout:6/93: mknod d3/dd/d19/c1d 0 2024-09-17T01:52:00.130 INFO:tasks.workunit.client.0.smithi031.stdout:4/307: read d8/f27 [1521892,116924] 0 2024-09-17T01:52:00.130 INFO:tasks.workunit.client.1.smithi092.stdout:1/75: symlink db/l17 0 2024-09-17T01:52:00.131 INFO:tasks.workunit.client.1.smithi092.stdout:8/152: write fa [3316639,109367] 0 2024-09-17T01:52:00.132 INFO:tasks.workunit.client.1.smithi092.stdout:4/55: unlink f1 0 2024-09-17T01:52:00.132 INFO:tasks.workunit.client.0.smithi031.stdout:4/308: stat d8/d22/d25/d36/d4c/d52/f5b 0 2024-09-17T01:52:00.135 INFO:tasks.workunit.client.1.smithi092.stdout:1/76: write f6 [3711748,17258] 0 2024-09-17T01:52:00.138 INFO:tasks.workunit.client.1.smithi092.stdout:0/67: creat d3/da/f10 x:0 0 0 2024-09-17T01:52:00.138 INFO:tasks.workunit.client.0.smithi031.stdout:4/309: dread d8/f16 [0,4194304] 0 2024-09-17T01:52:00.138 INFO:tasks.workunit.client.1.smithi092.stdout:2/101: dwrite d10/f1a [0,4194304] 0 2024-09-17T01:52:00.139 INFO:tasks.workunit.client.1.smithi092.stdout:7/153: rename d3/d6/d13/d21/f24 to d3/d6/d13/f34 0 2024-09-17T01:52:00.141 INFO:tasks.workunit.client.0.smithi031.stdout:4/310: getdents d8/d22 0 2024-09-17T01:52:00.142 INFO:tasks.workunit.client.1.smithi092.stdout:0/68: dread - d3/f7 zero size 2024-09-17T01:52:00.143 INFO:tasks.workunit.client.1.smithi092.stdout:6/94: mkdir d3/dd/d19/d1b/d1e 0 2024-09-17T01:52:00.146 INFO:tasks.workunit.client.1.smithi092.stdout:1/77: rename db/l12 to db/l18 0 2024-09-17T01:52:00.152 INFO:tasks.workunit.client.1.smithi092.stdout:9/148: dwrite d0/df/f18 [0,4194304] 0 2024-09-17T01:52:00.155 INFO:tasks.workunit.client.1.smithi092.stdout:8/153: rename d15/f19 to d15/d25/f29 0 2024-09-17T01:52:00.155 INFO:tasks.workunit.client.0.smithi031.stdout:4/311: dwrite d8/d22/f3c [4194304,4194304] 0 2024-09-17T01:52:00.157 INFO:tasks.workunit.client.1.smithi092.stdout:6/95: mkdir d3/d10/d1f 0 2024-09-17T01:52:00.160 INFO:tasks.workunit.client.1.smithi092.stdout:4/56: dread d4/fc [0,4194304] 0 2024-09-17T01:52:00.161 INFO:tasks.workunit.client.0.smithi031.stdout:4/312: dread d8/f11 [0,4194304] 0 2024-09-17T01:52:00.163 INFO:tasks.workunit.client.1.smithi092.stdout:1/78: creat db/f19 x:0 0 0 2024-09-17T01:52:00.165 INFO:tasks.workunit.client.1.smithi092.stdout:9/149: rmdir d0/df/d17/d1f 39 2024-09-17T01:52:00.166 INFO:tasks.workunit.client.0.smithi031.stdout:4/313: dread d8/d3a/f40 [0,4194304] 0 2024-09-17T01:52:00.167 INFO:tasks.workunit.client.1.smithi092.stdout:2/102: dwrite fe [0,4194304] 0 2024-09-17T01:52:00.167 INFO:tasks.workunit.client.1.smithi092.stdout:0/69: dread d3/da/fb [0,4194304] 0 2024-09-17T01:52:00.168 INFO:tasks.workunit.client.1.smithi092.stdout:4/57: fsync d4/d5/fd 0 2024-09-17T01:52:00.168 INFO:tasks.workunit.client.0.smithi031.stdout:4/314: mknod d8/d18/d4d/d5a/c5f 0 2024-09-17T01:52:00.170 INFO:tasks.workunit.client.0.smithi031.stdout:4/315: creat d8/d3a/d41/f60 x:0 0 0 2024-09-17T01:52:00.171 INFO:tasks.workunit.client.1.smithi092.stdout:1/79: creat db/f1a x:0 0 0 2024-09-17T01:52:00.173 INFO:tasks.workunit.client.1.smithi092.stdout:7/154: dwrite d3/db/f15 [4194304,4194304] 0 2024-09-17T01:52:00.173 INFO:tasks.workunit.client.1.smithi092.stdout:2/103: chown d10/d15/c1c 302 1 2024-09-17T01:52:00.173 INFO:tasks.workunit.client.0.smithi031.stdout:4/316: mkdir d8/d22/d25/d36/d4c/d61 0 2024-09-17T01:52:00.178 INFO:tasks.workunit.client.1.smithi092.stdout:6/96: fsync f2 0 2024-09-17T01:52:00.179 INFO:tasks.workunit.client.0.smithi031.stdout:4/317: dwrite d8/f3b [0,4194304] 0 2024-09-17T01:52:00.184 INFO:tasks.workunit.client.1.smithi092.stdout:8/154: dwrite d15/f23 [0,4194304] 0 2024-09-17T01:52:00.185 INFO:tasks.workunit.client.0.smithi031.stdout:4/318: dread d8/d18/f21 [0,4194304] 0 2024-09-17T01:52:00.185 INFO:tasks.workunit.client.1.smithi092.stdout:0/70: symlink d3/da/l11 0 2024-09-17T01:52:00.187 INFO:tasks.workunit.client.0.smithi031.stdout:4/319: symlink d8/d22/d25/d36/d4c/d52/l62 0 2024-09-17T01:52:00.187 INFO:tasks.workunit.client.1.smithi092.stdout:7/155: write d3/f14 [855178,14795] 0 2024-09-17T01:52:00.189 INFO:tasks.workunit.client.0.smithi031.stdout:4/320: mknod d8/d3a/d41/c63 0 2024-09-17T01:52:00.195 INFO:tasks.workunit.client.1.smithi092.stdout:8/155: symlink d15/l2a 0 2024-09-17T01:52:00.195 INFO:tasks.workunit.client.1.smithi092.stdout:7/156: read d3/db/f15 [3452188,44235] 0 2024-09-17T01:52:00.196 INFO:tasks.workunit.client.1.smithi092.stdout:6/97: creat d3/d10/f20 x:0 0 0 2024-09-17T01:52:00.198 INFO:tasks.workunit.client.1.smithi092.stdout:8/156: chown f12 115154 1 2024-09-17T01:52:00.200 INFO:tasks.workunit.client.1.smithi092.stdout:0/71: write d3/f5 [235777,101431] 0 2024-09-17T01:52:00.202 INFO:tasks.workunit.client.1.smithi092.stdout:2/104: dread d10/f12 [0,4194304] 0 2024-09-17T01:52:00.202 INFO:tasks.workunit.client.1.smithi092.stdout:4/58: dwrite f2 [0,4194304] 0 2024-09-17T01:52:00.202 INFO:tasks.workunit.client.1.smithi092.stdout:8/157: write f12 [1010803,34760] 0 2024-09-17T01:52:00.205 INFO:tasks.workunit.client.1.smithi092.stdout:9/150: dwrite d0/df/d17/f1c [0,4194304] 0 2024-09-17T01:52:00.205 INFO:tasks.workunit.client.1.smithi092.stdout:4/59: rename d4 to d4/d10 22 2024-09-17T01:52:00.205 INFO:tasks.workunit.client.1.smithi092.stdout:0/72: write d3/f4 [2673948,10711] 0 2024-09-17T01:52:00.206 INFO:tasks.workunit.client.1.smithi092.stdout:2/105: chown d10/c18 4109 1 2024-09-17T01:52:00.207 INFO:tasks.workunit.client.1.smithi092.stdout:4/60: fdatasync d4/d5/fd 0 2024-09-17T01:52:00.209 INFO:tasks.workunit.client.1.smithi092.stdout:4/61: chown d4/fc 19432 1 2024-09-17T01:52:00.211 INFO:tasks.workunit.client.1.smithi092.stdout:4/62: stat f2 0 2024-09-17T01:52:00.213 INFO:tasks.workunit.client.0.smithi031.stdout:4/321: write d8/d18/f2d [2780151,109759] 0 2024-09-17T01:52:00.214 INFO:tasks.workunit.client.1.smithi092.stdout:9/151: creat d0/df/d17/d1f/d20/f24 x:0 0 0 2024-09-17T01:52:00.217 INFO:tasks.workunit.client.0.smithi031.stdout:4/322: rename d8/d18 to d8/d3a/d41/d64 0 2024-09-17T01:52:00.218 INFO:tasks.workunit.client.1.smithi092.stdout:2/106: link d10/f12 d10/d15/f21 0 2024-09-17T01:52:00.218 INFO:tasks.workunit.client.0.smithi031.stdout:4/323: getdents d8/d22/d25/d36/d4c/d61 0 2024-09-17T01:52:00.219 INFO:tasks.workunit.client.1.smithi092.stdout:8/158: dread f1 [0,4194304] 0 2024-09-17T01:52:00.220 INFO:tasks.workunit.client.1.smithi092.stdout:0/73: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:52:00.223 INFO:tasks.workunit.client.0.smithi031.stdout:4/324: dread d8/d3a/d41/d64/f2f [0,4194304] 0 2024-09-17T01:52:00.224 INFO:tasks.workunit.client.1.smithi092.stdout:4/63: getdents d4/d5/d8 0 2024-09-17T01:52:00.225 INFO:tasks.workunit.client.0.smithi031.stdout:4/325: truncate d8/fc 3320847 0 2024-09-17T01:52:00.225 INFO:tasks.workunit.client.0.smithi031.stdout:4/326: fdatasync d8/d22/f54 0 2024-09-17T01:52:00.227 INFO:tasks.workunit.client.1.smithi092.stdout:2/107: rename c9 to d10/d15/c22 0 2024-09-17T01:52:00.227 INFO:tasks.workunit.client.1.smithi092.stdout:6/98: write d3/f8 [281124,84892] 0 2024-09-17T01:52:00.228 INFO:tasks.workunit.client.0.smithi031.stdout:4/327: mkdir d8/d22/d25/d65 0 2024-09-17T01:52:00.229 INFO:tasks.workunit.client.1.smithi092.stdout:0/74: creat d3/f12 x:0 0 0 2024-09-17T01:52:00.230 INFO:tasks.workunit.client.1.smithi092.stdout:8/159: mkdir d15/d25/d2b 0 2024-09-17T01:52:00.230 INFO:tasks.workunit.client.0.smithi031.stdout:4/328: write d8/d3a/d41/d64/f21 [2902818,78326] 0 2024-09-17T01:52:00.230 INFO:tasks.workunit.client.1.smithi092.stdout:4/64: symlink d4/d5/l11 0 2024-09-17T01:52:00.233 INFO:tasks.workunit.client.1.smithi092.stdout:0/75: symlink d3/l13 0 2024-09-17T01:52:00.234 INFO:tasks.workunit.client.1.smithi092.stdout:2/108: dread fe [0,4194304] 0 2024-09-17T01:52:00.235 INFO:tasks.workunit.client.1.smithi092.stdout:6/99: write d3/fa [2066083,44546] 0 2024-09-17T01:52:00.235 INFO:tasks.workunit.client.1.smithi092.stdout:2/109: chown fe 3 1 2024-09-17T01:52:00.239 INFO:tasks.workunit.client.0.smithi031.stdout:4/329: rmdir d8/d3a/d41 39 2024-09-17T01:52:00.240 INFO:tasks.workunit.client.1.smithi092.stdout:6/100: chown d3/dd/l14 64835 1 2024-09-17T01:52:00.243 INFO:tasks.workunit.client.1.smithi092.stdout:2/110: rename d10/f1f to d10/f23 0 2024-09-17T01:52:00.243 INFO:tasks.workunit.client.1.smithi092.stdout:8/160: dwrite d15/f1a [0,4194304] 0 2024-09-17T01:52:00.251 INFO:tasks.workunit.client.1.smithi092.stdout:2/111: fsync d10/d15/f21 0 2024-09-17T01:52:00.252 INFO:tasks.workunit.client.1.smithi092.stdout:0/76: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:52:00.252 INFO:tasks.workunit.client.1.smithi092.stdout:7/157: dwrite d3/db/d18/f20 [0,4194304] 0 2024-09-17T01:52:00.253 INFO:tasks.workunit.client.1.smithi092.stdout:8/161: symlink d15/l2c 0 2024-09-17T01:52:00.253 INFO:tasks.workunit.client.0.smithi031.stdout:4/330: dread d8/fd [0,4194304] 0 2024-09-17T01:52:00.254 INFO:tasks.workunit.client.1.smithi092.stdout:0/77: read d3/f6 [1612459,3714] 0 2024-09-17T01:52:00.256 INFO:tasks.workunit.client.0.smithi031.stdout:4/331: unlink d8/d22/d25/d36/d4c/f51 0 2024-09-17T01:52:00.256 INFO:tasks.workunit.client.1.smithi092.stdout:2/112: write fa [1552246,59331] 0 2024-09-17T01:52:00.257 INFO:tasks.workunit.client.1.smithi092.stdout:0/78: read d3/f4 [173326,49338] 0 2024-09-17T01:52:00.257 INFO:tasks.workunit.client.1.smithi092.stdout:2/113: chown d10/f23 2236050 1 2024-09-17T01:52:00.259 INFO:tasks.workunit.client.1.smithi092.stdout:6/101: rename d3/dd/d19/d1b to d3/d10/d1f/d21 0 2024-09-17T01:52:00.260 INFO:tasks.workunit.client.0.smithi031.stdout:4/332: creat d8/d22/d25/d36/f66 x:0 0 0 2024-09-17T01:52:00.262 INFO:tasks.workunit.client.0.smithi031.stdout:4/333: symlink d8/d22/d25/d36/d4c/d61/l67 0 2024-09-17T01:52:00.263 INFO:tasks.workunit.client.1.smithi092.stdout:7/158: fdatasync d3/db/f15 0 2024-09-17T01:52:00.264 INFO:tasks.workunit.client.0.smithi031.stdout:4/334: read d8/d3a/d41/d64/f2f [194950,30208] 0 2024-09-17T01:52:00.265 INFO:tasks.workunit.client.1.smithi092.stdout:8/162: creat d15/d25/f2d x:0 0 0 2024-09-17T01:52:00.266 INFO:tasks.workunit.client.1.smithi092.stdout:0/79: mknod d3/da/c14 0 2024-09-17T01:52:00.267 INFO:tasks.workunit.client.1.smithi092.stdout:2/114: mkdir d10/d1d/d24 0 2024-09-17T01:52:00.267 INFO:tasks.workunit.client.0.smithi031.stdout:4/335: dread d8/fd [0,4194304] 0 2024-09-17T01:52:00.267 INFO:tasks.workunit.client.1.smithi092.stdout:7/159: rename d3/d6 to d3/d6/d13/d21/d35 22 2024-09-17T01:52:00.268 INFO:tasks.workunit.client.0.smithi031.stdout:4/336: write d8/d3a/d41/d64/f21 [3971649,88928] 0 2024-09-17T01:52:00.269 INFO:tasks.workunit.client.1.smithi092.stdout:6/102: dwrite f1 [0,4194304] 0 2024-09-17T01:52:00.271 INFO:tasks.workunit.client.1.smithi092.stdout:2/115: creat d10/d15/f25 x:0 0 0 2024-09-17T01:52:00.271 INFO:tasks.workunit.client.0.smithi031.stdout:4/337: unlink d8/d3a/d41/d64/f29 0 2024-09-17T01:52:00.272 INFO:tasks.workunit.client.1.smithi092.stdout:0/80: read d3/da/fb [461610,51908] 0 2024-09-17T01:52:00.273 INFO:tasks.workunit.client.0.smithi031.stdout:4/338: write d8/fb [1146357,59055] 0 2024-09-17T01:52:00.273 INFO:tasks.workunit.client.1.smithi092.stdout:7/160: creat d3/d6/d13/d21/f36 x:0 0 0 2024-09-17T01:52:00.273 INFO:tasks.workunit.client.1.smithi092.stdout:8/163: dread f9 [0,4194304] 0 2024-09-17T01:52:00.274 INFO:tasks.workunit.client.1.smithi092.stdout:6/103: symlink d3/l22 0 2024-09-17T01:52:00.276 INFO:tasks.workunit.client.1.smithi092.stdout:7/161: write d3/d6/d13/d21/f36 [817599,125335] 0 2024-09-17T01:52:00.276 INFO:tasks.workunit.client.1.smithi092.stdout:2/116: fsync d10/d15/f21 0 2024-09-17T01:52:00.276 INFO:tasks.workunit.client.1.smithi092.stdout:6/104: chown d3/dd/d19 4 1 2024-09-17T01:52:00.279 INFO:tasks.workunit.client.1.smithi092.stdout:8/164: creat d15/d25/d27/f2e x:0 0 0 2024-09-17T01:52:00.285 INFO:tasks.workunit.client.1.smithi092.stdout:6/105: fsync d3/f5 0 2024-09-17T01:52:00.287 INFO:tasks.workunit.client.1.smithi092.stdout:2/117: dwrite d10/f13 [0,4194304] 0 2024-09-17T01:52:00.287 INFO:tasks.workunit.client.1.smithi092.stdout:8/165: symlink d15/d25/d27/l2f 0 2024-09-17T01:52:00.287 INFO:tasks.workunit.client.1.smithi092.stdout:7/162: read d3/f14 [436106,86608] 0 2024-09-17T01:52:00.287 INFO:tasks.workunit.client.1.smithi092.stdout:5/49: sync 2024-09-17T01:52:00.290 INFO:tasks.workunit.client.1.smithi092.stdout:2/118: chown d10/d1d/l20 880 1 2024-09-17T01:52:00.290 INFO:tasks.workunit.client.1.smithi092.stdout:7/163: write d3/db/d18/f20 [2791197,130952] 0 2024-09-17T01:52:00.291 INFO:tasks.workunit.client.1.smithi092.stdout:8/166: creat d15/d25/f30 x:0 0 0 2024-09-17T01:52:00.292 INFO:tasks.workunit.client.0.smithi031.stdout:4/339: truncate d8/d22/f3c 8345881 0 2024-09-17T01:52:00.292 INFO:tasks.workunit.client.1.smithi092.stdout:0/81: truncate d3/da/fb 2546122 0 2024-09-17T01:52:00.293 INFO:tasks.workunit.client.1.smithi092.stdout:5/50: unlink d0/l2 0 2024-09-17T01:52:00.295 INFO:tasks.workunit.client.0.smithi031.stdout:4/340: mknod d8/d3a/d41/d55/c68 0 2024-09-17T01:52:00.296 INFO:tasks.workunit.client.0.smithi031.stdout:4/341: read d8/d3a/d41/d64/f24 [383583,16896] 0 2024-09-17T01:52:00.297 INFO:tasks.workunit.client.0.smithi031.stdout:4/342: stat d8/d22/d25/f26 0 2024-09-17T01:52:00.298 INFO:tasks.workunit.client.1.smithi092.stdout:7/164: mkdir d3/d2b/d37 0 2024-09-17T01:52:00.299 INFO:tasks.workunit.client.0.smithi031.stdout:4/343: symlink d8/d3a/d41/l69 0 2024-09-17T01:52:00.299 INFO:tasks.workunit.client.1.smithi092.stdout:6/106: dwrite d3/d10/f20 [0,4194304] 0 2024-09-17T01:52:00.299 INFO:tasks.workunit.client.1.smithi092.stdout:0/82: mkdir d3/da/d15 0 2024-09-17T01:52:00.302 INFO:tasks.workunit.client.1.smithi092.stdout:2/119: dread d10/f13 [0,4194304] 0 2024-09-17T01:52:00.304 INFO:tasks.workunit.client.1.smithi092.stdout:5/51: mkdir d0/de 0 2024-09-17T01:52:00.304 INFO:tasks.workunit.client.0.smithi031.stdout:4/344: dread d8/d3a/d41/d64/f24 [0,4194304] 0 2024-09-17T01:52:00.305 INFO:tasks.workunit.client.1.smithi092.stdout:7/165: creat d3/d6/d13/d21/f38 x:0 0 0 2024-09-17T01:52:00.305 INFO:tasks.workunit.client.0.smithi031.stdout:4/345: stat d8/d22/d25/f26 0 2024-09-17T01:52:00.306 INFO:tasks.workunit.client.0.smithi031.stdout:4/346: readlink d8/d22/d25/d36/d4c/d52/l53 0 2024-09-17T01:52:00.308 INFO:tasks.workunit.client.1.smithi092.stdout:8/167: link f1 d15/d25/d2b/f31 0 2024-09-17T01:52:00.309 INFO:tasks.workunit.client.1.smithi092.stdout:2/120: creat d10/d1d/f26 x:0 0 0 2024-09-17T01:52:00.312 INFO:tasks.workunit.client.1.smithi092.stdout:5/52: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:00.318 INFO:tasks.workunit.client.1.smithi092.stdout:6/107: creat d3/d10/d1f/d21/d1e/f23 x:0 0 0 2024-09-17T01:52:00.320 INFO:tasks.workunit.client.1.smithi092.stdout:7/166: rename d3/db/l29 to d3/db/d26/l39 0 2024-09-17T01:52:00.320 INFO:tasks.workunit.client.1.smithi092.stdout:2/121: dwrite d10/f12 [0,4194304] 0 2024-09-17T01:52:00.320 INFO:tasks.workunit.client.1.smithi092.stdout:6/108: stat d3/dd 0 2024-09-17T01:52:00.323 INFO:tasks.workunit.client.1.smithi092.stdout:5/53: dread d0/f7 [0,4194304] 0 2024-09-17T01:52:00.326 INFO:tasks.workunit.client.1.smithi092.stdout:7/167: mkdir d3/d2b/d3a 0 2024-09-17T01:52:00.329 INFO:tasks.workunit.client.1.smithi092.stdout:6/109: dread d3/d10/f20 [0,4194304] 0 2024-09-17T01:52:00.329 INFO:tasks.workunit.client.1.smithi092.stdout:2/122: truncate d10/f19 528174 0 2024-09-17T01:52:00.332 INFO:tasks.workunit.client.1.smithi092.stdout:6/110: truncate f2 2407301 0 2024-09-17T01:52:00.335 INFO:tasks.workunit.client.1.smithi092.stdout:5/54: dwrite d0/f7 [0,4194304] 0 2024-09-17T01:52:00.336 INFO:tasks.workunit.client.1.smithi092.stdout:5/55: stat d0/ca 0 2024-09-17T01:52:00.337 INFO:tasks.workunit.client.1.smithi092.stdout:6/111: creat d3/d10/d1a/f24 x:0 0 0 2024-09-17T01:52:00.341 INFO:tasks.workunit.client.1.smithi092.stdout:5/56: rename d0/d9/fb to d0/d9/ff 0 2024-09-17T01:52:00.342 INFO:tasks.workunit.client.1.smithi092.stdout:2/123: dwrite d10/f13 [4194304,4194304] 0 2024-09-17T01:52:00.342 INFO:tasks.workunit.client.1.smithi092.stdout:5/57: chown d0/fc 37018 1 2024-09-17T01:52:00.348 INFO:tasks.workunit.client.1.smithi092.stdout:8/168: truncate d15/f1e 3809805 0 2024-09-17T01:52:00.349 INFO:tasks.workunit.client.1.smithi092.stdout:6/112: write d3/d10/f20 [5135455,3349] 0 2024-09-17T01:52:00.351 INFO:tasks.workunit.client.1.smithi092.stdout:6/113: readlink d3/l22 0 2024-09-17T01:52:00.353 INFO:tasks.workunit.client.1.smithi092.stdout:5/58: dwrite d0/fc [4194304,4194304] 0 2024-09-17T01:52:00.354 INFO:tasks.workunit.client.1.smithi092.stdout:8/169: mkdir d15/d32 0 2024-09-17T01:52:00.355 INFO:tasks.workunit.client.1.smithi092.stdout:7/168: truncate d3/db/d18/f20 561217 0 2024-09-17T01:52:00.356 INFO:tasks.workunit.client.0.smithi031.stdout:4/347: dwrite d8/f2b [0,4194304] 0 2024-09-17T01:52:00.359 INFO:tasks.workunit.client.1.smithi092.stdout:8/170: fdatasync d15/f1e 0 2024-09-17T01:52:00.362 INFO:tasks.workunit.client.1.smithi092.stdout:6/114: fsync f2 0 2024-09-17T01:52:00.363 INFO:tasks.workunit.client.1.smithi092.stdout:7/169: link d3/db/f17 d3/db/d26/f3b 0 2024-09-17T01:52:00.364 INFO:tasks.workunit.client.1.smithi092.stdout:6/115: write d3/d10/d1a/f24 [395724,57330] 0 2024-09-17T01:52:00.369 INFO:tasks.workunit.client.1.smithi092.stdout:6/116: mkdir d3/d25 0 2024-09-17T01:52:00.371 INFO:tasks.workunit.client.1.smithi092.stdout:0/83: truncate d3/f5 92183 0 2024-09-17T01:52:00.372 INFO:tasks.workunit.client.1.smithi092.stdout:8/171: getdents d15/d25/d27 0 2024-09-17T01:52:00.373 INFO:tasks.workunit.client.1.smithi092.stdout:6/117: mkdir d3/d10/d1a/d26 0 2024-09-17T01:52:00.374 INFO:tasks.workunit.client.1.smithi092.stdout:7/170: dwrite d3/d2b/f31 [0,4194304] 0 2024-09-17T01:52:00.376 INFO:tasks.workunit.client.1.smithi092.stdout:0/84: fsync d3/f6 0 2024-09-17T01:52:00.379 INFO:tasks.workunit.client.1.smithi092.stdout:8/172: unlink d15/d25/d27/f2e 0 2024-09-17T01:52:00.381 INFO:tasks.workunit.client.1.smithi092.stdout:5/59: truncate d0/f7 1343277 0 2024-09-17T01:52:00.384 INFO:tasks.workunit.client.1.smithi092.stdout:6/118: unlink d3/f17 0 2024-09-17T01:52:00.385 INFO:tasks.workunit.client.0.smithi031.stdout:4/348: dread d8/f27 [0,4194304] 0 2024-09-17T01:52:00.386 INFO:tasks.workunit.client.1.smithi092.stdout:6/119: dread - d3/f13 zero size 2024-09-17T01:52:00.387 INFO:tasks.workunit.client.0.smithi031.stdout:4/349: symlink d8/l6a 0 2024-09-17T01:52:00.388 INFO:tasks.workunit.client.1.smithi092.stdout:8/173: creat d15/d25/f33 x:0 0 0 2024-09-17T01:52:00.390 INFO:tasks.workunit.client.1.smithi092.stdout:5/60: creat d0/f10 x:0 0 0 2024-09-17T01:52:00.394 INFO:tasks.workunit.client.1.smithi092.stdout:0/85: creat d3/da/d15/f16 x:0 0 0 2024-09-17T01:52:00.395 INFO:tasks.workunit.client.1.smithi092.stdout:0/86: write d3/da/f10 [604338,67447] 0 2024-09-17T01:52:00.404 INFO:tasks.workunit.client.0.smithi031.stdout:4/350: dwrite d8/d3a/d41/d64/f24 [0,4194304] 0 2024-09-17T01:52:00.411 INFO:tasks.workunit.client.0.smithi031.stdout:4/351: dwrite d8/d22/d25/f47 [0,4194304] 0 2024-09-17T01:52:00.413 INFO:tasks.workunit.client.1.smithi092.stdout:3/93: sync 2024-09-17T01:52:00.414 INFO:tasks.workunit.client.0.smithi031.stdout:4/352: rename d8/c1c to d8/d3a/d41/d64/d4d/d5a/c6b 0 2024-09-17T01:52:00.415 INFO:tasks.workunit.client.0.smithi031.stdout:4/353: chown d8/d22/d25/d36/d4c/d52/l53 8923664 1 2024-09-17T01:52:00.416 INFO:tasks.workunit.client.0.smithi031.stdout:4/354: fsync d8/d22/d25/f26 0 2024-09-17T01:52:00.417 INFO:tasks.workunit.client.0.smithi031.stdout:4/355: write d8/d3a/f40 [643866,69056] 0 2024-09-17T01:52:00.420 INFO:tasks.workunit.client.0.smithi031.stdout:4/356: creat d8/d3a/d41/d64/f6c x:0 0 0 2024-09-17T01:52:00.423 INFO:tasks.workunit.client.0.smithi031.stdout:4/357: creat d8/d3a/d41/d64/d4f/f6d x:0 0 0 2024-09-17T01:52:00.425 INFO:tasks.workunit.client.0.smithi031.stdout:4/358: rmdir d8/d3a/d41/d55 39 2024-09-17T01:52:00.428 INFO:tasks.workunit.client.0.smithi031.stdout:4/359: rename d8/d22/f54 to d8/d3a/d41/d64/d4d/d5a/f6e 0 2024-09-17T01:52:00.430 INFO:tasks.workunit.client.0.smithi031.stdout:4/360: creat d8/d3a/f6f x:0 0 0 2024-09-17T01:52:00.432 INFO:tasks.workunit.client.1.smithi092.stdout:8/174: creat d15/f34 x:0 0 0 2024-09-17T01:52:00.433 INFO:tasks.workunit.client.1.smithi092.stdout:6/120: creat d3/dd/d18/f27 x:0 0 0 2024-09-17T01:52:00.434 INFO:tasks.workunit.client.1.smithi092.stdout:8/175: dread - d15/f21 zero size 2024-09-17T01:52:00.434 INFO:tasks.workunit.client.1.smithi092.stdout:5/61: creat d0/de/f11 x:0 0 0 2024-09-17T01:52:00.435 INFO:tasks.workunit.client.1.smithi092.stdout:3/94: mkdir d4/d20 0 2024-09-17T01:52:00.436 INFO:tasks.workunit.client.0.smithi031.stdout:4/361: dwrite d8/d3a/d41/d64/d4f/f6d [0,4194304] 0 2024-09-17T01:52:00.438 INFO:tasks.workunit.client.1.smithi092.stdout:6/121: chown d3/dd/d18/f27 303705062 1 2024-09-17T01:52:00.439 INFO:tasks.workunit.client.1.smithi092.stdout:5/62: creat d0/d9/f12 x:0 0 0 2024-09-17T01:52:00.440 INFO:tasks.workunit.client.1.smithi092.stdout:3/95: read d4/d16/f1c [76124,32626] 0 2024-09-17T01:52:00.442 INFO:tasks.workunit.client.0.smithi031.stdout:4/362: dread d8/d22/d25/f47 [0,4194304] 0 2024-09-17T01:52:00.442 INFO:tasks.workunit.client.1.smithi092.stdout:8/176: mknod d15/d25/d2b/c35 0 2024-09-17T01:52:00.444 INFO:tasks.workunit.client.1.smithi092.stdout:5/63: creat d0/de/f13 x:0 0 0 2024-09-17T01:52:00.445 INFO:tasks.workunit.client.1.smithi092.stdout:8/177: write d15/f1a [223657,87195] 0 2024-09-17T01:52:00.445 INFO:tasks.workunit.client.1.smithi092.stdout:7/171: dwrite d3/db/d26/f3b [0,4194304] 0 2024-09-17T01:52:00.446 INFO:tasks.workunit.client.1.smithi092.stdout:3/96: truncate d4/d13/f1d 4387720 0 2024-09-17T01:52:00.449 INFO:tasks.workunit.client.0.smithi031.stdout:4/363: dwrite d8/f3b [4194304,4194304] 0 2024-09-17T01:52:00.449 INFO:tasks.workunit.client.1.smithi092.stdout:3/97: write d4/d13/f1d [3353594,3462] 0 2024-09-17T01:52:00.452 INFO:tasks.workunit.client.1.smithi092.stdout:5/64: symlink d0/de/l14 0 2024-09-17T01:52:00.453 INFO:tasks.workunit.client.0.smithi031.stdout:4/364: mknod d8/d3a/c70 0 2024-09-17T01:52:00.455 INFO:tasks.workunit.client.1.smithi092.stdout:8/178: dwrite f7 [0,4194304] 0 2024-09-17T01:52:00.457 INFO:tasks.workunit.client.1.smithi092.stdout:7/172: rmdir d3/db 39 2024-09-17T01:52:00.458 INFO:tasks.workunit.client.0.smithi031.stdout:4/365: dread d8/f28 [0,4194304] 0 2024-09-17T01:52:00.461 INFO:tasks.workunit.client.1.smithi092.stdout:5/65: creat d0/de/f15 x:0 0 0 2024-09-17T01:52:00.464 INFO:tasks.workunit.client.1.smithi092.stdout:8/179: unlink f12 0 2024-09-17T01:52:00.466 INFO:tasks.workunit.client.1.smithi092.stdout:3/98: creat d4/d16/d1b/f21 x:0 0 0 2024-09-17T01:52:00.467 INFO:tasks.workunit.client.1.smithi092.stdout:3/99: chown d4/d13 1443 1 2024-09-17T01:52:00.468 INFO:tasks.workunit.client.0.smithi031.stdout:4/366: write d8/fc [3011557,27871] 0 2024-09-17T01:52:00.469 INFO:tasks.workunit.client.0.smithi031.stdout:4/367: fsync d8/d22/f30 0 2024-09-17T01:52:00.469 INFO:tasks.workunit.client.1.smithi092.stdout:8/180: creat d15/d25/d2b/f36 x:0 0 0 2024-09-17T01:52:00.470 INFO:tasks.workunit.client.1.smithi092.stdout:6/122: write d3/f5 [878111,96400] 0 2024-09-17T01:52:00.470 INFO:tasks.workunit.client.1.smithi092.stdout:8/181: chown f14 631 1 2024-09-17T01:52:00.472 INFO:tasks.workunit.client.1.smithi092.stdout:3/100: mknod d4/d13/c22 0 2024-09-17T01:52:00.473 INFO:tasks.workunit.client.1.smithi092.stdout:3/101: fdatasync d4/d13/f1d 0 2024-09-17T01:52:00.474 INFO:tasks.workunit.client.1.smithi092.stdout:7/173: chown d3/db/d26/l39 7 1 2024-09-17T01:52:00.474 INFO:tasks.workunit.client.1.smithi092.stdout:8/182: chown c10 96917 1 2024-09-17T01:52:00.474 INFO:tasks.workunit.client.1.smithi092.stdout:5/66: link d0/de/l14 d0/l16 0 2024-09-17T01:52:00.475 INFO:tasks.workunit.client.0.smithi031.stdout:4/368: dwrite d8/d22/d25/f26 [0,4194304] 0 2024-09-17T01:52:00.475 INFO:tasks.workunit.client.0.smithi031.stdout:4/369: chown d8/l20 3585 1 2024-09-17T01:52:00.476 INFO:tasks.workunit.client.1.smithi092.stdout:3/102: truncate d4/d16/d1b/f21 235091 0 2024-09-17T01:52:00.476 INFO:tasks.workunit.client.1.smithi092.stdout:6/123: mkdir d3/d10/d1f/d21/d28 0 2024-09-17T01:52:00.477 INFO:tasks.workunit.client.0.smithi031.stdout:4/370: creat d8/d3a/d41/d64/d4d/f71 x:0 0 0 2024-09-17T01:52:00.478 INFO:tasks.workunit.client.0.smithi031.stdout:4/371: readlink d8/d22/d25/l34 0 2024-09-17T01:52:00.478 INFO:tasks.workunit.client.1.smithi092.stdout:8/183: symlink d15/d25/d2b/l37 0 2024-09-17T01:52:00.479 INFO:tasks.workunit.client.0.smithi031.stdout:4/372: read d8/d22/d25/f26 [145409,6636] 0 2024-09-17T01:52:00.479 INFO:tasks.workunit.client.0.smithi031.stdout:4/373: readlink d8/d22/d25/d36/d4c/d52/l62 0 2024-09-17T01:52:00.480 INFO:tasks.workunit.client.1.smithi092.stdout:5/67: mknod d0/d9/c17 0 2024-09-17T01:52:00.480 INFO:tasks.workunit.client.1.smithi092.stdout:8/184: truncate f7 5231487 0 2024-09-17T01:52:00.482 INFO:tasks.workunit.client.1.smithi092.stdout:8/185: chown d15/d32 60075 1 2024-09-17T01:52:00.482 INFO:tasks.workunit.client.1.smithi092.stdout:5/68: dread - d0/f10 zero size 2024-09-17T01:52:00.484 INFO:tasks.workunit.client.0.smithi031.stdout:4/374: link d8/l6a d8/l72 0 2024-09-17T01:52:00.484 INFO:tasks.workunit.client.1.smithi092.stdout:5/69: chown d0/f10 2073 1 2024-09-17T01:52:00.485 INFO:tasks.workunit.client.1.smithi092.stdout:6/124: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:52:00.485 INFO:tasks.workunit.client.1.smithi092.stdout:0/87: write d3/f4 [273882,74019] 0 2024-09-17T01:52:00.486 INFO:tasks.workunit.client.1.smithi092.stdout:5/70: chown d0/f7 2068063027 1 2024-09-17T01:52:00.486 INFO:tasks.workunit.client.0.smithi031.stdout:4/375: creat d8/d22/d25/d36/d4c/d61/f73 x:0 0 0 2024-09-17T01:52:00.486 INFO:tasks.workunit.client.0.smithi031.stdout:4/376: chown d8/d22 10209869 1 2024-09-17T01:52:00.487 INFO:tasks.workunit.client.1.smithi092.stdout:7/174: mknod d3/d2b/d37/c3c 0 2024-09-17T01:52:00.488 INFO:tasks.workunit.client.1.smithi092.stdout:6/125: fdatasync d3/d10/d1a/f24 0 2024-09-17T01:52:00.491 INFO:tasks.workunit.client.0.smithi031.stdout:4/377: rename d8/d22/d25/d36/c3d to d8/d3a/c74 0 2024-09-17T01:52:00.491 INFO:tasks.workunit.client.1.smithi092.stdout:0/88: creat d3/f17 x:0 0 0 2024-09-17T01:52:00.492 INFO:tasks.workunit.client.1.smithi092.stdout:3/103: link d4/c11 d4/c23 0 2024-09-17T01:52:00.493 INFO:tasks.workunit.client.1.smithi092.stdout:3/104: chown d4/d20 522 1 2024-09-17T01:52:00.493 INFO:tasks.workunit.client.1.smithi092.stdout:5/71: chown d0/de/l14 7659980 1 2024-09-17T01:52:00.494 INFO:tasks.workunit.client.1.smithi092.stdout:0/89: write d3/da/f10 [1525779,122747] 0 2024-09-17T01:52:00.497 INFO:tasks.workunit.client.1.smithi092.stdout:5/72: creat d0/d9/f18 x:0 0 0 2024-09-17T01:52:00.501 INFO:tasks.workunit.client.1.smithi092.stdout:6/126: dwrite d3/dd/d18/f27 [0,4194304] 0 2024-09-17T01:52:00.501 INFO:tasks.workunit.client.1.smithi092.stdout:5/73: mkdir d0/de/d19 0 2024-09-17T01:52:00.502 INFO:tasks.workunit.client.0.smithi031.stdout:8/310: sync 2024-09-17T01:52:00.504 INFO:tasks.workunit.client.1.smithi092.stdout:6/127: stat d3/d10/d1f/d21/d1e/f23 0 2024-09-17T01:52:00.504 INFO:tasks.workunit.client.1.smithi092.stdout:3/105: link d4/d16/f1c d4/d16/f24 0 2024-09-17T01:52:00.506 INFO:tasks.workunit.client.1.smithi092.stdout:0/90: dwrite d3/da/d15/f16 [0,4194304] 0 2024-09-17T01:52:00.507 INFO:tasks.workunit.client.1.smithi092.stdout:5/74: mkdir d0/de/d19/d1a 0 2024-09-17T01:52:00.507 INFO:tasks.workunit.client.1.smithi092.stdout:8/186: write f1 [3147745,83170] 0 2024-09-17T01:52:00.511 INFO:tasks.workunit.client.1.smithi092.stdout:5/75: dread - d0/de/f15 zero size 2024-09-17T01:52:00.511 INFO:tasks.workunit.client.0.smithi031.stdout:4/378: dread d8/fc [0,4194304] 0 2024-09-17T01:52:00.512 INFO:tasks.workunit.client.1.smithi092.stdout:0/91: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:00.512 INFO:tasks.workunit.client.0.smithi031.stdout:8/311: dread d0/f9 [0,4194304] 0 2024-09-17T01:52:00.513 INFO:tasks.workunit.client.1.smithi092.stdout:7/175: truncate d3/db/f17 129042 0 2024-09-17T01:52:00.513 INFO:tasks.workunit.client.1.smithi092.stdout:5/76: dread - d0/d9/f12 zero size 2024-09-17T01:52:00.514 INFO:tasks.workunit.client.0.smithi031.stdout:4/379: read - d8/d22/d25/d36/d4c/d61/f73 zero size 2024-09-17T01:52:00.515 INFO:tasks.workunit.client.1.smithi092.stdout:8/187: rename d15/f26 to d15/d32/f38 0 2024-09-17T01:52:00.518 INFO:tasks.workunit.client.1.smithi092.stdout:6/128: dwrite d3/d10/d1f/d21/d1e/f23 [0,4194304] 0 2024-09-17T01:52:00.520 INFO:tasks.workunit.client.0.smithi031.stdout:8/312: dwrite d0/df/dd/f51 [0,4194304] 0 2024-09-17T01:52:00.521 INFO:tasks.workunit.client.0.smithi031.stdout:4/380: dread d8/d22/d25/f26 [0,4194304] 0 2024-09-17T01:52:00.521 INFO:tasks.workunit.client.1.smithi092.stdout:5/77: creat d0/d9/f1b x:0 0 0 2024-09-17T01:52:00.523 INFO:tasks.workunit.client.1.smithi092.stdout:8/188: mkdir d15/d25/d27/d39 0 2024-09-17T01:52:00.524 INFO:tasks.workunit.client.1.smithi092.stdout:5/78: write d0/de/f13 [40198,111586] 0 2024-09-17T01:52:00.524 INFO:tasks.workunit.client.0.smithi031.stdout:4/381: mkdir d8/d3a/d41/d64/d4d/d75 0 2024-09-17T01:52:00.527 INFO:tasks.workunit.client.1.smithi092.stdout:0/92: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:52:00.528 INFO:tasks.workunit.client.0.smithi031.stdout:4/382: symlink d8/d22/d25/d36/d4c/l76 0 2024-09-17T01:52:00.528 INFO:tasks.workunit.client.1.smithi092.stdout:8/189: write d15/d25/f30 [467164,126099] 0 2024-09-17T01:52:00.528 INFO:tasks.workunit.client.1.smithi092.stdout:5/79: fdatasync d0/d9/f1b 0 2024-09-17T01:52:00.532 INFO:tasks.workunit.client.0.smithi031.stdout:4/383: creat d8/d3a/d41/f77 x:0 0 0 2024-09-17T01:52:00.535 INFO:tasks.workunit.client.0.smithi031.stdout:4/384: creat d8/d3a/d41/d55/f78 x:0 0 0 2024-09-17T01:52:00.538 INFO:tasks.workunit.client.1.smithi092.stdout:7/176: getdents d3/d2b/d37 0 2024-09-17T01:52:00.542 INFO:tasks.workunit.client.1.smithi092.stdout:8/190: rmdir d15/d25/d27/d39 0 2024-09-17T01:52:00.543 INFO:tasks.workunit.client.1.smithi092.stdout:0/93: dwrite d3/f17 [0,4194304] 0 2024-09-17T01:52:00.543 INFO:tasks.workunit.client.0.smithi031.stdout:8/313: dread d0/d5/fa [0,4194304] 0 2024-09-17T01:52:00.543 INFO:tasks.workunit.client.1.smithi092.stdout:7/177: creat d3/d2b/d37/f3d x:0 0 0 2024-09-17T01:52:00.544 INFO:tasks.workunit.client.1.smithi092.stdout:5/80: dwrite d0/f10 [0,4194304] 0 2024-09-17T01:52:00.545 INFO:tasks.workunit.client.0.smithi031.stdout:8/314: creat d0/d5/f5d x:0 0 0 2024-09-17T01:52:00.546 INFO:tasks.workunit.client.1.smithi092.stdout:8/191: symlink d15/l3a 0 2024-09-17T01:52:00.547 INFO:tasks.workunit.client.1.smithi092.stdout:5/81: truncate d0/de/f15 83893 0 2024-09-17T01:52:00.547 INFO:tasks.workunit.client.0.smithi031.stdout:8/315: creat d0/d5/f5e x:0 0 0 2024-09-17T01:52:00.548 INFO:tasks.workunit.client.0.smithi031.stdout:8/316: write d0/d5/f5d [66717,57020] 0 2024-09-17T01:52:00.549 INFO:tasks.workunit.client.0.smithi031.stdout:8/317: creat d0/df/d19/d3d/f5f x:0 0 0 2024-09-17T01:52:00.549 INFO:tasks.workunit.client.1.smithi092.stdout:8/192: dread - d15/d25/f2d zero size 2024-09-17T01:52:00.549 INFO:tasks.workunit.client.1.smithi092.stdout:7/178: unlink d3/d2b/d37/f3d 0 2024-09-17T01:52:00.550 INFO:tasks.workunit.client.0.smithi031.stdout:8/318: truncate d0/df/d19/d3d/f5c 1000676 0 2024-09-17T01:52:00.551 INFO:tasks.workunit.client.0.smithi031.stdout:2/308: sync 2024-09-17T01:52:00.551 INFO:tasks.workunit.client.0.smithi031.stdout:0/254: sync 2024-09-17T01:52:00.555 INFO:tasks.workunit.client.1.smithi092.stdout:5/82: unlink d0/de/f13 0 2024-09-17T01:52:00.556 INFO:tasks.workunit.client.0.smithi031.stdout:4/385: truncate d8/fb 833628 0 2024-09-17T01:52:00.556 INFO:tasks.workunit.client.1.smithi092.stdout:5/83: chown d0/ca 14213654 1 2024-09-17T01:52:00.557 INFO:tasks.workunit.client.0.smithi031.stdout:0/255: creat d0/d29/d33/d2a/d25/d38/f65 x:0 0 0 2024-09-17T01:52:00.559 INFO:tasks.workunit.client.1.smithi092.stdout:0/94: link d3/cf d3/da/c18 0 2024-09-17T01:52:00.560 INFO:tasks.workunit.client.0.smithi031.stdout:2/309: dwrite d1/d3/df/d11/f26 [0,4194304] 0 2024-09-17T01:52:00.560 INFO:tasks.workunit.client.0.smithi031.stdout:4/386: mkdir d8/d3a/d41/d64/d4d/d5a/d79 0 2024-09-17T01:52:00.561 INFO:tasks.workunit.client.0.smithi031.stdout:0/256: fdatasync d0/d29/d33/d2a/d25/f26 0 2024-09-17T01:52:00.561 INFO:tasks.workunit.client.1.smithi092.stdout:7/179: link d3/db/f1e d3/d2b/d3a/f3e 0 2024-09-17T01:52:00.562 INFO:tasks.workunit.client.1.smithi092.stdout:8/193: dwrite d15/f1e [0,4194304] 0 2024-09-17T01:52:00.563 INFO:tasks.workunit.client.0.smithi031.stdout:2/310: creat d1/d4c/f73 x:0 0 0 2024-09-17T01:52:00.566 INFO:tasks.workunit.client.0.smithi031.stdout:0/257: creat d0/d29/d44/f66 x:0 0 0 2024-09-17T01:52:00.568 INFO:tasks.workunit.client.0.smithi031.stdout:2/311: symlink d1/d3/df/d19/d1e/d21/d34/l74 0 2024-09-17T01:52:00.568 INFO:tasks.workunit.client.0.smithi031.stdout:0/258: chown d0/d29/d33/d2a/d25/d30/d4a/f64 202965 1 2024-09-17T01:52:00.568 INFO:tasks.workunit.client.1.smithi092.stdout:6/129: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:52:00.569 INFO:tasks.workunit.client.1.smithi092.stdout:8/194: write d15/d25/d2b/f31 [2188351,19225] 0 2024-09-17T01:52:00.569 INFO:tasks.workunit.client.0.smithi031.stdout:2/312: stat d1/d3/df/d19/d1e/d4f/c59 0 2024-09-17T01:52:00.569 INFO:tasks.workunit.client.0.smithi031.stdout:4/387: link d8/f11 d8/d22/d25/f7a 0 2024-09-17T01:52:00.571 INFO:tasks.workunit.client.0.smithi031.stdout:2/313: fdatasync d1/d3/df/d18/f3b 0 2024-09-17T01:52:00.571 INFO:tasks.workunit.client.0.smithi031.stdout:0/259: write d0/f5c [3536639,4375] 0 2024-09-17T01:52:00.572 INFO:tasks.workunit.client.1.smithi092.stdout:6/130: chown d3/le 99160125 1 2024-09-17T01:52:00.573 INFO:tasks.workunit.client.0.smithi031.stdout:2/314: chown d1/d3/df/d19/f5e 239414759 1 2024-09-17T01:52:00.573 INFO:tasks.workunit.client.1.smithi092.stdout:7/180: mknod d3/d6/d13/d21/d2e/c3f 0 2024-09-17T01:52:00.575 INFO:tasks.workunit.client.1.smithi092.stdout:5/84: dwrite d0/de/f11 [0,4194304] 0 2024-09-17T01:52:00.575 INFO:tasks.workunit.client.1.smithi092.stdout:8/195: mkdir d15/d32/d3b 0 2024-09-17T01:52:00.577 INFO:tasks.workunit.client.1.smithi092.stdout:6/131: chown d3/l9 892 1 2024-09-17T01:52:00.577 INFO:tasks.workunit.client.1.smithi092.stdout:8/196: fdatasync d15/f21 0 2024-09-17T01:52:00.578 INFO:tasks.workunit.client.1.smithi092.stdout:8/197: stat d15/d25 0 2024-09-17T01:52:00.579 INFO:tasks.workunit.client.1.smithi092.stdout:6/132: write d3/f13 [477974,81862] 0 2024-09-17T01:52:00.580 INFO:tasks.workunit.client.1.smithi092.stdout:5/85: mknod d0/d9/c1c 0 2024-09-17T01:52:00.580 INFO:tasks.workunit.client.1.smithi092.stdout:7/181: mkdir d3/d6/d13/d40 0 2024-09-17T01:52:00.582 INFO:tasks.workunit.client.0.smithi031.stdout:2/315: creat d1/d3/df/d19/d1e/d4f/f75 x:0 0 0 2024-09-17T01:52:00.584 INFO:tasks.workunit.client.0.smithi031.stdout:4/388: dwrite d8/d3a/d41/f60 [0,4194304] 0 2024-09-17T01:52:00.584 INFO:tasks.workunit.client.0.smithi031.stdout:8/319: dread d0/f42 [0,4194304] 0 2024-09-17T01:52:00.585 INFO:tasks.workunit.client.1.smithi092.stdout:5/86: creat d0/d9/f1d x:0 0 0 2024-09-17T01:52:00.587 INFO:tasks.workunit.client.0.smithi031.stdout:8/320: dread - d0/df/d19/d3d/f4b zero size 2024-09-17T01:52:00.589 INFO:tasks.workunit.client.0.smithi031.stdout:0/260: dwrite d0/d29/d33/d2a/f39 [0,4194304] 0 2024-09-17T01:52:00.591 INFO:tasks.workunit.client.1.smithi092.stdout:8/198: dwrite d15/f1f [0,4194304] 0 2024-09-17T01:52:00.594 INFO:tasks.workunit.client.1.smithi092.stdout:7/182: link d3/d6/d13/d21/f36 d3/db/d18/f41 0 2024-09-17T01:52:00.594 INFO:tasks.workunit.client.1.smithi092.stdout:6/133: dwrite d3/d10/d1f/d21/d1e/f23 [0,4194304] 0 2024-09-17T01:52:00.594 INFO:tasks.workunit.client.1.smithi092.stdout:8/199: dread - d15/d25/f33 zero size 2024-09-17T01:52:00.596 INFO:tasks.workunit.client.1.smithi092.stdout:8/200: dread f14 [0,4194304] 0 2024-09-17T01:52:00.597 INFO:tasks.workunit.client.0.smithi031.stdout:8/321: rename d0/d5/d55 to d0/d5/d54/d60 0 2024-09-17T01:52:00.597 INFO:tasks.workunit.client.0.smithi031.stdout:4/389: dread d8/f27 [0,4194304] 0 2024-09-17T01:52:00.598 INFO:tasks.workunit.client.0.smithi031.stdout:8/322: chown d0/df/dd/c53 221506 1 2024-09-17T01:52:00.598 INFO:tasks.workunit.client.1.smithi092.stdout:8/201: dread - d15/f1c zero size 2024-09-17T01:52:00.601 INFO:tasks.workunit.client.1.smithi092.stdout:6/134: rmdir d3 39 2024-09-17T01:52:00.604 INFO:tasks.workunit.client.0.smithi031.stdout:4/390: rename d8/d22/c45 to d8/d3a/d41/d64/d4d/d5a/c7b 0 2024-09-17T01:52:00.606 INFO:tasks.workunit.client.1.smithi092.stdout:8/202: creat d15/d25/f3c x:0 0 0 2024-09-17T01:52:00.608 INFO:tasks.workunit.client.0.smithi031.stdout:0/261: truncate d0/d29/d33/d5/fa 3722731 0 2024-09-17T01:52:00.608 INFO:tasks.workunit.client.0.smithi031.stdout:8/323: dwrite d0/f52 [0,4194304] 0 2024-09-17T01:52:00.609 INFO:tasks.workunit.client.0.smithi031.stdout:8/324: fdatasync d0/d5/f11 0 2024-09-17T01:52:00.610 INFO:tasks.workunit.client.0.smithi031.stdout:0/262: write d0/d29/d33/f13 [217752,93186] 0 2024-09-17T01:52:00.610 INFO:tasks.workunit.client.1.smithi092.stdout:6/135: mknod d3/c29 0 2024-09-17T01:52:00.611 INFO:tasks.workunit.client.0.smithi031.stdout:8/325: write d0/df/d19/d3d/f4b [726988,25269] 0 2024-09-17T01:52:00.611 INFO:tasks.workunit.client.0.smithi031.stdout:4/391: unlink d8/d22/d25/d36/d4c/d52/l53 0 2024-09-17T01:52:00.612 INFO:tasks.workunit.client.1.smithi092.stdout:7/183: dread d3/f14 [0,4194304] 0 2024-09-17T01:52:00.612 INFO:tasks.workunit.client.0.smithi031.stdout:0/263: fdatasync d0/d29/d33/f28 0 2024-09-17T01:52:00.614 INFO:tasks.workunit.client.0.smithi031.stdout:8/326: write d0/df/d19/f31 [1386739,8907] 0 2024-09-17T01:52:00.615 INFO:tasks.workunit.client.1.smithi092.stdout:0/95: truncate d3/da/f10 1394754 0 2024-09-17T01:52:00.615 INFO:tasks.workunit.client.0.smithi031.stdout:4/392: write d8/fd [2504514,9416] 0 2024-09-17T01:52:00.616 INFO:tasks.workunit.client.1.smithi092.stdout:0/96: fdatasync d3/f17 0 2024-09-17T01:52:00.619 INFO:tasks.workunit.client.0.smithi031.stdout:4/393: dread d8/d3a/d41/d64/d4d/d5a/f6e [0,4194304] 0 2024-09-17T01:52:00.619 INFO:tasks.workunit.client.1.smithi092.stdout:0/97: write d3/f5 [1013719,19451] 0 2024-09-17T01:52:00.620 INFO:tasks.workunit.client.0.smithi031.stdout:8/327: link d0/c18 d0/c61 0 2024-09-17T01:52:00.621 INFO:tasks.workunit.client.1.smithi092.stdout:5/87: rename d0/d9 to d0/de/d19/d1a/d1e 0 2024-09-17T01:52:00.623 INFO:tasks.workunit.client.1.smithi092.stdout:0/98: rename d3/da/d15/f16 to d3/da/d15/f19 0 2024-09-17T01:52:00.624 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:00 smithi092 ceph-mon[33552]: pgmap v10: 65 pgs: 65 active+clean; 596 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s rd, 52 MiB/s wr, 308 op/s 2024-09-17T01:52:00.624 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:00 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:00.625 INFO:tasks.workunit.client.1.smithi092.stdout:6/136: rename d3/lb to d3/dd/d19/l2a 0 2024-09-17T01:52:00.626 INFO:tasks.workunit.client.0.smithi031.stdout:0/264: link d0/d29/d33/d2a/d25/d38/l3a d0/d29/d33/d5/d48/d56/l67 0 2024-09-17T01:52:00.627 INFO:tasks.workunit.client.0.smithi031.stdout:8/328: dwrite d0/df/d19/f27 [0,4194304] 0 2024-09-17T01:52:00.627 INFO:tasks.workunit.client.1.smithi092.stdout:0/99: mknod d3/da/c1a 0 2024-09-17T01:52:00.629 INFO:tasks.workunit.client.1.smithi092.stdout:6/137: dread f1 [0,4194304] 0 2024-09-17T01:52:00.629 INFO:tasks.workunit.client.0.smithi031.stdout:8/329: write d0/df/d19/d3d/f5c [1449649,96782] 0 2024-09-17T01:52:00.630 INFO:tasks.workunit.client.1.smithi092.stdout:6/138: chown d3/dd/d19 42889 1 2024-09-17T01:52:00.630 INFO:tasks.workunit.client.1.smithi092.stdout:7/184: rename d3/d2b/d37/c3c to d3/d6/d13/d21/c42 0 2024-09-17T01:52:00.630 INFO:tasks.workunit.client.1.smithi092.stdout:6/139: write d3/f15 [2547497,107194] 0 2024-09-17T01:52:00.630 INFO:tasks.workunit.client.0.smithi031.stdout:8/330: readlink d0/df/dd/l30 0 2024-09-17T01:52:00.631 INFO:tasks.workunit.client.1.smithi092.stdout:6/140: truncate d3/f8 1163075 0 2024-09-17T01:52:00.632 INFO:tasks.workunit.client.0.smithi031.stdout:0/265: creat d0/f68 x:0 0 0 2024-09-17T01:52:00.638 INFO:tasks.workunit.client.1.smithi092.stdout:9/152: sync 2024-09-17T01:52:00.638 INFO:tasks.workunit.client.1.smithi092.stdout:1/80: sync 2024-09-17T01:52:00.639 INFO:tasks.workunit.client.1.smithi092.stdout:0/100: link d3/da/c14 d3/da/c1b 0 2024-09-17T01:52:00.640 INFO:tasks.workunit.client.1.smithi092.stdout:6/141: dwrite d3/f13 [0,4194304] 0 2024-09-17T01:52:00.641 INFO:tasks.workunit.client.1.smithi092.stdout:0/101: truncate d3/f12 886393 0 2024-09-17T01:52:00.642 INFO:tasks.workunit.client.1.smithi092.stdout:9/153: unlink d0/fd 0 2024-09-17T01:52:00.642 INFO:tasks.workunit.client.1.smithi092.stdout:0/102: chown d3/f5 125033188 1 2024-09-17T01:52:00.643 INFO:tasks.workunit.client.0.smithi031.stdout:0/266: dwrite d0/d29/d33/d5/d48/f4d [0,4194304] 0 2024-09-17T01:52:00.644 INFO:tasks.workunit.client.1.smithi092.stdout:1/81: mknod db/c1b 0 2024-09-17T01:52:00.645 INFO:tasks.workunit.client.0.smithi031.stdout:8/331: dwrite d0/df/d19/d3d/f41 [0,4194304] 0 2024-09-17T01:52:00.645 INFO:tasks.workunit.client.1.smithi092.stdout:1/82: write db/f19 [275234,109875] 0 2024-09-17T01:52:00.647 INFO:tasks.workunit.client.1.smithi092.stdout:0/103: dread d3/f6 [0,4194304] 0 2024-09-17T01:52:00.652 INFO:tasks.workunit.client.1.smithi092.stdout:1/83: symlink db/l1c 0 2024-09-17T01:52:00.655 INFO:tasks.workunit.client.1.smithi092.stdout:0/104: mkdir d3/da/d1c 0 2024-09-17T01:52:00.655 INFO:tasks.workunit.client.0.smithi031.stdout:8/332: rename d0/f28 to d0/d5/d54/d60/f62 0 2024-09-17T01:52:00.657 INFO:tasks.workunit.client.1.smithi092.stdout:1/84: mkdir db/d1d 0 2024-09-17T01:52:00.657 INFO:tasks.workunit.client.0.smithi031.stdout:4/394: dwrite d8/d22/f3c [4194304,4194304] 0 2024-09-17T01:52:00.658 INFO:tasks.workunit.client.1.smithi092.stdout:5/88: truncate d0/fd 1141722 0 2024-09-17T01:52:00.658 INFO:tasks.workunit.client.1.smithi092.stdout:1/85: dread - db/f1a zero size 2024-09-17T01:52:00.659 INFO:tasks.workunit.client.1.smithi092.stdout:0/105: mkdir d3/d1d 0 2024-09-17T01:52:00.660 INFO:tasks.workunit.client.1.smithi092.stdout:5/89: rmdir d0/de/d19 39 2024-09-17T01:52:00.661 INFO:tasks.workunit.client.1.smithi092.stdout:0/106: write d3/f7 [422824,12359] 0 2024-09-17T01:52:00.661 INFO:tasks.workunit.client.1.smithi092.stdout:7/185: write d3/d2b/d3a/f3e [2333985,86427] 0 2024-09-17T01:52:00.662 INFO:tasks.workunit.client.1.smithi092.stdout:0/107: readlink d3/da/l11 0 2024-09-17T01:52:00.663 INFO:tasks.workunit.client.0.smithi031.stdout:0/267: rename d0/d29/d33/d2a/d25/l47 to d0/d29/d33/d2a/d25/d30/d4a/l69 0 2024-09-17T01:52:00.664 INFO:tasks.workunit.client.1.smithi092.stdout:0/108: chown d3/l13 15459 1 2024-09-17T01:52:00.664 INFO:tasks.workunit.client.1.smithi092.stdout:1/86: mknod db/d1d/c1e 0 2024-09-17T01:52:00.664 INFO:tasks.workunit.client.1.smithi092.stdout:5/90: readlink d0/l16 0 2024-09-17T01:52:00.665 INFO:tasks.workunit.client.0.smithi031.stdout:4/395: dread d8/f2b [0,4194304] 0 2024-09-17T01:52:00.666 INFO:tasks.workunit.client.0.smithi031.stdout:4/396: readlink d8/d3a/d41/l69 0 2024-09-17T01:52:00.666 INFO:tasks.workunit.client.0.smithi031.stdout:4/397: readlink d8/d22/l42 0 2024-09-17T01:52:00.667 INFO:tasks.workunit.client.1.smithi092.stdout:7/186: creat d3/db/d26/f43 x:0 0 0 2024-09-17T01:52:00.668 INFO:tasks.workunit.client.0.smithi031.stdout:0/268: getdents d0 0 2024-09-17T01:52:00.668 INFO:tasks.workunit.client.0.smithi031.stdout:4/398: chown d8/d22/d25/c5d 71 1 2024-09-17T01:52:00.668 INFO:tasks.workunit.client.0.smithi031.stdout:0/269: chown d0/l42 148490 1 2024-09-17T01:52:00.669 INFO:tasks.workunit.client.0.smithi031.stdout:4/399: write d8/d3a/d41/f60 [1644834,80628] 0 2024-09-17T01:52:00.670 INFO:tasks.workunit.client.1.smithi092.stdout:7/187: rmdir d3/d6/d13/d21/d2e 39 2024-09-17T01:52:00.671 INFO:tasks.workunit.client.0.smithi031.stdout:0/270: mknod d0/d29/d33/d5/d50/c6a 0 2024-09-17T01:52:00.672 INFO:tasks.workunit.client.0.smithi031.stdout:4/400: mknod d8/d22/d25/d36/d4c/d61/c7c 0 2024-09-17T01:52:00.673 INFO:tasks.workunit.client.1.smithi092.stdout:1/87: dread db/f19 [0,4194304] 0 2024-09-17T01:52:00.673 INFO:tasks.workunit.client.0.smithi031.stdout:0/271: creat d0/d29/d33/d2a/d25/d30/f6b x:0 0 0 2024-09-17T01:52:00.674 INFO:tasks.workunit.client.0.smithi031.stdout:4/401: creat d8/d3a/d41/d64/f7d x:0 0 0 2024-09-17T01:52:00.675 INFO:tasks.workunit.client.1.smithi092.stdout:7/188: mknod d3/c44 0 2024-09-17T01:52:00.675 INFO:tasks.workunit.client.1.smithi092.stdout:5/91: dread d0/fc [0,4194304] 0 2024-09-17T01:52:00.676 INFO:tasks.workunit.client.1.smithi092.stdout:0/109: dwrite d3/da/fb [0,4194304] 0 2024-09-17T01:52:00.677 INFO:tasks.workunit.client.0.smithi031.stdout:4/402: write d8/d3a/d41/d64/d4f/f56 [226621,78636] 0 2024-09-17T01:52:00.677 INFO:tasks.workunit.client.1.smithi092.stdout:1/88: write db/f1a [903440,46024] 0 2024-09-17T01:52:00.677 INFO:tasks.workunit.client.0.smithi031.stdout:0/272: creat d0/d29/d33/d2a/d25/d30/d4a/f6c x:0 0 0 2024-09-17T01:52:00.679 INFO:tasks.workunit.client.0.smithi031.stdout:4/403: mkdir d8/d3a/d7e 0 2024-09-17T01:52:00.680 INFO:tasks.workunit.client.1.smithi092.stdout:0/110: creat d3/da/f1e x:0 0 0 2024-09-17T01:52:00.682 INFO:tasks.workunit.client.0.smithi031.stdout:4/404: getdents d8/d3a/d7e 0 2024-09-17T01:52:00.683 INFO:tasks.workunit.client.1.smithi092.stdout:1/89: readlink l7 0 2024-09-17T01:52:00.683 INFO:tasks.workunit.client.1.smithi092.stdout:1/90: fsync f6 0 2024-09-17T01:52:00.684 INFO:tasks.workunit.client.0.smithi031.stdout:4/405: truncate d8/f27 4479768 0 2024-09-17T01:52:00.684 INFO:tasks.workunit.client.0.smithi031.stdout:0/273: dwrite d0/d29/d33/d2a/d25/f3f [0,4194304] 0 2024-09-17T01:52:00.686 INFO:tasks.workunit.client.1.smithi092.stdout:0/111: creat d3/f1f x:0 0 0 2024-09-17T01:52:00.686 INFO:tasks.workunit.client.1.smithi092.stdout:5/92: dread d0/fc [4194304,4194304] 0 2024-09-17T01:52:00.686 INFO:tasks.workunit.client.1.smithi092.stdout:0/112: stat d3 0 2024-09-17T01:52:00.688 INFO:tasks.workunit.client.1.smithi092.stdout:1/91: rename db/f11 to db/f1f 0 2024-09-17T01:52:00.688 INFO:tasks.workunit.client.1.smithi092.stdout:7/189: getdents d3/d6/d13/d21 0 2024-09-17T01:52:00.691 INFO:tasks.workunit.client.1.smithi092.stdout:0/113: write d3/da/d15/f19 [4128473,125370] 0 2024-09-17T01:52:00.692 INFO:tasks.workunit.client.0.smithi031.stdout:4/406: dwrite d8/d3a/f6f [0,4194304] 0 2024-09-17T01:52:00.695 INFO:tasks.workunit.client.0.smithi031.stdout:7/272: sync 2024-09-17T01:52:00.695 INFO:tasks.workunit.client.0.smithi031.stdout:6/419: sync 2024-09-17T01:52:00.695 INFO:tasks.workunit.client.0.smithi031.stdout:9/242: sync 2024-09-17T01:52:00.695 INFO:tasks.workunit.client.0.smithi031.stdout:3/227: sync 2024-09-17T01:52:00.695 INFO:tasks.workunit.client.0.smithi031.stdout:5/277: sync 2024-09-17T01:52:00.695 INFO:tasks.workunit.client.0.smithi031.stdout:1/330: sync 2024-09-17T01:52:00.697 INFO:tasks.workunit.client.0.smithi031.stdout:6/420: write f1a [446208,113647] 0 2024-09-17T01:52:00.697 INFO:tasks.workunit.client.0.smithi031.stdout:1/331: stat d4/c7 0 2024-09-17T01:52:00.697 INFO:tasks.workunit.client.1.smithi092.stdout:7/190: unlink d3/l2d 0 2024-09-17T01:52:00.699 INFO:tasks.workunit.client.0.smithi031.stdout:4/407: rename d8/d3a/d41/c63 to d8/d22/d25/d36/d4c/d52/c7f 0 2024-09-17T01:52:00.701 INFO:tasks.workunit.client.1.smithi092.stdout:7/191: chown d3/d6/d13/d21/c42 0 1 2024-09-17T01:52:00.702 INFO:tasks.workunit.client.1.smithi092.stdout:1/92: dwrite db/f19 [0,4194304] 0 2024-09-17T01:52:00.702 INFO:tasks.workunit.client.0.smithi031.stdout:7/273: creat db/d1c/d46/f52 x:0 0 0 2024-09-17T01:52:00.703 INFO:tasks.workunit.client.1.smithi092.stdout:1/93: write db/f1a [1810009,48936] 0 2024-09-17T01:52:00.703 INFO:tasks.workunit.client.0.smithi031.stdout:8/333: dread d0/df/d19/f33 [0,4194304] 0 2024-09-17T01:52:00.705 INFO:tasks.workunit.client.1.smithi092.stdout:0/114: link d3/da/c14 d3/da/c20 0 2024-09-17T01:52:00.705 INFO:tasks.workunit.client.1.smithi092.stdout:6/142: truncate f1 2257301 0 2024-09-17T01:52:00.709 INFO:tasks.workunit.client.1.smithi092.stdout:7/192: rmdir d3/d2b 39 2024-09-17T01:52:00.710 INFO:tasks.workunit.client.1.smithi092.stdout:7/193: stat d3/d6/f1c 0 2024-09-17T01:52:00.711 INFO:tasks.workunit.client.0.smithi031.stdout:5/278: symlink da/dc/d25/l5d 0 2024-09-17T01:52:00.711 INFO:tasks.workunit.client.1.smithi092.stdout:1/94: rename db/c1b to db/c20 0 2024-09-17T01:52:00.712 INFO:tasks.workunit.client.0.smithi031.stdout:1/332: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:52:00.716 INFO:tasks.workunit.client.0.smithi031.stdout:9/243: symlink d3/d4/d29/l50 0 2024-09-17T01:52:00.717 INFO:tasks.workunit.client.1.smithi092.stdout:0/115: dwrite d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:00.717 INFO:tasks.workunit.client.1.smithi092.stdout:1/95: symlink db/l21 0 2024-09-17T01:52:00.720 INFO:tasks.workunit.client.0.smithi031.stdout:3/228: fsync db/d29/d2f/f43 0 2024-09-17T01:52:00.720 INFO:tasks.workunit.client.1.smithi092.stdout:7/194: mknod d3/c45 0 2024-09-17T01:52:00.721 INFO:tasks.workunit.client.1.smithi092.stdout:5/93: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:00.721 INFO:tasks.workunit.client.0.smithi031.stdout:1/333: write d4/d1a/d43/d53/f55 [1363026,44739] 0 2024-09-17T01:52:00.722 INFO:tasks.workunit.client.0.smithi031.stdout:8/334: dwrite d0/df/f2b [0,4194304] 0 2024-09-17T01:52:00.724 INFO:tasks.workunit.client.0.smithi031.stdout:3/229: dread - db/f3e zero size 2024-09-17T01:52:00.725 INFO:tasks.workunit.client.1.smithi092.stdout:9/154: write d0/f6 [3100390,33129] 0 2024-09-17T01:52:00.726 INFO:tasks.workunit.client.0.smithi031.stdout:0/274: write d0/d29/d33/d2a/d25/d30/f57 [2557124,55471] 0 2024-09-17T01:52:00.728 INFO:tasks.workunit.client.0.smithi031.stdout:1/334: stat d4/d1e/d3f/d4d/c4e 0 2024-09-17T01:52:00.729 INFO:tasks.workunit.client.1.smithi092.stdout:0/116: dread d3/f6 [0,4194304] 0 2024-09-17T01:52:00.731 INFO:tasks.workunit.client.1.smithi092.stdout:0/117: write d3/f6 [2775454,20706] 0 2024-09-17T01:52:00.733 INFO:tasks.workunit.client.1.smithi092.stdout:5/94: rename d0/f10 to d0/de/d19/f1f 0 2024-09-17T01:52:00.734 INFO:tasks.workunit.client.0.smithi031.stdout:8/335: creat d0/f63 x:0 0 0 2024-09-17T01:52:00.735 INFO:tasks.workunit.client.0.smithi031.stdout:8/336: read - d0/f63 zero size 2024-09-17T01:52:00.736 INFO:tasks.workunit.client.1.smithi092.stdout:0/118: symlink d3/l21 0 2024-09-17T01:52:00.737 INFO:tasks.workunit.client.0.smithi031.stdout:9/244: read d3/d19/d1f/f21 [1137148,126456] 0 2024-09-17T01:52:00.737 INFO:tasks.workunit.client.0.smithi031.stdout:6/421: link d23/d50/c5f d23/d63/d47/c86 0 2024-09-17T01:52:00.737 INFO:tasks.workunit.client.0.smithi031.stdout:4/408: creat d8/d3a/d41/d64/d4d/d5a/d79/f80 x:0 0 0 2024-09-17T01:52:00.738 INFO:tasks.workunit.client.1.smithi092.stdout:5/95: symlink d0/de/d19/l20 0 2024-09-17T01:52:00.739 INFO:tasks.workunit.client.0.smithi031.stdout:0/275: dwrite d0/d29/d33/d5/f3b [0,4194304] 0 2024-09-17T01:52:00.740 INFO:tasks.workunit.client.1.smithi092.stdout:0/119: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:00.742 INFO:tasks.workunit.client.0.smithi031.stdout:9/245: mknod d3/d19/d1f/c51 0 2024-09-17T01:52:00.743 INFO:tasks.workunit.client.1.smithi092.stdout:0/120: write d3/f5 [2571096,114319] 0 2024-09-17T01:52:00.744 INFO:tasks.workunit.client.0.smithi031.stdout:6/422: rename d23/d50/l6b to d23/d50/l87 0 2024-09-17T01:52:00.745 INFO:tasks.workunit.client.0.smithi031.stdout:6/423: chown d23/f2e 13314580 1 2024-09-17T01:52:00.746 INFO:tasks.workunit.client.0.smithi031.stdout:3/230: creat db/df/d1d/f48 x:0 0 0 2024-09-17T01:52:00.747 INFO:tasks.workunit.client.1.smithi092.stdout:0/121: creat d3/da/f22 x:0 0 0 2024-09-17T01:52:00.748 INFO:tasks.workunit.client.1.smithi092.stdout:6/143: dread f1 [0,4194304] 0 2024-09-17T01:52:00.750 INFO:tasks.workunit.client.1.smithi092.stdout:0/122: mknod d3/da/d1c/c23 0 2024-09-17T01:52:00.752 INFO:tasks.workunit.client.1.smithi092.stdout:6/144: mkdir d3/d10/d1f/d21/d28/d2b 0 2024-09-17T01:52:00.754 INFO:tasks.workunit.client.1.smithi092.stdout:6/145: unlink d3/c12 0 2024-09-17T01:52:00.754 INFO:tasks.workunit.client.1.smithi092.stdout:6/146: readlink d3/l9 0 2024-09-17T01:52:00.755 INFO:tasks.workunit.client.1.smithi092.stdout:0/123: symlink d3/d1d/l24 0 2024-09-17T01:52:00.757 INFO:tasks.workunit.client.1.smithi092.stdout:1/96: truncate db/fd 2659041 0 2024-09-17T01:52:00.757 INFO:tasks.workunit.client.1.smithi092.stdout:1/97: fsync db/f1a 0 2024-09-17T01:52:00.761 INFO:tasks.workunit.client.1.smithi092.stdout:1/98: dread db/f19 [0,4194304] 0 2024-09-17T01:52:00.762 INFO:tasks.workunit.client.1.smithi092.stdout:7/195: truncate d3/db/f1e 374335 0 2024-09-17T01:52:00.762 INFO:tasks.workunit.client.1.smithi092.stdout:7/196: stat d3/db/d26/c30 0 2024-09-17T01:52:00.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:00 smithi031 ceph-mon[27673]: pgmap v10: 65 pgs: 65 active+clean; 596 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s rd, 52 MiB/s wr, 308 op/s 2024-09-17T01:52:00.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:00 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:00.769 INFO:tasks.workunit.client.1.smithi092.stdout:0/124: getdents d3/da 0 2024-09-17T01:52:00.769 INFO:tasks.workunit.client.1.smithi092.stdout:5/96: truncate d0/fc 702312 0 2024-09-17T01:52:00.770 INFO:tasks.workunit.client.1.smithi092.stdout:1/99: rename db/f19 to db/d1d/f22 0 2024-09-17T01:52:00.772 INFO:tasks.workunit.client.1.smithi092.stdout:7/197: creat d3/d2b/d37/f46 x:0 0 0 2024-09-17T01:52:00.773 INFO:tasks.workunit.client.1.smithi092.stdout:0/125: symlink d3/da/d1c/l25 0 2024-09-17T01:52:00.773 INFO:tasks.workunit.client.1.smithi092.stdout:5/97: dread d0/de/d19/f1f [0,4194304] 0 2024-09-17T01:52:00.775 INFO:tasks.workunit.client.1.smithi092.stdout:7/198: write d3/d6/d13/f34 [1195638,103213] 0 2024-09-17T01:52:00.777 INFO:tasks.workunit.client.1.smithi092.stdout:0/126: rename c2 to d3/d1d/c26 0 2024-09-17T01:52:00.780 INFO:tasks.workunit.client.1.smithi092.stdout:6/147: truncate d3/f5 60236 0 2024-09-17T01:52:00.782 INFO:tasks.workunit.client.1.smithi092.stdout:7/199: symlink d3/db/l47 0 2024-09-17T01:52:00.783 INFO:tasks.workunit.client.1.smithi092.stdout:5/98: dwrite d0/de/f15 [0,4194304] 0 2024-09-17T01:52:00.789 INFO:tasks.workunit.client.1.smithi092.stdout:0/127: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:52:00.793 INFO:tasks.workunit.client.1.smithi092.stdout:0/128: truncate d3/da/f22 558826 0 2024-09-17T01:52:00.794 INFO:tasks.workunit.client.1.smithi092.stdout:7/200: dread d3/d6/d13/d21/f36 [0,4194304] 0 2024-09-17T01:52:00.794 INFO:tasks.workunit.client.1.smithi092.stdout:0/129: readlink d3/l9 0 2024-09-17T01:52:00.794 INFO:tasks.workunit.client.0.smithi031.stdout:2/316: sync 2024-09-17T01:52:00.795 INFO:tasks.workunit.client.1.smithi092.stdout:5/99: dread d0/de/f15 [0,4194304] 0 2024-09-17T01:52:00.796 INFO:tasks.workunit.client.0.smithi031.stdout:4/409: link d8/d3a/d41/d64/f6c d8/d3a/d41/d64/d4d/f81 0 2024-09-17T01:52:00.796 INFO:tasks.workunit.client.0.smithi031.stdout:9/246: symlink d3/d4/d29/l52 0 2024-09-17T01:52:00.797 INFO:tasks.workunit.client.0.smithi031.stdout:5/279: write da/d42/d26/f34 [3745863,20638] 0 2024-09-17T01:52:00.797 INFO:tasks.workunit.client.0.smithi031.stdout:2/317: dread - d1/d3/d45/d4a/f6d zero size 2024-09-17T01:52:00.797 INFO:tasks.workunit.client.1.smithi092.stdout:0/130: stat d3/da/d15 0 2024-09-17T01:52:00.798 INFO:tasks.workunit.client.1.smithi092.stdout:1/100: getdents db 0 2024-09-17T01:52:00.799 INFO:tasks.workunit.client.0.smithi031.stdout:1/335: link d4/d1a/d2d/d18/f39 d4/d1a/d2d/d18/f6c 0 2024-09-17T01:52:00.799 INFO:tasks.workunit.client.1.smithi092.stdout:0/131: fsync d3/f1f 0 2024-09-17T01:52:00.800 INFO:tasks.workunit.client.0.smithi031.stdout:2/318: chown d1/d3/df/d19/d1e/d4f 1432713 1 2024-09-17T01:52:00.800 INFO:tasks.workunit.client.1.smithi092.stdout:7/201: dread - d3/d2b/d37/f46 zero size 2024-09-17T01:52:00.801 INFO:tasks.workunit.client.0.smithi031.stdout:1/336: truncate d4/d1e/d3f/f60 408978 0 2024-09-17T01:52:00.802 INFO:tasks.workunit.client.0.smithi031.stdout:2/319: truncate d1/d4c/f73 559292 0 2024-09-17T01:52:00.803 INFO:tasks.workunit.client.1.smithi092.stdout:5/100: truncate d0/f7 1503528 0 2024-09-17T01:52:00.804 INFO:tasks.workunit.client.1.smithi092.stdout:1/101: mkdir db/d1d/d23 0 2024-09-17T01:52:00.804 INFO:tasks.workunit.client.0.smithi031.stdout:1/337: write d4/d1a/d43/f4c [2676298,71281] 0 2024-09-17T01:52:00.804 INFO:tasks.workunit.client.0.smithi031.stdout:4/410: rename d8/c12 to d8/d3a/d7e/c82 0 2024-09-17T01:52:00.804 INFO:tasks.workunit.client.0.smithi031.stdout:5/280: symlink da/dc/d25/l5e 0 2024-09-17T01:52:00.805 INFO:tasks.workunit.client.0.smithi031.stdout:3/231: creat db/df/d1d/f49 x:0 0 0 2024-09-17T01:52:00.806 INFO:tasks.workunit.client.1.smithi092.stdout:6/148: getdents d3/d10/d1f/d21/d28 0 2024-09-17T01:52:00.807 INFO:tasks.workunit.client.0.smithi031.stdout:3/232: dread - db/f42 zero size 2024-09-17T01:52:00.807 INFO:tasks.workunit.client.0.smithi031.stdout:1/338: fsync d4/d1a/d2d/d18/f1c 0 2024-09-17T01:52:00.808 INFO:tasks.workunit.client.1.smithi092.stdout:7/202: mknod d3/d6/d13/d21/d2e/c48 0 2024-09-17T01:52:00.809 INFO:tasks.workunit.client.0.smithi031.stdout:3/233: chown db/d29/d2f/l3b 11126 1 2024-09-17T01:52:00.809 INFO:tasks.workunit.client.1.smithi092.stdout:0/132: dwrite d3/da/f22 [0,4194304] 0 2024-09-17T01:52:00.809 INFO:tasks.workunit.client.0.smithi031.stdout:3/234: truncate db/f42 358685 0 2024-09-17T01:52:00.810 INFO:tasks.workunit.client.1.smithi092.stdout:0/133: dread - d3/da/f1e zero size 2024-09-17T01:52:00.810 INFO:tasks.workunit.client.0.smithi031.stdout:2/320: link d1/d3/d45/d4a/f57 d1/d3/df/d18/f76 0 2024-09-17T01:52:00.810 INFO:tasks.workunit.client.1.smithi092.stdout:1/102: symlink db/d1d/l24 0 2024-09-17T01:52:00.811 INFO:tasks.workunit.client.0.smithi031.stdout:8/337: dread d0/df/d19/d3d/f49 [0,4194304] 0 2024-09-17T01:52:00.811 INFO:tasks.workunit.client.1.smithi092.stdout:0/134: write d3/f6 [2966243,126070] 0 2024-09-17T01:52:00.811 INFO:tasks.workunit.client.1.smithi092.stdout:1/103: chown l9 88589 1 2024-09-17T01:52:00.812 INFO:tasks.workunit.client.0.smithi031.stdout:8/338: chown d0/df/dd 402 1 2024-09-17T01:52:00.812 INFO:tasks.workunit.client.0.smithi031.stdout:8/339: stat d0/df/dd 0 2024-09-17T01:52:00.813 INFO:tasks.workunit.client.1.smithi092.stdout:6/149: fdatasync f1 0 2024-09-17T01:52:00.814 INFO:tasks.workunit.client.1.smithi092.stdout:0/135: write d3/da/f22 [641378,91755] 0 2024-09-17T01:52:00.815 INFO:tasks.workunit.client.1.smithi092.stdout:0/136: chown d3/da/d1c 334 1 2024-09-17T01:52:00.816 INFO:tasks.workunit.client.1.smithi092.stdout:6/150: chown d3/dd/l14 2418084 1 2024-09-17T01:52:00.818 INFO:tasks.workunit.client.0.smithi031.stdout:3/235: rename db/d29/d2f to db/df/d1d/d37/d4a 0 2024-09-17T01:52:00.818 INFO:tasks.workunit.client.1.smithi092.stdout:7/203: write d3/db/d18/f41 [789249,127452] 0 2024-09-17T01:52:00.821 INFO:tasks.workunit.client.1.smithi092.stdout:1/104: write db/f1f [817392,85983] 0 2024-09-17T01:52:00.822 INFO:tasks.workunit.client.0.smithi031.stdout:8/340: dwrite d0/df/d19/f29 [0,4194304] 0 2024-09-17T01:52:00.822 INFO:tasks.workunit.client.1.smithi092.stdout:0/137: unlink d3/da/ld 0 2024-09-17T01:52:00.823 INFO:tasks.workunit.client.0.smithi031.stdout:4/411: link d8/d3a/d41/d64/l46 d8/d3a/d41/d64/d4d/d5a/d79/l83 0 2024-09-17T01:52:00.824 INFO:tasks.workunit.client.0.smithi031.stdout:3/236: dread db/df/d1d/d37/f3f [0,4194304] 0 2024-09-17T01:52:00.824 INFO:tasks.workunit.client.1.smithi092.stdout:7/204: symlink d3/d2b/d37/l49 0 2024-09-17T01:52:00.825 INFO:tasks.workunit.client.0.smithi031.stdout:3/237: dread - db/f41 zero size 2024-09-17T01:52:00.826 INFO:tasks.workunit.client.1.smithi092.stdout:0/138: creat d3/f27 x:0 0 0 2024-09-17T01:52:00.828 INFO:tasks.workunit.client.0.smithi031.stdout:2/321: rename d1/d3/df/d18/d40/d43/f6f to d1/d3/d2d/d71/f77 0 2024-09-17T01:52:00.828 INFO:tasks.workunit.client.1.smithi092.stdout:1/105: creat db/d1d/d23/f25 x:0 0 0 2024-09-17T01:52:00.829 INFO:tasks.workunit.client.0.smithi031.stdout:3/238: truncate db/f34 368574 0 2024-09-17T01:52:00.834 INFO:tasks.workunit.client.1.smithi092.stdout:1/106: fdatasync db/d1d/f22 0 2024-09-17T01:52:00.834 INFO:tasks.workunit.client.0.smithi031.stdout:6/424: write d23/d50/f53 [2367430,86976] 0 2024-09-17T01:52:00.834 INFO:tasks.workunit.client.0.smithi031.stdout:5/281: dread da/d42/d12/f23 [0,4194304] 0 2024-09-17T01:52:00.835 INFO:tasks.workunit.client.0.smithi031.stdout:4/412: symlink d8/d3a/d41/d64/l84 0 2024-09-17T01:52:00.836 INFO:tasks.workunit.client.1.smithi092.stdout:1/107: write db/f1a [1261126,62318] 0 2024-09-17T01:52:00.836 INFO:tasks.workunit.client.1.smithi092.stdout:0/139: dwrite d3/f1f [0,4194304] 0 2024-09-17T01:52:00.837 INFO:tasks.workunit.client.1.smithi092.stdout:6/151: dread f2 [0,4194304] 0 2024-09-17T01:52:00.838 INFO:tasks.workunit.client.0.smithi031.stdout:2/322: creat d1/d3/d45/f78 x:0 0 0 2024-09-17T01:52:00.838 INFO:tasks.workunit.client.0.smithi031.stdout:2/323: chown d1 3 1 2024-09-17T01:52:00.839 INFO:tasks.workunit.client.1.smithi092.stdout:0/140: write d3/da/d15/f19 [2467100,26460] 0 2024-09-17T01:52:00.839 INFO:tasks.workunit.client.1.smithi092.stdout:0/141: chown d3/d1d 11704 1 2024-09-17T01:52:00.839 INFO:tasks.workunit.client.0.smithi031.stdout:2/324: dread - d1/d3/df/d18/f3b zero size 2024-09-17T01:52:00.840 INFO:tasks.workunit.client.0.smithi031.stdout:3/239: creat db/df/d1d/d37/f4b x:0 0 0 2024-09-17T01:52:00.841 INFO:tasks.workunit.client.1.smithi092.stdout:1/108: mknod db/d1d/c26 0 2024-09-17T01:52:00.841 INFO:tasks.workunit.client.1.smithi092.stdout:1/109: dread - db/f14 zero size 2024-09-17T01:52:00.843 INFO:tasks.workunit.client.1.smithi092.stdout:0/142: creat d3/f28 x:0 0 0 2024-09-17T01:52:00.844 INFO:tasks.workunit.client.0.smithi031.stdout:1/339: write d4/d1a/d2d/f68 [2280684,20966] 0 2024-09-17T01:52:00.845 INFO:tasks.workunit.client.0.smithi031.stdout:5/282: mknod da/d4b/c5f 0 2024-09-17T01:52:00.845 INFO:tasks.workunit.client.1.smithi092.stdout:1/110: symlink db/l27 0 2024-09-17T01:52:00.846 INFO:tasks.workunit.client.0.smithi031.stdout:4/413: fdatasync d8/d22/d25/f26 0 2024-09-17T01:52:00.846 INFO:tasks.workunit.client.1.smithi092.stdout:1/111: chown db/l1c 167 1 2024-09-17T01:52:00.846 INFO:tasks.workunit.client.0.smithi031.stdout:5/283: read - da/dc/d2e/f4c zero size 2024-09-17T01:52:00.846 INFO:tasks.workunit.client.0.smithi031.stdout:8/341: truncate d0/d5/f11 679490 0 2024-09-17T01:52:00.848 INFO:tasks.workunit.client.1.smithi092.stdout:6/152: link d3/d10/d1a/f24 d3/d10/d1f/d21/d28/f2c 0 2024-09-17T01:52:00.849 INFO:tasks.workunit.client.0.smithi031.stdout:4/414: chown d8/c17 6187 1 2024-09-17T01:52:00.849 INFO:tasks.workunit.client.1.smithi092.stdout:1/112: mkdir db/d1d/d28 0 2024-09-17T01:52:00.849 INFO:tasks.workunit.client.0.smithi031.stdout:2/325: creat d1/d3/df/d18/d40/d43/f79 x:0 0 0 2024-09-17T01:52:00.850 INFO:tasks.workunit.client.0.smithi031.stdout:8/342: truncate d0/df/d19/f33 9197144 0 2024-09-17T01:52:00.850 INFO:tasks.workunit.client.0.smithi031.stdout:5/284: write da/d42/f51 [361477,111974] 0 2024-09-17T01:52:00.851 INFO:tasks.workunit.client.1.smithi092.stdout:6/153: rename d3/d10/d1a/d26 to d3/d10/d1a/d2d 0 2024-09-17T01:52:00.852 INFO:tasks.workunit.client.1.smithi092.stdout:6/154: chown d3/d25 6 1 2024-09-17T01:52:00.852 INFO:tasks.workunit.client.0.smithi031.stdout:6/425: unlink c17 0 2024-09-17T01:52:00.852 INFO:tasks.workunit.client.1.smithi092.stdout:6/155: fsync d3/f6 0 2024-09-17T01:52:00.853 INFO:tasks.workunit.client.1.smithi092.stdout:7/205: write d3/db/f17 [1031867,110205] 0 2024-09-17T01:52:00.853 INFO:tasks.workunit.client.0.smithi031.stdout:4/415: readlink d8/d22/d25/d36/d4c/d52/l62 0 2024-09-17T01:52:00.853 INFO:tasks.workunit.client.0.smithi031.stdout:2/326: fsync d1/d3/df/d11/d30/f4d 0 2024-09-17T01:52:00.854 INFO:tasks.workunit.client.1.smithi092.stdout:1/113: mkdir db/d1d/d29 0 2024-09-17T01:52:00.854 INFO:tasks.workunit.client.0.smithi031.stdout:1/340: symlink d4/d1a/d2d/d18/d52/l6d 0 2024-09-17T01:52:00.855 INFO:tasks.workunit.client.1.smithi092.stdout:1/114: dread - db/f14 zero size 2024-09-17T01:52:00.855 INFO:tasks.workunit.client.1.smithi092.stdout:0/143: getdents d3/da/d1c 0 2024-09-17T01:52:00.856 INFO:tasks.workunit.client.0.smithi031.stdout:2/327: fdatasync d1/d3/df/d11/f2f 0 2024-09-17T01:52:00.856 INFO:tasks.workunit.client.0.smithi031.stdout:1/341: chown d4/d3d/f5a 62 1 2024-09-17T01:52:00.857 INFO:tasks.workunit.client.1.smithi092.stdout:7/206: dread d3/d2b/d3a/f3e [0,4194304] 0 2024-09-17T01:52:00.858 INFO:tasks.workunit.client.1.smithi092.stdout:6/156: dread d3/d10/f20 [0,4194304] 0 2024-09-17T01:52:00.859 INFO:tasks.workunit.client.0.smithi031.stdout:8/343: dread d0/d5/fa [0,4194304] 0 2024-09-17T01:52:00.860 INFO:tasks.workunit.client.1.smithi092.stdout:0/144: link d3/da/d15/f19 d3/da/f29 0 2024-09-17T01:52:00.861 INFO:tasks.workunit.client.0.smithi031.stdout:6/426: creat d23/d50/d6a/d70/f88 x:0 0 0 2024-09-17T01:52:00.861 INFO:tasks.workunit.client.1.smithi092.stdout:0/145: dread - d3/f28 zero size 2024-09-17T01:52:00.861 INFO:tasks.workunit.client.1.smithi092.stdout:7/207: creat d3/db/f4a x:0 0 0 2024-09-17T01:52:00.862 INFO:tasks.workunit.client.1.smithi092.stdout:0/146: dread - d3/f27 zero size 2024-09-17T01:52:00.863 INFO:tasks.workunit.client.1.smithi092.stdout:6/157: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:00.863 INFO:tasks.workunit.client.1.smithi092.stdout:1/115: rmdir db/d1d/d28 0 2024-09-17T01:52:00.865 INFO:tasks.workunit.client.1.smithi092.stdout:7/208: dread d3/db/d18/f20 [0,4194304] 0 2024-09-17T01:52:00.865 INFO:tasks.workunit.client.1.smithi092.stdout:0/147: creat d3/da/f2a x:0 0 0 2024-09-17T01:52:00.866 INFO:tasks.workunit.client.1.smithi092.stdout:7/209: chown d3/d6/d13/c32 3 1 2024-09-17T01:52:00.866 INFO:tasks.workunit.client.0.smithi031.stdout:2/328: rename d1/d3/d2d/f41 to d1/d3/df/d11/d30/f7a 0 2024-09-17T01:52:00.868 INFO:tasks.workunit.client.0.smithi031.stdout:4/416: mknod d8/d22/d25/d65/c85 0 2024-09-17T01:52:00.868 INFO:tasks.workunit.client.1.smithi092.stdout:0/148: unlink d3/da/f29 0 2024-09-17T01:52:00.869 INFO:tasks.workunit.client.1.smithi092.stdout:1/116: truncate db/fd 1653032 0 2024-09-17T01:52:00.869 INFO:tasks.workunit.client.1.smithi092.stdout:7/210: fsync d3/f14 0 2024-09-17T01:52:00.871 INFO:tasks.workunit.client.0.smithi031.stdout:1/342: mknod d4/d3d/d65/c6e 0 2024-09-17T01:52:00.872 INFO:tasks.workunit.client.1.smithi092.stdout:0/149: mknod d3/da/d15/c2b 0 2024-09-17T01:52:00.875 INFO:tasks.workunit.client.0.smithi031.stdout:6/427: rename c1 to d23/d50/d64/d67/c89 0 2024-09-17T01:52:00.876 INFO:tasks.workunit.client.0.smithi031.stdout:5/285: getdents da/d42 0 2024-09-17T01:52:00.877 INFO:tasks.workunit.client.0.smithi031.stdout:3/240: truncate db/f34 325029 0 2024-09-17T01:52:00.877 INFO:tasks.workunit.client.1.smithi092.stdout:1/117: dwrite f6 [0,4194304] 0 2024-09-17T01:52:00.878 INFO:tasks.workunit.client.0.smithi031.stdout:3/241: write db/f41 [698348,35243] 0 2024-09-17T01:52:00.879 INFO:tasks.workunit.client.0.smithi031.stdout:4/417: mkdir d8/d3a/d41/d64/d86 0 2024-09-17T01:52:00.880 INFO:tasks.workunit.client.1.smithi092.stdout:0/150: symlink d3/da/l2c 0 2024-09-17T01:52:00.881 INFO:tasks.workunit.client.0.smithi031.stdout:1/343: dread d4/d1e/f4f [0,4194304] 0 2024-09-17T01:52:00.882 INFO:tasks.workunit.client.1.smithi092.stdout:4/65: sync 2024-09-17T01:52:00.884 INFO:tasks.workunit.client.0.smithi031.stdout:6/428: mkdir d23/d50/d8a 0 2024-09-17T01:52:00.885 INFO:tasks.workunit.client.0.smithi031.stdout:6/429: chown d23/f42 7265 1 2024-09-17T01:52:00.885 INFO:tasks.workunit.client.0.smithi031.stdout:5/286: fsync da/dc/f3a 0 2024-09-17T01:52:00.886 INFO:tasks.workunit.client.1.smithi092.stdout:4/66: creat d4/f12 x:0 0 0 2024-09-17T01:52:00.889 INFO:tasks.workunit.client.1.smithi092.stdout:0/151: rename d3/da/c1b to d3/da/d1c/c2d 0 2024-09-17T01:52:00.890 INFO:tasks.workunit.client.1.smithi092.stdout:4/67: mkdir d4/d13 0 2024-09-17T01:52:00.892 INFO:tasks.workunit.client.0.smithi031.stdout:4/418: rename d8/d3a/d41/d64/c1e to d8/d22/d25/d65/c87 0 2024-09-17T01:52:00.892 INFO:tasks.workunit.client.1.smithi092.stdout:6/158: dwrite d3/d10/d1a/f24 [0,4194304] 0 2024-09-17T01:52:00.893 INFO:tasks.workunit.client.0.smithi031.stdout:7/274: sync 2024-09-17T01:52:00.894 INFO:tasks.workunit.client.1.smithi092.stdout:1/118: getdents db 0 2024-09-17T01:52:00.895 INFO:tasks.workunit.client.0.smithi031.stdout:7/275: chown db/l3f 1796 1 2024-09-17T01:52:00.895 INFO:tasks.workunit.client.0.smithi031.stdout:1/344: creat d4/d1e/d3f/d4d/f6f x:0 0 0 2024-09-17T01:52:00.897 INFO:tasks.workunit.client.1.smithi092.stdout:0/152: unlink d3/l8 0 2024-09-17T01:52:00.899 INFO:tasks.workunit.client.1.smithi092.stdout:4/68: unlink d4/f12 0 2024-09-17T01:52:00.900 INFO:tasks.workunit.client.0.smithi031.stdout:2/329: getdents d1/d3/df/d11/d30 0 2024-09-17T01:52:00.900 INFO:tasks.workunit.client.1.smithi092.stdout:7/211: write d3/db/d18/f2c [745879,40498] 0 2024-09-17T01:52:00.901 INFO:tasks.workunit.client.0.smithi031.stdout:7/276: truncate db/d1c/d41/f4b 382074 0 2024-09-17T01:52:00.902 INFO:tasks.workunit.client.0.smithi031.stdout:4/419: dread d8/d3a/d41/d64/f24 [0,4194304] 0 2024-09-17T01:52:00.903 INFO:tasks.workunit.client.1.smithi092.stdout:1/119: creat db/d1d/f2a x:0 0 0 2024-09-17T01:52:00.903 INFO:tasks.workunit.client.0.smithi031.stdout:1/345: dread d4/f4a [0,4194304] 0 2024-09-17T01:52:00.903 INFO:tasks.workunit.client.0.smithi031.stdout:7/277: write db/d29/f49 [106067,86484] 0 2024-09-17T01:52:00.904 INFO:tasks.workunit.client.0.smithi031.stdout:2/330: symlink d1/d3/df/d18/d40/d43/l7b 0 2024-09-17T01:52:00.906 INFO:tasks.workunit.client.0.smithi031.stdout:4/420: write d8/d3a/d41/d64/f2d [1182953,69903] 0 2024-09-17T01:52:00.907 INFO:tasks.workunit.client.0.smithi031.stdout:5/287: getdents da/dc/d2e 0 2024-09-17T01:52:00.907 INFO:tasks.workunit.client.1.smithi092.stdout:0/153: dwrite d3/da/f22 [0,4194304] 0 2024-09-17T01:52:00.909 INFO:tasks.workunit.client.0.smithi031.stdout:3/242: dread db/f11 [0,4194304] 0 2024-09-17T01:52:00.913 INFO:tasks.workunit.client.1.smithi092.stdout:6/159: creat d3/d10/d1f/d21/d28/d2b/f2e x:0 0 0 2024-09-17T01:52:00.913 INFO:tasks.workunit.client.1.smithi092.stdout:4/69: dwrite f2 [0,4194304] 0 2024-09-17T01:52:00.917 INFO:tasks.workunit.client.1.smithi092.stdout:1/120: rename db/f1f to db/f2b 0 2024-09-17T01:52:00.917 INFO:tasks.workunit.client.0.smithi031.stdout:3/243: stat db/df/f1e 0 2024-09-17T01:52:00.917 INFO:tasks.workunit.client.0.smithi031.stdout:4/421: dwrite d8/d22/f30 [0,4194304] 0 2024-09-17T01:52:00.918 INFO:tasks.workunit.client.1.smithi092.stdout:0/154: mkdir d3/d2e 0 2024-09-17T01:52:00.921 INFO:tasks.workunit.client.1.smithi092.stdout:4/70: dread f2 [0,4194304] 0 2024-09-17T01:52:00.924 INFO:tasks.workunit.client.1.smithi092.stdout:6/160: creat d3/d10/d1f/d21/d28/f2f x:0 0 0 2024-09-17T01:52:00.924 INFO:tasks.workunit.client.1.smithi092.stdout:7/212: creat d3/f4b x:0 0 0 2024-09-17T01:52:00.924 INFO:tasks.workunit.client.1.smithi092.stdout:1/121: fsync db/d1d/f22 0 2024-09-17T01:52:00.926 INFO:tasks.workunit.client.0.smithi031.stdout:6/430: dwrite d23/f2e [0,4194304] 0 2024-09-17T01:52:00.926 INFO:tasks.workunit.client.1.smithi092.stdout:6/161: fsync d3/f15 0 2024-09-17T01:52:00.927 INFO:tasks.workunit.client.1.smithi092.stdout:4/71: mknod d4/d5/c14 0 2024-09-17T01:52:00.927 INFO:tasks.workunit.client.0.smithi031.stdout:2/331: write d1/f23 [4367778,129107] 0 2024-09-17T01:52:00.928 INFO:tasks.workunit.client.0.smithi031.stdout:6/431: write d23/f35 [1800521,68120] 0 2024-09-17T01:52:00.932 INFO:tasks.workunit.client.1.smithi092.stdout:7/213: rename d3/d2b/d37/f46 to d3/d2b/f4c 0 2024-09-17T01:52:00.933 INFO:tasks.workunit.client.0.smithi031.stdout:5/288: truncate da/d42/d12/f19 3210138 0 2024-09-17T01:52:00.933 INFO:tasks.workunit.client.0.smithi031.stdout:7/278: dread db/d1c/d41/f44 [0,4194304] 0 2024-09-17T01:52:00.933 INFO:tasks.workunit.client.1.smithi092.stdout:4/72: creat d4/d5/f15 x:0 0 0 2024-09-17T01:52:00.934 INFO:tasks.workunit.client.0.smithi031.stdout:3/244: creat db/df/d1d/f4c x:0 0 0 2024-09-17T01:52:00.935 INFO:tasks.workunit.client.0.smithi031.stdout:3/245: chown db/df/d1d/f48 24227 1 2024-09-17T01:52:00.936 INFO:tasks.workunit.client.1.smithi092.stdout:0/155: truncate d3/da/d15/f19 2214709 0 2024-09-17T01:52:00.937 INFO:tasks.workunit.client.0.smithi031.stdout:4/422: rename d8/c1b to d8/d3a/d41/c88 0 2024-09-17T01:52:00.938 INFO:tasks.workunit.client.0.smithi031.stdout:5/289: creat da/d42/d12/d4a/f60 x:0 0 0 2024-09-17T01:52:00.939 INFO:tasks.workunit.client.0.smithi031.stdout:7/279: mknod db/d1c/d41/c53 0 2024-09-17T01:52:00.939 INFO:tasks.workunit.client.1.smithi092.stdout:0/156: rename d3/l13 to d3/l2f 0 2024-09-17T01:52:00.940 INFO:tasks.workunit.client.0.smithi031.stdout:3/246: creat db/df/d1d/d37/f4d x:0 0 0 2024-09-17T01:52:00.941 INFO:tasks.workunit.client.0.smithi031.stdout:4/423: fsync d8/d3a/d41/d64/d4d/d5a/f6e 0 2024-09-17T01:52:00.944 INFO:tasks.workunit.client.1.smithi092.stdout:6/162: dread d3/f6 [0,4194304] 0 2024-09-17T01:52:00.945 INFO:tasks.workunit.client.0.smithi031.stdout:2/332: rename d1/d3/df/d18/d5d to d1/d7c 0 2024-09-17T01:52:00.945 INFO:tasks.workunit.client.1.smithi092.stdout:6/163: truncate d3/d10/d1f/d21/d28/d2b/f2e 564521 0 2024-09-17T01:52:00.946 INFO:tasks.workunit.client.1.smithi092.stdout:6/164: truncate d3/d10/f20 5544686 0 2024-09-17T01:52:00.946 INFO:tasks.workunit.client.0.smithi031.stdout:4/424: truncate d8/d3a/d41/d64/f2f 446378 0 2024-09-17T01:52:00.947 INFO:tasks.workunit.client.0.smithi031.stdout:7/280: dwrite db/d29/f49 [0,4194304] 0 2024-09-17T01:52:00.947 INFO:tasks.workunit.client.0.smithi031.stdout:2/333: read - d1/d3/d45/d4a/f6d zero size 2024-09-17T01:52:00.947 INFO:tasks.workunit.client.1.smithi092.stdout:6/165: getdents d3/d10/d1a/d2d 0 2024-09-17T01:52:00.948 INFO:tasks.workunit.client.0.smithi031.stdout:1/346: dread d4/d1a/d43/f4c [0,4194304] 0 2024-09-17T01:52:00.949 INFO:tasks.workunit.client.0.smithi031.stdout:4/425: read f5 [226580,103499] 0 2024-09-17T01:52:00.951 INFO:tasks.workunit.client.0.smithi031.stdout:7/281: creat db/d29/f54 x:0 0 0 2024-09-17T01:52:00.951 INFO:tasks.workunit.client.0.smithi031.stdout:4/426: readlink d8/d22/d25/d36/d4c/d61/l67 0 2024-09-17T01:52:00.952 INFO:tasks.workunit.client.0.smithi031.stdout:2/334: mkdir d1/d3/df/d11/d30/d7d 0 2024-09-17T01:52:00.954 INFO:tasks.workunit.client.0.smithi031.stdout:1/347: creat d4/d1e/f70 x:0 0 0 2024-09-17T01:52:00.955 INFO:tasks.workunit.client.0.smithi031.stdout:2/335: creat d1/d3/df/d18/d40/f7e x:0 0 0 2024-09-17T01:52:00.956 INFO:tasks.workunit.client.0.smithi031.stdout:1/348: write d4/d1e/d40/f54 [820115,39799] 0 2024-09-17T01:52:00.957 INFO:tasks.workunit.client.0.smithi031.stdout:2/336: stat d1/d3/df/d19/l3f 0 2024-09-17T01:52:00.961 INFO:tasks.workunit.client.0.smithi031.stdout:1/349: dread d4/d1a/d2d/d18/f39 [0,4194304] 0 2024-09-17T01:52:00.963 INFO:tasks.workunit.client.0.smithi031.stdout:2/337: mkdir d1/d3/df/d19/d1e/d2a/d7f 0 2024-09-17T01:52:00.963 INFO:tasks.workunit.client.0.smithi031.stdout:2/338: chown d1/d3/df/d11/d30 500 1 2024-09-17T01:52:00.966 INFO:tasks.workunit.client.0.smithi031.stdout:4/427: rename d8/d3a/d41/c88 to d8/d3a/d41/d64/d4d/d5a/c89 0 2024-09-17T01:52:00.968 INFO:tasks.workunit.client.0.smithi031.stdout:4/428: chown d8/d3a/d41/d64/f21 7237 1 2024-09-17T01:52:00.970 INFO:tasks.workunit.client.0.smithi031.stdout:2/339: unlink d1/d3/df/d18/f76 0 2024-09-17T01:52:00.973 INFO:tasks.workunit.client.0.smithi031.stdout:1/350: mknod d4/d1a/c71 0 2024-09-17T01:52:00.973 INFO:tasks.workunit.client.0.smithi031.stdout:4/429: dread d8/f16 [0,4194304] 0 2024-09-17T01:52:00.979 INFO:tasks.workunit.client.0.smithi031.stdout:2/340: symlink d1/d3/df/d18/l80 0 2024-09-17T01:52:00.981 INFO:tasks.workunit.client.0.smithi031.stdout:4/430: dwrite d8/d22/d25/d36/f66 [0,4194304] 0 2024-09-17T01:52:00.983 INFO:tasks.workunit.client.0.smithi031.stdout:7/282: dread db/f15 [0,4194304] 0 2024-09-17T01:52:00.984 INFO:tasks.workunit.client.0.smithi031.stdout:2/341: unlink d1/d3/d45/d4a/f6c 0 2024-09-17T01:52:00.984 INFO:tasks.workunit.client.0.smithi031.stdout:7/283: chown db/f15 75 1 2024-09-17T01:52:00.985 INFO:tasks.workunit.client.0.smithi031.stdout:4/431: fsync d8/f2b 0 2024-09-17T01:52:00.989 INFO:tasks.workunit.client.0.smithi031.stdout:7/284: symlink db/d1c/l55 0 2024-09-17T01:52:00.991 INFO:tasks.workunit.client.0.smithi031.stdout:7/285: fsync db/d1c/f21 0 2024-09-17T01:52:00.993 INFO:tasks.workunit.client.0.smithi031.stdout:1/351: truncate d4/d1a/f33 717878 0 2024-09-17T01:52:00.994 INFO:tasks.workunit.client.0.smithi031.stdout:7/286: read - db/d18/f48 zero size 2024-09-17T01:52:00.994 INFO:tasks.workunit.client.0.smithi031.stdout:2/342: dwrite d1/d3/df/d11/f26 [0,4194304] 0 2024-09-17T01:52:00.996 INFO:tasks.workunit.client.0.smithi031.stdout:7/287: read - db/f51 zero size 2024-09-17T01:52:00.997 INFO:tasks.workunit.client.0.smithi031.stdout:1/352: mkdir d4/d1e/d3f/d72 0 2024-09-17T01:52:00.997 INFO:tasks.workunit.client.0.smithi031.stdout:4/432: dwrite d8/d3a/d41/d64/f21 [0,4194304] 0 2024-09-17T01:52:01.001 INFO:tasks.workunit.client.0.smithi031.stdout:2/343: mknod d1/d3/d2d/c81 0 2024-09-17T01:52:01.005 INFO:tasks.workunit.client.0.smithi031.stdout:1/353: creat d4/d1a/d43/d53/f73 x:0 0 0 2024-09-17T01:52:01.008 INFO:tasks.workunit.client.0.smithi031.stdout:2/344: creat d1/d3/df/d11/d30/f82 x:0 0 0 2024-09-17T01:52:01.011 INFO:tasks.workunit.client.0.smithi031.stdout:7/288: dwrite db/f15 [0,4194304] 0 2024-09-17T01:52:01.012 INFO:tasks.workunit.client.0.smithi031.stdout:4/433: getdents d8/d22/d25/d36/d4c/d61 0 2024-09-17T01:52:01.017 INFO:tasks.workunit.client.0.smithi031.stdout:2/345: creat d1/d3/d2d/d42/f83 x:0 0 0 2024-09-17T01:52:01.018 INFO:tasks.workunit.client.0.smithi031.stdout:7/289: mknod db/d1c/d41/c56 0 2024-09-17T01:52:01.019 INFO:tasks.workunit.client.0.smithi031.stdout:1/354: dwrite d4/d1e/f42 [0,4194304] 0 2024-09-17T01:52:01.021 INFO:tasks.workunit.client.0.smithi031.stdout:7/290: truncate db/d1c/d46/f52 447326 0 2024-09-17T01:52:01.026 INFO:tasks.workunit.client.0.smithi031.stdout:4/434: rename d8/d3a/d41/d64/l84 to d8/d3a/l8a 0 2024-09-17T01:52:01.029 INFO:tasks.workunit.client.0.smithi031.stdout:1/355: dwrite d4/d1e/d40/f54 [0,4194304] 0 2024-09-17T01:52:01.029 INFO:tasks.workunit.client.0.smithi031.stdout:7/291: write db/d29/f54 [572079,40590] 0 2024-09-17T01:52:01.030 INFO:tasks.workunit.client.0.smithi031.stdout:2/346: write d1/d3/df/d19/f1d [4764399,20507] 0 2024-09-17T01:52:01.034 INFO:tasks.workunit.client.0.smithi031.stdout:7/292: write db/f3a [290756,106971] 0 2024-09-17T01:52:01.039 INFO:tasks.workunit.client.0.smithi031.stdout:2/347: link d1/d3/f25 d1/d3/df/d19/d1e/d21/f84 0 2024-09-17T01:52:01.040 INFO:tasks.workunit.client.1.smithi092.stdout:1/122: fsync db/f2b 0 2024-09-17T01:52:01.041 INFO:tasks.workunit.client.1.smithi092.stdout:4/73: truncate d4/fc 342637 0 2024-09-17T01:52:01.041 INFO:tasks.workunit.client.1.smithi092.stdout:0/157: truncate d3/f5 686568 0 2024-09-17T01:52:01.042 INFO:tasks.workunit.client.1.smithi092.stdout:4/74: readlink d4/lf 0 2024-09-17T01:52:01.042 INFO:tasks.workunit.client.0.smithi031.stdout:7/293: dwrite db/fe [0,4194304] 0 2024-09-17T01:52:01.042 INFO:tasks.workunit.client.0.smithi031.stdout:2/348: write d1/d3/df/d18/d40/d43/f6a [884222,23998] 0 2024-09-17T01:52:01.042 INFO:tasks.workunit.client.0.smithi031.stdout:1/356: dread d4/d1a/f1d [4194304,4194304] 0 2024-09-17T01:52:01.044 INFO:tasks.workunit.client.0.smithi031.stdout:1/357: write d4/d1e/f3b [539250,107702] 0 2024-09-17T01:52:01.045 INFO:tasks.workunit.client.1.smithi092.stdout:6/166: creat d3/d10/d1f/f30 x:0 0 0 2024-09-17T01:52:01.045 INFO:tasks.workunit.client.0.smithi031.stdout:7/294: mknod db/d1c/c57 0 2024-09-17T01:52:01.046 INFO:tasks.workunit.client.1.smithi092.stdout:6/167: chown d3/d10/d1f/d21/d1e 99197 1 2024-09-17T01:52:01.046 INFO:tasks.workunit.client.1.smithi092.stdout:1/123: mknod db/d1d/d23/c2c 0 2024-09-17T01:52:01.046 INFO:tasks.workunit.client.1.smithi092.stdout:6/168: fsync d3/fa 0 2024-09-17T01:52:01.047 INFO:tasks.workunit.client.0.smithi031.stdout:2/349: dread - d1/d3/d2d/d42/f83 zero size 2024-09-17T01:52:01.049 INFO:tasks.workunit.client.0.smithi031.stdout:2/350: readlink d1/d3/df/l36 0 2024-09-17T01:52:01.050 INFO:tasks.workunit.client.0.smithi031.stdout:7/295: fsync db/d1c/d41/f44 0 2024-09-17T01:52:01.053 INFO:tasks.workunit.client.0.smithi031.stdout:4/435: dwrite d8/d3a/d41/d64/d4d/f81 [0,4194304] 0 2024-09-17T01:52:01.054 INFO:tasks.workunit.client.0.smithi031.stdout:4/436: readlink d8/l20 0 2024-09-17T01:52:01.055 INFO:tasks.workunit.client.0.smithi031.stdout:2/351: symlink d1/d3/df/d66/l85 0 2024-09-17T01:52:01.067 INFO:tasks.workunit.client.0.smithi031.stdout:2/352: truncate d1/d3/df/d11/f26 2898411 0 2024-09-17T01:52:01.071 INFO:tasks.workunit.client.0.smithi031.stdout:2/353: dread - d1/d3/df/d11/d30/f82 zero size 2024-09-17T01:52:01.073 INFO:tasks.workunit.client.0.smithi031.stdout:4/437: dwrite d8/fb [0,4194304] 0 2024-09-17T01:52:01.076 INFO:tasks.workunit.client.0.smithi031.stdout:2/354: mknod d1/d3/d2d/d71/c86 0 2024-09-17T01:52:01.077 INFO:tasks.workunit.client.0.smithi031.stdout:2/355: stat d1/d3/d2d/f3c 0 2024-09-17T01:52:01.080 INFO:tasks.workunit.client.0.smithi031.stdout:4/438: rename d8/c17 to d8/d3a/d41/c8b 0 2024-09-17T01:52:01.083 INFO:tasks.workunit.client.0.smithi031.stdout:4/439: chown d8/d3a/d41/d64/d4d/c5c 6799419 1 2024-09-17T01:52:01.085 INFO:tasks.workunit.client.0.smithi031.stdout:2/356: link d1/d3/f4 d1/f87 0 2024-09-17T01:52:01.087 INFO:tasks.workunit.client.0.smithi031.stdout:4/440: unlink d8/d22/d25/l34 0 2024-09-17T01:52:01.087 INFO:tasks.workunit.client.0.smithi031.stdout:7/296: dread db/d18/f2f [0,4194304] 0 2024-09-17T01:52:01.091 INFO:tasks.workunit.client.0.smithi031.stdout:7/297: creat db/d29/f58 x:0 0 0 2024-09-17T01:52:01.093 INFO:tasks.workunit.client.0.smithi031.stdout:2/357: dread d1/d3/df/d11/d30/f37 [0,4194304] 0 2024-09-17T01:52:01.093 INFO:tasks.workunit.client.0.smithi031.stdout:7/298: dread db/d1c/d46/f52 [0,4194304] 0 2024-09-17T01:52:01.094 INFO:tasks.workunit.client.0.smithi031.stdout:2/358: write d1/d3/df/d19/d1e/f3e [1233740,123011] 0 2024-09-17T01:52:01.096 INFO:tasks.workunit.client.0.smithi031.stdout:7/299: creat db/d1c/d41/f59 x:0 0 0 2024-09-17T01:52:01.097 INFO:tasks.workunit.client.0.smithi031.stdout:2/359: mknod d1/d3/d2d/d71/c88 0 2024-09-17T01:52:01.098 INFO:tasks.workunit.client.0.smithi031.stdout:7/300: mknod db/d1c/d41/c5a 0 2024-09-17T01:52:01.101 INFO:tasks.workunit.client.0.smithi031.stdout:7/301: mknod db/d1c/d46/c5b 0 2024-09-17T01:52:01.104 INFO:tasks.workunit.client.0.smithi031.stdout:4/441: rename d8/d22 to d8/d3a/d41/d64/d4d/d5a/d8c 0 2024-09-17T01:52:01.105 INFO:tasks.workunit.client.0.smithi031.stdout:2/360: getdents d1/d3 0 2024-09-17T01:52:01.106 INFO:tasks.workunit.client.0.smithi031.stdout:7/302: rename db/d29/f49 to db/d1c/f5c 0 2024-09-17T01:52:01.107 INFO:tasks.workunit.client.0.smithi031.stdout:2/361: truncate d1/d3/df/d19/d1e/d21/f24 1874522 0 2024-09-17T01:52:01.108 INFO:tasks.workunit.client.0.smithi031.stdout:7/303: fdatasync db/d1c/d41/f4b 0 2024-09-17T01:52:01.108 INFO:tasks.workunit.client.0.smithi031.stdout:4/442: creat d8/d3a/d41/d64/f8d x:0 0 0 2024-09-17T01:52:01.109 INFO:tasks.workunit.client.0.smithi031.stdout:7/304: write db/f15 [2324609,14382] 0 2024-09-17T01:52:01.109 INFO:tasks.workunit.client.1.smithi092.stdout:2/124: sync 2024-09-17T01:52:01.111 INFO:tasks.workunit.client.1.smithi092.stdout:4/75: mknod d4/d5/c16 0 2024-09-17T01:52:01.111 INFO:tasks.workunit.client.0.smithi031.stdout:2/362: symlink d1/d3/df/d11/l89 0 2024-09-17T01:52:01.112 INFO:tasks.workunit.client.1.smithi092.stdout:6/169: dread d3/d10/d1f/d21/d28/d2b/f2e [0,4194304] 0 2024-09-17T01:52:01.112 INFO:tasks.workunit.client.1.smithi092.stdout:4/76: chown d4/d5/d8 43 1 2024-09-17T01:52:01.112 INFO:tasks.workunit.client.0.smithi031.stdout:4/443: write d8/fc [2705718,86853] 0 2024-09-17T01:52:01.113 INFO:tasks.workunit.client.1.smithi092.stdout:1/124: rename db/l21 to db/d1d/l2d 0 2024-09-17T01:52:01.113 INFO:tasks.workunit.client.0.smithi031.stdout:7/305: creat db/d29/f5d x:0 0 0 2024-09-17T01:52:01.113 INFO:tasks.workunit.client.1.smithi092.stdout:6/170: fsync d3/d10/d1f/d21/d28/f2f 0 2024-09-17T01:52:01.117 INFO:tasks.workunit.client.1.smithi092.stdout:6/171: mkdir d3/d31 0 2024-09-17T01:52:01.117 INFO:tasks.workunit.client.0.smithi031.stdout:7/306: write db/d1c/f5c [2416842,74809] 0 2024-09-17T01:52:01.117 INFO:tasks.workunit.client.1.smithi092.stdout:2/125: mknod d10/d1d/d24/c27 0 2024-09-17T01:52:01.118 INFO:tasks.workunit.client.1.smithi092.stdout:2/126: chown fe 7075 1 2024-09-17T01:52:01.118 INFO:tasks.workunit.client.1.smithi092.stdout:0/158: mkdir d3/da/d15/d30 0 2024-09-17T01:52:01.119 INFO:tasks.workunit.client.1.smithi092.stdout:4/77: truncate d4/fc 496975 0 2024-09-17T01:52:01.119 INFO:tasks.workunit.client.0.smithi031.stdout:2/363: truncate d1/d3/df/d11/f15 627121 0 2024-09-17T01:52:01.120 INFO:tasks.workunit.client.1.smithi092.stdout:1/125: truncate db/fd 381365 0 2024-09-17T01:52:01.120 INFO:tasks.workunit.client.1.smithi092.stdout:4/78: dread - d4/d5/f15 zero size 2024-09-17T01:52:01.121 INFO:tasks.workunit.client.1.smithi092.stdout:6/172: creat d3/d10/d1f/f32 x:0 0 0 2024-09-17T01:52:01.121 INFO:tasks.workunit.client.1.smithi092.stdout:4/79: stat d4/d5/d8/ca 0 2024-09-17T01:52:01.121 INFO:tasks.workunit.client.1.smithi092.stdout:4/80: chown d4 1836698 1 2024-09-17T01:52:01.122 INFO:tasks.workunit.client.1.smithi092.stdout:2/127: rename l6 to d10/l28 0 2024-09-17T01:52:01.122 INFO:tasks.workunit.client.0.smithi031.stdout:7/307: mknod db/d29/c5e 0 2024-09-17T01:52:01.122 INFO:tasks.workunit.client.0.smithi031.stdout:2/364: dread - d1/d3/df/d19/f28 zero size 2024-09-17T01:52:01.123 INFO:tasks.workunit.client.1.smithi092.stdout:2/128: readlink d10/d1d/l20 0 2024-09-17T01:52:01.123 INFO:tasks.workunit.client.1.smithi092.stdout:1/126: mkdir db/d1d/d2e 0 2024-09-17T01:52:01.124 INFO:tasks.workunit.client.0.smithi031.stdout:4/444: getdents d8/d3a/d41/d64/d4d/d5a/d79 0 2024-09-17T01:52:01.124 INFO:tasks.workunit.client.1.smithi092.stdout:1/127: write db/f14 [948265,84388] 0 2024-09-17T01:52:01.125 INFO:tasks.workunit.client.1.smithi092.stdout:6/173: creat d3/f33 x:0 0 0 2024-09-17T01:52:01.125 INFO:tasks.workunit.client.0.smithi031.stdout:2/365: mkdir d1/d3/df/d19/d1e/d21/d34/d8a 0 2024-09-17T01:52:01.127 INFO:tasks.workunit.client.1.smithi092.stdout:0/159: dread d3/f1f [0,4194304] 0 2024-09-17T01:52:01.127 INFO:tasks.workunit.client.0.smithi031.stdout:7/308: rename l4 to db/d1c/l5f 0 2024-09-17T01:52:01.128 INFO:tasks.workunit.client.1.smithi092.stdout:6/174: fsync f2 0 2024-09-17T01:52:01.128 INFO:tasks.workunit.client.0.smithi031.stdout:7/309: read db/f15 [2478793,35594] 0 2024-09-17T01:52:01.130 INFO:tasks.workunit.client.0.smithi031.stdout:4/445: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f8e x:0 0 0 2024-09-17T01:52:01.132 INFO:tasks.workunit.client.0.smithi031.stdout:7/310: dread db/f15 [4194304,4194304] 0 2024-09-17T01:52:01.133 INFO:tasks.workunit.client.0.smithi031.stdout:7/311: read - db/d1c/d41/f59 zero size 2024-09-17T01:52:01.134 INFO:tasks.workunit.client.1.smithi092.stdout:6/175: mknod d3/d10/d1a/c34 0 2024-09-17T01:52:01.134 INFO:tasks.workunit.client.0.smithi031.stdout:4/446: mkdir d8/d3a/d41/d64/d4d/d8f 0 2024-09-17T01:52:01.135 INFO:tasks.workunit.client.1.smithi092.stdout:4/81: rename d4/fc to d4/d13/f17 0 2024-09-17T01:52:01.135 INFO:tasks.workunit.client.1.smithi092.stdout:4/82: dread - d4/d5/f15 zero size 2024-09-17T01:52:01.136 INFO:tasks.workunit.client.0.smithi031.stdout:7/312: creat db/d1c/d46/f60 x:0 0 0 2024-09-17T01:52:01.136 INFO:tasks.workunit.client.1.smithi092.stdout:4/83: fsync d4/d5/f15 0 2024-09-17T01:52:01.136 INFO:tasks.workunit.client.1.smithi092.stdout:1/128: read db/fd [142224,50799] 0 2024-09-17T01:52:01.137 INFO:tasks.workunit.client.1.smithi092.stdout:1/129: fdatasync f6 0 2024-09-17T01:52:01.138 INFO:tasks.workunit.client.0.smithi031.stdout:4/447: unlink d8/d3a/d41/d64/d4d/d5a/d8c/f37 0 2024-09-17T01:52:01.140 INFO:tasks.workunit.client.0.smithi031.stdout:4/448: dread - d8/d3a/d41/d64/d4d/f71 zero size 2024-09-17T01:52:01.140 INFO:tasks.workunit.client.0.smithi031.stdout:7/313: dread db/d29/f54 [0,4194304] 0 2024-09-17T01:52:01.140 INFO:tasks.workunit.client.1.smithi092.stdout:0/160: mknod d3/c31 0 2024-09-17T01:52:01.141 INFO:tasks.workunit.client.0.smithi031.stdout:2/366: write d1/f5 [695120,60711] 0 2024-09-17T01:52:01.141 INFO:tasks.workunit.client.0.smithi031.stdout:7/314: fdatasync db/d1c/d46/f4f 0 2024-09-17T01:52:01.142 INFO:tasks.workunit.client.1.smithi092.stdout:6/176: symlink d3/dd/d19/l35 0 2024-09-17T01:52:01.143 INFO:tasks.workunit.client.1.smithi092.stdout:6/177: write d3/f13 [2624743,35088] 0 2024-09-17T01:52:01.143 INFO:tasks.workunit.client.1.smithi092.stdout:6/178: read f1 [792122,16900] 0 2024-09-17T01:52:01.144 INFO:tasks.workunit.client.0.smithi031.stdout:4/449: mknod d8/d3a/d41/d64/d4d/d5a/c90 0 2024-09-17T01:52:01.144 INFO:tasks.workunit.client.1.smithi092.stdout:6/179: truncate d3/f33 138589 0 2024-09-17T01:52:01.145 INFO:tasks.workunit.client.1.smithi092.stdout:4/84: symlink d4/d13/l18 0 2024-09-17T01:52:01.145 INFO:tasks.workunit.client.0.smithi031.stdout:7/315: creat db/d18/f61 x:0 0 0 2024-09-17T01:52:01.146 INFO:tasks.workunit.client.0.smithi031.stdout:7/316: read - db/d29/f4e zero size 2024-09-17T01:52:01.147 INFO:tasks.workunit.client.1.smithi092.stdout:2/129: getdents d10 0 2024-09-17T01:52:01.148 INFO:tasks.workunit.client.1.smithi092.stdout:0/161: stat d3/f27 0 2024-09-17T01:52:01.148 INFO:tasks.workunit.client.0.smithi031.stdout:2/367: rmdir d1/d3/df/d11/d30/d7d 0 2024-09-17T01:52:01.149 INFO:tasks.workunit.client.1.smithi092.stdout:0/162: write d3/da/f22 [2051373,96333] 0 2024-09-17T01:52:01.149 INFO:tasks.workunit.client.0.smithi031.stdout:4/450: dwrite d8/f16 [0,4194304] 0 2024-09-17T01:52:01.150 INFO:tasks.workunit.client.1.smithi092.stdout:6/180: unlink d3/le 0 2024-09-17T01:52:01.151 INFO:tasks.workunit.client.0.smithi031.stdout:2/368: creat d1/d3/d2d/f8b x:0 0 0 2024-09-17T01:52:01.153 INFO:tasks.workunit.client.1.smithi092.stdout:4/85: mkdir d4/d5/d8/d19 0 2024-09-17T01:52:01.154 INFO:tasks.workunit.client.0.smithi031.stdout:4/451: mkdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91 0 2024-09-17T01:52:01.155 INFO:tasks.workunit.client.1.smithi092.stdout:4/86: dread - d4/d5/fd zero size 2024-09-17T01:52:01.155 INFO:tasks.workunit.client.1.smithi092.stdout:2/130: chown d10/d15/c22 99 1 2024-09-17T01:52:01.158 INFO:tasks.workunit.client.1.smithi092.stdout:2/131: write d10/d15/f1b [330140,104508] 0 2024-09-17T01:52:01.159 INFO:tasks.workunit.client.1.smithi092.stdout:6/181: dwrite d3/f33 [0,4194304] 0 2024-09-17T01:52:01.159 INFO:tasks.workunit.client.0.smithi031.stdout:2/369: dwrite d1/d3/df/d11/d30/f4d [0,4194304] 0 2024-09-17T01:52:01.160 INFO:tasks.workunit.client.1.smithi092.stdout:1/130: link db/c20 db/d1d/d29/c2f 0 2024-09-17T01:52:01.162 INFO:tasks.workunit.client.1.smithi092.stdout:4/87: dread f2 [0,4194304] 0 2024-09-17T01:52:01.163 INFO:tasks.workunit.client.0.smithi031.stdout:2/370: write d1/d3/df/d11/d30/f37 [448927,20154] 0 2024-09-17T01:52:01.163 INFO:tasks.workunit.client.1.smithi092.stdout:4/88: chown d4/d13/l18 29309585 1 2024-09-17T01:52:01.168 INFO:tasks.workunit.client.1.smithi092.stdout:0/163: rename d3/f6 to d3/d1d/f32 0 2024-09-17T01:52:01.171 INFO:tasks.workunit.client.0.smithi031.stdout:4/452: stat d8/f3b 0 2024-09-17T01:52:01.175 INFO:tasks.workunit.client.1.smithi092.stdout:0/164: dread d3/da/f10 [0,4194304] 0 2024-09-17T01:52:01.175 INFO:tasks.workunit.client.1.smithi092.stdout:2/132: rename fa to d10/d1d/d24/f29 0 2024-09-17T01:52:01.176 INFO:tasks.workunit.client.0.smithi031.stdout:2/371: dread d1/d3/df/d19/f63 [0,4194304] 0 2024-09-17T01:52:01.177 INFO:tasks.workunit.client.1.smithi092.stdout:1/131: link db/d1d/d29/c2f db/d1d/c30 0 2024-09-17T01:52:01.177 INFO:tasks.workunit.client.1.smithi092.stdout:1/132: write f6 [3142920,48972] 0 2024-09-17T01:52:01.178 INFO:tasks.workunit.client.1.smithi092.stdout:6/182: write f2 [1215497,117121] 0 2024-09-17T01:52:01.179 INFO:tasks.workunit.client.1.smithi092.stdout:0/165: dread - d3/f28 zero size 2024-09-17T01:52:01.180 INFO:tasks.workunit.client.1.smithi092.stdout:0/166: chown d3/c31 971542091 1 2024-09-17T01:52:01.180 INFO:tasks.workunit.client.1.smithi092.stdout:2/133: creat d10/f2a x:0 0 0 2024-09-17T01:52:01.182 INFO:tasks.workunit.client.1.smithi092.stdout:1/133: rename c8 to db/d1d/d23/c31 0 2024-09-17T01:52:01.183 INFO:tasks.workunit.client.1.smithi092.stdout:6/183: readlink d3/l9 0 2024-09-17T01:52:01.184 INFO:tasks.workunit.client.1.smithi092.stdout:0/167: symlink d3/da/d1c/l33 0 2024-09-17T01:52:01.186 INFO:tasks.workunit.client.1.smithi092.stdout:2/134: rename d10/f23 to d10/d15/f2b 0 2024-09-17T01:52:01.187 INFO:tasks.workunit.client.1.smithi092.stdout:2/135: write d10/f12 [2915150,127341] 0 2024-09-17T01:52:01.188 INFO:tasks.workunit.client.1.smithi092.stdout:6/184: dread d3/dd/d18/f27 [0,4194304] 0 2024-09-17T01:52:01.189 INFO:tasks.workunit.client.1.smithi092.stdout:2/136: write d10/d15/f21 [4551786,21684] 0 2024-09-17T01:52:01.189 INFO:tasks.workunit.client.1.smithi092.stdout:6/185: stat d3/d10/f20 0 2024-09-17T01:52:01.192 INFO:tasks.workunit.client.1.smithi092.stdout:1/134: link db/f1a db/d1d/d2e/f32 0 2024-09-17T01:52:01.194 INFO:tasks.workunit.client.1.smithi092.stdout:1/135: rename db/d1d/d29 to db/d1d/d29/d33 22 2024-09-17T01:52:01.194 INFO:tasks.workunit.client.0.smithi031.stdout:2/372: dwrite d1/d3/df/d11/f13 [0,4194304] 0 2024-09-17T01:52:01.195 INFO:tasks.workunit.client.0.smithi031.stdout:2/373: stat d1/d3/f1c 0 2024-09-17T01:52:01.195 INFO:tasks.workunit.client.1.smithi092.stdout:1/136: dread - db/d1d/d23/f25 zero size 2024-09-17T01:52:01.196 INFO:tasks.workunit.client.1.smithi092.stdout:6/186: dwrite d3/f33 [0,4194304] 0 2024-09-17T01:52:01.197 INFO:tasks.workunit.client.1.smithi092.stdout:2/137: mkdir d10/d1d/d2c 0 2024-09-17T01:52:01.198 INFO:tasks.workunit.client.1.smithi092.stdout:6/187: chown f1 28955035 1 2024-09-17T01:52:01.198 INFO:tasks.workunit.client.0.smithi031.stdout:2/374: creat d1/d3/d45/f8c x:0 0 0 2024-09-17T01:52:01.199 INFO:tasks.workunit.client.1.smithi092.stdout:1/137: truncate db/d1d/d23/f25 77838 0 2024-09-17T01:52:01.200 INFO:tasks.workunit.client.1.smithi092.stdout:2/138: mkdir d10/d1d/d2d 0 2024-09-17T01:52:01.201 INFO:tasks.workunit.client.0.smithi031.stdout:2/375: write d1/d3/df/d11/d30/f4d [560414,98711] 0 2024-09-17T01:52:01.202 INFO:tasks.workunit.client.1.smithi092.stdout:6/188: creat d3/f36 x:0 0 0 2024-09-17T01:52:01.203 INFO:tasks.workunit.client.0.smithi031.stdout:4/453: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/f47 [8388608,4194304] 0 2024-09-17T01:52:01.204 INFO:tasks.workunit.client.1.smithi092.stdout:1/138: rmdir db 39 2024-09-17T01:52:01.204 INFO:tasks.workunit.client.1.smithi092.stdout:0/168: rmdir d3/da 39 2024-09-17T01:52:01.207 INFO:tasks.workunit.client.1.smithi092.stdout:2/139: unlink d10/d15/f25 0 2024-09-17T01:52:01.210 INFO:tasks.workunit.client.0.smithi031.stdout:4/454: rmdir d8/d3a/d41/d64/d4d/d5a/d79 39 2024-09-17T01:52:01.211 INFO:tasks.workunit.client.1.smithi092.stdout:6/189: rename d3/lc to d3/d10/d1f/d21/d28/l37 0 2024-09-17T01:52:01.212 INFO:tasks.workunit.client.0.smithi031.stdout:4/455: mkdir d8/d3a/d41/d64/d92 0 2024-09-17T01:52:01.215 INFO:tasks.workunit.client.0.smithi031.stdout:4/456: creat d8/d3a/d41/d64/d4d/d75/f93 x:0 0 0 2024-09-17T01:52:01.218 INFO:tasks.workunit.client.1.smithi092.stdout:0/169: dread d3/f12 [0,4194304] 0 2024-09-17T01:52:01.220 INFO:tasks.workunit.client.1.smithi092.stdout:6/190: symlink d3/d10/d1f/d21/d28/d2b/l38 0 2024-09-17T01:52:01.221 INFO:tasks.workunit.client.0.smithi031.stdout:2/376: write d1/d3/fd [4600773,31048] 0 2024-09-17T01:52:01.222 INFO:tasks.workunit.client.1.smithi092.stdout:1/139: dwrite db/f14 [0,4194304] 0 2024-09-17T01:52:01.222 INFO:tasks.workunit.client.1.smithi092.stdout:2/140: getdents d10/d1d/d2c 0 2024-09-17T01:52:01.222 INFO:tasks.workunit.client.0.smithi031.stdout:2/377: stat d1/d3/df/d11 0 2024-09-17T01:52:01.223 INFO:tasks.workunit.client.1.smithi092.stdout:1/140: write db/f2b [2346369,78675] 0 2024-09-17T01:52:01.223 INFO:tasks.workunit.client.0.smithi031.stdout:2/378: write d1/d3/df/d18/f61 [1347533,18261] 0 2024-09-17T01:52:01.224 INFO:tasks.workunit.client.1.smithi092.stdout:2/141: dread - d10/d1d/f26 zero size 2024-09-17T01:52:01.225 INFO:tasks.workunit.client.1.smithi092.stdout:6/191: stat d3/d10/d1f/d21/d28/d2b/l38 0 2024-09-17T01:52:01.227 INFO:tasks.workunit.client.0.smithi031.stdout:2/379: unlink d1/d3/df/d19/l49 0 2024-09-17T01:52:01.229 INFO:tasks.workunit.client.0.smithi031.stdout:4/457: truncate d8/fb 3695752 0 2024-09-17T01:52:01.229 INFO:tasks.workunit.client.1.smithi092.stdout:1/141: rename db/d1d/d29 to db/d1d/d23/d34 0 2024-09-17T01:52:01.232 INFO:tasks.workunit.client.1.smithi092.stdout:0/170: link d3/da/d1c/l25 d3/da/d1c/l34 0 2024-09-17T01:52:01.233 INFO:tasks.workunit.client.0.smithi031.stdout:2/380: creat d1/d3/df/f8d x:0 0 0 2024-09-17T01:52:01.234 INFO:tasks.workunit.client.1.smithi092.stdout:0/171: write d3/da/f2a [436588,117965] 0 2024-09-17T01:52:01.235 INFO:tasks.workunit.client.0.smithi031.stdout:2/381: write d1/d4c/f73 [1589010,75076] 0 2024-09-17T01:52:01.235 INFO:tasks.workunit.client.1.smithi092.stdout:6/192: link d3/dd/d19/l2a d3/d10/d1f/l39 0 2024-09-17T01:52:01.238 INFO:tasks.workunit.client.1.smithi092.stdout:1/142: dwrite db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:01.238 INFO:tasks.workunit.client.1.smithi092.stdout:0/172: readlink d3/le 0 2024-09-17T01:52:01.238 INFO:tasks.workunit.client.0.smithi031.stdout:4/458: dwrite d8/d3a/d41/d64/d4d/d5a/d79/f80 [0,4194304] 0 2024-09-17T01:52:01.239 INFO:tasks.workunit.client.1.smithi092.stdout:6/193: truncate d3/d10/d1f/f32 974495 0 2024-09-17T01:52:01.240 INFO:tasks.workunit.client.0.smithi031.stdout:2/382: fdatasync d1/d3/d45/d4a/f57 0 2024-09-17T01:52:01.241 INFO:tasks.workunit.client.1.smithi092.stdout:1/143: rename l7 to db/d1d/d23/l35 0 2024-09-17T01:52:01.242 INFO:tasks.workunit.client.0.smithi031.stdout:2/383: write d1/d3/df/d19/d1e/d2a/f67 [422925,11359] 0 2024-09-17T01:52:01.243 INFO:tasks.workunit.client.0.smithi031.stdout:4/459: creat d8/d3a/d41/d64/d86/f94 x:0 0 0 2024-09-17T01:52:01.243 INFO:tasks.workunit.client.1.smithi092.stdout:6/194: creat d3/f3a x:0 0 0 2024-09-17T01:52:01.244 INFO:tasks.workunit.client.1.smithi092.stdout:6/195: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:01.245 INFO:tasks.workunit.client.0.smithi031.stdout:4/460: read d8/d3a/d41/d64/f6c [1187321,23900] 0 2024-09-17T01:52:01.246 INFO:tasks.workunit.client.0.smithi031.stdout:2/384: symlink d1/d3/d2d/d71/l8e 0 2024-09-17T01:52:01.247 INFO:tasks.workunit.client.1.smithi092.stdout:1/144: truncate db/fd 446703 0 2024-09-17T01:52:01.251 INFO:tasks.workunit.client.0.smithi031.stdout:4/461: chown d8/d3a/d41/d64/d4d/d5a/d79/l83 1244 1 2024-09-17T01:52:01.253 INFO:tasks.workunit.client.1.smithi092.stdout:6/196: creat d3/d10/d1f/d21/f3b x:0 0 0 2024-09-17T01:52:01.253 INFO:tasks.workunit.client.1.smithi092.stdout:1/145: chown db/c13 6 1 2024-09-17T01:52:01.254 INFO:tasks.workunit.client.1.smithi092.stdout:0/173: link d3/le d3/da/d15/d30/l35 0 2024-09-17T01:52:01.255 INFO:tasks.workunit.client.1.smithi092.stdout:6/197: truncate d3/f5 484072 0 2024-09-17T01:52:01.255 INFO:tasks.workunit.client.0.smithi031.stdout:2/385: link d1/d3/df/d18/d40/d43/f79 d1/f8f 0 2024-09-17T01:52:01.256 INFO:tasks.workunit.client.1.smithi092.stdout:6/198: write d3/f6 [415278,39300] 0 2024-09-17T01:52:01.256 INFO:tasks.workunit.client.1.smithi092.stdout:1/146: mknod db/d1d/c36 0 2024-09-17T01:52:01.257 INFO:tasks.workunit.client.1.smithi092.stdout:1/147: write db/d1d/f2a [4109272,60071] 0 2024-09-17T01:52:01.259 INFO:tasks.workunit.client.0.smithi031.stdout:4/462: dwrite d8/f2b [0,4194304] 0 2024-09-17T01:52:01.261 INFO:tasks.workunit.client.1.smithi092.stdout:0/174: link d3/da/f2a d3/f36 0 2024-09-17T01:52:01.261 INFO:tasks.workunit.client.0.smithi031.stdout:4/463: chown d8/d3a/d41/d64/d4d/d5a/d79/f80 295327723 1 2024-09-17T01:52:01.262 INFO:tasks.workunit.client.1.smithi092.stdout:1/148: symlink db/d1d/d23/l37 0 2024-09-17T01:52:01.263 INFO:tasks.workunit.client.0.smithi031.stdout:4/464: readlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/l67 0 2024-09-17T01:52:01.264 INFO:tasks.workunit.client.1.smithi092.stdout:0/175: rename d3/da/f1e to d3/da/f37 0 2024-09-17T01:52:01.267 INFO:tasks.workunit.client.0.smithi031.stdout:4/465: truncate d8/d3a/d41/d64/f6c 2232608 0 2024-09-17T01:52:01.267 INFO:tasks.workunit.client.1.smithi092.stdout:0/176: rmdir d3 39 2024-09-17T01:52:01.269 INFO:tasks.workunit.client.0.smithi031.stdout:2/386: write d1/d3/df/d11/f26 [3269941,46595] 0 2024-09-17T01:52:01.270 INFO:tasks.workunit.client.0.smithi031.stdout:2/387: write d1/d3/d45/f8c [75217,32055] 0 2024-09-17T01:52:01.271 INFO:tasks.workunit.client.0.smithi031.stdout:4/466: rename d8/f2b to d8/d3a/d41/d64/d4d/d8f/f95 0 2024-09-17T01:52:01.278 INFO:tasks.workunit.client.1.smithi092.stdout:1/149: truncate db/f2b 3100634 0 2024-09-17T01:52:01.279 INFO:tasks.workunit.client.1.smithi092.stdout:0/177: write d3/da/fb [1007989,113613] 0 2024-09-17T01:52:01.279 INFO:tasks.workunit.client.0.smithi031.stdout:2/388: write d1/d3/d2d/f3c [928489,52117] 0 2024-09-17T01:52:01.280 INFO:tasks.workunit.client.0.smithi031.stdout:4/467: write d8/fb [3530747,58833] 0 2024-09-17T01:52:01.282 INFO:tasks.workunit.client.0.smithi031.stdout:4/468: chown d8/l59 18416586 1 2024-09-17T01:52:01.284 INFO:tasks.workunit.client.0.smithi031.stdout:2/389: creat d1/d3/df/d19/d1e/d21/f90 x:0 0 0 2024-09-17T01:52:01.285 INFO:tasks.workunit.client.0.smithi031.stdout:2/390: chown d1/d3/d2d/f55 3645239 1 2024-09-17T01:52:01.285 INFO:tasks.workunit.client.1.smithi092.stdout:1/150: dread db/f1a [0,4194304] 0 2024-09-17T01:52:01.286 INFO:tasks.workunit.client.0.smithi031.stdout:4/469: creat d8/d3a/d41/d64/d4d/d5a/f96 x:0 0 0 2024-09-17T01:52:01.286 INFO:tasks.workunit.client.0.smithi031.stdout:2/391: mkdir d1/d3/d2d/d91 0 2024-09-17T01:52:01.288 INFO:tasks.workunit.client.0.smithi031.stdout:4/470: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91 122381 1 2024-09-17T01:52:01.289 INFO:tasks.workunit.client.0.smithi031.stdout:2/392: mkdir d1/d3/df/d19/d1e/d4f/d92 0 2024-09-17T01:52:01.290 INFO:tasks.workunit.client.0.smithi031.stdout:4/471: creat d8/d3a/d41/d64/d4d/d8f/f97 x:0 0 0 2024-09-17T01:52:01.290 INFO:tasks.workunit.client.0.smithi031.stdout:0/276: sync 2024-09-17T01:52:01.293 INFO:tasks.workunit.client.0.smithi031.stdout:4/472: creat d8/f98 x:0 0 0 2024-09-17T01:52:01.297 INFO:tasks.workunit.client.0.smithi031.stdout:2/393: dwrite d1/d3/d2d/d71/f77 [0,4194304] 0 2024-09-17T01:52:01.301 INFO:tasks.workunit.client.0.smithi031.stdout:2/394: unlink d1/d3/df/d19/d1e/d4f/f75 0 2024-09-17T01:52:01.303 INFO:tasks.workunit.client.0.smithi031.stdout:0/277: truncate d0/d29/d33/d5/f3b 970183 0 2024-09-17T01:52:01.311 INFO:tasks.workunit.client.0.smithi031.stdout:2/395: creat d1/d3/df/d19/d1e/d21/d34/f93 x:0 0 0 2024-09-17T01:52:01.313 INFO:tasks.workunit.client.0.smithi031.stdout:4/473: truncate d8/d3a/d41/d64/d4d/d8f/f95 2885875 0 2024-09-17T01:52:01.315 INFO:tasks.workunit.client.0.smithi031.stdout:2/396: symlink d1/d3/df/d19/l94 0 2024-09-17T01:52:01.315 INFO:tasks.workunit.client.0.smithi031.stdout:4/474: truncate d8/d3a/d41/d64/d4d/d5a/f96 815763 0 2024-09-17T01:52:01.316 INFO:tasks.workunit.client.0.smithi031.stdout:2/397: stat d1/d3/df/d18/d40/d43/f79 0 2024-09-17T01:52:01.317 INFO:tasks.workunit.client.0.smithi031.stdout:4/475: read d8/d3a/d41/d64/f39 [390257,58303] 0 2024-09-17T01:52:01.318 INFO:tasks.workunit.client.0.smithi031.stdout:2/398: read d1/d3/df/d19/f1f [3952102,31172] 0 2024-09-17T01:52:01.326 INFO:tasks.workunit.client.0.smithi031.stdout:2/399: fdatasync d1/d3/f25 0 2024-09-17T01:52:01.326 INFO:tasks.workunit.client.0.smithi031.stdout:0/278: dwrite d0/d29/d33/d5/f3b [0,4194304] 0 2024-09-17T01:52:01.332 INFO:tasks.workunit.client.0.smithi031.stdout:4/476: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/f7a [0,4194304] 0 2024-09-17T01:52:01.337 INFO:tasks.workunit.client.0.smithi031.stdout:4/477: chown d8/f28 65398 1 2024-09-17T01:52:01.339 INFO:tasks.workunit.client.0.smithi031.stdout:2/400: dwrite d1/d3/d2d/f8b [0,4194304] 0 2024-09-17T01:52:01.340 INFO:tasks.workunit.client.0.smithi031.stdout:0/279: dwrite d0/d29/d33/d2a/d25/d38/f41 [0,4194304] 0 2024-09-17T01:52:01.343 INFO:tasks.workunit.client.1.smithi092.stdout:3/106: sync 2024-09-17T01:52:01.343 INFO:tasks.workunit.client.1.smithi092.stdout:3/107: fdatasync d4/d16/f1e 0 2024-09-17T01:52:01.344 INFO:tasks.workunit.client.0.smithi031.stdout:4/478: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/c38 0 1 2024-09-17T01:52:01.353 INFO:tasks.workunit.client.0.smithi031.stdout:0/280: dwrite d0/d29/d33/d2a/d25/d30/d4a/f54 [0,4194304] 0 2024-09-17T01:52:01.357 INFO:tasks.workunit.client.0.smithi031.stdout:2/401: dwrite d1/d3/df/d19/f28 [0,4194304] 0 2024-09-17T01:52:01.362 INFO:tasks.workunit.client.0.smithi031.stdout:2/402: creat d1/d3/df/d19/d1e/d2a/f95 x:0 0 0 2024-09-17T01:52:01.364 INFO:tasks.workunit.client.0.smithi031.stdout:2/403: rmdir d1/d3/d2d/d71 39 2024-09-17T01:52:01.367 INFO:tasks.workunit.client.0.smithi031.stdout:2/404: rmdir d1/d3/df/d19/d1e/d21/d34 39 2024-09-17T01:52:01.370 INFO:tasks.workunit.client.0.smithi031.stdout:0/281: dwrite d0/d29/f63 [0,4194304] 0 2024-09-17T01:52:01.373 INFO:tasks.workunit.client.0.smithi031.stdout:0/282: creat d0/d29/d33/d5b/f6d x:0 0 0 2024-09-17T01:52:01.381 INFO:tasks.workunit.client.0.smithi031.stdout:0/283: dwrite d0/d29/d33/d2a/d25/d30/d4a/f64 [0,4194304] 0 2024-09-17T01:52:01.382 INFO:tasks.workunit.client.1.smithi092.stdout:0/178: rename d3/da/d1c/l33 to d3/d1d/l38 0 2024-09-17T01:52:01.386 INFO:tasks.workunit.client.1.smithi092.stdout:3/108: mknod d4/c25 0 2024-09-17T01:52:01.387 INFO:tasks.workunit.client.0.smithi031.stdout:4/479: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/f5b [0,4194304] 0 2024-09-17T01:52:01.388 INFO:tasks.workunit.client.1.smithi092.stdout:0/179: mkdir d3/d1d/d39 0 2024-09-17T01:52:01.389 INFO:tasks.workunit.client.0.smithi031.stdout:0/284: fdatasync d0/d29/d33/d2a/d25/d30/d4a/f54 0 2024-09-17T01:52:01.389 INFO:tasks.workunit.client.0.smithi031.stdout:4/480: stat d8/d3a/d41/d64/d4d/d5a/d8c/d25/c3e 0 2024-09-17T01:52:01.391 INFO:tasks.workunit.client.1.smithi092.stdout:3/109: creat d4/d20/f26 x:0 0 0 2024-09-17T01:52:01.392 INFO:tasks.workunit.client.0.smithi031.stdout:0/285: creat d0/d29/d33/d2a/d25/d30/d4a/f6e x:0 0 0 2024-09-17T01:52:01.393 INFO:tasks.workunit.client.1.smithi092.stdout:1/151: dwrite db/f1a [0,4194304] 0 2024-09-17T01:52:01.394 INFO:tasks.workunit.client.0.smithi031.stdout:0/286: mkdir d0/d37/d6f 0 2024-09-17T01:52:01.395 INFO:tasks.workunit.client.1.smithi092.stdout:0/180: dread d3/da/f22 [0,4194304] 0 2024-09-17T01:52:01.396 INFO:tasks.workunit.client.1.smithi092.stdout:3/110: mknod d4/d13/c27 0 2024-09-17T01:52:01.397 INFO:tasks.workunit.client.0.smithi031.stdout:0/287: chown d0/d29/d33/d5/d50/c61 527039969 1 2024-09-17T01:52:01.398 INFO:tasks.workunit.client.1.smithi092.stdout:3/111: chown d4/l7 34766114 1 2024-09-17T01:52:01.398 INFO:tasks.workunit.client.1.smithi092.stdout:0/181: unlink d3/da/d15/c2b 0 2024-09-17T01:52:01.400 INFO:tasks.workunit.client.0.smithi031.stdout:0/288: creat d0/d29/f70 x:0 0 0 2024-09-17T01:52:01.402 INFO:tasks.workunit.client.0.smithi031.stdout:4/481: truncate d8/d3a/d41/d64/d4d/d5a/d8c/f30 1786000 0 2024-09-17T01:52:01.403 INFO:tasks.workunit.client.1.smithi092.stdout:3/112: dread d4/d16/f24 [0,4194304] 0 2024-09-17T01:52:01.403 INFO:tasks.workunit.client.0.smithi031.stdout:0/289: mknod d0/d29/d33/d2a/d25/d30/c71 0 2024-09-17T01:52:01.406 INFO:tasks.workunit.client.0.smithi031.stdout:0/290: symlink d0/d29/d33/d5/d48/l72 0 2024-09-17T01:52:01.407 INFO:tasks.workunit.client.0.smithi031.stdout:0/291: stat d0/d29/d33/d5/d48/d56 0 2024-09-17T01:52:01.407 INFO:tasks.workunit.client.0.smithi031.stdout:4/482: rename d8/d3a/d41/d64/d4d/d5a/c7b to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/c99 0 2024-09-17T01:52:01.408 INFO:tasks.workunit.client.1.smithi092.stdout:0/182: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:52:01.408 INFO:tasks.workunit.client.1.smithi092.stdout:3/113: dread d4/f18 [0,4194304] 0 2024-09-17T01:52:01.409 INFO:tasks.workunit.client.0.smithi031.stdout:0/292: mknod d0/d29/d33/d5/c73 0 2024-09-17T01:52:01.411 INFO:tasks.workunit.client.0.smithi031.stdout:4/483: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/l9a 0 2024-09-17T01:52:01.411 INFO:tasks.workunit.client.0.smithi031.stdout:0/293: write d0/d29/d33/d2a/d25/d30/f6b [162648,82247] 0 2024-09-17T01:52:01.413 INFO:tasks.workunit.client.0.smithi031.stdout:4/484: mknod d8/d3a/d41/d64/c9b 0 2024-09-17T01:52:01.414 INFO:tasks.workunit.client.0.smithi031.stdout:0/294: write d0/d29/d33/d5/f62 [559520,26524] 0 2024-09-17T01:52:01.418 INFO:tasks.workunit.client.1.smithi092.stdout:0/183: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:52:01.419 INFO:tasks.workunit.client.0.smithi031.stdout:0/295: getdents d0/d29/d33/d5/d50 0 2024-09-17T01:52:01.419 INFO:tasks.workunit.client.1.smithi092.stdout:1/152: dwrite db/f2b [0,4194304] 0 2024-09-17T01:52:01.420 INFO:tasks.workunit.client.0.smithi031.stdout:0/296: write d0/f34 [87003,106948] 0 2024-09-17T01:52:01.420 INFO:tasks.workunit.client.0.smithi031.stdout:4/485: dwrite d8/d3a/d41/d64/d4d/d5a/d79/f80 [0,4194304] 0 2024-09-17T01:52:01.422 INFO:tasks.workunit.client.0.smithi031.stdout:4/486: stat d8/d3a/d41/d64/d4d/d8f/f97 0 2024-09-17T01:52:01.423 INFO:tasks.workunit.client.1.smithi092.stdout:0/184: mkdir d3/da/d1c/d3a 0 2024-09-17T01:52:01.423 INFO:tasks.workunit.client.0.smithi031.stdout:4/487: fsync d8/d3a/f40 0 2024-09-17T01:52:01.427 INFO:tasks.workunit.client.0.smithi031.stdout:4/488: chown d8/d3a/d41/d64/d4d/f81 1714555 1 2024-09-17T01:52:01.428 INFO:tasks.workunit.client.1.smithi092.stdout:0/185: chown d3/d1d/c26 1361 1 2024-09-17T01:52:01.429 INFO:tasks.workunit.client.0.smithi031.stdout:4/489: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/f66 [2227322,96739] 0 2024-09-17T01:52:01.430 INFO:tasks.workunit.client.1.smithi092.stdout:1/153: dwrite f6 [0,4194304] 0 2024-09-17T01:52:01.432 INFO:tasks.workunit.client.0.smithi031.stdout:4/490: dread - d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f8e zero size 2024-09-17T01:52:01.434 INFO:tasks.workunit.client.1.smithi092.stdout:1/154: rmdir db/d1d/d2e 39 2024-09-17T01:52:01.436 INFO:tasks.workunit.client.1.smithi092.stdout:0/186: dread d3/f17 [0,4194304] 0 2024-09-17T01:52:01.436 INFO:tasks.workunit.client.0.smithi031.stdout:4/491: mkdir d8/d9c 0 2024-09-17T01:52:01.437 INFO:tasks.workunit.client.1.smithi092.stdout:1/155: symlink db/d1d/d23/l38 0 2024-09-17T01:52:01.441 INFO:tasks.workunit.client.1.smithi092.stdout:0/187: dread d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:01.442 INFO:tasks.workunit.client.1.smithi092.stdout:0/188: dread - d3/da/f37 zero size 2024-09-17T01:52:01.442 INFO:tasks.workunit.client.1.smithi092.stdout:1/156: creat db/d1d/f39 x:0 0 0 2024-09-17T01:52:01.446 INFO:tasks.workunit.client.1.smithi092.stdout:0/189: getdents d3/d2e 0 2024-09-17T01:52:01.447 INFO:tasks.workunit.client.1.smithi092.stdout:1/157: dread db/f1a [0,4194304] 0 2024-09-17T01:52:01.448 INFO:tasks.workunit.client.1.smithi092.stdout:1/158: chown db/d1d/d23/c31 48 1 2024-09-17T01:52:01.450 INFO:tasks.workunit.client.1.smithi092.stdout:0/190: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:01.450 INFO:tasks.workunit.client.1.smithi092.stdout:1/159: creat db/d1d/d23/f3a x:0 0 0 2024-09-17T01:52:01.453 INFO:tasks.workunit.client.1.smithi092.stdout:0/191: unlink d3/l21 0 2024-09-17T01:52:01.455 INFO:tasks.workunit.client.1.smithi092.stdout:0/192: dread d3/da/f2a [0,4194304] 0 2024-09-17T01:52:01.460 INFO:tasks.workunit.client.0.smithi031.stdout:0/297: dread d0/f1f [0,4194304] 0 2024-09-17T01:52:01.462 INFO:tasks.workunit.client.1.smithi092.stdout:0/193: dwrite d3/f1f [0,4194304] 0 2024-09-17T01:52:01.462 INFO:tasks.workunit.client.1.smithi092.stdout:1/160: fdatasync db/f2b 0 2024-09-17T01:52:01.465 INFO:tasks.workunit.client.0.smithi031.stdout:0/298: dwrite d0/d29/d33/d5/f3b [0,4194304] 0 2024-09-17T01:52:01.467 INFO:tasks.workunit.client.0.smithi031.stdout:0/299: symlink d0/d29/d44/l74 0 2024-09-17T01:52:01.468 INFO:tasks.workunit.client.1.smithi092.stdout:1/161: dread db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:01.469 INFO:tasks.workunit.client.1.smithi092.stdout:0/194: mkdir d3/d2e/d3b 0 2024-09-17T01:52:01.471 INFO:tasks.workunit.client.1.smithi092.stdout:1/162: mkdir db/d3b 0 2024-09-17T01:52:01.471 INFO:tasks.workunit.client.0.smithi031.stdout:0/300: getdents d0/d29/d33/d2a/d25 0 2024-09-17T01:52:01.471 INFO:tasks.workunit.client.0.smithi031.stdout:0/301: readlink d0/d29/d44/l74 0 2024-09-17T01:52:01.472 INFO:tasks.workunit.client.0.smithi031.stdout:0/302: rmdir d0 39 2024-09-17T01:52:01.473 INFO:tasks.workunit.client.0.smithi031.stdout:9/247: sync 2024-09-17T01:52:01.475 INFO:tasks.workunit.client.1.smithi092.stdout:0/195: creat d3/da/d15/d30/f3c x:0 0 0 2024-09-17T01:52:01.476 INFO:tasks.workunit.client.0.smithi031.stdout:0/303: write d0/d29/d33/d2a/d25/f3f [595084,5014] 0 2024-09-17T01:52:01.477 INFO:tasks.workunit.client.1.smithi092.stdout:1/163: write db/d1d/f2a [3061894,53054] 0 2024-09-17T01:52:01.478 INFO:tasks.workunit.client.1.smithi092.stdout:0/196: write d3/da/fb [3932970,94265] 0 2024-09-17T01:52:01.481 INFO:tasks.workunit.client.1.smithi092.stdout:0/197: fdatasync d3/da/f37 0 2024-09-17T01:52:01.482 INFO:tasks.workunit.client.1.smithi092.stdout:1/164: dread db/f14 [0,4194304] 0 2024-09-17T01:52:01.484 INFO:tasks.workunit.client.1.smithi092.stdout:1/165: fsync db/d1d/f22 0 2024-09-17T01:52:01.485 INFO:tasks.workunit.client.0.smithi031.stdout:0/304: dwrite d0/d29/d33/d2a/d25/d30/d4a/f6c [0,4194304] 0 2024-09-17T01:52:01.485 INFO:tasks.workunit.client.1.smithi092.stdout:1/166: chown db/d1d/d23 3648216 1 2024-09-17T01:52:01.487 INFO:tasks.workunit.client.1.smithi092.stdout:0/198: fdatasync d3/f5 0 2024-09-17T01:52:01.487 INFO:tasks.workunit.client.0.smithi031.stdout:0/305: write d0/d29/d33/f35 [4491967,128836] 0 2024-09-17T01:52:01.487 INFO:tasks.workunit.client.1.smithi092.stdout:1/167: dread db/d1d/d23/f25 [0,4194304] 0 2024-09-17T01:52:01.492 INFO:tasks.workunit.client.1.smithi092.stdout:1/168: rename db/d1d/f39 to db/d1d/d23/f3c 0 2024-09-17T01:52:01.493 INFO:tasks.workunit.client.0.smithi031.stdout:9/248: dwrite d3/f2a [0,4194304] 0 2024-09-17T01:52:01.493 INFO:tasks.workunit.client.0.smithi031.stdout:0/306: read d0/d29/d33/d2a/f39 [3305404,64753] 0 2024-09-17T01:52:01.494 INFO:tasks.workunit.client.0.smithi031.stdout:9/249: dread - d3/d19/f34 zero size 2024-09-17T01:52:01.494 INFO:tasks.workunit.client.1.smithi092.stdout:1/169: readlink db/lf 0 2024-09-17T01:52:01.496 INFO:tasks.workunit.client.1.smithi092.stdout:0/199: dwrite d3/f17 [4194304,4194304] 0 2024-09-17T01:52:01.497 INFO:tasks.workunit.client.0.smithi031.stdout:0/307: creat d0/d29/d33/f75 x:0 0 0 2024-09-17T01:52:01.498 INFO:tasks.workunit.client.1.smithi092.stdout:0/200: write d3/da/f37 [444413,8863] 0 2024-09-17T01:52:01.504 INFO:tasks.workunit.client.1.smithi092.stdout:1/170: dread db/f14 [0,4194304] 0 2024-09-17T01:52:01.506 INFO:tasks.workunit.client.1.smithi092.stdout:1/171: read db/f2b [3150574,95243] 0 2024-09-17T01:52:01.506 INFO:tasks.workunit.client.1.smithi092.stdout:0/201: creat d3/da/d15/f3d x:0 0 0 2024-09-17T01:52:01.509 INFO:tasks.workunit.client.1.smithi092.stdout:1/172: rename db/d1d/l24 to db/l3d 0 2024-09-17T01:52:01.511 INFO:tasks.workunit.client.0.smithi031.stdout:0/308: truncate d0/f5c 3693422 0 2024-09-17T01:52:01.512 INFO:tasks.workunit.client.1.smithi092.stdout:1/173: mknod db/d1d/d23/d34/c3e 0 2024-09-17T01:52:01.516 INFO:tasks.workunit.client.0.smithi031.stdout:0/309: dread d0/d29/d33/f35 [0,4194304] 0 2024-09-17T01:52:01.516 INFO:tasks.workunit.client.0.smithi031.stdout:9/250: dread d3/d10/f14 [0,4194304] 0 2024-09-17T01:52:01.516 INFO:tasks.workunit.client.1.smithi092.stdout:0/202: dwrite d3/d1d/f32 [0,4194304] 0 2024-09-17T01:52:01.517 INFO:tasks.workunit.client.0.smithi031.stdout:0/310: write d0/d29/d33/d5b/f6d [317015,62523] 0 2024-09-17T01:52:01.518 INFO:tasks.workunit.client.0.smithi031.stdout:9/251: symlink d3/d47/l53 0 2024-09-17T01:52:01.519 INFO:tasks.workunit.client.0.smithi031.stdout:9/252: dread - d3/d19/f34 zero size 2024-09-17T01:52:01.520 INFO:tasks.workunit.client.1.smithi092.stdout:0/203: fsync d3/f36 0 2024-09-17T01:52:01.521 INFO:tasks.workunit.client.1.smithi092.stdout:1/174: dwrite db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:01.522 INFO:tasks.workunit.client.0.smithi031.stdout:9/253: read d3/d4/d29/f2b [4458463,64771] 0 2024-09-17T01:52:01.522 INFO:tasks.workunit.client.1.smithi092.stdout:0/204: dread - d3/da/d15/f3d zero size 2024-09-17T01:52:01.530 INFO:tasks.workunit.client.1.smithi092.stdout:8/203: sync 2024-09-17T01:52:01.531 INFO:tasks.workunit.client.1.smithi092.stdout:9/155: sync 2024-09-17T01:52:01.534 INFO:tasks.workunit.client.1.smithi092.stdout:0/205: dwrite d3/f28 [0,4194304] 0 2024-09-17T01:52:01.535 INFO:tasks.workunit.client.1.smithi092.stdout:8/204: mkdir d15/d25/d2b/d3d 0 2024-09-17T01:52:01.535 INFO:tasks.workunit.client.0.smithi031.stdout:0/311: dwrite d0/d29/d33/f11 [0,4194304] 0 2024-09-17T01:52:01.536 INFO:tasks.workunit.client.1.smithi092.stdout:8/205: readlink d15/l2c 0 2024-09-17T01:52:01.536 INFO:tasks.workunit.client.1.smithi092.stdout:0/206: read d3/f1f [2385198,90496] 0 2024-09-17T01:52:01.537 INFO:tasks.workunit.client.0.smithi031.stdout:0/312: read - d0/d29/d33/d2a/d25/d38/f5e zero size 2024-09-17T01:52:01.537 INFO:tasks.workunit.client.1.smithi092.stdout:1/175: dwrite db/d1d/d23/f3c [0,4194304] 0 2024-09-17T01:52:01.539 INFO:tasks.workunit.client.0.smithi031.stdout:0/313: write d0/d29/f63 [361626,78404] 0 2024-09-17T01:52:01.539 INFO:tasks.workunit.client.1.smithi092.stdout:0/207: truncate d3/da/d15/f3d 410510 0 2024-09-17T01:52:01.543 INFO:tasks.workunit.client.1.smithi092.stdout:0/208: rmdir d3/d1d 39 2024-09-17T01:52:01.544 INFO:tasks.workunit.client.0.smithi031.stdout:0/314: dread d0/f34 [0,4194304] 0 2024-09-17T01:52:01.545 INFO:tasks.workunit.client.1.smithi092.stdout:0/209: truncate d3/da/f10 1601015 0 2024-09-17T01:52:01.546 INFO:tasks.workunit.client.0.smithi031.stdout:0/315: stat d0/d29/d33/d2a/d25/l52 0 2024-09-17T01:52:01.546 INFO:tasks.workunit.client.1.smithi092.stdout:0/210: stat d3/f17 0 2024-09-17T01:52:01.548 INFO:tasks.workunit.client.0.smithi031.stdout:0/316: write d0/d29/d33/d2a/d25/d30/f6b [1203134,97928] 0 2024-09-17T01:52:01.549 INFO:tasks.workunit.client.1.smithi092.stdout:1/176: write db/d1d/d23/f25 [1008557,33702] 0 2024-09-17T01:52:01.551 INFO:tasks.workunit.client.1.smithi092.stdout:0/211: rename d3/f1f to d3/f3e 0 2024-09-17T01:52:01.553 INFO:tasks.workunit.client.1.smithi092.stdout:1/177: getdents db/d1d/d23/d34 0 2024-09-17T01:52:01.561 INFO:tasks.workunit.client.1.smithi092.stdout:1/178: dwrite db/f1a [0,4194304] 0 2024-09-17T01:52:01.562 INFO:tasks.workunit.client.1.smithi092.stdout:1/179: write db/d1d/f2a [2594255,34655] 0 2024-09-17T01:52:01.568 INFO:tasks.workunit.client.1.smithi092.stdout:1/180: dwrite db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:01.570 INFO:tasks.workunit.client.1.smithi092.stdout:9/156: dread d0/f6 [4194304,4194304] 0 2024-09-17T01:52:01.573 INFO:tasks.workunit.client.1.smithi092.stdout:1/181: dread db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:01.574 INFO:tasks.workunit.client.1.smithi092.stdout:0/212: dread d3/f3e [0,4194304] 0 2024-09-17T01:52:01.575 INFO:tasks.workunit.client.1.smithi092.stdout:9/157: symlink d0/df/d17/d1f/d20/l25 0 2024-09-17T01:52:01.575 INFO:tasks.workunit.client.0.smithi031.stdout:0/317: dwrite d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:52:01.576 INFO:tasks.workunit.client.1.smithi092.stdout:0/213: mknod d3/da/d1c/c3f 0 2024-09-17T01:52:01.577 INFO:tasks.workunit.client.1.smithi092.stdout:1/182: getdents db/d1d/d23/d34 0 2024-09-17T01:52:01.577 INFO:tasks.workunit.client.1.smithi092.stdout:1/183: chown db 29704653 1 2024-09-17T01:52:01.579 INFO:tasks.workunit.client.1.smithi092.stdout:0/214: chown d3/cf 144610847 1 2024-09-17T01:52:01.579 INFO:tasks.workunit.client.0.smithi031.stdout:0/318: mkdir d0/d29/d33/d2a/d25/d30/d4a/d76 0 2024-09-17T01:52:01.581 INFO:tasks.workunit.client.0.smithi031.stdout:0/319: chown d0/d29/d33/d2a/d25/d30 0 1 2024-09-17T01:52:01.582 INFO:tasks.workunit.client.0.smithi031.stdout:0/320: dread - d0/d29/d33/d2a/d25/d30/d4a/f6e zero size 2024-09-17T01:52:01.583 INFO:tasks.workunit.client.1.smithi092.stdout:0/215: mkdir d3/d2e/d3b/d40 0 2024-09-17T01:52:01.583 INFO:tasks.workunit.client.0.smithi031.stdout:0/321: write d0/d29/d33/d2a/d25/d38/f5e [769242,30812] 0 2024-09-17T01:52:01.584 INFO:tasks.workunit.client.1.smithi092.stdout:1/184: dread db/f14 [0,4194304] 0 2024-09-17T01:52:01.585 INFO:tasks.workunit.client.1.smithi092.stdout:9/158: dwrite d0/f6 [8388608,4194304] 0 2024-09-17T01:52:01.585 INFO:tasks.workunit.client.0.smithi031.stdout:0/322: write d0/d29/d33/d2a/f39 [2638184,39232] 0 2024-09-17T01:52:01.588 INFO:tasks.workunit.client.1.smithi092.stdout:1/185: creat db/d1d/d23/f3f x:0 0 0 2024-09-17T01:52:01.589 INFO:tasks.workunit.client.0.smithi031.stdout:0/323: getdents d0/d37 0 2024-09-17T01:52:01.589 INFO:tasks.workunit.client.1.smithi092.stdout:9/159: rmdir d0/d7 39 2024-09-17T01:52:01.591 INFO:tasks.workunit.client.1.smithi092.stdout:9/160: dread - d0/df/d17/d1f/d20/f24 zero size 2024-09-17T01:52:01.591 INFO:tasks.workunit.client.0.smithi031.stdout:0/324: creat d0/d29/d33/d2a/d25/d30/f77 x:0 0 0 2024-09-17T01:52:01.593 INFO:tasks.workunit.client.1.smithi092.stdout:1/186: dread db/f1a [0,4194304] 0 2024-09-17T01:52:01.593 INFO:tasks.workunit.client.0.smithi031.stdout:0/325: chown d0/d29/d33/c49 36640 1 2024-09-17T01:52:01.593 INFO:tasks.workunit.client.1.smithi092.stdout:1/187: chown db/f1a 71665 1 2024-09-17T01:52:01.594 INFO:tasks.workunit.client.1.smithi092.stdout:1/188: readlink db/l17 0 2024-09-17T01:52:01.595 INFO:tasks.workunit.client.1.smithi092.stdout:1/189: write db/d1d/d23/f3f [422728,43166] 0 2024-09-17T01:52:01.595 INFO:tasks.workunit.client.0.smithi031.stdout:0/326: truncate d0/d29/d33/d5/f62 1466734 0 2024-09-17T01:52:01.596 INFO:tasks.workunit.client.1.smithi092.stdout:1/190: write db/d1d/d23/f3a [523002,50664] 0 2024-09-17T01:52:01.597 INFO:tasks.workunit.client.1.smithi092.stdout:1/191: readlink l9 0 2024-09-17T01:52:01.597 INFO:tasks.workunit.client.1.smithi092.stdout:9/161: getdents d0/df/d17/d1f/d20 0 2024-09-17T01:52:01.598 INFO:tasks.workunit.client.0.smithi031.stdout:0/327: mkdir d0/d29/d33/d5/d78 0 2024-09-17T01:52:01.599 INFO:tasks.workunit.client.0.smithi031.stdout:0/328: truncate d0/f34 5078572 0 2024-09-17T01:52:01.601 INFO:tasks.workunit.client.0.smithi031.stdout:0/329: creat d0/d29/d33/d5/d78/f79 x:0 0 0 2024-09-17T01:52:01.601 INFO:tasks.workunit.client.1.smithi092.stdout:0/216: truncate d3/da/f37 337042 0 2024-09-17T01:52:01.602 INFO:tasks.workunit.client.0.smithi031.stdout:0/330: write d0/d29/d33/d5/fa [121163,27366] 0 2024-09-17T01:52:01.603 INFO:tasks.workunit.client.0.smithi031.stdout:0/331: chown d0/f1f 244697 1 2024-09-17T01:52:01.604 INFO:tasks.workunit.client.1.smithi092.stdout:0/217: dread d3/f7 [0,4194304] 0 2024-09-17T01:52:01.608 INFO:tasks.workunit.client.1.smithi092.stdout:0/218: link d3/d1d/f32 d3/da/d15/d30/f41 0 2024-09-17T01:52:01.610 INFO:tasks.workunit.client.1.smithi092.stdout:1/192: truncate f6 849984 0 2024-09-17T01:52:01.612 INFO:tasks.workunit.client.1.smithi092.stdout:1/193: write db/d1d/d23/f3a [758271,14429] 0 2024-09-17T01:52:01.612 INFO:tasks.workunit.client.1.smithi092.stdout:0/219: getdents d3/d1d 0 2024-09-17T01:52:01.613 INFO:tasks.workunit.client.1.smithi092.stdout:1/194: write db/d1d/d23/f3f [161570,85730] 0 2024-09-17T01:52:01.617 INFO:tasks.workunit.client.1.smithi092.stdout:0/220: rmdir d3/d1d/d39 0 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:8/344: sync 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:6/432: sync 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:7/317: sync 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:2/405: sync 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:1/358: sync 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:5/290: sync 2024-09-17T01:52:01.618 INFO:tasks.workunit.client.0.smithi031.stdout:3/247: sync 2024-09-17T01:52:01.619 INFO:tasks.workunit.client.0.smithi031.stdout:8/345: chown d0/d5/d54/d60 0 1 2024-09-17T01:52:01.619 INFO:tasks.workunit.client.1.smithi092.stdout:9/162: dread d0/d5/f8 [0,4194304] 0 2024-09-17T01:52:01.620 INFO:tasks.workunit.client.0.smithi031.stdout:7/318: write db/d1c/f5c [2662470,44200] 0 2024-09-17T01:52:01.620 INFO:tasks.workunit.client.0.smithi031.stdout:6/433: creat d23/d50/f8b x:0 0 0 2024-09-17T01:52:01.620 INFO:tasks.workunit.client.1.smithi092.stdout:0/221: rename d3/d1d/c26 to d3/d2e/d3b/c42 0 2024-09-17T01:52:01.620 INFO:tasks.workunit.client.1.smithi092.stdout:1/195: dwrite db/d1d/d23/f25 [0,4194304] 0 2024-09-17T01:52:01.623 INFO:tasks.workunit.client.0.smithi031.stdout:3/248: chown db/df/d1d/d37/l3d 44130585 1 2024-09-17T01:52:01.624 INFO:tasks.workunit.client.1.smithi092.stdout:9/163: mkdir d0/df/d17/d1f/d26 0 2024-09-17T01:52:01.624 INFO:tasks.workunit.client.0.smithi031.stdout:2/406: mkdir d1/d3/d45/d4a/d96 0 2024-09-17T01:52:01.625 INFO:tasks.workunit.client.1.smithi092.stdout:1/196: dread db/d1d/f22 [0,4194304] 0 2024-09-17T01:52:01.626 INFO:tasks.workunit.client.1.smithi092.stdout:9/164: write d0/d7/f23 [1685227,56860] 0 2024-09-17T01:52:01.630 INFO:tasks.workunit.client.0.smithi031.stdout:3/249: creat db/d29/f4e x:0 0 0 2024-09-17T01:52:01.630 INFO:tasks.workunit.client.0.smithi031.stdout:6/434: mknod d23/c8c 0 2024-09-17T01:52:01.631 INFO:tasks.workunit.client.0.smithi031.stdout:7/319: chown db/d18/c37 310701 1 2024-09-17T01:52:01.633 INFO:tasks.workunit.client.0.smithi031.stdout:8/346: dwrite d0/f63 [0,4194304] 0 2024-09-17T01:52:01.633 INFO:tasks.workunit.client.1.smithi092.stdout:1/197: creat db/d1d/f40 x:0 0 0 2024-09-17T01:52:01.635 INFO:tasks.workunit.client.1.smithi092.stdout:9/165: link d0/d7/f23 d0/df/f27 0 2024-09-17T01:52:01.635 INFO:tasks.workunit.client.0.smithi031.stdout:7/320: chown db/d18/c19 1916056949 1 2024-09-17T01:52:01.636 INFO:tasks.workunit.client.1.smithi092.stdout:1/198: mknod db/d1d/d23/c41 0 2024-09-17T01:52:01.637 INFO:tasks.workunit.client.1.smithi092.stdout:0/222: write d3/f36 [563319,15140] 0 2024-09-17T01:52:01.637 INFO:tasks.workunit.client.0.smithi031.stdout:2/407: creat d1/d3/df/d19/d1e/f97 x:0 0 0 2024-09-17T01:52:01.639 INFO:tasks.workunit.client.1.smithi092.stdout:1/199: truncate db/d1d/d2e/f32 4254883 0 2024-09-17T01:52:01.639 INFO:tasks.workunit.client.0.smithi031.stdout:1/359: dwrite d4/d1a/d2d/d18/f2e [0,4194304] 0 2024-09-17T01:52:01.639 INFO:tasks.workunit.client.0.smithi031.stdout:8/347: unlink d0/df/l32 0 2024-09-17T01:52:01.640 INFO:tasks.workunit.client.0.smithi031.stdout:7/321: chown db/d1c/d46 0 1 2024-09-17T01:52:01.640 INFO:tasks.workunit.client.1.smithi092.stdout:1/200: fsync db/d1d/d23/f3f 0 2024-09-17T01:52:01.641 INFO:tasks.workunit.client.0.smithi031.stdout:2/408: chown d1/d3/f1c 2422 1 2024-09-17T01:52:01.642 INFO:tasks.workunit.client.0.smithi031.stdout:3/250: dread db/f34 [0,4194304] 0 2024-09-17T01:52:01.643 INFO:tasks.workunit.client.0.smithi031.stdout:6/435: mknod d23/d63/d47/d81/c8d 0 2024-09-17T01:52:01.643 INFO:tasks.workunit.client.1.smithi092.stdout:0/223: dread d3/da/f10 [0,4194304] 0 2024-09-17T01:52:01.645 INFO:tasks.workunit.client.0.smithi031.stdout:2/409: write d1/d3/df/d11/f2f [1780213,41175] 0 2024-09-17T01:52:01.645 INFO:tasks.workunit.client.0.smithi031.stdout:8/348: rmdir d0/df/d19/d3d 39 2024-09-17T01:52:01.645 INFO:tasks.workunit.client.1.smithi092.stdout:0/224: truncate d3/da/f10 30387 0 2024-09-17T01:52:01.646 INFO:tasks.workunit.client.0.smithi031.stdout:5/291: dread da/d14/f3c [0,4194304] 0 2024-09-17T01:52:01.647 INFO:tasks.workunit.client.1.smithi092.stdout:0/225: write d3/f27 [705753,73066] 0 2024-09-17T01:52:01.648 INFO:tasks.workunit.client.0.smithi031.stdout:3/251: symlink db/df/d1c/l4f 0 2024-09-17T01:52:01.648 INFO:tasks.workunit.client.1.smithi092.stdout:0/226: chown d3/f28 97311 1 2024-09-17T01:52:01.649 INFO:tasks.workunit.client.0.smithi031.stdout:8/349: readlink d0/df/l1c 0 2024-09-17T01:52:01.650 INFO:tasks.workunit.client.1.smithi092.stdout:0/227: read d3/f17 [3252738,44821] 0 2024-09-17T01:52:01.651 INFO:tasks.workunit.client.0.smithi031.stdout:5/292: write da/dc/f44 [60486,65228] 0 2024-09-17T01:52:01.654 INFO:tasks.workunit.client.1.smithi092.stdout:9/166: chown d0/df/d17/d1f 32101 1 2024-09-17T01:52:01.656 INFO:tasks.workunit.client.0.smithi031.stdout:7/322: dwrite db/d29/f5d [0,4194304] 0 2024-09-17T01:52:01.656 INFO:tasks.workunit.client.1.smithi092.stdout:0/228: rename d3/f27 to d3/da/d1c/f43 0 2024-09-17T01:52:01.657 INFO:tasks.workunit.client.1.smithi092.stdout:1/201: write db/fd [664287,59452] 0 2024-09-17T01:52:01.658 INFO:tasks.workunit.client.0.smithi031.stdout:8/350: mknod d0/df/dd/c64 0 2024-09-17T01:52:01.659 INFO:tasks.workunit.client.1.smithi092.stdout:1/202: write db/d1d/d23/f3f [36010,15401] 0 2024-09-17T01:52:01.659 INFO:tasks.workunit.client.1.smithi092.stdout:1/203: chown c5 709774766 1 2024-09-17T01:52:01.659 INFO:tasks.workunit.client.0.smithi031.stdout:5/293: symlink da/dc/d25/l61 0 2024-09-17T01:52:01.660 INFO:tasks.workunit.client.0.smithi031.stdout:2/410: truncate d1/d3/df/d19/d1e/f39 505167 0 2024-09-17T01:52:01.660 INFO:tasks.workunit.client.1.smithi092.stdout:9/167: unlink d0/d7/f11 0 2024-09-17T01:52:01.660 INFO:tasks.workunit.client.1.smithi092.stdout:0/229: mknod d3/d2e/d3b/d40/c44 0 2024-09-17T01:52:01.663 INFO:tasks.workunit.client.1.smithi092.stdout:1/204: rename db/f1a to db/d3b/f42 0 2024-09-17T01:52:01.664 INFO:tasks.workunit.client.1.smithi092.stdout:0/230: write d3/da/f22 [4180273,83546] 0 2024-09-17T01:52:01.665 INFO:tasks.workunit.client.0.smithi031.stdout:1/360: dwrite d4/d1a/d43/d53/f55 [0,4194304] 0 2024-09-17T01:52:01.665 INFO:tasks.workunit.client.0.smithi031.stdout:5/294: chown da/d42/d12/d4a/l56 63461 1 2024-09-17T01:52:01.668 INFO:tasks.workunit.client.1.smithi092.stdout:0/231: creat d3/da/d1c/f45 x:0 0 0 2024-09-17T01:52:01.669 INFO:tasks.workunit.client.0.smithi031.stdout:5/295: stat da/l5b 0 2024-09-17T01:52:01.670 INFO:tasks.workunit.client.1.smithi092.stdout:0/232: write d3/f28 [271177,88854] 0 2024-09-17T01:52:01.670 INFO:tasks.workunit.client.1.smithi092.stdout:1/205: getdents db/d1d 0 2024-09-17T01:52:01.671 INFO:tasks.workunit.client.0.smithi031.stdout:6/436: dwrite d23/d63/d47/f4c [4194304,4194304] 0 2024-09-17T01:52:01.671 INFO:tasks.workunit.client.0.smithi031.stdout:5/296: fdatasync da/d42/d26/f39 0 2024-09-17T01:52:01.671 INFO:tasks.workunit.client.0.smithi031.stdout:8/351: creat d0/df/f65 x:0 0 0 2024-09-17T01:52:01.675 INFO:tasks.workunit.client.1.smithi092.stdout:1/206: unlink db/f14 0 2024-09-17T01:52:01.675 INFO:tasks.workunit.client.0.smithi031.stdout:2/411: mkdir d1/d3/df/d19/d1e/d21/d98 0 2024-09-17T01:52:01.676 INFO:tasks.workunit.client.1.smithi092.stdout:0/233: mknod d3/c46 0 2024-09-17T01:52:01.676 INFO:tasks.workunit.client.0.smithi031.stdout:3/252: write db/df/d1d/d37/f3f [168445,5020] 0 2024-09-17T01:52:01.676 INFO:tasks.workunit.client.0.smithi031.stdout:7/323: dwrite db/d18/f25 [0,4194304] 0 2024-09-17T01:52:01.677 INFO:tasks.workunit.client.0.smithi031.stdout:1/361: rename d4/d1a/d2d/d18/d52/c66 to d4/d3d/c74 0 2024-09-17T01:52:01.680 INFO:tasks.workunit.client.1.smithi092.stdout:1/207: symlink db/l43 0 2024-09-17T01:52:01.682 INFO:tasks.workunit.client.1.smithi092.stdout:0/234: mkdir d3/da/d1c/d47 0 2024-09-17T01:52:01.682 INFO:tasks.workunit.client.0.smithi031.stdout:5/297: mkdir da/dc/d2e/d62 0 2024-09-17T01:52:01.684 INFO:tasks.workunit.client.0.smithi031.stdout:8/352: chown d0/df/d19/d3d/f5c 933 1 2024-09-17T01:52:01.686 INFO:tasks.workunit.client.0.smithi031.stdout:6/437: mknod d23/d50/d8a/c8e 0 2024-09-17T01:52:01.686 INFO:tasks.workunit.client.1.smithi092.stdout:0/235: read d3/f12 [539491,114352] 0 2024-09-17T01:52:01.686 INFO:tasks.workunit.client.0.smithi031.stdout:7/324: dwrite db/d1c/d41/f4b [0,4194304] 0 2024-09-17T01:52:01.688 INFO:tasks.workunit.client.1.smithi092.stdout:0/236: chown d3/l9 196698 1 2024-09-17T01:52:01.689 INFO:tasks.workunit.client.0.smithi031.stdout:2/412: rmdir d1/d3/df/d18/d40/d43 39 2024-09-17T01:52:01.689 INFO:tasks.workunit.client.0.smithi031.stdout:1/362: creat d4/d3d/d65/f75 x:0 0 0 2024-09-17T01:52:01.690 INFO:tasks.workunit.client.0.smithi031.stdout:8/353: stat d0/df/d19/f27 0 2024-09-17T01:52:01.692 INFO:tasks.workunit.client.0.smithi031.stdout:2/413: readlink d1/d3/df/d19/d1e/d21/l35 0 2024-09-17T01:52:01.692 INFO:tasks.workunit.client.1.smithi092.stdout:0/237: mkdir d3/d2e/d3b/d48 0 2024-09-17T01:52:01.694 INFO:tasks.workunit.client.0.smithi031.stdout:8/354: read d0/df/dd/f51 [3028345,74248] 0 2024-09-17T01:52:01.694 INFO:tasks.workunit.client.0.smithi031.stdout:9/254: sync 2024-09-17T01:52:01.694 INFO:tasks.workunit.client.0.smithi031.stdout:4/492: sync 2024-09-17T01:52:01.695 INFO:tasks.workunit.client.1.smithi092.stdout:9/168: dwrite d0/d7/f23 [0,4194304] 0 2024-09-17T01:52:01.697 INFO:tasks.workunit.client.0.smithi031.stdout:5/298: rename da/d14/f3c to da/d42/d12/f63 0 2024-09-17T01:52:01.698 INFO:tasks.workunit.client.1.smithi092.stdout:0/238: creat d3/da/d1c/f49 x:0 0 0 2024-09-17T01:52:01.700 INFO:tasks.workunit.client.1.smithi092.stdout:9/169: rmdir d0/d7 39 2024-09-17T01:52:01.702 INFO:tasks.workunit.client.1.smithi092.stdout:0/239: fsync d3/da/d1c/f43 0 2024-09-17T01:52:01.704 INFO:tasks.workunit.client.1.smithi092.stdout:9/170: mknod d0/c28 0 2024-09-17T01:52:01.704 INFO:tasks.workunit.client.0.smithi031.stdout:1/363: dwrite d4/d1a/d2d/d18/f31 [4194304,4194304] 0 2024-09-17T01:52:01.705 INFO:tasks.workunit.client.1.smithi092.stdout:0/240: truncate d3/f12 1667123 0 2024-09-17T01:52:01.705 INFO:tasks.workunit.client.1.smithi092.stdout:0/241: read d3/f28 [2739100,43273] 0 2024-09-17T01:52:01.706 INFO:tasks.workunit.client.0.smithi031.stdout:9/255: symlink d3/d4/d41/l54 0 2024-09-17T01:52:01.707 INFO:tasks.workunit.client.0.smithi031.stdout:7/325: creat db/f62 x:0 0 0 2024-09-17T01:52:01.709 INFO:tasks.workunit.client.0.smithi031.stdout:5/299: mkdir da/d42/d12/d64 0 2024-09-17T01:52:01.710 INFO:tasks.workunit.client.1.smithi092.stdout:9/171: dread d0/df/d17/f1c [0,4194304] 0 2024-09-17T01:52:01.711 INFO:tasks.workunit.client.0.smithi031.stdout:2/414: dwrite d1/d3/df/d11/d30/f37 [0,4194304] 0 2024-09-17T01:52:01.714 INFO:tasks.workunit.client.1.smithi092.stdout:0/242: dwrite d3/da/fb [4194304,4194304] 0 2024-09-17T01:52:01.714 INFO:tasks.workunit.client.1.smithi092.stdout:7/214: sync 2024-09-17T01:52:01.715 INFO:tasks.workunit.client.1.smithi092.stdout:5/101: sync 2024-09-17T01:52:01.715 INFO:tasks.workunit.client.0.smithi031.stdout:9/256: creat d3/d19/d1f/f55 x:0 0 0 2024-09-17T01:52:01.716 INFO:tasks.workunit.client.1.smithi092.stdout:5/102: readlink d0/de/l14 0 2024-09-17T01:52:01.716 INFO:tasks.workunit.client.1.smithi092.stdout:0/243: write d3/da/d15/d30/f3c [570455,103253] 0 2024-09-17T01:52:01.719 INFO:tasks.workunit.client.1.smithi092.stdout:0/244: mkdir d3/da/d1c/d4a 0 2024-09-17T01:52:01.723 INFO:tasks.workunit.client.0.smithi031.stdout:3/253: dwrite db/f46 [0,4194304] 0 2024-09-17T01:52:01.724 INFO:tasks.workunit.client.0.smithi031.stdout:5/300: creat da/d4b/f65 x:0 0 0 2024-09-17T01:52:01.725 INFO:tasks.workunit.client.1.smithi092.stdout:5/103: dwrite d0/f7 [0,4194304] 0 2024-09-17T01:52:01.725 INFO:tasks.workunit.client.0.smithi031.stdout:5/301: readlink da/d42/l4f 0 2024-09-17T01:52:01.725 INFO:tasks.workunit.client.0.smithi031.stdout:1/364: creat d4/d1e/d3f/d72/f76 x:0 0 0 2024-09-17T01:52:01.728 INFO:tasks.workunit.client.0.smithi031.stdout:2/415: fsync d1/d3/df/f2b 0 2024-09-17T01:52:01.728 INFO:tasks.workunit.client.0.smithi031.stdout:7/326: dwrite db/f15 [8388608,4194304] 0 2024-09-17T01:52:01.728 INFO:tasks.workunit.client.0.smithi031.stdout:8/355: getdents d0/df/dd/d59 0 2024-09-17T01:52:01.729 INFO:tasks.workunit.client.0.smithi031.stdout:9/257: mknod d3/d19/d1f/d44/c56 0 2024-09-17T01:52:01.731 INFO:tasks.workunit.client.1.smithi092.stdout:5/104: creat d0/de/f21 x:0 0 0 2024-09-17T01:52:01.735 INFO:tasks.workunit.client.0.smithi031.stdout:5/302: mknod da/c66 0 2024-09-17T01:52:01.736 INFO:tasks.workunit.client.0.smithi031.stdout:0/332: sync 2024-09-17T01:52:01.739 INFO:tasks.workunit.client.0.smithi031.stdout:9/258: write d3/d19/d1f/f43 [2826251,1815] 0 2024-09-17T01:52:01.740 INFO:tasks.workunit.client.0.smithi031.stdout:0/333: write d0/f21 [5613886,53206] 0 2024-09-17T01:52:01.741 INFO:tasks.workunit.client.0.smithi031.stdout:2/416: mknod d1/d7c/c99 0 2024-09-17T01:52:01.744 INFO:tasks.workunit.client.1.smithi092.stdout:9/172: dwrite d0/d5/f8 [0,4194304] 0 2024-09-17T01:52:01.747 INFO:tasks.workunit.client.1.smithi092.stdout:9/173: mkdir d0/d5/d29 0 2024-09-17T01:52:01.747 INFO:tasks.workunit.client.0.smithi031.stdout:3/254: write db/df/f1e [1686919,113003] 0 2024-09-17T01:52:01.748 INFO:tasks.workunit.client.0.smithi031.stdout:1/365: dwrite d4/d1e/d3f/d4d/f6f [0,4194304] 0 2024-09-17T01:52:01.748 INFO:tasks.workunit.client.1.smithi092.stdout:9/174: rmdir d0 39 2024-09-17T01:52:01.750 INFO:tasks.workunit.client.1.smithi092.stdout:9/175: creat d0/d5/f2a x:0 0 0 2024-09-17T01:52:01.753 INFO:tasks.workunit.client.1.smithi092.stdout:9/176: symlink d0/df/d17/d1f/l2b 0 2024-09-17T01:52:01.754 INFO:tasks.workunit.client.0.smithi031.stdout:0/334: creat d0/d29/d33/d2a/d25/f7a x:0 0 0 2024-09-17T01:52:01.754 INFO:tasks.workunit.client.1.smithi092.stdout:9/177: symlink d0/d5/l2c 0 2024-09-17T01:52:01.755 INFO:tasks.workunit.client.0.smithi031.stdout:8/356: getdents d0/df/d19 0 2024-09-17T01:52:01.757 INFO:tasks.workunit.client.0.smithi031.stdout:5/303: link da/d42/d12/d4a/l56 da/d42/d12/d64/l67 0 2024-09-17T01:52:01.759 INFO:tasks.workunit.client.1.smithi092.stdout:7/215: dread d3/fc [4194304,4194304] 0 2024-09-17T01:52:01.760 INFO:tasks.workunit.client.0.smithi031.stdout:1/366: mkdir d4/d1e/d40/d77 0 2024-09-17T01:52:01.760 INFO:tasks.workunit.client.0.smithi031.stdout:3/255: mkdir db/df/d50 0 2024-09-17T01:52:01.760 INFO:tasks.workunit.client.0.smithi031.stdout:2/417: dread d1/d3/df/d19/d1e/d21/f84 [0,4194304] 0 2024-09-17T01:52:01.761 INFO:tasks.workunit.client.0.smithi031.stdout:4/493: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/f30 [0,4194304] 0 2024-09-17T01:52:01.763 INFO:tasks.workunit.client.1.smithi092.stdout:7/216: mknod d3/d6/c4d 0 2024-09-17T01:52:01.763 INFO:tasks.workunit.client.0.smithi031.stdout:6/438: dread d23/f30 [0,4194304] 0 2024-09-17T01:52:01.765 INFO:tasks.workunit.client.0.smithi031.stdout:5/304: creat da/dc/d2e/f68 x:0 0 0 2024-09-17T01:52:01.766 INFO:tasks.workunit.client.1.smithi092.stdout:7/217: unlink d3/d2b/f4c 0 2024-09-17T01:52:01.768 INFO:tasks.workunit.client.0.smithi031.stdout:1/367: mkdir d4/d3d/d65/d78 0 2024-09-17T01:52:01.769 INFO:tasks.workunit.client.1.smithi092.stdout:7/218: mkdir d3/d6/d13/d21/d4e 0 2024-09-17T01:52:01.771 INFO:tasks.workunit.client.0.smithi031.stdout:6/439: write d23/f39 [1177188,121725] 0 2024-09-17T01:52:01.772 INFO:tasks.workunit.client.0.smithi031.stdout:0/335: dwrite d0/f21 [0,4194304] 0 2024-09-17T01:52:01.773 INFO:tasks.workunit.client.0.smithi031.stdout:5/305: truncate da/d42/d12/d4a/f60 143788 0 2024-09-17T01:52:01.773 INFO:tasks.workunit.client.0.smithi031.stdout:7/327: truncate db/d18/f2f 125822 0 2024-09-17T01:52:01.777 INFO:tasks.workunit.client.0.smithi031.stdout:8/357: getdents d0/df/d19/d3d 0 2024-09-17T01:52:01.777 INFO:tasks.workunit.client.0.smithi031.stdout:7/328: read - db/f51 zero size 2024-09-17T01:52:01.778 INFO:tasks.workunit.client.0.smithi031.stdout:2/418: creat d1/d3/df/d19/d1e/d4f/f9a x:0 0 0 2024-09-17T01:52:01.780 INFO:tasks.workunit.client.0.smithi031.stdout:4/494: dread d8/d3a/d41/d64/d4d/d5a/d8c/f30 [0,4194304] 0 2024-09-17T01:52:01.781 INFO:tasks.workunit.client.0.smithi031.stdout:3/256: link db/df/f22 db/df/d50/f51 0 2024-09-17T01:52:01.781 INFO:tasks.workunit.client.0.smithi031.stdout:7/329: read db/f16 [4112266,11559] 0 2024-09-17T01:52:01.784 INFO:tasks.workunit.client.0.smithi031.stdout:7/330: read db/d1c/d41/f44 [4184216,63137] 0 2024-09-17T01:52:01.787 INFO:tasks.workunit.client.0.smithi031.stdout:0/336: symlink d0/d29/d44/l7b 0 2024-09-17T01:52:01.792 INFO:tasks.workunit.client.0.smithi031.stdout:1/368: mknod d4/d1e/d5d/c79 0 2024-09-17T01:52:01.793 INFO:tasks.workunit.client.1.smithi092.stdout:7/219: dwrite d3/d2b/d3a/f3e [0,4194304] 0 2024-09-17T01:52:01.798 INFO:tasks.workunit.client.0.smithi031.stdout:3/257: dwrite db/f3e [0,4194304] 0 2024-09-17T01:52:01.800 INFO:tasks.workunit.client.0.smithi031.stdout:0/337: chown d0/d29/d33/d5/c12 955 1 2024-09-17T01:52:01.802 INFO:tasks.workunit.client.0.smithi031.stdout:1/369: truncate d4/d1e/f42 4757211 0 2024-09-17T01:52:01.802 INFO:tasks.workunit.client.0.smithi031.stdout:4/495: dwrite d8/d3a/d41/d64/d86/f94 [0,4194304] 0 2024-09-17T01:52:01.802 INFO:tasks.workunit.client.0.smithi031.stdout:7/331: dread db/d29/f54 [0,4194304] 0 2024-09-17T01:52:01.807 INFO:tasks.workunit.client.0.smithi031.stdout:3/258: chown db/f3e 166258479 1 2024-09-17T01:52:01.808 INFO:tasks.workunit.client.0.smithi031.stdout:8/358: creat d0/d5/d54/d60/f66 x:0 0 0 2024-09-17T01:52:01.809 INFO:tasks.workunit.client.0.smithi031.stdout:2/419: link d1/d3/f4 d1/d3/df/d66/f9b 0 2024-09-17T01:52:01.809 INFO:tasks.workunit.client.0.smithi031.stdout:7/332: fsync db/d1c/d46/f60 0 2024-09-17T01:52:01.811 INFO:tasks.workunit.client.1.smithi092.stdout:7/220: dread d3/d6/d13/f34 [0,4194304] 0 2024-09-17T01:52:01.813 INFO:tasks.workunit.client.0.smithi031.stdout:7/333: write db/d29/f4e [181266,76462] 0 2024-09-17T01:52:01.813 INFO:tasks.workunit.client.0.smithi031.stdout:0/338: rmdir d0/d29/d33 39 2024-09-17T01:52:01.814 INFO:tasks.workunit.client.1.smithi092.stdout:7/221: creat d3/d6/d13/d40/f4f x:0 0 0 2024-09-17T01:52:01.816 INFO:tasks.workunit.client.0.smithi031.stdout:1/370: creat d4/d1e/d3f/d72/f7a x:0 0 0 2024-09-17T01:52:01.817 INFO:tasks.workunit.client.1.smithi092.stdout:7/222: mknod d3/d6/d13/d40/c50 0 2024-09-17T01:52:01.818 INFO:tasks.workunit.client.0.smithi031.stdout:4/496: rmdir d8/d3a/d41/d64/d4f 39 2024-09-17T01:52:01.818 INFO:tasks.workunit.client.0.smithi031.stdout:2/420: truncate d1/d3/df/d19/d1e/f39 759677 0 2024-09-17T01:52:01.818 INFO:tasks.workunit.client.0.smithi031.stdout:5/306: dwrite f4 [4194304,4194304] 0 2024-09-17T01:52:01.819 INFO:tasks.workunit.client.1.smithi092.stdout:7/223: truncate d3/d6/d13/f34 2089408 0 2024-09-17T01:52:01.820 INFO:tasks.workunit.client.1.smithi092.stdout:7/224: rmdir d3/d6/d13 39 2024-09-17T01:52:01.821 INFO:tasks.workunit.client.0.smithi031.stdout:1/371: readlink d4/d1e/d40/l5f 0 2024-09-17T01:52:01.821 INFO:tasks.workunit.client.1.smithi092.stdout:7/225: write d3/db/f15 [4719636,103862] 0 2024-09-17T01:52:01.821 INFO:tasks.workunit.client.1.smithi092.stdout:7/226: readlink d3/db/l47 0 2024-09-17T01:52:01.822 INFO:tasks.workunit.client.0.smithi031.stdout:6/440: getdents d23/d50/d6a/d70 0 2024-09-17T01:52:01.823 INFO:tasks.workunit.client.1.smithi092.stdout:7/227: creat d3/db/d26/f51 x:0 0 0 2024-09-17T01:52:01.823 INFO:tasks.workunit.client.1.smithi092.stdout:7/228: dread - d3/db/f4a zero size 2024-09-17T01:52:01.827 INFO:tasks.workunit.client.1.smithi092.stdout:7/229: dread d3/db/d18/f2c [0,4194304] 0 2024-09-17T01:52:01.831 INFO:tasks.workunit.client.0.smithi031.stdout:6/441: truncate d23/d63/d47/f83 319144 0 2024-09-17T01:52:01.831 INFO:tasks.workunit.client.0.smithi031.stdout:1/372: unlink d4/c3e 0 2024-09-17T01:52:01.832 INFO:tasks.workunit.client.1.smithi092.stdout:7/230: mknod d3/d6/d13/d40/c52 0 2024-09-17T01:52:01.834 INFO:tasks.workunit.client.0.smithi031.stdout:7/334: link db/d29/f4e db/d1c/f63 0 2024-09-17T01:52:01.834 INFO:tasks.workunit.client.0.smithi031.stdout:6/442: chown d23/d50/d8a 1 1 2024-09-17T01:52:01.834 INFO:tasks.workunit.client.0.smithi031.stdout:2/421: dread d1/d3/df/d11/f13 [0,4194304] 0 2024-09-17T01:52:01.835 INFO:tasks.workunit.client.1.smithi092.stdout:7/231: creat d3/db/d18/f53 x:0 0 0 2024-09-17T01:52:01.835 INFO:tasks.workunit.client.0.smithi031.stdout:5/307: dwrite da/dc/d2e/f68 [0,4194304] 0 2024-09-17T01:52:01.837 INFO:tasks.workunit.client.1.smithi092.stdout:7/232: rename d3/f10 to d3/db/f54 0 2024-09-17T01:52:01.838 INFO:tasks.workunit.client.0.smithi031.stdout:8/359: dread d0/df/f2b [0,4194304] 0 2024-09-17T01:52:01.840 INFO:tasks.workunit.client.0.smithi031.stdout:1/373: mknod d4/d3d/d65/c7b 0 2024-09-17T01:52:01.841 INFO:tasks.workunit.client.0.smithi031.stdout:0/339: read d0/d29/d33/d2a/d25/f27 [3248282,24021] 0 2024-09-17T01:52:01.842 INFO:tasks.workunit.client.0.smithi031.stdout:6/443: stat d23/d50/l87 0 2024-09-17T01:52:01.844 INFO:tasks.workunit.client.0.smithi031.stdout:2/422: dread d1/d3/df/d19/d1e/d2a/f67 [0,4194304] 0 2024-09-17T01:52:01.844 INFO:tasks.workunit.client.0.smithi031.stdout:5/308: mknod da/d4b/c69 0 2024-09-17T01:52:01.847 INFO:tasks.workunit.client.0.smithi031.stdout:8/360: mknod d0/df/dd/d59/c67 0 2024-09-17T01:52:01.848 INFO:tasks.workunit.client.0.smithi031.stdout:5/309: fsync da/d42/f5c 0 2024-09-17T01:52:01.849 INFO:tasks.workunit.client.0.smithi031.stdout:1/374: readlink d4/l32 0 2024-09-17T01:52:01.850 INFO:tasks.workunit.client.0.smithi031.stdout:7/335: dwrite db/d18/f61 [0,4194304] 0 2024-09-17T01:52:01.852 INFO:tasks.workunit.client.0.smithi031.stdout:6/444: write d23/f3b [3022289,121644] 0 2024-09-17T01:52:01.853 INFO:tasks.workunit.client.0.smithi031.stdout:0/340: unlink d0/d29/d33/f11 0 2024-09-17T01:52:01.853 INFO:tasks.workunit.client.0.smithi031.stdout:4/497: dwrite d8/d3a/d41/d64/f6c [0,4194304] 0 2024-09-17T01:52:01.856 INFO:tasks.workunit.client.1.smithi092.stdout:7/233: dread d3/fc [0,4194304] 0 2024-09-17T01:52:01.857 INFO:tasks.workunit.client.1.smithi092.stdout:7/234: write d3/d2b/f31 [3652822,113841] 0 2024-09-17T01:52:01.858 INFO:tasks.workunit.client.0.smithi031.stdout:8/361: mknod d0/df/dd/c68 0 2024-09-17T01:52:01.859 INFO:tasks.workunit.client.0.smithi031.stdout:0/341: stat d0/d29/d33/f75 0 2024-09-17T01:52:01.860 INFO:tasks.workunit.client.1.smithi092.stdout:7/235: creat d3/d6/d13/d40/f55 x:0 0 0 2024-09-17T01:52:01.860 INFO:tasks.workunit.client.0.smithi031.stdout:1/375: truncate d4/d1e/f4b 964441 0 2024-09-17T01:52:01.864 INFO:tasks.workunit.client.0.smithi031.stdout:5/310: dwrite da/d42/f51 [0,4194304] 0 2024-09-17T01:52:01.864 INFO:tasks.workunit.client.0.smithi031.stdout:7/336: rmdir db/d1c/d46 39 2024-09-17T01:52:01.865 INFO:tasks.workunit.client.1.smithi092.stdout:7/236: rename d3/db/d18/c33 to d3/c56 0 2024-09-17T01:52:01.867 INFO:tasks.workunit.client.0.smithi031.stdout:7/337: truncate db/f1f 4317207 0 2024-09-17T01:52:01.867 INFO:tasks.workunit.client.1.smithi092.stdout:7/237: mknod d3/c57 0 2024-09-17T01:52:01.868 INFO:tasks.workunit.client.1.smithi092.stdout:7/238: read - d3/db/d26/f51 zero size 2024-09-17T01:52:01.869 INFO:tasks.workunit.client.1.smithi092.stdout:7/239: read d3/db/d18/f41 [1803,103309] 0 2024-09-17T01:52:01.870 INFO:tasks.workunit.client.0.smithi031.stdout:6/445: creat d23/d50/d6a/d70/f8f x:0 0 0 2024-09-17T01:52:01.872 INFO:tasks.workunit.client.0.smithi031.stdout:8/362: symlink d0/df/d19/d3d/l69 0 2024-09-17T01:52:01.874 INFO:tasks.workunit.client.0.smithi031.stdout:5/311: unlink da/dc/d25/l32 0 2024-09-17T01:52:01.875 INFO:tasks.workunit.client.0.smithi031.stdout:5/312: readlink da/l1e 0 2024-09-17T01:52:01.875 INFO:tasks.workunit.client.1.smithi092.stdout:7/240: symlink d3/d6/d13/d21/d4e/l58 0 2024-09-17T01:52:01.876 INFO:tasks.workunit.client.1.smithi092.stdout:7/241: truncate d3/f4b 650623 0 2024-09-17T01:52:01.876 INFO:tasks.workunit.client.1.smithi092.stdout:7/242: dread - d3/db/f4a zero size 2024-09-17T01:52:01.878 INFO:tasks.workunit.client.1.smithi092.stdout:7/243: dread d3/db/d18/f20 [0,4194304] 0 2024-09-17T01:52:01.878 INFO:tasks.workunit.client.0.smithi031.stdout:2/423: write d1/f87 [3600666,58397] 0 2024-09-17T01:52:01.880 INFO:tasks.workunit.client.1.smithi092.stdout:7/244: readlink d3/d6/d13/d21/d2e/l2f 0 2024-09-17T01:52:01.881 INFO:tasks.workunit.client.0.smithi031.stdout:6/446: symlink d23/d63/l90 0 2024-09-17T01:52:01.881 INFO:tasks.workunit.client.0.smithi031.stdout:2/424: truncate d1/d3/df/d18/f3b 912047 0 2024-09-17T01:52:01.882 INFO:tasks.workunit.client.1.smithi092.stdout:7/245: creat d3/d6/d13/d21/d2e/f59 x:0 0 0 2024-09-17T01:52:01.883 INFO:tasks.workunit.client.0.smithi031.stdout:6/447: rmdir d23/d50/d6a 39 2024-09-17T01:52:01.884 INFO:tasks.workunit.client.0.smithi031.stdout:8/363: link d0/d5/d54/c58 d0/df/d19/d3d/c6a 0 2024-09-17T01:52:01.885 INFO:tasks.workunit.client.0.smithi031.stdout:6/448: write f1a [4637949,44558] 0 2024-09-17T01:52:01.886 INFO:tasks.workunit.client.0.smithi031.stdout:7/338: getdents db/d1c 0 2024-09-17T01:52:01.886 INFO:tasks.workunit.client.0.smithi031.stdout:8/364: chown d0/l4c 187 1 2024-09-17T01:52:01.891 INFO:tasks.workunit.client.0.smithi031.stdout:8/365: creat d0/d5/d54/d60/f6b x:0 0 0 2024-09-17T01:52:01.892 INFO:tasks.workunit.client.0.smithi031.stdout:5/313: write da/d14/f53 [129969,103633] 0 2024-09-17T01:52:01.892 INFO:tasks.workunit.client.0.smithi031.stdout:6/449: mkdir d23/d50/d6a/d91 0 2024-09-17T01:52:01.896 INFO:tasks.workunit.client.0.smithi031.stdout:8/366: stat d0/df/d19/c2a 0 2024-09-17T01:52:01.896 INFO:tasks.workunit.client.0.smithi031.stdout:4/498: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 [0,4194304] 0 2024-09-17T01:52:01.898 INFO:tasks.workunit.client.0.smithi031.stdout:7/339: dwrite db/d1c/d41/f59 [0,4194304] 0 2024-09-17T01:52:01.898 INFO:tasks.workunit.client.0.smithi031.stdout:8/367: chown d0/df/f65 74 1 2024-09-17T01:52:01.898 INFO:tasks.workunit.client.0.smithi031.stdout:5/314: creat da/d14/f6a x:0 0 0 2024-09-17T01:52:01.902 INFO:tasks.workunit.client.1.smithi092.stdout:4/89: sync 2024-09-17T01:52:01.903 INFO:tasks.workunit.client.1.smithi092.stdout:2/142: sync 2024-09-17T01:52:01.903 INFO:tasks.workunit.client.1.smithi092.stdout:3/114: sync 2024-09-17T01:52:01.903 INFO:tasks.workunit.client.1.smithi092.stdout:6/199: sync 2024-09-17T01:52:01.903 INFO:tasks.workunit.client.1.smithi092.stdout:8/206: sync 2024-09-17T01:52:01.905 INFO:tasks.workunit.client.1.smithi092.stdout:3/115: dread d4/d16/f24 [0,4194304] 0 2024-09-17T01:52:01.906 INFO:tasks.workunit.client.0.smithi031.stdout:5/315: creat da/dc/d2e/d62/f6b x:0 0 0 2024-09-17T01:52:01.907 INFO:tasks.workunit.client.0.smithi031.stdout:6/450: mkdir d23/d50/d6a/d70/d74/d92 0 2024-09-17T01:52:01.907 INFO:tasks.workunit.client.1.smithi092.stdout:6/200: unlink d3/d10/d1a/c34 0 2024-09-17T01:52:01.910 INFO:tasks.workunit.client.1.smithi092.stdout:8/207: creat d15/d25/d27/f3e x:0 0 0 2024-09-17T01:52:01.910 INFO:tasks.workunit.client.0.smithi031.stdout:7/340: unlink db/d1c/d41/f59 0 2024-09-17T01:52:01.912 INFO:tasks.workunit.client.1.smithi092.stdout:8/208: chown f1 671661 1 2024-09-17T01:52:01.913 INFO:tasks.workunit.client.0.smithi031.stdout:8/368: dwrite d0/df/dd/f2d [0,4194304] 0 2024-09-17T01:52:01.914 INFO:tasks.workunit.client.0.smithi031.stdout:4/499: rename d8/d3a/c3f to d8/d3a/d41/c9d 0 2024-09-17T01:52:01.915 INFO:tasks.workunit.client.1.smithi092.stdout:2/143: creat d10/d1d/d2c/f2e x:0 0 0 2024-09-17T01:52:01.916 INFO:tasks.workunit.client.0.smithi031.stdout:8/369: chown d0/df/d19/l21 5 1 2024-09-17T01:52:01.917 INFO:tasks.workunit.client.1.smithi092.stdout:6/201: symlink d3/d25/l3c 0 2024-09-17T01:52:01.917 INFO:tasks.workunit.client.1.smithi092.stdout:8/209: symlink d15/d25/d2b/d3d/l3f 0 2024-09-17T01:52:01.919 INFO:tasks.workunit.client.1.smithi092.stdout:6/202: dread - d3/d10/d1f/d21/f3b zero size 2024-09-17T01:52:01.920 INFO:tasks.workunit.client.0.smithi031.stdout:4/500: mknod d8/d3a/d41/d55/c9e 0 2024-09-17T01:52:01.920 INFO:tasks.workunit.client.1.smithi092.stdout:2/144: rmdir d10/d15 39 2024-09-17T01:52:01.922 INFO:tasks.workunit.client.0.smithi031.stdout:8/370: rmdir d0/df/dd 39 2024-09-17T01:52:01.922 INFO:tasks.workunit.client.1.smithi092.stdout:8/210: mkdir d15/d32/d40 0 2024-09-17T01:52:01.922 INFO:tasks.workunit.client.1.smithi092.stdout:6/203: mkdir d3/dd/d19/d3d 0 2024-09-17T01:52:01.923 INFO:tasks.workunit.client.0.smithi031.stdout:5/316: dread da/dc/f44 [0,4194304] 0 2024-09-17T01:52:01.923 INFO:tasks.workunit.client.1.smithi092.stdout:7/246: dwrite d3/db/f54 [0,4194304] 0 2024-09-17T01:52:01.924 INFO:tasks.workunit.client.1.smithi092.stdout:6/204: fsync d3/f13 0 2024-09-17T01:52:01.925 INFO:tasks.workunit.client.1.smithi092.stdout:7/247: fdatasync d3/db/f15 0 2024-09-17T01:52:01.927 INFO:tasks.workunit.client.0.smithi031.stdout:6/451: dwrite d23/d63/d47/f4c [0,4194304] 0 2024-09-17T01:52:01.927 INFO:tasks.workunit.client.0.smithi031.stdout:5/317: chown da/d42/d12/c1b 27 1 2024-09-17T01:52:01.929 INFO:tasks.workunit.client.0.smithi031.stdout:8/371: mkdir d0/d5/d6c 0 2024-09-17T01:52:01.930 INFO:tasks.workunit.client.0.smithi031.stdout:7/341: dwrite db/d1c/d46/f60 [0,4194304] 0 2024-09-17T01:52:01.933 INFO:tasks.workunit.client.0.smithi031.stdout:4/501: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f9f x:0 0 0 2024-09-17T01:52:01.936 INFO:tasks.workunit.client.1.smithi092.stdout:4/90: write d4/d13/f17 [1241789,97142] 0 2024-09-17T01:52:01.936 INFO:tasks.workunit.client.1.smithi092.stdout:8/211: dwrite ff [0,4194304] 0 2024-09-17T01:52:01.937 INFO:tasks.workunit.client.1.smithi092.stdout:2/145: dwrite d10/d1d/d2c/f2e [0,4194304] 0 2024-09-17T01:52:01.939 INFO:tasks.workunit.client.0.smithi031.stdout:4/502: dread - d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f73 zero size 2024-09-17T01:52:01.940 INFO:tasks.workunit.client.1.smithi092.stdout:7/248: rename d3/d6/d13/d21/d4e to d3/d2b/d3a/d5a 0 2024-09-17T01:52:01.942 INFO:tasks.workunit.client.0.smithi031.stdout:7/342: dread db/d1c/d46/f52 [0,4194304] 0 2024-09-17T01:52:01.942 INFO:tasks.workunit.client.0.smithi031.stdout:5/318: fdatasync da/f49 0 2024-09-17T01:52:01.943 INFO:tasks.workunit.client.1.smithi092.stdout:6/205: truncate d3/d10/d1f/d21/d28/f2f 777457 0 2024-09-17T01:52:01.943 INFO:tasks.workunit.client.0.smithi031.stdout:6/452: dwrite d23/f3b [0,4194304] 0 2024-09-17T01:52:01.944 INFO:tasks.workunit.client.0.smithi031.stdout:5/319: stat da/d14/l55 0 2024-09-17T01:52:01.945 INFO:tasks.workunit.client.1.smithi092.stdout:6/206: chown d3/f8 5 1 2024-09-17T01:52:01.947 INFO:tasks.workunit.client.0.smithi031.stdout:4/503: creat d8/d3a/d41/d64/d92/fa0 x:0 0 0 2024-09-17T01:52:01.948 INFO:tasks.workunit.client.1.smithi092.stdout:4/91: creat d4/d5/d8/d19/f1a x:0 0 0 2024-09-17T01:52:01.948 INFO:tasks.workunit.client.0.smithi031.stdout:4/504: fdatasync d8/d3a/d41/f60 0 2024-09-17T01:52:01.950 INFO:tasks.workunit.client.0.smithi031.stdout:5/320: mkdir da/d4b/d6c 0 2024-09-17T01:52:01.951 INFO:tasks.workunit.client.1.smithi092.stdout:8/212: unlink d15/d25/d2b/c35 0 2024-09-17T01:52:01.952 INFO:tasks.workunit.client.0.smithi031.stdout:5/321: write da/dc/f16 [778529,121876] 0 2024-09-17T01:52:01.952 INFO:tasks.workunit.client.1.smithi092.stdout:3/116: dread d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:01.953 INFO:tasks.workunit.client.1.smithi092.stdout:6/207: creat d3/dd/f3e x:0 0 0 2024-09-17T01:52:01.953 INFO:tasks.workunit.client.1.smithi092.stdout:8/213: chown d15/l3a 0 1 2024-09-17T01:52:01.955 INFO:tasks.workunit.client.1.smithi092.stdout:4/92: symlink d4/l1b 0 2024-09-17T01:52:01.955 INFO:tasks.workunit.client.0.smithi031.stdout:7/343: rename db/l1e to db/d1c/l64 0 2024-09-17T01:52:01.955 INFO:tasks.workunit.client.1.smithi092.stdout:6/208: write d3/d10/d1f/d21/f3b [632918,10919] 0 2024-09-17T01:52:01.956 INFO:tasks.workunit.client.0.smithi031.stdout:6/453: symlink d23/d50/d6a/d91/l93 0 2024-09-17T01:52:01.957 INFO:tasks.workunit.client.0.smithi031.stdout:4/505: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa1 x:0 0 0 2024-09-17T01:52:01.958 INFO:tasks.workunit.client.1.smithi092.stdout:7/249: mknod d3/c5b 0 2024-09-17T01:52:01.959 INFO:tasks.workunit.client.0.smithi031.stdout:7/344: rmdir db/d18 39 2024-09-17T01:52:01.959 INFO:tasks.workunit.client.0.smithi031.stdout:1/376: dread d4/d1e/f49 [0,4194304] 0 2024-09-17T01:52:01.959 INFO:tasks.workunit.client.1.smithi092.stdout:3/117: rmdir d4 39 2024-09-17T01:52:01.960 INFO:tasks.workunit.client.0.smithi031.stdout:6/454: truncate d23/d50/d6a/d72/d75/f85 189821 0 2024-09-17T01:52:01.961 INFO:tasks.workunit.client.0.smithi031.stdout:5/322: rmdir da/d42/d12/d4a 39 2024-09-17T01:52:01.963 INFO:tasks.workunit.client.1.smithi092.stdout:8/214: dwrite d15/f1e [4194304,4194304] 0 2024-09-17T01:52:01.964 INFO:tasks.workunit.client.0.smithi031.stdout:6/455: symlink d23/d50/d6a/l94 0 2024-09-17T01:52:01.964 INFO:tasks.workunit.client.1.smithi092.stdout:8/215: dread - d15/f1c zero size 2024-09-17T01:52:01.965 INFO:tasks.workunit.client.0.smithi031.stdout:1/377: creat d4/d1e/d3f/f7c x:0 0 0 2024-09-17T01:52:01.966 INFO:tasks.workunit.client.1.smithi092.stdout:4/93: rename d4/d5/fd to d4/d13/f1c 0 2024-09-17T01:52:01.967 INFO:tasks.workunit.client.0.smithi031.stdout:1/378: fdatasync d4/d1a/d2d/f61 0 2024-09-17T01:52:01.968 INFO:tasks.workunit.client.0.smithi031.stdout:5/323: symlink da/l6d 0 2024-09-17T01:52:01.969 INFO:tasks.workunit.client.1.smithi092.stdout:4/94: fdatasync d4/d13/f1c 0 2024-09-17T01:52:01.969 INFO:tasks.workunit.client.0.smithi031.stdout:8/372: write d0/df/d19/d3d/f49 [1683508,77043] 0 2024-09-17T01:52:01.969 INFO:tasks.workunit.client.0.smithi031.stdout:1/379: write d4/d1e/d3f/f7c [13858,10678] 0 2024-09-17T01:52:01.971 INFO:tasks.workunit.client.0.smithi031.stdout:1/380: chown d4/d1e/d40/l5f 966800 1 2024-09-17T01:52:01.971 INFO:tasks.workunit.client.1.smithi092.stdout:6/209: rmdir d3/d31 0 2024-09-17T01:52:01.972 INFO:tasks.workunit.client.0.smithi031.stdout:5/324: write da/dc/d2e/f59 [573684,13870] 0 2024-09-17T01:52:01.972 INFO:tasks.workunit.client.1.smithi092.stdout:3/118: creat d4/f28 x:0 0 0 2024-09-17T01:52:01.973 INFO:tasks.workunit.client.1.smithi092.stdout:7/250: dwrite d3/db/f1e [0,4194304] 0 2024-09-17T01:52:01.974 INFO:tasks.workunit.client.1.smithi092.stdout:4/95: truncate d4/d5/d8/d19/f1a 52139 0 2024-09-17T01:52:01.975 INFO:tasks.workunit.client.1.smithi092.stdout:4/96: stat c3 0 2024-09-17T01:52:01.976 INFO:tasks.workunit.client.1.smithi092.stdout:6/210: truncate d3/d10/d1f/f30 91449 0 2024-09-17T01:52:01.976 INFO:tasks.workunit.client.1.smithi092.stdout:7/251: write d3/db/f15 [1223746,22177] 0 2024-09-17T01:52:01.976 INFO:tasks.workunit.client.1.smithi092.stdout:3/119: creat d4/d16/d1b/f29 x:0 0 0 2024-09-17T01:52:01.978 INFO:tasks.workunit.client.0.smithi031.stdout:1/381: creat d4/d3d/d65/d78/f7d x:0 0 0 2024-09-17T01:52:01.978 INFO:tasks.workunit.client.1.smithi092.stdout:3/120: write d4/d16/d1b/f21 [58378,127176] 0 2024-09-17T01:52:01.978 INFO:tasks.workunit.client.0.smithi031.stdout:6/456: dread f1e [0,4194304] 0 2024-09-17T01:52:01.980 INFO:tasks.workunit.client.0.smithi031.stdout:6/457: chown d23/d63/d47/f83 2042 1 2024-09-17T01:52:01.981 INFO:tasks.workunit.client.0.smithi031.stdout:1/382: truncate d4/d3d/d65/f75 659431 0 2024-09-17T01:52:01.982 INFO:tasks.workunit.client.0.smithi031.stdout:1/383: stat d4/d1a/d2d/lf 0 2024-09-17T01:52:01.983 INFO:tasks.workunit.client.0.smithi031.stdout:5/325: truncate da/d42/d12/d4a/f60 270423 0 2024-09-17T01:52:01.984 INFO:tasks.workunit.client.1.smithi092.stdout:7/252: creat d3/d6/d13/d21/f5c x:0 0 0 2024-09-17T01:52:01.986 INFO:tasks.workunit.client.1.smithi092.stdout:7/253: dread d3/db/d18/f2c [0,4194304] 0 2024-09-17T01:52:01.987 INFO:tasks.workunit.client.0.smithi031.stdout:6/458: rename d23/f2e to d23/d50/d6a/d72/d75/f95 0 2024-09-17T01:52:01.990 INFO:tasks.workunit.client.0.smithi031.stdout:5/326: symlink da/d42/d26/l6e 0 2024-09-17T01:52:01.990 INFO:tasks.workunit.client.1.smithi092.stdout:7/254: symlink d3/d6/l5d 0 2024-09-17T01:52:01.991 INFO:tasks.workunit.client.0.smithi031.stdout:5/327: read da/d42/f51 [1704689,44133] 0 2024-09-17T01:52:01.992 INFO:tasks.workunit.client.1.smithi092.stdout:4/97: rename d4/d5/d8/d19 to d4/d5/d1d 0 2024-09-17T01:52:01.992 INFO:tasks.workunit.client.0.smithi031.stdout:5/328: dread - da/dc/d2e/f4c zero size 2024-09-17T01:52:01.993 INFO:tasks.workunit.client.0.smithi031.stdout:6/459: creat d23/d50/d6a/d72/f96 x:0 0 0 2024-09-17T01:52:01.994 INFO:tasks.workunit.client.1.smithi092.stdout:4/98: dread - d4/d13/f1c zero size 2024-09-17T01:52:01.994 INFO:tasks.workunit.client.1.smithi092.stdout:8/216: getdents d15/d25/d2b 0 2024-09-17T01:52:01.994 INFO:tasks.workunit.client.0.smithi031.stdout:6/460: stat d23/d63/l90 0 2024-09-17T01:52:01.996 INFO:tasks.workunit.client.0.smithi031.stdout:7/345: fsync db/d1c/d46/f60 0 2024-09-17T01:52:01.997 INFO:tasks.workunit.client.1.smithi092.stdout:4/99: truncate d4/d13/f17 2361286 0 2024-09-17T01:52:01.999 INFO:tasks.workunit.client.1.smithi092.stdout:7/255: dwrite d3/db/d18/f53 [0,4194304] 0 2024-09-17T01:52:01.999 INFO:tasks.workunit.client.0.smithi031.stdout:1/384: getdents d4/d1e 0 2024-09-17T01:52:01.999 INFO:tasks.workunit.client.0.smithi031.stdout:6/461: symlink d23/d63/d47/l97 0 2024-09-17T01:52:02.000 INFO:tasks.workunit.client.1.smithi092.stdout:4/100: creat d4/f1e x:0 0 0 2024-09-17T01:52:02.003 INFO:tasks.workunit.client.1.smithi092.stdout:7/256: creat d3/db/f5e x:0 0 0 2024-09-17T01:52:02.003 INFO:tasks.workunit.client.1.smithi092.stdout:6/211: fsync d3/d10/f20 0 2024-09-17T01:52:02.004 INFO:tasks.workunit.client.0.smithi031.stdout:7/346: dread db/d1c/f63 [0,4194304] 0 2024-09-17T01:52:02.005 INFO:tasks.workunit.client.1.smithi092.stdout:4/101: mknod d4/d5/c1f 0 2024-09-17T01:52:02.006 INFO:tasks.workunit.client.0.smithi031.stdout:6/462: mknod d23/d50/d6a/d70/d74/c98 0 2024-09-17T01:52:02.007 INFO:tasks.workunit.client.1.smithi092.stdout:8/217: dwrite d15/d25/d2b/f36 [0,4194304] 0 2024-09-17T01:52:02.008 INFO:tasks.workunit.client.0.smithi031.stdout:6/463: truncate d23/f39 4474352 0 2024-09-17T01:52:02.008 INFO:tasks.workunit.client.1.smithi092.stdout:4/102: write d4/d5/f15 [215379,98880] 0 2024-09-17T01:52:02.009 INFO:tasks.workunit.client.0.smithi031.stdout:5/329: link da/d42/f5c da/f6f 0 2024-09-17T01:52:02.009 INFO:tasks.workunit.client.1.smithi092.stdout:6/212: mknod d3/d10/c3f 0 2024-09-17T01:52:02.011 INFO:tasks.workunit.client.0.smithi031.stdout:5/330: chown da/d14/l33 234150996 1 2024-09-17T01:52:02.011 INFO:tasks.workunit.client.1.smithi092.stdout:7/257: creat d3/d6/d13/d21/d2e/f5f x:0 0 0 2024-09-17T01:52:02.013 INFO:tasks.workunit.client.0.smithi031.stdout:1/385: dwrite d4/d1a/d2d/fe [0,4194304] 0 2024-09-17T01:52:02.014 INFO:tasks.workunit.client.1.smithi092.stdout:7/258: readlink d3/db/d26/l39 0 2024-09-17T01:52:02.016 INFO:tasks.workunit.client.1.smithi092.stdout:6/213: write d3/d10/d1f/f30 [619155,83241] 0 2024-09-17T01:52:02.017 INFO:tasks.workunit.client.1.smithi092.stdout:3/121: dwrite d4/d16/f1c [0,4194304] 0 2024-09-17T01:52:02.019 INFO:tasks.workunit.client.0.smithi031.stdout:7/347: rmdir db 39 2024-09-17T01:52:02.019 INFO:tasks.workunit.client.1.smithi092.stdout:7/259: mkdir d3/d6/d13/d40/d60 0 2024-09-17T01:52:02.021 INFO:tasks.workunit.client.1.smithi092.stdout:3/122: mknod d4/d20/c2a 0 2024-09-17T01:52:02.022 INFO:tasks.workunit.client.1.smithi092.stdout:8/218: dwrite d15/d25/f3c [0,4194304] 0 2024-09-17T01:52:02.023 INFO:tasks.workunit.client.1.smithi092.stdout:4/103: dread f2 [0,4194304] 0 2024-09-17T01:52:02.023 INFO:tasks.workunit.client.1.smithi092.stdout:3/123: write d4/d13/f14 [335420,24457] 0 2024-09-17T01:52:02.024 INFO:tasks.workunit.client.0.smithi031.stdout:1/386: dwrite d4/d1e/d3f/d4d/f6f [0,4194304] 0 2024-09-17T01:52:02.025 INFO:tasks.workunit.client.1.smithi092.stdout:7/260: unlink d3/c5b 0 2024-09-17T01:52:02.025 INFO:tasks.workunit.client.0.smithi031.stdout:6/464: creat d23/d50/d6a/d70/d74/f99 x:0 0 0 2024-09-17T01:52:02.025 INFO:tasks.workunit.client.1.smithi092.stdout:6/214: symlink d3/dd/d19/d3d/l40 0 2024-09-17T01:52:02.026 INFO:tasks.workunit.client.1.smithi092.stdout:7/261: dread - d3/d6/d13/d40/f55 zero size 2024-09-17T01:52:02.027 INFO:tasks.workunit.client.1.smithi092.stdout:7/262: readlink d3/db/d26/l39 0 2024-09-17T01:52:02.028 INFO:tasks.workunit.client.1.smithi092.stdout:4/104: mkdir d4/d13/d20 0 2024-09-17T01:52:02.029 INFO:tasks.workunit.client.1.smithi092.stdout:4/105: write d4/f1e [699930,20207] 0 2024-09-17T01:52:02.029 INFO:tasks.workunit.client.1.smithi092.stdout:3/124: unlink d4/lf 0 2024-09-17T01:52:02.030 INFO:tasks.workunit.client.0.smithi031.stdout:6/465: fdatasync f1d 0 2024-09-17T01:52:02.030 INFO:tasks.workunit.client.0.smithi031.stdout:1/387: mkdir d4/d1e/d3f/d72/d7e 0 2024-09-17T01:52:02.031 INFO:tasks.workunit.client.0.smithi031.stdout:7/348: stat db/l35 0 2024-09-17T01:52:02.032 INFO:tasks.workunit.client.1.smithi092.stdout:3/125: fdatasync d4/f28 0 2024-09-17T01:52:02.032 INFO:tasks.workunit.client.0.smithi031.stdout:6/466: fsync d23/d50/d6a/d72/f96 0 2024-09-17T01:52:02.033 INFO:tasks.workunit.client.1.smithi092.stdout:4/106: chown d4/d5/d1d/f1a 10989 1 2024-09-17T01:52:02.033 INFO:tasks.workunit.client.0.smithi031.stdout:1/388: chown d4/d1e/l62 1 1 2024-09-17T01:52:02.034 INFO:tasks.workunit.client.0.smithi031.stdout:7/349: write db/d1c/d41/f44 [2573821,73154] 0 2024-09-17T01:52:02.036 INFO:tasks.workunit.client.0.smithi031.stdout:9/259: sync 2024-09-17T01:52:02.036 INFO:tasks.workunit.client.1.smithi092.stdout:8/219: dwrite d15/d32/f38 [0,4194304] 0 2024-09-17T01:52:02.037 INFO:tasks.workunit.client.1.smithi092.stdout:4/107: chown d4/d13/f17 13518002 1 2024-09-17T01:52:02.037 INFO:tasks.workunit.client.0.smithi031.stdout:6/467: symlink d23/d63/d47/l9a 0 2024-09-17T01:52:02.037 INFO:tasks.workunit.client.1.smithi092.stdout:4/108: fsync d4/d13/f1c 0 2024-09-17T01:52:02.039 INFO:tasks.workunit.client.1.smithi092.stdout:4/109: readlink d4/d5/d8/lb 0 2024-09-17T01:52:02.042 INFO:tasks.workunit.client.1.smithi092.stdout:6/215: link d3/d10/d1f/d21/d1e/f23 d3/d10/d1f/d21/d28/d2b/f41 0 2024-09-17T01:52:02.042 INFO:tasks.workunit.client.1.smithi092.stdout:3/126: mkdir d4/d16/d1b/d2b 0 2024-09-17T01:52:02.044 INFO:tasks.workunit.client.1.smithi092.stdout:8/220: link d15/f1c d15/d25/d27/f41 0 2024-09-17T01:52:02.045 INFO:tasks.workunit.client.1.smithi092.stdout:3/127: write d4/f28 [854061,100672] 0 2024-09-17T01:52:02.046 INFO:tasks.workunit.client.1.smithi092.stdout:6/216: rename d3/c29 to d3/dd/d18/c42 0 2024-09-17T01:52:02.048 INFO:tasks.workunit.client.1.smithi092.stdout:3/128: fsync d4/f18 0 2024-09-17T01:52:02.050 INFO:tasks.workunit.client.1.smithi092.stdout:4/110: dwrite d4/f1e [0,4194304] 0 2024-09-17T01:52:02.050 INFO:tasks.workunit.client.1.smithi092.stdout:3/129: read d4/d16/f1c [650469,103599] 0 2024-09-17T01:52:02.052 INFO:tasks.workunit.client.1.smithi092.stdout:6/217: mkdir d3/d10/d1a/d43 0 2024-09-17T01:52:02.052 INFO:tasks.workunit.client.1.smithi092.stdout:4/111: rename d4/d5/d1d to d4/d5/d1d/d21 22 2024-09-17T01:52:02.054 INFO:tasks.workunit.client.1.smithi092.stdout:8/221: dread d15/f1e [4194304,4194304] 0 2024-09-17T01:52:02.054 INFO:tasks.workunit.client.1.smithi092.stdout:8/222: chown d15/l20 115005494 1 2024-09-17T01:52:02.056 INFO:tasks.workunit.client.0.smithi031.stdout:7/350: mknod db/d29/c65 0 2024-09-17T01:52:02.056 INFO:tasks.workunit.client.0.smithi031.stdout:6/468: truncate d23/d63/f5d 772382 0 2024-09-17T01:52:02.058 INFO:tasks.workunit.client.0.smithi031.stdout:9/260: creat d3/d19/d1f/d44/f57 x:0 0 0 2024-09-17T01:52:02.059 INFO:tasks.workunit.client.1.smithi092.stdout:6/218: link d3/f3a d3/f44 0 2024-09-17T01:52:02.059 INFO:tasks.workunit.client.1.smithi092.stdout:4/112: link c3 d4/c22 0 2024-09-17T01:52:02.059 INFO:tasks.workunit.client.1.smithi092.stdout:4/113: readlink d4/d5/l11 0 2024-09-17T01:52:02.059 INFO:tasks.workunit.client.1.smithi092.stdout:6/219: chown d3/d10/d1a/f24 11903917 1 2024-09-17T01:52:02.061 INFO:tasks.workunit.client.1.smithi092.stdout:6/220: write d3/f3a [753407,128618] 0 2024-09-17T01:52:02.062 INFO:tasks.workunit.client.1.smithi092.stdout:4/114: symlink d4/d5/d1d/l23 0 2024-09-17T01:52:02.063 INFO:tasks.workunit.client.1.smithi092.stdout:6/221: rename d3 to d3/d10/d45 22 2024-09-17T01:52:02.064 INFO:tasks.workunit.client.1.smithi092.stdout:4/115: creat d4/f24 x:0 0 0 2024-09-17T01:52:02.065 INFO:tasks.workunit.client.1.smithi092.stdout:4/116: dread - d4/d13/f1c zero size 2024-09-17T01:52:02.065 INFO:tasks.workunit.client.1.smithi092.stdout:4/117: readlink d4/lf 0 2024-09-17T01:52:02.066 INFO:tasks.workunit.client.1.smithi092.stdout:4/118: fdatasync f2 0 2024-09-17T01:52:02.067 INFO:tasks.workunit.client.0.smithi031.stdout:1/389: dwrite d4/d1a/d2d/fe [0,4194304] 0 2024-09-17T01:52:02.068 INFO:tasks.workunit.client.0.smithi031.stdout:7/351: dread db/d1c/d46/f60 [0,4194304] 0 2024-09-17T01:52:02.069 INFO:tasks.workunit.client.1.smithi092.stdout:4/119: rename d4/d5/d8/lb to d4/d13/d20/l25 0 2024-09-17T01:52:02.070 INFO:tasks.workunit.client.1.smithi092.stdout:6/222: dread d3/d10/d1f/f30 [0,4194304] 0 2024-09-17T01:52:02.070 INFO:tasks.workunit.client.0.smithi031.stdout:6/469: rename d23/d50/d8a/c8e to d23/d50/c9b 0 2024-09-17T01:52:02.071 INFO:tasks.workunit.client.1.smithi092.stdout:6/223: fsync d3/fa 0 2024-09-17T01:52:02.071 INFO:tasks.workunit.client.1.smithi092.stdout:4/120: creat d4/d5/d1d/f26 x:0 0 0 2024-09-17T01:52:02.072 INFO:tasks.workunit.client.1.smithi092.stdout:6/224: write d3/f8 [287850,38255] 0 2024-09-17T01:52:02.073 INFO:tasks.workunit.client.1.smithi092.stdout:4/121: write d4/d5/d1d/f26 [109931,19495] 0 2024-09-17T01:52:02.073 INFO:tasks.workunit.client.0.smithi031.stdout:1/390: symlink d4/l7f 0 2024-09-17T01:52:02.075 INFO:tasks.workunit.client.1.smithi092.stdout:6/225: symlink d3/dd/l46 0 2024-09-17T01:52:02.075 INFO:tasks.workunit.client.0.smithi031.stdout:9/261: getdents d3/d4c 0 2024-09-17T01:52:02.076 INFO:tasks.workunit.client.1.smithi092.stdout:4/122: creat d4/d13/d20/f27 x:0 0 0 2024-09-17T01:52:02.077 INFO:tasks.workunit.client.0.smithi031.stdout:6/470: mknod d23/d50/d6a/d70/d74/c9c 0 2024-09-17T01:52:02.078 INFO:tasks.workunit.client.1.smithi092.stdout:1/208: sync 2024-09-17T01:52:02.079 INFO:tasks.workunit.client.1.smithi092.stdout:1/209: chown f6 148 1 2024-09-17T01:52:02.080 INFO:tasks.workunit.client.0.smithi031.stdout:7/352: rename db/d29/c65 to db/c66 0 2024-09-17T01:52:02.080 INFO:tasks.workunit.client.0.smithi031.stdout:9/262: rmdir d3/d4c 39 2024-09-17T01:52:02.081 INFO:tasks.workunit.client.1.smithi092.stdout:1/210: write db/f2b [605430,102667] 0 2024-09-17T01:52:02.081 INFO:tasks.workunit.client.1.smithi092.stdout:6/226: dwrite d3/d10/d1a/f24 [4194304,4194304] 0 2024-09-17T01:52:02.084 INFO:tasks.workunit.client.0.smithi031.stdout:6/471: symlink d23/d50/d64/d67/l9d 0 2024-09-17T01:52:02.084 INFO:tasks.workunit.client.1.smithi092.stdout:1/211: mkdir db/d1d/d44 0 2024-09-17T01:52:02.085 INFO:tasks.workunit.client.1.smithi092.stdout:6/227: symlink d3/l47 0 2024-09-17T01:52:02.085 INFO:tasks.workunit.client.0.smithi031.stdout:6/472: dread - d23/f5c zero size 2024-09-17T01:52:02.086 INFO:tasks.workunit.client.1.smithi092.stdout:6/228: fsync d3/d10/d1f/d21/f3b 0 2024-09-17T01:52:02.086 INFO:tasks.workunit.client.0.smithi031.stdout:7/353: chown db/d18/f25 73 1 2024-09-17T01:52:02.091 INFO:tasks.workunit.client.1.smithi092.stdout:1/212: dwrite db/fd [0,4194304] 0 2024-09-17T01:52:02.091 INFO:tasks.workunit.client.0.smithi031.stdout:9/263: dwrite d3/d10/f1a [0,4194304] 0 2024-09-17T01:52:02.092 INFO:tasks.workunit.client.1.smithi092.stdout:7/263: getdents d3 0 2024-09-17T01:52:02.094 INFO:tasks.workunit.client.0.smithi031.stdout:6/473: unlink d23/d50/d6a/l94 0 2024-09-17T01:52:02.095 INFO:tasks.workunit.client.0.smithi031.stdout:5/331: truncate da/dc/d2e/f59 441489 0 2024-09-17T01:52:02.096 INFO:tasks.workunit.client.0.smithi031.stdout:1/391: getdents d4/d3d/d65/d78 0 2024-09-17T01:52:02.098 INFO:tasks.workunit.client.0.smithi031.stdout:1/392: fdatasync d4/d3d/d65/f75 0 2024-09-17T01:52:02.098 INFO:tasks.workunit.client.0.smithi031.stdout:7/354: rmdir db/d1c/d46 39 2024-09-17T01:52:02.101 INFO:tasks.workunit.client.0.smithi031.stdout:1/393: chown d4/d1a/d2d/d18/c6b 57 1 2024-09-17T01:52:02.103 INFO:tasks.workunit.client.1.smithi092.stdout:8/223: rmdir d15 39 2024-09-17T01:52:02.104 INFO:tasks.workunit.client.0.smithi031.stdout:9/264: link d3/d10/f1a d3/d19/d1f/f58 0 2024-09-17T01:52:02.105 INFO:tasks.workunit.client.0.smithi031.stdout:9/265: fsync d3/d19/f22 0 2024-09-17T01:52:02.107 INFO:tasks.workunit.client.0.smithi031.stdout:9/266: readlink d3/d10/d36/l37 0 2024-09-17T01:52:02.107 INFO:tasks.workunit.client.0.smithi031.stdout:7/355: mkdir db/d18/d67 0 2024-09-17T01:52:02.109 INFO:tasks.workunit.client.1.smithi092.stdout:4/123: stat d4/d13/d20/l25 0 2024-09-17T01:52:02.113 INFO:tasks.workunit.client.1.smithi092.stdout:6/229: rename d3/dd to d3/d10/d1f/d21/d28/d2b/d48 0 2024-09-17T01:52:02.113 INFO:tasks.workunit.client.1.smithi092.stdout:6/230: chown d3/d10/c3f 1690425 1 2024-09-17T01:52:02.115 INFO:tasks.workunit.client.0.smithi031.stdout:5/332: truncate da/d42/d26/f39 3290698 0 2024-09-17T01:52:02.116 INFO:tasks.workunit.client.0.smithi031.stdout:9/267: mkdir d3/d59 0 2024-09-17T01:52:02.117 INFO:tasks.workunit.client.0.smithi031.stdout:9/268: chown d3/d4/f2f 125221 1 2024-09-17T01:52:02.119 INFO:tasks.workunit.client.0.smithi031.stdout:9/269: stat d3/d4/c2c 0 2024-09-17T01:52:02.120 INFO:tasks.workunit.client.1.smithi092.stdout:1/213: creat db/d1d/d23/f45 x:0 0 0 2024-09-17T01:52:02.120 INFO:tasks.workunit.client.1.smithi092.stdout:7/264: truncate d3/f4b 11423 0 2024-09-17T01:52:02.121 INFO:tasks.workunit.client.1.smithi092.stdout:8/224: truncate f9 1385127 0 2024-09-17T01:52:02.122 INFO:tasks.workunit.client.0.smithi031.stdout:7/356: symlink db/d1c/d46/l68 0 2024-09-17T01:52:02.123 INFO:tasks.workunit.client.1.smithi092.stdout:6/231: getdents d3/d10/d1f/d21/d1e 0 2024-09-17T01:52:02.124 INFO:tasks.workunit.client.1.smithi092.stdout:4/124: truncate d4/d5/d1d/f26 77894 0 2024-09-17T01:52:02.124 INFO:tasks.workunit.client.1.smithi092.stdout:6/232: truncate d3/f15 4572310 0 2024-09-17T01:52:02.125 INFO:tasks.workunit.client.0.smithi031.stdout:5/333: creat da/d42/d12/d64/f70 x:0 0 0 2024-09-17T01:52:02.126 INFO:tasks.workunit.client.1.smithi092.stdout:7/265: unlink d3/d6/d13/d21/d2e/f5f 0 2024-09-17T01:52:02.127 INFO:tasks.workunit.client.1.smithi092.stdout:1/214: write db/d1d/d2e/f32 [661509,12235] 0 2024-09-17T01:52:02.128 INFO:tasks.workunit.client.0.smithi031.stdout:9/270: mknod d3/d4/d29/c5a 0 2024-09-17T01:52:02.129 INFO:tasks.workunit.client.1.smithi092.stdout:4/125: mknod d4/d13/d20/c28 0 2024-09-17T01:52:02.130 INFO:tasks.workunit.client.1.smithi092.stdout:7/266: mkdir d3/d6/d13/d40/d61 0 2024-09-17T01:52:02.130 INFO:tasks.workunit.client.1.smithi092.stdout:4/126: write d4/d13/f1c [577083,96752] 0 2024-09-17T01:52:02.131 INFO:tasks.workunit.client.1.smithi092.stdout:1/215: fsync db/d3b/f42 0 2024-09-17T01:52:02.132 INFO:tasks.workunit.client.1.smithi092.stdout:4/127: dread - d4/d13/d20/f27 zero size 2024-09-17T01:52:02.132 INFO:tasks.workunit.client.1.smithi092.stdout:7/267: write d3/db/f5e [517737,104786] 0 2024-09-17T01:52:02.133 INFO:tasks.workunit.client.0.smithi031.stdout:6/474: dwrite f1c [0,4194304] 0 2024-09-17T01:52:02.133 INFO:tasks.workunit.client.1.smithi092.stdout:1/216: read db/d1d/d23/f25 [2964634,37925] 0 2024-09-17T01:52:02.133 INFO:tasks.workunit.client.1.smithi092.stdout:8/225: mkdir d15/d32/d40/d42 0 2024-09-17T01:52:02.134 INFO:tasks.workunit.client.0.smithi031.stdout:1/394: dread d4/d1e/f3b [0,4194304] 0 2024-09-17T01:52:02.135 INFO:tasks.workunit.client.1.smithi092.stdout:4/128: write d4/d5/d1d/f1a [235004,108873] 0 2024-09-17T01:52:02.135 INFO:tasks.workunit.client.1.smithi092.stdout:8/226: fdatasync d15/f1a 0 2024-09-17T01:52:02.136 INFO:tasks.workunit.client.0.smithi031.stdout:7/357: mkdir db/d1c/d41/d69 0 2024-09-17T01:52:02.136 INFO:tasks.workunit.client.0.smithi031.stdout:7/358: stat db/l3f 0 2024-09-17T01:52:02.137 INFO:tasks.workunit.client.0.smithi031.stdout:7/359: write db/fe [3397398,9843] 0 2024-09-17T01:52:02.139 INFO:tasks.workunit.client.1.smithi092.stdout:7/268: creat d3/db/d26/f62 x:0 0 0 2024-09-17T01:52:02.140 INFO:tasks.workunit.client.1.smithi092.stdout:7/269: fdatasync d3/db/f54 0 2024-09-17T01:52:02.140 INFO:tasks.workunit.client.1.smithi092.stdout:7/270: stat d3/db/f4a 0 2024-09-17T01:52:02.142 INFO:tasks.workunit.client.0.smithi031.stdout:6/475: mknod d23/d50/d6a/c9e 0 2024-09-17T01:52:02.146 INFO:tasks.workunit.client.1.smithi092.stdout:1/217: truncate db/d1d/f22 1233683 0 2024-09-17T01:52:02.146 INFO:tasks.workunit.client.1.smithi092.stdout:1/218: readlink la 0 2024-09-17T01:52:02.147 INFO:tasks.workunit.client.0.smithi031.stdout:1/395: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:52:02.147 INFO:tasks.workunit.client.0.smithi031.stdout:6/476: chown d23/l4e 77822391 1 2024-09-17T01:52:02.149 INFO:tasks.workunit.client.1.smithi092.stdout:7/271: mknod d3/d2b/d3a/d5a/c63 0 2024-09-17T01:52:02.150 INFO:tasks.workunit.client.0.smithi031.stdout:7/360: write db/d1c/f1d [4870378,39247] 0 2024-09-17T01:52:02.152 INFO:tasks.workunit.client.1.smithi092.stdout:8/227: mkdir d15/d32/d40/d42/d43 0 2024-09-17T01:52:02.152 INFO:tasks.workunit.client.1.smithi092.stdout:1/219: dwrite db/f2b [0,4194304] 0 2024-09-17T01:52:02.154 INFO:tasks.workunit.client.1.smithi092.stdout:8/228: write d15/f1f [776949,19282] 0 2024-09-17T01:52:02.157 INFO:tasks.workunit.client.0.smithi031.stdout:6/477: dwrite d23/f31 [0,4194304] 0 2024-09-17T01:52:02.159 INFO:tasks.workunit.client.1.smithi092.stdout:6/233: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:52:02.161 INFO:tasks.workunit.client.0.smithi031.stdout:9/271: link d3/d19/d1f/c51 d3/d4c/c5b 0 2024-09-17T01:52:02.162 INFO:tasks.workunit.client.1.smithi092.stdout:4/129: getdents d4/d5 0 2024-09-17T01:52:02.163 INFO:tasks.workunit.client.1.smithi092.stdout:1/220: unlink db/d1d/d23/l38 0 2024-09-17T01:52:02.165 INFO:tasks.workunit.client.0.smithi031.stdout:7/361: dwrite db/d1c/d41/f4d [0,4194304] 0 2024-09-17T01:52:02.166 INFO:tasks.workunit.client.0.smithi031.stdout:9/272: read d3/f8 [2966902,106400] 0 2024-09-17T01:52:02.168 INFO:tasks.workunit.client.1.smithi092.stdout:7/272: creat d3/d6/f64 x:0 0 0 2024-09-17T01:52:02.168 INFO:tasks.workunit.client.0.smithi031.stdout:6/478: mknod d23/d50/c9f 0 2024-09-17T01:52:02.169 INFO:tasks.workunit.client.1.smithi092.stdout:6/234: mkdir d3/d10/d1a/d49 0 2024-09-17T01:52:02.171 INFO:tasks.workunit.client.1.smithi092.stdout:6/235: write d3/fa [2219711,3914] 0 2024-09-17T01:52:02.171 INFO:tasks.workunit.client.1.smithi092.stdout:1/221: rmdir db/d1d 39 2024-09-17T01:52:02.173 INFO:tasks.workunit.client.1.smithi092.stdout:7/273: mkdir d3/db/d26/d65 0 2024-09-17T01:52:02.174 INFO:tasks.workunit.client.1.smithi092.stdout:1/222: truncate f6 1316523 0 2024-09-17T01:52:02.174 INFO:tasks.workunit.client.0.smithi031.stdout:1/396: dwrite d4/d1a/d2d/d18/d52/f63 [0,4194304] 0 2024-09-17T01:52:02.174 INFO:tasks.workunit.client.0.smithi031.stdout:1/397: stat d4/d1a/f1d 0 2024-09-17T01:52:02.175 INFO:tasks.workunit.client.1.smithi092.stdout:1/223: rename db to db/d1d/d23/d46 22 2024-09-17T01:52:02.176 INFO:tasks.workunit.client.1.smithi092.stdout:7/274: creat d3/db/d26/f66 x:0 0 0 2024-09-17T01:52:02.176 INFO:tasks.workunit.client.1.smithi092.stdout:1/224: truncate db/f2b 4225309 0 2024-09-17T01:52:02.176 INFO:tasks.workunit.client.0.smithi031.stdout:6/479: fdatasync d23/f39 0 2024-09-17T01:52:02.176 INFO:tasks.workunit.client.0.smithi031.stdout:9/273: write d3/f2a [749668,14206] 0 2024-09-17T01:52:02.177 INFO:tasks.workunit.client.1.smithi092.stdout:6/236: creat d3/d10/d1a/d43/f4a x:0 0 0 2024-09-17T01:52:02.178 INFO:tasks.workunit.client.1.smithi092.stdout:7/275: unlink d3/f14 0 2024-09-17T01:52:02.179 INFO:tasks.workunit.client.0.smithi031.stdout:7/362: creat db/d18/f6a x:0 0 0 2024-09-17T01:52:02.180 INFO:tasks.workunit.client.0.smithi031.stdout:1/398: rmdir d4 39 2024-09-17T01:52:02.180 INFO:tasks.workunit.client.0.smithi031.stdout:5/334: dwrite da/d42/d12/f19 [0,4194304] 0 2024-09-17T01:52:02.184 INFO:tasks.workunit.client.0.smithi031.stdout:6/480: mkdir d23/d63/d47/d81/da0 0 2024-09-17T01:52:02.184 INFO:tasks.workunit.client.0.smithi031.stdout:7/363: stat db/d1c/d41/f4d 0 2024-09-17T01:52:02.185 INFO:tasks.workunit.client.1.smithi092.stdout:1/225: symlink db/l47 0 2024-09-17T01:52:02.189 INFO:tasks.workunit.client.0.smithi031.stdout:5/335: creat da/d42/d12/d4a/f71 x:0 0 0 2024-09-17T01:52:02.191 INFO:tasks.workunit.client.0.smithi031.stdout:9/274: dwrite d3/d4c/f4f [0,4194304] 0 2024-09-17T01:52:02.191 INFO:tasks.workunit.client.0.smithi031.stdout:1/399: dread f3 [0,4194304] 0 2024-09-17T01:52:02.193 INFO:tasks.workunit.client.0.smithi031.stdout:6/481: symlink d23/d50/la1 0 2024-09-17T01:52:02.202 INFO:tasks.workunit.client.0.smithi031.stdout:6/482: symlink d23/d63/la2 0 2024-09-17T01:52:02.206 INFO:tasks.workunit.client.1.smithi092.stdout:1/226: dread f6 [0,4194304] 0 2024-09-17T01:52:02.208 INFO:tasks.workunit.client.0.smithi031.stdout:9/275: dwrite d3/d19/d1f/f21 [0,4194304] 0 2024-09-17T01:52:02.210 INFO:tasks.workunit.client.1.smithi092.stdout:1/227: rename f6 to db/d3b/f48 0 2024-09-17T01:52:02.212 INFO:tasks.workunit.client.0.smithi031.stdout:9/276: readlink d3/d19/d1f/l45 0 2024-09-17T01:52:02.212 INFO:tasks.workunit.client.0.smithi031.stdout:6/483: mknod d23/d50/d6a/d70/d74/d92/ca3 0 2024-09-17T01:52:02.213 INFO:tasks.workunit.client.1.smithi092.stdout:1/228: write db/d1d/d23/f3a [875303,7265] 0 2024-09-17T01:52:02.214 INFO:tasks.workunit.client.1.smithi092.stdout:6/237: dwrite d3/d10/d1f/d21/d28/d2b/f2e [0,4194304] 0 2024-09-17T01:52:02.215 INFO:tasks.workunit.client.0.smithi031.stdout:1/400: dwrite d4/d1e/f70 [0,4194304] 0 2024-09-17T01:52:02.216 INFO:tasks.workunit.client.1.smithi092.stdout:1/229: truncate db/d3b/f42 4530196 0 2024-09-17T01:52:02.218 INFO:tasks.workunit.client.0.smithi031.stdout:6/484: symlink d23/la4 0 2024-09-17T01:52:02.220 INFO:tasks.workunit.client.1.smithi092.stdout:1/230: dread - db/d1d/f40 zero size 2024-09-17T01:52:02.220 INFO:tasks.workunit.client.0.smithi031.stdout:5/336: dwrite da/d42/d12/f23 [0,4194304] 0 2024-09-17T01:52:02.221 INFO:tasks.workunit.client.0.smithi031.stdout:6/485: readlink d23/d63/d47/l6e 0 2024-09-17T01:52:02.223 INFO:tasks.workunit.client.0.smithi031.stdout:1/401: write d4/d1a/f1d [2508449,62728] 0 2024-09-17T01:52:02.225 INFO:tasks.workunit.client.1.smithi092.stdout:1/231: symlink db/d1d/l49 0 2024-09-17T01:52:02.227 INFO:tasks.workunit.client.1.smithi092.stdout:6/238: dwrite d3/d10/d1f/d21/d28/d2b/d48/d18/f27 [0,4194304] 0 2024-09-17T01:52:02.227 INFO:tasks.workunit.client.0.smithi031.stdout:5/337: read da/f49 [405377,21329] 0 2024-09-17T01:52:02.231 INFO:tasks.workunit.client.0.smithi031.stdout:1/402: creat d4/d3d/d65/d78/f80 x:0 0 0 2024-09-17T01:52:02.231 INFO:tasks.workunit.client.0.smithi031.stdout:5/338: rmdir da/d42/d12 39 2024-09-17T01:52:02.232 INFO:tasks.workunit.client.1.smithi092.stdout:6/239: creat d3/f4b x:0 0 0 2024-09-17T01:52:02.232 INFO:tasks.workunit.client.0.smithi031.stdout:5/339: chown da 46917589 1 2024-09-17T01:52:02.233 INFO:tasks.workunit.client.1.smithi092.stdout:1/232: dread db/f2b [0,4194304] 0 2024-09-17T01:52:02.233 INFO:tasks.workunit.client.1.smithi092.stdout:6/240: chown f2 111 1 2024-09-17T01:52:02.233 INFO:tasks.workunit.client.0.smithi031.stdout:6/486: dwrite d23/d50/f53 [4194304,4194304] 0 2024-09-17T01:52:02.234 INFO:tasks.workunit.client.1.smithi092.stdout:6/241: fsync d3/f13 0 2024-09-17T01:52:02.235 INFO:tasks.workunit.client.1.smithi092.stdout:7/276: dread d3/d6/f1c [0,4194304] 0 2024-09-17T01:52:02.238 INFO:tasks.workunit.client.1.smithi092.stdout:6/242: mknod d3/d10/d1a/d43/c4c 0 2024-09-17T01:52:02.239 INFO:tasks.workunit.client.0.smithi031.stdout:6/487: write d23/d50/f5e [451788,24269] 0 2024-09-17T01:52:02.239 INFO:tasks.workunit.client.1.smithi092.stdout:7/277: chown d3/c56 4463 1 2024-09-17T01:52:02.242 INFO:tasks.workunit.client.1.smithi092.stdout:6/243: unlink d3/d10/d1f/d21/d1e/f23 0 2024-09-17T01:52:02.243 INFO:tasks.workunit.client.1.smithi092.stdout:6/244: write f2 [325458,36020] 0 2024-09-17T01:52:02.243 INFO:tasks.workunit.client.1.smithi092.stdout:6/245: chown d3/f6 14 1 2024-09-17T01:52:02.245 INFO:tasks.workunit.client.1.smithi092.stdout:1/233: rename db/d1d/c36 to db/c4a 0 2024-09-17T01:52:02.246 INFO:tasks.workunit.client.0.smithi031.stdout:1/403: rename d4/d1a/d2d/d18/l29 to d4/d1a/d2d/l81 0 2024-09-17T01:52:02.247 INFO:tasks.workunit.client.1.smithi092.stdout:7/278: link d3/d6/d13/lf d3/d6/d13/d40/d61/l67 0 2024-09-17T01:52:02.247 INFO:tasks.workunit.client.0.smithi031.stdout:6/488: creat d23/d50/fa5 x:0 0 0 2024-09-17T01:52:02.248 INFO:tasks.workunit.client.1.smithi092.stdout:1/234: truncate db/d1d/d23/f25 3368431 0 2024-09-17T01:52:02.249 INFO:tasks.workunit.client.0.smithi031.stdout:1/404: creat d4/d1e/d3f/d72/d7e/f82 x:0 0 0 2024-09-17T01:52:02.250 INFO:tasks.workunit.client.1.smithi092.stdout:1/235: unlink db/d3b/f42 0 2024-09-17T01:52:02.251 INFO:tasks.workunit.client.0.smithi031.stdout:1/405: symlink d4/d3d/d65/l83 0 2024-09-17T01:52:02.252 INFO:tasks.workunit.client.0.smithi031.stdout:1/406: mkdir d4/d1e/d40/d84 0 2024-09-17T01:52:02.253 INFO:tasks.workunit.client.1.smithi092.stdout:7/279: unlink d3/db/d26/f51 0 2024-09-17T01:52:02.255 INFO:tasks.workunit.client.1.smithi092.stdout:7/280: truncate d3/d6/d13/d21/d2e/f59 174532 0 2024-09-17T01:52:02.256 INFO:tasks.workunit.client.0.smithi031.stdout:1/407: getdents d4/d3d 0 2024-09-17T01:52:02.259 INFO:tasks.workunit.client.1.smithi092.stdout:7/281: rename d3/db/f17 to d3/d2b/d3a/d5a/f68 0 2024-09-17T01:52:02.263 INFO:tasks.workunit.client.1.smithi092.stdout:7/282: dread d3/d6/d13/f34 [0,4194304] 0 2024-09-17T01:52:02.263 INFO:tasks.workunit.client.1.smithi092.stdout:7/283: readlink d3/d2b/d37/l49 0 2024-09-17T01:52:02.264 INFO:tasks.workunit.client.1.smithi092.stdout:7/284: symlink d3/d2b/l69 0 2024-09-17T01:52:02.264 INFO:tasks.workunit.client.0.smithi031.stdout:1/408: dread d4/d1e/f4b [0,4194304] 0 2024-09-17T01:52:02.265 INFO:tasks.workunit.client.1.smithi092.stdout:7/285: write d3/d6/d13/d40/f55 [6644,95919] 0 2024-09-17T01:52:02.265 INFO:tasks.workunit.client.1.smithi092.stdout:7/286: dread - d3/d6/f64 zero size 2024-09-17T01:52:02.266 INFO:tasks.workunit.client.1.smithi092.stdout:7/287: dread - d3/db/f4a zero size 2024-09-17T01:52:02.268 INFO:tasks.workunit.client.0.smithi031.stdout:1/409: creat d4/d1e/d40/d84/f85 x:0 0 0 2024-09-17T01:52:02.268 INFO:tasks.workunit.client.1.smithi092.stdout:7/288: rmdir d3/d2b/d37 39 2024-09-17T01:52:02.270 INFO:tasks.workunit.client.0.smithi031.stdout:9/277: dread d3/d19/f22 [0,4194304] 0 2024-09-17T01:52:02.272 INFO:tasks.workunit.client.0.smithi031.stdout:1/410: symlink d4/d1a/d2d/d18/d52/l86 0 2024-09-17T01:52:02.273 INFO:tasks.workunit.client.0.smithi031.stdout:5/340: write da/d42/f51 [1972063,60869] 0 2024-09-17T01:52:02.273 INFO:tasks.workunit.client.1.smithi092.stdout:6/246: getdents d3 0 2024-09-17T01:52:02.273 INFO:tasks.workunit.client.0.smithi031.stdout:6/489: dread d23/d50/d6a/d72/d75/f95 [0,4194304] 0 2024-09-17T01:52:02.274 INFO:tasks.workunit.client.0.smithi031.stdout:6/490: stat d23/d50/d6a/d70/f8f 0 2024-09-17T01:52:02.275 INFO:tasks.workunit.client.1.smithi092.stdout:6/247: mknod d3/d10/d1a/c4d 0 2024-09-17T01:52:02.275 INFO:tasks.workunit.client.0.smithi031.stdout:9/278: getdents d3/d4c 0 2024-09-17T01:52:02.275 INFO:tasks.workunit.client.1.smithi092.stdout:6/248: chown d3/f3a 934689 1 2024-09-17T01:52:02.276 INFO:tasks.workunit.client.0.smithi031.stdout:6/491: chown d23/d50/f5e 1354261 1 2024-09-17T01:52:02.277 INFO:tasks.workunit.client.0.smithi031.stdout:1/411: symlink d4/d1e/d40/d77/l87 0 2024-09-17T01:52:02.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/492: chown d23/c46 1041863430 1 2024-09-17T01:52:02.278 INFO:tasks.workunit.client.0.smithi031.stdout:6/493: truncate f20 4366412 0 2024-09-17T01:52:02.279 INFO:tasks.workunit.client.0.smithi031.stdout:5/341: mkdir da/d42/d12/d72 0 2024-09-17T01:52:02.280 INFO:tasks.workunit.client.0.smithi031.stdout:5/342: fdatasync da/dc/f16 0 2024-09-17T01:52:02.282 INFO:tasks.workunit.client.1.smithi092.stdout:6/249: dwrite d3/f33 [0,4194304] 0 2024-09-17T01:52:02.282 INFO:tasks.workunit.client.0.smithi031.stdout:9/279: rename d3/d4c/c5b to d3/d4/d41/c5c 0 2024-09-17T01:52:02.284 INFO:tasks.workunit.client.0.smithi031.stdout:6/494: dread f1a [0,4194304] 0 2024-09-17T01:52:02.285 INFO:tasks.workunit.client.1.smithi092.stdout:6/250: mknod d3/d10/d1a/d43/c4e 0 2024-09-17T01:52:02.286 INFO:tasks.workunit.client.0.smithi031.stdout:9/280: symlink d3/d4/l5d 0 2024-09-17T01:52:02.287 INFO:tasks.workunit.client.1.smithi092.stdout:0/245: sync 2024-09-17T01:52:02.287 INFO:tasks.workunit.client.1.smithi092.stdout:5/105: sync 2024-09-17T01:52:02.287 INFO:tasks.workunit.client.1.smithi092.stdout:9/178: sync 2024-09-17T01:52:02.288 INFO:tasks.workunit.client.1.smithi092.stdout:2/146: sync 2024-09-17T01:52:02.289 INFO:tasks.workunit.client.1.smithi092.stdout:9/179: write d0/f6 [11447792,68149] 0 2024-09-17T01:52:02.290 INFO:tasks.workunit.client.1.smithi092.stdout:0/246: read d3/da/f22 [4131684,43898] 0 2024-09-17T01:52:02.290 INFO:tasks.workunit.client.1.smithi092.stdout:9/180: stat d0/d5/f8 0 2024-09-17T01:52:02.291 INFO:tasks.workunit.client.0.smithi031.stdout:6/495: unlink d23/d63/d47/l6e 0 2024-09-17T01:52:02.292 INFO:tasks.workunit.client.1.smithi092.stdout:9/181: stat d0/df/d17/f1c 0 2024-09-17T01:52:02.292 INFO:tasks.workunit.client.1.smithi092.stdout:5/106: read d0/fc [228106,58145] 0 2024-09-17T01:52:02.293 INFO:tasks.workunit.client.0.smithi031.stdout:3/259: sync 2024-09-17T01:52:02.294 INFO:tasks.workunit.client.0.smithi031.stdout:0/342: sync 2024-09-17T01:52:02.294 INFO:tasks.workunit.client.1.smithi092.stdout:5/107: fdatasync d0/fd 0 2024-09-17T01:52:02.295 INFO:tasks.workunit.client.0.smithi031.stdout:5/343: rename da/d42/f51 to da/dc/f73 0 2024-09-17T01:52:02.295 INFO:tasks.workunit.client.1.smithi092.stdout:2/147: truncate fd 2212976 0 2024-09-17T01:52:02.299 INFO:tasks.workunit.client.0.smithi031.stdout:9/281: dread d3/d10/f14 [0,4194304] 0 2024-09-17T01:52:02.299 INFO:tasks.workunit.client.1.smithi092.stdout:1/236: write db/d1d/d23/f25 [2866545,100649] 0 2024-09-17T01:52:02.300 INFO:tasks.workunit.client.1.smithi092.stdout:5/108: creat d0/de/d19/d1a/f22 x:0 0 0 2024-09-17T01:52:02.300 INFO:tasks.workunit.client.1.smithi092.stdout:1/237: write db/d1d/d23/f3f [8847,116969] 0 2024-09-17T01:52:02.301 INFO:tasks.workunit.client.0.smithi031.stdout:3/260: symlink db/df/d1c/l52 0 2024-09-17T01:52:02.301 INFO:tasks.workunit.client.1.smithi092.stdout:5/109: stat d0/de/f15 0 2024-09-17T01:52:02.302 INFO:tasks.workunit.client.1.smithi092.stdout:1/238: write db/d1d/f40 [302324,99967] 0 2024-09-17T01:52:02.304 INFO:tasks.workunit.client.0.smithi031.stdout:9/282: symlink d3/d4c/l5e 0 2024-09-17T01:52:02.305 INFO:tasks.workunit.client.1.smithi092.stdout:0/247: mknod d3/da/d1c/d3a/c4b 0 2024-09-17T01:52:02.306 INFO:tasks.workunit.client.0.smithi031.stdout:9/283: chown d3/d19/d1f/c3d 3110 1 2024-09-17T01:52:02.306 INFO:tasks.workunit.client.0.smithi031.stdout:3/261: mknod db/d29/c53 0 2024-09-17T01:52:02.308 INFO:tasks.workunit.client.1.smithi092.stdout:0/248: write d3/da/d15/d30/f3c [1694841,31508] 0 2024-09-17T01:52:02.308 INFO:tasks.workunit.client.0.smithi031.stdout:9/284: read d3/d4c/f4f [1296486,58502] 0 2024-09-17T01:52:02.308 INFO:tasks.workunit.client.0.smithi031.stdout:3/262: truncate db/f12 5006631 0 2024-09-17T01:52:02.309 INFO:tasks.workunit.client.0.smithi031.stdout:5/344: creat da/f74 x:0 0 0 2024-09-17T01:52:02.310 INFO:tasks.workunit.client.1.smithi092.stdout:2/148: dwrite d10/d15/f21 [0,4194304] 0 2024-09-17T01:52:02.311 INFO:tasks.workunit.client.1.smithi092.stdout:5/110: mkdir d0/d23 0 2024-09-17T01:52:02.315 INFO:tasks.workunit.client.1.smithi092.stdout:2/149: read d10/d1d/d24/f29 [2117127,20865] 0 2024-09-17T01:52:02.316 INFO:tasks.workunit.client.0.smithi031.stdout:0/343: dread d0/d29/d33/f35 [0,4194304] 0 2024-09-17T01:52:02.316 INFO:tasks.workunit.client.1.smithi092.stdout:1/239: dread db/f2b [0,4194304] 0 2024-09-17T01:52:02.317 INFO:tasks.workunit.client.0.smithi031.stdout:1/412: truncate d4/d1a/d2d/d18/d52/f63 2484261 0 2024-09-17T01:52:02.317 INFO:tasks.workunit.client.1.smithi092.stdout:6/251: creat d3/d10/d1f/d21/d28/d2b/d48/d19/d3d/f4f x:0 0 0 2024-09-17T01:52:02.318 INFO:tasks.workunit.client.1.smithi092.stdout:5/111: mkdir d0/de/d19/d1a/d24 0 2024-09-17T01:52:02.320 INFO:tasks.workunit.client.1.smithi092.stdout:0/249: getdents d3/d2e/d3b/d48 0 2024-09-17T01:52:02.322 INFO:tasks.workunit.client.0.smithi031.stdout:1/413: creat d4/d1e/f88 x:0 0 0 2024-09-17T01:52:02.323 INFO:tasks.workunit.client.1.smithi092.stdout:6/252: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:52:02.325 INFO:tasks.workunit.client.0.smithi031.stdout:6/496: truncate d23/f3b 2037134 0 2024-09-17T01:52:02.326 INFO:tasks.workunit.client.0.smithi031.stdout:1/414: truncate d4/d1a/f3c 372084 0 2024-09-17T01:52:02.327 INFO:tasks.workunit.client.1.smithi092.stdout:1/240: mkdir db/d1d/d4b 0 2024-09-17T01:52:02.328 INFO:tasks.workunit.client.0.smithi031.stdout:6/497: mknod d23/d50/d64/d67/ca6 0 2024-09-17T01:52:02.331 INFO:tasks.workunit.client.1.smithi092.stdout:2/150: rename d10/l28 to d10/l2f 0 2024-09-17T01:52:02.333 INFO:tasks.workunit.client.1.smithi092.stdout:6/253: creat d3/d10/d1f/d21/d28/d2b/d48/d19/f50 x:0 0 0 2024-09-17T01:52:02.335 INFO:tasks.workunit.client.1.smithi092.stdout:1/241: dwrite db/d1d/d23/f3f [0,4194304] 0 2024-09-17T01:52:02.338 INFO:tasks.workunit.client.0.smithi031.stdout:9/285: truncate d3/f15 269058 0 2024-09-17T01:52:02.339 INFO:tasks.workunit.client.1.smithi092.stdout:6/254: mknod d3/d10/d1f/d21/d28/d2b/d48/c51 0 2024-09-17T01:52:02.341 INFO:tasks.workunit.client.0.smithi031.stdout:0/344: dread d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:52:02.341 INFO:tasks.workunit.client.0.smithi031.stdout:9/286: write d3/d19/d1f/d44/f57 [241468,2797] 0 2024-09-17T01:52:02.343 INFO:tasks.workunit.client.0.smithi031.stdout:3/263: dwrite db/df/d50/f51 [0,4194304] 0 2024-09-17T01:52:02.345 INFO:tasks.workunit.client.1.smithi092.stdout:0/250: dwrite d3/f28 [0,4194304] 0 2024-09-17T01:52:02.347 INFO:tasks.workunit.client.1.smithi092.stdout:1/242: write db/d3b/f48 [2288090,29894] 0 2024-09-17T01:52:02.350 INFO:tasks.workunit.client.1.smithi092.stdout:6/255: dread d3/f3a [0,4194304] 0 2024-09-17T01:52:02.351 INFO:tasks.workunit.client.1.smithi092.stdout:0/251: symlink d3/da/d1c/d3a/l4c 0 2024-09-17T01:52:02.352 INFO:tasks.workunit.client.0.smithi031.stdout:9/287: fsync d3/d4c/f4f 0 2024-09-17T01:52:02.352 INFO:tasks.workunit.client.1.smithi092.stdout:1/243: creat db/d1d/d23/f4c x:0 0 0 2024-09-17T01:52:02.356 INFO:tasks.workunit.client.1.smithi092.stdout:6/256: creat d3/d10/d1f/f52 x:0 0 0 2024-09-17T01:52:02.356 INFO:tasks.workunit.client.1.smithi092.stdout:2/151: dwrite d10/f19 [0,4194304] 0 2024-09-17T01:52:02.357 INFO:tasks.workunit.client.1.smithi092.stdout:1/244: symlink db/d3b/l4d 0 2024-09-17T01:52:02.358 INFO:tasks.workunit.client.1.smithi092.stdout:1/245: chown db/l17 397732155 1 2024-09-17T01:52:02.358 INFO:tasks.workunit.client.0.smithi031.stdout:0/345: dwrite d0/d29/d33/d5/d48/f5a [0,4194304] 0 2024-09-17T01:52:02.359 INFO:tasks.workunit.client.1.smithi092.stdout:2/152: rmdir d10/d15 39 2024-09-17T01:52:02.360 INFO:tasks.workunit.client.1.smithi092.stdout:0/252: getdents d3/da/d1c/d47 0 2024-09-17T01:52:02.361 INFO:tasks.workunit.client.1.smithi092.stdout:1/246: chown db/d1d/f2a 822639 1 2024-09-17T01:52:02.362 INFO:tasks.workunit.client.0.smithi031.stdout:0/346: mknod d0/d29/d33/d5/d48/c7c 0 2024-09-17T01:52:02.364 INFO:tasks.workunit.client.1.smithi092.stdout:0/253: stat d3/f4 0 2024-09-17T01:52:02.364 INFO:tasks.workunit.client.1.smithi092.stdout:6/257: dread d3/d10/f20 [0,4194304] 0 2024-09-17T01:52:02.364 INFO:tasks.workunit.client.1.smithi092.stdout:2/153: chown d10/d15/f21 13059186 1 2024-09-17T01:52:02.364 INFO:tasks.workunit.client.1.smithi092.stdout:1/247: chown db/d1d/d23/f3f 4121641 1 2024-09-17T01:52:02.365 INFO:tasks.workunit.client.1.smithi092.stdout:6/258: stat d3/d10/d1f/d21/d28/f2f 0 2024-09-17T01:52:02.366 INFO:tasks.workunit.client.1.smithi092.stdout:1/248: fsync db/d1d/d23/f45 0 2024-09-17T01:52:02.367 INFO:tasks.workunit.client.0.smithi031.stdout:9/288: dwrite d3/d4/d29/f4b [0,4194304] 0 2024-09-17T01:52:02.367 INFO:tasks.workunit.client.1.smithi092.stdout:1/249: fsync db/d1d/d23/f3a 0 2024-09-17T01:52:02.368 INFO:tasks.workunit.client.1.smithi092.stdout:6/259: readlink d3/d10/d1f/d21/d28/d2b/d48/d19/l35 0 2024-09-17T01:52:02.368 INFO:tasks.workunit.client.1.smithi092.stdout:0/254: rmdir d3/da/d1c/d3a 39 2024-09-17T01:52:02.369 INFO:tasks.workunit.client.1.smithi092.stdout:6/260: chown d3/d10 13 1 2024-09-17T01:52:02.369 INFO:tasks.workunit.client.0.smithi031.stdout:6/498: dread d23/d63/f56 [0,4194304] 0 2024-09-17T01:52:02.370 INFO:tasks.workunit.client.1.smithi092.stdout:6/261: dread - d3/f4b zero size 2024-09-17T01:52:02.371 INFO:tasks.workunit.client.1.smithi092.stdout:6/262: truncate d3/f4b 28375 0 2024-09-17T01:52:02.371 INFO:tasks.workunit.client.1.smithi092.stdout:0/255: rmdir d3/da/d15/d30 39 2024-09-17T01:52:02.372 INFO:tasks.workunit.client.1.smithi092.stdout:0/256: read d3/f4 [8135372,22257] 0 2024-09-17T01:52:02.372 INFO:tasks.workunit.client.0.smithi031.stdout:6/499: read d23/d50/d6a/d72/d75/f95 [3882323,72883] 0 2024-09-17T01:52:02.373 INFO:tasks.workunit.client.1.smithi092.stdout:6/263: mkdir d3/d10/d1a/d53 0 2024-09-17T01:52:02.377 INFO:tasks.workunit.client.0.smithi031.stdout:9/289: rename d3/d19/d1f/c51 to d3/d19/d1f/d44/c5f 0 2024-09-17T01:52:02.377 INFO:tasks.workunit.client.1.smithi092.stdout:6/264: creat d3/d10/d1f/d21/d28/f54 x:0 0 0 2024-09-17T01:52:02.380 INFO:tasks.workunit.client.1.smithi092.stdout:6/265: rmdir d3/d10/d1a/d43 39 2024-09-17T01:52:02.382 INFO:tasks.workunit.client.1.smithi092.stdout:6/266: readlink d3/d10/d1f/d21/d28/d2b/d48/d19/d3d/l40 0 2024-09-17T01:52:02.383 INFO:tasks.workunit.client.0.smithi031.stdout:9/290: creat d3/d10/f60 x:0 0 0 2024-09-17T01:52:02.383 INFO:tasks.workunit.client.1.smithi092.stdout:6/267: fdatasync d3/f33 0 2024-09-17T01:52:02.384 INFO:tasks.workunit.client.0.smithi031.stdout:1/415: dwrite d4/d1a/f3c [0,4194304] 0 2024-09-17T01:52:02.384 INFO:tasks.workunit.client.0.smithi031.stdout:9/291: chown d3/lf 235 1 2024-09-17T01:52:02.384 INFO:tasks.workunit.client.0.smithi031.stdout:3/264: dread db/fe [0,4194304] 0 2024-09-17T01:52:02.387 INFO:tasks.workunit.client.0.smithi031.stdout:1/416: symlink d4/d3d/d65/d78/l89 0 2024-09-17T01:52:02.388 INFO:tasks.workunit.client.0.smithi031.stdout:9/292: write d3/d10/f24 [1886796,61422] 0 2024-09-17T01:52:02.389 INFO:tasks.workunit.client.1.smithi092.stdout:6/268: dread d3/d10/d1f/d21/d28/d2b/f2e [0,4194304] 0 2024-09-17T01:52:02.394 INFO:tasks.workunit.client.0.smithi031.stdout:1/417: symlink d4/d1e/d3f/l8a 0 2024-09-17T01:52:02.394 INFO:tasks.workunit.client.0.smithi031.stdout:3/265: getdents db/df/d1d/d37/d3a 0 2024-09-17T01:52:02.396 INFO:tasks.workunit.client.0.smithi031.stdout:1/418: dread - d4/d1a/d2d/d18/f1c zero size 2024-09-17T01:52:02.397 INFO:tasks.workunit.client.0.smithi031.stdout:9/293: dwrite d3/d19/f22 [0,4194304] 0 2024-09-17T01:52:02.403 INFO:tasks.workunit.client.0.smithi031.stdout:3/266: creat db/df/f54 x:0 0 0 2024-09-17T01:52:02.404 INFO:tasks.workunit.client.0.smithi031.stdout:3/267: chown db/df/d1c/l52 1910311 1 2024-09-17T01:52:02.405 INFO:tasks.workunit.client.1.smithi092.stdout:0/257: write d3/da/f10 [1042071,57252] 0 2024-09-17T01:52:02.405 INFO:tasks.workunit.client.0.smithi031.stdout:9/294: rename d3/d19/d1f/f43 to d3/d19/d1f/d44/f61 0 2024-09-17T01:52:02.407 INFO:tasks.workunit.client.0.smithi031.stdout:0/347: truncate d0/d29/d33/d2a/d25/f26 3491378 0 2024-09-17T01:52:02.407 INFO:tasks.workunit.client.1.smithi092.stdout:2/154: dread d10/f1a [0,4194304] 0 2024-09-17T01:52:02.409 INFO:tasks.workunit.client.1.smithi092.stdout:1/250: dwrite db/f2b [0,4194304] 0 2024-09-17T01:52:02.410 INFO:tasks.workunit.client.1.smithi092.stdout:1/251: stat db/d1d/d23/c2c 0 2024-09-17T01:52:02.410 INFO:tasks.workunit.client.1.smithi092.stdout:0/258: dread d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:02.410 INFO:tasks.workunit.client.0.smithi031.stdout:6/500: dread d23/f3d [0,4194304] 0 2024-09-17T01:52:02.411 INFO:tasks.workunit.client.1.smithi092.stdout:1/252: fsync db/d1d/f2a 0 2024-09-17T01:52:02.411 INFO:tasks.workunit.client.0.smithi031.stdout:1/419: creat d4/d1a/d2d/f8b x:0 0 0 2024-09-17T01:52:02.413 INFO:tasks.workunit.client.0.smithi031.stdout:6/501: dread - d23/d50/d64/f78 zero size 2024-09-17T01:52:02.414 INFO:tasks.workunit.client.0.smithi031.stdout:3/268: dwrite db/f42 [0,4194304] 0 2024-09-17T01:52:02.414 INFO:tasks.workunit.client.1.smithi092.stdout:2/155: link d10/d1d/l20 d10/d1d/d24/l30 0 2024-09-17T01:52:02.416 INFO:tasks.workunit.client.1.smithi092.stdout:1/253: creat db/d1d/d44/f4e x:0 0 0 2024-09-17T01:52:02.416 INFO:tasks.workunit.client.0.smithi031.stdout:9/295: read d3/d4/d29/f31 [22326,118154] 0 2024-09-17T01:52:02.417 INFO:tasks.workunit.client.0.smithi031.stdout:9/296: chown d3/d10/d36/l3f 53761 1 2024-09-17T01:52:02.418 INFO:tasks.workunit.client.1.smithi092.stdout:2/156: creat d10/d1d/d2d/f31 x:0 0 0 2024-09-17T01:52:02.420 INFO:tasks.workunit.client.0.smithi031.stdout:6/502: creat d23/d50/d6a/d91/fa7 x:0 0 0 2024-09-17T01:52:02.420 INFO:tasks.workunit.client.1.smithi092.stdout:2/157: creat d10/d15/f32 x:0 0 0 2024-09-17T01:52:02.421 INFO:tasks.workunit.client.0.smithi031.stdout:3/269: mknod db/df/d1d/d37/c55 0 2024-09-17T01:52:02.422 INFO:tasks.workunit.client.1.smithi092.stdout:1/254: unlink db/d1d/c1e 0 2024-09-17T01:52:02.423 INFO:tasks.workunit.client.1.smithi092.stdout:0/259: truncate d3/f7 1561922 0 2024-09-17T01:52:02.425 INFO:tasks.workunit.client.1.smithi092.stdout:2/158: rename d10/d15/f32 to d10/d15/f33 0 2024-09-17T01:52:02.426 INFO:tasks.workunit.client.0.smithi031.stdout:3/270: symlink db/l56 0 2024-09-17T01:52:02.427 INFO:tasks.workunit.client.1.smithi092.stdout:2/159: truncate d10/f14 1047334 0 2024-09-17T01:52:02.428 INFO:tasks.workunit.client.0.smithi031.stdout:6/503: creat d23/d50/d6a/d70/d74/d92/fa8 x:0 0 0 2024-09-17T01:52:02.429 INFO:tasks.workunit.client.0.smithi031.stdout:0/348: rmdir d0/d29/d33/d2a/d25/d30/d4a/d76 0 2024-09-17T01:52:02.431 INFO:tasks.workunit.client.0.smithi031.stdout:0/349: write d0/d29/f70 [533312,126191] 0 2024-09-17T01:52:02.432 INFO:tasks.workunit.client.1.smithi092.stdout:2/160: getdents d10/d1d/d24 0 2024-09-17T01:52:02.432 INFO:tasks.workunit.client.1.smithi092.stdout:1/255: dwrite db/d1d/d23/f3c [4194304,4194304] 0 2024-09-17T01:52:02.432 INFO:tasks.workunit.client.0.smithi031.stdout:0/350: chown d0/d29/d33/d2a/d25/d30/c71 184962 1 2024-09-17T01:52:02.433 INFO:tasks.workunit.client.1.smithi092.stdout:2/161: chown d10/f1a 2 1 2024-09-17T01:52:02.433 INFO:tasks.workunit.client.1.smithi092.stdout:1/256: dread - db/d1d/d44/f4e zero size 2024-09-17T01:52:02.434 INFO:tasks.workunit.client.0.smithi031.stdout:1/420: link d4/d1e/f88 d4/d1e/d40/d84/f8c 0 2024-09-17T01:52:02.435 INFO:tasks.workunit.client.0.smithi031.stdout:3/271: mknod db/c57 0 2024-09-17T01:52:02.436 INFO:tasks.workunit.client.1.smithi092.stdout:2/162: creat d10/d1d/d2d/f34 x:0 0 0 2024-09-17T01:52:02.436 INFO:tasks.workunit.client.0.smithi031.stdout:3/272: write db/f41 [1558727,28453] 0 2024-09-17T01:52:02.436 INFO:tasks.workunit.client.0.smithi031.stdout:6/504: symlink d23/d50/d8a/la9 0 2024-09-17T01:52:02.437 INFO:tasks.workunit.client.0.smithi031.stdout:1/421: dread d4/d1e/d3f/f60 [0,4194304] 0 2024-09-17T01:52:02.438 INFO:tasks.workunit.client.0.smithi031.stdout:6/505: fsync f20 0 2024-09-17T01:52:02.438 INFO:tasks.workunit.client.1.smithi092.stdout:2/163: creat d10/d15/f35 x:0 0 0 2024-09-17T01:52:02.438 INFO:tasks.workunit.client.1.smithi092.stdout:1/257: getdents db/d1d/d4b 0 2024-09-17T01:52:02.439 INFO:tasks.workunit.client.0.smithi031.stdout:0/351: readlink d0/d29/d33/d5/d48/d56/l67 0 2024-09-17T01:52:02.442 INFO:tasks.workunit.client.1.smithi092.stdout:0/260: write d3/f17 [1014109,63842] 0 2024-09-17T01:52:02.444 INFO:tasks.workunit.client.0.smithi031.stdout:9/297: write d3/f15 [1066264,60988] 0 2024-09-17T01:52:02.444 INFO:tasks.workunit.client.0.smithi031.stdout:3/273: fsync db/df/f15 0 2024-09-17T01:52:02.445 INFO:tasks.workunit.client.1.smithi092.stdout:0/261: fsync d3/da/d15/f3d 0 2024-09-17T01:52:02.447 INFO:tasks.workunit.client.0.smithi031.stdout:0/352: write d0/d29/d33/d2a/d25/d38/f41 [848493,81398] 0 2024-09-17T01:52:02.448 INFO:tasks.workunit.client.1.smithi092.stdout:0/262: stat d3/da/d1c/f49 0 2024-09-17T01:52:02.448 INFO:tasks.workunit.client.1.smithi092.stdout:1/258: dwrite db/f2b [0,4194304] 0 2024-09-17T01:52:02.449 INFO:tasks.workunit.client.1.smithi092.stdout:2/164: dwrite d10/d1d/d2d/f34 [0,4194304] 0 2024-09-17T01:52:02.449 INFO:tasks.workunit.client.0.smithi031.stdout:1/422: mkdir d4/d1e/d8d 0 2024-09-17T01:52:02.453 INFO:tasks.workunit.client.1.smithi092.stdout:1/259: mknod db/d1d/d23/c4f 0 2024-09-17T01:52:02.453 INFO:tasks.workunit.client.1.smithi092.stdout:0/263: dread d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:02.454 INFO:tasks.workunit.client.0.smithi031.stdout:3/274: dwrite db/df/d50/f51 [4194304,4194304] 0 2024-09-17T01:52:02.455 INFO:tasks.workunit.client.1.smithi092.stdout:0/264: readlink d3/d1d/l24 0 2024-09-17T01:52:02.456 INFO:tasks.workunit.client.0.smithi031.stdout:0/353: creat d0/f7d x:0 0 0 2024-09-17T01:52:02.457 INFO:tasks.workunit.client.0.smithi031.stdout:6/506: getdents d23/d50/d6a/d70 0 2024-09-17T01:52:02.458 INFO:tasks.workunit.client.0.smithi031.stdout:0/354: fdatasync d0/f21 0 2024-09-17T01:52:02.459 INFO:tasks.workunit.client.1.smithi092.stdout:1/260: mkdir db/d1d/d2e/d50 0 2024-09-17T01:52:02.460 INFO:tasks.workunit.client.0.smithi031.stdout:0/355: stat d0/d29/d33/d5/f3b 0 2024-09-17T01:52:02.461 INFO:tasks.workunit.client.1.smithi092.stdout:3/130: sync 2024-09-17T01:52:02.461 INFO:tasks.workunit.client.1.smithi092.stdout:2/165: dwrite d10/f19 [0,4194304] 0 2024-09-17T01:52:02.465 INFO:tasks.workunit.client.0.smithi031.stdout:6/507: rename d23/d50/fa5 to d23/d50/d8a/faa 0 2024-09-17T01:52:02.466 INFO:tasks.workunit.client.1.smithi092.stdout:1/261: rename db/f2b to db/f51 0 2024-09-17T01:52:02.466 INFO:tasks.workunit.client.0.smithi031.stdout:2/425: sync 2024-09-17T01:52:02.467 INFO:tasks.workunit.client.0.smithi031.stdout:0/356: chown d0/d29/c2f 0 1 2024-09-17T01:52:02.468 INFO:tasks.workunit.client.1.smithi092.stdout:1/262: truncate db/d1d/d23/f3c 9355007 0 2024-09-17T01:52:02.468 INFO:tasks.workunit.client.1.smithi092.stdout:3/131: rename d4/c11 to d4/d16/d1b/d2b/c2c 0 2024-09-17T01:52:02.469 INFO:tasks.workunit.client.1.smithi092.stdout:3/132: fsync d4/d16/f1e 0 2024-09-17T01:52:02.470 INFO:tasks.workunit.client.1.smithi092.stdout:3/133: write d4/d13/f14 [636952,120061] 0 2024-09-17T01:52:02.472 INFO:tasks.workunit.client.1.smithi092.stdout:3/134: fsync d4/d16/f24 0 2024-09-17T01:52:02.472 INFO:tasks.workunit.client.0.smithi031.stdout:3/275: getdents db/df/d1d/d37/d3a 0 2024-09-17T01:52:02.475 INFO:tasks.workunit.client.0.smithi031.stdout:6/508: unlink d23/d50/d6a/d70/d74/c98 0 2024-09-17T01:52:02.477 INFO:tasks.workunit.client.0.smithi031.stdout:2/426: rmdir d1/d3/d45 39 2024-09-17T01:52:02.478 INFO:tasks.workunit.client.1.smithi092.stdout:3/135: dwrite d4/f28 [0,4194304] 0 2024-09-17T01:52:02.479 INFO:tasks.workunit.client.0.smithi031.stdout:3/276: rmdir db/df/d1c 39 2024-09-17T01:52:02.480 INFO:tasks.workunit.client.0.smithi031.stdout:6/509: mknod d23/d50/d6a/d70/d74/d92/cab 0 2024-09-17T01:52:02.482 INFO:tasks.workunit.client.0.smithi031.stdout:6/510: readlink d23/l44 0 2024-09-17T01:52:02.482 INFO:tasks.workunit.client.1.smithi092.stdout:3/136: creat d4/f2d x:0 0 0 2024-09-17T01:52:02.483 INFO:tasks.workunit.client.0.smithi031.stdout:2/427: mknod d1/d3/d45/d4a/c9c 0 2024-09-17T01:52:02.486 INFO:tasks.workunit.client.1.smithi092.stdout:0/265: write d3/da/f37 [223066,130445] 0 2024-09-17T01:52:02.491 INFO:tasks.workunit.client.0.smithi031.stdout:2/428: getdents d1/d7c 0 2024-09-17T01:52:02.491 INFO:tasks.workunit.client.1.smithi092.stdout:1/263: rmdir db/d1d/d2e/d50 0 2024-09-17T01:52:02.492 INFO:tasks.workunit.client.1.smithi092.stdout:3/137: dwrite d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:02.492 INFO:tasks.workunit.client.1.smithi092.stdout:1/264: chown db/lf 1206078735 1 2024-09-17T01:52:02.492 INFO:tasks.workunit.client.0.smithi031.stdout:9/298: dwrite d3/d19/f30 [0,4194304] 0 2024-09-17T01:52:02.493 INFO:tasks.workunit.client.0.smithi031.stdout:2/429: chown d1/f8f 972125346 1 2024-09-17T01:52:02.494 INFO:tasks.workunit.client.1.smithi092.stdout:3/138: truncate d4/d16/d1b/f21 422943 0 2024-09-17T01:52:02.495 INFO:tasks.workunit.client.1.smithi092.stdout:2/166: dread d10/d1d/d24/f29 [0,4194304] 0 2024-09-17T01:52:02.495 INFO:tasks.workunit.client.0.smithi031.stdout:6/511: dwrite f5 [4194304,4194304] 0 2024-09-17T01:52:02.497 INFO:tasks.workunit.client.1.smithi092.stdout:3/139: mkdir d4/d13/d2e 0 2024-09-17T01:52:02.497 INFO:tasks.workunit.client.0.smithi031.stdout:2/430: chown d1/d3/d45/f6b 4204 1 2024-09-17T01:52:02.498 INFO:tasks.workunit.client.1.smithi092.stdout:2/167: readlink d10/d1d/d24/l30 0 2024-09-17T01:52:02.499 INFO:tasks.workunit.client.1.smithi092.stdout:1/265: dwrite db/d1d/d23/f3f [0,4194304] 0 2024-09-17T01:52:02.500 INFO:tasks.workunit.client.0.smithi031.stdout:3/277: dread db/df/d1c/f2b [0,4194304] 0 2024-09-17T01:52:02.501 INFO:tasks.workunit.client.1.smithi092.stdout:2/168: write d10/d1d/d24/f29 [3838108,44112] 0 2024-09-17T01:52:02.505 INFO:tasks.workunit.client.1.smithi092.stdout:2/169: creat d10/d1d/d2d/f36 x:0 0 0 2024-09-17T01:52:02.506 INFO:tasks.workunit.client.0.smithi031.stdout:1/423: dwrite d4/d1e/f4f [0,4194304] 0 2024-09-17T01:52:02.509 INFO:tasks.workunit.client.1.smithi092.stdout:1/266: dwrite db/d1d/d23/f3a [0,4194304] 0 2024-09-17T01:52:02.510 INFO:tasks.workunit.client.0.smithi031.stdout:6/512: rename d23/d50/d6a/d72/d75 to d23/d50/d6a/dac 0 2024-09-17T01:52:02.512 INFO:tasks.workunit.client.0.smithi031.stdout:0/357: dread d0/d29/d33/d2a/f23 [0,4194304] 0 2024-09-17T01:52:02.513 INFO:tasks.workunit.client.0.smithi031.stdout:6/513: write d23/d50/d6a/dac/f85 [866111,128565] 0 2024-09-17T01:52:02.514 INFO:tasks.workunit.client.0.smithi031.stdout:3/278: creat db/df/d1d/d37/d3a/f58 x:0 0 0 2024-09-17T01:52:02.516 INFO:tasks.workunit.client.0.smithi031.stdout:1/424: fsync d4/d1e/d3f/d72/f7a 0 2024-09-17T01:52:02.516 INFO:tasks.workunit.client.0.smithi031.stdout:1/425: stat d4/d1e/d3f/c46 0 2024-09-17T01:52:02.519 INFO:tasks.workunit.client.0.smithi031.stdout:0/358: write d0/d29/d33/d5/fa [5051330,85487] 0 2024-09-17T01:52:02.521 INFO:tasks.workunit.client.0.smithi031.stdout:3/279: unlink db/df/d1d/l2a 0 2024-09-17T01:52:02.523 INFO:tasks.workunit.client.1.smithi092.stdout:1/267: dwrite db/d1d/d23/f3c [0,4194304] 0 2024-09-17T01:52:02.524 INFO:tasks.workunit.client.1.smithi092.stdout:1/268: stat db/d1d/d23/d34/c3e 0 2024-09-17T01:52:02.524 INFO:tasks.workunit.client.1.smithi092.stdout:1/269: fdatasync db/d1d/f2a 0 2024-09-17T01:52:02.526 INFO:tasks.workunit.client.0.smithi031.stdout:0/359: creat d0/f7e x:0 0 0 2024-09-17T01:52:02.526 INFO:tasks.workunit.client.1.smithi092.stdout:1/270: chown db/d1d/d2e/f32 7 1 2024-09-17T01:52:02.529 INFO:tasks.workunit.client.1.smithi092.stdout:1/271: creat db/d1d/d44/f52 x:0 0 0 2024-09-17T01:52:02.529 INFO:tasks.workunit.client.1.smithi092.stdout:1/272: chown db/l3d 3274246 1 2024-09-17T01:52:02.530 INFO:tasks.workunit.client.0.smithi031.stdout:1/426: rename d4/d3d/d65/l83 to d4/d1e/d40/d84/l8e 0 2024-09-17T01:52:02.530 INFO:tasks.workunit.client.1.smithi092.stdout:1/273: mknod db/d1d/d44/c53 0 2024-09-17T01:52:02.531 INFO:tasks.workunit.client.1.smithi092.stdout:1/274: chown db/d1d/d23/c41 1 1 2024-09-17T01:52:02.533 INFO:tasks.workunit.client.0.smithi031.stdout:0/360: write d0/d29/d33/d5/d78/f79 [346046,106047] 0 2024-09-17T01:52:02.533 INFO:tasks.workunit.client.0.smithi031.stdout:3/280: link db/df/d1d/d37/f4d db/df/d1d/f59 0 2024-09-17T01:52:02.533 INFO:tasks.workunit.client.0.smithi031.stdout:9/299: dwrite d3/d19/d1f/f23 [4194304,4194304] 0 2024-09-17T01:52:02.535 INFO:tasks.workunit.client.0.smithi031.stdout:3/281: dread - db/df/f54 zero size 2024-09-17T01:52:02.535 INFO:tasks.workunit.client.1.smithi092.stdout:1/275: dread db/d1d/d23/f25 [0,4194304] 0 2024-09-17T01:52:02.537 INFO:tasks.workunit.client.0.smithi031.stdout:1/427: creat d4/d1e/d5d/f8f x:0 0 0 2024-09-17T01:52:02.539 INFO:tasks.workunit.client.0.smithi031.stdout:9/300: mkdir d3/d10/d36/d62 0 2024-09-17T01:52:02.539 INFO:tasks.workunit.client.0.smithi031.stdout:0/361: creat d0/d29/d33/d2a/f7f x:0 0 0 2024-09-17T01:52:02.540 INFO:tasks.workunit.client.0.smithi031.stdout:3/282: mknod db/d29/c5a 0 2024-09-17T01:52:02.544 INFO:tasks.workunit.client.0.smithi031.stdout:0/362: unlink d0/d29/d33/d5/d48/f4d 0 2024-09-17T01:52:02.546 INFO:tasks.workunit.client.0.smithi031.stdout:0/363: chown d0/d29/d33/d2a/d25/d30/f6b 25551239 1 2024-09-17T01:52:02.547 INFO:tasks.workunit.client.0.smithi031.stdout:3/283: read db/df/f15 [3180781,56303] 0 2024-09-17T01:52:02.548 INFO:tasks.workunit.client.0.smithi031.stdout:9/301: rename d3/d19/f3e to d3/d10/f63 0 2024-09-17T01:52:02.548 INFO:tasks.workunit.client.0.smithi031.stdout:3/284: write db/f46 [1636828,39071] 0 2024-09-17T01:52:02.554 INFO:tasks.workunit.client.0.smithi031.stdout:2/431: truncate d1/d3/fd 1913542 0 2024-09-17T01:52:02.556 INFO:tasks.workunit.client.0.smithi031.stdout:2/432: read - d1/f8f zero size 2024-09-17T01:52:02.557 INFO:tasks.workunit.client.0.smithi031.stdout:9/302: dwrite d3/f15 [0,4194304] 0 2024-09-17T01:52:02.558 INFO:tasks.workunit.client.0.smithi031.stdout:6/514: dread d23/d63/f59 [0,4194304] 0 2024-09-17T01:52:02.560 INFO:tasks.workunit.client.0.smithi031.stdout:0/364: dwrite d0/d29/d33/f35 [0,4194304] 0 2024-09-17T01:52:02.562 INFO:tasks.workunit.client.0.smithi031.stdout:0/365: read d0/f1f [1555385,1000] 0 2024-09-17T01:52:02.562 INFO:tasks.workunit.client.1.smithi092.stdout:1/276: truncate db/d3b/f48 724370 0 2024-09-17T01:52:02.563 INFO:tasks.workunit.client.0.smithi031.stdout:9/303: mkdir d3/d19/d1f/d44/d64 0 2024-09-17T01:52:02.566 INFO:tasks.workunit.client.1.smithi092.stdout:1/277: creat db/d3b/f54 x:0 0 0 2024-09-17T01:52:02.568 INFO:tasks.workunit.client.0.smithi031.stdout:0/366: symlink d0/d29/d33/d2a/d25/d38/l80 0 2024-09-17T01:52:02.569 INFO:tasks.workunit.client.0.smithi031.stdout:2/433: dread d1/d3/df/d19/d1e/f39 [0,4194304] 0 2024-09-17T01:52:02.572 INFO:tasks.workunit.client.0.smithi031.stdout:6/515: dwrite d23/f30 [0,4194304] 0 2024-09-17T01:52:02.573 INFO:tasks.workunit.client.1.smithi092.stdout:1/278: dwrite db/d3b/f54 [0,4194304] 0 2024-09-17T01:52:02.574 INFO:tasks.workunit.client.0.smithi031.stdout:0/367: unlink d0/d29/d33/d5/c73 0 2024-09-17T01:52:02.576 INFO:tasks.workunit.client.1.smithi092.stdout:1/279: mkdir db/d1d/d23/d55 0 2024-09-17T01:52:02.576 INFO:tasks.workunit.client.0.smithi031.stdout:2/434: fsync d1/d3/d2d/f38 0 2024-09-17T01:52:02.578 INFO:tasks.workunit.client.0.smithi031.stdout:2/435: write d1/d3/df/d19/d1e/d21/f90 [900930,38968] 0 2024-09-17T01:52:02.578 INFO:tasks.workunit.client.0.smithi031.stdout:6/516: creat d23/d50/d6a/d70/d74/d92/fad x:0 0 0 2024-09-17T01:52:02.579 INFO:tasks.workunit.client.0.smithi031.stdout:6/517: readlink d23/l4e 0 2024-09-17T01:52:02.580 INFO:tasks.workunit.client.1.smithi092.stdout:1/280: creat db/d1d/d4b/f56 x:0 0 0 2024-09-17T01:52:02.584 INFO:tasks.workunit.client.0.smithi031.stdout:6/518: mknod d23/d50/d6a/d70/d74/cae 0 2024-09-17T01:52:02.585 INFO:tasks.workunit.client.0.smithi031.stdout:0/368: fdatasync d0/d29/d33/f35 0 2024-09-17T01:52:02.587 INFO:tasks.workunit.client.0.smithi031.stdout:0/369: chown d0/d29/d33/d5b/f6d 751293441 1 2024-09-17T01:52:02.588 INFO:tasks.workunit.client.1.smithi092.stdout:1/281: dwrite db/d3b/f54 [0,4194304] 0 2024-09-17T01:52:02.588 INFO:tasks.workunit.client.1.smithi092.stdout:1/282: chown db/c15 42708386 1 2024-09-17T01:52:02.589 INFO:tasks.workunit.client.1.smithi092.stdout:1/283: chown db/d1d/d23/c2c 158 1 2024-09-17T01:52:02.590 INFO:tasks.workunit.client.0.smithi031.stdout:6/519: creat d23/d50/d64/faf x:0 0 0 2024-09-17T01:52:02.592 INFO:tasks.workunit.client.0.smithi031.stdout:2/436: getdents d1/d3/df/d19/d1e/d2a 0 2024-09-17T01:52:02.593 INFO:tasks.workunit.client.0.smithi031.stdout:9/304: dread d3/d10/f24 [0,4194304] 0 2024-09-17T01:52:02.594 INFO:tasks.workunit.client.0.smithi031.stdout:6/520: mkdir d23/d50/d6a/d70/db0 0 2024-09-17T01:52:02.595 INFO:tasks.workunit.client.0.smithi031.stdout:0/370: dread d0/d29/d33/f28 [0,4194304] 0 2024-09-17T01:52:02.595 INFO:tasks.workunit.client.0.smithi031.stdout:9/305: chown d3/d19/d1f/f23 10091636 1 2024-09-17T01:52:02.599 INFO:tasks.workunit.client.0.smithi031.stdout:0/371: fdatasync d0/d29/d33/f35 0 2024-09-17T01:52:02.600 INFO:tasks.workunit.client.0.smithi031.stdout:9/306: read d3/d19/d1f/d44/f61 [3850792,55795] 0 2024-09-17T01:52:02.603 INFO:tasks.workunit.client.0.smithi031.stdout:3/285: dwrite f9 [0,4194304] 0 2024-09-17T01:52:02.604 INFO:tasks.workunit.client.0.smithi031.stdout:9/307: write d3/d19/d1f/f21 [3071717,55185] 0 2024-09-17T01:52:02.605 INFO:tasks.workunit.client.0.smithi031.stdout:0/372: truncate d0/d29/d33/d2a/d25/f7a 118912 0 2024-09-17T01:52:02.605 INFO:tasks.workunit.client.0.smithi031.stdout:3/286: readlink db/df/d1c/l4f 0 2024-09-17T01:52:02.605 INFO:tasks.workunit.client.0.smithi031.stdout:9/308: chown d3/d19/d1f/c4a 3366242 1 2024-09-17T01:52:02.607 INFO:tasks.workunit.client.0.smithi031.stdout:2/437: dread d1/d3/df/d19/d1e/d21/f24 [0,4194304] 0 2024-09-17T01:52:02.607 INFO:tasks.workunit.client.0.smithi031.stdout:0/373: rmdir d0/d29/d33/d5/d78 39 2024-09-17T01:52:02.608 INFO:tasks.workunit.client.0.smithi031.stdout:2/438: fdatasync d1/d3/d2d/f46 0 2024-09-17T01:52:02.608 INFO:tasks.workunit.client.1.smithi092.stdout:1/284: truncate db/d1d/d23/f25 2715248 0 2024-09-17T01:52:02.610 INFO:tasks.workunit.client.0.smithi031.stdout:0/374: creat d0/d37/f81 x:0 0 0 2024-09-17T01:52:02.610 INFO:tasks.workunit.client.1.smithi092.stdout:1/285: chown db/d1d/f22 111645 1 2024-09-17T01:52:02.611 INFO:tasks.workunit.client.0.smithi031.stdout:2/439: symlink d1/d3/df/d11/d44/l9d 0 2024-09-17T01:52:02.612 INFO:tasks.workunit.client.0.smithi031.stdout:2/440: dread - d1/d3/df/f5a zero size 2024-09-17T01:52:02.614 INFO:tasks.workunit.client.0.smithi031.stdout:9/309: rename d3/d10/f1a to d3/d19/f65 0 2024-09-17T01:52:02.615 INFO:tasks.workunit.client.0.smithi031.stdout:0/375: mkdir d0/d29/d44/d82 0 2024-09-17T01:52:02.620 INFO:tasks.workunit.client.0.smithi031.stdout:9/310: dwrite d3/f2a [0,4194304] 0 2024-09-17T01:52:02.623 INFO:tasks.workunit.client.0.smithi031.stdout:0/376: symlink d0/d29/d33/d2a/d25/d30/l83 0 2024-09-17T01:52:02.627 INFO:tasks.workunit.client.0.smithi031.stdout:3/287: rename db/df/d1d/d37/l3d to db/df/d1d/l5b 0 2024-09-17T01:52:02.633 INFO:tasks.workunit.client.0.smithi031.stdout:9/311: rmdir d3/d59 0 2024-09-17T01:52:02.634 INFO:tasks.workunit.client.0.smithi031.stdout:0/377: mkdir d0/d29/d33/d84 0 2024-09-17T01:52:02.634 INFO:tasks.workunit.client.0.smithi031.stdout:0/378: stat d0/d29/d33/f28 0 2024-09-17T01:52:02.635 INFO:tasks.workunit.client.0.smithi031.stdout:6/521: creat d23/d50/d6a/d70/d74/fb1 x:0 0 0 2024-09-17T01:52:02.637 INFO:tasks.workunit.client.0.smithi031.stdout:3/288: mknod db/df/d50/c5c 0 2024-09-17T01:52:02.638 INFO:tasks.workunit.client.0.smithi031.stdout:3/289: write db/df/f39 [5048424,128959] 0 2024-09-17T01:52:02.638 INFO:tasks.workunit.client.0.smithi031.stdout:9/312: truncate d3/d4/d29/f2b 3549154 0 2024-09-17T01:52:02.640 INFO:tasks.workunit.client.0.smithi031.stdout:9/313: write d3/d10/f60 [414087,15781] 0 2024-09-17T01:52:02.640 INFO:tasks.workunit.client.0.smithi031.stdout:0/379: rmdir d0/d29/d33/d5b 39 2024-09-17T01:52:02.643 INFO:tasks.workunit.client.0.smithi031.stdout:9/314: write d3/d19/d1f/f55 [780867,42811] 0 2024-09-17T01:52:02.643 INFO:tasks.workunit.client.0.smithi031.stdout:6/522: creat d23/d50/d6a/d70/db0/fb2 x:0 0 0 2024-09-17T01:52:02.644 INFO:tasks.workunit.client.0.smithi031.stdout:3/290: mknod db/df/d1d/c5d 0 2024-09-17T01:52:02.645 INFO:tasks.workunit.client.0.smithi031.stdout:9/315: read d3/d19/d1f/f21 [2183189,6637] 0 2024-09-17T01:52:02.645 INFO:tasks.workunit.client.0.smithi031.stdout:3/291: fdatasync db/f46 0 2024-09-17T01:52:02.650 INFO:tasks.workunit.client.0.smithi031.stdout:0/380: creat d0/d29/d33/d5/f85 x:0 0 0 2024-09-17T01:52:02.650 INFO:tasks.workunit.client.0.smithi031.stdout:2/441: dread d1/d3/d2d/f8b [0,4194304] 0 2024-09-17T01:52:02.651 INFO:tasks.workunit.client.0.smithi031.stdout:3/292: dread db/df/d50/f51 [4194304,4194304] 0 2024-09-17T01:52:02.659 INFO:tasks.workunit.client.0.smithi031.stdout:6/523: rename d23/la4 to d23/d50/lb3 0 2024-09-17T01:52:02.665 INFO:tasks.workunit.client.0.smithi031.stdout:9/316: getdents d3/d47 0 2024-09-17T01:52:02.665 INFO:tasks.workunit.client.0.smithi031.stdout:3/293: dwrite db/f11 [0,4194304] 0 2024-09-17T01:52:02.671 INFO:tasks.workunit.client.0.smithi031.stdout:0/381: write d0/d29/d33/d2a/d25/d30/f57 [3712479,79837] 0 2024-09-17T01:52:02.673 INFO:tasks.workunit.client.0.smithi031.stdout:6/524: rename d23/d50 to d23/db4 0 2024-09-17T01:52:02.676 INFO:tasks.workunit.client.0.smithi031.stdout:3/294: rmdir db/df/d1d 39 2024-09-17T01:52:02.678 INFO:tasks.workunit.client.0.smithi031.stdout:0/382: mkdir d0/d29/d33/d2a/d25/d30/d4a/d86 0 2024-09-17T01:52:02.679 INFO:tasks.workunit.client.0.smithi031.stdout:6/525: creat d23/db4/d6a/d70/d74/fb5 x:0 0 0 2024-09-17T01:52:02.679 INFO:tasks.workunit.client.0.smithi031.stdout:0/383: dread - d0/d29/d33/d5/f85 zero size 2024-09-17T01:52:02.680 INFO:tasks.workunit.client.1.smithi092.stdout:4/130: sync 2024-09-17T01:52:02.681 INFO:tasks.workunit.client.0.smithi031.stdout:3/295: symlink db/df/l5e 0 2024-09-17T01:52:02.681 INFO:tasks.workunit.client.1.smithi092.stdout:8/229: sync 2024-09-17T01:52:02.682 INFO:tasks.workunit.client.1.smithi092.stdout:4/131: read d4/d5/d1d/f26 [1242,14712] 0 2024-09-17T01:52:02.682 INFO:tasks.workunit.client.1.smithi092.stdout:8/230: write d15/f24 [163565,99569] 0 2024-09-17T01:52:02.682 INFO:tasks.workunit.client.0.smithi031.stdout:9/317: getdents d3 0 2024-09-17T01:52:02.683 INFO:tasks.workunit.client.0.smithi031.stdout:0/384: creat d0/d37/f87 x:0 0 0 2024-09-17T01:52:02.685 INFO:tasks.workunit.client.1.smithi092.stdout:4/132: creat d4/d13/d20/f29 x:0 0 0 2024-09-17T01:52:02.685 INFO:tasks.workunit.client.0.smithi031.stdout:6/526: rename d23/db4/d6a/d70/f8f to d23/db4/d6a/d91/fb6 0 2024-09-17T01:52:02.687 INFO:tasks.workunit.client.0.smithi031.stdout:3/296: creat db/f5f x:0 0 0 2024-09-17T01:52:02.687 INFO:tasks.workunit.client.0.smithi031.stdout:9/318: dread d3/d4/d29/f4b [0,4194304] 0 2024-09-17T01:52:02.690 INFO:tasks.workunit.client.1.smithi092.stdout:4/133: dwrite d4/f1e [0,4194304] 0 2024-09-17T01:52:02.691 INFO:tasks.workunit.client.0.smithi031.stdout:0/385: mknod d0/c88 0 2024-09-17T01:52:02.692 INFO:tasks.workunit.client.1.smithi092.stdout:8/231: truncate fa 4839061 0 2024-09-17T01:52:02.693 INFO:tasks.workunit.client.0.smithi031.stdout:6/527: read d23/f3b [8556,38087] 0 2024-09-17T01:52:02.695 INFO:tasks.workunit.client.0.smithi031.stdout:3/297: write db/df/d1d/d37/d3a/f58 [318380,72009] 0 2024-09-17T01:52:02.696 INFO:tasks.workunit.client.0.smithi031.stdout:3/298: chown db/f42 12302987 1 2024-09-17T01:52:02.697 INFO:tasks.workunit.client.0.smithi031.stdout:3/299: chown db/df/d1d/l25 38 1 2024-09-17T01:52:02.698 INFO:tasks.workunit.client.1.smithi092.stdout:4/134: dwrite d4/d13/d20/f27 [0,4194304] 0 2024-09-17T01:52:02.700 INFO:tasks.workunit.client.0.smithi031.stdout:0/386: mknod d0/d29/d33/d2a/d25/d30/d4a/c89 0 2024-09-17T01:52:02.701 INFO:tasks.workunit.client.0.smithi031.stdout:6/528: symlink d23/db4/d6a/lb7 0 2024-09-17T01:52:02.702 INFO:tasks.workunit.client.0.smithi031.stdout:9/319: mknod d3/d19/d1f/d44/d64/c66 0 2024-09-17T01:52:02.703 INFO:tasks.workunit.client.0.smithi031.stdout:3/300: symlink db/df/d1c/l60 0 2024-09-17T01:52:02.703 INFO:tasks.workunit.client.0.smithi031.stdout:9/320: write d3/d10/f38 [605463,43440] 0 2024-09-17T01:52:02.704 INFO:tasks.workunit.client.0.smithi031.stdout:0/387: creat d0/f8a x:0 0 0 2024-09-17T01:52:02.705 INFO:tasks.workunit.client.0.smithi031.stdout:3/301: dread - db/d29/f4e zero size 2024-09-17T01:52:02.706 INFO:tasks.workunit.client.1.smithi092.stdout:4/135: dwrite f2 [0,4194304] 0 2024-09-17T01:52:02.707 INFO:tasks.workunit.client.0.smithi031.stdout:6/529: creat d23/d63/fb8 x:0 0 0 2024-09-17T01:52:02.707 INFO:tasks.workunit.client.1.smithi092.stdout:4/136: stat d4/d13/l18 0 2024-09-17T01:52:02.709 INFO:tasks.workunit.client.1.smithi092.stdout:8/232: dwrite f14 [0,4194304] 0 2024-09-17T01:52:02.709 INFO:tasks.workunit.client.0.smithi031.stdout:9/321: mknod d3/d4/d29/c67 0 2024-09-17T01:52:02.710 INFO:tasks.workunit.client.1.smithi092.stdout:8/233: stat d15/d25 0 2024-09-17T01:52:02.711 INFO:tasks.workunit.client.0.smithi031.stdout:3/302: creat db/df/d1d/f61 x:0 0 0 2024-09-17T01:52:02.711 INFO:tasks.workunit.client.1.smithi092.stdout:4/137: symlink d4/d5/l2a 0 2024-09-17T01:52:02.712 INFO:tasks.workunit.client.0.smithi031.stdout:9/322: mkdir d3/d4/d68 0 2024-09-17T01:52:02.713 INFO:tasks.workunit.client.1.smithi092.stdout:4/138: write d4/d13/f1c [1661769,113612] 0 2024-09-17T01:52:02.714 INFO:tasks.workunit.client.1.smithi092.stdout:4/139: chown d4/d5/l11 9095 1 2024-09-17T01:52:02.715 INFO:tasks.workunit.client.1.smithi092.stdout:8/234: mknod d15/c44 0 2024-09-17T01:52:02.715 INFO:tasks.workunit.client.0.smithi031.stdout:3/303: rename f9 to db/df/d50/f62 0 2024-09-17T01:52:02.716 INFO:tasks.workunit.client.0.smithi031.stdout:3/304: chown db/df/d50/c5c 13 1 2024-09-17T01:52:02.716 INFO:tasks.workunit.client.1.smithi092.stdout:8/235: fdatasync d15/d25/d2b/f31 0 2024-09-17T01:52:02.717 INFO:tasks.workunit.client.0.smithi031.stdout:9/323: getdents d3/d4/d68 0 2024-09-17T01:52:02.719 INFO:tasks.workunit.client.0.smithi031.stdout:3/305: creat db/df/d50/f63 x:0 0 0 2024-09-17T01:52:02.719 INFO:tasks.workunit.client.1.smithi092.stdout:4/140: rename d4/f24 to d4/d13/f2b 0 2024-09-17T01:52:02.720 INFO:tasks.workunit.client.0.smithi031.stdout:3/306: read - db/df/d1d/d37/f4b zero size 2024-09-17T01:52:02.721 INFO:tasks.workunit.client.1.smithi092.stdout:8/236: creat d15/d32/d40/d42/f45 x:0 0 0 2024-09-17T01:52:02.722 INFO:tasks.workunit.client.0.smithi031.stdout:9/324: rename d3/d4/d29/f2b to d3/d10/d36/f69 0 2024-09-17T01:52:02.722 INFO:tasks.workunit.client.1.smithi092.stdout:4/141: symlink d4/d5/l2c 0 2024-09-17T01:52:02.722 INFO:tasks.workunit.client.1.smithi092.stdout:8/237: truncate d15/f34 370630 0 2024-09-17T01:52:02.723 INFO:tasks.workunit.client.0.smithi031.stdout:3/307: mknod db/d29/c64 0 2024-09-17T01:52:02.724 INFO:tasks.workunit.client.1.smithi092.stdout:4/142: creat d4/d5/f2d x:0 0 0 2024-09-17T01:52:02.724 INFO:tasks.workunit.client.0.smithi031.stdout:9/325: mknod d3/d10/d36/d62/c6a 0 2024-09-17T01:52:02.725 INFO:tasks.workunit.client.1.smithi092.stdout:8/238: unlink d15/d25/d27/l2f 0 2024-09-17T01:52:02.726 INFO:tasks.workunit.client.0.smithi031.stdout:9/326: readlink d3/d4/d29/l33 0 2024-09-17T01:52:02.726 INFO:tasks.workunit.client.0.smithi031.stdout:6/530: dread d23/d63/d47/f60 [0,4194304] 0 2024-09-17T01:52:02.727 INFO:tasks.workunit.client.1.smithi092.stdout:8/239: symlink d15/d25/l46 0 2024-09-17T01:52:02.728 INFO:tasks.workunit.client.0.smithi031.stdout:9/327: getdents d3/d4/d68 0 2024-09-17T01:52:02.729 INFO:tasks.workunit.client.0.smithi031.stdout:3/308: dwrite db/d29/f2e [0,4194304] 0 2024-09-17T01:52:02.733 INFO:tasks.workunit.client.0.smithi031.stdout:3/309: fdatasync db/df/f44 0 2024-09-17T01:52:02.733 INFO:tasks.workunit.client.1.smithi092.stdout:8/240: dwrite d15/d32/f38 [4194304,4194304] 0 2024-09-17T01:52:02.733 INFO:tasks.workunit.client.0.smithi031.stdout:3/310: mkdir db/df/d1d/d37/d65 0 2024-09-17T01:52:02.735 INFO:tasks.workunit.client.1.smithi092.stdout:8/241: unlink d15/f1c 0 2024-09-17T01:52:02.737 INFO:tasks.workunit.client.0.smithi031.stdout:3/311: link db/df/d1d/d37/c3c db/df/d1d/d37/d4a/c66 0 2024-09-17T01:52:02.738 INFO:tasks.workunit.client.0.smithi031.stdout:3/312: fdatasync db/f1f 0 2024-09-17T01:52:02.738 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:02 smithi092 ceph-mon[33552]: pgmap v11: 65 pgs: 65 active+clean; 999 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 125 MiB/s wr, 429 op/s 2024-09-17T01:52:02.739 INFO:tasks.workunit.client.0.smithi031.stdout:3/313: fsync db/df/d1d/d37/f3f 0 2024-09-17T01:52:02.741 INFO:tasks.workunit.client.1.smithi092.stdout:8/242: rename d15/c22 to d15/d32/d40/d42/d43/c47 0 2024-09-17T01:52:02.743 INFO:tasks.workunit.client.1.smithi092.stdout:8/243: rmdir d15/d25/d2b/d3d 39 2024-09-17T01:52:02.745 INFO:tasks.workunit.client.0.smithi031.stdout:3/314: symlink db/df/d1d/d37/d65/l67 0 2024-09-17T01:52:02.747 INFO:tasks.workunit.client.1.smithi092.stdout:8/244: dread ff [0,4194304] 0 2024-09-17T01:52:02.749 INFO:tasks.workunit.client.1.smithi092.stdout:8/245: mkdir d15/d48 0 2024-09-17T01:52:02.750 INFO:tasks.workunit.client.1.smithi092.stdout:4/143: rmdir d4/d5 39 2024-09-17T01:52:02.750 INFO:tasks.workunit.client.1.smithi092.stdout:8/246: fsync d15/d25/f3c 0 2024-09-17T01:52:02.751 INFO:tasks.workunit.client.0.smithi031.stdout:9/328: dread d3/d10/f63 [0,4194304] 0 2024-09-17T01:52:02.751 INFO:tasks.workunit.client.0.smithi031.stdout:0/388: dread d0/d29/d33/d2a/f39 [0,4194304] 0 2024-09-17T01:52:02.751 INFO:tasks.workunit.client.1.smithi092.stdout:8/247: read - d15/f21 zero size 2024-09-17T01:52:02.752 INFO:tasks.workunit.client.0.smithi031.stdout:0/389: chown d0/d29/l36 21 1 2024-09-17T01:52:02.752 INFO:tasks.workunit.client.0.smithi031.stdout:9/329: creat d3/d19/d1f/f6b x:0 0 0 2024-09-17T01:52:02.754 INFO:tasks.workunit.client.1.smithi092.stdout:8/248: mkdir d15/d25/d27/d49 0 2024-09-17T01:52:02.756 INFO:tasks.workunit.client.1.smithi092.stdout:8/249: dread d15/f34 [0,4194304] 0 2024-09-17T01:52:02.758 INFO:tasks.workunit.client.0.smithi031.stdout:3/315: rmdir db/df/d50 39 2024-09-17T01:52:02.759 INFO:tasks.workunit.client.0.smithi031.stdout:0/390: dwrite d0/d29/d33/d5/f3b [4194304,4194304] 0 2024-09-17T01:52:02.760 INFO:tasks.workunit.client.1.smithi092.stdout:4/144: dwrite d4/d5/f2d [0,4194304] 0 2024-09-17T01:52:02.760 INFO:tasks.workunit.client.1.smithi092.stdout:8/250: creat d15/d25/d27/d49/f4a x:0 0 0 2024-09-17T01:52:02.761 INFO:tasks.workunit.client.1.smithi092.stdout:4/145: fsync d4/d5/d1d/f1a 0 2024-09-17T01:52:02.762 INFO:tasks.workunit.client.1.smithi092.stdout:8/251: stat c11 0 2024-09-17T01:52:02.763 INFO:tasks.workunit.client.0.smithi031.stdout:3/316: symlink db/df/d1d/d37/d3a/l68 0 2024-09-17T01:52:02.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:02 smithi031 ceph-mon[27673]: pgmap v11: 65 pgs: 65 active+clean; 999 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 125 MiB/s wr, 429 op/s 2024-09-17T01:52:02.767 INFO:tasks.workunit.client.0.smithi031.stdout:4/506: sync 2024-09-17T01:52:02.768 INFO:tasks.workunit.client.0.smithi031.stdout:0/391: mkdir d0/d29/d33/d8b 0 2024-09-17T01:52:02.770 INFO:tasks.workunit.client.0.smithi031.stdout:0/392: write d0/d29/d33/d2a/d25/f7a [752699,66523] 0 2024-09-17T01:52:02.771 INFO:tasks.workunit.client.1.smithi092.stdout:8/252: stat d15/d25/d27/f41 0 2024-09-17T01:52:02.771 INFO:tasks.workunit.client.1.smithi092.stdout:4/146: dread d4/d13/f17 [0,4194304] 0 2024-09-17T01:52:02.772 INFO:tasks.workunit.client.0.smithi031.stdout:9/330: write d3/d4c/f4f [240451,60055] 0 2024-09-17T01:52:02.773 INFO:tasks.workunit.client.0.smithi031.stdout:9/331: readlink d3/d4/d29/l33 0 2024-09-17T01:52:02.774 INFO:tasks.workunit.client.0.smithi031.stdout:0/393: mkdir d0/d29/d33/d5/d48/d8c 0 2024-09-17T01:52:02.775 INFO:tasks.workunit.client.0.smithi031.stdout:4/507: creat d8/d3a/d41/fa2 x:0 0 0 2024-09-17T01:52:02.779 INFO:tasks.workunit.client.1.smithi092.stdout:8/253: link d15/f24 d15/d32/d40/d42/f4b 0 2024-09-17T01:52:02.780 INFO:tasks.workunit.client.1.smithi092.stdout:4/147: dwrite d4/d13/d20/f29 [0,4194304] 0 2024-09-17T01:52:02.780 INFO:tasks.workunit.client.0.smithi031.stdout:0/394: getdents d0/d29/d33/d2a/d25/d30/d4a/d86 0 2024-09-17T01:52:02.781 INFO:tasks.workunit.client.0.smithi031.stdout:3/317: dwrite db/df/d1d/f59 [0,4194304] 0 2024-09-17T01:52:02.782 INFO:tasks.workunit.client.1.smithi092.stdout:4/148: truncate d4/d13/f2b 304627 0 2024-09-17T01:52:02.782 INFO:tasks.workunit.client.1.smithi092.stdout:8/254: unlink d15/f24 0 2024-09-17T01:52:02.785 INFO:tasks.workunit.client.0.smithi031.stdout:3/318: unlink c4 0 2024-09-17T01:52:02.786 INFO:tasks.workunit.client.1.smithi092.stdout:4/149: creat d4/d13/d20/f2e x:0 0 0 2024-09-17T01:52:02.787 INFO:tasks.workunit.client.0.smithi031.stdout:4/508: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/la3 0 2024-09-17T01:52:02.789 INFO:tasks.workunit.client.0.smithi031.stdout:4/509: fsync d8/d3a/d41/f4a 0 2024-09-17T01:52:02.789 INFO:tasks.workunit.client.0.smithi031.stdout:0/395: dwrite d0/d29/d33/d2a/d25/d30/f6b [0,4194304] 0 2024-09-17T01:52:02.791 INFO:tasks.workunit.client.0.smithi031.stdout:3/319: symlink db/df/d1d/d37/d3a/l69 0 2024-09-17T01:52:02.791 INFO:tasks.workunit.client.0.smithi031.stdout:4/510: chown d8/d3a/d41/d64/d4d/d5a/c90 3540 1 2024-09-17T01:52:02.798 INFO:tasks.workunit.client.0.smithi031.stdout:4/511: creat d8/d3a/d41/d64/d4d/fa4 x:0 0 0 2024-09-17T01:52:02.799 INFO:tasks.workunit.client.0.smithi031.stdout:0/396: dread d0/d29/d33/d5/d78/f79 [0,4194304] 0 2024-09-17T01:52:02.800 INFO:tasks.workunit.client.0.smithi031.stdout:9/332: dwrite d3/fb [0,4194304] 0 2024-09-17T01:52:02.802 INFO:tasks.workunit.client.0.smithi031.stdout:4/512: write d8/d3a/d41/d64/d4d/f71 [81448,92352] 0 2024-09-17T01:52:02.802 INFO:tasks.workunit.client.0.smithi031.stdout:3/320: dread db/f41 [0,4194304] 0 2024-09-17T01:52:02.802 INFO:tasks.workunit.client.0.smithi031.stdout:9/333: truncate d3/d4/f27 995263 0 2024-09-17T01:52:02.805 INFO:tasks.workunit.client.0.smithi031.stdout:3/321: mkdir db/df/d1c/d6a 0 2024-09-17T01:52:02.807 INFO:tasks.workunit.client.0.smithi031.stdout:9/334: mknod d3/d19/d1f/d44/d64/c6c 0 2024-09-17T01:52:02.809 INFO:tasks.workunit.client.0.smithi031.stdout:4/513: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fa5 x:0 0 0 2024-09-17T01:52:02.813 INFO:tasks.workunit.client.0.smithi031.stdout:3/322: dwrite db/f41 [0,4194304] 0 2024-09-17T01:52:02.816 INFO:tasks.workunit.client.0.smithi031.stdout:3/323: readlink db/df/d1d/d37/d3a/l40 0 2024-09-17T01:52:02.821 INFO:tasks.workunit.client.0.smithi031.stdout:3/324: unlink db/df/d1c/l27 0 2024-09-17T01:52:02.838 INFO:tasks.workunit.client.0.smithi031.stdout:3/325: dwrite db/df/d1d/d37/d4a/f43 [0,4194304] 0 2024-09-17T01:52:02.839 INFO:tasks.workunit.client.0.smithi031.stdout:4/514: dread d8/d3a/d41/d64/f24 [0,4194304] 0 2024-09-17T01:52:02.844 INFO:tasks.workunit.client.0.smithi031.stdout:4/515: unlink d8/d3a/d41/d55/c68 0 2024-09-17T01:52:02.845 INFO:tasks.workunit.client.0.smithi031.stdout:3/326: fsync db/df/d1d/d37/f3f 0 2024-09-17T01:52:02.847 INFO:tasks.workunit.client.0.smithi031.stdout:4/516: mknod d8/ca6 0 2024-09-17T01:52:02.848 INFO:tasks.workunit.client.0.smithi031.stdout:3/327: readlink db/df/d1d/l5b 0 2024-09-17T01:52:02.848 INFO:tasks.workunit.client.1.smithi092.stdout:4/150: write d4/d5/f15 [400546,18913] 0 2024-09-17T01:52:02.848 INFO:tasks.workunit.client.1.smithi092.stdout:4/151: readlink d4/d5/d1d/l23 0 2024-09-17T01:52:02.848 INFO:tasks.workunit.client.0.smithi031.stdout:3/328: chown db/df/f39 2475456 1 2024-09-17T01:52:02.850 INFO:tasks.workunit.client.0.smithi031.stdout:4/517: mknod d8/d3a/d41/d64/d4f/ca7 0 2024-09-17T01:52:02.853 INFO:tasks.workunit.client.0.smithi031.stdout:4/518: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa8 x:0 0 0 2024-09-17T01:52:02.853 INFO:tasks.workunit.client.1.smithi092.stdout:4/152: mknod d4/d5/c2f 0 2024-09-17T01:52:02.855 INFO:tasks.workunit.client.0.smithi031.stdout:4/519: creat d8/d3a/fa9 x:0 0 0 2024-09-17T01:52:02.860 INFO:tasks.workunit.client.0.smithi031.stdout:4/520: rename d8/d3a/d41/d64/d4f/f6d to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/faa 0 2024-09-17T01:52:02.866 INFO:tasks.workunit.client.0.smithi031.stdout:4/521: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa8 to d8/d3a/d41/d64/d4d/d5a/fab 0 2024-09-17T01:52:02.868 INFO:tasks.workunit.client.0.smithi031.stdout:3/329: dread db/f1f [0,4194304] 0 2024-09-17T01:52:02.869 INFO:tasks.workunit.client.0.smithi031.stdout:4/522: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/lac 0 2024-09-17T01:52:02.870 INFO:tasks.workunit.client.0.smithi031.stdout:3/330: creat db/f6b x:0 0 0 2024-09-17T01:52:02.871 INFO:tasks.workunit.client.0.smithi031.stdout:3/331: truncate db/df/d1d/f4c 957959 0 2024-09-17T01:52:02.872 INFO:tasks.workunit.client.0.smithi031.stdout:4/523: rmdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91 39 2024-09-17T01:52:02.872 INFO:tasks.workunit.client.0.smithi031.stdout:3/332: write db/df/d1d/f59 [198377,19090] 0 2024-09-17T01:52:02.876 INFO:tasks.workunit.client.0.smithi031.stdout:3/333: mkdir db/df/d1d/d37/d6c 0 2024-09-17T01:52:02.890 INFO:tasks.workunit.client.0.smithi031.stdout:3/334: readlink db/df/d1d/l5b 0 2024-09-17T01:52:02.892 INFO:tasks.workunit.client.0.smithi031.stdout:4/524: dwrite d8/d3a/d41/d64/d4d/d5a/f96 [0,4194304] 0 2024-09-17T01:52:02.894 INFO:tasks.workunit.client.0.smithi031.stdout:3/335: mknod db/df/d1d/d37/d4a/c6d 0 2024-09-17T01:52:02.899 INFO:tasks.workunit.client.0.smithi031.stdout:4/525: creat d8/fad x:0 0 0 2024-09-17T01:52:02.899 INFO:tasks.workunit.client.0.smithi031.stdout:3/336: mkdir db/df/d1d/d37/d6c/d6e 0 2024-09-17T01:52:02.900 INFO:tasks.workunit.client.0.smithi031.stdout:4/526: write d8/d3a/d41/f60 [363281,17435] 0 2024-09-17T01:52:02.900 INFO:tasks.workunit.client.0.smithi031.stdout:3/337: fsync db/df/d1d/f61 0 2024-09-17T01:52:02.902 INFO:tasks.workunit.client.0.smithi031.stdout:3/338: fdatasync db/fe 0 2024-09-17T01:52:02.903 INFO:tasks.workunit.client.0.smithi031.stdout:4/527: mkdir d8/d3a/d41/d64/d4d/dae 0 2024-09-17T01:52:02.905 INFO:tasks.workunit.client.0.smithi031.stdout:4/528: mknod d8/d3a/d41/d64/d4f/caf 0 2024-09-17T01:52:02.907 INFO:tasks.workunit.client.0.smithi031.stdout:3/339: dwrite db/f12 [0,4194304] 0 2024-09-17T01:52:02.910 INFO:tasks.workunit.client.0.smithi031.stdout:4/529: mkdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/db0 0 2024-09-17T01:52:02.915 INFO:tasks.workunit.client.1.smithi092.stdout:8/255: dwrite d15/d25/d27/f3e [0,4194304] 0 2024-09-17T01:52:02.918 INFO:tasks.workunit.client.1.smithi092.stdout:8/256: dread d15/f34 [0,4194304] 0 2024-09-17T01:52:02.921 INFO:tasks.workunit.client.1.smithi092.stdout:4/153: dwrite d4/d5/f2d [0,4194304] 0 2024-09-17T01:52:02.922 INFO:tasks.workunit.client.1.smithi092.stdout:8/257: mkdir d15/d32/d40/d4c 0 2024-09-17T01:52:02.925 INFO:tasks.workunit.client.1.smithi092.stdout:8/258: write d15/f21 [815631,57100] 0 2024-09-17T01:52:02.926 INFO:tasks.workunit.client.1.smithi092.stdout:8/259: write f1 [4590820,52026] 0 2024-09-17T01:52:02.928 INFO:tasks.workunit.client.1.smithi092.stdout:8/260: chown d15/d25 29193 1 2024-09-17T01:52:02.942 INFO:tasks.workunit.client.1.smithi092.stdout:4/154: write d4/d13/f17 [1900560,11509] 0 2024-09-17T01:52:02.947 INFO:tasks.workunit.client.1.smithi092.stdout:4/155: dread d4/d13/f1c [0,4194304] 0 2024-09-17T01:52:02.951 INFO:tasks.workunit.client.1.smithi092.stdout:5/112: sync 2024-09-17T01:52:02.951 INFO:tasks.workunit.client.1.smithi092.stdout:7/289: sync 2024-09-17T01:52:02.951 INFO:tasks.workunit.client.1.smithi092.stdout:9/182: sync 2024-09-17T01:52:02.953 INFO:tasks.workunit.client.1.smithi092.stdout:9/183: chown d0/d7/d12 2109910 1 2024-09-17T01:52:02.954 INFO:tasks.workunit.client.1.smithi092.stdout:7/290: write d3/d6/d13/d21/f5c [343321,80122] 0 2024-09-17T01:52:02.957 INFO:tasks.workunit.client.1.smithi092.stdout:4/156: dwrite d4/d5/d1d/f26 [0,4194304] 0 2024-09-17T01:52:02.958 INFO:tasks.workunit.client.1.smithi092.stdout:7/291: stat d3/d6/d13/d40/c50 0 2024-09-17T01:52:02.959 INFO:tasks.workunit.client.1.smithi092.stdout:9/184: creat d0/df/d17/d1f/f2d x:0 0 0 2024-09-17T01:52:02.962 INFO:tasks.workunit.client.1.smithi092.stdout:4/157: mkdir d4/d5/d1d/d30 0 2024-09-17T01:52:02.964 INFO:tasks.workunit.client.1.smithi092.stdout:5/113: dwrite d0/de/d19/d1a/f22 [0,4194304] 0 2024-09-17T01:52:02.964 INFO:tasks.workunit.client.1.smithi092.stdout:9/185: mkdir d0/df/d17/d1f/d20/d2e 0 2024-09-17T01:52:02.964 INFO:tasks.workunit.client.1.smithi092.stdout:4/158: rename d4/d5/d1d to d4/d5/d1d/d31 22 2024-09-17T01:52:02.965 INFO:tasks.workunit.client.1.smithi092.stdout:5/114: chown d0/de 27278 1 2024-09-17T01:52:02.965 INFO:tasks.workunit.client.1.smithi092.stdout:9/186: chown d0/df 1047323 1 2024-09-17T01:52:02.966 INFO:tasks.workunit.client.0.smithi031.stdout:3/340: truncate db/df/d1d/d37/d3a/f58 1001391 0 2024-09-17T01:52:02.966 INFO:tasks.workunit.client.1.smithi092.stdout:9/187: chown d0/d5/f8 2 1 2024-09-17T01:52:02.967 INFO:tasks.workunit.client.0.smithi031.stdout:4/530: write d8/fd [2915553,104461] 0 2024-09-17T01:52:02.968 INFO:tasks.workunit.client.1.smithi092.stdout:9/188: chown d0/df/d17/d1f/d20 210631 1 2024-09-17T01:52:02.972 INFO:tasks.workunit.client.1.smithi092.stdout:9/189: write d0/df/f18 [320819,101012] 0 2024-09-17T01:52:02.972 INFO:tasks.workunit.client.1.smithi092.stdout:4/159: dread d4/d13/d20/f29 [0,4194304] 0 2024-09-17T01:52:02.973 INFO:tasks.workunit.client.0.smithi031.stdout:4/531: dread d8/d3a/d41/d64/f24 [0,4194304] 0 2024-09-17T01:52:02.974 INFO:tasks.workunit.client.0.smithi031.stdout:4/532: chown d8/d3a/d41/d64/d4d/d5a/d79 535 1 2024-09-17T01:52:02.975 INFO:tasks.workunit.client.1.smithi092.stdout:9/190: fdatasync d0/df/d17/d1f/f2d 0 2024-09-17T01:52:02.975 INFO:tasks.workunit.client.1.smithi092.stdout:5/115: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:02.976 INFO:tasks.workunit.client.1.smithi092.stdout:4/160: dread - d4/d13/d20/f2e zero size 2024-09-17T01:52:02.982 INFO:tasks.workunit.client.1.smithi092.stdout:5/116: rename d0/f7 to d0/de/d19/d1a/f25 0 2024-09-17T01:52:02.984 INFO:tasks.workunit.client.1.smithi092.stdout:4/161: mkdir d4/d5/d1d/d32 0 2024-09-17T01:52:02.985 INFO:tasks.workunit.client.1.smithi092.stdout:9/191: dwrite d0/df/d17/d1f/d20/f24 [0,4194304] 0 2024-09-17T01:52:02.986 INFO:tasks.workunit.client.1.smithi092.stdout:9/192: write d0/f6 [13343748,1659] 0 2024-09-17T01:52:02.987 INFO:tasks.workunit.client.1.smithi092.stdout:4/162: dread d4/d13/f2b [0,4194304] 0 2024-09-17T01:52:02.988 INFO:tasks.workunit.client.1.smithi092.stdout:9/193: write d0/df/f18 [2448274,35095] 0 2024-09-17T01:52:02.991 INFO:tasks.workunit.client.1.smithi092.stdout:4/163: write d4/d13/d20/f2e [661121,57501] 0 2024-09-17T01:52:02.991 INFO:tasks.workunit.client.1.smithi092.stdout:5/117: rename d0/de/d19/d1a/d1e/c1c to d0/d23/c26 0 2024-09-17T01:52:02.999 INFO:tasks.workunit.client.1.smithi092.stdout:4/164: dwrite d4/d13/d20/f2e [0,4194304] 0 2024-09-17T01:52:02.999 INFO:tasks.workunit.client.1.smithi092.stdout:4/165: readlink d4/d13/d20/l25 0 2024-09-17T01:52:03.008 INFO:tasks.workunit.client.1.smithi092.stdout:4/166: dwrite d4/d13/d20/f2e [0,4194304] 0 2024-09-17T01:52:03.010 INFO:tasks.workunit.client.1.smithi092.stdout:9/194: dread d0/df/d17/f1c [0,4194304] 0 2024-09-17T01:52:03.012 INFO:tasks.workunit.client.0.smithi031.stdout:3/341: truncate db/df/d1d/f59 1212690 0 2024-09-17T01:52:03.014 INFO:tasks.workunit.client.0.smithi031.stdout:3/342: fsync db/df/f22 0 2024-09-17T01:52:03.017 INFO:tasks.workunit.client.0.smithi031.stdout:4/533: link d8/d3a/d41/d64/d86/f94 d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/fb1 0 2024-09-17T01:52:03.020 INFO:tasks.workunit.client.1.smithi092.stdout:4/167: dwrite d4/d13/d20/f27 [0,4194304] 0 2024-09-17T01:52:03.020 INFO:tasks.workunit.client.1.smithi092.stdout:9/195: dread d0/df/d17/d1f/d20/f24 [0,4194304] 0 2024-09-17T01:52:03.020 INFO:tasks.workunit.client.0.smithi031.stdout:3/343: rename db/df/d1d/f61 to db/d29/f6f 0 2024-09-17T01:52:03.021 INFO:tasks.workunit.client.0.smithi031.stdout:3/344: write db/df/f1e [415218,109167] 0 2024-09-17T01:52:03.022 INFO:tasks.workunit.client.1.smithi092.stdout:5/118: dread d0/fd [0,4194304] 0 2024-09-17T01:52:03.022 INFO:tasks.workunit.client.0.smithi031.stdout:3/345: fdatasync db/f11 0 2024-09-17T01:52:03.023 INFO:tasks.workunit.client.0.smithi031.stdout:4/534: rename d8/d3a/d41/d55/f78 to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/fb2 0 2024-09-17T01:52:03.024 INFO:tasks.workunit.client.1.smithi092.stdout:5/119: fdatasync d0/de/d19/d1a/f25 0 2024-09-17T01:52:03.025 INFO:tasks.workunit.client.1.smithi092.stdout:5/120: dread - d0/de/d19/d1a/d1e/f12 zero size 2024-09-17T01:52:03.026 INFO:tasks.workunit.client.1.smithi092.stdout:9/196: creat d0/df/d17/f2f x:0 0 0 2024-09-17T01:52:03.028 INFO:tasks.workunit.client.1.smithi092.stdout:4/168: getdents d4/d5/d8 0 2024-09-17T01:52:03.028 INFO:tasks.workunit.client.1.smithi092.stdout:9/197: truncate d0/df/d17/f2f 26942 0 2024-09-17T01:52:03.029 INFO:tasks.workunit.client.1.smithi092.stdout:4/169: chown d4/d5/l2a 5538774 1 2024-09-17T01:52:03.029 INFO:tasks.workunit.client.1.smithi092.stdout:5/121: creat d0/d23/f27 x:0 0 0 2024-09-17T01:52:03.030 INFO:tasks.workunit.client.1.smithi092.stdout:9/198: write d0/df/d17/d1f/f2d [553205,125181] 0 2024-09-17T01:52:03.031 INFO:tasks.workunit.client.0.smithi031.stdout:3/346: getdents db/df/d1c 0 2024-09-17T01:52:03.031 INFO:tasks.workunit.client.1.smithi092.stdout:4/170: fdatasync d4/d13/f2b 0 2024-09-17T01:52:03.032 INFO:tasks.workunit.client.0.smithi031.stdout:4/535: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f8e [0,4194304] 0 2024-09-17T01:52:03.033 INFO:tasks.workunit.client.0.smithi031.stdout:4/536: fsync d8/d3a/d41/d64/d4d/f81 0 2024-09-17T01:52:03.034 INFO:tasks.workunit.client.1.smithi092.stdout:4/171: creat d4/d5/f33 x:0 0 0 2024-09-17T01:52:03.035 INFO:tasks.workunit.client.1.smithi092.stdout:9/199: mknod d0/df/d17/d1f/d20/d2e/c30 0 2024-09-17T01:52:03.037 INFO:tasks.workunit.client.0.smithi031.stdout:4/537: chown d8/d3a/d41/d64/d4d/d5a/c89 151652 1 2024-09-17T01:52:03.037 INFO:tasks.workunit.client.1.smithi092.stdout:5/122: getdents d0/de 0 2024-09-17T01:52:03.038 INFO:tasks.workunit.client.0.smithi031.stdout:4/538: write d8/fd [969554,103975] 0 2024-09-17T01:52:03.038 INFO:tasks.workunit.client.0.smithi031.stdout:4/539: chown f5 16369246 1 2024-09-17T01:52:03.041 INFO:tasks.workunit.client.1.smithi092.stdout:4/172: link d4/f1e d4/d5/d8/f34 0 2024-09-17T01:52:03.042 INFO:tasks.workunit.client.1.smithi092.stdout:4/173: truncate d4/d13/f2b 552834 0 2024-09-17T01:52:03.043 INFO:tasks.workunit.client.0.smithi031.stdout:4/540: rmdir d8/d3a/d41/d55 39 2024-09-17T01:52:03.044 INFO:tasks.workunit.client.1.smithi092.stdout:9/200: link d0/df/d17/f1c d0/df/d17/d1f/d26/f31 0 2024-09-17T01:52:03.045 INFO:tasks.workunit.client.1.smithi092.stdout:4/174: fdatasync d4/d13/d20/f29 0 2024-09-17T01:52:03.046 INFO:tasks.workunit.client.0.smithi031.stdout:4/541: creat d8/d3a/d41/d64/d92/fb3 x:0 0 0 2024-09-17T01:52:03.047 INFO:tasks.workunit.client.0.smithi031.stdout:4/542: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f9f [414461,43971] 0 2024-09-17T01:52:03.048 INFO:tasks.workunit.client.1.smithi092.stdout:9/201: creat d0/f32 x:0 0 0 2024-09-17T01:52:03.049 INFO:tasks.workunit.client.1.smithi092.stdout:4/175: mkdir d4/d5/d1d/d32/d35 0 2024-09-17T01:52:03.050 INFO:tasks.workunit.client.1.smithi092.stdout:9/202: symlink d0/d5/l33 0 2024-09-17T01:52:03.052 INFO:tasks.workunit.client.0.smithi031.stdout:4/543: getdents d8 0 2024-09-17T01:52:03.052 INFO:tasks.workunit.client.1.smithi092.stdout:4/176: creat d4/d5/d8/f36 x:0 0 0 2024-09-17T01:52:03.053 INFO:tasks.workunit.client.0.smithi031.stdout:4/544: fdatasync d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 0 2024-09-17T01:52:03.055 INFO:tasks.workunit.client.1.smithi092.stdout:4/177: mknod d4/d5/d8/c37 0 2024-09-17T01:52:03.057 INFO:tasks.workunit.client.1.smithi092.stdout:9/203: rename d0/df/d17/d1f to d0/d7/d12/d34 0 2024-09-17T01:52:03.059 INFO:tasks.workunit.client.1.smithi092.stdout:0/266: sync 2024-09-17T01:52:03.059 INFO:tasks.workunit.client.1.smithi092.stdout:6/269: sync 2024-09-17T01:52:03.059 INFO:tasks.workunit.client.1.smithi092.stdout:3/140: sync 2024-09-17T01:52:03.059 INFO:tasks.workunit.client.1.smithi092.stdout:4/178: fsync d4/d5/d8/f36 0 2024-09-17T01:52:03.060 INFO:tasks.workunit.client.0.smithi031.stdout:4/545: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fa5 to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/fb4 0 2024-09-17T01:52:03.060 INFO:tasks.workunit.client.1.smithi092.stdout:5/123: dwrite d0/fc [0,4194304] 0 2024-09-17T01:52:03.061 INFO:tasks.workunit.client.1.smithi092.stdout:9/204: fdatasync d0/d7/d12/d34/d26/f31 0 2024-09-17T01:52:03.061 INFO:tasks.workunit.client.0.smithi031.stdout:4/546: symlink d8/d9c/lb5 0 2024-09-17T01:52:03.063 INFO:tasks.workunit.client.1.smithi092.stdout:3/141: mkdir d4/d2f 0 2024-09-17T01:52:03.063 INFO:tasks.workunit.client.1.smithi092.stdout:6/270: read - d3/d10/d1f/d21/d28/d2b/d48/d19/f50 zero size 2024-09-17T01:52:03.063 INFO:tasks.workunit.client.1.smithi092.stdout:3/142: chown d4/c1f 102659 1 2024-09-17T01:52:03.064 INFO:tasks.workunit.client.0.smithi031.stdout:3/347: dread db/df/f1e [0,4194304] 0 2024-09-17T01:52:03.064 INFO:tasks.workunit.client.1.smithi092.stdout:3/143: write d4/d16/f24 [3348576,98025] 0 2024-09-17T01:52:03.065 INFO:tasks.workunit.client.0.smithi031.stdout:4/547: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/lb6 0 2024-09-17T01:52:03.066 INFO:tasks.workunit.client.1.smithi092.stdout:0/267: truncate d3/da/f22 1678434 0 2024-09-17T01:52:03.066 INFO:tasks.workunit.client.1.smithi092.stdout:0/268: dread - d3/da/d1c/f45 zero size 2024-09-17T01:52:03.067 INFO:tasks.workunit.client.0.smithi031.stdout:4/548: stat d8/d3a/d41/d64/d4d/d5a/c90 0 2024-09-17T01:52:03.067 INFO:tasks.workunit.client.1.smithi092.stdout:5/124: symlink d0/de/l28 0 2024-09-17T01:52:03.068 INFO:tasks.workunit.client.1.smithi092.stdout:5/125: chown d0/fd 232726 1 2024-09-17T01:52:03.069 INFO:tasks.workunit.client.1.smithi092.stdout:6/271: mkdir d3/d10/d1f/d21/d1e/d55 0 2024-09-17T01:52:03.069 INFO:tasks.workunit.client.1.smithi092.stdout:6/272: fsync f2 0 2024-09-17T01:52:03.070 INFO:tasks.workunit.client.1.smithi092.stdout:3/144: creat d4/f30 x:0 0 0 2024-09-17T01:52:03.072 INFO:tasks.workunit.client.0.smithi031.stdout:3/348: dwrite db/f3e [4194304,4194304] 0 2024-09-17T01:52:03.074 INFO:tasks.workunit.client.1.smithi092.stdout:9/205: rename d0/c28 to d0/df/c35 0 2024-09-17T01:52:03.075 INFO:tasks.workunit.client.0.smithi031.stdout:4/549: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/fb7 x:0 0 0 2024-09-17T01:52:03.076 INFO:tasks.workunit.client.1.smithi092.stdout:9/206: truncate d0/df/f27 4719146 0 2024-09-17T01:52:03.077 INFO:tasks.workunit.client.0.smithi031.stdout:4/550: truncate d8/fd 4430957 0 2024-09-17T01:52:03.077 INFO:tasks.workunit.client.1.smithi092.stdout:0/269: link d3/da/c18 d3/d1d/c4d 0 2024-09-17T01:52:03.078 INFO:tasks.workunit.client.0.smithi031.stdout:3/349: symlink db/df/d50/l70 0 2024-09-17T01:52:03.080 INFO:tasks.workunit.client.1.smithi092.stdout:4/179: rename d4/c6 to d4/d13/d20/c38 0 2024-09-17T01:52:03.082 INFO:tasks.workunit.client.1.smithi092.stdout:3/145: dwrite d4/d16/f1e [0,4194304] 0 2024-09-17T01:52:03.084 INFO:tasks.workunit.client.1.smithi092.stdout:9/207: creat d0/d7/f36 x:0 0 0 2024-09-17T01:52:03.086 INFO:tasks.workunit.client.1.smithi092.stdout:6/273: rename d3/d10/f20 to d3/d10/d1f/d21/d28/f56 0 2024-09-17T01:52:03.087 INFO:tasks.workunit.client.0.smithi031.stdout:3/350: dwrite db/df/f39 [0,4194304] 0 2024-09-17T01:52:03.087 INFO:tasks.workunit.client.0.smithi031.stdout:4/551: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/fb2 to d8/d3a/d41/fb8 0 2024-09-17T01:52:03.088 INFO:tasks.workunit.client.1.smithi092.stdout:3/146: mkdir d4/d20/d31 0 2024-09-17T01:52:03.088 INFO:tasks.workunit.client.1.smithi092.stdout:6/274: read - d3/d10/d1f/d21/d28/d2b/d48/f3e zero size 2024-09-17T01:52:03.089 INFO:tasks.workunit.client.0.smithi031.stdout:4/552: truncate d8/fad 524878 0 2024-09-17T01:52:03.089 INFO:tasks.workunit.client.1.smithi092.stdout:0/270: getdents d3/da/d1c/d4a 0 2024-09-17T01:52:03.090 INFO:tasks.workunit.client.1.smithi092.stdout:4/180: dread d4/d5/d1d/f26 [0,4194304] 0 2024-09-17T01:52:03.092 INFO:tasks.workunit.client.1.smithi092.stdout:4/181: truncate d4/d5/d8/f36 773555 0 2024-09-17T01:52:03.092 INFO:tasks.workunit.client.1.smithi092.stdout:4/182: readlink d4/d5/l2a 0 2024-09-17T01:52:03.094 INFO:tasks.workunit.client.0.smithi031.stdout:4/553: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/lb9 0 2024-09-17T01:52:03.095 INFO:tasks.workunit.client.1.smithi092.stdout:6/275: creat d3/d10/f57 x:0 0 0 2024-09-17T01:52:03.098 INFO:tasks.workunit.client.1.smithi092.stdout:5/126: chown d0/de/d19/f1f 3405 1 2024-09-17T01:52:03.100 INFO:tasks.workunit.client.1.smithi092.stdout:6/276: dread d3/d10/d1a/f24 [4194304,4194304] 0 2024-09-17T01:52:03.101 INFO:tasks.workunit.client.1.smithi092.stdout:6/277: write d3/f5 [3308765,53564] 0 2024-09-17T01:52:03.103 INFO:tasks.workunit.client.1.smithi092.stdout:4/183: creat d4/d5/d1d/d32/d35/f39 x:0 0 0 2024-09-17T01:52:03.106 INFO:tasks.workunit.client.1.smithi092.stdout:0/271: rename d3/da/f37 to d3/da/d15/f4e 0 2024-09-17T01:52:03.108 INFO:tasks.workunit.client.1.smithi092.stdout:6/278: symlink d3/d10/d1f/d21/l58 0 2024-09-17T01:52:03.108 INFO:tasks.workunit.client.1.smithi092.stdout:6/279: chown d3/f3a 2343190 1 2024-09-17T01:52:03.109 INFO:tasks.workunit.client.1.smithi092.stdout:0/272: readlink d3/da/d1c/l25 0 2024-09-17T01:52:03.110 INFO:tasks.workunit.client.1.smithi092.stdout:6/280: creat d3/d10/d1f/f59 x:0 0 0 2024-09-17T01:52:03.112 INFO:tasks.workunit.client.1.smithi092.stdout:0/273: mknod d3/d2e/c4f 0 2024-09-17T01:52:03.113 INFO:tasks.workunit.client.1.smithi092.stdout:0/274: chown d3/da/d1c 5 1 2024-09-17T01:52:03.113 INFO:tasks.workunit.client.1.smithi092.stdout:4/184: getdents d4 0 2024-09-17T01:52:03.115 INFO:tasks.workunit.client.1.smithi092.stdout:4/185: mknod d4/d5/d1d/d32/d35/c3a 0 2024-09-17T01:52:03.117 INFO:tasks.workunit.client.1.smithi092.stdout:0/275: dread d3/da/f2a [0,4194304] 0 2024-09-17T01:52:03.117 INFO:tasks.workunit.client.1.smithi092.stdout:4/186: mkdir d4/d13/d3b 0 2024-09-17T01:52:03.117 INFO:tasks.workunit.client.1.smithi092.stdout:0/276: readlink d3/l9 0 2024-09-17T01:52:03.119 INFO:tasks.workunit.client.1.smithi092.stdout:4/187: creat d4/d5/d1d/f3c x:0 0 0 2024-09-17T01:52:03.122 INFO:tasks.workunit.client.1.smithi092.stdout:4/188: getdents d4/d5/d1d/d32 0 2024-09-17T01:52:03.123 INFO:tasks.workunit.client.1.smithi092.stdout:4/189: read d4/f1e [871804,91841] 0 2024-09-17T01:52:03.123 INFO:tasks.workunit.client.1.smithi092.stdout:4/190: readlink d4/d13/d20/l25 0 2024-09-17T01:52:03.124 INFO:tasks.workunit.client.1.smithi092.stdout:4/191: rename d4 to d4/d13/d3b/d3d 22 2024-09-17T01:52:03.127 INFO:tasks.workunit.client.0.smithi031.stdout:4/554: dread d8/f3b [4194304,4194304] 0 2024-09-17T01:52:03.129 INFO:tasks.workunit.client.1.smithi092.stdout:9/208: write d0/d7/d12/d34/d26/f31 [1010787,729] 0 2024-09-17T01:52:03.130 INFO:tasks.workunit.client.0.smithi031.stdout:3/351: dread db/f3e [0,4194304] 0 2024-09-17T01:52:03.131 INFO:tasks.workunit.client.1.smithi092.stdout:0/277: fsync d3/da/f22 0 2024-09-17T01:52:03.132 INFO:tasks.workunit.client.0.smithi031.stdout:3/352: fdatasync db/df/f15 0 2024-09-17T01:52:03.132 INFO:tasks.workunit.client.1.smithi092.stdout:4/192: dwrite d4/d5/d8/f36 [0,4194304] 0 2024-09-17T01:52:03.135 INFO:tasks.workunit.client.0.smithi031.stdout:4/555: dwrite d8/d3a/d41/d64/d4d/d5a/d79/f80 [0,4194304] 0 2024-09-17T01:52:03.137 INFO:tasks.workunit.client.0.smithi031.stdout:3/353: creat db/df/d1d/d37/d6c/f71 x:0 0 0 2024-09-17T01:52:03.138 INFO:tasks.workunit.client.0.smithi031.stdout:4/556: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f9f [203486,49199] 0 2024-09-17T01:52:03.140 INFO:tasks.workunit.client.1.smithi092.stdout:9/209: creat d0/d7/d21/f37 x:0 0 0 2024-09-17T01:52:03.140 INFO:tasks.workunit.client.1.smithi092.stdout:4/193: mkdir d4/d5/d1d/d32/d35/d3e 0 2024-09-17T01:52:03.142 INFO:tasks.workunit.client.1.smithi092.stdout:5/127: dread d0/de/d19/d1a/d1e/ff [0,4194304] 0 2024-09-17T01:52:03.143 INFO:tasks.workunit.client.0.smithi031.stdout:4/557: unlink d8/d3a/d7e/c82 0 2024-09-17T01:52:03.145 INFO:tasks.workunit.client.1.smithi092.stdout:0/278: dwrite d3/da/d1c/f49 [0,4194304] 0 2024-09-17T01:52:03.145 INFO:tasks.workunit.client.0.smithi031.stdout:8/373: sync 2024-09-17T01:52:03.149 INFO:tasks.workunit.client.1.smithi092.stdout:0/279: truncate d3/f4 3627491 0 2024-09-17T01:52:03.151 INFO:tasks.workunit.client.1.smithi092.stdout:5/128: mkdir d0/de/d19/d1a/d1e/d29 0 2024-09-17T01:52:03.152 INFO:tasks.workunit.client.1.smithi092.stdout:9/210: creat d0/df/d17/f38 x:0 0 0 2024-09-17T01:52:03.155 INFO:tasks.workunit.client.1.smithi092.stdout:6/281: dread d3/f13 [0,4194304] 0 2024-09-17T01:52:03.157 INFO:tasks.workunit.client.0.smithi031.stdout:3/354: dwrite db/df/d1c/f2b [0,4194304] 0 2024-09-17T01:52:03.160 INFO:tasks.workunit.client.1.smithi092.stdout:6/282: symlink d3/d10/d1a/d43/l5a 0 2024-09-17T01:52:03.160 INFO:tasks.workunit.client.1.smithi092.stdout:5/129: dwrite d0/de/d19/d1a/f22 [0,4194304] 0 2024-09-17T01:52:03.162 INFO:tasks.workunit.client.1.smithi092.stdout:6/283: chown d3/l22 23903344 1 2024-09-17T01:52:03.164 INFO:tasks.workunit.client.0.smithi031.stdout:3/355: dwrite db/df/f31 [0,4194304] 0 2024-09-17T01:52:03.165 INFO:tasks.workunit.client.1.smithi092.stdout:6/284: rmdir d3/d10/d1f/d21/d28/d2b 39 2024-09-17T01:52:03.166 INFO:tasks.workunit.client.0.smithi031.stdout:4/558: dread d8/d3a/d41/d64/f2d [0,4194304] 0 2024-09-17T01:52:03.166 INFO:tasks.workunit.client.1.smithi092.stdout:6/285: write d3/f8 [1157192,74721] 0 2024-09-17T01:52:03.167 INFO:tasks.workunit.client.1.smithi092.stdout:5/130: rename d0/de/f15 to d0/de/d19/d1a/d1e/f2a 0 2024-09-17T01:52:03.179 INFO:tasks.workunit.client.1.smithi092.stdout:0/280: write d3/f7 [1744312,48861] 0 2024-09-17T01:52:03.180 INFO:tasks.workunit.client.1.smithi092.stdout:9/211: truncate d0/d7/d12/d34/f2d 61689 0 2024-09-17T01:52:03.181 INFO:tasks.workunit.client.1.smithi092.stdout:9/212: write d0/f32 [986692,37607] 0 2024-09-17T01:52:03.183 INFO:tasks.workunit.client.1.smithi092.stdout:0/281: rename d3/f3e to d3/d2e/d3b/d40/f50 0 2024-09-17T01:52:03.186 INFO:tasks.workunit.client.1.smithi092.stdout:9/213: rename d0/d5/l13 to d0/d5/d29/l39 0 2024-09-17T01:52:03.186 INFO:tasks.workunit.client.1.smithi092.stdout:9/214: stat d0/d7/d21/c22 0 2024-09-17T01:52:03.188 INFO:tasks.workunit.client.1.smithi092.stdout:6/286: write f1 [1156416,57549] 0 2024-09-17T01:52:03.188 INFO:tasks.workunit.client.1.smithi092.stdout:5/131: write d0/de/d19/d1a/d1e/f12 [488457,81843] 0 2024-09-17T01:52:03.192 INFO:tasks.workunit.client.1.smithi092.stdout:9/215: creat d0/d7/d12/d34/f3a x:0 0 0 2024-09-17T01:52:03.193 INFO:tasks.workunit.client.0.smithi031.stdout:4/559: truncate d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f8e 606728 0 2024-09-17T01:52:03.193 INFO:tasks.workunit.client.1.smithi092.stdout:0/282: getdents d3/d2e 0 2024-09-17T01:52:03.195 INFO:tasks.workunit.client.1.smithi092.stdout:5/132: fdatasync d0/de/d19/d1a/d1e/f12 0 2024-09-17T01:52:03.196 INFO:tasks.workunit.client.0.smithi031.stdout:4/560: dread d8/f14 [0,4194304] 0 2024-09-17T01:52:03.197 INFO:tasks.workunit.client.0.smithi031.stdout:3/356: dwrite db/f34 [0,4194304] 0 2024-09-17T01:52:03.197 INFO:tasks.workunit.client.1.smithi092.stdout:6/287: dwrite d3/d10/d1f/d21/f3b [0,4194304] 0 2024-09-17T01:52:03.199 INFO:tasks.workunit.client.0.smithi031.stdout:4/561: creat d8/fba x:0 0 0 2024-09-17T01:52:03.199 INFO:tasks.workunit.client.1.smithi092.stdout:5/133: rmdir d0/de/d19/d1a 39 2024-09-17T01:52:03.199 INFO:tasks.workunit.client.1.smithi092.stdout:5/134: fdatasync d0/fd 0 2024-09-17T01:52:03.205 INFO:tasks.workunit.client.0.smithi031.stdout:3/357: rename db/d29/f6f to db/df/d1d/d37/f72 0 2024-09-17T01:52:03.206 INFO:tasks.workunit.client.1.smithi092.stdout:0/283: getdents d3/da/d1c 0 2024-09-17T01:52:03.207 INFO:tasks.workunit.client.1.smithi092.stdout:0/284: chown d3/da/f22 3 1 2024-09-17T01:52:03.209 INFO:tasks.workunit.client.0.smithi031.stdout:3/358: symlink db/df/d1d/d37/d3a/l73 0 2024-09-17T01:52:03.209 INFO:tasks.workunit.client.1.smithi092.stdout:5/135: mknod d0/c2b 0 2024-09-17T01:52:03.209 INFO:tasks.workunit.client.0.smithi031.stdout:4/562: fdatasync d8/d3a/d41/d64/f2d 0 2024-09-17T01:52:03.210 INFO:tasks.workunit.client.0.smithi031.stdout:3/359: chown db/df/d1d/d37/d3a/l69 2 1 2024-09-17T01:52:03.211 INFO:tasks.workunit.client.0.smithi031.stdout:3/360: fsync db/f41 0 2024-09-17T01:52:03.211 INFO:tasks.workunit.client.1.smithi092.stdout:6/288: creat d3/d10/d1f/d21/d1e/d55/f5b x:0 0 0 2024-09-17T01:52:03.213 INFO:tasks.workunit.client.0.smithi031.stdout:4/563: dread d8/d3a/d41/d64/f2d [0,4194304] 0 2024-09-17T01:52:03.214 INFO:tasks.workunit.client.1.smithi092.stdout:5/136: write d0/de/d19/d1a/d1e/f1b [806069,97673] 0 2024-09-17T01:52:03.214 INFO:tasks.workunit.client.0.smithi031.stdout:4/564: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/lb9 5626 1 2024-09-17T01:52:03.215 INFO:tasks.workunit.client.1.smithi092.stdout:0/285: truncate d3/da/f22 1415504 0 2024-09-17T01:52:03.218 INFO:tasks.workunit.client.0.smithi031.stdout:4/565: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/fbb x:0 0 0 2024-09-17T01:52:03.219 INFO:tasks.workunit.client.1.smithi092.stdout:0/286: creat d3/da/d1c/d47/f51 x:0 0 0 2024-09-17T01:52:03.220 INFO:tasks.workunit.client.1.smithi092.stdout:6/289: dread d3/d10/d1f/d21/d28/f2c [4194304,4194304] 0 2024-09-17T01:52:03.224 INFO:tasks.workunit.client.1.smithi092.stdout:5/137: dwrite d0/de/d19/d1a/d1e/ff [0,4194304] 0 2024-09-17T01:52:03.224 INFO:tasks.workunit.client.0.smithi031.stdout:4/566: rename d8/d3a/d41/d64/d4d/d5a/d8c/f30 to d8/d9c/fbc 0 2024-09-17T01:52:03.226 INFO:tasks.workunit.client.1.smithi092.stdout:0/287: rename d3/f36 to d3/da/d1c/d47/f52 0 2024-09-17T01:52:03.226 INFO:tasks.workunit.client.1.smithi092.stdout:9/216: truncate d0/d7/d12/d34/d26/f31 3774325 0 2024-09-17T01:52:03.226 INFO:tasks.workunit.client.0.smithi031.stdout:4/567: fsync d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 0 2024-09-17T01:52:03.227 INFO:tasks.workunit.client.1.smithi092.stdout:9/217: dread - d0/d7/d21/f37 zero size 2024-09-17T01:52:03.227 INFO:tasks.workunit.client.0.smithi031.stdout:3/361: truncate db/df/f39 2975882 0 2024-09-17T01:52:03.227 INFO:tasks.workunit.client.1.smithi092.stdout:6/290: symlink d3/d10/d1f/d21/d1e/l5c 0 2024-09-17T01:52:03.228 INFO:tasks.workunit.client.1.smithi092.stdout:9/218: dread - d0/d7/d21/f37 zero size 2024-09-17T01:52:03.228 INFO:tasks.workunit.client.1.smithi092.stdout:5/138: creat d0/d23/f2c x:0 0 0 2024-09-17T01:52:03.230 INFO:tasks.workunit.client.1.smithi092.stdout:0/288: rename d3/da/d15/f3d to d3/d2e/d3b/d40/f53 0 2024-09-17T01:52:03.231 INFO:tasks.workunit.client.1.smithi092.stdout:6/291: mkdir d3/d10/d1a/d2d/d5d 0 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:3/362: rename db/f41 to db/df/d1c/d6a/f74 0 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:9/335: sync 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:2/442: sync 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:7/364: sync 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:5/345: sync 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:1/428: sync 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:0/397: sync 2024-09-17T01:52:03.232 INFO:tasks.workunit.client.0.smithi031.stdout:6/531: sync 2024-09-17T01:52:03.233 INFO:tasks.workunit.client.1.smithi092.stdout:9/219: mknod d0/d5/c3b 0 2024-09-17T01:52:03.233 INFO:tasks.workunit.client.1.smithi092.stdout:5/139: stat d0/d23/c26 0 2024-09-17T01:52:03.233 INFO:tasks.workunit.client.0.smithi031.stdout:1/429: chown d4/d1a/d43 24195808 1 2024-09-17T01:52:03.234 INFO:tasks.workunit.client.1.smithi092.stdout:2/170: sync 2024-09-17T01:52:03.234 INFO:tasks.workunit.client.0.smithi031.stdout:5/346: stat da/d14 0 2024-09-17T01:52:03.235 INFO:tasks.workunit.client.0.smithi031.stdout:3/363: stat db/df/d1d/f4c 0 2024-09-17T01:52:03.235 INFO:tasks.workunit.client.1.smithi092.stdout:0/289: creat d3/d2e/d3b/d40/f54 x:0 0 0 2024-09-17T01:52:03.236 INFO:tasks.workunit.client.0.smithi031.stdout:3/364: chown ca 32626427 1 2024-09-17T01:52:03.236 INFO:tasks.workunit.client.0.smithi031.stdout:9/336: read d3/d10/f60 [263290,10016] 0 2024-09-17T01:52:03.237 INFO:tasks.workunit.client.0.smithi031.stdout:6/532: chown d23/db4/d6a/d72/l7d 5 1 2024-09-17T01:52:03.238 INFO:tasks.workunit.client.0.smithi031.stdout:2/443: write d1/d3/df/d11/d30/f4d [2714776,130826] 0 2024-09-17T01:52:03.238 INFO:tasks.workunit.client.1.smithi092.stdout:6/292: dread - d3/d10/d1f/d21/d28/d2b/d48/f3e zero size 2024-09-17T01:52:03.238 INFO:tasks.workunit.client.1.smithi092.stdout:2/171: mknod d10/d1d/d2c/c37 0 2024-09-17T01:52:03.238 INFO:tasks.workunit.client.0.smithi031.stdout:5/347: creat da/d42/d26/f75 x:0 0 0 2024-09-17T01:52:03.238 INFO:tasks.workunit.client.1.smithi092.stdout:0/290: mkdir d3/d2e/d55 0 2024-09-17T01:52:03.239 INFO:tasks.workunit.client.0.smithi031.stdout:0/398: write d0/d29/d33/f13 [207917,52461] 0 2024-09-17T01:52:03.239 INFO:tasks.workunit.client.0.smithi031.stdout:3/365: stat db/df/l32 0 2024-09-17T01:52:03.239 INFO:tasks.workunit.client.0.smithi031.stdout:7/365: symlink db/d18/l6b 0 2024-09-17T01:52:03.240 INFO:tasks.workunit.client.1.smithi092.stdout:6/293: write d3/d10/d1f/f59 [451962,129764] 0 2024-09-17T01:52:03.241 INFO:tasks.workunit.client.1.smithi092.stdout:5/140: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:03.241 INFO:tasks.workunit.client.1.smithi092.stdout:9/220: creat d0/df/f3c x:0 0 0 2024-09-17T01:52:03.243 INFO:tasks.workunit.client.1.smithi092.stdout:9/221: dread - d0/df/f3c zero size 2024-09-17T01:52:03.243 INFO:tasks.workunit.client.0.smithi031.stdout:0/399: write d0/d29/d33/f35 [480952,1614] 0 2024-09-17T01:52:03.243 INFO:tasks.workunit.client.0.smithi031.stdout:2/444: truncate d1/d3/df/d66/f9b 5582509 0 2024-09-17T01:52:03.244 INFO:tasks.workunit.client.1.smithi092.stdout:0/291: creat d3/d2e/d3b/f56 x:0 0 0 2024-09-17T01:52:03.246 INFO:tasks.workunit.client.0.smithi031.stdout:1/430: creat d4/d3d/d65/d78/f90 x:0 0 0 2024-09-17T01:52:03.246 INFO:tasks.workunit.client.0.smithi031.stdout:4/568: truncate d8/d3a/d41/d64/f24 3626480 0 2024-09-17T01:52:03.247 INFO:tasks.workunit.client.0.smithi031.stdout:1/431: stat d4/d1e/d40/d77 0 2024-09-17T01:52:03.249 INFO:tasks.workunit.client.0.smithi031.stdout:7/366: mkdir db/d1c/d41/d6c 0 2024-09-17T01:52:03.250 INFO:tasks.workunit.client.1.smithi092.stdout:5/141: write d0/de/d19/f1f [3731068,123134] 0 2024-09-17T01:52:03.250 INFO:tasks.workunit.client.1.smithi092.stdout:9/222: mknod d0/d7/d12/d34/d20/d2e/c3d 0 2024-09-17T01:52:03.251 INFO:tasks.workunit.client.0.smithi031.stdout:7/367: write db/d1c/d46/f60 [3145277,24161] 0 2024-09-17T01:52:03.254 INFO:tasks.workunit.client.0.smithi031.stdout:3/366: link db/df/f44 db/df/d50/f75 0 2024-09-17T01:52:03.254 INFO:tasks.workunit.client.0.smithi031.stdout:4/569: truncate d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa1 160926 0 2024-09-17T01:52:03.255 INFO:tasks.workunit.client.0.smithi031.stdout:3/367: write db/f46 [454363,75041] 0 2024-09-17T01:52:03.256 INFO:tasks.workunit.client.0.smithi031.stdout:6/533: rename d23/c8c to d23/d63/cb9 0 2024-09-17T01:52:03.256 INFO:tasks.workunit.client.0.smithi031.stdout:4/570: chown d8/d3a/d7e 4311 1 2024-09-17T01:52:03.257 INFO:tasks.workunit.client.1.smithi092.stdout:2/172: dwrite d10/f1a [0,4194304] 0 2024-09-17T01:52:03.258 INFO:tasks.workunit.client.0.smithi031.stdout:1/432: mkdir d4/d1e/d91 0 2024-09-17T01:52:03.258 INFO:tasks.workunit.client.0.smithi031.stdout:6/534: stat d23/db4/d6a/dac/f95 0 2024-09-17T01:52:03.259 INFO:tasks.workunit.client.1.smithi092.stdout:6/294: dwrite d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:03.259 INFO:tasks.workunit.client.1.smithi092.stdout:5/142: read d0/de/d19/d1a/d1e/ff [1296437,78912] 0 2024-09-17T01:52:03.261 INFO:tasks.workunit.client.0.smithi031.stdout:6/535: write d23/db4/d6a/dac/f95 [3935136,25391] 0 2024-09-17T01:52:03.267 INFO:tasks.workunit.client.0.smithi031.stdout:1/433: truncate d4/d1e/d5d/f8f 973225 0 2024-09-17T01:52:03.267 INFO:tasks.workunit.client.0.smithi031.stdout:3/368: truncate db/df/d1d/d37/d6c/f71 679347 0 2024-09-17T01:52:03.267 INFO:tasks.workunit.client.0.smithi031.stdout:9/337: rename d3/d10/f24 to d3/d19/d1f/f6d 0 2024-09-17T01:52:03.267 INFO:tasks.workunit.client.1.smithi092.stdout:0/292: dwrite d3/da/f10 [0,4194304] 0 2024-09-17T01:52:03.267 INFO:tasks.workunit.client.1.smithi092.stdout:2/173: symlink d10/l38 0 2024-09-17T01:52:03.267 INFO:tasks.workunit.client.1.smithi092.stdout:5/143: symlink d0/d23/l2d 0 2024-09-17T01:52:03.268 INFO:tasks.workunit.client.0.smithi031.stdout:5/348: link da/dc/c28 da/d42/d12/d4a/c76 0 2024-09-17T01:52:03.268 INFO:tasks.workunit.client.0.smithi031.stdout:7/368: creat db/d1c/d41/d6c/f6d x:0 0 0 2024-09-17T01:52:03.268 INFO:tasks.workunit.client.1.smithi092.stdout:0/293: fdatasync d3/da/d15/d30/f3c 0 2024-09-17T01:52:03.270 INFO:tasks.workunit.client.1.smithi092.stdout:6/295: truncate d3/d10/d1f/d21/d28/f2c 7867359 0 2024-09-17T01:52:03.271 INFO:tasks.workunit.client.0.smithi031.stdout:9/338: write d3/d10/f60 [563817,109151] 0 2024-09-17T01:52:03.273 INFO:tasks.workunit.client.1.smithi092.stdout:5/144: symlink d0/de/d19/d1a/d1e/l2e 0 2024-09-17T01:52:03.276 INFO:tasks.workunit.client.1.smithi092.stdout:0/294: creat d3/da/d1c/d3a/f57 x:0 0 0 2024-09-17T01:52:03.277 INFO:tasks.workunit.client.0.smithi031.stdout:0/400: rename d0/d29/d33/d2a/d25/d30/d4a/c89 to d0/d29/d33/d84/c8d 0 2024-09-17T01:52:03.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/536: dwrite f1e [0,4194304] 0 2024-09-17T01:52:03.279 INFO:tasks.workunit.client.0.smithi031.stdout:5/349: creat da/dc/d2e/f77 x:0 0 0 2024-09-17T01:52:03.279 INFO:tasks.workunit.client.0.smithi031.stdout:7/369: mknod db/d1c/d41/c6e 0 2024-09-17T01:52:03.281 INFO:tasks.workunit.client.1.smithi092.stdout:6/296: readlink d3/d10/d1f/d21/d28/d2b/d48/d19/l2a 0 2024-09-17T01:52:03.283 INFO:tasks.workunit.client.1.smithi092.stdout:6/297: fdatasync d3/f8 0 2024-09-17T01:52:03.283 INFO:tasks.workunit.client.0.smithi031.stdout:2/445: rename d1/d3/df/d19/d1e/d4f/l58 to d1/d3/df/d19/d1e/d4f/d92/l9e 0 2024-09-17T01:52:03.284 INFO:tasks.workunit.client.1.smithi092.stdout:5/145: symlink d0/de/l2f 0 2024-09-17T01:52:03.284 INFO:tasks.workunit.client.0.smithi031.stdout:0/401: creat d0/d29/d33/d2a/d25/d30/f8e x:0 0 0 2024-09-17T01:52:03.285 INFO:tasks.workunit.client.0.smithi031.stdout:6/537: creat d23/d63/d47/fba x:0 0 0 2024-09-17T01:52:03.285 INFO:tasks.workunit.client.0.smithi031.stdout:8/374: sync 2024-09-17T01:52:03.288 INFO:tasks.workunit.client.1.smithi092.stdout:0/295: dwrite d3/d2e/d3b/d40/f54 [0,4194304] 0 2024-09-17T01:52:03.288 INFO:tasks.workunit.client.0.smithi031.stdout:7/370: symlink db/d1c/d41/l6f 0 2024-09-17T01:52:03.289 INFO:tasks.workunit.client.1.smithi092.stdout:0/296: chown d3/da/d1c/d3a 25 1 2024-09-17T01:52:03.289 INFO:tasks.workunit.client.0.smithi031.stdout:1/434: dread d4/f4a [0,4194304] 0 2024-09-17T01:52:03.289 INFO:tasks.workunit.client.0.smithi031.stdout:5/350: chown da/dc/l38 10 1 2024-09-17T01:52:03.290 INFO:tasks.workunit.client.0.smithi031.stdout:7/371: write db/f62 [731511,37149] 0 2024-09-17T01:52:03.290 INFO:tasks.workunit.client.0.smithi031.stdout:4/571: rename d8/d3a/d41/d64/d4d/d75/f93 to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fbd 0 2024-09-17T01:52:03.291 INFO:tasks.workunit.client.1.smithi092.stdout:5/146: rename d0/ca to d0/de/c30 0 2024-09-17T01:52:03.291 INFO:tasks.workunit.client.1.smithi092.stdout:9/223: dread d0/df/f27 [0,4194304] 0 2024-09-17T01:52:03.292 INFO:tasks.workunit.client.0.smithi031.stdout:9/339: dwrite d3/d19/f65 [0,4194304] 0 2024-09-17T01:52:03.292 INFO:tasks.workunit.client.0.smithi031.stdout:2/446: unlink d1/d3/df/d11/l89 0 2024-09-17T01:52:03.295 INFO:tasks.workunit.client.1.smithi092.stdout:6/298: rename d3/d10/d1a/d2d to d3/d10/d1a/d43/d5e 0 2024-09-17T01:52:03.296 INFO:tasks.workunit.client.0.smithi031.stdout:9/340: stat d3/d4/d41/l54 0 2024-09-17T01:52:03.297 INFO:tasks.workunit.client.0.smithi031.stdout:1/435: truncate d4/d1a/d2d/f8b 891918 0 2024-09-17T01:52:03.298 INFO:tasks.workunit.client.1.smithi092.stdout:0/297: mkdir d3/d58 0 2024-09-17T01:52:03.298 INFO:tasks.workunit.client.0.smithi031.stdout:0/402: rmdir d0/d29/d33/d5 39 2024-09-17T01:52:03.301 INFO:tasks.workunit.client.1.smithi092.stdout:9/224: dread d0/d7/d12/d34/f2d [0,4194304] 0 2024-09-17T01:52:03.301 INFO:tasks.workunit.client.0.smithi031.stdout:7/372: dread db/d29/f54 [0,4194304] 0 2024-09-17T01:52:03.303 INFO:tasks.workunit.client.0.smithi031.stdout:4/572: truncate d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa1 759996 0 2024-09-17T01:52:03.303 INFO:tasks.workunit.client.0.smithi031.stdout:5/351: creat da/dc/d2e/d62/f78 x:0 0 0 2024-09-17T01:52:03.304 INFO:tasks.workunit.client.0.smithi031.stdout:2/447: write d1/d3/df/d11/d30/f7a [3756208,56997] 0 2024-09-17T01:52:03.305 INFO:tasks.workunit.client.1.smithi092.stdout:9/225: write d0/d5/f2a [1044949,117178] 0 2024-09-17T01:52:03.309 INFO:tasks.workunit.client.1.smithi092.stdout:6/299: dwrite d3/f36 [0,4194304] 0 2024-09-17T01:52:03.309 INFO:tasks.workunit.client.0.smithi031.stdout:8/375: mkdir d0/d5/d6c/d6d 0 2024-09-17T01:52:03.310 INFO:tasks.workunit.client.1.smithi092.stdout:9/226: truncate d0/df/d17/f38 362694 0 2024-09-17T01:52:03.310 INFO:tasks.workunit.client.1.smithi092.stdout:6/300: chown d3 6 1 2024-09-17T01:52:03.314 INFO:tasks.workunit.client.1.smithi092.stdout:9/227: truncate d0/df/f3c 717546 0 2024-09-17T01:52:03.314 INFO:tasks.workunit.client.0.smithi031.stdout:6/538: creat d23/fbb x:0 0 0 2024-09-17T01:52:03.315 INFO:tasks.workunit.client.1.smithi092.stdout:0/298: dwrite d3/da/d15/f4e [0,4194304] 0 2024-09-17T01:52:03.316 INFO:tasks.workunit.client.0.smithi031.stdout:6/539: truncate d23/db4/d6a/dac/f85 1550478 0 2024-09-17T01:52:03.317 INFO:tasks.workunit.client.1.smithi092.stdout:5/147: truncate d0/de/d19/d1a/d1e/f2a 2786931 0 2024-09-17T01:52:03.318 INFO:tasks.workunit.client.1.smithi092.stdout:0/299: write d3/da/d1c/d47/f51 [115140,36000] 0 2024-09-17T01:52:03.320 INFO:tasks.workunit.client.0.smithi031.stdout:4/573: symlink d8/d9c/lbe 0 2024-09-17T01:52:03.320 INFO:tasks.workunit.client.1.smithi092.stdout:9/228: mkdir d0/d5/d3e 0 2024-09-17T01:52:03.323 INFO:tasks.workunit.client.0.smithi031.stdout:2/448: mkdir d1/d3/df/d18/d9f 0 2024-09-17T01:52:03.324 INFO:tasks.workunit.client.1.smithi092.stdout:6/301: dwrite d3/f3a [0,4194304] 0 2024-09-17T01:52:03.325 INFO:tasks.workunit.client.1.smithi092.stdout:0/300: unlink d3/da/f2a 0 2024-09-17T01:52:03.326 INFO:tasks.workunit.client.1.smithi092.stdout:9/229: mknod d0/d5/d29/c3f 0 2024-09-17T01:52:03.328 INFO:tasks.workunit.client.0.smithi031.stdout:0/403: truncate d0/d29/d33/d5/f3c 463944 0 2024-09-17T01:52:03.328 INFO:tasks.workunit.client.0.smithi031.stdout:3/369: write db/df/d1d/f59 [1123886,8723] 0 2024-09-17T01:52:03.329 INFO:tasks.workunit.client.0.smithi031.stdout:6/540: fdatasync d23/d63/d47/f60 0 2024-09-17T01:52:03.329 INFO:tasks.workunit.client.0.smithi031.stdout:1/436: dread d4/d1a/d2d/d18/f6c [0,4194304] 0 2024-09-17T01:52:03.331 INFO:tasks.workunit.client.1.smithi092.stdout:9/230: chown d0/df/f27 135611 1 2024-09-17T01:52:03.332 INFO:tasks.workunit.client.1.smithi092.stdout:5/148: truncate d0/de/f21 614465 0 2024-09-17T01:52:03.332 INFO:tasks.workunit.client.0.smithi031.stdout:4/574: write d8/f98 [881689,53462] 0 2024-09-17T01:52:03.333 INFO:tasks.workunit.client.1.smithi092.stdout:9/231: read d0/f6 [12759686,114547] 0 2024-09-17T01:52:03.334 INFO:tasks.workunit.client.1.smithi092.stdout:6/302: link d3/f8 d3/d10/d1a/d43/d5e/f5f 0 2024-09-17T01:52:03.335 INFO:tasks.workunit.client.0.smithi031.stdout:0/404: dread d0/d29/d33/d2a/f39 [0,4194304] 0 2024-09-17T01:52:03.336 INFO:tasks.workunit.client.1.smithi092.stdout:0/301: mknod d3/d2e/d3b/d48/c59 0 2024-09-17T01:52:03.337 INFO:tasks.workunit.client.0.smithi031.stdout:8/376: creat d0/df/dd/d59/f6e x:0 0 0 2024-09-17T01:52:03.337 INFO:tasks.workunit.client.0.smithi031.stdout:0/405: readlink d0/d29/d33/d5/d48/l72 0 2024-09-17T01:52:03.339 INFO:tasks.workunit.client.0.smithi031.stdout:3/370: rename db/df/d1c/d6a/f74 to db/df/d1c/d6a/f76 0 2024-09-17T01:52:03.339 INFO:tasks.workunit.client.0.smithi031.stdout:3/371: chown db/df/f44 14 1 2024-09-17T01:52:03.342 INFO:tasks.workunit.client.1.smithi092.stdout:5/149: dwrite d0/de/d19/d1a/d1e/f12 [0,4194304] 0 2024-09-17T01:52:03.342 INFO:tasks.workunit.client.0.smithi031.stdout:3/372: dread db/df/d1d/d37/d6c/f71 [0,4194304] 0 2024-09-17T01:52:03.342 INFO:tasks.workunit.client.1.smithi092.stdout:0/302: dread d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:03.344 INFO:tasks.workunit.client.1.smithi092.stdout:9/232: link d0/d5/f8 d0/d5/d29/f40 0 2024-09-17T01:52:03.344 INFO:tasks.workunit.client.0.smithi031.stdout:4/575: write d8/d3a/d41/fb8 [535748,32654] 0 2024-09-17T01:52:03.345 INFO:tasks.workunit.client.1.smithi092.stdout:9/233: chown d0/df/d17 99166 1 2024-09-17T01:52:03.345 INFO:tasks.workunit.client.0.smithi031.stdout:8/377: dread - d0/d5/f5e zero size 2024-09-17T01:52:03.346 INFO:tasks.workunit.client.0.smithi031.stdout:1/437: fdatasync d4/d1e/f3b 0 2024-09-17T01:52:03.347 INFO:tasks.workunit.client.0.smithi031.stdout:9/341: write d3/d4/d29/f4b [3277052,48468] 0 2024-09-17T01:52:03.348 INFO:tasks.workunit.client.1.smithi092.stdout:0/303: symlink d3/da/d1c/d4a/l5a 0 2024-09-17T01:52:03.348 INFO:tasks.workunit.client.1.smithi092.stdout:6/303: read d3/d10/d1a/f24 [5822316,55331] 0 2024-09-17T01:52:03.350 INFO:tasks.workunit.client.1.smithi092.stdout:6/304: chown d3/d10/d1a/d53 114279 1 2024-09-17T01:52:03.350 INFO:tasks.workunit.client.0.smithi031.stdout:0/406: creat d0/d37/f8f x:0 0 0 2024-09-17T01:52:03.353 INFO:tasks.workunit.client.1.smithi092.stdout:5/150: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:03.353 INFO:tasks.workunit.client.1.smithi092.stdout:6/305: write d3/d10/d1f/f59 [31535,77404] 0 2024-09-17T01:52:03.353 INFO:tasks.workunit.client.0.smithi031.stdout:3/373: readlink db/df/d1d/d37/l38 0 2024-09-17T01:52:03.355 INFO:tasks.workunit.client.1.smithi092.stdout:0/304: creat d3/d2e/d3b/d48/f5b x:0 0 0 2024-09-17T01:52:03.355 INFO:tasks.workunit.client.0.smithi031.stdout:5/352: write da/d4b/f4d [405338,127219] 0 2024-09-17T01:52:03.356 INFO:tasks.workunit.client.0.smithi031.stdout:8/378: creat d0/df/dd/d59/f6f x:0 0 0 2024-09-17T01:52:03.359 INFO:tasks.workunit.client.1.smithi092.stdout:9/234: dwrite d0/d7/d12/d34/d20/f24 [0,4194304] 0 2024-09-17T01:52:03.360 INFO:tasks.workunit.client.0.smithi031.stdout:9/342: write d3/d10/f14 [9090824,5381] 0 2024-09-17T01:52:03.360 INFO:tasks.workunit.client.1.smithi092.stdout:6/306: dread - d3/d10/d1f/d21/d28/d2b/d48/f3e zero size 2024-09-17T01:52:03.360 INFO:tasks.workunit.client.0.smithi031.stdout:7/373: dwrite db/d29/f4e [0,4194304] 0 2024-09-17T01:52:03.361 INFO:tasks.workunit.client.1.smithi092.stdout:9/235: chown d0/d7/d12/d34/l2b 7194128 1 2024-09-17T01:52:03.361 INFO:tasks.workunit.client.1.smithi092.stdout:5/151: rename d0/de/d19 to d0/de/d19/d1a/d1e/d31 22 2024-09-17T01:52:03.362 INFO:tasks.workunit.client.0.smithi031.stdout:1/438: mkdir d4/d1e/d3f/d72/d7e/d92 0 2024-09-17T01:52:03.362 INFO:tasks.workunit.client.0.smithi031.stdout:2/449: write d1/d3/df/d19/f33 [1640604,92355] 0 2024-09-17T01:52:03.364 INFO:tasks.workunit.client.0.smithi031.stdout:0/407: mkdir d0/d29/d33/d2a/d25/d30/d4a/d90 0 2024-09-17T01:52:03.365 INFO:tasks.workunit.client.1.smithi092.stdout:0/305: creat d3/d2e/f5c x:0 0 0 2024-09-17T01:52:03.366 INFO:tasks.workunit.client.0.smithi031.stdout:0/408: fsync d0/d29/d33/d2a/f7f 0 2024-09-17T01:52:03.367 INFO:tasks.workunit.client.1.smithi092.stdout:9/236: write d0/df/f18 [4906836,90092] 0 2024-09-17T01:52:03.369 INFO:tasks.workunit.client.0.smithi031.stdout:8/379: creat d0/f70 x:0 0 0 2024-09-17T01:52:03.370 INFO:tasks.workunit.client.1.smithi092.stdout:9/237: read d0/df/d17/f2f [24112,22425] 0 2024-09-17T01:52:03.372 INFO:tasks.workunit.client.0.smithi031.stdout:6/541: link d23/f31 d23/db4/d6a/d70/d74/fbc 0 2024-09-17T01:52:03.372 INFO:tasks.workunit.client.1.smithi092.stdout:9/238: readlink d0/d7/d12/d34/l2b 0 2024-09-17T01:52:03.372 INFO:tasks.workunit.client.1.smithi092.stdout:5/152: symlink d0/de/l32 0 2024-09-17T01:52:03.374 INFO:tasks.workunit.client.1.smithi092.stdout:9/239: readlink d0/d7/d12/d34/l2b 0 2024-09-17T01:52:03.374 INFO:tasks.workunit.client.1.smithi092.stdout:0/306: dwrite d3/f17 [0,4194304] 0 2024-09-17T01:52:03.375 INFO:tasks.workunit.client.0.smithi031.stdout:2/450: dwrite d1/d3/df/d19/d1e/f3e [0,4194304] 0 2024-09-17T01:52:03.376 INFO:tasks.workunit.client.0.smithi031.stdout:3/374: mkdir db/df/d1d/d37/d77 0 2024-09-17T01:52:03.377 INFO:tasks.workunit.client.0.smithi031.stdout:5/353: symlink da/d4b/d6c/l79 0 2024-09-17T01:52:03.378 INFO:tasks.workunit.client.0.smithi031.stdout:4/576: link d8/d3a/d41/d64/l4b d8/d3a/d41/d64/d4d/dae/lbf 0 2024-09-17T01:52:03.378 INFO:tasks.workunit.client.1.smithi092.stdout:9/240: creat d0/d7/d12/d34/d20/d2e/f41 x:0 0 0 2024-09-17T01:52:03.380 INFO:tasks.workunit.client.0.smithi031.stdout:5/354: dread - da/d42/d12/d4a/f71 zero size 2024-09-17T01:52:03.383 INFO:tasks.workunit.client.0.smithi031.stdout:4/577: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f73 238709116 1 2024-09-17T01:52:03.383 INFO:tasks.workunit.client.0.smithi031.stdout:8/380: rmdir d0/d5/d54/d60 39 2024-09-17T01:52:03.384 INFO:tasks.workunit.client.0.smithi031.stdout:3/375: dread db/df/d1d/f4c [0,4194304] 0 2024-09-17T01:52:03.387 INFO:tasks.workunit.client.0.smithi031.stdout:0/409: symlink d0/d29/d33/d8b/l91 0 2024-09-17T01:52:03.393 INFO:tasks.workunit.client.0.smithi031.stdout:0/410: unlink d0/f34 0 2024-09-17T01:52:03.393 INFO:tasks.workunit.client.1.smithi092.stdout:0/307: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:52:03.393 INFO:tasks.workunit.client.0.smithi031.stdout:0/411: chown d0/f21 275 1 2024-09-17T01:52:03.394 INFO:tasks.workunit.client.1.smithi092.stdout:0/308: chown d3/da/d15/f4e 588187654 1 2024-09-17T01:52:03.395 INFO:tasks.workunit.client.0.smithi031.stdout:0/412: write d0/d29/d33/d2a/d25/d30/f77 [122658,17252] 0 2024-09-17T01:52:03.396 INFO:tasks.workunit.client.0.smithi031.stdout:6/542: creat d23/fbd x:0 0 0 2024-09-17T01:52:03.397 INFO:tasks.workunit.client.1.smithi092.stdout:0/309: fsync d3/da/d15/d30/f41 0 2024-09-17T01:52:03.397 INFO:tasks.workunit.client.0.smithi031.stdout:0/413: readlink d0/d29/d33/d2a/d25/d38/l80 0 2024-09-17T01:52:03.398 INFO:tasks.workunit.client.0.smithi031.stdout:5/355: mknod da/d42/d12/d72/c7a 0 2024-09-17T01:52:03.398 INFO:tasks.workunit.client.0.smithi031.stdout:6/543: chown d23/db4/c66 177659 1 2024-09-17T01:52:03.399 INFO:tasks.workunit.client.0.smithi031.stdout:3/376: symlink db/df/d1d/d37/d65/l78 0 2024-09-17T01:52:03.403 INFO:tasks.workunit.client.0.smithi031.stdout:5/356: symlink da/d4b/l7b 0 2024-09-17T01:52:03.404 INFO:tasks.workunit.client.0.smithi031.stdout:7/374: dread db/f1f [0,4194304] 0 2024-09-17T01:52:03.405 INFO:tasks.workunit.client.0.smithi031.stdout:3/377: dread db/f1f [0,4194304] 0 2024-09-17T01:52:03.406 INFO:tasks.workunit.client.0.smithi031.stdout:6/544: dread d23/f5b [0,4194304] 0 2024-09-17T01:52:03.407 INFO:tasks.workunit.client.0.smithi031.stdout:3/378: chown db/df/d50 1 1 2024-09-17T01:52:03.407 INFO:tasks.workunit.client.0.smithi031.stdout:1/439: write d4/d1e/f4b [1854293,69088] 0 2024-09-17T01:52:03.408 INFO:tasks.workunit.client.0.smithi031.stdout:0/414: mknod d0/d37/d6f/c92 0 2024-09-17T01:52:03.409 INFO:tasks.workunit.client.1.smithi092.stdout:7/292: sync 2024-09-17T01:52:03.409 INFO:tasks.workunit.client.1.smithi092.stdout:3/147: sync 2024-09-17T01:52:03.409 INFO:tasks.workunit.client.1.smithi092.stdout:1/286: sync 2024-09-17T01:52:03.410 INFO:tasks.workunit.client.1.smithi092.stdout:8/261: sync 2024-09-17T01:52:03.410 INFO:tasks.workunit.client.1.smithi092.stdout:1/287: stat db/d1d/d44 0 2024-09-17T01:52:03.410 INFO:tasks.workunit.client.0.smithi031.stdout:7/375: dread - db/d1c/f21 zero size 2024-09-17T01:52:03.411 INFO:tasks.workunit.client.0.smithi031.stdout:0/415: write d0/f21 [5543464,46571] 0 2024-09-17T01:52:03.412 INFO:tasks.workunit.client.1.smithi092.stdout:3/148: creat d4/d20/f32 x:0 0 0 2024-09-17T01:52:03.412 INFO:tasks.workunit.client.0.smithi031.stdout:3/379: read db/df/f39 [1807605,127414] 0 2024-09-17T01:52:03.412 INFO:tasks.workunit.client.0.smithi031.stdout:1/440: truncate d4/d1a/d2d/f61 1604333 0 2024-09-17T01:52:03.414 INFO:tasks.workunit.client.1.smithi092.stdout:7/293: fsync d3/d6/d13/d21/f38 0 2024-09-17T01:52:03.414 INFO:tasks.workunit.client.1.smithi092.stdout:1/288: creat db/d3b/f57 x:0 0 0 2024-09-17T01:52:03.414 INFO:tasks.workunit.client.1.smithi092.stdout:0/310: dwrite d3/da/f22 [0,4194304] 0 2024-09-17T01:52:03.415 INFO:tasks.workunit.client.0.smithi031.stdout:7/376: rmdir db/d1c 39 2024-09-17T01:52:03.415 INFO:tasks.workunit.client.1.smithi092.stdout:0/311: stat d3/da/d15/f19 0 2024-09-17T01:52:03.416 INFO:tasks.workunit.client.1.smithi092.stdout:8/262: mknod d15/d25/d2b/c4d 0 2024-09-17T01:52:03.416 INFO:tasks.workunit.client.0.smithi031.stdout:9/343: dwrite d3/d10/d36/f69 [0,4194304] 0 2024-09-17T01:52:03.417 INFO:tasks.workunit.client.0.smithi031.stdout:0/416: write d0/d29/d33/d2a/d25/f7a [183886,125490] 0 2024-09-17T01:52:03.417 INFO:tasks.workunit.client.1.smithi092.stdout:8/263: write d15/d25/f33 [649804,100775] 0 2024-09-17T01:52:03.418 INFO:tasks.workunit.client.1.smithi092.stdout:1/289: creat db/d1d/d4b/f58 x:0 0 0 2024-09-17T01:52:03.418 INFO:tasks.workunit.client.1.smithi092.stdout:8/264: chown d15/c44 518109 1 2024-09-17T01:52:03.422 INFO:tasks.workunit.client.0.smithi031.stdout:3/380: dwrite db/f46 [0,4194304] 0 2024-09-17T01:52:03.427 INFO:tasks.workunit.client.0.smithi031.stdout:1/441: mknod d4/c93 0 2024-09-17T01:52:03.428 INFO:tasks.workunit.client.0.smithi031.stdout:5/357: write da/dc/f3e [82512,76414] 0 2024-09-17T01:52:03.429 INFO:tasks.workunit.client.0.smithi031.stdout:3/381: write db/df/d1d/d37/f72 [1037539,224] 0 2024-09-17T01:52:03.430 INFO:tasks.workunit.client.0.smithi031.stdout:1/442: write d4/d1e/d5d/f8f [526325,48919] 0 2024-09-17T01:52:03.431 INFO:tasks.workunit.client.0.smithi031.stdout:1/443: fsync d4/f6a 0 2024-09-17T01:52:03.433 INFO:tasks.workunit.client.0.smithi031.stdout:5/358: fdatasync da/d14/f1d 0 2024-09-17T01:52:03.433 INFO:tasks.workunit.client.1.smithi092.stdout:8/265: symlink d15/d32/d40/l4e 0 2024-09-17T01:52:03.433 INFO:tasks.workunit.client.1.smithi092.stdout:0/312: symlink d3/da/d15/l5d 0 2024-09-17T01:52:03.433 INFO:tasks.workunit.client.1.smithi092.stdout:1/290: dread db/f51 [0,4194304] 0 2024-09-17T01:52:03.434 INFO:tasks.workunit.client.1.smithi092.stdout:3/149: getdents d4/d16/d1b/d2b 0 2024-09-17T01:52:03.434 INFO:tasks.workunit.client.0.smithi031.stdout:1/444: write d4/d1a/d2d/f61 [283316,87222] 0 2024-09-17T01:52:03.434 INFO:tasks.workunit.client.1.smithi092.stdout:1/291: write db/d3b/f57 [700575,70351] 0 2024-09-17T01:52:03.437 INFO:tasks.workunit.client.0.smithi031.stdout:5/359: symlink da/d42/d12/d72/l7c 0 2024-09-17T01:52:03.437 INFO:tasks.workunit.client.1.smithi092.stdout:3/150: rename d4/d16/f1e to d4/d20/f33 0 2024-09-17T01:52:03.440 INFO:tasks.workunit.client.0.smithi031.stdout:1/445: creat d4/d1e/d3f/d72/d7e/d92/f94 x:0 0 0 2024-09-17T01:52:03.440 INFO:tasks.workunit.client.1.smithi092.stdout:8/266: rename d15/c1b to d15/d25/d2b/d3d/c4f 0 2024-09-17T01:52:03.443 INFO:tasks.workunit.client.1.smithi092.stdout:1/292: rename db/l18 to db/l59 0 2024-09-17T01:52:03.446 INFO:tasks.workunit.client.0.smithi031.stdout:1/446: dread d4/d1a/f33 [0,4194304] 0 2024-09-17T01:52:03.447 INFO:tasks.workunit.client.1.smithi092.stdout:3/151: link d4/d13/c27 d4/d2f/c34 0 2024-09-17T01:52:03.448 INFO:tasks.workunit.client.1.smithi092.stdout:3/152: chown d4/d20/d31 1 1 2024-09-17T01:52:03.448 INFO:tasks.workunit.client.0.smithi031.stdout:0/417: mknod d0/d29/d33/d2a/d25/d30/d4a/c93 0 2024-09-17T01:52:03.448 INFO:tasks.workunit.client.0.smithi031.stdout:3/382: dread db/fe [0,4194304] 0 2024-09-17T01:52:03.450 INFO:tasks.workunit.client.1.smithi092.stdout:1/293: dwrite db/d3b/f54 [0,4194304] 0 2024-09-17T01:52:03.451 INFO:tasks.workunit.client.0.smithi031.stdout:7/377: dwrite db/d18/f2f [0,4194304] 0 2024-09-17T01:52:03.452 INFO:tasks.workunit.client.1.smithi092.stdout:3/153: getdents d4/d20 0 2024-09-17T01:52:03.453 INFO:tasks.workunit.client.0.smithi031.stdout:7/378: fsync db/d18/f25 0 2024-09-17T01:52:03.453 INFO:tasks.workunit.client.0.smithi031.stdout:1/447: rename d4/d1a/d2d/c14 to d4/d1e/d40/d77/c95 0 2024-09-17T01:52:03.454 INFO:tasks.workunit.client.1.smithi092.stdout:1/294: getdents db/d1d/d23/d34 0 2024-09-17T01:52:03.456 INFO:tasks.workunit.client.1.smithi092.stdout:1/295: read db/fd [2945307,120652] 0 2024-09-17T01:52:03.457 INFO:tasks.workunit.client.1.smithi092.stdout:3/154: symlink d4/d16/l35 0 2024-09-17T01:52:03.457 INFO:tasks.workunit.client.0.smithi031.stdout:7/379: write db/d1c/f1d [1154094,71840] 0 2024-09-17T01:52:03.458 INFO:tasks.workunit.client.0.smithi031.stdout:1/448: chown d4/d1a/d2d/d18/d52/f63 5216 1 2024-09-17T01:52:03.458 INFO:tasks.workunit.client.0.smithi031.stdout:7/380: chown db/d1c/d41/l6f 233 1 2024-09-17T01:52:03.459 INFO:tasks.workunit.client.0.smithi031.stdout:7/381: read - db/d1c/d46/f4f zero size 2024-09-17T01:52:03.462 INFO:tasks.workunit.client.0.smithi031.stdout:1/449: mknod d4/d1e/d3f/d72/c96 0 2024-09-17T01:52:03.463 INFO:tasks.workunit.client.1.smithi092.stdout:3/155: read d4/d16/f1c [298337,126585] 0 2024-09-17T01:52:03.463 INFO:tasks.workunit.client.1.smithi092.stdout:1/296: unlink db/d1d/d23/c2c 0 2024-09-17T01:52:03.464 INFO:tasks.workunit.client.1.smithi092.stdout:1/297: readlink db/l3d 0 2024-09-17T01:52:03.467 INFO:tasks.workunit.client.1.smithi092.stdout:3/156: dread d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:03.469 INFO:tasks.workunit.client.0.smithi031.stdout:0/418: dread d0/f1f [0,4194304] 0 2024-09-17T01:52:03.470 INFO:tasks.workunit.client.0.smithi031.stdout:1/450: dwrite d4/d1e/d3f/f7c [0,4194304] 0 2024-09-17T01:52:03.472 INFO:tasks.workunit.client.0.smithi031.stdout:1/451: creat d4/d1e/d40/d84/f97 x:0 0 0 2024-09-17T01:52:03.474 INFO:tasks.workunit.client.1.smithi092.stdout:3/157: dwrite d4/d16/f1c [4194304,4194304] 0 2024-09-17T01:52:03.475 INFO:tasks.workunit.client.1.smithi092.stdout:1/298: truncate db/fd 4450066 0 2024-09-17T01:52:03.476 INFO:tasks.workunit.client.0.smithi031.stdout:0/419: creat d0/d29/d33/d5b/f94 x:0 0 0 2024-09-17T01:52:03.476 INFO:tasks.workunit.client.0.smithi031.stdout:3/383: truncate db/df/d50/f62 518478 0 2024-09-17T01:52:03.479 INFO:tasks.workunit.client.0.smithi031.stdout:7/382: truncate db/f15 7096124 0 2024-09-17T01:52:03.480 INFO:tasks.workunit.client.1.smithi092.stdout:1/299: write db/f51 [3550214,82120] 0 2024-09-17T01:52:03.482 INFO:tasks.workunit.client.0.smithi031.stdout:3/384: dread db/df/f31 [0,4194304] 0 2024-09-17T01:52:03.483 INFO:tasks.workunit.client.1.smithi092.stdout:1/300: readlink db/d1d/l2d 0 2024-09-17T01:52:03.485 INFO:tasks.workunit.client.1.smithi092.stdout:3/158: dwrite d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:03.489 INFO:tasks.workunit.client.1.smithi092.stdout:3/159: mknod d4/c36 0 2024-09-17T01:52:03.490 INFO:tasks.workunit.client.1.smithi092.stdout:1/301: getdents db/d1d/d44 0 2024-09-17T01:52:03.492 INFO:tasks.workunit.client.1.smithi092.stdout:1/302: creat db/d1d/d23/f5a x:0 0 0 2024-09-17T01:52:03.494 INFO:tasks.workunit.client.1.smithi092.stdout:1/303: creat db/d1d/d23/f5b x:0 0 0 2024-09-17T01:52:03.496 INFO:tasks.workunit.client.1.smithi092.stdout:3/160: dwrite d4/d16/d1b/f29 [0,4194304] 0 2024-09-17T01:52:03.499 INFO:tasks.workunit.client.1.smithi092.stdout:1/304: link db/f51 db/d1d/d23/f5c 0 2024-09-17T01:52:03.499 INFO:tasks.workunit.client.1.smithi092.stdout:1/305: readlink l9 0 2024-09-17T01:52:03.506 INFO:tasks.workunit.client.1.smithi092.stdout:1/306: dwrite db/d1d/f40 [0,4194304] 0 2024-09-17T01:52:03.538 INFO:tasks.workunit.client.1.smithi092.stdout:1/307: dwrite db/d3b/f48 [0,4194304] 0 2024-09-17T01:52:03.539 INFO:tasks.workunit.client.1.smithi092.stdout:3/161: dread d4/d13/f14 [0,4194304] 0 2024-09-17T01:52:03.543 INFO:tasks.workunit.client.1.smithi092.stdout:3/162: rename d4/c1f to d4/d2f/c37 0 2024-09-17T01:52:03.543 INFO:tasks.workunit.client.1.smithi092.stdout:3/163: fdatasync d4/f18 0 2024-09-17T01:52:03.544 INFO:tasks.workunit.client.1.smithi092.stdout:1/308: symlink db/d1d/d2e/l5d 0 2024-09-17T01:52:03.545 INFO:tasks.workunit.client.1.smithi092.stdout:1/309: fsync db/d1d/d23/f3c 0 2024-09-17T01:52:03.549 INFO:tasks.workunit.client.1.smithi092.stdout:1/310: creat db/d1d/d44/f5e x:0 0 0 2024-09-17T01:52:03.552 INFO:tasks.workunit.client.1.smithi092.stdout:1/311: chown db/d1d/d23/f3c 83987750 1 2024-09-17T01:52:03.552 INFO:tasks.workunit.client.1.smithi092.stdout:3/164: dwrite d4/f2d [0,4194304] 0 2024-09-17T01:52:03.553 INFO:tasks.workunit.client.1.smithi092.stdout:1/312: dread db/d1d/d2e/f32 [4194304,4194304] 0 2024-09-17T01:52:03.554 INFO:tasks.workunit.client.1.smithi092.stdout:3/165: mknod d4/d20/c38 0 2024-09-17T01:52:03.554 INFO:tasks.workunit.client.1.smithi092.stdout:3/166: fsync d4/d16/f24 0 2024-09-17T01:52:03.555 INFO:tasks.workunit.client.1.smithi092.stdout:3/167: fsync d4/d16/d1b/f29 0 2024-09-17T01:52:03.556 INFO:tasks.workunit.client.1.smithi092.stdout:3/168: fsync d4/d16/d1b/f29 0 2024-09-17T01:52:03.559 INFO:tasks.workunit.client.1.smithi092.stdout:1/313: creat db/f5f x:0 0 0 2024-09-17T01:52:03.559 INFO:tasks.workunit.client.1.smithi092.stdout:3/169: mkdir d4/d20/d39 0 2024-09-17T01:52:03.562 INFO:tasks.workunit.client.1.smithi092.stdout:1/314: mknod db/d1d/d44/c60 0 2024-09-17T01:52:03.564 INFO:tasks.workunit.client.1.smithi092.stdout:3/170: rename d4/c25 to d4/d20/c3a 0 2024-09-17T01:52:03.566 INFO:tasks.workunit.client.1.smithi092.stdout:1/315: creat db/d1d/d23/d55/f61 x:0 0 0 2024-09-17T01:52:03.570 INFO:tasks.workunit.client.1.smithi092.stdout:1/316: mkdir db/d1d/d2e/d62 0 2024-09-17T01:52:03.571 INFO:tasks.workunit.client.1.smithi092.stdout:1/317: fdatasync db/d1d/d23/f5a 0 2024-09-17T01:52:03.572 INFO:tasks.workunit.client.1.smithi092.stdout:1/318: mknod db/d1d/d23/d55/c63 0 2024-09-17T01:52:03.573 INFO:tasks.workunit.client.1.smithi092.stdout:1/319: chown db/d1d/d4b 6 1 2024-09-17T01:52:03.577 INFO:tasks.workunit.client.1.smithi092.stdout:3/171: truncate d4/d13/f1d 1153162 0 2024-09-17T01:52:03.579 INFO:tasks.workunit.client.1.smithi092.stdout:1/320: dwrite db/d1d/d23/f45 [0,4194304] 0 2024-09-17T01:52:03.580 INFO:tasks.workunit.client.1.smithi092.stdout:3/172: creat d4/d13/d2e/f3b x:0 0 0 2024-09-17T01:52:03.589 INFO:tasks.workunit.client.1.smithi092.stdout:1/321: dwrite db/d1d/d2e/f32 [0,4194304] 0 2024-09-17T01:52:03.594 INFO:tasks.workunit.client.1.smithi092.stdout:1/322: creat db/d1d/f64 x:0 0 0 2024-09-17T01:52:03.597 INFO:tasks.workunit.client.1.smithi092.stdout:1/323: mknod db/d1d/d2e/d62/c65 0 2024-09-17T01:52:03.598 INFO:tasks.workunit.client.1.smithi092.stdout:1/324: chown db/d1d/f40 153996 1 2024-09-17T01:52:03.601 INFO:tasks.workunit.client.1.smithi092.stdout:1/325: creat db/d1d/d2e/d62/f66 x:0 0 0 2024-09-17T01:52:03.601 INFO:tasks.workunit.client.1.smithi092.stdout:3/173: dwrite d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:03.603 INFO:tasks.workunit.client.0.smithi031.stdout:0/420: rename d0/d29/d33/d84/c8d to d0/d29/d33/d2a/d25/c95 0 2024-09-17T01:52:03.604 INFO:tasks.workunit.client.1.smithi092.stdout:1/326: unlink db/d3b/f57 0 2024-09-17T01:52:03.605 INFO:tasks.workunit.client.0.smithi031.stdout:0/421: dread - d0/d29/d33/d5/f85 zero size 2024-09-17T01:52:03.605 INFO:tasks.workunit.client.1.smithi092.stdout:1/327: write db/d1d/f64 [353810,24686] 0 2024-09-17T01:52:03.605 INFO:tasks.workunit.client.1.smithi092.stdout:3/174: mkdir d4/d16/d1b/d2b/d3c 0 2024-09-17T01:52:03.606 INFO:tasks.workunit.client.1.smithi092.stdout:3/175: fsync d4/d16/d1b/f29 0 2024-09-17T01:52:03.606 INFO:tasks.workunit.client.1.smithi092.stdout:1/328: truncate db/d1d/f64 1223694 0 2024-09-17T01:52:03.606 INFO:tasks.workunit.client.0.smithi031.stdout:7/383: rename db/d29/f54 to db/d1c/d41/d69/f70 0 2024-09-17T01:52:03.607 INFO:tasks.workunit.client.1.smithi092.stdout:1/329: write db/d1d/f64 [1240168,86892] 0 2024-09-17T01:52:03.608 INFO:tasks.workunit.client.1.smithi092.stdout:3/176: symlink d4/d13/l3d 0 2024-09-17T01:52:03.609 INFO:tasks.workunit.client.0.smithi031.stdout:0/422: symlink d0/d29/d33/d8b/l96 0 2024-09-17T01:52:03.610 INFO:tasks.workunit.client.0.smithi031.stdout:3/385: getdents db/df/d1d/d37/d3a 0 2024-09-17T01:52:03.611 INFO:tasks.workunit.client.0.smithi031.stdout:7/384: readlink db/l17 0 2024-09-17T01:52:03.611 INFO:tasks.workunit.client.1.smithi092.stdout:1/330: symlink db/d1d/d23/d55/l67 0 2024-09-17T01:52:03.612 INFO:tasks.workunit.client.1.smithi092.stdout:3/177: creat d4/d16/d1b/d2b/d3c/f3e x:0 0 0 2024-09-17T01:52:03.612 INFO:tasks.workunit.client.0.smithi031.stdout:3/386: creat db/f79 x:0 0 0 2024-09-17T01:52:03.614 INFO:tasks.workunit.client.1.smithi092.stdout:3/178: chown d4/d2f/c34 3 1 2024-09-17T01:52:03.614 INFO:tasks.workunit.client.0.smithi031.stdout:3/387: stat db/df/d1d/d37 0 2024-09-17T01:52:03.614 INFO:tasks.workunit.client.0.smithi031.stdout:0/423: creat d0/d29/d33/d84/f97 x:0 0 0 2024-09-17T01:52:03.616 INFO:tasks.workunit.client.1.smithi092.stdout:1/331: link db/d1d/l49 db/l68 0 2024-09-17T01:52:03.617 INFO:tasks.workunit.client.0.smithi031.stdout:0/424: creat d0/d29/d33/d5/f98 x:0 0 0 2024-09-17T01:52:03.619 INFO:tasks.workunit.client.1.smithi092.stdout:1/332: write db/d1d/d23/f3a [1359102,44294] 0 2024-09-17T01:52:03.621 INFO:tasks.workunit.client.1.smithi092.stdout:3/179: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:52:03.621 INFO:tasks.workunit.client.1.smithi092.stdout:1/333: mknod db/d3b/c69 0 2024-09-17T01:52:03.622 INFO:tasks.workunit.client.1.smithi092.stdout:1/334: fdatasync db/d1d/f64 0 2024-09-17T01:52:03.623 INFO:tasks.workunit.client.0.smithi031.stdout:3/388: dwrite db/df/d1d/d37/d4a/f43 [4194304,4194304] 0 2024-09-17T01:52:03.623 INFO:tasks.workunit.client.0.smithi031.stdout:3/389: fsync db/f5f 0 2024-09-17T01:52:03.626 INFO:tasks.workunit.client.1.smithi092.stdout:1/335: unlink db/f51 0 2024-09-17T01:52:03.630 INFO:tasks.workunit.client.1.smithi092.stdout:3/180: dwrite d4/d20/f33 [0,4194304] 0 2024-09-17T01:52:03.634 INFO:tasks.workunit.client.0.smithi031.stdout:0/425: dread d0/d29/d33/d2a/d25/d30/d4a/f54 [0,4194304] 0 2024-09-17T01:52:03.637 INFO:tasks.workunit.client.0.smithi031.stdout:0/426: write d0/d29/d33/d2a/d25/d30/f6b [3359375,116968] 0 2024-09-17T01:52:03.638 INFO:tasks.workunit.client.1.smithi092.stdout:3/181: getdents d4/d13/d2e 0 2024-09-17T01:52:03.639 INFO:tasks.workunit.client.1.smithi092.stdout:3/182: stat d4/d16/d1b/f21 0 2024-09-17T01:52:03.641 INFO:tasks.workunit.client.0.smithi031.stdout:3/390: dread f6 [0,4194304] 0 2024-09-17T01:52:03.641 INFO:tasks.workunit.client.1.smithi092.stdout:3/183: mkdir d4/d20/d3f 0 2024-09-17T01:52:03.643 INFO:tasks.workunit.client.1.smithi092.stdout:3/184: symlink d4/d16/d1b/d2b/l40 0 2024-09-17T01:52:03.644 INFO:tasks.workunit.client.1.smithi092.stdout:2/174: sync 2024-09-17T01:52:03.644 INFO:tasks.workunit.client.1.smithi092.stdout:4/194: sync 2024-09-17T01:52:03.646 INFO:tasks.workunit.client.1.smithi092.stdout:4/195: read d4/f1e [327272,26740] 0 2024-09-17T01:52:03.649 INFO:tasks.workunit.client.1.smithi092.stdout:4/196: mkdir d4/d5/d1d/d30/d3f 0 2024-09-17T01:52:03.650 INFO:tasks.workunit.client.1.smithi092.stdout:3/185: dwrite d4/d16/f1c [4194304,4194304] 0 2024-09-17T01:52:03.652 INFO:tasks.workunit.client.1.smithi092.stdout:4/197: creat d4/d5/f40 x:0 0 0 2024-09-17T01:52:03.654 INFO:tasks.workunit.client.1.smithi092.stdout:4/198: write d4/d5/d8/f36 [2277327,112661] 0 2024-09-17T01:52:03.656 INFO:tasks.workunit.client.1.smithi092.stdout:4/199: dread d4/d13/f2b [0,4194304] 0 2024-09-17T01:52:03.662 INFO:tasks.workunit.client.0.smithi031.stdout:0/427: rmdir d0/d29/d33 39 2024-09-17T01:52:03.663 INFO:tasks.workunit.client.1.smithi092.stdout:4/200: mkdir d4/d5/d1d/d32/d41 0 2024-09-17T01:52:03.663 INFO:tasks.workunit.client.0.smithi031.stdout:3/391: write db/df/f39 [1517360,90224] 0 2024-09-17T01:52:03.665 INFO:tasks.workunit.client.1.smithi092.stdout:4/201: chown d4/d5 338699 1 2024-09-17T01:52:03.667 INFO:tasks.workunit.client.1.smithi092.stdout:4/202: fsync d4/d5/f33 0 2024-09-17T01:52:03.669 INFO:tasks.workunit.client.1.smithi092.stdout:1/336: dwrite db/d1d/f22 [0,4194304] 0 2024-09-17T01:52:03.670 INFO:tasks.workunit.client.1.smithi092.stdout:4/203: fsync d4/d5/d1d/d32/d35/f39 0 2024-09-17T01:52:03.671 INFO:tasks.workunit.client.0.smithi031.stdout:0/428: dwrite d0/d37/f87 [0,4194304] 0 2024-09-17T01:52:03.673 INFO:tasks.workunit.client.0.smithi031.stdout:3/392: dwrite db/f46 [0,4194304] 0 2024-09-17T01:52:03.674 INFO:tasks.workunit.client.0.smithi031.stdout:3/393: readlink db/df/d1d/l25 0 2024-09-17T01:52:03.675 INFO:tasks.workunit.client.1.smithi092.stdout:2/175: dread d10/f12 [0,4194304] 0 2024-09-17T01:52:03.676 INFO:tasks.workunit.client.1.smithi092.stdout:3/186: link d4/d2f/c37 d4/d13/d2e/c41 0 2024-09-17T01:52:03.677 INFO:tasks.workunit.client.1.smithi092.stdout:1/337: symlink db/d3b/l6a 0 2024-09-17T01:52:03.678 INFO:tasks.workunit.client.1.smithi092.stdout:3/187: dread - d4/d20/f26 zero size 2024-09-17T01:52:03.680 INFO:tasks.workunit.client.1.smithi092.stdout:3/188: write d4/f30 [71868,37538] 0 2024-09-17T01:52:03.682 INFO:tasks.workunit.client.1.smithi092.stdout:1/338: truncate db/d1d/d44/f52 866582 0 2024-09-17T01:52:03.685 INFO:tasks.workunit.client.1.smithi092.stdout:4/204: mkdir d4/d13/d3b/d42 0 2024-09-17T01:52:03.686 INFO:tasks.workunit.client.1.smithi092.stdout:2/176: truncate fd 3165286 0 2024-09-17T01:52:03.690 INFO:tasks.workunit.client.1.smithi092.stdout:1/339: creat db/d1d/d44/f6b x:0 0 0 2024-09-17T01:52:03.692 INFO:tasks.workunit.client.1.smithi092.stdout:3/189: dwrite d4/f30 [0,4194304] 0 2024-09-17T01:52:03.692 INFO:tasks.workunit.client.1.smithi092.stdout:4/205: dread d4/d13/f2b [0,4194304] 0 2024-09-17T01:52:03.693 INFO:tasks.workunit.client.1.smithi092.stdout:1/340: chown db/d1d/d2e/l5d 23113889 1 2024-09-17T01:52:03.693 INFO:tasks.workunit.client.1.smithi092.stdout:4/206: stat d4/d5/c7 0 2024-09-17T01:52:03.694 INFO:tasks.workunit.client.1.smithi092.stdout:4/207: chown d4/d5/d1d/d30 5 1 2024-09-17T01:52:03.695 INFO:tasks.workunit.client.1.smithi092.stdout:3/190: creat d4/d20/f42 x:0 0 0 2024-09-17T01:52:03.696 INFO:tasks.workunit.client.1.smithi092.stdout:3/191: write d4/d20/f26 [714898,72441] 0 2024-09-17T01:52:03.697 INFO:tasks.workunit.client.1.smithi092.stdout:1/341: mkdir db/d6c 0 2024-09-17T01:52:03.699 INFO:tasks.workunit.client.1.smithi092.stdout:1/342: dread - db/d1d/d4b/f58 zero size 2024-09-17T01:52:03.699 INFO:tasks.workunit.client.1.smithi092.stdout:3/192: chown d4/d2f/c37 236721 1 2024-09-17T01:52:03.701 INFO:tasks.workunit.client.1.smithi092.stdout:3/193: chown d4/d13/d2e/c41 12004 1 2024-09-17T01:52:03.701 INFO:tasks.workunit.client.1.smithi092.stdout:1/343: stat db/c20 0 2024-09-17T01:52:03.701 INFO:tasks.workunit.client.0.smithi031.stdout:0/429: truncate d0/d29/d33/d2a/f39 769261 0 2024-09-17T01:52:03.702 INFO:tasks.workunit.client.1.smithi092.stdout:4/208: dread d4/d5/f15 [0,4194304] 0 2024-09-17T01:52:03.703 INFO:tasks.workunit.client.0.smithi031.stdout:0/430: fdatasync d0/d29/d44/f4c 0 2024-09-17T01:52:03.704 INFO:tasks.workunit.client.1.smithi092.stdout:3/194: mkdir d4/d13/d2e/d43 0 2024-09-17T01:52:03.706 INFO:tasks.workunit.client.1.smithi092.stdout:3/195: truncate d4/d13/d2e/f3b 588162 0 2024-09-17T01:52:03.706 INFO:tasks.workunit.client.1.smithi092.stdout:3/196: dread - d4/d20/f42 zero size 2024-09-17T01:52:03.707 INFO:tasks.workunit.client.1.smithi092.stdout:3/197: chown d4/d13/d2e/f3b 0 1 2024-09-17T01:52:03.708 INFO:tasks.workunit.client.1.smithi092.stdout:1/344: symlink db/d1d/d23/l6d 0 2024-09-17T01:52:03.710 INFO:tasks.workunit.client.1.smithi092.stdout:3/198: getdents d4/d20/d31 0 2024-09-17T01:52:03.710 INFO:tasks.workunit.client.1.smithi092.stdout:3/199: readlink d4/l5 0 2024-09-17T01:52:03.711 INFO:tasks.workunit.client.1.smithi092.stdout:3/200: fdatasync d4/d16/d1b/d2b/d3c/f3e 0 2024-09-17T01:52:03.718 INFO:tasks.workunit.client.1.smithi092.stdout:3/201: dwrite d4/d20/f33 [4194304,4194304] 0 2024-09-17T01:52:03.719 INFO:tasks.workunit.client.1.smithi092.stdout:2/177: dread d10/d1d/d2d/f34 [0,4194304] 0 2024-09-17T01:52:03.719 INFO:tasks.workunit.client.1.smithi092.stdout:1/345: write db/d1d/d23/d55/f61 [983144,13092] 0 2024-09-17T01:52:03.722 INFO:tasks.workunit.client.1.smithi092.stdout:2/178: chown d10/d15/f2b 1003 1 2024-09-17T01:52:03.723 INFO:tasks.workunit.client.1.smithi092.stdout:3/202: fsync d4/d13/f14 0 2024-09-17T01:52:03.723 INFO:tasks.workunit.client.1.smithi092.stdout:4/209: dwrite d4/d13/f2b [0,4194304] 0 2024-09-17T01:52:03.726 INFO:tasks.workunit.client.1.smithi092.stdout:1/346: creat db/d3b/f6e x:0 0 0 2024-09-17T01:52:03.728 INFO:tasks.workunit.client.1.smithi092.stdout:2/179: creat d10/d1d/d2c/f39 x:0 0 0 2024-09-17T01:52:03.730 INFO:tasks.workunit.client.1.smithi092.stdout:3/203: rename d4/d16/d1b/d2b to d4/d2f/d44 0 2024-09-17T01:52:03.730 INFO:tasks.workunit.client.1.smithi092.stdout:3/204: stat d4/d20/f32 0 2024-09-17T01:52:03.734 INFO:tasks.workunit.client.1.smithi092.stdout:3/205: creat d4/d2f/d44/d3c/f45 x:0 0 0 2024-09-17T01:52:03.734 INFO:tasks.workunit.client.1.smithi092.stdout:3/206: dread - d4/d20/f32 zero size 2024-09-17T01:52:03.735 INFO:tasks.workunit.client.1.smithi092.stdout:4/210: link d4/d5/d1d/f26 d4/d5/d1d/d32/d35/d3e/f43 0 2024-09-17T01:52:03.736 INFO:tasks.workunit.client.1.smithi092.stdout:2/180: mkdir d10/d3a 0 2024-09-17T01:52:03.737 INFO:tasks.workunit.client.1.smithi092.stdout:1/347: creat db/d1d/d23/f6f x:0 0 0 2024-09-17T01:52:03.738 INFO:tasks.workunit.client.1.smithi092.stdout:3/207: symlink d4/d2f/d44/d3c/l46 0 2024-09-17T01:52:03.739 INFO:tasks.workunit.client.1.smithi092.stdout:4/211: fdatasync d4/d5/f15 0 2024-09-17T01:52:03.740 INFO:tasks.workunit.client.1.smithi092.stdout:3/208: write d4/d2f/d44/d3c/f45 [848329,122946] 0 2024-09-17T01:52:03.740 INFO:tasks.workunit.client.1.smithi092.stdout:2/181: rename d10/d1d/l20 to d10/d1d/d2d/l3b 0 2024-09-17T01:52:03.746 INFO:tasks.workunit.client.1.smithi092.stdout:2/182: write d10/d15/f33 [535010,81088] 0 2024-09-17T01:52:03.747 INFO:tasks.workunit.client.1.smithi092.stdout:3/209: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:52:03.748 INFO:tasks.workunit.client.1.smithi092.stdout:4/212: link d4/d13/d20/f27 d4/d13/d20/f44 0 2024-09-17T01:52:03.749 INFO:tasks.workunit.client.1.smithi092.stdout:1/348: link db/l16 db/d6c/l70 0 2024-09-17T01:52:03.749 INFO:tasks.workunit.client.1.smithi092.stdout:4/213: rename d4 to d4/d5/d45 22 2024-09-17T01:52:03.749 INFO:tasks.workunit.client.1.smithi092.stdout:1/349: chown c5 80845 1 2024-09-17T01:52:03.752 INFO:tasks.workunit.client.1.smithi092.stdout:2/183: unlink d10/c17 0 2024-09-17T01:52:03.753 INFO:tasks.workunit.client.1.smithi092.stdout:3/210: creat d4/d16/d1b/f47 x:0 0 0 2024-09-17T01:52:03.756 INFO:tasks.workunit.client.1.smithi092.stdout:4/214: mkdir d4/d5/d46 0 2024-09-17T01:52:03.757 INFO:tasks.workunit.client.1.smithi092.stdout:1/350: symlink db/d1d/d2e/d62/l71 0 2024-09-17T01:52:03.760 INFO:tasks.workunit.client.1.smithi092.stdout:3/211: creat d4/d16/f48 x:0 0 0 2024-09-17T01:52:03.761 INFO:tasks.workunit.client.1.smithi092.stdout:2/184: creat d10/d3a/f3c x:0 0 0 2024-09-17T01:52:03.764 INFO:tasks.workunit.client.1.smithi092.stdout:2/185: write d10/f13 [3055354,23199] 0 2024-09-17T01:52:03.764 INFO:tasks.workunit.client.1.smithi092.stdout:4/215: dwrite d4/d13/d20/f29 [4194304,4194304] 0 2024-09-17T01:52:03.764 INFO:tasks.workunit.client.1.smithi092.stdout:3/212: creat d4/d13/f49 x:0 0 0 2024-09-17T01:52:03.769 INFO:tasks.workunit.client.1.smithi092.stdout:4/216: rmdir d4/d5/d1d/d32 39 2024-09-17T01:52:03.769 INFO:tasks.workunit.client.1.smithi092.stdout:1/351: dwrite db/d1d/d4b/f58 [0,4194304] 0 2024-09-17T01:52:03.772 INFO:tasks.workunit.client.1.smithi092.stdout:2/186: write d10/f12 [5140194,61967] 0 2024-09-17T01:52:03.776 INFO:tasks.workunit.client.1.smithi092.stdout:4/217: creat d4/d13/d3b/f47 x:0 0 0 2024-09-17T01:52:03.778 INFO:tasks.workunit.client.1.smithi092.stdout:3/213: creat d4/d20/d39/f4a x:0 0 0 2024-09-17T01:52:03.782 INFO:tasks.workunit.client.1.smithi092.stdout:4/218: unlink d4/d13/d20/f44 0 2024-09-17T01:52:03.783 INFO:tasks.workunit.client.1.smithi092.stdout:4/219: chown d4/d13/d20 380698 1 2024-09-17T01:52:03.784 INFO:tasks.workunit.client.1.smithi092.stdout:3/214: mkdir d4/d16/d1b/d4b 0 2024-09-17T01:52:03.787 INFO:tasks.workunit.client.1.smithi092.stdout:3/215: creat d4/f4c x:0 0 0 2024-09-17T01:52:03.788 INFO:tasks.workunit.client.1.smithi092.stdout:2/187: dread d10/d1d/d24/f29 [0,4194304] 0 2024-09-17T01:52:03.790 INFO:tasks.workunit.client.1.smithi092.stdout:2/188: creat d10/d1d/d2c/f3d x:0 0 0 2024-09-17T01:52:03.793 INFO:tasks.workunit.client.1.smithi092.stdout:3/216: dread d4/d16/d1b/f29 [0,4194304] 0 2024-09-17T01:52:03.794 INFO:tasks.workunit.client.1.smithi092.stdout:3/217: write d4/f4c [632211,80777] 0 2024-09-17T01:52:03.794 INFO:tasks.workunit.client.1.smithi092.stdout:2/189: rename d10/d1d/d2d/f36 to d10/d15/f3e 0 2024-09-17T01:52:03.796 INFO:tasks.workunit.client.1.smithi092.stdout:3/218: truncate d4/f4c 947129 0 2024-09-17T01:52:03.797 INFO:tasks.workunit.client.1.smithi092.stdout:4/220: truncate d4/d5/d8/f36 1676122 0 2024-09-17T01:52:03.798 INFO:tasks.workunit.client.1.smithi092.stdout:2/190: creat d10/d3a/f3f x:0 0 0 2024-09-17T01:52:03.799 INFO:tasks.workunit.client.1.smithi092.stdout:3/219: mknod d4/d16/d1b/c4d 0 2024-09-17T01:52:03.800 INFO:tasks.workunit.client.1.smithi092.stdout:1/352: dread db/d1d/d23/f3c [4194304,4194304] 0 2024-09-17T01:52:03.800 INFO:tasks.workunit.client.1.smithi092.stdout:3/220: chown d4/d2f/c34 1 1 2024-09-17T01:52:03.801 INFO:tasks.workunit.client.1.smithi092.stdout:3/221: readlink d4/l5 0 2024-09-17T01:52:03.801 INFO:tasks.workunit.client.1.smithi092.stdout:4/221: truncate d4/d5/d1d/d32/d35/f39 1022183 0 2024-09-17T01:52:03.804 INFO:tasks.workunit.client.1.smithi092.stdout:1/353: rmdir db/d1d/d2e/d62 39 2024-09-17T01:52:03.805 INFO:tasks.workunit.client.1.smithi092.stdout:3/222: mknod d4/d2f/c4e 0 2024-09-17T01:52:03.805 INFO:tasks.workunit.client.1.smithi092.stdout:3/223: stat d4/d13/d2e/d43 0 2024-09-17T01:52:03.807 INFO:tasks.workunit.client.1.smithi092.stdout:4/222: rename d4/d13/f1c to d4/d5/d1d/d32/f48 0 2024-09-17T01:52:03.808 INFO:tasks.workunit.client.1.smithi092.stdout:4/223: chown d4/d5/d46 1 1 2024-09-17T01:52:03.813 INFO:tasks.workunit.client.1.smithi092.stdout:2/191: truncate d10/f13 3850148 0 2024-09-17T01:52:03.816 INFO:tasks.workunit.client.1.smithi092.stdout:3/224: rename d4/f4c to d4/d2f/f4f 0 2024-09-17T01:52:03.817 INFO:tasks.workunit.client.1.smithi092.stdout:4/224: rename d4/d5/d1d/d32/d35 to d4/d5/d1d/d32/d35/d49 22 2024-09-17T01:52:03.819 INFO:tasks.workunit.client.1.smithi092.stdout:1/354: creat db/d1d/f72 x:0 0 0 2024-09-17T01:52:03.820 INFO:tasks.workunit.client.1.smithi092.stdout:2/192: symlink d10/l40 0 2024-09-17T01:52:03.821 INFO:tasks.workunit.client.1.smithi092.stdout:3/225: mknod d4/d13/d2e/c50 0 2024-09-17T01:52:03.825 INFO:tasks.workunit.client.1.smithi092.stdout:2/193: write fe [91788,119465] 0 2024-09-17T01:52:03.826 INFO:tasks.workunit.client.0.smithi031.stdout:2/451: sync 2024-09-17T01:52:03.826 INFO:tasks.workunit.client.0.smithi031.stdout:4/578: sync 2024-09-17T01:52:03.827 INFO:tasks.workunit.client.1.smithi092.stdout:2/194: stat d10/d1d/d2d/f34 0 2024-09-17T01:52:03.828 INFO:tasks.workunit.client.0.smithi031.stdout:2/452: dread - d1/d3/d45/d4a/f6d zero size 2024-09-17T01:52:03.828 INFO:tasks.workunit.client.1.smithi092.stdout:3/226: dwrite d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:03.829 INFO:tasks.workunit.client.0.smithi031.stdout:4/579: dread - d8/d3a/d41/d64/d4d/d8f/f97 zero size 2024-09-17T01:52:03.829 INFO:tasks.workunit.client.0.smithi031.stdout:2/453: fdatasync d1/d3/d2d/f46 0 2024-09-17T01:52:03.830 INFO:tasks.workunit.client.1.smithi092.stdout:3/227: truncate d4/d16/f48 568968 0 2024-09-17T01:52:03.832 INFO:tasks.workunit.client.1.smithi092.stdout:1/355: symlink db/d1d/d2e/d62/l73 0 2024-09-17T01:52:03.835 INFO:tasks.workunit.client.1.smithi092.stdout:3/228: symlink d4/d2f/d44/d3c/l51 0 2024-09-17T01:52:03.841 INFO:tasks.workunit.client.1.smithi092.stdout:1/356: mknod db/d1d/c74 0 2024-09-17T01:52:03.846 INFO:tasks.workunit.client.1.smithi092.stdout:4/225: dwrite d4/d13/d20/f27 [0,4194304] 0 2024-09-17T01:52:03.847 INFO:tasks.workunit.client.1.smithi092.stdout:3/229: link d4/d20/c3a d4/d2f/d44/d3c/c52 0 2024-09-17T01:52:03.848 INFO:tasks.workunit.client.1.smithi092.stdout:4/226: chown f2 262507444 1 2024-09-17T01:52:03.849 INFO:tasks.workunit.client.1.smithi092.stdout:1/357: mkdir db/d1d/d23/d55/d75 0 2024-09-17T01:52:03.850 INFO:tasks.workunit.client.1.smithi092.stdout:3/230: truncate d4/d20/d39/f4a 919108 0 2024-09-17T01:52:03.851 INFO:tasks.workunit.client.1.smithi092.stdout:4/227: symlink d4/d13/d20/l4a 0 2024-09-17T01:52:03.851 INFO:tasks.workunit.client.0.smithi031.stdout:2/454: dread d1/d3/f1c [0,4194304] 0 2024-09-17T01:52:03.853 INFO:tasks.workunit.client.0.smithi031.stdout:2/455: truncate d1/d3/d45/f6b 996783 0 2024-09-17T01:52:03.854 INFO:tasks.workunit.client.1.smithi092.stdout:2/195: truncate d10/d1d/d2d/f34 2545589 0 2024-09-17T01:52:03.855 INFO:tasks.workunit.client.0.smithi031.stdout:2/456: write d1/d3/df/d19/d1e/f29 [3969887,26011] 0 2024-09-17T01:52:03.857 INFO:tasks.workunit.client.1.smithi092.stdout:2/196: stat fd 0 2024-09-17T01:52:03.858 INFO:tasks.workunit.client.1.smithi092.stdout:6/307: sync 2024-09-17T01:52:03.859 INFO:tasks.workunit.client.0.smithi031.stdout:2/457: rmdir d1/d3/df/d19/d1e/d4f 39 2024-09-17T01:52:03.859 INFO:tasks.workunit.client.1.smithi092.stdout:4/228: mkdir d4/d5/d1d/d30/d3f/d4b 0 2024-09-17T01:52:03.862 INFO:tasks.workunit.client.1.smithi092.stdout:1/358: dwrite db/d3b/f54 [0,4194304] 0 2024-09-17T01:52:03.864 INFO:tasks.workunit.client.1.smithi092.stdout:3/231: dwrite d4/d20/d39/f4a [0,4194304] 0 2024-09-17T01:52:03.865 INFO:tasks.workunit.client.0.smithi031.stdout:2/458: truncate d1/d3/df/d19/f1d 561063 0 2024-09-17T01:52:03.866 INFO:tasks.workunit.client.0.smithi031.stdout:2/459: stat d1/d3/df/d66 0 2024-09-17T01:52:03.871 INFO:tasks.workunit.client.1.smithi092.stdout:4/229: truncate d4/d5/d8/f34 1821442 0 2024-09-17T01:52:03.871 INFO:tasks.workunit.client.1.smithi092.stdout:4/230: fdatasync d4/d13/f17 0 2024-09-17T01:52:03.872 INFO:tasks.workunit.client.0.smithi031.stdout:2/460: dwrite d1/d3/df/d19/d1e/f29 [0,4194304] 0 2024-09-17T01:52:03.877 INFO:tasks.workunit.client.1.smithi092.stdout:2/197: link d10/d1d/c1e d10/d1d/d2d/c41 0 2024-09-17T01:52:03.880 INFO:tasks.workunit.client.0.smithi031.stdout:2/461: symlink d1/d3/df/d19/d1e/d21/d34/d8a/la0 0 2024-09-17T01:52:03.880 INFO:tasks.workunit.client.1.smithi092.stdout:2/198: readlink d10/d1d/d24/l30 0 2024-09-17T01:52:03.882 INFO:tasks.workunit.client.0.smithi031.stdout:2/462: mkdir d1/d3/df/d11/d30/da1 0 2024-09-17T01:52:03.882 INFO:tasks.workunit.client.1.smithi092.stdout:4/231: link d4/d5/d1d/l23 d4/d13/d20/l4c 0 2024-09-17T01:52:03.889 INFO:tasks.workunit.client.1.smithi092.stdout:2/199: link d10/d1d/d2d/f31 d10/d1d/d2c/f42 0 2024-09-17T01:52:03.890 INFO:tasks.workunit.client.1.smithi092.stdout:4/232: symlink d4/d5/d1d/d30/d3f/d4b/l4d 0 2024-09-17T01:52:03.894 INFO:tasks.workunit.client.1.smithi092.stdout:3/232: truncate d4/f30 2338275 0 2024-09-17T01:52:03.897 INFO:tasks.workunit.client.1.smithi092.stdout:2/200: dwrite d10/d15/f33 [0,4194304] 0 2024-09-17T01:52:03.898 INFO:tasks.workunit.client.1.smithi092.stdout:1/359: dread db/d1d/d23/f3f [0,4194304] 0 2024-09-17T01:52:03.899 INFO:tasks.workunit.client.1.smithi092.stdout:3/233: creat d4/d2f/f53 x:0 0 0 2024-09-17T01:52:03.899 INFO:tasks.workunit.client.0.smithi031.stdout:2/463: write d1/d3/df/d19/d1e/d21/f24 [177624,38401] 0 2024-09-17T01:52:03.902 INFO:tasks.workunit.client.1.smithi092.stdout:2/201: creat d10/d1d/d24/f43 x:0 0 0 2024-09-17T01:52:03.905 INFO:tasks.workunit.client.1.smithi092.stdout:3/234: mkdir d4/d2f/d44/d54 0 2024-09-17T01:52:03.906 INFO:tasks.workunit.client.1.smithi092.stdout:3/235: chown d4/d16/f48 512368125 1 2024-09-17T01:52:03.907 INFO:tasks.workunit.client.0.smithi031.stdout:2/464: dwrite d1/d3/d2d/f38 [0,4194304] 0 2024-09-17T01:52:03.908 INFO:tasks.workunit.client.1.smithi092.stdout:3/236: dread d4/d13/d2e/f3b [0,4194304] 0 2024-09-17T01:52:03.909 INFO:tasks.workunit.client.1.smithi092.stdout:2/202: unlink d10/f12 0 2024-09-17T01:52:03.910 INFO:tasks.workunit.client.1.smithi092.stdout:2/203: dread - d10/d15/f35 zero size 2024-09-17T01:52:03.911 INFO:tasks.workunit.client.0.smithi031.stdout:2/465: truncate d1/d3/fd 677148 0 2024-09-17T01:52:03.911 INFO:tasks.workunit.client.1.smithi092.stdout:2/204: write d10/d15/f35 [238536,83947] 0 2024-09-17T01:52:03.912 INFO:tasks.workunit.client.0.smithi031.stdout:2/466: chown d1/f14 1 1 2024-09-17T01:52:03.912 INFO:tasks.workunit.client.1.smithi092.stdout:4/233: fsync d4/d5/d8/f34 0 2024-09-17T01:52:03.912 INFO:tasks.workunit.client.0.smithi031.stdout:2/467: readlink d1/d3/d2d/l51 0 2024-09-17T01:52:03.915 INFO:tasks.workunit.client.0.smithi031.stdout:2/468: symlink d1/d3/d2d/la2 0 2024-09-17T01:52:03.916 INFO:tasks.workunit.client.1.smithi092.stdout:1/360: rmdir db/d1d/d23/d55/d75 0 2024-09-17T01:52:03.918 INFO:tasks.workunit.client.1.smithi092.stdout:4/234: creat d4/d5/d8/f4e x:0 0 0 2024-09-17T01:52:03.918 INFO:tasks.workunit.client.1.smithi092.stdout:3/237: chown d4/f30 14 1 2024-09-17T01:52:03.920 INFO:tasks.workunit.client.0.smithi031.stdout:2/469: dwrite d1/f87 [4194304,4194304] 0 2024-09-17T01:52:03.921 INFO:tasks.workunit.client.1.smithi092.stdout:2/205: dwrite d10/d15/f35 [0,4194304] 0 2024-09-17T01:52:03.922 INFO:tasks.workunit.client.1.smithi092.stdout:3/238: unlink d4/d13/f49 0 2024-09-17T01:52:03.922 INFO:tasks.workunit.client.0.smithi031.stdout:2/470: dread - d1/d3/df/d19/d1e/d4f/f9a zero size 2024-09-17T01:52:03.923 INFO:tasks.workunit.client.1.smithi092.stdout:1/361: symlink db/d1d/l76 0 2024-09-17T01:52:03.923 INFO:tasks.workunit.client.0.smithi031.stdout:2/471: fdatasync d1/d3/df/d19/d1e/d21/f24 0 2024-09-17T01:52:03.924 INFO:tasks.workunit.client.1.smithi092.stdout:2/206: symlink d10/d1d/l44 0 2024-09-17T01:52:03.925 INFO:tasks.workunit.client.1.smithi092.stdout:4/235: symlink d4/d5/d46/l4f 0 2024-09-17T01:52:03.926 INFO:tasks.workunit.client.0.smithi031.stdout:2/472: mknod d1/d3/df/ca3 0 2024-09-17T01:52:03.927 INFO:tasks.workunit.client.0.smithi031.stdout:2/473: fdatasync d1/d3/df/f5b 0 2024-09-17T01:52:03.927 INFO:tasks.workunit.client.1.smithi092.stdout:3/239: unlink d4/d16/f1c 0 2024-09-17T01:52:03.928 INFO:tasks.workunit.client.1.smithi092.stdout:1/362: rmdir db/d1d/d2e/d62 39 2024-09-17T01:52:03.931 INFO:tasks.workunit.client.0.smithi031.stdout:2/474: mknod d1/d3/df/d18/d40/ca4 0 2024-09-17T01:52:03.933 INFO:tasks.workunit.client.1.smithi092.stdout:3/240: creat d4/d16/d1b/f55 x:0 0 0 2024-09-17T01:52:03.934 INFO:tasks.workunit.client.0.smithi031.stdout:2/475: truncate d1/d3/d45/d4a/f57 691462 0 2024-09-17T01:52:03.935 INFO:tasks.workunit.client.0.smithi031.stdout:2/476: symlink d1/d4c/la5 0 2024-09-17T01:52:03.936 INFO:tasks.workunit.client.1.smithi092.stdout:4/236: rename d4/d5/d8/f36 to d4/d5/d46/f50 0 2024-09-17T01:52:03.937 INFO:tasks.workunit.client.1.smithi092.stdout:4/237: fdatasync d4/d13/d20/f2e 0 2024-09-17T01:52:03.938 INFO:tasks.workunit.client.1.smithi092.stdout:1/363: mknod db/d6c/c77 0 2024-09-17T01:52:03.938 INFO:tasks.workunit.client.0.smithi031.stdout:2/477: mkdir d1/d3/d2d/da6 0 2024-09-17T01:52:03.939 INFO:tasks.workunit.client.1.smithi092.stdout:3/241: dread d4/f18 [0,4194304] 0 2024-09-17T01:52:03.940 INFO:tasks.workunit.client.1.smithi092.stdout:3/242: read d4/d2f/f4f [158688,49136] 0 2024-09-17T01:52:03.940 INFO:tasks.workunit.client.0.smithi031.stdout:2/478: creat d1/d3/fa7 x:0 0 0 2024-09-17T01:52:03.942 INFO:tasks.workunit.client.1.smithi092.stdout:4/238: creat d4/d13/d20/f51 x:0 0 0 2024-09-17T01:52:03.943 INFO:tasks.workunit.client.1.smithi092.stdout:4/239: dread - d4/d5/d1d/f3c zero size 2024-09-17T01:52:03.944 INFO:tasks.workunit.client.1.smithi092.stdout:4/240: readlink d4/d13/d20/l4a 0 2024-09-17T01:52:03.949 INFO:tasks.workunit.client.1.smithi092.stdout:1/364: mknod db/d1d/d23/c78 0 2024-09-17T01:52:03.950 INFO:tasks.workunit.client.1.smithi092.stdout:4/241: symlink d4/l52 0 2024-09-17T01:52:03.959 INFO:tasks.workunit.client.1.smithi092.stdout:3/243: getdents d4/d13/d2e 0 2024-09-17T01:52:03.959 INFO:tasks.workunit.client.1.smithi092.stdout:2/207: write d10/d1d/d2d/f31 [818424,80095] 0 2024-09-17T01:52:03.960 INFO:tasks.workunit.client.0.smithi031.stdout:0/431: sync 2024-09-17T01:52:03.960 INFO:tasks.workunit.client.0.smithi031.stdout:5/360: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.0.smithi031.stdout:3/394: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.0.smithi031.stdout:6/545: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.0.smithi031.stdout:8/381: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.0.smithi031.stdout:9/344: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.0.smithi031.stdout:7/385: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.0.smithi031.stdout:1/452: sync 2024-09-17T01:52:03.961 INFO:tasks.workunit.client.1.smithi092.stdout:3/244: write d4/f28 [1079308,66643] 0 2024-09-17T01:52:03.962 INFO:tasks.workunit.client.1.smithi092.stdout:2/208: dread - d10/d1d/d2c/f39 zero size 2024-09-17T01:52:03.962 INFO:tasks.workunit.client.0.smithi031.stdout:2/479: dread d1/d3/df/d11/f2f [0,4194304] 0 2024-09-17T01:52:03.963 INFO:tasks.workunit.client.0.smithi031.stdout:0/432: creat d0/f99 x:0 0 0 2024-09-17T01:52:03.967 INFO:tasks.workunit.client.0.smithi031.stdout:5/361: chown da/dc/d2e/f59 875855380 1 2024-09-17T01:52:03.967 INFO:tasks.workunit.client.0.smithi031.stdout:0/433: write d0/d29/d33/f75 [883757,112638] 0 2024-09-17T01:52:03.967 INFO:tasks.workunit.client.0.smithi031.stdout:3/395: unlink db/df/d1c/f2b 0 2024-09-17T01:52:03.968 INFO:tasks.workunit.client.1.smithi092.stdout:3/245: symlink d4/d13/l56 0 2024-09-17T01:52:03.969 INFO:tasks.workunit.client.1.smithi092.stdout:3/246: write d4/d20/f32 [277383,8604] 0 2024-09-17T01:52:03.970 INFO:tasks.workunit.client.1.smithi092.stdout:3/247: stat d4/d13/f14 0 2024-09-17T01:52:03.970 INFO:tasks.workunit.client.1.smithi092.stdout:3/248: chown d4/c8 172799319 1 2024-09-17T01:52:03.970 INFO:tasks.workunit.client.0.smithi031.stdout:8/382: fdatasync d0/df/d19/d3d/f3e 0 2024-09-17T01:52:03.973 INFO:tasks.workunit.client.0.smithi031.stdout:2/480: creat d1/d3/df/d11/d30/fa8 x:0 0 0 2024-09-17T01:52:03.976 INFO:tasks.workunit.client.0.smithi031.stdout:0/434: write d0/d29/d33/d84/f97 [662913,6599] 0 2024-09-17T01:52:03.977 INFO:tasks.workunit.client.0.smithi031.stdout:1/453: link d4/d3d/f5a d4/d1e/d40/d84/f98 0 2024-09-17T01:52:03.978 INFO:tasks.workunit.client.1.smithi092.stdout:1/365: truncate db/d3b/f54 3117201 0 2024-09-17T01:52:03.979 INFO:tasks.workunit.client.0.smithi031.stdout:6/546: dwrite d23/d63/d47/f83 [0,4194304] 0 2024-09-17T01:52:03.979 INFO:tasks.workunit.client.1.smithi092.stdout:3/249: dwrite d4/d13/f1d [4194304,4194304] 0 2024-09-17T01:52:03.980 INFO:tasks.workunit.client.0.smithi031.stdout:9/345: dwrite d3/d10/f60 [0,4194304] 0 2024-09-17T01:52:03.982 INFO:tasks.workunit.client.0.smithi031.stdout:9/346: chown d3/d10/l4e 9462730 1 2024-09-17T01:52:03.991 INFO:tasks.workunit.client.1.smithi092.stdout:3/250: dread - d4/d16/d1b/f55 zero size 2024-09-17T01:52:03.991 INFO:tasks.workunit.client.1.smithi092.stdout:1/366: mknod db/d1d/d23/c79 0 2024-09-17T01:52:03.992 INFO:tasks.workunit.client.0.smithi031.stdout:6/547: creat d23/db4/d6a/d91/fbe x:0 0 0 2024-09-17T01:52:03.994 INFO:tasks.workunit.client.0.smithi031.stdout:1/454: dwrite d4/d1e/d3f/f44 [0,4194304] 0 2024-09-17T01:52:03.994 INFO:tasks.workunit.client.1.smithi092.stdout:3/251: mknod d4/d2f/c57 0 2024-09-17T01:52:03.996 INFO:tasks.workunit.client.1.smithi092.stdout:1/367: unlink db/l17 0 2024-09-17T01:52:03.997 INFO:tasks.workunit.client.1.smithi092.stdout:2/209: write d10/d15/f21 [4972140,43545] 0 2024-09-17T01:52:03.999 INFO:tasks.workunit.client.1.smithi092.stdout:3/252: rmdir d4/d13 39 2024-09-17T01:52:04.000 INFO:tasks.workunit.client.1.smithi092.stdout:4/242: write d4/d5/d46/f50 [805597,97597] 0 2024-09-17T01:52:04.003 INFO:tasks.workunit.client.0.smithi031.stdout:5/362: getdents da/d42/d12/d4a 0 2024-09-17T01:52:04.004 INFO:tasks.workunit.client.0.smithi031.stdout:5/363: write da/dc/f3e [892377,87167] 0 2024-09-17T01:52:04.004 INFO:tasks.workunit.client.0.smithi031.stdout:1/455: creat d4/d1e/d3f/d72/d7e/d92/f99 x:0 0 0 2024-09-17T01:52:04.005 INFO:tasks.workunit.client.0.smithi031.stdout:1/456: readlink d4/l7f 0 2024-09-17T01:52:04.006 INFO:tasks.workunit.client.0.smithi031.stdout:1/457: chown d4/d3d/d65/d78 366 1 2024-09-17T01:52:04.007 INFO:tasks.workunit.client.1.smithi092.stdout:3/253: symlink d4/d16/l58 0 2024-09-17T01:52:04.009 INFO:tasks.workunit.client.0.smithi031.stdout:1/458: write d4/d3d/d65/d78/f90 [69518,64574] 0 2024-09-17T01:52:04.011 INFO:tasks.workunit.client.1.smithi092.stdout:2/210: dwrite d10/d15/f16 [0,4194304] 0 2024-09-17T01:52:04.011 INFO:tasks.workunit.client.1.smithi092.stdout:4/243: dread d4/d13/d20/f27 [0,4194304] 0 2024-09-17T01:52:04.012 INFO:tasks.workunit.client.0.smithi031.stdout:4/580: sync 2024-09-17T01:52:04.015 INFO:tasks.workunit.client.1.smithi092.stdout:4/244: write d4/d5/d1d/d32/d35/f39 [126281,2577] 0 2024-09-17T01:52:04.015 INFO:tasks.workunit.client.1.smithi092.stdout:3/254: dread d4/f2d [0,4194304] 0 2024-09-17T01:52:04.016 INFO:tasks.workunit.client.1.smithi092.stdout:2/211: write d10/d1d/d24/f29 [3987098,7331] 0 2024-09-17T01:52:04.018 INFO:tasks.workunit.client.1.smithi092.stdout:3/255: write d4/d20/f32 [994673,118113] 0 2024-09-17T01:52:04.019 INFO:tasks.workunit.client.1.smithi092.stdout:3/256: truncate d4/f2d 4634295 0 2024-09-17T01:52:04.021 INFO:tasks.workunit.client.0.smithi031.stdout:0/435: link d0/d29/d33/d2a/c53 d0/d29/d33/d2a/d25/d38/c9a 0 2024-09-17T01:52:04.022 INFO:tasks.workunit.client.1.smithi092.stdout:2/212: mknod d10/d3a/c45 0 2024-09-17T01:52:04.022 INFO:tasks.workunit.client.0.smithi031.stdout:7/386: dwrite db/d1c/d41/d69/f70 [0,4194304] 0 2024-09-17T01:52:04.024 INFO:tasks.workunit.client.0.smithi031.stdout:1/459: read d4/d1e/f4f [2667430,95031] 0 2024-09-17T01:52:04.024 INFO:tasks.workunit.client.0.smithi031.stdout:7/387: write db/d1c/d46/f4c [29530,3970] 0 2024-09-17T01:52:04.025 INFO:tasks.workunit.client.1.smithi092.stdout:1/368: truncate db/d1d/d4b/f58 1336438 0 2024-09-17T01:52:04.026 INFO:tasks.workunit.client.1.smithi092.stdout:1/369: chown la 10894784 1 2024-09-17T01:52:04.027 INFO:tasks.workunit.client.0.smithi031.stdout:6/548: rmdir d23/d63/d47/d81/da0 0 2024-09-17T01:52:04.027 INFO:tasks.workunit.client.0.smithi031.stdout:2/481: write d1/d3/f25 [590955,108816] 0 2024-09-17T01:52:04.030 INFO:tasks.workunit.client.0.smithi031.stdout:8/383: truncate d0/df/d19/f27 3903772 0 2024-09-17T01:52:04.031 INFO:tasks.workunit.client.1.smithi092.stdout:2/213: dread - d10/d15/f3e zero size 2024-09-17T01:52:04.032 INFO:tasks.workunit.client.1.smithi092.stdout:3/257: symlink d4/d20/d3f/l59 0 2024-09-17T01:52:04.034 INFO:tasks.workunit.client.1.smithi092.stdout:4/245: getdents d4/d5/d8 0 2024-09-17T01:52:04.035 INFO:tasks.workunit.client.1.smithi092.stdout:1/370: mkdir db/d6c/d7a 0 2024-09-17T01:52:04.036 INFO:tasks.workunit.client.0.smithi031.stdout:3/396: write db/df/f1b [3179014,55055] 0 2024-09-17T01:52:04.036 INFO:tasks.workunit.client.1.smithi092.stdout:1/371: dread - db/d1d/d44/f5e zero size 2024-09-17T01:52:04.037 INFO:tasks.workunit.client.1.smithi092.stdout:2/214: mknod d10/d1d/d24/c46 0 2024-09-17T01:52:04.037 INFO:tasks.workunit.client.0.smithi031.stdout:3/397: readlink db/df/d1d/d37/d3a/l40 0 2024-09-17T01:52:04.038 INFO:tasks.workunit.client.1.smithi092.stdout:3/258: creat d4/d20/d3f/f5a x:0 0 0 2024-09-17T01:52:04.038 INFO:tasks.workunit.client.1.smithi092.stdout:4/246: rmdir d4/d5/d1d/d30/d3f/d4b 39 2024-09-17T01:52:04.041 INFO:tasks.workunit.client.0.smithi031.stdout:6/549: creat d23/d63/d47/fbf x:0 0 0 2024-09-17T01:52:04.041 INFO:tasks.workunit.client.1.smithi092.stdout:1/372: creat db/d1d/d23/d55/f7b x:0 0 0 2024-09-17T01:52:04.043 INFO:tasks.workunit.client.1.smithi092.stdout:4/247: symlink d4/d5/d8/l53 0 2024-09-17T01:52:04.044 INFO:tasks.workunit.client.0.smithi031.stdout:1/460: rename d4/d1a/d2d/f61 to d4/d1e/d8d/f9a 0 2024-09-17T01:52:04.044 INFO:tasks.workunit.client.1.smithi092.stdout:4/248: write d4/d5/d1d/f1a [685904,86101] 0 2024-09-17T01:52:04.045 INFO:tasks.workunit.client.1.smithi092.stdout:4/249: write d4/d5/d1d/f1a [1760484,11227] 0 2024-09-17T01:52:04.045 INFO:tasks.workunit.client.0.smithi031.stdout:8/384: symlink d0/l71 0 2024-09-17T01:52:04.046 INFO:tasks.workunit.client.1.smithi092.stdout:2/215: creat d10/d15/f47 x:0 0 0 2024-09-17T01:52:04.050 INFO:tasks.workunit.client.0.smithi031.stdout:3/398: write db/df/d1d/d37/f4d [209154,5663] 0 2024-09-17T01:52:04.050 INFO:tasks.workunit.client.0.smithi031.stdout:6/550: dwrite f20 [0,4194304] 0 2024-09-17T01:52:04.050 INFO:tasks.workunit.client.1.smithi092.stdout:1/373: link c5 db/d1d/d44/c7c 0 2024-09-17T01:52:04.051 INFO:tasks.workunit.client.1.smithi092.stdout:3/259: link d4/d13/c22 d4/d20/d3f/c5b 0 2024-09-17T01:52:04.051 INFO:tasks.workunit.client.1.smithi092.stdout:3/260: fdatasync d4/f28 0 2024-09-17T01:52:04.053 INFO:tasks.workunit.client.0.smithi031.stdout:0/436: mkdir d0/d29/d33/d2a/d25/d30/d4a/d90/d9b 0 2024-09-17T01:52:04.054 INFO:tasks.workunit.client.0.smithi031.stdout:6/551: fsync d23/d63/d47/f60 0 2024-09-17T01:52:04.055 INFO:tasks.workunit.client.1.smithi092.stdout:7/294: sync 2024-09-17T01:52:04.055 INFO:tasks.workunit.client.1.smithi092.stdout:5/153: sync 2024-09-17T01:52:04.055 INFO:tasks.workunit.client.1.smithi092.stdout:9/241: sync 2024-09-17T01:52:04.055 INFO:tasks.workunit.client.1.smithi092.stdout:0/313: sync 2024-09-17T01:52:04.056 INFO:tasks.workunit.client.1.smithi092.stdout:8/267: sync 2024-09-17T01:52:04.056 INFO:tasks.workunit.client.1.smithi092.stdout:1/374: unlink db/c4a 0 2024-09-17T01:52:04.056 INFO:tasks.workunit.client.0.smithi031.stdout:3/399: truncate db/df/d1d/d37/f72 1852825 0 2024-09-17T01:52:04.058 INFO:tasks.workunit.client.0.smithi031.stdout:1/461: creat d4/d1a/d2d/d18/f9b x:0 0 0 2024-09-17T01:52:04.058 INFO:tasks.workunit.client.1.smithi092.stdout:9/242: read d0/df/f18 [1116292,113634] 0 2024-09-17T01:52:04.059 INFO:tasks.workunit.client.1.smithi092.stdout:1/375: write db/d1d/f2a [3522787,37646] 0 2024-09-17T01:52:04.060 INFO:tasks.workunit.client.0.smithi031.stdout:5/364: link da/dc/l4e da/d42/d12/d4a/l7d 0 2024-09-17T01:52:04.061 INFO:tasks.workunit.client.0.smithi031.stdout:8/385: dwrite d0/df/f65 [0,4194304] 0 2024-09-17T01:52:04.061 INFO:tasks.workunit.client.1.smithi092.stdout:9/243: write d0/d7/f36 [829725,72300] 0 2024-09-17T01:52:04.062 INFO:tasks.workunit.client.1.smithi092.stdout:5/154: fsync d0/de/f11 0 2024-09-17T01:52:04.064 INFO:tasks.workunit.client.0.smithi031.stdout:9/347: getdents d3 0 2024-09-17T01:52:04.067 INFO:tasks.workunit.client.1.smithi092.stdout:3/261: dwrite d4/d20/f32 [0,4194304] 0 2024-09-17T01:52:04.069 INFO:tasks.workunit.client.0.smithi031.stdout:2/482: truncate d1/d3/df/f5b 172223 0 2024-09-17T01:52:04.069 INFO:tasks.workunit.client.1.smithi092.stdout:0/314: write d3/da/d1c/d47/f51 [1179780,88237] 0 2024-09-17T01:52:04.070 INFO:tasks.workunit.client.0.smithi031.stdout:0/437: mkdir d0/d29/d33/d2a/d25/d30/d9c 0 2024-09-17T01:52:04.074 INFO:tasks.workunit.client.0.smithi031.stdout:8/386: dwrite d0/d5/f5e [0,4194304] 0 2024-09-17T01:52:04.076 INFO:tasks.workunit.client.0.smithi031.stdout:6/552: creat d23/db4/d6a/d70/db0/fc0 x:0 0 0 2024-09-17T01:52:04.077 INFO:tasks.workunit.client.0.smithi031.stdout:2/483: truncate d1/d3/df/d19/d1e/d4f/f9a 344191 0 2024-09-17T01:52:04.078 INFO:tasks.workunit.client.1.smithi092.stdout:9/244: rename d0/d5/d29/c3f to d0/d7/d12/d34/c42 0 2024-09-17T01:52:04.079 INFO:tasks.workunit.client.0.smithi031.stdout:7/388: dwrite db/f15 [4194304,4194304] 0 2024-09-17T01:52:04.081 INFO:tasks.workunit.client.1.smithi092.stdout:9/245: readlink d0/d5/l2c 0 2024-09-17T01:52:04.081 INFO:tasks.workunit.client.1.smithi092.stdout:5/155: creat d0/de/d19/d1a/f33 x:0 0 0 2024-09-17T01:52:04.081 INFO:tasks.workunit.client.0.smithi031.stdout:3/400: mkdir db/d29/d7a 0 2024-09-17T01:52:04.081 INFO:tasks.workunit.client.0.smithi031.stdout:5/365: symlink da/d42/d12/d4a/l7e 0 2024-09-17T01:52:04.083 INFO:tasks.workunit.client.0.smithi031.stdout:1/462: rename d4/d1e/d3f/f44 to d4/d1e/d91/f9c 0 2024-09-17T01:52:04.083 INFO:tasks.workunit.client.0.smithi031.stdout:7/389: write db/f15 [5478576,125996] 0 2024-09-17T01:52:04.084 INFO:tasks.workunit.client.0.smithi031.stdout:1/463: chown d4/d1e/d40/d77 4621427 1 2024-09-17T01:52:04.085 INFO:tasks.workunit.client.0.smithi031.stdout:9/348: rename d3/d10/d36/f69 to d3/d10/d36/f6e 0 2024-09-17T01:52:04.085 INFO:tasks.workunit.client.1.smithi092.stdout:1/376: dwrite db/d1d/d23/f5a [0,4194304] 0 2024-09-17T01:52:04.086 INFO:tasks.workunit.client.0.smithi031.stdout:3/401: truncate db/df/d1d/d37/f3f 1592021 0 2024-09-17T01:52:04.086 INFO:tasks.workunit.client.0.smithi031.stdout:1/464: dread - d4/d1a/d2d/f5c zero size 2024-09-17T01:52:04.088 INFO:tasks.workunit.client.0.smithi031.stdout:6/553: mkdir d23/db4/d64/dc1 0 2024-09-17T01:52:04.088 INFO:tasks.workunit.client.1.smithi092.stdout:2/216: truncate f5 538801 0 2024-09-17T01:52:04.089 INFO:tasks.workunit.client.0.smithi031.stdout:9/349: read d3/f15 [3972446,16719] 0 2024-09-17T01:52:04.091 INFO:tasks.workunit.client.0.smithi031.stdout:8/387: write d0/d5/f2f [3223487,126025] 0 2024-09-17T01:52:04.093 INFO:tasks.workunit.client.1.smithi092.stdout:1/377: write db/f5f [28552,127672] 0 2024-09-17T01:52:04.097 INFO:tasks.workunit.client.1.smithi092.stdout:1/378: write db/d1d/d23/f3c [1632775,64032] 0 2024-09-17T01:52:04.098 INFO:tasks.workunit.client.0.smithi031.stdout:0/438: rename d0/d29/d44/d82 to d0/d29/d33/d5/d50/d9d 0 2024-09-17T01:52:04.099 INFO:tasks.workunit.client.0.smithi031.stdout:7/390: unlink db/d1c/d41/c56 0 2024-09-17T01:52:04.100 INFO:tasks.workunit.client.1.smithi092.stdout:4/250: dwrite d4/d5/d1d/d32/d35/d3e/f43 [0,4194304] 0 2024-09-17T01:52:04.101 INFO:tasks.workunit.client.1.smithi092.stdout:1/379: readlink db/lf 0 2024-09-17T01:52:04.102 INFO:tasks.workunit.client.0.smithi031.stdout:8/388: dwrite d0/d5/f5e [0,4194304] 0 2024-09-17T01:52:04.103 INFO:tasks.workunit.client.1.smithi092.stdout:9/246: write d0/df/f27 [1135470,10870] 0 2024-09-17T01:52:04.106 INFO:tasks.workunit.client.1.smithi092.stdout:0/315: fdatasync d3/f12 0 2024-09-17T01:52:04.107 INFO:tasks.workunit.client.0.smithi031.stdout:2/484: rename d1/d3/d2d/f3c to d1/d3/df/d19/d1e/d2a/d7f/fa9 0 2024-09-17T01:52:04.107 INFO:tasks.workunit.client.1.smithi092.stdout:2/217: dwrite d10/d1d/d2c/f39 [0,4194304] 0 2024-09-17T01:52:04.107 INFO:tasks.workunit.client.1.smithi092.stdout:9/247: readlink d0/d5/l2c 0 2024-09-17T01:52:04.108 INFO:tasks.workunit.client.0.smithi031.stdout:1/465: symlink d4/d1e/l9d 0 2024-09-17T01:52:04.109 INFO:tasks.workunit.client.1.smithi092.stdout:2/218: write fe [163318,28562] 0 2024-09-17T01:52:04.111 INFO:tasks.workunit.client.1.smithi092.stdout:4/251: fsync d4/f1e 0 2024-09-17T01:52:04.113 INFO:tasks.workunit.client.1.smithi092.stdout:4/252: dread - d4/d13/d3b/f47 zero size 2024-09-17T01:52:04.114 INFO:tasks.workunit.client.0.smithi031.stdout:0/439: dwrite d0/d29/d33/d2a/d25/d30/f6b [4194304,4194304] 0 2024-09-17T01:52:04.116 INFO:tasks.workunit.client.1.smithi092.stdout:2/219: stat d10/d1d/d2c/c37 0 2024-09-17T01:52:04.117 INFO:tasks.workunit.client.0.smithi031.stdout:3/402: rename db/df/d1d/d37/d3a/l68 to db/d29/d7a/l7b 0 2024-09-17T01:52:04.117 INFO:tasks.workunit.client.1.smithi092.stdout:5/156: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:04.118 INFO:tasks.workunit.client.1.smithi092.stdout:0/316: symlink d3/d1d/l5e 0 2024-09-17T01:52:04.119 INFO:tasks.workunit.client.0.smithi031.stdout:1/466: mkdir d4/d1a/d43/d53/d9e 0 2024-09-17T01:52:04.120 INFO:tasks.workunit.client.1.smithi092.stdout:4/253: dread - d4/d13/d20/f51 zero size 2024-09-17T01:52:04.122 INFO:tasks.workunit.client.0.smithi031.stdout:0/440: creat d0/d29/d33/d5b/f9e x:0 0 0 2024-09-17T01:52:04.123 INFO:tasks.workunit.client.1.smithi092.stdout:8/268: dwrite f9 [0,4194304] 0 2024-09-17T01:52:04.124 INFO:tasks.workunit.client.0.smithi031.stdout:3/403: dread db/f1f [0,4194304] 0 2024-09-17T01:52:04.124 INFO:tasks.workunit.client.0.smithi031.stdout:6/554: rename d23/db4/d6a/d70/d74/d92 to d23/d63/d47/dc2 0 2024-09-17T01:52:04.125 INFO:tasks.workunit.client.1.smithi092.stdout:5/157: chown d0/fc 315 1 2024-09-17T01:52:04.125 INFO:tasks.workunit.client.1.smithi092.stdout:2/220: rmdir d10/d15 39 2024-09-17T01:52:04.126 INFO:tasks.workunit.client.1.smithi092.stdout:4/254: write d4/d5/f15 [424296,49496] 0 2024-09-17T01:52:04.127 INFO:tasks.workunit.client.0.smithi031.stdout:9/350: dread d3/d19/f30 [0,4194304] 0 2024-09-17T01:52:04.127 INFO:tasks.workunit.client.0.smithi031.stdout:3/404: chown db/f5f 34833174 1 2024-09-17T01:52:04.128 INFO:tasks.workunit.client.0.smithi031.stdout:2/485: creat d1/d3/df/faa x:0 0 0 2024-09-17T01:52:04.128 INFO:tasks.workunit.client.0.smithi031.stdout:7/391: getdents db/d18 0 2024-09-17T01:52:04.129 INFO:tasks.workunit.client.1.smithi092.stdout:0/317: mkdir d3/da/d1c/d47/d5f 0 2024-09-17T01:52:04.130 INFO:tasks.workunit.client.0.smithi031.stdout:9/351: readlink d3/d4/d41/l54 0 2024-09-17T01:52:04.130 INFO:tasks.workunit.client.0.smithi031.stdout:3/405: chown db/c28 62594 1 2024-09-17T01:52:04.131 INFO:tasks.workunit.client.1.smithi092.stdout:4/255: read d4/d13/d20/f27 [2107850,20180] 0 2024-09-17T01:52:04.131 INFO:tasks.workunit.client.1.smithi092.stdout:5/158: write d0/de/d19/d1a/d1e/ff [3643059,2985] 0 2024-09-17T01:52:04.132 INFO:tasks.workunit.client.0.smithi031.stdout:6/555: mknod d23/db4/d6a/cc3 0 2024-09-17T01:52:04.133 INFO:tasks.workunit.client.1.smithi092.stdout:8/269: creat d15/d32/f50 x:0 0 0 2024-09-17T01:52:04.134 INFO:tasks.workunit.client.1.smithi092.stdout:2/221: fdatasync fe 0 2024-09-17T01:52:04.135 INFO:tasks.workunit.client.0.smithi031.stdout:1/467: rename d4/d1e/d40/d84/f98 to d4/d1e/d91/f9f 0 2024-09-17T01:52:04.137 INFO:tasks.workunit.client.0.smithi031.stdout:1/468: dread - d4/d1e/d3f/d72/d7e/d92/f99 zero size 2024-09-17T01:52:04.138 INFO:tasks.workunit.client.0.smithi031.stdout:0/441: dread d0/d29/d33/d2a/d25/f7a [0,4194304] 0 2024-09-17T01:52:04.142 INFO:tasks.workunit.client.0.smithi031.stdout:2/486: creat d1/d3/df/d19/d1e/d21/d34/fab x:0 0 0 2024-09-17T01:52:04.147 INFO:tasks.workunit.client.0.smithi031.stdout:7/392: creat db/d1c/f71 x:0 0 0 2024-09-17T01:52:04.149 INFO:tasks.workunit.client.0.smithi031.stdout:0/442: creat d0/d29/d33/d5b/f9f x:0 0 0 2024-09-17T01:52:04.152 INFO:tasks.workunit.client.0.smithi031.stdout:9/352: dwrite d3/d10/f63 [0,4194304] 0 2024-09-17T01:52:04.152 INFO:tasks.workunit.client.1.smithi092.stdout:0/318: dwrite d3/d2e/d3b/f56 [0,4194304] 0 2024-09-17T01:52:04.152 INFO:tasks.workunit.client.1.smithi092.stdout:2/222: dread d10/d1d/d2d/f34 [0,4194304] 0 2024-09-17T01:52:04.152 INFO:tasks.workunit.client.1.smithi092.stdout:4/256: dwrite d4/d5/d1d/f3c [0,4194304] 0 2024-09-17T01:52:04.153 INFO:tasks.workunit.client.1.smithi092.stdout:8/270: write d15/d32/d40/d42/f45 [723099,5105] 0 2024-09-17T01:52:04.154 INFO:tasks.workunit.client.1.smithi092.stdout:1/380: dread db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:04.154 INFO:tasks.workunit.client.0.smithi031.stdout:3/406: dwrite db/df/f1e [0,4194304] 0 2024-09-17T01:52:04.155 INFO:tasks.workunit.client.0.smithi031.stdout:6/556: getdents d23/db4/d6a/d70/db0 0 2024-09-17T01:52:04.155 INFO:tasks.workunit.client.0.smithi031.stdout:0/443: readlink d0/d29/l36 0 2024-09-17T01:52:04.157 INFO:tasks.workunit.client.0.smithi031.stdout:7/393: mkdir db/d1c/d41/d72 0 2024-09-17T01:52:04.160 INFO:tasks.workunit.client.0.smithi031.stdout:2/487: dwrite d1/f20 [0,4194304] 0 2024-09-17T01:52:04.161 INFO:tasks.workunit.client.1.smithi092.stdout:1/381: chown db/d1d/d44/c53 1863474 1 2024-09-17T01:52:04.162 INFO:tasks.workunit.client.1.smithi092.stdout:2/223: fdatasync d10/d1d/d2d/f31 0 2024-09-17T01:52:04.164 INFO:tasks.workunit.client.1.smithi092.stdout:5/159: getdents d0/d23 0 2024-09-17T01:52:04.165 INFO:tasks.workunit.client.1.smithi092.stdout:8/271: rmdir d15/d32/d40 39 2024-09-17T01:52:04.167 INFO:tasks.workunit.client.1.smithi092.stdout:3/262: dwrite d4/f30 [0,4194304] 0 2024-09-17T01:52:04.168 INFO:tasks.workunit.client.0.smithi031.stdout:0/444: write d0/d29/d33/d5/fa [1823844,32783] 0 2024-09-17T01:52:04.172 INFO:tasks.workunit.client.0.smithi031.stdout:3/407: dread db/f3e [0,4194304] 0 2024-09-17T01:52:04.173 INFO:tasks.workunit.client.0.smithi031.stdout:7/394: unlink db/d1c/d41/f4d 0 2024-09-17T01:52:04.175 INFO:tasks.workunit.client.0.smithi031.stdout:0/445: write d0/d29/d33/d2a/d25/d30/f77 [819662,116134] 0 2024-09-17T01:52:04.176 INFO:tasks.workunit.client.0.smithi031.stdout:3/408: chown db/df/d1c/d6a 1 1 2024-09-17T01:52:04.178 INFO:tasks.workunit.client.0.smithi031.stdout:6/557: dwrite d23/f3d [0,4194304] 0 2024-09-17T01:52:04.182 INFO:tasks.workunit.client.1.smithi092.stdout:8/272: unlink d15/c44 0 2024-09-17T01:52:04.182 INFO:tasks.workunit.client.1.smithi092.stdout:4/257: dwrite d4/d5/d1d/f3c [0,4194304] 0 2024-09-17T01:52:04.186 INFO:tasks.workunit.client.1.smithi092.stdout:1/382: rename db/d6c/c77 to db/d1d/d23/d55/c7d 0 2024-09-17T01:52:04.189 INFO:tasks.workunit.client.0.smithi031.stdout:7/395: dread db/d1c/f63 [0,4194304] 0 2024-09-17T01:52:04.190 INFO:tasks.workunit.client.0.smithi031.stdout:0/446: unlink d0/d29/d33/d5/d48/l72 0 2024-09-17T01:52:04.190 INFO:tasks.workunit.client.1.smithi092.stdout:9/248: dwrite d0/df/d17/f1c [0,4194304] 0 2024-09-17T01:52:04.190 INFO:tasks.workunit.client.1.smithi092.stdout:2/224: unlink d10/d15/f21 0 2024-09-17T01:52:04.191 INFO:tasks.workunit.client.0.smithi031.stdout:2/488: link d1/d3/df/d19/c69 d1/d3/df/d19/d1e/d2a/cac 0 2024-09-17T01:52:04.191 INFO:tasks.workunit.client.0.smithi031.stdout:6/558: dwrite d23/f35 [0,4194304] 0 2024-09-17T01:52:04.196 INFO:tasks.workunit.client.1.smithi092.stdout:2/225: truncate d10/f1a 4395181 0 2024-09-17T01:52:04.198 INFO:tasks.workunit.client.1.smithi092.stdout:9/249: dread - d0/d7/d21/f37 zero size 2024-09-17T01:52:04.198 INFO:tasks.workunit.client.0.smithi031.stdout:0/447: dread - d0/d29/d33/d2a/d25/d30/f8e zero size 2024-09-17T01:52:04.199 INFO:tasks.workunit.client.0.smithi031.stdout:0/448: chown d0/d29/d33/c49 22989944 1 2024-09-17T01:52:04.201 INFO:tasks.workunit.client.1.smithi092.stdout:3/263: dwrite d4/d20/f33 [0,4194304] 0 2024-09-17T01:52:04.202 INFO:tasks.workunit.client.0.smithi031.stdout:3/409: creat db/df/d1d/f7c x:0 0 0 2024-09-17T01:52:04.203 INFO:tasks.workunit.client.0.smithi031.stdout:9/353: dread d3/d4c/f4f [0,4194304] 0 2024-09-17T01:52:04.204 INFO:tasks.workunit.client.1.smithi092.stdout:1/383: mkdir db/d6c/d7e 0 2024-09-17T01:52:04.205 INFO:tasks.workunit.client.1.smithi092.stdout:4/258: dwrite d4/d13/d20/f51 [0,4194304] 0 2024-09-17T01:52:04.208 INFO:tasks.workunit.client.1.smithi092.stdout:9/250: readlink d0/d7/d12/d34/d20/l25 0 2024-09-17T01:52:04.209 INFO:tasks.workunit.client.0.smithi031.stdout:7/396: dwrite db/f3a [0,4194304] 0 2024-09-17T01:52:04.209 INFO:tasks.workunit.client.1.smithi092.stdout:8/273: write d15/d25/d27/d49/f4a [680896,1981] 0 2024-09-17T01:52:04.210 INFO:tasks.workunit.client.0.smithi031.stdout:0/449: unlink d0/d29/d33/d2a/c24 0 2024-09-17T01:52:04.211 INFO:tasks.workunit.client.0.smithi031.stdout:7/397: readlink db/l35 0 2024-09-17T01:52:04.215 INFO:tasks.workunit.client.1.smithi092.stdout:4/259: write d4/d5/d1d/f26 [4301558,21385] 0 2024-09-17T01:52:04.217 INFO:tasks.workunit.client.0.smithi031.stdout:3/410: write db/df/d1c/d6a/f76 [817532,122912] 0 2024-09-17T01:52:04.218 INFO:tasks.workunit.client.1.smithi092.stdout:0/319: dread d3/da/d15/d30/f3c [0,4194304] 0 2024-09-17T01:52:04.218 INFO:tasks.workunit.client.1.smithi092.stdout:9/251: mknod d0/d7/d12/c43 0 2024-09-17T01:52:04.218 INFO:tasks.workunit.client.0.smithi031.stdout:2/489: mkdir d1/d3/d2d/d91/dad 0 2024-09-17T01:52:04.219 INFO:tasks.workunit.client.0.smithi031.stdout:8/389: write d0/df/dd/f51 [676863,76479] 0 2024-09-17T01:52:04.219 INFO:tasks.workunit.client.0.smithi031.stdout:9/354: read d3/d19/d1f/f23 [6865471,110550] 0 2024-09-17T01:52:04.219 INFO:tasks.workunit.client.0.smithi031.stdout:6/559: dread d23/f42 [0,4194304] 0 2024-09-17T01:52:04.220 INFO:tasks.workunit.client.1.smithi092.stdout:0/320: read d3/da/f10 [1104840,7415] 0 2024-09-17T01:52:04.223 INFO:tasks.workunit.client.0.smithi031.stdout:3/411: fsync db/df/d1d/d37/f4d 0 2024-09-17T01:52:04.224 INFO:tasks.workunit.client.1.smithi092.stdout:4/260: write d4/d13/d20/f27 [2034506,6378] 0 2024-09-17T01:52:04.224 INFO:tasks.workunit.client.1.smithi092.stdout:3/264: dread d4/d20/d39/f4a [0,4194304] 0 2024-09-17T01:52:04.226 INFO:tasks.workunit.client.0.smithi031.stdout:9/355: write d3/f1d [2286992,7288] 0 2024-09-17T01:52:04.226 INFO:tasks.workunit.client.0.smithi031.stdout:3/412: chown db/df 35892127 1 2024-09-17T01:52:04.227 INFO:tasks.workunit.client.0.smithi031.stdout:0/450: dread d0/f1f [0,4194304] 0 2024-09-17T01:52:04.227 INFO:tasks.workunit.client.0.smithi031.stdout:8/390: fdatasync d0/df/d19/d3d/f5f 0 2024-09-17T01:52:04.230 INFO:tasks.workunit.client.0.smithi031.stdout:7/398: dwrite db/d1c/d41/d69/f70 [0,4194304] 0 2024-09-17T01:52:04.233 INFO:tasks.workunit.client.1.smithi092.stdout:0/321: mknod d3/da/d1c/c60 0 2024-09-17T01:52:04.234 INFO:tasks.workunit.client.0.smithi031.stdout:3/413: creat db/f7d x:0 0 0 2024-09-17T01:52:04.234 INFO:tasks.workunit.client.1.smithi092.stdout:2/226: creat d10/d15/f48 x:0 0 0 2024-09-17T01:52:04.234 INFO:tasks.workunit.client.1.smithi092.stdout:8/274: mknod d15/d32/d40/d42/d43/c51 0 2024-09-17T01:52:04.235 INFO:tasks.workunit.client.1.smithi092.stdout:4/261: mknod d4/d5/c54 0 2024-09-17T01:52:04.235 INFO:tasks.workunit.client.0.smithi031.stdout:3/414: dread - db/f5f zero size 2024-09-17T01:52:04.235 INFO:tasks.workunit.client.1.smithi092.stdout:1/384: dread db/d1d/d23/d55/f61 [0,4194304] 0 2024-09-17T01:52:04.236 INFO:tasks.workunit.client.0.smithi031.stdout:0/451: write d0/d29/d33/d2a/d25/d30/d4a/f6e [86978,70953] 0 2024-09-17T01:52:04.238 INFO:tasks.workunit.client.1.smithi092.stdout:3/265: dwrite d4/d20/f33 [0,4194304] 0 2024-09-17T01:52:04.241 INFO:tasks.workunit.client.0.smithi031.stdout:6/560: rename d23/d63/l7b to d23/db4/d6a/d72/lc4 0 2024-09-17T01:52:04.242 INFO:tasks.workunit.client.1.smithi092.stdout:4/262: write d4/d13/f17 [3041617,27256] 0 2024-09-17T01:52:04.242 INFO:tasks.workunit.client.0.smithi031.stdout:9/356: dwrite d3/d10/f38 [0,4194304] 0 2024-09-17T01:52:04.243 INFO:tasks.workunit.client.1.smithi092.stdout:8/275: mknod d15/d32/c52 0 2024-09-17T01:52:04.244 INFO:tasks.workunit.client.1.smithi092.stdout:2/227: truncate d10/d1d/d2d/f31 1530204 0 2024-09-17T01:52:04.247 INFO:tasks.workunit.client.1.smithi092.stdout:3/266: chown d4/d13/d2e 267241876 1 2024-09-17T01:52:04.247 INFO:tasks.workunit.client.1.smithi092.stdout:4/263: mknod d4/d5/d1d/d30/c55 0 2024-09-17T01:52:04.248 INFO:tasks.workunit.client.1.smithi092.stdout:1/385: dwrite db/d1d/f22 [0,4194304] 0 2024-09-17T01:52:04.251 INFO:tasks.workunit.client.1.smithi092.stdout:8/276: rmdir d15/d32/d40/d42 39 2024-09-17T01:52:04.251 INFO:tasks.workunit.client.1.smithi092.stdout:4/264: write d4/d5/f40 [479378,76351] 0 2024-09-17T01:52:04.251 INFO:tasks.workunit.client.0.smithi031.stdout:7/399: dwrite db/f1f [0,4194304] 0 2024-09-17T01:52:04.252 INFO:tasks.workunit.client.0.smithi031.stdout:7/400: fdatasync db/d29/f58 0 2024-09-17T01:52:04.256 INFO:tasks.workunit.client.1.smithi092.stdout:3/267: stat d4/d20/d3f/c5b 0 2024-09-17T01:52:04.259 INFO:tasks.workunit.client.1.smithi092.stdout:6/308: sync 2024-09-17T01:52:04.259 INFO:tasks.workunit.client.1.smithi092.stdout:1/386: creat db/d1d/d4b/f7f x:0 0 0 2024-09-17T01:52:04.259 INFO:tasks.workunit.client.1.smithi092.stdout:4/265: rmdir d4/d5/d46 39 2024-09-17T01:52:04.265 INFO:tasks.workunit.client.0.smithi031.stdout:9/357: symlink d3/d4/d29/l6f 0 2024-09-17T01:52:04.266 INFO:tasks.workunit.client.1.smithi092.stdout:8/277: dwrite f9 [4194304,4194304] 0 2024-09-17T01:52:04.266 INFO:tasks.workunit.client.1.smithi092.stdout:6/309: creat d3/d25/f60 x:0 0 0 2024-09-17T01:52:04.269 INFO:tasks.workunit.client.1.smithi092.stdout:4/266: mknod d4/d13/c56 0 2024-09-17T01:52:04.269 INFO:tasks.workunit.client.1.smithi092.stdout:1/387: mknod db/d1d/d23/d55/c80 0 2024-09-17T01:52:04.275 INFO:tasks.workunit.client.1.smithi092.stdout:6/310: mknod d3/d10/d1f/d21/d1e/d55/c61 0 2024-09-17T01:52:04.275 INFO:tasks.workunit.client.1.smithi092.stdout:1/388: dread db/fd [4194304,4194304] 0 2024-09-17T01:52:04.278 INFO:tasks.workunit.client.1.smithi092.stdout:4/267: rename c0 to d4/d5/d1d/d32/c57 0 2024-09-17T01:52:04.280 INFO:tasks.workunit.client.1.smithi092.stdout:6/311: rmdir d3/d10/d1f/d21/d28/d2b 39 2024-09-17T01:52:04.282 INFO:tasks.workunit.client.1.smithi092.stdout:1/389: rename db/d1d/d23/d55/c80 to db/d3b/c81 0 2024-09-17T01:52:04.284 INFO:tasks.workunit.client.1.smithi092.stdout:1/390: fsync db/d1d/d44/f5e 0 2024-09-17T01:52:04.286 INFO:tasks.workunit.client.1.smithi092.stdout:4/268: dwrite d4/d5/d8/f34 [0,4194304] 0 2024-09-17T01:52:04.291 INFO:tasks.workunit.client.1.smithi092.stdout:1/391: truncate db/d1d/d23/f4c 494630 0 2024-09-17T01:52:04.293 INFO:tasks.workunit.client.1.smithi092.stdout:4/269: dread d4/d5/d1d/d32/d35/f39 [0,4194304] 0 2024-09-17T01:52:04.297 INFO:tasks.workunit.client.0.smithi031.stdout:2/490: write d1/d3/f1c [1828772,4343] 0 2024-09-17T01:52:04.298 INFO:tasks.workunit.client.1.smithi092.stdout:9/252: dwrite d0/d5/d29/f40 [0,4194304] 0 2024-09-17T01:52:04.301 INFO:tasks.workunit.client.1.smithi092.stdout:9/253: dread - d0/d7/d12/d34/d20/d2e/f41 zero size 2024-09-17T01:52:04.303 INFO:tasks.workunit.client.1.smithi092.stdout:4/270: rename d4/d5/c54 to d4/d5/d1d/d32/d35/c58 0 2024-09-17T01:52:04.303 INFO:tasks.workunit.client.0.smithi031.stdout:7/401: write db/d18/f27 [773633,72225] 0 2024-09-17T01:52:04.304 INFO:tasks.workunit.client.0.smithi031.stdout:6/561: truncate d23/db4/d64/d67/f7a 1704627 0 2024-09-17T01:52:04.305 INFO:tasks.workunit.client.1.smithi092.stdout:9/254: symlink d0/d7/d12/d34/d20/l44 0 2024-09-17T01:52:04.307 INFO:tasks.workunit.client.1.smithi092.stdout:0/322: truncate d3/d2e/d3b/d40/f53 216086 0 2024-09-17T01:52:04.308 INFO:tasks.workunit.client.1.smithi092.stdout:0/323: chown d3/d1d/l5e 0 1 2024-09-17T01:52:04.310 INFO:tasks.workunit.client.1.smithi092.stdout:4/271: mknod d4/d13/d3b/c59 0 2024-09-17T01:52:04.310 INFO:tasks.workunit.client.0.smithi031.stdout:7/402: dread - db/d29/f58 zero size 2024-09-17T01:52:04.314 INFO:tasks.workunit.client.1.smithi092.stdout:9/255: rmdir d0/d7/d21 39 2024-09-17T01:52:04.316 INFO:tasks.workunit.client.0.smithi031.stdout:6/562: mknod d23/db4/d64/cc5 0 2024-09-17T01:52:04.316 INFO:tasks.workunit.client.1.smithi092.stdout:8/278: truncate d15/d25/d27/f3e 3174544 0 2024-09-17T01:52:04.320 INFO:tasks.workunit.client.1.smithi092.stdout:4/272: dwrite d4/d5/d1d/f1a [0,4194304] 0 2024-09-17T01:52:04.321 INFO:tasks.workunit.client.0.smithi031.stdout:7/403: unlink db/d1c/l2b 0 2024-09-17T01:52:04.322 INFO:tasks.workunit.client.1.smithi092.stdout:1/392: getdents db/d1d/d23/d55 0 2024-09-17T01:52:04.322 INFO:tasks.workunit.client.0.smithi031.stdout:0/452: dwrite d0/d29/d33/d2a/f39 [0,4194304] 0 2024-09-17T01:52:04.324 INFO:tasks.workunit.client.0.smithi031.stdout:2/491: dwrite d1/d3/df/d19/d1e/d2a/d7f/fa9 [0,4194304] 0 2024-09-17T01:52:04.326 INFO:tasks.workunit.client.1.smithi092.stdout:9/256: rename d0/d7/d12/d34/d26/f31 to d0/d5/f45 0 2024-09-17T01:52:04.327 INFO:tasks.workunit.client.0.smithi031.stdout:3/415: dwrite db/df/d50/f62 [0,4194304] 0 2024-09-17T01:52:04.328 INFO:tasks.workunit.client.0.smithi031.stdout:8/391: dwrite d0/d5/f43 [0,4194304] 0 2024-09-17T01:52:04.332 INFO:tasks.workunit.client.0.smithi031.stdout:7/404: chown db/d29/l38 12464126 1 2024-09-17T01:52:04.332 INFO:tasks.workunit.client.0.smithi031.stdout:6/563: creat d23/db4/d8a/fc6 x:0 0 0 2024-09-17T01:52:04.332 INFO:tasks.workunit.client.0.smithi031.stdout:2/492: chown d1/d3/df/d19/d1e/d4f/l64 50331395 1 2024-09-17T01:52:04.336 INFO:tasks.workunit.client.0.smithi031.stdout:6/564: readlink d23/db4/d6a/d72/l7d 0 2024-09-17T01:52:04.336 INFO:tasks.workunit.client.0.smithi031.stdout:7/405: read db/f15 [7700614,95648] 0 2024-09-17T01:52:04.336 INFO:tasks.workunit.client.0.smithi031.stdout:2/493: read d1/d3/df/d11/f15 [3762482,122143] 0 2024-09-17T01:52:04.338 INFO:tasks.workunit.client.1.smithi092.stdout:4/273: unlink d4/d13/d20/f51 0 2024-09-17T01:52:04.338 INFO:tasks.workunit.client.1.smithi092.stdout:0/324: creat d3/da/d15/f61 x:0 0 0 2024-09-17T01:52:04.341 INFO:tasks.workunit.client.0.smithi031.stdout:8/392: dwrite d0/df/f65 [0,4194304] 0 2024-09-17T01:52:04.343 INFO:tasks.workunit.client.0.smithi031.stdout:3/416: creat db/df/d1d/d37/d6c/d6e/f7e x:0 0 0 2024-09-17T01:52:04.344 INFO:tasks.workunit.client.0.smithi031.stdout:3/417: chown db/d29/d7a 5760 1 2024-09-17T01:52:04.348 INFO:tasks.workunit.client.1.smithi092.stdout:8/279: symlink d15/d32/d40/d42/l53 0 2024-09-17T01:52:04.349 INFO:tasks.workunit.client.0.smithi031.stdout:7/406: mknod db/d18/d67/c73 0 2024-09-17T01:52:04.350 INFO:tasks.workunit.client.1.smithi092.stdout:0/325: mknod d3/d2e/c62 0 2024-09-17T01:52:04.350 INFO:tasks.workunit.client.1.smithi092.stdout:4/274: symlink d4/d5/d1d/d32/d35/l5a 0 2024-09-17T01:52:04.351 INFO:tasks.workunit.client.0.smithi031.stdout:3/418: creat db/df/d50/f7f x:0 0 0 2024-09-17T01:52:04.351 INFO:tasks.workunit.client.1.smithi092.stdout:1/393: mkdir db/d6c/d7e/d82 0 2024-09-17T01:52:04.351 INFO:tasks.workunit.client.1.smithi092.stdout:4/275: truncate f2 4437670 0 2024-09-17T01:52:04.352 INFO:tasks.workunit.client.0.smithi031.stdout:3/419: write db/df/f1b [5159529,37699] 0 2024-09-17T01:52:04.354 INFO:tasks.workunit.client.1.smithi092.stdout:0/326: mkdir d3/d2e/d55/d63 0 2024-09-17T01:52:04.355 INFO:tasks.workunit.client.0.smithi031.stdout:8/393: creat d0/d5/d6c/d6d/f72 x:0 0 0 2024-09-17T01:52:04.355 INFO:tasks.workunit.client.1.smithi092.stdout:0/327: stat d3/d2e/f5c 0 2024-09-17T01:52:04.356 INFO:tasks.workunit.client.0.smithi031.stdout:7/407: dread - db/d1c/f40 zero size 2024-09-17T01:52:04.356 INFO:tasks.workunit.client.1.smithi092.stdout:4/276: creat d4/d5/d1d/d30/f5b x:0 0 0 2024-09-17T01:52:04.358 INFO:tasks.workunit.client.1.smithi092.stdout:0/328: truncate d3/d2e/f5c 148649 0 2024-09-17T01:52:04.358 INFO:tasks.workunit.client.0.smithi031.stdout:2/494: creat d1/d3/df/d19/d1e/d21/fae x:0 0 0 2024-09-17T01:52:04.358 INFO:tasks.workunit.client.1.smithi092.stdout:0/329: chown d3/c31 7 1 2024-09-17T01:52:04.360 INFO:tasks.workunit.client.1.smithi092.stdout:0/330: readlink d3/da/d1c/d3a/l4c 0 2024-09-17T01:52:04.360 INFO:tasks.workunit.client.1.smithi092.stdout:1/394: rename db/d3b/f6e to db/f83 0 2024-09-17T01:52:04.360 INFO:tasks.workunit.client.0.smithi031.stdout:6/565: link d23/db4/d6a/d70/db0/fb2 d23/d63/fc7 0 2024-09-17T01:52:04.361 INFO:tasks.workunit.client.0.smithi031.stdout:2/495: dread - d1/d3/fa7 zero size 2024-09-17T01:52:04.361 INFO:tasks.workunit.client.1.smithi092.stdout:1/395: write db/d1d/f22 [3365020,25714] 0 2024-09-17T01:52:04.362 INFO:tasks.workunit.client.1.smithi092.stdout:4/277: unlink d4/d13/d20/l4a 0 2024-09-17T01:52:04.362 INFO:tasks.workunit.client.1.smithi092.stdout:9/257: dread d0/df/f27 [0,4194304] 0 2024-09-17T01:52:04.363 INFO:tasks.workunit.client.0.smithi031.stdout:3/420: dwrite db/df/d1d/f7c [0,4194304] 0 2024-09-17T01:52:04.365 INFO:tasks.workunit.client.1.smithi092.stdout:4/278: fdatasync d4/d5/d1d/d32/d35/d3e/f43 0 2024-09-17T01:52:04.367 INFO:tasks.workunit.client.1.smithi092.stdout:9/258: symlink d0/d7/d12/d34/d26/l46 0 2024-09-17T01:52:04.368 INFO:tasks.workunit.client.0.smithi031.stdout:6/566: truncate d23/db4/d64/f78 39987 0 2024-09-17T01:52:04.368 INFO:tasks.workunit.client.0.smithi031.stdout:7/408: rename db/d1c/l34 to db/d1c/d41/d69/l74 0 2024-09-17T01:52:04.370 INFO:tasks.workunit.client.0.smithi031.stdout:8/394: dwrite d0/df/d19/d3d/f41 [0,4194304] 0 2024-09-17T01:52:04.370 INFO:tasks.workunit.client.1.smithi092.stdout:0/331: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:52:04.372 INFO:tasks.workunit.client.1.smithi092.stdout:4/279: mknod d4/d5/d46/c5c 0 2024-09-17T01:52:04.373 INFO:tasks.workunit.client.0.smithi031.stdout:6/567: write d23/d63/fb8 [269647,119614] 0 2024-09-17T01:52:04.374 INFO:tasks.workunit.client.0.smithi031.stdout:2/496: creat d1/d3/faf x:0 0 0 2024-09-17T01:52:04.375 INFO:tasks.workunit.client.0.smithi031.stdout:2/497: dread - d1/f8f zero size 2024-09-17T01:52:04.375 INFO:tasks.workunit.client.0.smithi031.stdout:7/409: creat db/d29/f75 x:0 0 0 2024-09-17T01:52:04.376 INFO:tasks.workunit.client.0.smithi031.stdout:8/395: rmdir d0/d5/d54 39 2024-09-17T01:52:04.376 INFO:tasks.workunit.client.0.smithi031.stdout:6/568: rmdir d23 39 2024-09-17T01:52:04.376 INFO:tasks.workunit.client.1.smithi092.stdout:4/280: symlink d4/d5/d1d/d30/l5d 0 2024-09-17T01:52:04.381 INFO:tasks.workunit.client.0.smithi031.stdout:7/410: mknod db/d1c/d41/d69/c76 0 2024-09-17T01:52:04.385 INFO:tasks.workunit.client.1.smithi092.stdout:4/281: dwrite d4/d13/d20/f29 [4194304,4194304] 0 2024-09-17T01:52:04.386 INFO:tasks.workunit.client.0.smithi031.stdout:2/498: rename d1/d3/df/d19/d1e/d21/f24 to d1/d3/d2d/fb0 0 2024-09-17T01:52:04.387 INFO:tasks.workunit.client.1.smithi092.stdout:9/259: dread d0/d5/f2a [0,4194304] 0 2024-09-17T01:52:04.389 INFO:tasks.workunit.client.1.smithi092.stdout:4/282: rmdir d4 39 2024-09-17T01:52:04.392 INFO:tasks.workunit.client.1.smithi092.stdout:9/260: fsync d0/df/d17/f2f 0 2024-09-17T01:52:04.393 INFO:tasks.workunit.client.0.smithi031.stdout:2/499: mkdir d1/d3/df/d11/d30/db1 0 2024-09-17T01:52:04.397 INFO:tasks.workunit.client.0.smithi031.stdout:0/453: dwrite d0/f5c [0,4194304] 0 2024-09-17T01:52:04.397 INFO:tasks.workunit.client.0.smithi031.stdout:7/411: rename db/d1c/l64 to db/d1c/d41/d72/l77 0 2024-09-17T01:52:04.397 INFO:tasks.workunit.client.1.smithi092.stdout:9/261: write d0/df/f27 [2575435,25766] 0 2024-09-17T01:52:04.400 INFO:tasks.workunit.client.1.smithi092.stdout:9/262: write d0/df/f3c [1333988,106181] 0 2024-09-17T01:52:04.401 INFO:tasks.workunit.client.0.smithi031.stdout:6/569: getdents d23/db4/d6a/d70/d74 0 2024-09-17T01:52:04.406 INFO:tasks.workunit.client.1.smithi092.stdout:4/283: dwrite d4/d5/d1d/d30/f5b [0,4194304] 0 2024-09-17T01:52:04.406 INFO:tasks.workunit.client.1.smithi092.stdout:9/263: fsync d0/d7/d12/d34/f2d 0 2024-09-17T01:52:04.407 INFO:tasks.workunit.client.0.smithi031.stdout:6/570: chown d23/db4/d6a/c9e 4394 1 2024-09-17T01:52:04.407 INFO:tasks.workunit.client.0.smithi031.stdout:6/571: stat d23/d63/d47/d81 0 2024-09-17T01:52:04.407 INFO:tasks.workunit.client.0.smithi031.stdout:2/500: dwrite d1/d3/d2d/f38 [4194304,4194304] 0 2024-09-17T01:52:04.410 INFO:tasks.workunit.client.0.smithi031.stdout:3/421: write db/df/d50/f75 [317213,92822] 0 2024-09-17T01:52:04.410 INFO:tasks.workunit.client.0.smithi031.stdout:7/412: mknod db/d1c/d41/c78 0 2024-09-17T01:52:04.412 INFO:tasks.workunit.client.0.smithi031.stdout:0/454: unlink d0/d29/d44/f4c 0 2024-09-17T01:52:04.414 INFO:tasks.workunit.client.1.smithi092.stdout:4/284: rename d4/d13/l18 to d4/d13/d3b/l5e 0 2024-09-17T01:52:04.414 INFO:tasks.workunit.client.0.smithi031.stdout:6/572: mknod d23/db4/d6a/d72/cc8 0 2024-09-17T01:52:04.415 INFO:tasks.workunit.client.1.smithi092.stdout:4/285: truncate d4/d5/f15 1450856 0 2024-09-17T01:52:04.416 INFO:tasks.workunit.client.1.smithi092.stdout:9/264: creat d0/df/f47 x:0 0 0 2024-09-17T01:52:04.419 INFO:tasks.workunit.client.0.smithi031.stdout:8/396: dread d0/f42 [0,4194304] 0 2024-09-17T01:52:04.421 INFO:tasks.workunit.client.1.smithi092.stdout:9/265: symlink d0/d7/d12/d34/d26/l48 0 2024-09-17T01:52:04.422 INFO:tasks.workunit.client.1.smithi092.stdout:4/286: mknod d4/d5/d1d/d32/d41/c5f 0 2024-09-17T01:52:04.423 INFO:tasks.workunit.client.0.smithi031.stdout:3/422: creat db/df/d1d/d37/d77/f80 x:0 0 0 2024-09-17T01:52:04.424 INFO:tasks.workunit.client.1.smithi092.stdout:1/396: dwrite db/d1d/d23/f25 [0,4194304] 0 2024-09-17T01:52:04.425 INFO:tasks.workunit.client.0.smithi031.stdout:7/413: mkdir db/d18/d79 0 2024-09-17T01:52:04.427 INFO:tasks.workunit.client.0.smithi031.stdout:8/397: symlink d0/df/dd/l73 0 2024-09-17T01:52:04.428 INFO:tasks.workunit.client.1.smithi092.stdout:9/266: mknod d0/d7/d12/d34/c49 0 2024-09-17T01:52:04.428 INFO:tasks.workunit.client.1.smithi092.stdout:0/332: dwrite d3/d2e/d3b/d40/f50 [0,4194304] 0 2024-09-17T01:52:04.429 INFO:tasks.workunit.client.0.smithi031.stdout:3/423: dread db/d29/f2e [0,4194304] 0 2024-09-17T01:52:04.431 INFO:tasks.workunit.client.1.smithi092.stdout:4/287: rename d4/d5/d1d/f26 to d4/d5/d1d/d32/f60 0 2024-09-17T01:52:04.433 INFO:tasks.workunit.client.1.smithi092.stdout:1/397: unlink db/d1d/d2e/d62/f66 0 2024-09-17T01:52:04.434 INFO:tasks.workunit.client.0.smithi031.stdout:2/501: rename d1/d3/df/d19 to d1/d3/d2d/db2 0 2024-09-17T01:52:04.435 INFO:tasks.workunit.client.1.smithi092.stdout:0/333: symlink d3/da/d1c/d4a/l64 0 2024-09-17T01:52:04.435 INFO:tasks.workunit.client.1.smithi092.stdout:1/398: read db/f5f [17151,86598] 0 2024-09-17T01:52:04.436 INFO:tasks.workunit.client.0.smithi031.stdout:7/414: rmdir db/d1c/d46 39 2024-09-17T01:52:04.437 INFO:tasks.workunit.client.1.smithi092.stdout:9/267: rename d0/d5/l2c to d0/d7/d12/l4a 0 2024-09-17T01:52:04.438 INFO:tasks.workunit.client.1.smithi092.stdout:4/288: symlink d4/d13/d3b/l61 0 2024-09-17T01:52:04.438 INFO:tasks.workunit.client.1.smithi092.stdout:4/289: chown d4/d13/d20/f29 0 1 2024-09-17T01:52:04.439 INFO:tasks.workunit.client.1.smithi092.stdout:0/334: mknod d3/d2e/d3b/d40/c65 0 2024-09-17T01:52:04.440 INFO:tasks.workunit.client.1.smithi092.stdout:4/290: write d4/d5/d46/f50 [1793558,102320] 0 2024-09-17T01:52:04.440 INFO:tasks.workunit.client.1.smithi092.stdout:4/291: chown d4/d5/f2d 0 1 2024-09-17T01:52:04.441 INFO:tasks.workunit.client.0.smithi031.stdout:6/573: link d23/db4/la1 d23/d63/lc9 0 2024-09-17T01:52:04.441 INFO:tasks.workunit.client.0.smithi031.stdout:2/502: creat d1/d3/d2d/db2/d1e/d4f/d92/fb3 x:0 0 0 2024-09-17T01:52:04.441 INFO:tasks.workunit.client.1.smithi092.stdout:9/268: dread - d0/d7/d21/f37 zero size 2024-09-17T01:52:04.446 INFO:tasks.workunit.client.1.smithi092.stdout:1/399: truncate db/d1d/f64 438918 0 2024-09-17T01:52:04.448 INFO:tasks.workunit.client.0.smithi031.stdout:3/424: getdents db/d29/d7a 0 2024-09-17T01:52:04.448 INFO:tasks.workunit.client.1.smithi092.stdout:1/400: chown db/d1d/d23/c78 116 1 2024-09-17T01:52:04.449 INFO:tasks.workunit.client.1.smithi092.stdout:4/292: creat d4/f62 x:0 0 0 2024-09-17T01:52:04.451 INFO:tasks.workunit.client.1.smithi092.stdout:1/401: truncate db/d1d/d44/f6b 63329 0 2024-09-17T01:52:04.451 INFO:tasks.workunit.client.1.smithi092.stdout:0/335: dread d3/da/d1c/d47/f51 [0,4194304] 0 2024-09-17T01:52:04.452 INFO:tasks.workunit.client.0.smithi031.stdout:3/425: read - db/d29/f4e zero size 2024-09-17T01:52:04.452 INFO:tasks.workunit.client.0.smithi031.stdout:2/503: dwrite d1/f5 [0,4194304] 0 2024-09-17T01:52:04.452 INFO:tasks.workunit.client.1.smithi092.stdout:9/269: dwrite d0/df/f18 [0,4194304] 0 2024-09-17T01:52:04.454 INFO:tasks.workunit.client.0.smithi031.stdout:3/426: write db/df/d1d/d37/d77/f80 [918559,115229] 0 2024-09-17T01:52:04.455 INFO:tasks.workunit.client.0.smithi031.stdout:6/574: dwrite d23/db4/d8a/faa [0,4194304] 0 2024-09-17T01:52:04.458 INFO:tasks.workunit.client.1.smithi092.stdout:9/270: rename d0/d7/d12/d34/d20/l25 to d0/d5/l4b 0 2024-09-17T01:52:04.459 INFO:tasks.workunit.client.0.smithi031.stdout:3/427: write db/df/d1d/d37/d3a/f58 [204962,73406] 0 2024-09-17T01:52:04.461 INFO:tasks.workunit.client.0.smithi031.stdout:2/504: rmdir d1/d3/df/d18 39 2024-09-17T01:52:04.462 INFO:tasks.workunit.client.0.smithi031.stdout:6/575: creat d23/d63/d47/d81/fca x:0 0 0 2024-09-17T01:52:04.463 INFO:tasks.workunit.client.1.smithi092.stdout:0/336: dwrite d3/da/d1c/d47/f51 [0,4194304] 0 2024-09-17T01:52:04.465 INFO:tasks.workunit.client.1.smithi092.stdout:0/337: write d3/f17 [4898808,43703] 0 2024-09-17T01:52:04.466 INFO:tasks.workunit.client.1.smithi092.stdout:9/271: creat d0/f4c x:0 0 0 2024-09-17T01:52:04.466 INFO:tasks.workunit.client.0.smithi031.stdout:6/576: symlink d23/db4/d6a/dac/lcb 0 2024-09-17T01:52:04.467 INFO:tasks.workunit.client.0.smithi031.stdout:3/428: dread db/f3e [4194304,4194304] 0 2024-09-17T01:52:04.468 INFO:tasks.workunit.client.0.smithi031.stdout:6/577: fdatasync d23/fbb 0 2024-09-17T01:52:04.468 INFO:tasks.workunit.client.1.smithi092.stdout:0/338: stat d3/da/d15/f4e 0 2024-09-17T01:52:04.470 INFO:tasks.workunit.client.1.smithi092.stdout:0/339: write d3/da/d15/f61 [129914,76143] 0 2024-09-17T01:52:04.470 INFO:tasks.workunit.client.0.smithi031.stdout:2/505: mknod d1/d3/df/d66/cb4 0 2024-09-17T01:52:04.471 INFO:tasks.workunit.client.1.smithi092.stdout:0/340: write d3/d2e/f5c [1147555,21826] 0 2024-09-17T01:52:04.471 INFO:tasks.workunit.client.1.smithi092.stdout:0/341: chown d3/d2e/d3b/d48/f5b 37563165 1 2024-09-17T01:52:04.472 INFO:tasks.workunit.client.1.smithi092.stdout:0/342: write d3/f7 [1455051,91426] 0 2024-09-17T01:52:04.477 INFO:tasks.workunit.client.1.smithi092.stdout:0/343: creat d3/da/d1c/d3a/f66 x:0 0 0 2024-09-17T01:52:04.478 INFO:tasks.workunit.client.0.smithi031.stdout:3/429: dwrite db/df/d1d/d37/f3f [0,4194304] 0 2024-09-17T01:52:04.478 INFO:tasks.workunit.client.1.smithi092.stdout:1/402: rmdir db/d1d/d2e/d62 39 2024-09-17T01:52:04.479 INFO:tasks.workunit.client.1.smithi092.stdout:1/403: dread - db/d1d/f72 zero size 2024-09-17T01:52:04.480 INFO:tasks.workunit.client.1.smithi092.stdout:1/404: fsync db/d1d/d23/f3c 0 2024-09-17T01:52:04.481 INFO:tasks.workunit.client.0.smithi031.stdout:3/430: creat db/f81 x:0 0 0 2024-09-17T01:52:04.483 INFO:tasks.workunit.client.0.smithi031.stdout:3/431: unlink db/d29/c64 0 2024-09-17T01:52:04.488 INFO:tasks.workunit.client.1.smithi092.stdout:0/344: getdents d3/da/d15 0 2024-09-17T01:52:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:04 smithi092 ceph-mon[33552]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 143 MiB/s wr, 303 op/s 2024-09-17T01:52:04.492 INFO:tasks.workunit.client.1.smithi092.stdout:1/405: dwrite db/d1d/d44/f4e [0,4194304] 0 2024-09-17T01:52:04.492 INFO:tasks.workunit.client.0.smithi031.stdout:2/506: write d1/f20 [2990489,26599] 0 2024-09-17T01:52:04.495 INFO:tasks.workunit.client.1.smithi092.stdout:1/406: dread - db/d1d/d44/f5e zero size 2024-09-17T01:52:04.495 INFO:tasks.workunit.client.1.smithi092.stdout:1/407: fsync db/d1d/d23/d55/f7b 0 2024-09-17T01:52:04.497 INFO:tasks.workunit.client.0.smithi031.stdout:2/507: mkdir d1/d3/df/d18/d40/db5 0 2024-09-17T01:52:04.497 INFO:tasks.workunit.client.1.smithi092.stdout:0/345: creat d3/d2e/d55/f67 x:0 0 0 2024-09-17T01:52:04.501 INFO:tasks.workunit.client.1.smithi092.stdout:9/272: truncate d0/d7/f23 3129118 0 2024-09-17T01:52:04.502 INFO:tasks.workunit.client.1.smithi092.stdout:1/408: fdatasync db/f5f 0 2024-09-17T01:52:04.503 INFO:tasks.workunit.client.1.smithi092.stdout:0/346: symlink d3/da/d15/d30/l68 0 2024-09-17T01:52:04.510 INFO:tasks.workunit.client.1.smithi092.stdout:9/273: fdatasync d0/d7/f23 0 2024-09-17T01:52:04.513 INFO:tasks.workunit.client.1.smithi092.stdout:0/347: symlink d3/l69 0 2024-09-17T01:52:04.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:04 smithi031 ceph-mon[27673]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 143 MiB/s wr, 303 op/s 2024-09-17T01:52:04.514 INFO:tasks.workunit.client.1.smithi092.stdout:9/274: write d0/d5/f2a [79642,128074] 0 2024-09-17T01:52:04.514 INFO:tasks.workunit.client.1.smithi092.stdout:4/293: truncate d4/d13/f17 3060512 0 2024-09-17T01:52:04.517 INFO:tasks.workunit.client.1.smithi092.stdout:0/348: rename d3/d2e/d3b/d40/f50 to d3/d2e/d55/f6a 0 2024-09-17T01:52:04.519 INFO:tasks.workunit.client.1.smithi092.stdout:1/409: truncate db/d1d/f22 1242494 0 2024-09-17T01:52:04.522 INFO:tasks.workunit.client.1.smithi092.stdout:0/349: mkdir d3/d1d/d6b 0 2024-09-17T01:52:04.523 INFO:tasks.workunit.client.1.smithi092.stdout:0/350: fdatasync d3/f4 0 2024-09-17T01:52:04.525 INFO:tasks.workunit.client.1.smithi092.stdout:1/410: creat db/d6c/d7e/f84 x:0 0 0 2024-09-17T01:52:04.526 INFO:tasks.workunit.client.1.smithi092.stdout:4/294: dwrite d4/d5/d46/f50 [0,4194304] 0 2024-09-17T01:52:04.528 INFO:tasks.workunit.client.1.smithi092.stdout:0/351: rmdir d3/da/d15 39 2024-09-17T01:52:04.533 INFO:tasks.workunit.client.1.smithi092.stdout:1/411: write db/d1d/d23/f3f [5074949,111981] 0 2024-09-17T01:52:04.533 INFO:tasks.workunit.client.1.smithi092.stdout:4/295: mknod d4/d5/d1d/d30/c63 0 2024-09-17T01:52:04.535 INFO:tasks.workunit.client.1.smithi092.stdout:4/296: chown d4/d13/d3b/l61 8982960 1 2024-09-17T01:52:04.535 INFO:tasks.workunit.client.1.smithi092.stdout:9/275: getdents d0 0 2024-09-17T01:52:04.536 INFO:tasks.workunit.client.1.smithi092.stdout:0/352: dread d3/d2e/d3b/f56 [0,4194304] 0 2024-09-17T01:52:04.538 INFO:tasks.workunit.client.1.smithi092.stdout:4/297: write d4/d5/d8/f34 [3334168,127851] 0 2024-09-17T01:52:04.543 INFO:tasks.workunit.client.0.smithi031.stdout:4/581: sync 2024-09-17T01:52:04.544 INFO:tasks.workunit.client.1.smithi092.stdout:1/412: mkdir db/d1d/d23/d85 0 2024-09-17T01:52:04.545 INFO:tasks.workunit.client.0.smithi031.stdout:4/582: stat d8/d3a/d41/d64/d4d/d8f/f95 0 2024-09-17T01:52:04.546 INFO:tasks.workunit.client.1.smithi092.stdout:9/276: rename d0/c1b to d0/d5/d3e/c4d 0 2024-09-17T01:52:04.546 INFO:tasks.workunit.client.0.smithi031.stdout:4/583: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/f66 [602961,47555] 0 2024-09-17T01:52:04.547 INFO:tasks.workunit.client.1.smithi092.stdout:4/298: creat d4/d5/d1d/d30/f64 x:0 0 0 2024-09-17T01:52:04.547 INFO:tasks.workunit.client.0.smithi031.stdout:4/584: write d8/d3a/fa9 [57470,11501] 0 2024-09-17T01:52:04.550 INFO:tasks.workunit.client.1.smithi092.stdout:1/413: truncate db/f5f 1039813 0 2024-09-17T01:52:04.553 INFO:tasks.workunit.client.0.smithi031.stdout:4/585: link d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/faa d8/d3a/d41/d64/d4f/fc0 0 2024-09-17T01:52:04.553 INFO:tasks.workunit.client.1.smithi092.stdout:4/299: dread d4/d5/d1d/d30/f5b [0,4194304] 0 2024-09-17T01:52:04.555 INFO:tasks.workunit.client.0.smithi031.stdout:4/586: creat d8/d3a/d41/d64/d4d/d8f/fc1 x:0 0 0 2024-09-17T01:52:04.557 INFO:tasks.workunit.client.1.smithi092.stdout:4/300: creat d4/d5/d46/f65 x:0 0 0 2024-09-17T01:52:04.559 INFO:tasks.workunit.client.1.smithi092.stdout:0/353: dread d3/da/d1c/f49 [0,4194304] 0 2024-09-17T01:52:04.559 INFO:tasks.workunit.client.0.smithi031.stdout:4/587: getdents d8/d3a/d41 0 2024-09-17T01:52:04.560 INFO:tasks.workunit.client.1.smithi092.stdout:1/414: dwrite db/d1d/d23/f5a [0,4194304] 0 2024-09-17T01:52:04.562 INFO:tasks.workunit.client.0.smithi031.stdout:4/588: dread d8/d3a/d41/d64/d4d/d5a/f6e [0,4194304] 0 2024-09-17T01:52:04.565 INFO:tasks.workunit.client.0.smithi031.stdout:4/589: mknod d8/cc2 0 2024-09-17T01:52:04.568 INFO:tasks.workunit.client.1.smithi092.stdout:0/354: rename d3/da/d15/f61 to d3/d1d/d6b/f6c 0 2024-09-17T01:52:04.572 INFO:tasks.workunit.client.0.smithi031.stdout:4/590: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fc3 x:0 0 0 2024-09-17T01:52:04.573 INFO:tasks.workunit.client.1.smithi092.stdout:9/277: dwrite d0/f32 [0,4194304] 0 2024-09-17T01:52:04.574 INFO:tasks.workunit.client.1.smithi092.stdout:4/301: dread d4/d13/f17 [0,4194304] 0 2024-09-17T01:52:04.575 INFO:tasks.workunit.client.1.smithi092.stdout:1/415: link db/d1d/d23/f45 db/d1d/d2e/d62/f86 0 2024-09-17T01:52:04.575 INFO:tasks.workunit.client.0.smithi031.stdout:4/591: rename d8/d3a/d41/d64/d92/fa0 to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fc4 0 2024-09-17T01:52:04.576 INFO:tasks.workunit.client.1.smithi092.stdout:1/416: fsync db/d1d/d23/f25 0 2024-09-17T01:52:04.577 INFO:tasks.workunit.client.1.smithi092.stdout:0/355: creat d3/d2e/d55/d63/f6d x:0 0 0 2024-09-17T01:52:04.577 INFO:tasks.workunit.client.1.smithi092.stdout:1/417: read db/d1d/d23/f3f [2209490,17238] 0 2024-09-17T01:52:04.578 INFO:tasks.workunit.client.0.smithi031.stdout:4/592: fdatasync d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f73 0 2024-09-17T01:52:04.579 INFO:tasks.workunit.client.1.smithi092.stdout:0/356: chown d3/da/d1c/d47/d5f 1487 1 2024-09-17T01:52:04.580 INFO:tasks.workunit.client.1.smithi092.stdout:0/357: read d3/f7 [861707,72978] 0 2024-09-17T01:52:04.582 INFO:tasks.workunit.client.0.smithi031.stdout:4/593: getdents d8/d3a/d7e 0 2024-09-17T01:52:04.582 INFO:tasks.workunit.client.1.smithi092.stdout:0/358: chown d3/da/d1c/f49 2 1 2024-09-17T01:52:04.583 INFO:tasks.workunit.client.0.smithi031.stdout:4/594: write d8/d3a/d41/d64/d4d/f71 [882773,52575] 0 2024-09-17T01:52:04.584 INFO:tasks.workunit.client.1.smithi092.stdout:4/302: dread d4/d13/d20/f29 [4194304,4194304] 0 2024-09-17T01:52:04.585 INFO:tasks.workunit.client.0.smithi031.stdout:4/595: chown d8/d3a/c74 1419704907 1 2024-09-17T01:52:04.587 INFO:tasks.workunit.client.0.smithi031.stdout:4/596: write d8/d3a/d41/fb8 [408198,116906] 0 2024-09-17T01:52:04.587 INFO:tasks.workunit.client.1.smithi092.stdout:9/278: link d0/f32 d0/d7/d12/d34/d20/f4e 0 2024-09-17T01:52:04.590 INFO:tasks.workunit.client.1.smithi092.stdout:1/418: dwrite db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:04.590 INFO:tasks.workunit.client.1.smithi092.stdout:0/359: creat d3/da/d1c/d4a/f6e x:0 0 0 2024-09-17T01:52:04.592 INFO:tasks.workunit.client.1.smithi092.stdout:4/303: mknod d4/d5/d46/c66 0 2024-09-17T01:52:04.593 INFO:tasks.workunit.client.1.smithi092.stdout:4/304: write d4/d5/d46/f50 [3770164,44728] 0 2024-09-17T01:52:04.595 INFO:tasks.workunit.client.1.smithi092.stdout:9/279: write d0/df/f47 [263610,31249] 0 2024-09-17T01:52:04.596 INFO:tasks.workunit.client.1.smithi092.stdout:1/419: chown db/d1d/l49 1696088 1 2024-09-17T01:52:04.597 INFO:tasks.workunit.client.1.smithi092.stdout:1/420: chown db/d1d/d23/c79 0 1 2024-09-17T01:52:04.598 INFO:tasks.workunit.client.1.smithi092.stdout:0/360: rename d3/da/d1c/l25 to d3/d1d/d6b/l6f 0 2024-09-17T01:52:04.600 INFO:tasks.workunit.client.1.smithi092.stdout:4/305: mkdir d4/d5/d1d/d32/d41/d67 0 2024-09-17T01:52:04.600 INFO:tasks.workunit.client.1.smithi092.stdout:0/361: write d3/d2e/d55/d63/f6d [113963,40701] 0 2024-09-17T01:52:04.602 INFO:tasks.workunit.client.1.smithi092.stdout:4/306: chown d4/d5/c7 6 1 2024-09-17T01:52:04.604 INFO:tasks.workunit.client.0.smithi031.stdout:4/597: dread d8/d3a/d41/f60 [0,4194304] 0 2024-09-17T01:52:04.605 INFO:tasks.workunit.client.1.smithi092.stdout:4/307: creat d4/d5/d8/f68 x:0 0 0 2024-09-17T01:52:04.607 INFO:tasks.workunit.client.1.smithi092.stdout:1/421: rename db/d1d/d23/f3f to db/f87 0 2024-09-17T01:52:04.608 INFO:tasks.workunit.client.0.smithi031.stdout:4/598: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/lc5 0 2024-09-17T01:52:04.609 INFO:tasks.workunit.client.1.smithi092.stdout:1/422: write db/d1d/d23/f6f [295314,104864] 0 2024-09-17T01:52:04.610 INFO:tasks.workunit.client.1.smithi092.stdout:4/308: creat d4/d5/d1d/d32/d41/d67/f69 x:0 0 0 2024-09-17T01:52:04.611 INFO:tasks.workunit.client.1.smithi092.stdout:0/362: dwrite d3/da/d1c/f45 [0,4194304] 0 2024-09-17T01:52:04.612 INFO:tasks.workunit.client.0.smithi031.stdout:4/599: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/faa to d8/fc6 0 2024-09-17T01:52:04.612 INFO:tasks.workunit.client.1.smithi092.stdout:9/280: rename d0/d7/d21/f37 to d0/d7/d12/d34/d20/f4f 0 2024-09-17T01:52:04.612 INFO:tasks.workunit.client.1.smithi092.stdout:1/423: chown db/fd 4 1 2024-09-17T01:52:04.617 INFO:tasks.workunit.client.1.smithi092.stdout:1/424: read db/d1d/d23/d55/f61 [193951,21195] 0 2024-09-17T01:52:04.617 INFO:tasks.workunit.client.1.smithi092.stdout:9/281: creat d0/d7/d21/f50 x:0 0 0 2024-09-17T01:52:04.618 INFO:tasks.workunit.client.0.smithi031.stdout:4/600: dwrite d8/d3a/d41/f77 [0,4194304] 0 2024-09-17T01:52:04.619 INFO:tasks.workunit.client.1.smithi092.stdout:4/309: rename d4/d5/f2d to d4/d5/f6a 0 2024-09-17T01:52:04.620 INFO:tasks.workunit.client.0.smithi031.stdout:5/366: sync 2024-09-17T01:52:04.624 INFO:tasks.workunit.client.0.smithi031.stdout:5/367: symlink da/dc/d25/l7f 0 2024-09-17T01:52:04.624 INFO:tasks.workunit.client.1.smithi092.stdout:0/363: dwrite d3/d2e/d55/f67 [0,4194304] 0 2024-09-17T01:52:04.624 INFO:tasks.workunit.client.1.smithi092.stdout:1/425: mkdir db/d1d/d23/d88 0 2024-09-17T01:52:04.625 INFO:tasks.workunit.client.0.smithi031.stdout:4/601: fsync d8/d9c/fbc 0 2024-09-17T01:52:04.625 INFO:tasks.workunit.client.1.smithi092.stdout:4/310: mknod d4/d5/d1d/d30/d3f/c6b 0 2024-09-17T01:52:04.626 INFO:tasks.workunit.client.1.smithi092.stdout:1/426: readlink db/d1d/l2d 0 2024-09-17T01:52:04.626 INFO:tasks.workunit.client.1.smithi092.stdout:0/364: dread - d3/d2e/d3b/d48/f5b zero size 2024-09-17T01:52:04.628 INFO:tasks.workunit.client.0.smithi031.stdout:5/368: mknod da/d14/c80 0 2024-09-17T01:52:04.628 INFO:tasks.workunit.client.1.smithi092.stdout:4/311: mknod d4/d13/d3b/c6c 0 2024-09-17T01:52:04.628 INFO:tasks.workunit.client.1.smithi092.stdout:0/365: dread d3/d2e/d55/d63/f6d [0,4194304] 0 2024-09-17T01:52:04.630 INFO:tasks.workunit.client.0.smithi031.stdout:4/602: creat d8/d3a/d41/d64/d86/fc7 x:0 0 0 2024-09-17T01:52:04.635 INFO:tasks.workunit.client.0.smithi031.stdout:4/603: read d8/d3a/d41/d64/f2f [52222,36291] 0 2024-09-17T01:52:04.636 INFO:tasks.workunit.client.1.smithi092.stdout:4/312: link d4/d5/d1d/d30/f5b d4/d13/d3b/f6d 0 2024-09-17T01:52:04.637 INFO:tasks.workunit.client.0.smithi031.stdout:5/369: dread da/f6f [0,4194304] 0 2024-09-17T01:52:04.640 INFO:tasks.workunit.client.0.smithi031.stdout:4/604: getdents d8/d3a/d41/d64/d4d/d75 0 2024-09-17T01:52:04.640 INFO:tasks.workunit.client.1.smithi092.stdout:4/313: getdents d4/d5/d8 0 2024-09-17T01:52:04.641 INFO:tasks.workunit.client.0.smithi031.stdout:4/605: chown d8/d3a/d41/d64/f6c 116 1 2024-09-17T01:52:04.642 INFO:tasks.workunit.client.1.smithi092.stdout:4/314: symlink d4/d5/d1d/d32/d41/d67/l6e 0 2024-09-17T01:52:04.642 INFO:tasks.workunit.client.0.smithi031.stdout:4/606: symlink d8/d3a/d41/d55/lc8 0 2024-09-17T01:52:04.646 INFO:tasks.workunit.client.0.smithi031.stdout:4/607: creat d8/d3a/d41/d64/fc9 x:0 0 0 2024-09-17T01:52:04.649 INFO:tasks.workunit.client.1.smithi092.stdout:1/427: getdents db/d1d/d23 0 2024-09-17T01:52:04.650 INFO:tasks.workunit.client.0.smithi031.stdout:4/608: getdents d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91 0 2024-09-17T01:52:04.656 INFO:tasks.workunit.client.1.smithi092.stdout:1/428: dwrite db/d1d/d23/f5a [0,4194304] 0 2024-09-17T01:52:04.656 INFO:tasks.workunit.client.0.smithi031.stdout:4/609: dwrite d8/d3a/d41/d64/fc9 [0,4194304] 0 2024-09-17T01:52:04.657 INFO:tasks.workunit.client.1.smithi092.stdout:4/315: dwrite d4/d13/f17 [0,4194304] 0 2024-09-17T01:52:04.658 INFO:tasks.workunit.client.1.smithi092.stdout:4/316: read d4/d5/d1d/d32/f60 [2391877,72407] 0 2024-09-17T01:52:04.661 INFO:tasks.workunit.client.1.smithi092.stdout:1/429: creat db/d1d/d23/f89 x:0 0 0 2024-09-17T01:52:04.662 INFO:tasks.workunit.client.1.smithi092.stdout:4/317: symlink d4/d5/d46/l6f 0 2024-09-17T01:52:04.663 INFO:tasks.workunit.client.1.smithi092.stdout:1/430: creat db/d1d/d44/f8a x:0 0 0 2024-09-17T01:52:04.666 INFO:tasks.workunit.client.1.smithi092.stdout:7/295: sync 2024-09-17T01:52:04.667 INFO:tasks.workunit.client.1.smithi092.stdout:5/160: sync 2024-09-17T01:52:04.669 INFO:tasks.workunit.client.1.smithi092.stdout:7/296: truncate d3/db/d26/f43 263183 0 2024-09-17T01:52:04.669 INFO:tasks.workunit.client.1.smithi092.stdout:4/318: creat d4/d5/f70 x:0 0 0 2024-09-17T01:52:04.671 INFO:tasks.workunit.client.1.smithi092.stdout:7/297: truncate d3/d6/d13/d21/f38 376696 0 2024-09-17T01:52:04.672 INFO:tasks.workunit.client.1.smithi092.stdout:1/431: getdents db/d6c 0 2024-09-17T01:52:04.673 INFO:tasks.workunit.client.1.smithi092.stdout:5/161: write d0/de/d19/d1a/d1e/f12 [4266089,48318] 0 2024-09-17T01:52:04.675 INFO:tasks.workunit.client.1.smithi092.stdout:1/432: mkdir db/d6c/d8b 0 2024-09-17T01:52:04.677 INFO:tasks.workunit.client.1.smithi092.stdout:5/162: creat d0/de/d19/d1a/f34 x:0 0 0 2024-09-17T01:52:04.678 INFO:tasks.workunit.client.1.smithi092.stdout:5/163: fsync d0/de/d19/d1a/d1e/f18 0 2024-09-17T01:52:04.678 INFO:tasks.workunit.client.1.smithi092.stdout:7/298: mkdir d3/d6/d13/d40/d6a 0 2024-09-17T01:52:04.680 INFO:tasks.workunit.client.1.smithi092.stdout:5/164: truncate d0/de/d19/d1a/f33 457118 0 2024-09-17T01:52:04.681 INFO:tasks.workunit.client.1.smithi092.stdout:1/433: write db/d1d/d23/d55/f61 [1394095,67105] 0 2024-09-17T01:52:04.685 INFO:tasks.workunit.client.1.smithi092.stdout:1/434: dread - db/d1d/d23/f5b zero size 2024-09-17T01:52:04.688 INFO:tasks.workunit.client.1.smithi092.stdout:4/319: dread d4/d5/d1d/d32/f48 [0,4194304] 0 2024-09-17T01:52:04.691 INFO:tasks.workunit.client.1.smithi092.stdout:5/165: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:04.695 INFO:tasks.workunit.client.1.smithi092.stdout:5/166: truncate d0/d23/f2c 205358 0 2024-09-17T01:52:04.698 INFO:tasks.workunit.client.1.smithi092.stdout:5/167: write d0/de/d19/d1a/d1e/ff [3840806,6737] 0 2024-09-17T01:52:04.701 INFO:tasks.workunit.client.1.smithi092.stdout:5/168: chown d0/de/d19/d1a 3904 1 2024-09-17T01:52:04.701 INFO:tasks.workunit.client.1.smithi092.stdout:7/299: dwrite d3/db/d18/f41 [0,4194304] 0 2024-09-17T01:52:04.704 INFO:tasks.workunit.client.0.smithi031.stdout:4/610: dread d8/d9c/fbc [0,4194304] 0 2024-09-17T01:52:04.705 INFO:tasks.workunit.client.0.smithi031.stdout:4/611: chown d8/l20 1965098 1 2024-09-17T01:52:04.707 INFO:tasks.workunit.client.0.smithi031.stdout:4/612: fdatasync d8/d3a/d41/d64/d4d/d5a/d8c/d25/f7a 0 2024-09-17T01:52:04.710 INFO:tasks.workunit.client.1.smithi092.stdout:7/300: dread d3/d6/d13/d21/f5c [0,4194304] 0 2024-09-17T01:52:04.713 INFO:tasks.workunit.client.0.smithi031.stdout:4/613: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/la3 to d8/d3a/d41/d64/d4d/d75/lca 0 2024-09-17T01:52:04.713 INFO:tasks.workunit.client.1.smithi092.stdout:7/301: creat d3/d2b/d3a/f6b x:0 0 0 2024-09-17T01:52:04.716 INFO:tasks.workunit.client.0.smithi031.stdout:4/614: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fbd [357113,6242] 0 2024-09-17T01:52:04.717 INFO:tasks.workunit.client.0.smithi031.stdout:4/615: chown d8/f98 61557594 1 2024-09-17T01:52:04.717 INFO:tasks.workunit.client.1.smithi092.stdout:4/320: dread d4/d5/f6a [0,4194304] 0 2024-09-17T01:52:04.718 INFO:tasks.workunit.client.0.smithi031.stdout:4/616: write d8/d3a/d41/d64/d4d/d5a/f6e [938127,37917] 0 2024-09-17T01:52:04.723 INFO:tasks.workunit.client.1.smithi092.stdout:4/321: symlink d4/d13/d20/l71 0 2024-09-17T01:52:04.725 INFO:tasks.workunit.client.0.smithi031.stdout:4/617: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/fb1 [4054010,125260] 0 2024-09-17T01:52:04.726 INFO:tasks.workunit.client.0.smithi031.stdout:4/618: stat d8/d3a/d41/d64/d4d/d5a/d8c/f3c 0 2024-09-17T01:52:04.726 INFO:tasks.workunit.client.1.smithi092.stdout:5/169: dwrite d0/de/d19/d1a/d1e/f2a [0,4194304] 0 2024-09-17T01:52:04.726 INFO:tasks.workunit.client.1.smithi092.stdout:7/302: dwrite d3/d6/d13/d40/f4f [0,4194304] 0 2024-09-17T01:52:04.727 INFO:tasks.workunit.client.0.smithi031.stdout:4/619: creat d8/d3a/d41/d64/d4d/dae/fcb x:0 0 0 2024-09-17T01:52:04.728 INFO:tasks.workunit.client.1.smithi092.stdout:5/170: chown d0/fd 3317487 1 2024-09-17T01:52:04.729 INFO:tasks.workunit.client.0.smithi031.stdout:4/620: creat d8/d3a/d41/d64/d4d/d8f/fcc x:0 0 0 2024-09-17T01:52:04.730 INFO:tasks.workunit.client.1.smithi092.stdout:5/171: write d0/de/f11 [4604477,40934] 0 2024-09-17T01:52:04.731 INFO:tasks.workunit.client.1.smithi092.stdout:4/322: mknod d4/d13/d20/c72 0 2024-09-17T01:52:04.731 INFO:tasks.workunit.client.1.smithi092.stdout:7/303: dread d3/db/d26/f43 [0,4194304] 0 2024-09-17T01:52:04.732 INFO:tasks.workunit.client.1.smithi092.stdout:4/323: write d4/d13/d20/f27 [1058502,75696] 0 2024-09-17T01:52:04.736 INFO:tasks.workunit.client.1.smithi092.stdout:5/172: mknod d0/c35 0 2024-09-17T01:52:04.737 INFO:tasks.workunit.client.1.smithi092.stdout:7/304: creat d3/d6/d13/d40/f6c x:0 0 0 2024-09-17T01:52:04.740 INFO:tasks.workunit.client.1.smithi092.stdout:7/305: dread - d3/db/f4a zero size 2024-09-17T01:52:04.741 INFO:tasks.workunit.client.1.smithi092.stdout:4/324: write d4/d5/f6a [1856498,108936] 0 2024-09-17T01:52:04.742 INFO:tasks.workunit.client.1.smithi092.stdout:5/173: link d0/de/d19/d1a/f33 d0/de/d19/d1a/d1e/f36 0 2024-09-17T01:52:04.743 INFO:tasks.workunit.client.1.smithi092.stdout:7/306: creat d3/db/d26/f6d x:0 0 0 2024-09-17T01:52:04.745 INFO:tasks.workunit.client.1.smithi092.stdout:7/307: stat d3/d6/d13/d21/f5c 0 2024-09-17T01:52:04.747 INFO:tasks.workunit.client.1.smithi092.stdout:5/174: mknod d0/de/d19/d1a/d24/c37 0 2024-09-17T01:52:04.748 INFO:tasks.workunit.client.1.smithi092.stdout:4/325: dwrite d4/f62 [0,4194304] 0 2024-09-17T01:52:04.748 INFO:tasks.workunit.client.1.smithi092.stdout:7/308: fdatasync d3/d2b/d3a/d5a/f68 0 2024-09-17T01:52:04.749 INFO:tasks.workunit.client.1.smithi092.stdout:7/309: chown d3/d6/d13/d40/d61 249 1 2024-09-17T01:52:04.751 INFO:tasks.workunit.client.1.smithi092.stdout:4/326: unlink d4/d5/d1d/d32/d35/l5a 0 2024-09-17T01:52:04.755 INFO:tasks.workunit.client.1.smithi092.stdout:4/327: link d4/d5/d46/l4f d4/l73 0 2024-09-17T01:52:04.761 INFO:tasks.workunit.client.1.smithi092.stdout:4/328: mknod d4/d5/d1d/d30/d3f/d4b/c74 0 2024-09-17T01:52:04.763 INFO:tasks.workunit.client.1.smithi092.stdout:7/310: dread d3/d6/d13/f34 [0,4194304] 0 2024-09-17T01:52:04.763 INFO:tasks.workunit.client.1.smithi092.stdout:4/329: write d4/d5/f40 [1192117,27731] 0 2024-09-17T01:52:04.765 INFO:tasks.workunit.client.1.smithi092.stdout:7/311: write d3/db/d26/f3b [448371,33211] 0 2024-09-17T01:52:04.771 INFO:tasks.workunit.client.1.smithi092.stdout:7/312: rename d3/db/d18 to d3/d6/d13/d21/d2e/d6e 0 2024-09-17T01:52:04.776 INFO:tasks.workunit.client.1.smithi092.stdout:7/313: mkdir d3/db/d26/d6f 0 2024-09-17T01:52:04.776 INFO:tasks.workunit.client.1.smithi092.stdout:7/314: write d3/db/f4a [765868,122456] 0 2024-09-17T01:52:04.777 INFO:tasks.workunit.client.1.smithi092.stdout:7/315: write d3/d6/d13/d21/f38 [130439,121477] 0 2024-09-17T01:52:04.779 INFO:tasks.workunit.client.1.smithi092.stdout:5/175: dread d0/de/d19/d1a/f25 [0,4194304] 0 2024-09-17T01:52:04.780 INFO:tasks.workunit.client.1.smithi092.stdout:4/330: dwrite d4/d13/d3b/f6d [0,4194304] 0 2024-09-17T01:52:04.781 INFO:tasks.workunit.client.1.smithi092.stdout:7/316: creat d3/d6/d13/f70 x:0 0 0 2024-09-17T01:52:04.782 INFO:tasks.workunit.client.1.smithi092.stdout:7/317: fsync d3/d2b/f31 0 2024-09-17T01:52:04.783 INFO:tasks.workunit.client.1.smithi092.stdout:5/176: rename d0/de/l28 to d0/d23/l38 0 2024-09-17T01:52:04.785 INFO:tasks.workunit.client.1.smithi092.stdout:5/177: write d0/de/d19/d1a/f34 [132246,31528] 0 2024-09-17T01:52:04.787 INFO:tasks.workunit.client.1.smithi092.stdout:7/318: write d3/d6/d13/d21/f36 [1358195,6099] 0 2024-09-17T01:52:04.787 INFO:tasks.workunit.client.1.smithi092.stdout:4/331: dread d4/d13/d3b/f6d [0,4194304] 0 2024-09-17T01:52:04.791 INFO:tasks.workunit.client.1.smithi092.stdout:7/319: read d3/d6/d13/d21/f38 [213319,114716] 0 2024-09-17T01:52:04.793 INFO:tasks.workunit.client.1.smithi092.stdout:7/320: truncate d3/db/d26/f6d 341556 0 2024-09-17T01:52:04.793 INFO:tasks.workunit.client.1.smithi092.stdout:4/332: dread d4/d5/f40 [0,4194304] 0 2024-09-17T01:52:04.794 INFO:tasks.workunit.client.1.smithi092.stdout:4/333: stat d4/d5/d8/f4e 0 2024-09-17T01:52:04.795 INFO:tasks.workunit.client.0.smithi031.stdout:4/621: read d8/fc [1257954,30368] 0 2024-09-17T01:52:04.796 INFO:tasks.workunit.client.1.smithi092.stdout:5/178: getdents d0/de 0 2024-09-17T01:52:04.796 INFO:tasks.workunit.client.1.smithi092.stdout:4/334: chown d4/d5/f6a 22592036 1 2024-09-17T01:52:04.799 INFO:tasks.workunit.client.0.smithi031.stdout:4/622: truncate d8/d3a/d41/d64/d4d/d5a/d8c/d25/f7a 917655 0 2024-09-17T01:52:04.800 INFO:tasks.workunit.client.1.smithi092.stdout:4/335: mknod d4/d5/d8/c75 0 2024-09-17T01:52:04.801 INFO:tasks.workunit.client.0.smithi031.stdout:4/623: rmdir d8/d3a/d41/d64/d4d/d5a/d8c 39 2024-09-17T01:52:04.802 INFO:tasks.workunit.client.1.smithi092.stdout:7/321: dwrite d3/db/d26/f66 [0,4194304] 0 2024-09-17T01:52:04.802 INFO:tasks.workunit.client.1.smithi092.stdout:4/336: read d4/d5/f40 [804075,41096] 0 2024-09-17T01:52:04.802 INFO:tasks.workunit.client.0.smithi031.stdout:4/624: truncate d8/d3a/f40 2581838 0 2024-09-17T01:52:04.804 INFO:tasks.workunit.client.0.smithi031.stdout:4/625: chown d8/l6a 275599413 1 2024-09-17T01:52:04.805 INFO:tasks.workunit.client.1.smithi092.stdout:5/179: link d0/d23/l38 d0/de/d19/d1a/l39 0 2024-09-17T01:52:04.806 INFO:tasks.workunit.client.0.smithi031.stdout:4/626: symlink d8/d3a/d41/d64/d4d/d8f/lcd 0 2024-09-17T01:52:04.807 INFO:tasks.workunit.client.1.smithi092.stdout:5/180: mknod d0/c3a 0 2024-09-17T01:52:04.809 INFO:tasks.workunit.client.1.smithi092.stdout:7/322: link d3/d2b/d3a/f3e d3/d6/d13/d21/d2e/d6e/f71 0 2024-09-17T01:52:04.811 INFO:tasks.workunit.client.1.smithi092.stdout:5/181: mkdir d0/de/d19/d1a/d3b 0 2024-09-17T01:52:04.818 INFO:tasks.workunit.client.1.smithi092.stdout:7/323: dwrite d3/d6/d13/d21/d2e/d6e/f71 [4194304,4194304] 0 2024-09-17T01:52:04.820 INFO:tasks.workunit.client.1.smithi092.stdout:7/324: readlink d3/d6/d13/lf 0 2024-09-17T01:52:04.825 INFO:tasks.workunit.client.1.smithi092.stdout:4/337: truncate d4/d13/d3b/f6d 33595 0 2024-09-17T01:52:04.826 INFO:tasks.workunit.client.1.smithi092.stdout:7/325: creat d3/db/d26/f72 x:0 0 0 2024-09-17T01:52:04.830 INFO:tasks.workunit.client.1.smithi092.stdout:4/338: rename d4/d5/d1d/d32 to d4/d13/d3b/d42/d76 0 2024-09-17T01:52:04.831 INFO:tasks.workunit.client.1.smithi092.stdout:7/326: symlink d3/d6/d13/d40/l73 0 2024-09-17T01:52:04.832 INFO:tasks.workunit.client.1.smithi092.stdout:5/182: dwrite d0/de/d19/d1a/f33 [0,4194304] 0 2024-09-17T01:52:04.833 INFO:tasks.workunit.client.1.smithi092.stdout:7/327: readlink d3/db/l28 0 2024-09-17T01:52:04.839 INFO:tasks.workunit.client.1.smithi092.stdout:5/183: unlink d0/de/d19/d1a/d1e/ff 0 2024-09-17T01:52:04.841 INFO:tasks.workunit.client.0.smithi031.stdout:1/469: sync 2024-09-17T01:52:04.842 INFO:tasks.workunit.client.1.smithi092.stdout:7/328: dread d3/d6/d13/d21/d2e/d6e/f2c [0,4194304] 0 2024-09-17T01:52:04.843 INFO:tasks.workunit.client.0.smithi031.stdout:4/627: write d8/d3a/d41/d64/d4d/d8f/fcc [318365,101017] 0 2024-09-17T01:52:04.844 INFO:tasks.workunit.client.1.smithi092.stdout:4/339: link d4/ce d4/d13/d20/c77 0 2024-09-17T01:52:04.844 INFO:tasks.workunit.client.0.smithi031.stdout:1/470: write d4/d3d/d65/d78/f7d [460814,99739] 0 2024-09-17T01:52:04.846 INFO:tasks.workunit.client.1.smithi092.stdout:5/184: mkdir d0/de/d19/d3c 0 2024-09-17T01:52:04.847 INFO:tasks.workunit.client.0.smithi031.stdout:1/471: rmdir d4/d3d/d65/d78 39 2024-09-17T01:52:04.848 INFO:tasks.workunit.client.0.smithi031.stdout:1/472: readlink d4/d1a/l28 0 2024-09-17T01:52:04.849 INFO:tasks.workunit.client.1.smithi092.stdout:7/329: symlink d3/d6/d13/d21/l74 0 2024-09-17T01:52:04.849 INFO:tasks.workunit.client.1.smithi092.stdout:5/185: symlink d0/de/d19/d1a/d1e/l3d 0 2024-09-17T01:52:04.850 INFO:tasks.workunit.client.1.smithi092.stdout:4/340: stat d4/d13/d20/c38 0 2024-09-17T01:52:04.851 INFO:tasks.workunit.client.0.smithi031.stdout:4/628: dwrite d8/d3a/d41/d64/d86/f94 [0,4194304] 0 2024-09-17T01:52:04.851 INFO:tasks.workunit.client.1.smithi092.stdout:7/330: symlink d3/d2b/d3a/d5a/l75 0 2024-09-17T01:52:04.858 INFO:tasks.workunit.client.1.smithi092.stdout:7/331: write d3/d6/d13/f34 [1553272,35581] 0 2024-09-17T01:52:04.859 INFO:tasks.workunit.client.0.smithi031.stdout:4/629: dwrite d8/fc [0,4194304] 0 2024-09-17T01:52:04.861 INFO:tasks.workunit.client.1.smithi092.stdout:4/341: dread d4/d13/f17 [0,4194304] 0 2024-09-17T01:52:04.861 INFO:tasks.workunit.client.1.smithi092.stdout:5/186: dwrite d0/d23/f27 [0,4194304] 0 2024-09-17T01:52:04.865 INFO:tasks.workunit.client.0.smithi031.stdout:4/630: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/lce 0 2024-09-17T01:52:04.870 INFO:tasks.workunit.client.0.smithi031.stdout:4/631: mkdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf 0 2024-09-17T01:52:04.871 INFO:tasks.workunit.client.1.smithi092.stdout:5/187: dread d0/d23/f27 [0,4194304] 0 2024-09-17T01:52:04.873 INFO:tasks.workunit.client.1.smithi092.stdout:4/342: rename d4/d13/d3b/d42/d76/f60 to d4/d13/d3b/f78 0 2024-09-17T01:52:04.876 INFO:tasks.workunit.client.1.smithi092.stdout:5/188: mkdir d0/de/d19/d1a/d1e/d3e 0 2024-09-17T01:52:04.877 INFO:tasks.workunit.client.1.smithi092.stdout:7/332: mkdir d3/d6/d13/d40/d60/d76 0 2024-09-17T01:52:04.878 INFO:tasks.workunit.client.1.smithi092.stdout:7/333: chown d3/d2b 951087041 1 2024-09-17T01:52:04.878 INFO:tasks.workunit.client.1.smithi092.stdout:4/343: rmdir d4/d13/d3b/d42/d76/d35 39 2024-09-17T01:52:04.879 INFO:tasks.workunit.client.1.smithi092.stdout:7/334: read d3/d6/d13/d40/f55 [53979,6657] 0 2024-09-17T01:52:04.879 INFO:tasks.workunit.client.1.smithi092.stdout:4/344: chown d4/d5/f70 25247 1 2024-09-17T01:52:04.880 INFO:tasks.workunit.client.1.smithi092.stdout:5/189: mknod d0/de/d19/c3f 0 2024-09-17T01:52:04.881 INFO:tasks.workunit.client.1.smithi092.stdout:4/345: read - d4/d13/d3b/d42/d76/d41/d67/f69 zero size 2024-09-17T01:52:04.882 INFO:tasks.workunit.client.0.smithi031.stdout:1/473: dread d4/d1e/d3f/f7c [0,4194304] 0 2024-09-17T01:52:04.883 INFO:tasks.workunit.client.1.smithi092.stdout:7/335: symlink d3/d2b/d37/l77 0 2024-09-17T01:52:04.887 INFO:tasks.workunit.client.1.smithi092.stdout:5/190: dwrite d0/de/d19/d1a/d1e/f1d [0,4194304] 0 2024-09-17T01:52:04.887 INFO:tasks.workunit.client.0.smithi031.stdout:1/474: dwrite d4/d3d/f57 [0,4194304] 0 2024-09-17T01:52:04.888 INFO:tasks.workunit.client.0.smithi031.stdout:1/475: truncate d4/d1e/f88 282594 0 2024-09-17T01:52:04.890 INFO:tasks.workunit.client.1.smithi092.stdout:5/191: creat d0/de/d19/d1a/d1e/d3e/f40 x:0 0 0 2024-09-17T01:52:04.892 INFO:tasks.workunit.client.1.smithi092.stdout:5/192: mkdir d0/de/d19/d3c/d41 0 2024-09-17T01:52:04.893 INFO:tasks.workunit.client.0.smithi031.stdout:1/476: getdents d4/d3d/d65 0 2024-09-17T01:52:04.893 INFO:tasks.workunit.client.1.smithi092.stdout:5/193: chown d0/c3a 456127 1 2024-09-17T01:52:04.895 INFO:tasks.workunit.client.0.smithi031.stdout:1/477: rename d4/d1a/d2d/d18/f9b to d4/d1e/d3f/d72/d7e/d92/fa0 0 2024-09-17T01:52:04.896 INFO:tasks.workunit.client.0.smithi031.stdout:1/478: chown d4/d1e/l59 0 1 2024-09-17T01:52:04.902 INFO:tasks.workunit.client.0.smithi031.stdout:1/479: dwrite d4/d1e/f4f [0,4194304] 0 2024-09-17T01:52:04.904 INFO:tasks.workunit.client.0.smithi031.stdout:1/480: creat d4/d3d/d65/fa1 x:0 0 0 2024-09-17T01:52:04.904 INFO:tasks.workunit.client.0.smithi031.stdout:1/481: chown d4/c6 12 1 2024-09-17T01:52:04.962 INFO:tasks.workunit.client.1.smithi092.stdout:5/194: dread d0/d23/f2c [0,4194304] 0 2024-09-17T01:52:04.963 INFO:tasks.workunit.client.1.smithi092.stdout:5/195: chown d0/de/d19/d1a/d1e/f12 148361984 1 2024-09-17T01:52:04.968 INFO:tasks.workunit.client.1.smithi092.stdout:5/196: creat d0/de/d19/d1a/d1e/f42 x:0 0 0 2024-09-17T01:52:04.969 INFO:tasks.workunit.client.1.smithi092.stdout:5/197: chown d0/d23/l2d 756189335 1 2024-09-17T01:52:04.971 INFO:tasks.workunit.client.1.smithi092.stdout:5/198: rmdir d0/de/d19 39 2024-09-17T01:52:04.976 INFO:tasks.workunit.client.0.smithi031.stdout:0/455: sync 2024-09-17T01:52:04.976 INFO:tasks.workunit.client.0.smithi031.stdout:9/358: sync 2024-09-17T01:52:04.977 INFO:tasks.workunit.client.0.smithi031.stdout:0/456: chown d0/d29/d33/d5/d48/f5a 227645873 1 2024-09-17T01:52:04.978 INFO:tasks.workunit.client.0.smithi031.stdout:0/457: read - d0/d29/d33/d5b/f9e zero size 2024-09-17T01:52:04.978 INFO:tasks.workunit.client.1.smithi092.stdout:5/199: dwrite d0/de/d19/d1a/d1e/f36 [0,4194304] 0 2024-09-17T01:52:04.979 INFO:tasks.workunit.client.0.smithi031.stdout:9/359: mkdir d3/d4/d41/d70 0 2024-09-17T01:52:04.979 INFO:tasks.workunit.client.0.smithi031.stdout:9/360: chown d3/d4/d41 56904 1 2024-09-17T01:52:04.980 INFO:tasks.workunit.client.1.smithi092.stdout:5/200: readlink d0/de/d19/d1a/d1e/l3d 0 2024-09-17T01:52:04.980 INFO:tasks.workunit.client.0.smithi031.stdout:0/458: chown d0/d29/d33/d2a/d25/d30/d4a/f6e 76 1 2024-09-17T01:52:04.982 INFO:tasks.workunit.client.0.smithi031.stdout:9/361: mkdir d3/d10/d71 0 2024-09-17T01:52:04.983 INFO:tasks.workunit.client.1.smithi092.stdout:5/201: getdents d0/de 0 2024-09-17T01:52:04.984 INFO:tasks.workunit.client.0.smithi031.stdout:0/459: getdents d0/d29 0 2024-09-17T01:52:04.985 INFO:tasks.workunit.client.0.smithi031.stdout:9/362: write d3/d19/d1f/f6d [4928138,106159] 0 2024-09-17T01:52:04.989 INFO:tasks.workunit.client.0.smithi031.stdout:9/363: creat d3/d47/f72 x:0 0 0 2024-09-17T01:52:04.989 INFO:tasks.workunit.client.0.smithi031.stdout:0/460: creat d0/d29/d33/d2a/d25/d30/d9c/fa0 x:0 0 0 2024-09-17T01:52:04.990 INFO:tasks.workunit.client.1.smithi092.stdout:5/202: dwrite d0/de/d19/f1f [4194304,4194304] 0 2024-09-17T01:52:04.991 INFO:tasks.workunit.client.0.smithi031.stdout:9/364: symlink d3/d10/d71/l73 0 2024-09-17T01:52:04.995 INFO:tasks.workunit.client.1.smithi092.stdout:7/336: dread d3/d6/f1c [0,4194304] 0 2024-09-17T01:52:04.996 INFO:tasks.workunit.client.1.smithi092.stdout:5/203: dread d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:04.996 INFO:tasks.workunit.client.1.smithi092.stdout:7/337: fdatasync d3/d6/d13/d40/f4f 0 2024-09-17T01:52:04.998 INFO:tasks.workunit.client.1.smithi092.stdout:7/338: readlink d3/d6/d13/l11 0 2024-09-17T01:52:04.998 INFO:tasks.workunit.client.1.smithi092.stdout:5/204: write d0/de/f21 [1088218,34701] 0 2024-09-17T01:52:04.999 INFO:tasks.workunit.client.1.smithi092.stdout:5/205: chown d0/de/d19/d1a 68748 1 2024-09-17T01:52:04.999 INFO:tasks.workunit.client.1.smithi092.stdout:7/339: dread - d3/d6/d13/f70 zero size 2024-09-17T01:52:05.001 INFO:tasks.workunit.client.0.smithi031.stdout:9/365: dwrite d3/d19/f65 [0,4194304] 0 2024-09-17T01:52:05.005 INFO:tasks.workunit.client.1.smithi092.stdout:7/340: dread d3/db/f4a [0,4194304] 0 2024-09-17T01:52:05.006 INFO:tasks.workunit.client.0.smithi031.stdout:1/482: stat d4/d3d/d65/d78/f7d 0 2024-09-17T01:52:05.006 INFO:tasks.workunit.client.0.smithi031.stdout:1/483: chown d4/d1a/d43/d53/f73 2775 1 2024-09-17T01:52:05.007 INFO:tasks.workunit.client.0.smithi031.stdout:1/484: read - d4/d3d/d65/fa1 zero size 2024-09-17T01:52:05.008 INFO:tasks.workunit.client.0.smithi031.stdout:9/366: read d3/d19/d1f/d44/f57 [191044,77237] 0 2024-09-17T01:52:05.008 INFO:tasks.workunit.client.1.smithi092.stdout:5/206: dwrite d0/de/d19/d1a/d1e/f2a [0,4194304] 0 2024-09-17T01:52:05.009 INFO:tasks.workunit.client.0.smithi031.stdout:1/485: dread - d4/d1e/d3f/d72/d7e/d92/fa0 zero size 2024-09-17T01:52:05.012 INFO:tasks.workunit.client.0.smithi031.stdout:1/486: mkdir d4/d1e/d3f/d72/d7e/da2 0 2024-09-17T01:52:05.013 INFO:tasks.workunit.client.0.smithi031.stdout:1/487: stat d4/c8 0 2024-09-17T01:52:05.014 INFO:tasks.workunit.client.1.smithi092.stdout:7/341: rename d3/db/l47 to d3/d6/d13/d40/d60/l78 0 2024-09-17T01:52:05.017 INFO:tasks.workunit.client.1.smithi092.stdout:5/207: creat d0/de/d19/d3c/d41/f43 x:0 0 0 2024-09-17T01:52:05.018 INFO:tasks.workunit.client.1.smithi092.stdout:7/342: fsync d3/d6/d13/d21/f5c 0 2024-09-17T01:52:05.020 INFO:tasks.workunit.client.1.smithi092.stdout:5/208: mknod d0/de/d19/d1a/d1e/d3e/c44 0 2024-09-17T01:52:05.021 INFO:tasks.workunit.client.1.smithi092.stdout:5/209: dread - d0/de/d19/d1a/d1e/d3e/f40 zero size 2024-09-17T01:52:05.022 INFO:tasks.workunit.client.1.smithi092.stdout:7/343: rename d3/d2b/f31 to d3/db/d26/d6f/f79 0 2024-09-17T01:52:05.023 INFO:tasks.workunit.client.1.smithi092.stdout:7/344: fdatasync d3/d6/d13/d21/d2e/f59 0 2024-09-17T01:52:05.024 INFO:tasks.workunit.client.1.smithi092.stdout:5/210: mknod d0/de/d19/d1a/d1e/c45 0 2024-09-17T01:52:05.025 INFO:tasks.workunit.client.1.smithi092.stdout:5/211: dread - d0/de/d19/d1a/d1e/d3e/f40 zero size 2024-09-17T01:52:05.027 INFO:tasks.workunit.client.1.smithi092.stdout:7/345: unlink d3/d6/d13/d21/d2e/d6e/l1b 0 2024-09-17T01:52:05.027 INFO:tasks.workunit.client.1.smithi092.stdout:5/212: write d0/de/d19/d1a/f22 [874214,73398] 0 2024-09-17T01:52:05.028 INFO:tasks.workunit.client.0.smithi031.stdout:0/461: dread d0/d29/d33/d2a/d25/f3f [0,4194304] 0 2024-09-17T01:52:05.028 INFO:tasks.workunit.client.1.smithi092.stdout:7/346: write d3/db/d26/f72 [505500,11629] 0 2024-09-17T01:52:05.028 INFO:tasks.workunit.client.1.smithi092.stdout:7/347: chown d3/d6/d13 1317 1 2024-09-17T01:52:05.030 INFO:tasks.workunit.client.1.smithi092.stdout:7/348: truncate d3/d6/d13/d21/f38 1121857 0 2024-09-17T01:52:05.031 INFO:tasks.workunit.client.0.smithi031.stdout:9/367: dread d3/fb [0,4194304] 0 2024-09-17T01:52:05.031 INFO:tasks.workunit.client.1.smithi092.stdout:5/213: mkdir d0/de/d19/d1a/d1e/d3e/d46 0 2024-09-17T01:52:05.033 INFO:tasks.workunit.client.1.smithi092.stdout:5/214: rename d0/c3a to d0/de/d19/d1a/d1e/d29/c47 0 2024-09-17T01:52:05.038 INFO:tasks.workunit.client.0.smithi031.stdout:7/415: sync 2024-09-17T01:52:05.038 INFO:tasks.workunit.client.0.smithi031.stdout:8/398: sync 2024-09-17T01:52:05.039 INFO:tasks.workunit.client.1.smithi092.stdout:5/215: dwrite d0/de/d19/d1a/d1e/f42 [0,4194304] 0 2024-09-17T01:52:05.042 INFO:tasks.workunit.client.1.smithi092.stdout:5/216: chown d0/de/d19/d1a/d1e/d3e/d46 1390 1 2024-09-17T01:52:05.043 INFO:tasks.workunit.client.0.smithi031.stdout:1/488: truncate d4/f17 1455743 0 2024-09-17T01:52:05.049 INFO:tasks.workunit.client.1.smithi092.stdout:5/217: dwrite d0/de/f11 [0,4194304] 0 2024-09-17T01:52:05.051 INFO:tasks.workunit.client.0.smithi031.stdout:0/462: mkdir d0/d29/d33/d2a/d25/d30/d4a/d86/da1 0 2024-09-17T01:52:05.052 INFO:tasks.workunit.client.1.smithi092.stdout:5/218: creat d0/d23/f48 x:0 0 0 2024-09-17T01:52:05.053 INFO:tasks.workunit.client.1.smithi092.stdout:5/219: dread - d0/de/d19/d1a/d1e/d3e/f40 zero size 2024-09-17T01:52:05.053 INFO:tasks.workunit.client.0.smithi031.stdout:0/463: write d0/d29/d33/d2a/f7f [215544,83040] 0 2024-09-17T01:52:05.054 INFO:tasks.workunit.client.0.smithi031.stdout:8/399: dread d0/df/d19/f29 [0,4194304] 0 2024-09-17T01:52:05.056 INFO:tasks.workunit.client.0.smithi031.stdout:0/464: chown d0/d29/d33/d2a/f7f 1 1 2024-09-17T01:52:05.057 INFO:tasks.workunit.client.0.smithi031.stdout:9/368: rename d3/d4/d29/f4b to d3/d4/d29/f74 0 2024-09-17T01:52:05.058 INFO:tasks.workunit.client.1.smithi092.stdout:5/220: getdents d0/de/d19/d1a/d1e 0 2024-09-17T01:52:05.059 INFO:tasks.workunit.client.1.smithi092.stdout:5/221: chown d0/de/d19/d1a/f25 0 1 2024-09-17T01:52:05.061 INFO:tasks.workunit.client.0.smithi031.stdout:8/400: rename d0/df/d19/f1b to d0/f74 0 2024-09-17T01:52:05.063 INFO:tasks.workunit.client.0.smithi031.stdout:0/465: creat d0/d29/fa2 x:0 0 0 2024-09-17T01:52:05.064 INFO:tasks.workunit.client.0.smithi031.stdout:9/369: symlink d3/d19/d1f/l75 0 2024-09-17T01:52:05.065 INFO:tasks.workunit.client.0.smithi031.stdout:7/416: link db/d29/c2a db/d1c/d46/c7a 0 2024-09-17T01:52:05.066 INFO:tasks.workunit.client.1.smithi092.stdout:5/222: truncate d0/de/f21 119553 0 2024-09-17T01:52:05.067 INFO:tasks.workunit.client.0.smithi031.stdout:8/401: mknod d0/df/dd/c75 0 2024-09-17T01:52:05.072 INFO:tasks.workunit.client.0.smithi031.stdout:8/402: dread d0/df/f65 [0,4194304] 0 2024-09-17T01:52:05.073 INFO:tasks.workunit.client.0.smithi031.stdout:8/403: chown d0/d5/f43 212 1 2024-09-17T01:52:05.074 INFO:tasks.workunit.client.0.smithi031.stdout:8/404: fsync d0/df/f65 0 2024-09-17T01:52:05.074 INFO:tasks.workunit.client.0.smithi031.stdout:9/370: rename d3/d47/f72 to d3/d4/d41/d70/f76 0 2024-09-17T01:52:05.075 INFO:tasks.workunit.client.0.smithi031.stdout:9/371: readlink d3/d4/d29/l50 0 2024-09-17T01:52:05.077 INFO:tasks.workunit.client.1.smithi092.stdout:5/223: dwrite d0/de/f21 [0,4194304] 0 2024-09-17T01:52:05.081 INFO:tasks.workunit.client.1.smithi092.stdout:5/224: creat d0/de/d19/d1a/d1e/d3e/d46/f49 x:0 0 0 2024-09-17T01:52:05.083 INFO:tasks.workunit.client.1.smithi092.stdout:5/225: mknod d0/de/d19/d1a/d24/c4a 0 2024-09-17T01:52:05.083 INFO:tasks.workunit.client.0.smithi031.stdout:9/372: unlink d3/d19/d1f/d44/f61 0 2024-09-17T01:52:05.087 INFO:tasks.workunit.client.1.smithi092.stdout:5/226: rename d0/de/d19/d1a/f33 to d0/de/d19/d1a/d24/f4b 0 2024-09-17T01:52:05.087 INFO:tasks.workunit.client.1.smithi092.stdout:5/227: stat d0/de/d19/d1a/f22 0 2024-09-17T01:52:05.088 INFO:tasks.workunit.client.0.smithi031.stdout:9/373: symlink d3/d10/d36/l77 0 2024-09-17T01:52:05.089 INFO:tasks.workunit.client.0.smithi031.stdout:7/417: dread db/d18/f61 [0,4194304] 0 2024-09-17T01:52:05.091 INFO:tasks.workunit.client.1.smithi092.stdout:5/228: dread d0/de/d19/d1a/d1e/f36 [0,4194304] 0 2024-09-17T01:52:05.093 INFO:tasks.workunit.client.0.smithi031.stdout:7/418: creat db/d18/f7b x:0 0 0 2024-09-17T01:52:05.094 INFO:tasks.workunit.client.0.smithi031.stdout:1/489: write d4/f17 [40653,100078] 0 2024-09-17T01:52:05.095 INFO:tasks.workunit.client.0.smithi031.stdout:7/419: truncate db/d18/f48 124205 0 2024-09-17T01:52:05.097 INFO:tasks.workunit.client.0.smithi031.stdout:3/432: sync 2024-09-17T01:52:05.097 INFO:tasks.workunit.client.0.smithi031.stdout:5/370: sync 2024-09-17T01:52:05.097 INFO:tasks.workunit.client.0.smithi031.stdout:4/632: sync 2024-09-17T01:52:05.097 INFO:tasks.workunit.client.0.smithi031.stdout:1/490: truncate d4/d1e/d3f/d72/f7a 301348 0 2024-09-17T01:52:05.097 INFO:tasks.workunit.client.0.smithi031.stdout:6/578: sync 2024-09-17T01:52:05.097 INFO:tasks.workunit.client.0.smithi031.stdout:2/508: sync 2024-09-17T01:52:05.100 INFO:tasks.workunit.client.0.smithi031.stdout:9/374: creat d3/d4/d29/f78 x:0 0 0 2024-09-17T01:52:05.103 INFO:tasks.workunit.client.0.smithi031.stdout:2/509: write d1/d3/d2d/db2/f28 [3519536,8671] 0 2024-09-17T01:52:05.103 INFO:tasks.workunit.client.0.smithi031.stdout:9/375: fsync d3/d19/d1f/f6d 0 2024-09-17T01:52:05.105 INFO:tasks.workunit.client.0.smithi031.stdout:4/633: creat d8/d3a/d41/d64/d4f/fd0 x:0 0 0 2024-09-17T01:52:05.107 INFO:tasks.workunit.client.0.smithi031.stdout:9/376: fsync d3/d19/d1f/f55 0 2024-09-17T01:52:05.110 INFO:tasks.workunit.client.0.smithi031.stdout:7/420: mknod db/c7c 0 2024-09-17T01:52:05.110 INFO:tasks.workunit.client.0.smithi031.stdout:9/377: chown d3/d4/d41/d70/f76 5619 1 2024-09-17T01:52:05.112 INFO:tasks.workunit.client.0.smithi031.stdout:3/433: rename db/d29/d7a to db/d82 0 2024-09-17T01:52:05.114 INFO:tasks.workunit.client.0.smithi031.stdout:6/579: dwrite d23/d63/d47/d81/fca [0,4194304] 0 2024-09-17T01:52:05.115 INFO:tasks.workunit.client.0.smithi031.stdout:6/580: write f20 [4596263,85173] 0 2024-09-17T01:52:05.117 INFO:tasks.workunit.client.0.smithi031.stdout:3/434: write db/df/d1d/f59 [939121,55952] 0 2024-09-17T01:52:05.122 INFO:tasks.workunit.client.0.smithi031.stdout:7/421: read db/d18/f48 [120376,20156] 0 2024-09-17T01:52:05.122 INFO:tasks.workunit.client.0.smithi031.stdout:1/491: symlink d4/d1e/d3f/d72/d7e/da2/la3 0 2024-09-17T01:52:05.122 INFO:tasks.workunit.client.0.smithi031.stdout:3/435: write db/df/d1d/f59 [225863,4349] 0 2024-09-17T01:52:05.124 INFO:tasks.workunit.client.0.smithi031.stdout:2/510: dwrite d1/d3/d2d/db2/f33 [4194304,4194304] 0 2024-09-17T01:52:05.124 INFO:tasks.workunit.client.0.smithi031.stdout:7/422: write db/d18/f6a [134005,13901] 0 2024-09-17T01:52:05.126 INFO:tasks.workunit.client.0.smithi031.stdout:8/405: truncate d0/df/d19/d3d/f41 189237 0 2024-09-17T01:52:05.129 INFO:tasks.workunit.client.0.smithi031.stdout:2/511: dread - d1/d3/d2d/db2/d1e/d21/fae zero size 2024-09-17T01:52:05.130 INFO:tasks.workunit.client.0.smithi031.stdout:6/581: truncate d23/db4/d6a/dac/f85 1740196 0 2024-09-17T01:52:05.132 INFO:tasks.workunit.client.0.smithi031.stdout:9/378: mkdir d3/d10/d36/d79 0 2024-09-17T01:52:05.134 INFO:tasks.workunit.client.0.smithi031.stdout:2/512: read d1/d3/d2d/db2/d1e/d21/f90 [639964,126518] 0 2024-09-17T01:52:05.144 INFO:tasks.workunit.client.0.smithi031.stdout:8/406: symlink d0/l76 0 2024-09-17T01:52:05.145 INFO:tasks.workunit.client.1.smithi092.stdout:2/228: sync 2024-09-17T01:52:05.146 INFO:tasks.workunit.client.0.smithi031.stdout:5/371: getdents da/dc/d25 0 2024-09-17T01:52:05.147 INFO:tasks.workunit.client.0.smithi031.stdout:7/423: rmdir db/d1c/d41/d72 39 2024-09-17T01:52:05.147 INFO:tasks.workunit.client.1.smithi092.stdout:2/229: symlink d10/l49 0 2024-09-17T01:52:05.147 INFO:tasks.workunit.client.0.smithi031.stdout:7/424: fdatasync db/d29/f75 0 2024-09-17T01:52:05.148 INFO:tasks.workunit.client.1.smithi092.stdout:2/230: creat d10/d3a/f4a x:0 0 0 2024-09-17T01:52:05.149 INFO:tasks.workunit.client.0.smithi031.stdout:7/425: fdatasync db/d1c/d41/d69/f70 0 2024-09-17T01:52:05.149 INFO:tasks.workunit.client.0.smithi031.stdout:6/582: chown d23/db4/c9b 17 1 2024-09-17T01:52:05.150 INFO:tasks.workunit.client.0.smithi031.stdout:9/379: chown d3/d10/l26 1 1 2024-09-17T01:52:05.152 INFO:tasks.workunit.client.0.smithi031.stdout:3/436: dread db/df/f22 [0,4194304] 0 2024-09-17T01:52:05.153 INFO:tasks.workunit.client.0.smithi031.stdout:4/634: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/cd1 0 2024-09-17T01:52:05.155 INFO:tasks.workunit.client.1.smithi092.stdout:2/231: dwrite d10/f2a [0,4194304] 0 2024-09-17T01:52:05.158 INFO:tasks.workunit.client.0.smithi031.stdout:5/372: truncate da/dc/f27 331057 0 2024-09-17T01:52:05.159 INFO:tasks.workunit.client.0.smithi031.stdout:5/373: chown da/d4b/d6c/l79 869 1 2024-09-17T01:52:05.165 INFO:tasks.workunit.client.0.smithi031.stdout:3/437: rmdir db/d82 39 2024-09-17T01:52:05.166 INFO:tasks.workunit.client.0.smithi031.stdout:3/438: read - db/f5f zero size 2024-09-17T01:52:05.169 INFO:tasks.workunit.client.0.smithi031.stdout:1/492: link d4/d1e/f49 d4/d1e/d3f/d72/d7e/da2/fa4 0 2024-09-17T01:52:05.171 INFO:tasks.workunit.client.0.smithi031.stdout:5/374: unlink da/dc/f44 0 2024-09-17T01:52:05.171 INFO:tasks.workunit.client.1.smithi092.stdout:2/232: creat d10/f4b x:0 0 0 2024-09-17T01:52:05.173 INFO:tasks.workunit.client.0.smithi031.stdout:6/583: unlink d23/db4/d6a/d70/c71 0 2024-09-17T01:52:05.174 INFO:tasks.workunit.client.1.smithi092.stdout:2/233: mkdir d10/d4c 0 2024-09-17T01:52:05.174 INFO:tasks.workunit.client.1.smithi092.stdout:2/234: fdatasync d10/f1a 0 2024-09-17T01:52:05.175 INFO:tasks.workunit.client.0.smithi031.stdout:6/584: truncate d23/db4/d6a/d70/d74/fb1 111939 0 2024-09-17T01:52:05.176 INFO:tasks.workunit.client.0.smithi031.stdout:6/585: read - d23/db4/d6a/d91/fb6 zero size 2024-09-17T01:52:05.177 INFO:tasks.workunit.client.0.smithi031.stdout:0/466: rename d0/d29/d33/d5/d48/c7c to d0/d29/d33/d2a/d25/ca3 0 2024-09-17T01:52:05.180 INFO:tasks.workunit.client.0.smithi031.stdout:3/439: mkdir db/df/d1c/d6a/d83 0 2024-09-17T01:52:05.182 INFO:tasks.workunit.client.1.smithi092.stdout:2/235: dwrite d10/d15/f2b [0,4194304] 0 2024-09-17T01:52:05.182 INFO:tasks.workunit.client.0.smithi031.stdout:1/493: mkdir d4/d1e/d3f/d4d/da5 0 2024-09-17T01:52:05.184 INFO:tasks.workunit.client.0.smithi031.stdout:0/467: dread d0/d29/d33/f75 [0,4194304] 0 2024-09-17T01:52:05.189 INFO:tasks.workunit.client.1.smithi092.stdout:2/236: link d10/f19 d10/d1d/d2c/f4d 0 2024-09-17T01:52:05.190 INFO:tasks.workunit.client.0.smithi031.stdout:5/375: mkdir da/dc/d25/d81 0 2024-09-17T01:52:05.190 INFO:tasks.workunit.client.0.smithi031.stdout:2/513: dwrite d1/d3/df/f5b [0,4194304] 0 2024-09-17T01:52:05.190 INFO:tasks.workunit.client.0.smithi031.stdout:6/586: truncate d23/d63/f76 560068 0 2024-09-17T01:52:05.191 INFO:tasks.workunit.client.1.smithi092.stdout:2/237: creat d10/d1d/d2d/f4e x:0 0 0 2024-09-17T01:52:05.191 INFO:tasks.workunit.client.0.smithi031.stdout:9/380: rename d3/d19/f30 to d3/d4/d41/f7a 0 2024-09-17T01:52:05.192 INFO:tasks.workunit.client.1.smithi092.stdout:2/238: creat d10/d1d/d24/f4f x:0 0 0 2024-09-17T01:52:05.192 INFO:tasks.workunit.client.0.smithi031.stdout:3/440: dread db/df/d50/f62 [0,4194304] 0 2024-09-17T01:52:05.193 INFO:tasks.workunit.client.0.smithi031.stdout:9/381: readlink d3/d19/d1f/l45 0 2024-09-17T01:52:05.193 INFO:tasks.workunit.client.1.smithi092.stdout:2/239: write d10/d1d/d2c/f39 [4403367,32423] 0 2024-09-17T01:52:05.195 INFO:tasks.workunit.client.0.smithi031.stdout:9/382: write d3/d19/f22 [364129,68655] 0 2024-09-17T01:52:05.199 INFO:tasks.workunit.client.0.smithi031.stdout:8/407: write d0/df/d19/d3d/f41 [809917,99195] 0 2024-09-17T01:52:05.200 INFO:tasks.workunit.client.0.smithi031.stdout:0/468: dwrite d0/d29/d33/d2a/d25/d38/f5e [0,4194304] 0 2024-09-17T01:52:05.200 INFO:tasks.workunit.client.0.smithi031.stdout:8/408: fdatasync d0/df/d19/d3d/f5f 0 2024-09-17T01:52:05.203 INFO:tasks.workunit.client.0.smithi031.stdout:5/376: rmdir da/d42/d12 39 2024-09-17T01:52:05.203 INFO:tasks.workunit.client.0.smithi031.stdout:0/469: chown d0/d29/d33/d2a/d25/f7a 211462224 1 2024-09-17T01:52:05.204 INFO:tasks.workunit.client.0.smithi031.stdout:2/514: chown d1/d3/df/d18/d40/d43 7352740 1 2024-09-17T01:52:05.206 INFO:tasks.workunit.client.0.smithi031.stdout:6/587: creat d23/db4/d8a/fcc x:0 0 0 2024-09-17T01:52:05.207 INFO:tasks.workunit.client.1.smithi092.stdout:2/240: rmdir d10/d1d/d2c 39 2024-09-17T01:52:05.209 INFO:tasks.workunit.client.1.smithi092.stdout:2/241: fsync d10/d15/f3e 0 2024-09-17T01:52:05.212 INFO:tasks.workunit.client.1.smithi092.stdout:2/242: symlink d10/d4c/l50 0 2024-09-17T01:52:05.212 INFO:tasks.workunit.client.0.smithi031.stdout:9/383: dwrite d3/d19/d1f/f6d [0,4194304] 0 2024-09-17T01:52:05.214 INFO:tasks.workunit.client.1.smithi092.stdout:2/243: symlink d10/d1d/d2c/l51 0 2024-09-17T01:52:05.215 INFO:tasks.workunit.client.0.smithi031.stdout:0/470: dwrite d0/d29/d33/d5b/f94 [0,4194304] 0 2024-09-17T01:52:05.216 INFO:tasks.workunit.client.0.smithi031.stdout:4/635: truncate d8/f3b 8025677 0 2024-09-17T01:52:05.218 INFO:tasks.workunit.client.0.smithi031.stdout:3/441: write db/f3e [616866,111510] 0 2024-09-17T01:52:05.222 INFO:tasks.workunit.client.0.smithi031.stdout:9/384: chown d3/d4/d29/f31 24040 1 2024-09-17T01:52:05.222 INFO:tasks.workunit.client.0.smithi031.stdout:3/442: chown db/df/f39 0 1 2024-09-17T01:52:05.225 INFO:tasks.workunit.client.1.smithi092.stdout:2/244: write d10/f13 [1395634,89521] 0 2024-09-17T01:52:05.227 INFO:tasks.workunit.client.0.smithi031.stdout:8/409: mkdir d0/df/dd/d77 0 2024-09-17T01:52:05.229 INFO:tasks.workunit.client.0.smithi031.stdout:8/410: chown d0/l2e 1097198 1 2024-09-17T01:52:05.229 INFO:tasks.workunit.client.1.smithi092.stdout:2/245: rename d10/f13 to d10/d1d/d2d/f52 0 2024-09-17T01:52:05.233 INFO:tasks.workunit.client.0.smithi031.stdout:0/471: dwrite d0/d29/d33/d5/f62 [0,4194304] 0 2024-09-17T01:52:05.236 INFO:tasks.workunit.client.0.smithi031.stdout:1/494: dwrite d4/d1a/d2d/d18/d52/f63 [0,4194304] 0 2024-09-17T01:52:05.240 INFO:tasks.workunit.client.1.smithi092.stdout:2/246: dread d10/d1d/d2c/f42 [0,4194304] 0 2024-09-17T01:52:05.241 INFO:tasks.workunit.client.0.smithi031.stdout:2/515: mkdir d1/db6 0 2024-09-17T01:52:05.242 INFO:tasks.workunit.client.0.smithi031.stdout:2/516: readlink d1/d3/d2d/db2/d1e/d21/d34/l74 0 2024-09-17T01:52:05.243 INFO:tasks.workunit.client.0.smithi031.stdout:6/588: unlink d23/l2b 0 2024-09-17T01:52:05.245 INFO:tasks.workunit.client.1.smithi092.stdout:2/247: creat d10/d1d/f53 x:0 0 0 2024-09-17T01:52:05.250 INFO:tasks.workunit.client.1.smithi092.stdout:2/248: mkdir d10/d54 0 2024-09-17T01:52:05.251 INFO:tasks.workunit.client.0.smithi031.stdout:0/472: mknod d0/d37/ca4 0 2024-09-17T01:52:05.251 INFO:tasks.workunit.client.0.smithi031.stdout:2/517: dwrite d1/d3/d2d/db2/d1e/f29 [0,4194304] 0 2024-09-17T01:52:05.253 INFO:tasks.workunit.client.0.smithi031.stdout:2/518: write d1/f87 [5994076,67574] 0 2024-09-17T01:52:05.253 INFO:tasks.workunit.client.0.smithi031.stdout:1/495: creat d4/d1e/d40/d84/fa6 x:0 0 0 2024-09-17T01:52:05.255 INFO:tasks.workunit.client.0.smithi031.stdout:9/385: link d3/d4/d29/f74 d3/d19/d1f/f7b 0 2024-09-17T01:52:05.256 INFO:tasks.workunit.client.1.smithi092.stdout:2/249: dwrite d10/d1d/d2d/f52 [0,4194304] 0 2024-09-17T01:52:05.258 INFO:tasks.workunit.client.0.smithi031.stdout:8/411: mkdir d0/df/dd/d77/d78 0 2024-09-17T01:52:05.260 INFO:tasks.workunit.client.1.smithi092.stdout:2/250: unlink d10/d1d/d2c/f2e 0 2024-09-17T01:52:05.261 INFO:tasks.workunit.client.0.smithi031.stdout:5/377: mkdir da/dc/d2e/d82 0 2024-09-17T01:52:05.264 INFO:tasks.workunit.client.1.smithi092.stdout:2/251: mkdir d10/d55 0 2024-09-17T01:52:05.264 INFO:tasks.workunit.client.0.smithi031.stdout:0/473: dread d0/d29/d33/f75 [0,4194304] 0 2024-09-17T01:52:05.265 INFO:tasks.workunit.client.1.smithi092.stdout:2/252: write d10/d1d/f26 [391344,34399] 0 2024-09-17T01:52:05.265 INFO:tasks.workunit.client.0.smithi031.stdout:2/519: dwrite d1/f23 [0,4194304] 0 2024-09-17T01:52:05.266 INFO:tasks.workunit.client.1.smithi092.stdout:2/253: chown d10/d1d/d2c/l51 116 1 2024-09-17T01:52:05.268 INFO:tasks.workunit.client.1.smithi092.stdout:2/254: write d10/d1d/d2c/f42 [2171553,500] 0 2024-09-17T01:52:05.270 INFO:tasks.workunit.client.0.smithi031.stdout:3/443: rename db/l56 to db/df/d1d/l84 0 2024-09-17T01:52:05.273 INFO:tasks.workunit.client.0.smithi031.stdout:9/386: symlink d3/d4/l7c 0 2024-09-17T01:52:05.275 INFO:tasks.workunit.client.1.smithi092.stdout:2/255: dwrite fe [0,4194304] 0 2024-09-17T01:52:05.275 INFO:tasks.workunit.client.0.smithi031.stdout:1/496: dwrite d4/d1e/f70 [0,4194304] 0 2024-09-17T01:52:05.276 INFO:tasks.workunit.client.1.smithi092.stdout:2/256: fsync d10/d1d/d24/f4f 0 2024-09-17T01:52:05.279 INFO:tasks.workunit.client.0.smithi031.stdout:1/497: stat d4/d1e/d3f/d72/d7e/da2/la3 0 2024-09-17T01:52:05.279 INFO:tasks.workunit.client.1.smithi092.stdout:2/257: unlink d10/d1d/d2d/c41 0 2024-09-17T01:52:05.281 INFO:tasks.workunit.client.1.smithi092.stdout:2/258: mkdir d10/d1d/d2c/d56 0 2024-09-17T01:52:05.285 INFO:tasks.workunit.client.1.smithi092.stdout:2/259: unlink d10/d15/f1b 0 2024-09-17T01:52:05.286 INFO:tasks.workunit.client.0.smithi031.stdout:9/387: dwrite d3/d19/f34 [0,4194304] 0 2024-09-17T01:52:05.288 INFO:tasks.workunit.client.0.smithi031.stdout:4/636: getdents d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36 0 2024-09-17T01:52:05.288 INFO:tasks.workunit.client.0.smithi031.stdout:3/444: fdatasync db/df/d1d/d37/d4a/f33 0 2024-09-17T01:52:05.290 INFO:tasks.workunit.client.0.smithi031.stdout:3/445: fsync db/f81 0 2024-09-17T01:52:05.293 INFO:tasks.workunit.client.0.smithi031.stdout:8/412: chown d0/d5/d54/d60 8741 1 2024-09-17T01:52:05.295 INFO:tasks.workunit.client.0.smithi031.stdout:6/589: creat d23/d63/fcd x:0 0 0 2024-09-17T01:52:05.296 INFO:tasks.workunit.client.0.smithi031.stdout:5/378: chown da/dc/l4e 5669769 1 2024-09-17T01:52:05.302 INFO:tasks.workunit.client.0.smithi031.stdout:2/520: creat d1/d3/df/d11/d30/db1/fb7 x:0 0 0 2024-09-17T01:52:05.303 INFO:tasks.workunit.client.0.smithi031.stdout:4/637: unlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/c5d 0 2024-09-17T01:52:05.303 INFO:tasks.workunit.client.0.smithi031.stdout:2/521: chown d1/d3/df/d18/d40/f7e 3454 1 2024-09-17T01:52:05.304 INFO:tasks.workunit.client.0.smithi031.stdout:2/522: stat d1/d3/df/l36 0 2024-09-17T01:52:05.305 INFO:tasks.workunit.client.0.smithi031.stdout:3/446: rename db/df/d1d/d37/d3a/f58 to db/df/d1d/d37/d6c/d6e/f85 0 2024-09-17T01:52:05.306 INFO:tasks.workunit.client.0.smithi031.stdout:3/447: write db/f7d [689638,14560] 0 2024-09-17T01:52:05.307 INFO:tasks.workunit.client.0.smithi031.stdout:6/590: unlink d23/f3d 0 2024-09-17T01:52:05.307 INFO:tasks.workunit.client.0.smithi031.stdout:3/448: truncate db/f42 4952167 0 2024-09-17T01:52:05.308 INFO:tasks.workunit.client.0.smithi031.stdout:6/591: fdatasync d23/db4/f8b 0 2024-09-17T01:52:05.310 INFO:tasks.workunit.client.0.smithi031.stdout:3/449: truncate db/df/d1d/f49 931523 0 2024-09-17T01:52:05.310 INFO:tasks.workunit.client.0.smithi031.stdout:9/388: mknod d3/d4/d29/c7d 0 2024-09-17T01:52:05.315 INFO:tasks.workunit.client.0.smithi031.stdout:5/379: mknod da/d42/d26/c83 0 2024-09-17T01:52:05.315 INFO:tasks.workunit.client.0.smithi031.stdout:1/498: link d4/d1e/d3f/l8a d4/d1a/d43/d53/la7 0 2024-09-17T01:52:05.317 INFO:tasks.workunit.client.0.smithi031.stdout:6/592: creat d23/db4/d6a/d72/fce x:0 0 0 2024-09-17T01:52:05.318 INFO:tasks.workunit.client.0.smithi031.stdout:3/450: symlink db/df/d1d/d37/d3a/l86 0 2024-09-17T01:52:05.320 INFO:tasks.workunit.client.0.smithi031.stdout:8/413: link d0/df/dd/d59/c5a d0/df/dd/c79 0 2024-09-17T01:52:05.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/593: dwrite f1e [0,4194304] 0 2024-09-17T01:52:05.324 INFO:tasks.workunit.client.0.smithi031.stdout:1/499: creat d4/d1e/d40/fa8 x:0 0 0 2024-09-17T01:52:05.325 INFO:tasks.workunit.client.0.smithi031.stdout:6/594: truncate d23/db4/d6a/d91/fb6 1024882 0 2024-09-17T01:52:05.328 INFO:tasks.workunit.client.0.smithi031.stdout:2/523: write d1/d3/d2d/db2/f1f [5019108,109370] 0 2024-09-17T01:52:05.330 INFO:tasks.workunit.client.0.smithi031.stdout:3/451: unlink ca 0 2024-09-17T01:52:05.331 INFO:tasks.workunit.client.0.smithi031.stdout:2/524: chown d1/d3/d45/d4a/f6d 1420541 1 2024-09-17T01:52:05.331 INFO:tasks.workunit.client.0.smithi031.stdout:4/638: link d8/d9c/fbc d8/fd2 0 2024-09-17T01:52:05.335 INFO:tasks.workunit.client.0.smithi031.stdout:8/414: unlink d0/f63 0 2024-09-17T01:52:05.336 INFO:tasks.workunit.client.0.smithi031.stdout:5/380: symlink da/d4b/l84 0 2024-09-17T01:52:05.340 INFO:tasks.workunit.client.0.smithi031.stdout:4/639: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fc3 4 1 2024-09-17T01:52:05.340 INFO:tasks.workunit.client.0.smithi031.stdout:6/595: dwrite d23/d63/d47/dc2/fa8 [0,4194304] 0 2024-09-17T01:52:05.341 INFO:tasks.workunit.client.0.smithi031.stdout:5/381: write da/dc/d2e/f4c [998234,37696] 0 2024-09-17T01:52:05.342 INFO:tasks.workunit.client.0.smithi031.stdout:6/596: chown d23/db4/d64/d67 4612455 1 2024-09-17T01:52:05.345 INFO:tasks.workunit.client.0.smithi031.stdout:4/640: write d8/d3a/d41/d64/d4d/d8f/f97 [178559,98477] 0 2024-09-17T01:52:05.345 INFO:tasks.workunit.client.0.smithi031.stdout:2/525: dwrite d1/d3/d2d/db2/f28 [0,4194304] 0 2024-09-17T01:52:05.347 INFO:tasks.workunit.client.0.smithi031.stdout:8/415: mknod d0/c7a 0 2024-09-17T01:52:05.347 INFO:tasks.workunit.client.0.smithi031.stdout:4/641: dread - d8/d3a/d41/d64/d4d/dae/fcb zero size 2024-09-17T01:52:05.354 INFO:tasks.workunit.client.0.smithi031.stdout:1/500: write d4/d1e/d3f/f60 [1056202,38173] 0 2024-09-17T01:52:05.354 INFO:tasks.workunit.client.0.smithi031.stdout:3/452: write db/df/d50/f51 [360780,100168] 0 2024-09-17T01:52:05.356 INFO:tasks.workunit.client.0.smithi031.stdout:2/526: dwrite d1/d3/d2d/db2/f28 [4194304,4194304] 0 2024-09-17T01:52:05.358 INFO:tasks.workunit.client.0.smithi031.stdout:5/382: fsync da/f58 0 2024-09-17T01:52:05.361 INFO:tasks.workunit.client.0.smithi031.stdout:1/501: write d4/f6a [546968,69032] 0 2024-09-17T01:52:05.366 INFO:tasks.workunit.client.0.smithi031.stdout:6/597: creat d23/fcf x:0 0 0 2024-09-17T01:52:05.367 INFO:tasks.workunit.client.0.smithi031.stdout:2/527: symlink d1/d3/df/d18/d40/lb8 0 2024-09-17T01:52:05.369 INFO:tasks.workunit.client.0.smithi031.stdout:5/383: mkdir da/dc/d25/d85 0 2024-09-17T01:52:05.369 INFO:tasks.workunit.client.0.smithi031.stdout:3/453: dwrite db/f42 [0,4194304] 0 2024-09-17T01:52:05.369 INFO:tasks.workunit.client.0.smithi031.stdout:6/598: chown d23/d63/d47/f60 502434588 1 2024-09-17T01:52:05.370 INFO:tasks.workunit.client.0.smithi031.stdout:6/599: chown d23/db4/d64/d67 442 1 2024-09-17T01:52:05.371 INFO:tasks.workunit.client.0.smithi031.stdout:1/502: creat d4/d1e/d3f/d72/d7e/fa9 x:0 0 0 2024-09-17T01:52:05.375 INFO:tasks.workunit.client.0.smithi031.stdout:2/528: write d1/d3/df/d11/f2f [1809268,43690] 0 2024-09-17T01:52:05.377 INFO:tasks.workunit.client.0.smithi031.stdout:1/503: unlink d4/f6a 0 2024-09-17T01:52:05.380 INFO:tasks.workunit.client.0.smithi031.stdout:8/416: dwrite d0/df/dd/f45 [0,4194304] 0 2024-09-17T01:52:05.382 INFO:tasks.workunit.client.0.smithi031.stdout:6/600: creat d23/db4/d6a/d70/fd0 x:0 0 0 2024-09-17T01:52:05.383 INFO:tasks.workunit.client.0.smithi031.stdout:1/504: mkdir d4/d1e/d40/daa 0 2024-09-17T01:52:05.384 INFO:tasks.workunit.client.0.smithi031.stdout:5/384: truncate da/d14/f1d 414689 0 2024-09-17T01:52:05.386 INFO:tasks.workunit.client.0.smithi031.stdout:8/417: symlink d0/df/dd/l7b 0 2024-09-17T01:52:05.389 INFO:tasks.workunit.client.0.smithi031.stdout:1/505: truncate d4/d1a/d2d/d18/f39 634426 0 2024-09-17T01:52:05.392 INFO:tasks.workunit.client.0.smithi031.stdout:8/418: unlink d0/df/dd/d59/f6e 0 2024-09-17T01:52:05.393 INFO:tasks.workunit.client.0.smithi031.stdout:8/419: stat d0/df 0 2024-09-17T01:52:05.396 INFO:tasks.workunit.client.0.smithi031.stdout:5/385: rmdir da/dc/d25/d85 0 2024-09-17T01:52:05.397 INFO:tasks.workunit.client.0.smithi031.stdout:5/386: dread - da/dc/d2e/d62/f78 zero size 2024-09-17T01:52:05.397 INFO:tasks.workunit.client.0.smithi031.stdout:8/420: symlink d0/df/dd/d59/l7c 0 2024-09-17T01:52:05.398 INFO:tasks.workunit.client.0.smithi031.stdout:8/421: chown d0/df/c4d 21 1 2024-09-17T01:52:05.401 INFO:tasks.workunit.client.0.smithi031.stdout:8/422: write d0/df/d19/d3d/f41 [1676220,57478] 0 2024-09-17T01:52:05.402 INFO:tasks.workunit.client.0.smithi031.stdout:4/642: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/f47 [0,4194304] 0 2024-09-17T01:52:05.406 INFO:tasks.workunit.client.0.smithi031.stdout:4/643: dread - d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f73 zero size 2024-09-17T01:52:05.408 INFO:tasks.workunit.client.0.smithi031.stdout:1/506: write d4/d1a/d2d/d18/f1b [904407,51343] 0 2024-09-17T01:52:05.411 INFO:tasks.workunit.client.0.smithi031.stdout:5/387: rename da/d42/d12/f63 to da/d42/d12/f86 0 2024-09-17T01:52:05.411 INFO:tasks.workunit.client.0.smithi031.stdout:1/507: chown d4/d1e/d40/d77/l87 1629 1 2024-09-17T01:52:05.413 INFO:tasks.workunit.client.0.smithi031.stdout:1/508: stat d4/d1e/d40/d84 0 2024-09-17T01:52:05.413 INFO:tasks.workunit.client.0.smithi031.stdout:6/601: dwrite d23/d63/d47/f6f [0,4194304] 0 2024-09-17T01:52:05.415 INFO:tasks.workunit.client.0.smithi031.stdout:8/423: getdents d0/d5/d6c/d6d 0 2024-09-17T01:52:05.418 INFO:tasks.workunit.client.0.smithi031.stdout:5/388: creat da/d4b/d6c/f87 x:0 0 0 2024-09-17T01:52:05.422 INFO:tasks.workunit.client.0.smithi031.stdout:6/602: mkdir d23/dd1 0 2024-09-17T01:52:05.423 INFO:tasks.workunit.client.0.smithi031.stdout:5/389: creat da/d42/d12/d72/f88 x:0 0 0 2024-09-17T01:52:05.424 INFO:tasks.workunit.client.0.smithi031.stdout:8/424: creat d0/d5/f7d x:0 0 0 2024-09-17T01:52:05.425 INFO:tasks.workunit.client.0.smithi031.stdout:6/603: symlink d23/db4/ld2 0 2024-09-17T01:52:05.426 INFO:tasks.workunit.client.0.smithi031.stdout:5/390: creat da/d14/f89 x:0 0 0 2024-09-17T01:52:05.429 INFO:tasks.workunit.client.0.smithi031.stdout:8/425: dread d0/f42 [0,4194304] 0 2024-09-17T01:52:05.429 INFO:tasks.workunit.client.0.smithi031.stdout:5/391: rename da/d14/c17 to da/d14/c8a 0 2024-09-17T01:52:05.433 INFO:tasks.workunit.client.0.smithi031.stdout:5/392: creat da/dc/d2e/d82/f8b x:0 0 0 2024-09-17T01:52:05.437 INFO:tasks.workunit.client.0.smithi031.stdout:5/393: creat da/d42/f8c x:0 0 0 2024-09-17T01:52:05.441 INFO:tasks.workunit.client.0.smithi031.stdout:8/426: dread d0/df/dd/f2d [0,4194304] 0 2024-09-17T01:52:05.442 INFO:tasks.workunit.client.0.smithi031.stdout:5/394: rmdir da/dc/d25/d81 0 2024-09-17T01:52:05.444 INFO:tasks.workunit.client.0.smithi031.stdout:5/395: symlink da/d4b/l8d 0 2024-09-17T01:52:05.445 INFO:tasks.workunit.client.0.smithi031.stdout:8/427: symlink d0/d5/d54/d60/l7e 0 2024-09-17T01:52:05.446 INFO:tasks.workunit.client.0.smithi031.stdout:5/396: dread da/d42/d26/f45 [0,4194304] 0 2024-09-17T01:52:05.448 INFO:tasks.workunit.client.0.smithi031.stdout:5/397: symlink da/l8e 0 2024-09-17T01:52:05.449 INFO:tasks.workunit.client.0.smithi031.stdout:8/428: dread d0/f42 [0,4194304] 0 2024-09-17T01:52:05.450 INFO:tasks.workunit.client.0.smithi031.stdout:5/398: symlink da/dc/l8f 0 2024-09-17T01:52:05.451 INFO:tasks.workunit.client.0.smithi031.stdout:5/399: fsync da/d4b/f4d 0 2024-09-17T01:52:05.451 INFO:tasks.workunit.client.0.smithi031.stdout:8/429: creat d0/df/dd/d77/d78/f7f x:0 0 0 2024-09-17T01:52:05.461 INFO:tasks.workunit.client.0.smithi031.stdout:8/430: dwrite d0/df/f65 [0,4194304] 0 2024-09-17T01:52:05.468 INFO:tasks.workunit.client.0.smithi031.stdout:8/431: dwrite d0/d5/d54/d60/f66 [0,4194304] 0 2024-09-17T01:52:05.479 INFO:tasks.workunit.client.0.smithi031.stdout:8/432: write d0/df/f46 [228574,87408] 0 2024-09-17T01:52:05.480 INFO:tasks.workunit.client.0.smithi031.stdout:8/433: fsync d0/df/dd/f45 0 2024-09-17T01:52:05.482 INFO:tasks.workunit.client.0.smithi031.stdout:8/434: rename d0/df/dd/f2d to d0/d5/d54/d60/f80 0 2024-09-17T01:52:05.484 INFO:tasks.workunit.client.0.smithi031.stdout:8/435: symlink d0/df/dd/d77/l81 0 2024-09-17T01:52:05.487 INFO:tasks.workunit.client.0.smithi031.stdout:8/436: getdents d0/d5/d54 0 2024-09-17T01:52:05.487 INFO:tasks.workunit.client.0.smithi031.stdout:8/437: dread - d0/d5/d54/d60/f57 zero size 2024-09-17T01:52:05.489 INFO:tasks.workunit.client.0.smithi031.stdout:8/438: write d0/df/d19/d3d/f49 [3337184,122946] 0 2024-09-17T01:52:05.490 INFO:tasks.workunit.client.0.smithi031.stdout:8/439: truncate d0/df/dd/f51 4302060 0 2024-09-17T01:52:05.492 INFO:tasks.workunit.client.1.smithi092.stdout:3/268: sync 2024-09-17T01:52:05.493 INFO:tasks.workunit.client.0.smithi031.stdout:8/440: rename d0/df/l1c to d0/d5/d54/l82 0 2024-09-17T01:52:05.494 INFO:tasks.workunit.client.0.smithi031.stdout:8/441: mknod d0/df/d19/d3d/c83 0 2024-09-17T01:52:05.505 INFO:tasks.workunit.client.1.smithi092.stdout:3/269: dread d4/d16/f24 [4194304,4194304] 0 2024-09-17T01:52:05.510 INFO:tasks.workunit.client.1.smithi092.stdout:3/270: link d4/d20/d3f/f5a d4/d16/d1b/d4b/f5c 0 2024-09-17T01:52:05.512 INFO:tasks.workunit.client.1.smithi092.stdout:3/271: symlink d4/d20/d39/l5d 0 2024-09-17T01:52:05.512 INFO:tasks.workunit.client.1.smithi092.stdout:3/272: readlink d4/d2f/d44/d3c/l51 0 2024-09-17T01:52:05.514 INFO:tasks.workunit.client.1.smithi092.stdout:3/273: creat d4/d20/d39/f5e x:0 0 0 2024-09-17T01:52:05.519 INFO:tasks.workunit.client.1.smithi092.stdout:1/435: sync 2024-09-17T01:52:05.519 INFO:tasks.workunit.client.1.smithi092.stdout:5/229: sync 2024-09-17T01:52:05.519 INFO:tasks.workunit.client.1.smithi092.stdout:6/312: sync 2024-09-17T01:52:05.519 INFO:tasks.workunit.client.1.smithi092.stdout:7/349: sync 2024-09-17T01:52:05.519 INFO:tasks.workunit.client.1.smithi092.stdout:4/346: sync 2024-09-17T01:52:05.519 INFO:tasks.workunit.client.1.smithi092.stdout:9/282: sync 2024-09-17T01:52:05.520 INFO:tasks.workunit.client.1.smithi092.stdout:8/280: sync 2024-09-17T01:52:05.520 INFO:tasks.workunit.client.1.smithi092.stdout:0/366: sync 2024-09-17T01:52:05.520 INFO:tasks.workunit.client.1.smithi092.stdout:2/260: sync 2024-09-17T01:52:05.520 INFO:tasks.workunit.client.1.smithi092.stdout:6/313: stat d3/d10/d1f/d21 0 2024-09-17T01:52:05.522 INFO:tasks.workunit.client.1.smithi092.stdout:1/436: truncate db/d6c/d7e/f84 179529 0 2024-09-17T01:52:05.522 INFO:tasks.workunit.client.1.smithi092.stdout:7/350: truncate d3/d6/d13/d21/f38 1613217 0 2024-09-17T01:52:05.523 INFO:tasks.workunit.client.1.smithi092.stdout:0/367: chown d3/da/d1c/l34 0 1 2024-09-17T01:52:05.523 INFO:tasks.workunit.client.1.smithi092.stdout:7/351: chown d3/d6/d13/d40/f55 172355 1 2024-09-17T01:52:05.525 INFO:tasks.workunit.client.1.smithi092.stdout:9/283: rmdir d0/d5 39 2024-09-17T01:52:05.526 INFO:tasks.workunit.client.1.smithi092.stdout:8/281: symlink d15/d25/d2b/l54 0 2024-09-17T01:52:05.527 INFO:tasks.workunit.client.1.smithi092.stdout:8/282: readlink d15/l20 0 2024-09-17T01:52:05.528 INFO:tasks.workunit.client.1.smithi092.stdout:4/347: write d4/d5/f70 [436223,13938] 0 2024-09-17T01:52:05.530 INFO:tasks.workunit.client.1.smithi092.stdout:6/314: chown d3/f5 57814 1 2024-09-17T01:52:05.531 INFO:tasks.workunit.client.1.smithi092.stdout:4/348: write d4/d13/f2b [2215332,13136] 0 2024-09-17T01:52:05.533 INFO:tasks.workunit.client.1.smithi092.stdout:6/315: dread - d3/d10/d1a/d43/f4a zero size 2024-09-17T01:52:05.533 INFO:tasks.workunit.client.1.smithi092.stdout:7/352: dread d3/d6/d13/f34 [0,4194304] 0 2024-09-17T01:52:05.540 INFO:tasks.workunit.client.1.smithi092.stdout:7/353: dread d3/d6/f1c [0,4194304] 0 2024-09-17T01:52:05.541 INFO:tasks.workunit.client.1.smithi092.stdout:5/230: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:05.541 INFO:tasks.workunit.client.1.smithi092.stdout:9/284: chown d0/d7/d12/d34/d20/f4f 24 1 2024-09-17T01:52:05.545 INFO:tasks.workunit.client.1.smithi092.stdout:3/274: rename d4/d16/d1b/d4b to d4/d13/d2e/d5f 0 2024-09-17T01:52:05.547 INFO:tasks.workunit.client.1.smithi092.stdout:2/261: link d10/d1d/d2d/f34 d10/d1d/d2c/f57 0 2024-09-17T01:52:05.548 INFO:tasks.workunit.client.1.smithi092.stdout:7/354: symlink d3/d6/d13/d40/l7a 0 2024-09-17T01:52:05.550 INFO:tasks.workunit.client.1.smithi092.stdout:3/275: write d4/d2f/d44/d3c/f45 [211714,71923] 0 2024-09-17T01:52:05.551 INFO:tasks.workunit.client.1.smithi092.stdout:0/368: dwrite d3/d2e/d3b/f56 [0,4194304] 0 2024-09-17T01:52:05.552 INFO:tasks.workunit.client.1.smithi092.stdout:5/231: rename d0/de/d19/d1a/d1e/d3e/d46 to d0/de/d19/d1a/d1e/d3e/d4c 0 2024-09-17T01:52:05.554 INFO:tasks.workunit.client.1.smithi092.stdout:4/349: creat d4/d5/f79 x:0 0 0 2024-09-17T01:52:05.559 INFO:tasks.workunit.client.1.smithi092.stdout:7/355: mkdir d3/db/d7b 0 2024-09-17T01:52:05.561 INFO:tasks.workunit.client.1.smithi092.stdout:4/350: mkdir d4/d5/d1d/d30/d7a 0 2024-09-17T01:52:05.563 INFO:tasks.workunit.client.1.smithi092.stdout:8/283: rename d15/d25/f33 to d15/d32/d40/d42/f55 0 2024-09-17T01:52:05.564 INFO:tasks.workunit.client.1.smithi092.stdout:7/356: write d3/d6/d13/d40/f6c [665807,46521] 0 2024-09-17T01:52:05.565 INFO:tasks.workunit.client.1.smithi092.stdout:0/369: dwrite d3/f5 [4194304,4194304] 0 2024-09-17T01:52:05.565 INFO:tasks.workunit.client.1.smithi092.stdout:9/285: creat d0/df/d17/f51 x:0 0 0 2024-09-17T01:52:05.565 INFO:tasks.workunit.client.1.smithi092.stdout:4/351: read - d4/d5/f33 zero size 2024-09-17T01:52:05.566 INFO:tasks.workunit.client.1.smithi092.stdout:8/284: chown d15/d25 530260 1 2024-09-17T01:52:05.567 INFO:tasks.workunit.client.1.smithi092.stdout:3/276: creat d4/f60 x:0 0 0 2024-09-17T01:52:05.568 INFO:tasks.workunit.client.1.smithi092.stdout:7/357: readlink d3/d6/l5d 0 2024-09-17T01:52:05.570 INFO:tasks.workunit.client.1.smithi092.stdout:5/232: dwrite d0/de/d19/d1a/d1e/f12 [0,4194304] 0 2024-09-17T01:52:05.571 INFO:tasks.workunit.client.1.smithi092.stdout:6/316: truncate d3/d10/d1f/d21/d28/f2f 35102 0 2024-09-17T01:52:05.574 INFO:tasks.workunit.client.1.smithi092.stdout:4/352: write d4/d13/d3b/d42/d76/d41/d67/f69 [14502,74016] 0 2024-09-17T01:52:05.574 INFO:tasks.workunit.client.1.smithi092.stdout:2/262: rename d10/c11 to d10/d1d/d2d/c58 0 2024-09-17T01:52:05.575 INFO:tasks.workunit.client.1.smithi092.stdout:9/286: dread d0/df/f47 [0,4194304] 0 2024-09-17T01:52:05.576 INFO:tasks.workunit.client.1.smithi092.stdout:6/317: readlink d3/d10/d1f/d21/d28/l37 0 2024-09-17T01:52:05.577 INFO:tasks.workunit.client.1.smithi092.stdout:0/370: dread d3/da/d1c/f49 [0,4194304] 0 2024-09-17T01:52:05.577 INFO:tasks.workunit.client.1.smithi092.stdout:7/358: symlink d3/d6/d13/d21/d2e/l7c 0 2024-09-17T01:52:05.579 INFO:tasks.workunit.client.1.smithi092.stdout:6/318: write d3/f5 [1265914,119046] 0 2024-09-17T01:52:05.581 INFO:tasks.workunit.client.1.smithi092.stdout:7/359: chown d3/d6/d13/d40/c50 4038 1 2024-09-17T01:52:05.582 INFO:tasks.workunit.client.1.smithi092.stdout:5/233: rename d0/de/d19/d1a/d1e/f42 to d0/d23/f4d 0 2024-09-17T01:52:05.585 INFO:tasks.workunit.client.1.smithi092.stdout:8/285: creat d15/d48/f56 x:0 0 0 2024-09-17T01:52:05.585 INFO:tasks.workunit.client.1.smithi092.stdout:7/360: chown d3/d6/d13/d21/d2e/c48 13558192 1 2024-09-17T01:52:05.587 INFO:tasks.workunit.client.1.smithi092.stdout:2/263: unlink d10/d3a/f4a 0 2024-09-17T01:52:05.587 INFO:tasks.workunit.client.1.smithi092.stdout:5/234: chown d0/de/d19/d1a/d1e/d3e/c44 1 1 2024-09-17T01:52:05.588 INFO:tasks.workunit.client.1.smithi092.stdout:9/287: dwrite d0/d7/d12/d34/d20/d2e/f41 [0,4194304] 0 2024-09-17T01:52:05.589 INFO:tasks.workunit.client.1.smithi092.stdout:9/288: stat d0/df/f3c 0 2024-09-17T01:52:05.590 INFO:tasks.workunit.client.1.smithi092.stdout:0/371: creat d3/d2e/d55/f70 x:0 0 0 2024-09-17T01:52:05.592 INFO:tasks.workunit.client.1.smithi092.stdout:3/277: creat d4/f61 x:0 0 0 2024-09-17T01:52:05.597 INFO:tasks.workunit.client.1.smithi092.stdout:3/278: read d4/d20/f33 [8259532,47661] 0 2024-09-17T01:52:05.604 INFO:tasks.workunit.client.1.smithi092.stdout:7/361: dwrite d3/db/d26/f66 [4194304,4194304] 0 2024-09-17T01:52:05.606 INFO:tasks.workunit.client.1.smithi092.stdout:0/372: unlink d3/d2e/d3b/f56 0 2024-09-17T01:52:05.608 INFO:tasks.workunit.client.1.smithi092.stdout:8/286: symlink d15/d32/d40/l57 0 2024-09-17T01:52:05.609 INFO:tasks.workunit.client.1.smithi092.stdout:2/264: dwrite d10/d3a/f3f [0,4194304] 0 2024-09-17T01:52:05.611 INFO:tasks.workunit.client.1.smithi092.stdout:5/235: dread d0/de/d19/d1a/d1e/f1d [0,4194304] 0 2024-09-17T01:52:05.615 INFO:tasks.workunit.client.1.smithi092.stdout:9/289: creat d0/d5/d29/f52 x:0 0 0 2024-09-17T01:52:05.616 INFO:tasks.workunit.client.1.smithi092.stdout:3/279: rmdir d4/d2f/d44 39 2024-09-17T01:52:05.622 INFO:tasks.workunit.client.1.smithi092.stdout:2/265: rmdir d10/d15 39 2024-09-17T01:52:05.624 INFO:tasks.workunit.client.1.smithi092.stdout:9/290: dwrite d0/d7/d12/d34/d20/f24 [0,4194304] 0 2024-09-17T01:52:05.624 INFO:tasks.workunit.client.1.smithi092.stdout:8/287: symlink d15/d25/d2b/d3d/l58 0 2024-09-17T01:52:05.627 INFO:tasks.workunit.client.1.smithi092.stdout:5/236: unlink d0/de/f21 0 2024-09-17T01:52:05.630 INFO:tasks.workunit.client.1.smithi092.stdout:3/280: fdatasync d4/d2f/d44/d3c/f3e 0 2024-09-17T01:52:05.630 INFO:tasks.workunit.client.1.smithi092.stdout:0/373: mknod d3/d58/c71 0 2024-09-17T01:52:05.631 INFO:tasks.workunit.client.1.smithi092.stdout:3/281: chown l2 8855231 1 2024-09-17T01:52:05.632 INFO:tasks.workunit.client.1.smithi092.stdout:2/266: read - d10/d15/f47 zero size 2024-09-17T01:52:05.633 INFO:tasks.workunit.client.1.smithi092.stdout:5/237: creat d0/de/d19/d1a/d1e/f4e x:0 0 0 2024-09-17T01:52:05.634 INFO:tasks.workunit.client.1.smithi092.stdout:7/362: dwrite d3/d6/d13/d21/d2e/d6e/f2c [0,4194304] 0 2024-09-17T01:52:05.636 INFO:tasks.workunit.client.1.smithi092.stdout:9/291: symlink d0/df/l53 0 2024-09-17T01:52:05.637 INFO:tasks.workunit.client.1.smithi092.stdout:3/282: creat d4/d13/d2e/d5f/f62 x:0 0 0 2024-09-17T01:52:05.639 INFO:tasks.workunit.client.1.smithi092.stdout:2/267: symlink d10/d3a/l59 0 2024-09-17T01:52:05.640 INFO:tasks.workunit.client.1.smithi092.stdout:7/363: fdatasync d3/db/d26/f3b 0 2024-09-17T01:52:05.641 INFO:tasks.workunit.client.1.smithi092.stdout:9/292: write d0/df/d17/f38 [371908,55961] 0 2024-09-17T01:52:05.643 INFO:tasks.workunit.client.1.smithi092.stdout:3/283: creat d4/d13/f63 x:0 0 0 2024-09-17T01:52:05.644 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:05 smithi092 ceph-mon[33552]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 142 MiB/s wr, 261 op/s 2024-09-17T01:52:05.645 INFO:tasks.workunit.client.1.smithi092.stdout:2/268: mkdir d10/d1d/d2c/d5a 0 2024-09-17T01:52:05.645 INFO:tasks.workunit.client.1.smithi092.stdout:7/364: creat d3/d6/d13/f7d x:0 0 0 2024-09-17T01:52:05.646 INFO:tasks.workunit.client.1.smithi092.stdout:3/284: chown d4/d2f/d44/d3c/f3e 1 1 2024-09-17T01:52:05.647 INFO:tasks.workunit.client.1.smithi092.stdout:0/374: dread d3/f7 [0,4194304] 0 2024-09-17T01:52:05.650 INFO:tasks.workunit.client.1.smithi092.stdout:3/285: fsync d4/d20/d39/f4a 0 2024-09-17T01:52:05.651 INFO:tasks.workunit.client.1.smithi092.stdout:5/238: dwrite d0/de/d19/d1a/d1e/d3e/d4c/f49 [0,4194304] 0 2024-09-17T01:52:05.652 INFO:tasks.workunit.client.1.smithi092.stdout:7/365: write d3/d6/d13/f34 [2057591,117417] 0 2024-09-17T01:52:05.653 INFO:tasks.workunit.client.1.smithi092.stdout:7/366: stat d3/c56 0 2024-09-17T01:52:05.657 INFO:tasks.workunit.client.1.smithi092.stdout:9/293: rename d0/d7/d12/d34/d20 to d0/d7/d12/d34/d26/d54 0 2024-09-17T01:52:05.658 INFO:tasks.workunit.client.1.smithi092.stdout:3/286: unlink d4/d16/d1b/f29 0 2024-09-17T01:52:05.663 INFO:tasks.workunit.client.1.smithi092.stdout:5/239: mknod d0/de/d19/d1a/d24/c4f 0 2024-09-17T01:52:05.665 INFO:tasks.workunit.client.0.smithi031.stdout:7/426: sync 2024-09-17T01:52:05.665 INFO:tasks.workunit.client.1.smithi092.stdout:9/294: creat d0/d5/d29/f55 x:0 0 0 2024-09-17T01:52:05.667 INFO:tasks.workunit.client.1.smithi092.stdout:2/269: getdents d10 0 2024-09-17T01:52:05.668 INFO:tasks.workunit.client.1.smithi092.stdout:3/287: truncate d4/d13/d2e/f3b 219680 0 2024-09-17T01:52:05.669 INFO:tasks.workunit.client.1.smithi092.stdout:5/240: dread d0/de/d19/d1a/f25 [0,4194304] 0 2024-09-17T01:52:05.670 INFO:tasks.workunit.client.1.smithi092.stdout:0/375: truncate d3/da/d15/f19 1483944 0 2024-09-17T01:52:05.670 INFO:tasks.workunit.client.1.smithi092.stdout:5/241: stat d0/de/d19/d1a/d1e/f12 0 2024-09-17T01:52:05.673 INFO:tasks.workunit.client.1.smithi092.stdout:5/242: read d0/de/d19/d1a/f25 [2502850,75575] 0 2024-09-17T01:52:05.674 INFO:tasks.workunit.client.1.smithi092.stdout:9/295: creat d0/d7/d12/d34/f56 x:0 0 0 2024-09-17T01:52:05.676 INFO:tasks.workunit.client.1.smithi092.stdout:5/243: chown d0/de/d19/d1a/d1e/d3e/c44 13679448 1 2024-09-17T01:52:05.676 INFO:tasks.workunit.client.1.smithi092.stdout:3/288: stat d4/d2f/d44/c2c 0 2024-09-17T01:52:05.677 INFO:tasks.workunit.client.1.smithi092.stdout:3/289: stat d4/d20/d31 0 2024-09-17T01:52:05.677 INFO:tasks.workunit.client.1.smithi092.stdout:0/376: mkdir d3/d2e/d3b/d72 0 2024-09-17T01:52:05.678 INFO:tasks.workunit.client.1.smithi092.stdout:0/377: stat d3/da/d1c/f49 0 2024-09-17T01:52:05.680 INFO:tasks.workunit.client.1.smithi092.stdout:2/270: dread d10/d1d/d24/f29 [0,4194304] 0 2024-09-17T01:52:05.681 INFO:tasks.workunit.client.1.smithi092.stdout:9/296: unlink d0/d7/d12/d34/f2d 0 2024-09-17T01:52:05.682 INFO:tasks.workunit.client.1.smithi092.stdout:5/244: dread d0/d23/f2c [0,4194304] 0 2024-09-17T01:52:05.683 INFO:tasks.workunit.client.1.smithi092.stdout:5/245: fdatasync d0/de/d19/f1f 0 2024-09-17T01:52:05.685 INFO:tasks.workunit.client.1.smithi092.stdout:9/297: write d0/d7/d12/d34/d26/d54/f4f [845361,59676] 0 2024-09-17T01:52:05.686 INFO:tasks.workunit.client.1.smithi092.stdout:8/288: dread d15/f1e [4194304,4194304] 0 2024-09-17T01:52:05.686 INFO:tasks.workunit.client.1.smithi092.stdout:9/298: fdatasync d0/df/d17/f51 0 2024-09-17T01:52:05.688 INFO:tasks.workunit.client.1.smithi092.stdout:0/378: mkdir d3/d73 0 2024-09-17T01:52:05.689 INFO:tasks.workunit.client.1.smithi092.stdout:5/246: mkdir d0/d50 0 2024-09-17T01:52:05.692 INFO:tasks.workunit.client.1.smithi092.stdout:9/299: chown d0/d5/l4b 5576 1 2024-09-17T01:52:05.692 INFO:tasks.workunit.client.1.smithi092.stdout:9/300: chown d0/d7/d21 810953906 1 2024-09-17T01:52:05.693 INFO:tasks.workunit.client.1.smithi092.stdout:0/379: creat d3/d2e/d3b/f74 x:0 0 0 2024-09-17T01:52:05.694 INFO:tasks.workunit.client.1.smithi092.stdout:5/247: symlink d0/de/d19/d1a/d1e/d3e/d4c/l51 0 2024-09-17T01:52:05.697 INFO:tasks.workunit.client.1.smithi092.stdout:5/248: chown d0/de/d19/c3f 169628532 1 2024-09-17T01:52:05.697 INFO:tasks.workunit.client.1.smithi092.stdout:3/290: getdents d4/d13 0 2024-09-17T01:52:05.698 INFO:tasks.workunit.client.1.smithi092.stdout:7/367: write d3/f4b [866962,32468] 0 2024-09-17T01:52:05.702 INFO:tasks.workunit.client.1.smithi092.stdout:5/249: mkdir d0/de/d19/d1a/d1e/d52 0 2024-09-17T01:52:05.704 INFO:tasks.workunit.client.1.smithi092.stdout:8/289: rename d15/d25/d2b/f31 to d15/d32/f59 0 2024-09-17T01:52:05.705 INFO:tasks.workunit.client.1.smithi092.stdout:8/290: chown c10 337115070 1 2024-09-17T01:52:05.706 INFO:tasks.workunit.client.1.smithi092.stdout:9/301: mknod d0/d7/c57 0 2024-09-17T01:52:05.709 INFO:tasks.workunit.client.1.smithi092.stdout:7/368: mknod d3/d2b/d3a/c7e 0 2024-09-17T01:52:05.713 INFO:tasks.workunit.client.1.smithi092.stdout:8/291: rmdir d15/d32/d40/d42/d43 39 2024-09-17T01:52:05.717 INFO:tasks.workunit.client.1.smithi092.stdout:0/380: dread d3/da/f22 [0,4194304] 0 2024-09-17T01:52:05.717 INFO:tasks.workunit.client.1.smithi092.stdout:9/302: mkdir d0/d7/d12/d34/d26/d54/d58 0 2024-09-17T01:52:05.719 INFO:tasks.workunit.client.1.smithi092.stdout:7/369: dwrite d3/db/d26/f72 [0,4194304] 0 2024-09-17T01:52:05.719 INFO:tasks.workunit.client.1.smithi092.stdout:8/292: creat d15/d25/f5a x:0 0 0 2024-09-17T01:52:05.720 INFO:tasks.workunit.client.1.smithi092.stdout:5/250: dread d0/fd [0,4194304] 0 2024-09-17T01:52:05.721 INFO:tasks.workunit.client.1.smithi092.stdout:8/293: write d15/d48/f56 [318624,87545] 0 2024-09-17T01:52:05.726 INFO:tasks.workunit.client.1.smithi092.stdout:9/303: unlink d0/d7/f23 0 2024-09-17T01:52:05.727 INFO:tasks.workunit.client.1.smithi092.stdout:5/251: creat d0/f53 x:0 0 0 2024-09-17T01:52:05.729 INFO:tasks.workunit.client.1.smithi092.stdout:5/252: truncate d0/d23/f48 467002 0 2024-09-17T01:52:05.730 INFO:tasks.workunit.client.1.smithi092.stdout:0/381: creat d3/d73/f75 x:0 0 0 2024-09-17T01:52:05.730 INFO:tasks.workunit.client.1.smithi092.stdout:5/253: write d0/de/f11 [3370720,9397] 0 2024-09-17T01:52:05.731 INFO:tasks.workunit.client.1.smithi092.stdout:3/291: truncate d4/d2f/f4f 3142 0 2024-09-17T01:52:05.734 INFO:tasks.workunit.client.0.smithi031.stdout:0/474: sync 2024-09-17T01:52:05.734 INFO:tasks.workunit.client.0.smithi031.stdout:4/644: sync 2024-09-17T01:52:05.734 INFO:tasks.workunit.client.0.smithi031.stdout:9/389: sync 2024-09-17T01:52:05.734 INFO:tasks.workunit.client.0.smithi031.stdout:5/400: sync 2024-09-17T01:52:05.734 INFO:tasks.workunit.client.0.smithi031.stdout:6/604: sync 2024-09-17T01:52:05.735 INFO:tasks.workunit.client.0.smithi031.stdout:3/454: sync 2024-09-17T01:52:05.735 INFO:tasks.workunit.client.0.smithi031.stdout:1/509: sync 2024-09-17T01:52:05.735 INFO:tasks.workunit.client.0.smithi031.stdout:2/529: sync 2024-09-17T01:52:05.735 INFO:tasks.workunit.client.0.smithi031.stdout:8/442: sync 2024-09-17T01:52:05.735 INFO:tasks.workunit.client.1.smithi092.stdout:0/382: rmdir d3/d58 39 2024-09-17T01:52:05.735 INFO:tasks.workunit.client.0.smithi031.stdout:5/401: chown da/dc 7 1 2024-09-17T01:52:05.738 INFO:tasks.workunit.client.0.smithi031.stdout:6/605: rmdir d23/d63/d47 39 2024-09-17T01:52:05.740 INFO:tasks.workunit.client.1.smithi092.stdout:5/254: unlink d0/de/d19/d1a/l39 0 2024-09-17T01:52:05.742 INFO:tasks.workunit.client.0.smithi031.stdout:1/510: symlink d4/d1e/d3f/d72/lab 0 2024-09-17T01:52:05.742 INFO:tasks.workunit.client.1.smithi092.stdout:9/304: creat d0/f59 x:0 0 0 2024-09-17T01:52:05.742 INFO:tasks.workunit.client.0.smithi031.stdout:1/511: stat d4/d1e/d3f/d72/d7e 0 2024-09-17T01:52:05.743 INFO:tasks.workunit.client.1.smithi092.stdout:0/383: mkdir d3/d2e/d3b/d48/d76 0 2024-09-17T01:52:05.744 INFO:tasks.workunit.client.0.smithi031.stdout:3/455: mknod db/df/d1d/d37/d6c/c87 0 2024-09-17T01:52:05.744 INFO:tasks.workunit.client.1.smithi092.stdout:3/292: dwrite d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T01:52:05.745 INFO:tasks.workunit.client.0.smithi031.stdout:5/402: chown da/dc/c36 1115179 1 2024-09-17T01:52:05.746 INFO:tasks.workunit.client.1.smithi092.stdout:3/293: chown d4/f28 4717498 1 2024-09-17T01:52:05.747 INFO:tasks.workunit.client.1.smithi092.stdout:3/294: dread - d4/d20/f42 zero size 2024-09-17T01:52:05.747 INFO:tasks.workunit.client.1.smithi092.stdout:9/305: truncate d0/df/d17/f1c 4587290 0 2024-09-17T01:52:05.748 INFO:tasks.workunit.client.0.smithi031.stdout:2/530: mknod d1/d3/d2d/db2/d1e/d21/d34/cb9 0 2024-09-17T01:52:05.748 INFO:tasks.workunit.client.1.smithi092.stdout:5/255: symlink d0/de/d19/d1a/d1e/d3e/d4c/l54 0 2024-09-17T01:52:05.750 INFO:tasks.workunit.client.0.smithi031.stdout:0/475: write d0/d29/d33/f75 [536220,40922] 0 2024-09-17T01:52:05.751 INFO:tasks.workunit.client.0.smithi031.stdout:9/390: dread d3/d10/d36/f6e [0,4194304] 0 2024-09-17T01:52:05.752 INFO:tasks.workunit.client.1.smithi092.stdout:9/306: dread - d0/d7/d12/d34/f3a zero size 2024-09-17T01:52:05.752 INFO:tasks.workunit.client.0.smithi031.stdout:9/391: readlink d3/d19/d1f/l75 0 2024-09-17T01:52:05.752 INFO:tasks.workunit.client.1.smithi092.stdout:7/370: dread d3/db/d26/d6f/f79 [0,4194304] 0 2024-09-17T01:52:05.753 INFO:tasks.workunit.client.0.smithi031.stdout:9/392: write d3/d19/f65 [3079786,24627] 0 2024-09-17T01:52:05.754 INFO:tasks.workunit.client.1.smithi092.stdout:8/294: write d15/d25/d27/f3e [3079914,29883] 0 2024-09-17T01:52:05.756 INFO:tasks.workunit.client.1.smithi092.stdout:3/295: creat d4/d16/d1b/f64 x:0 0 0 2024-09-17T01:52:05.757 INFO:tasks.workunit.client.1.smithi092.stdout:8/295: chown d15/d48 474311425 1 2024-09-17T01:52:05.757 INFO:tasks.workunit.client.0.smithi031.stdout:5/403: rename da/d14/c18 to da/d4b/d6c/c90 0 2024-09-17T01:52:05.759 INFO:tasks.workunit.client.1.smithi092.stdout:0/384: dwrite d3/d2e/d55/f67 [0,4194304] 0 2024-09-17T01:52:05.759 INFO:tasks.workunit.client.0.smithi031.stdout:0/476: rmdir d0/d29/d33/d2a/d25/d38 39 2024-09-17T01:52:05.760 INFO:tasks.workunit.client.1.smithi092.stdout:5/256: dread d0/d23/f27 [0,4194304] 0 2024-09-17T01:52:05.761 INFO:tasks.workunit.client.0.smithi031.stdout:8/443: fsync d0/d5/d54/d60/f62 0 2024-09-17T01:52:05.762 INFO:tasks.workunit.client.0.smithi031.stdout:1/512: mkdir d4/dac 0 2024-09-17T01:52:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:05 smithi031 ceph-mon[27673]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 142 MiB/s wr, 261 op/s 2024-09-17T01:52:05.764 INFO:tasks.workunit.client.0.smithi031.stdout:9/393: rename d3/d19/d1f/d44/d64/c66 to d3/c7e 0 2024-09-17T01:52:05.768 INFO:tasks.workunit.client.1.smithi092.stdout:0/385: read d3/d2e/d55/f6a [2069314,78091] 0 2024-09-17T01:52:05.768 INFO:tasks.workunit.client.0.smithi031.stdout:4/645: truncate d8/d3a/d41/d64/f6c 1977241 0 2024-09-17T01:52:05.769 INFO:tasks.workunit.client.1.smithi092.stdout:8/296: symlink d15/d25/d2b/d3d/l5b 0 2024-09-17T01:52:05.769 INFO:tasks.workunit.client.0.smithi031.stdout:2/531: mknod d1/d3/df/d18/d40/cba 0 2024-09-17T01:52:05.770 INFO:tasks.workunit.client.1.smithi092.stdout:8/297: write d15/d48/f56 [151892,76794] 0 2024-09-17T01:52:05.772 INFO:tasks.workunit.client.1.smithi092.stdout:5/257: write d0/de/d19/d1a/d1e/f36 [612310,116309] 0 2024-09-17T01:52:05.772 INFO:tasks.workunit.client.1.smithi092.stdout:8/298: fsync d15/f1f 0 2024-09-17T01:52:05.773 INFO:tasks.workunit.client.0.smithi031.stdout:3/456: creat db/f88 x:0 0 0 2024-09-17T01:52:05.773 INFO:tasks.workunit.client.1.smithi092.stdout:7/371: fdatasync d3/fc 0 2024-09-17T01:52:05.774 INFO:tasks.workunit.client.0.smithi031.stdout:5/404: dwrite da/dc/f73 [0,4194304] 0 2024-09-17T01:52:05.775 INFO:tasks.workunit.client.0.smithi031.stdout:1/513: creat d4/d1a/d43/fad x:0 0 0 2024-09-17T01:52:05.777 INFO:tasks.workunit.client.0.smithi031.stdout:3/457: readlink db/df/d1c/l60 0 2024-09-17T01:52:05.777 INFO:tasks.workunit.client.0.smithi031.stdout:0/477: mkdir d0/d29/d33/d2a/d25/da5 0 2024-09-17T01:52:05.780 INFO:tasks.workunit.client.1.smithi092.stdout:0/386: dread d3/d2e/d55/d63/f6d [0,4194304] 0 2024-09-17T01:52:05.783 INFO:tasks.workunit.client.0.smithi031.stdout:5/405: symlink da/d4b/d6c/l91 0 2024-09-17T01:52:05.783 INFO:tasks.workunit.client.0.smithi031.stdout:7/427: sync 2024-09-17T01:52:05.783 INFO:tasks.workunit.client.0.smithi031.stdout:6/606: dwrite d23/db4/d6a/d70/db0/fb2 [0,4194304] 0 2024-09-17T01:52:05.784 INFO:tasks.workunit.client.1.smithi092.stdout:7/372: write d3/db/f4a [1500827,100155] 0 2024-09-17T01:52:05.786 INFO:tasks.workunit.client.1.smithi092.stdout:3/296: dwrite d4/d20/f32 [4194304,4194304] 0 2024-09-17T01:52:05.790 INFO:tasks.workunit.client.0.smithi031.stdout:8/444: creat d0/d5/d54/f84 x:0 0 0 2024-09-17T01:52:05.790 INFO:tasks.workunit.client.1.smithi092.stdout:9/307: chown d0/df/d17/f2f 31 1 2024-09-17T01:52:05.790 INFO:tasks.workunit.client.1.smithi092.stdout:7/373: write d3/d2b/d3a/f6b [126363,29129] 0 2024-09-17T01:52:05.790 INFO:tasks.workunit.client.1.smithi092.stdout:8/299: creat d15/d32/d40/d4c/f5c x:0 0 0 2024-09-17T01:52:05.793 INFO:tasks.workunit.client.0.smithi031.stdout:7/428: chown db/d1c/d41/d72 80 1 2024-09-17T01:52:05.793 INFO:tasks.workunit.client.1.smithi092.stdout:3/297: rename l2 to d4/d20/d39/l65 0 2024-09-17T01:52:05.793 INFO:tasks.workunit.client.1.smithi092.stdout:3/298: fdatasync d4/f28 0 2024-09-17T01:52:05.795 INFO:tasks.workunit.client.1.smithi092.stdout:5/258: rmdir d0/de/d19/d1a/d3b 0 2024-09-17T01:52:05.796 INFO:tasks.workunit.client.1.smithi092.stdout:9/308: mknod d0/d5/d29/c5a 0 2024-09-17T01:52:05.797 INFO:tasks.workunit.client.0.smithi031.stdout:6/607: fsync d23/db4/d6a/d72/f73 0 2024-09-17T01:52:05.800 INFO:tasks.workunit.client.0.smithi031.stdout:5/406: dread da/f58 [0,4194304] 0 2024-09-17T01:52:05.800 INFO:tasks.workunit.client.0.smithi031.stdout:2/532: link d1/d3/df/l36 d1/d3/d2d/db2/lbb 0 2024-09-17T01:52:05.800 INFO:tasks.workunit.client.1.smithi092.stdout:3/299: read d4/d2f/f4f [364,14867] 0 2024-09-17T01:52:05.801 INFO:tasks.workunit.client.0.smithi031.stdout:0/478: mknod d0/d29/d33/d2a/d25/da5/ca6 0 2024-09-17T01:52:05.801 INFO:tasks.workunit.client.1.smithi092.stdout:8/300: creat d15/d32/d3b/f5d x:0 0 0 2024-09-17T01:52:05.801 INFO:tasks.workunit.client.0.smithi031.stdout:2/533: dread - d1/d3/d2d/d42/f83 zero size 2024-09-17T01:52:05.802 INFO:tasks.workunit.client.1.smithi092.stdout:5/259: mknod d0/de/d19/c55 0 2024-09-17T01:52:05.802 INFO:tasks.workunit.client.0.smithi031.stdout:8/445: symlink d0/df/d19/d3d/l85 0 2024-09-17T01:52:05.803 INFO:tasks.workunit.client.0.smithi031.stdout:9/394: truncate d3/d19/d1f/f6d 4771251 0 2024-09-17T01:52:05.804 INFO:tasks.workunit.client.0.smithi031.stdout:7/429: mknod db/d1c/d41/d69/c7d 0 2024-09-17T01:52:05.806 INFO:tasks.workunit.client.0.smithi031.stdout:8/446: fdatasync d0/d5/d54/f84 0 2024-09-17T01:52:05.807 INFO:tasks.workunit.client.1.smithi092.stdout:8/301: unlink d15/d48/f56 0 2024-09-17T01:52:05.807 INFO:tasks.workunit.client.0.smithi031.stdout:9/395: readlink d3/d10/d71/l73 0 2024-09-17T01:52:05.808 INFO:tasks.workunit.client.1.smithi092.stdout:7/374: getdents d3/d6 0 2024-09-17T01:52:05.809 INFO:tasks.workunit.client.0.smithi031.stdout:1/514: write d4/d1a/d2d/f38 [73835,27289] 0 2024-09-17T01:52:05.809 INFO:tasks.workunit.client.1.smithi092.stdout:9/309: symlink d0/df/l5b 0 2024-09-17T01:52:05.809 INFO:tasks.workunit.client.1.smithi092.stdout:7/375: truncate d3/d6/d13/f7d 456469 0 2024-09-17T01:52:05.810 INFO:tasks.workunit.client.1.smithi092.stdout:5/260: symlink d0/de/d19/d1a/d1e/d3e/d4c/l56 0 2024-09-17T01:52:05.811 INFO:tasks.workunit.client.0.smithi031.stdout:5/407: dwrite da/d42/d12/d4a/f60 [0,4194304] 0 2024-09-17T01:52:05.811 INFO:tasks.workunit.client.1.smithi092.stdout:0/387: write d3/f7 [736641,25832] 0 2024-09-17T01:52:05.816 INFO:tasks.workunit.client.0.smithi031.stdout:4/646: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 [0,4194304] 0 2024-09-17T01:52:05.816 INFO:tasks.workunit.client.0.smithi031.stdout:3/458: link db/df/l18 db/df/d1d/d37/d65/l89 0 2024-09-17T01:52:05.817 INFO:tasks.workunit.client.1.smithi092.stdout:7/376: dwrite d3/d6/d13/d21/d2e/d6e/f41 [0,4194304] 0 2024-09-17T01:52:05.819 INFO:tasks.workunit.client.1.smithi092.stdout:5/261: mknod d0/c57 0 2024-09-17T01:52:05.819 INFO:tasks.workunit.client.0.smithi031.stdout:8/447: dwrite d0/d5/f43 [0,4194304] 0 2024-09-17T01:52:05.820 INFO:tasks.workunit.client.0.smithi031.stdout:9/396: creat d3/d4/f7f x:0 0 0 2024-09-17T01:52:05.820 INFO:tasks.workunit.client.1.smithi092.stdout:8/302: mknod d15/d32/d40/c5e 0 2024-09-17T01:52:05.827 INFO:tasks.workunit.client.0.smithi031.stdout:6/608: unlink d23/d63/d47/dc2/fa8 0 2024-09-17T01:52:05.829 INFO:tasks.workunit.client.1.smithi092.stdout:3/300: dwrite d4/d16/f24 [4194304,4194304] 0 2024-09-17T01:52:05.832 INFO:tasks.workunit.client.0.smithi031.stdout:5/408: mkdir da/dc/d2e/d82/d92 0 2024-09-17T01:52:05.832 INFO:tasks.workunit.client.0.smithi031.stdout:6/609: truncate d23/db4/d6a/d91/fbe 198415 0 2024-09-17T01:52:05.832 INFO:tasks.workunit.client.1.smithi092.stdout:0/388: creat d3/f77 x:0 0 0 2024-09-17T01:52:05.833 INFO:tasks.workunit.client.1.smithi092.stdout:8/303: dwrite d15/f1a [0,4194304] 0 2024-09-17T01:52:05.833 INFO:tasks.workunit.client.1.smithi092.stdout:3/301: stat d4/d2f/f53 0 2024-09-17T01:52:05.834 INFO:tasks.workunit.client.0.smithi031.stdout:3/459: stat db/df/f23 0 2024-09-17T01:52:05.835 INFO:tasks.workunit.client.1.smithi092.stdout:3/302: read - d4/d16/d1b/f47 zero size 2024-09-17T01:52:05.835 INFO:tasks.workunit.client.0.smithi031.stdout:3/460: fsync db/f6b 0 2024-09-17T01:52:05.836 INFO:tasks.workunit.client.0.smithi031.stdout:8/448: rmdir d0/df/dd/d59 39 2024-09-17T01:52:05.838 INFO:tasks.workunit.client.1.smithi092.stdout:3/303: write d4/d16/d1b/f21 [497568,99413] 0 2024-09-17T01:52:05.839 INFO:tasks.workunit.client.0.smithi031.stdout:6/610: dwrite d23/d63/d47/f83 [0,4194304] 0 2024-09-17T01:52:05.840 INFO:tasks.workunit.client.1.smithi092.stdout:0/389: mknod d3/d2e/c78 0 2024-09-17T01:52:05.840 INFO:tasks.workunit.client.1.smithi092.stdout:1/437: sync 2024-09-17T01:52:05.841 INFO:tasks.workunit.client.1.smithi092.stdout:1/438: read - db/d1d/f72 zero size 2024-09-17T01:52:05.842 INFO:tasks.workunit.client.0.smithi031.stdout:6/611: dread - d23/db4/d6a/d72/f73 zero size 2024-09-17T01:52:05.843 INFO:tasks.workunit.client.1.smithi092.stdout:1/439: write db/d1d/d23/d55/f61 [999005,14317] 0 2024-09-17T01:52:05.843 INFO:tasks.workunit.client.0.smithi031.stdout:0/479: rename d0/d29/d33/d8b to d0/d29/da7 0 2024-09-17T01:52:05.845 INFO:tasks.workunit.client.1.smithi092.stdout:3/304: rename d4/d20/d39/f4a to d4/d13/d2e/d5f/f66 0 2024-09-17T01:52:05.846 INFO:tasks.workunit.client.0.smithi031.stdout:5/409: creat da/d42/d12/d64/f93 x:0 0 0 2024-09-17T01:52:05.848 INFO:tasks.workunit.client.0.smithi031.stdout:5/410: read - da/d42/d26/f75 zero size 2024-09-17T01:52:05.849 INFO:tasks.workunit.client.1.smithi092.stdout:1/440: readlink db/d1d/d23/l35 0 2024-09-17T01:52:05.850 INFO:tasks.workunit.client.0.smithi031.stdout:3/461: dwrite db/f81 [0,4194304] 0 2024-09-17T01:52:05.851 INFO:tasks.workunit.client.1.smithi092.stdout:8/304: read d15/d25/d27/d49/f4a [446123,111772] 0 2024-09-17T01:52:05.851 INFO:tasks.workunit.client.1.smithi092.stdout:3/305: read d4/d13/d2e/f3b [62725,61890] 0 2024-09-17T01:52:05.853 INFO:tasks.workunit.client.0.smithi031.stdout:7/430: creat db/d1c/d41/f7e x:0 0 0 2024-09-17T01:52:05.853 INFO:tasks.workunit.client.1.smithi092.stdout:3/306: truncate d4/d16/d1b/f47 207660 0 2024-09-17T01:52:05.854 INFO:tasks.workunit.client.1.smithi092.stdout:1/441: chown db/d1d/d23/f3c 690043216 1 2024-09-17T01:52:05.856 INFO:tasks.workunit.client.1.smithi092.stdout:1/442: truncate db/d1d/d44/f52 1879225 0 2024-09-17T01:52:05.856 INFO:tasks.workunit.client.1.smithi092.stdout:0/390: getdents d3/d2e/d55/d63 0 2024-09-17T01:52:05.857 INFO:tasks.workunit.client.1.smithi092.stdout:0/391: stat d3/da/f22 0 2024-09-17T01:52:05.859 INFO:tasks.workunit.client.1.smithi092.stdout:3/307: mknod d4/d13/c67 0 2024-09-17T01:52:05.859 INFO:tasks.workunit.client.0.smithi031.stdout:3/462: fsync db/d29/f2e 0 2024-09-17T01:52:05.859 INFO:tasks.workunit.client.1.smithi092.stdout:7/377: write d3/d6/f1c [2778579,92697] 0 2024-09-17T01:52:05.860 INFO:tasks.workunit.client.0.smithi031.stdout:4/647: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/c7f to d8/d3a/d41/d64/d4d/dae/cd3 0 2024-09-17T01:52:05.862 INFO:tasks.workunit.client.0.smithi031.stdout:3/463: write db/d29/f2e [4703179,46054] 0 2024-09-17T01:52:05.862 INFO:tasks.workunit.client.1.smithi092.stdout:7/378: truncate d3/d6/d13/f70 814609 0 2024-09-17T01:52:05.863 INFO:tasks.workunit.client.0.smithi031.stdout:0/480: creat d0/d29/d33/d2a/d25/da5/fa8 x:0 0 0 2024-09-17T01:52:05.864 INFO:tasks.workunit.client.1.smithi092.stdout:1/443: symlink db/l8c 0 2024-09-17T01:52:05.865 INFO:tasks.workunit.client.0.smithi031.stdout:6/612: mknod d23/db4/cd3 0 2024-09-17T01:52:05.867 INFO:tasks.workunit.client.0.smithi031.stdout:3/464: truncate db/f7d 1711130 0 2024-09-17T01:52:05.868 INFO:tasks.workunit.client.1.smithi092.stdout:7/379: symlink d3/db/l7f 0 2024-09-17T01:52:05.869 INFO:tasks.workunit.client.1.smithi092.stdout:8/305: getdents d15 0 2024-09-17T01:52:05.871 INFO:tasks.workunit.client.0.smithi031.stdout:7/431: dwrite db/d1c/d46/f4c [0,4194304] 0 2024-09-17T01:52:05.873 INFO:tasks.workunit.client.0.smithi031.stdout:0/481: read d0/d29/d33/d5/d78/f79 [6139,88723] 0 2024-09-17T01:52:05.874 INFO:tasks.workunit.client.0.smithi031.stdout:6/613: creat d23/db4/d64/dc1/fd4 x:0 0 0 2024-09-17T01:52:05.874 INFO:tasks.workunit.client.1.smithi092.stdout:9/310: truncate d0/df/d17/f1c 18984 0 2024-09-17T01:52:05.875 INFO:tasks.workunit.client.1.smithi092.stdout:7/380: write d3/db/f4a [134027,95079] 0 2024-09-17T01:52:05.878 INFO:tasks.workunit.client.1.smithi092.stdout:8/306: write d15/d25/d27/f3e [3686746,124015] 0 2024-09-17T01:52:05.878 INFO:tasks.workunit.client.0.smithi031.stdout:4/648: dread f5 [0,4194304] 0 2024-09-17T01:52:05.879 INFO:tasks.workunit.client.0.smithi031.stdout:3/465: truncate db/df/d50/f7f 402357 0 2024-09-17T01:52:05.880 INFO:tasks.workunit.client.0.smithi031.stdout:9/397: dread d3/d10/f63 [0,4194304] 0 2024-09-17T01:52:05.882 INFO:tasks.workunit.client.1.smithi092.stdout:5/262: dwrite d0/d23/f2c [0,4194304] 0 2024-09-17T01:52:05.882 INFO:tasks.workunit.client.0.smithi031.stdout:1/515: truncate d4/d1e/f42 1158419 0 2024-09-17T01:52:05.885 INFO:tasks.workunit.client.1.smithi092.stdout:0/392: dwrite d3/da/d1c/d47/f52 [0,4194304] 0 2024-09-17T01:52:05.886 INFO:tasks.workunit.client.0.smithi031.stdout:8/449: write d0/d5/d54/d60/f57 [704557,36242] 0 2024-09-17T01:52:05.886 INFO:tasks.workunit.client.0.smithi031.stdout:7/432: read db/d1c/d46/f52 [32006,92570] 0 2024-09-17T01:52:05.887 INFO:tasks.workunit.client.1.smithi092.stdout:7/381: dread d3/d6/d13/d21/f5c [0,4194304] 0 2024-09-17T01:52:05.888 INFO:tasks.workunit.client.0.smithi031.stdout:6/614: dread - d23/d63/f34 zero size 2024-09-17T01:52:05.890 INFO:tasks.workunit.client.1.smithi092.stdout:7/382: write d3/db/f54 [195457,90686] 0 2024-09-17T01:52:05.890 INFO:tasks.workunit.client.1.smithi092.stdout:3/308: dwrite d4/f2d [0,4194304] 0 2024-09-17T01:52:05.890 INFO:tasks.workunit.client.1.smithi092.stdout:5/263: creat d0/de/d19/d1a/f58 x:0 0 0 2024-09-17T01:52:05.891 INFO:tasks.workunit.client.0.smithi031.stdout:4/649: read - d8/d3a/d41/d64/f7d zero size 2024-09-17T01:52:05.891 INFO:tasks.workunit.client.0.smithi031.stdout:0/482: creat d0/d29/d33/d2a/d25/d30/d4a/d90/d9b/fa9 x:0 0 0 2024-09-17T01:52:05.891 INFO:tasks.workunit.client.0.smithi031.stdout:9/398: truncate d3/d19/d1f/f21 1369567 0 2024-09-17T01:52:05.891 INFO:tasks.workunit.client.0.smithi031.stdout:2/534: dwrite d1/d3/d2d/db2/f1d [0,4194304] 0 2024-09-17T01:52:05.895 INFO:tasks.workunit.client.0.smithi031.stdout:7/433: write db/d1c/f40 [957013,74213] 0 2024-09-17T01:52:05.896 INFO:tasks.workunit.client.1.smithi092.stdout:9/311: creat d0/f5c x:0 0 0 2024-09-17T01:52:05.897 INFO:tasks.workunit.client.1.smithi092.stdout:5/264: readlink d0/de/d19/d1a/d1e/d3e/d4c/l56 0 2024-09-17T01:52:05.897 INFO:tasks.workunit.client.0.smithi031.stdout:1/516: rename d4/d1e/d91 to d4/d1e/d5d/dae 0 2024-09-17T01:52:05.899 INFO:tasks.workunit.client.1.smithi092.stdout:5/265: fdatasync d0/de/d19/d1a/f22 0 2024-09-17T01:52:05.900 INFO:tasks.workunit.client.0.smithi031.stdout:9/399: fsync d3/f11 0 2024-09-17T01:52:05.900 INFO:tasks.workunit.client.0.smithi031.stdout:8/450: mkdir d0/df/d19/d86 0 2024-09-17T01:52:05.901 INFO:tasks.workunit.client.1.smithi092.stdout:3/309: dwrite d4/d13/f1d [4194304,4194304] 0 2024-09-17T01:52:05.901 INFO:tasks.workunit.client.0.smithi031.stdout:5/411: dread da/dc/f3a [0,4194304] 0 2024-09-17T01:52:05.902 INFO:tasks.workunit.client.1.smithi092.stdout:0/393: creat d3/da/d1c/d47/d5f/f79 x:0 0 0 2024-09-17T01:52:05.904 INFO:tasks.workunit.client.0.smithi031.stdout:5/412: fsync da/dc/d2e/f77 0 2024-09-17T01:52:05.905 INFO:tasks.workunit.client.1.smithi092.stdout:8/307: rename d15/d25/f3c to d15/d32/d40/d42/f5f 0 2024-09-17T01:52:05.906 INFO:tasks.workunit.client.0.smithi031.stdout:6/615: mkdir d23/db4/d8a/dd5 0 2024-09-17T01:52:05.909 INFO:tasks.workunit.client.1.smithi092.stdout:7/383: link d3/d6/f64 d3/db/d26/f80 0 2024-09-17T01:52:05.909 INFO:tasks.workunit.client.1.smithi092.stdout:0/394: truncate d3/da/d1c/d47/f52 4889638 0 2024-09-17T01:52:05.910 INFO:tasks.workunit.client.1.smithi092.stdout:8/308: mknod d15/d25/d2b/d3d/c60 0 2024-09-17T01:52:05.911 INFO:tasks.workunit.client.1.smithi092.stdout:1/444: dread db/d1d/d4b/f58 [0,4194304] 0 2024-09-17T01:52:05.912 INFO:tasks.workunit.client.0.smithi031.stdout:3/466: dwrite db/df/f1e [4194304,4194304] 0 2024-09-17T01:52:05.912 INFO:tasks.workunit.client.0.smithi031.stdout:2/535: mknod d1/d3/d2d/db2/d1e/d4f/d92/cbc 0 2024-09-17T01:52:05.913 INFO:tasks.workunit.client.1.smithi092.stdout:7/384: fsync d3/d6/d13/d21/f36 0 2024-09-17T01:52:05.914 INFO:tasks.workunit.client.1.smithi092.stdout:5/266: dwrite d0/de/d19/d1a/f34 [0,4194304] 0 2024-09-17T01:52:05.915 INFO:tasks.workunit.client.1.smithi092.stdout:9/312: rename d0/d7/d12/d34/d26/d54/d58 to d0/df/d5d 0 2024-09-17T01:52:05.915 INFO:tasks.workunit.client.1.smithi092.stdout:0/395: truncate d3/d2e/d55/f70 110352 0 2024-09-17T01:52:05.915 INFO:tasks.workunit.client.0.smithi031.stdout:3/467: read db/f81 [1309931,81987] 0 2024-09-17T01:52:05.916 INFO:tasks.workunit.client.0.smithi031.stdout:3/468: chown db/f11 5170179 1 2024-09-17T01:52:05.917 INFO:tasks.workunit.client.1.smithi092.stdout:1/445: symlink db/d1d/d4b/l8d 0 2024-09-17T01:52:05.917 INFO:tasks.workunit.client.1.smithi092.stdout:8/309: mknod d15/d25/d27/c61 0 2024-09-17T01:52:05.919 INFO:tasks.workunit.client.1.smithi092.stdout:9/313: chown d0/d7/d12/d34/d26/d54/l44 3392 1 2024-09-17T01:52:05.919 INFO:tasks.workunit.client.1.smithi092.stdout:1/446: chown db/d1d/d2e 2007 1 2024-09-17T01:52:05.920 INFO:tasks.workunit.client.0.smithi031.stdout:7/434: creat db/d18/f7f x:0 0 0 2024-09-17T01:52:05.922 INFO:tasks.workunit.client.1.smithi092.stdout:1/447: fdatasync db/d1d/d44/f6b 0 2024-09-17T01:52:05.923 INFO:tasks.workunit.client.1.smithi092.stdout:5/267: rmdir d0/de/d19/d1a/d1e/d3e/d4c 39 2024-09-17T01:52:05.924 INFO:tasks.workunit.client.0.smithi031.stdout:4/650: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/fd4 x:0 0 0 2024-09-17T01:52:05.924 INFO:tasks.workunit.client.0.smithi031.stdout:8/451: dwrite d0/d5/d54/f84 [0,4194304] 0 2024-09-17T01:52:05.924 INFO:tasks.workunit.client.1.smithi092.stdout:0/396: mkdir d3/d2e/d3b/d72/d7a 0 2024-09-17T01:52:05.928 INFO:tasks.workunit.client.1.smithi092.stdout:5/268: fdatasync d0/d23/f2c 0 2024-09-17T01:52:05.929 INFO:tasks.workunit.client.1.smithi092.stdout:0/397: write d3/da/f22 [2589815,19083] 0 2024-09-17T01:52:05.930 INFO:tasks.workunit.client.0.smithi031.stdout:3/469: symlink db/df/d1d/d37/d65/l8a 0 2024-09-17T01:52:05.932 INFO:tasks.workunit.client.0.smithi031.stdout:3/470: readlink db/df/d1d/d37/d3a/l73 0 2024-09-17T01:52:05.933 INFO:tasks.workunit.client.1.smithi092.stdout:1/448: dwrite db/d1d/d4b/f56 [0,4194304] 0 2024-09-17T01:52:05.937 INFO:tasks.workunit.client.0.smithi031.stdout:2/536: rename d1/d3/fa to d1/db6/fbd 0 2024-09-17T01:52:05.938 INFO:tasks.workunit.client.1.smithi092.stdout:0/398: dwrite d3/d2e/d3b/d48/f5b [0,4194304] 0 2024-09-17T01:52:05.939 INFO:tasks.workunit.client.0.smithi031.stdout:9/400: mkdir d3/d19/d80 0 2024-09-17T01:52:05.939 INFO:tasks.workunit.client.1.smithi092.stdout:0/399: dread - d3/f77 zero size 2024-09-17T01:52:05.940 INFO:tasks.workunit.client.0.smithi031.stdout:7/435: truncate db/d1c/d46/f52 1027661 0 2024-09-17T01:52:05.940 INFO:tasks.workunit.client.0.smithi031.stdout:9/401: readlink d3/d19/l35 0 2024-09-17T01:52:05.941 INFO:tasks.workunit.client.0.smithi031.stdout:5/413: creat da/dc/d2e/d82/d92/f94 x:0 0 0 2024-09-17T01:52:05.942 INFO:tasks.workunit.client.0.smithi031.stdout:0/483: rmdir d0/d29/d33/d5/d50/d9d 0 2024-09-17T01:52:05.943 INFO:tasks.workunit.client.0.smithi031.stdout:5/414: dread - da/d4b/f65 zero size 2024-09-17T01:52:05.946 INFO:tasks.workunit.client.0.smithi031.stdout:5/415: read - da/d42/d26/f75 zero size 2024-09-17T01:52:05.949 INFO:tasks.workunit.client.0.smithi031.stdout:0/484: chown d0/d29/d33/d2a/d25/da5/fa8 569344 1 2024-09-17T01:52:05.954 INFO:tasks.workunit.client.0.smithi031.stdout:8/452: dwrite d0/f42 [0,4194304] 0 2024-09-17T01:52:05.957 INFO:tasks.workunit.client.0.smithi031.stdout:3/471: write db/df/d1d/d37/f4b [214535,10193] 0 2024-09-17T01:52:05.958 INFO:tasks.workunit.client.0.smithi031.stdout:1/517: creat d4/d1a/faf x:0 0 0 2024-09-17T01:52:05.963 INFO:tasks.workunit.client.0.smithi031.stdout:2/537: rename d1/f87 to d1/d3/d2d/db2/d1e/d2a/fbe 0 2024-09-17T01:52:05.965 INFO:tasks.workunit.client.0.smithi031.stdout:1/518: read d4/d1e/f4f [303500,123847] 0 2024-09-17T01:52:05.966 INFO:tasks.workunit.client.0.smithi031.stdout:9/402: write d3/d19/d1f/d44/f57 [28388,68936] 0 2024-09-17T01:52:05.969 INFO:tasks.workunit.client.0.smithi031.stdout:4/651: getdents d8/d3a/d41/d64/d4d/d5a/d79 0 2024-09-17T01:52:05.970 INFO:tasks.workunit.client.0.smithi031.stdout:9/403: write d3/d19/f34 [2659837,90650] 0 2024-09-17T01:52:05.976 INFO:tasks.workunit.client.0.smithi031.stdout:8/453: write d0/d5/f5d [146079,55922] 0 2024-09-17T01:52:05.982 INFO:tasks.workunit.client.0.smithi031.stdout:5/416: rmdir da/dc/d2e/d82/d92 39 2024-09-17T01:52:05.985 INFO:tasks.workunit.client.0.smithi031.stdout:6/616: truncate d23/db4/d6a/dac/f85 1507301 0 2024-09-17T01:52:05.986 INFO:tasks.workunit.client.0.smithi031.stdout:5/417: write da/d42/f8c [266484,93798] 0 2024-09-17T01:52:05.988 INFO:tasks.workunit.client.0.smithi031.stdout:1/519: rename d4/d1e/d3f/d4d/c4e to d4/d1e/d3f/cb0 0 2024-09-17T01:52:05.989 INFO:tasks.workunit.client.0.smithi031.stdout:5/418: write da/d42/d26/f34 [3703677,46430] 0 2024-09-17T01:52:05.991 INFO:tasks.workunit.client.0.smithi031.stdout:1/520: fsync d4/d1e/d5d/f8f 0 2024-09-17T01:52:05.994 INFO:tasks.workunit.client.0.smithi031.stdout:3/472: dread db/df/f31 [0,4194304] 0 2024-09-17T01:52:05.995 INFO:tasks.workunit.client.0.smithi031.stdout:9/404: dread d3/d10/f38 [0,4194304] 0 2024-09-17T01:52:05.997 INFO:tasks.workunit.client.0.smithi031.stdout:4/652: dread d8/d3a/d41/d64/d4f/fc0 [0,4194304] 0 2024-09-17T01:52:05.997 INFO:tasks.workunit.client.0.smithi031.stdout:0/485: symlink d0/d29/d33/d2a/d25/laa 0 2024-09-17T01:52:06.005 INFO:tasks.workunit.client.0.smithi031.stdout:3/473: dread db/df/d1d/f59 [0,4194304] 0 2024-09-17T01:52:06.009 INFO:tasks.workunit.client.0.smithi031.stdout:6/617: rmdir d23/db4/d64/d67 39 2024-09-17T01:52:06.013 INFO:tasks.workunit.client.0.smithi031.stdout:1/521: symlink d4/d1a/d43/d53/lb1 0 2024-09-17T01:52:06.013 INFO:tasks.workunit.client.0.smithi031.stdout:6/618: dwrite d23/f5c [0,4194304] 0 2024-09-17T01:52:06.017 INFO:tasks.workunit.client.0.smithi031.stdout:2/538: truncate d1/d3/d2d/db2/d1e/f29 1321958 0 2024-09-17T01:52:06.018 INFO:tasks.workunit.client.0.smithi031.stdout:4/653: write d8/d3a/d41/d64/f39 [374717,4480] 0 2024-09-17T01:52:06.020 INFO:tasks.workunit.client.0.smithi031.stdout:4/654: write d8/d3a/d41/d64/d92/fb3 [489182,54488] 0 2024-09-17T01:52:06.021 INFO:tasks.workunit.client.0.smithi031.stdout:9/405: rename d3/d10/d71/l73 to d3/d19/d1f/d44/l81 0 2024-09-17T01:52:06.022 INFO:tasks.workunit.client.0.smithi031.stdout:0/486: symlink d0/d29/d33/d2a/d25/d30/d4a/d90/d9b/lab 0 2024-09-17T01:52:06.024 INFO:tasks.workunit.client.0.smithi031.stdout:0/487: write d0/f5c [1976583,16916] 0 2024-09-17T01:52:06.025 INFO:tasks.workunit.client.0.smithi031.stdout:7/436: getdents db/d1c/d46 0 2024-09-17T01:52:06.032 INFO:tasks.workunit.client.0.smithi031.stdout:5/419: mknod da/dc/d2e/d82/d92/c95 0 2024-09-17T01:52:06.033 INFO:tasks.workunit.client.0.smithi031.stdout:7/437: chown db/f3a 2157400 1 2024-09-17T01:52:06.033 INFO:tasks.workunit.client.0.smithi031.stdout:0/488: stat d0/d29/d33/c49 0 2024-09-17T01:52:06.033 INFO:tasks.workunit.client.0.smithi031.stdout:5/420: chown da/dc 31 1 2024-09-17T01:52:06.033 INFO:tasks.workunit.client.0.smithi031.stdout:6/619: chown d23/c28 5 1 2024-09-17T01:52:06.037 INFO:tasks.workunit.client.0.smithi031.stdout:5/421: readlink da/dc/d2e/l52 0 2024-09-17T01:52:06.046 INFO:tasks.workunit.client.0.smithi031.stdout:8/454: truncate d0/d5/d54/d60/f66 559613 0 2024-09-17T01:52:06.047 INFO:tasks.workunit.client.0.smithi031.stdout:5/422: dwrite da/d4b/f4d [0,4194304] 0 2024-09-17T01:52:06.054 INFO:tasks.workunit.client.0.smithi031.stdout:1/522: write d4/d1e/d3f/d72/d7e/da2/fa4 [9073864,66476] 0 2024-09-17T01:52:06.055 INFO:tasks.workunit.client.0.smithi031.stdout:9/406: write d3/d19/d1f/f7b [5213447,3221] 0 2024-09-17T01:52:06.056 INFO:tasks.workunit.client.0.smithi031.stdout:1/523: dread - d4/d1e/d40/d84/f85 zero size 2024-09-17T01:52:06.069 INFO:tasks.workunit.client.0.smithi031.stdout:4/655: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/cd5 0 2024-09-17T01:52:06.069 INFO:tasks.workunit.client.0.smithi031.stdout:6/620: creat d23/db4/d6a/d70/db0/fd6 x:0 0 0 2024-09-17T01:52:06.072 INFO:tasks.workunit.client.0.smithi031.stdout:8/455: dread d0/df/d19/f29 [0,4194304] 0 2024-09-17T01:52:06.075 INFO:tasks.workunit.client.1.smithi092.stdout:3/310: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:52:06.076 INFO:tasks.workunit.client.1.smithi092.stdout:3/311: fsync d4/d13/f14 0 2024-09-17T01:52:06.078 INFO:tasks.workunit.client.1.smithi092.stdout:5/269: creat d0/de/d19/d1a/d1e/d3e/f59 x:0 0 0 2024-09-17T01:52:06.080 INFO:tasks.workunit.client.0.smithi031.stdout:1/524: unlink d4/d1a/f1d 0 2024-09-17T01:52:06.081 INFO:tasks.workunit.client.1.smithi092.stdout:3/312: symlink d4/d2f/d44/l68 0 2024-09-17T01:52:06.081 INFO:tasks.workunit.client.0.smithi031.stdout:9/407: mknod d3/d10/d36/d62/c82 0 2024-09-17T01:52:06.085 INFO:tasks.workunit.client.0.smithi031.stdout:6/621: creat d23/db4/d8a/fd7 x:0 0 0 2024-09-17T01:52:06.086 INFO:tasks.workunit.client.0.smithi031.stdout:7/438: write db/d29/f4a [955576,104902] 0 2024-09-17T01:52:06.086 INFO:tasks.workunit.client.1.smithi092.stdout:1/449: dread db/d1d/d23/f45 [0,4194304] 0 2024-09-17T01:52:06.093 INFO:tasks.workunit.client.1.smithi092.stdout:5/270: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:06.094 INFO:tasks.workunit.client.0.smithi031.stdout:3/474: getdents db 0 2024-09-17T01:52:06.094 INFO:tasks.workunit.client.0.smithi031.stdout:8/456: dread d0/df/f2b [0,4194304] 0 2024-09-17T01:52:06.094 INFO:tasks.workunit.client.0.smithi031.stdout:0/489: getdents d0/d29/d33/d2a/d25/d30/d4a/d86/da1 0 2024-09-17T01:52:06.094 INFO:tasks.workunit.client.1.smithi092.stdout:7/385: dwrite d3/d6/d13/d21/d2e/d6e/f20 [0,4194304] 0 2024-09-17T01:52:06.096 INFO:tasks.workunit.client.1.smithi092.stdout:3/313: dwrite d4/d16/d1b/f21 [0,4194304] 0 2024-09-17T01:52:06.099 INFO:tasks.workunit.client.1.smithi092.stdout:5/271: mknod d0/d23/c5a 0 2024-09-17T01:52:06.100 INFO:tasks.workunit.client.0.smithi031.stdout:7/439: dread db/d1c/d46/f52 [0,4194304] 0 2024-09-17T01:52:06.101 INFO:tasks.workunit.client.0.smithi031.stdout:9/408: rmdir d3/d4 39 2024-09-17T01:52:06.104 INFO:tasks.workunit.client.1.smithi092.stdout:3/314: unlink d4/d20/d3f/f5a 0 2024-09-17T01:52:06.107 INFO:tasks.workunit.client.0.smithi031.stdout:8/457: dwrite d0/d5/f2f [4194304,4194304] 0 2024-09-17T01:52:06.108 INFO:tasks.workunit.client.1.smithi092.stdout:3/315: read d4/f30 [2897195,128761] 0 2024-09-17T01:52:06.109 INFO:tasks.workunit.client.0.smithi031.stdout:2/539: getdents d1/d3/df/d11/d30 0 2024-09-17T01:52:06.109 INFO:tasks.workunit.client.1.smithi092.stdout:7/386: creat d3/db/d7b/f81 x:0 0 0 2024-09-17T01:52:06.110 INFO:tasks.workunit.client.0.smithi031.stdout:6/622: fdatasync d23/db4/f53 0 2024-09-17T01:52:06.110 INFO:tasks.workunit.client.0.smithi031.stdout:3/475: write db/df/f31 [8943002,54772] 0 2024-09-17T01:52:06.113 INFO:tasks.workunit.client.0.smithi031.stdout:8/458: write d0/d5/f7d [769553,28267] 0 2024-09-17T01:52:06.113 INFO:tasks.workunit.client.0.smithi031.stdout:9/409: chown d3/d19/c20 33178523 1 2024-09-17T01:52:06.115 INFO:tasks.workunit.client.0.smithi031.stdout:0/490: dread d0/d29/d33/d84/f97 [0,4194304] 0 2024-09-17T01:52:06.117 INFO:tasks.workunit.client.0.smithi031.stdout:3/476: stat db/df/d1d/d37/d4a/f43 0 2024-09-17T01:52:06.117 INFO:tasks.workunit.client.1.smithi092.stdout:3/316: dwrite d4/d16/d1b/f47 [0,4194304] 0 2024-09-17T01:52:06.118 INFO:tasks.workunit.client.1.smithi092.stdout:7/387: dread d3/db/d26/f72 [0,4194304] 0 2024-09-17T01:52:06.118 INFO:tasks.workunit.client.0.smithi031.stdout:4/656: rename d8/d3a/d41/f77 to d8/fd6 0 2024-09-17T01:52:06.118 INFO:tasks.workunit.client.0.smithi031.stdout:8/459: write d0/df/d19/d3d/f41 [1391134,19645] 0 2024-09-17T01:52:06.119 INFO:tasks.workunit.client.1.smithi092.stdout:5/272: link d0/f53 d0/d50/f5b 0 2024-09-17T01:52:06.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/540: write d1/d3/d2d/d71/f77 [4880769,73669] 0 2024-09-17T01:52:06.121 INFO:tasks.workunit.client.1.smithi092.stdout:5/273: fdatasync d0/de/d19/d1a/d1e/f1b 0 2024-09-17T01:52:06.121 INFO:tasks.workunit.client.0.smithi031.stdout:6/623: fsync d23/f31 0 2024-09-17T01:52:06.123 INFO:tasks.workunit.client.0.smithi031.stdout:2/541: fsync d1/d3/d2d/db2/d1e/f3e 0 2024-09-17T01:52:06.126 INFO:tasks.workunit.client.0.smithi031.stdout:0/491: mkdir d0/d29/d33/d5/d50/dac 0 2024-09-17T01:52:06.126 INFO:tasks.workunit.client.0.smithi031.stdout:7/440: mknod db/d1c/d41/c80 0 2024-09-17T01:52:06.127 INFO:tasks.workunit.client.1.smithi092.stdout:3/317: dread d4/d2f/d44/d3c/f45 [0,4194304] 0 2024-09-17T01:52:06.127 INFO:tasks.workunit.client.1.smithi092.stdout:7/388: dread d3/d6/d13/d21/d2e/d6e/f41 [0,4194304] 0 2024-09-17T01:52:06.128 INFO:tasks.workunit.client.0.smithi031.stdout:2/542: dread - d1/d3/df/d11/d30/db1/fb7 zero size 2024-09-17T01:52:06.129 INFO:tasks.workunit.client.0.smithi031.stdout:1/525: truncate d4/d3d/d65/f75 439801 0 2024-09-17T01:52:06.131 INFO:tasks.workunit.client.1.smithi092.stdout:5/274: creat d0/de/d19/d1a/d1e/f5c x:0 0 0 2024-09-17T01:52:06.131 INFO:tasks.workunit.client.0.smithi031.stdout:3/477: dwrite db/df/d1d/f49 [0,4194304] 0 2024-09-17T01:52:06.132 INFO:tasks.workunit.client.0.smithi031.stdout:2/543: fdatasync d1/d3/d45/f8c 0 2024-09-17T01:52:06.133 INFO:tasks.workunit.client.1.smithi092.stdout:5/275: write d0/de/d19/d1a/d1e/f18 [906004,111659] 0 2024-09-17T01:52:06.134 INFO:tasks.workunit.client.1.smithi092.stdout:3/318: unlink d4/d20/f33 0 2024-09-17T01:52:06.137 INFO:tasks.workunit.client.1.smithi092.stdout:0/400: rmdir d3/da/d15 39 2024-09-17T01:52:06.138 INFO:tasks.workunit.client.0.smithi031.stdout:2/544: write d1/d3/d2d/db2/d1e/d4f/d92/fb3 [433187,7951] 0 2024-09-17T01:52:06.138 INFO:tasks.workunit.client.0.smithi031.stdout:1/526: symlink d4/d1e/d5d/dae/lb2 0 2024-09-17T01:52:06.142 INFO:tasks.workunit.client.0.smithi031.stdout:1/527: read - d4/d1e/d3f/d72/d7e/d92/fa0 zero size 2024-09-17T01:52:06.143 INFO:tasks.workunit.client.1.smithi092.stdout:3/319: readlink d4/d16/l19 0 2024-09-17T01:52:06.143 INFO:tasks.workunit.client.1.smithi092.stdout:7/389: dwrite d3/d6/d13/d21/f38 [0,4194304] 0 2024-09-17T01:52:06.145 INFO:tasks.workunit.client.0.smithi031.stdout:3/478: creat db/df/d1d/d37/d77/f8b x:0 0 0 2024-09-17T01:52:06.148 INFO:tasks.workunit.client.0.smithi031.stdout:6/624: creat d23/d63/fd8 x:0 0 0 2024-09-17T01:52:06.148 INFO:tasks.workunit.client.1.smithi092.stdout:5/276: creat d0/de/d19/d1a/d1e/d3e/d4c/f5d x:0 0 0 2024-09-17T01:52:06.149 INFO:tasks.workunit.client.1.smithi092.stdout:0/401: chown d3/da/d15/d30 6326 1 2024-09-17T01:52:06.150 INFO:tasks.workunit.client.1.smithi092.stdout:0/402: read d3/da/d1c/d47/f52 [3857268,62325] 0 2024-09-17T01:52:06.151 INFO:tasks.workunit.client.1.smithi092.stdout:0/403: truncate d3/d2e/d55/f70 735643 0 2024-09-17T01:52:06.152 INFO:tasks.workunit.client.0.smithi031.stdout:9/410: dwrite d3/d4/d29/f78 [0,4194304] 0 2024-09-17T01:52:06.153 INFO:tasks.workunit.client.1.smithi092.stdout:7/390: rename d3/c56 to d3/d6/d13/d40/d6a/c82 0 2024-09-17T01:52:06.156 INFO:tasks.workunit.client.0.smithi031.stdout:8/460: creat d0/d5/f87 x:0 0 0 2024-09-17T01:52:06.159 INFO:tasks.workunit.client.1.smithi092.stdout:0/404: creat d3/da/d1c/f7b x:0 0 0 2024-09-17T01:52:06.159 INFO:tasks.workunit.client.1.smithi092.stdout:0/405: stat d3/da/d1c/d4a/l5a 0 2024-09-17T01:52:06.160 INFO:tasks.workunit.client.0.smithi031.stdout:1/528: creat d4/d1e/d3f/d72/d7e/da2/fb3 x:0 0 0 2024-09-17T01:52:06.161 INFO:tasks.workunit.client.1.smithi092.stdout:7/391: mkdir d3/db/d26/d83 0 2024-09-17T01:52:06.161 INFO:tasks.workunit.client.1.smithi092.stdout:7/392: stat d3/db/f54 0 2024-09-17T01:52:06.161 INFO:tasks.workunit.client.0.smithi031.stdout:3/479: creat db/df/d1c/d6a/f8c x:0 0 0 2024-09-17T01:52:06.162 INFO:tasks.workunit.client.0.smithi031.stdout:2/545: dread d1/d3/df/d18/f61 [0,4194304] 0 2024-09-17T01:52:06.164 INFO:tasks.workunit.client.1.smithi092.stdout:0/406: stat d3/cf 0 2024-09-17T01:52:06.167 INFO:tasks.workunit.client.0.smithi031.stdout:9/411: unlink d3/d4/d41/d70/f76 0 2024-09-17T01:52:06.168 INFO:tasks.workunit.client.1.smithi092.stdout:7/393: mkdir d3/d2b/d84 0 2024-09-17T01:52:06.171 INFO:tasks.workunit.client.0.smithi031.stdout:9/412: write d3/d19/f34 [2585497,111635] 0 2024-09-17T01:52:06.171 INFO:tasks.workunit.client.0.smithi031.stdout:0/492: unlink d0/d29/d33/d2a/c53 0 2024-09-17T01:52:06.172 INFO:tasks.workunit.client.0.smithi031.stdout:8/461: dwrite d0/df/dd/d77/d78/f7f [0,4194304] 0 2024-09-17T01:52:06.173 INFO:tasks.workunit.client.1.smithi092.stdout:0/407: dwrite d3/f77 [0,4194304] 0 2024-09-17T01:52:06.174 INFO:tasks.workunit.client.0.smithi031.stdout:3/480: dread db/df/d1d/d37/f72 [0,4194304] 0 2024-09-17T01:52:06.176 INFO:tasks.workunit.client.1.smithi092.stdout:0/408: dread - d3/da/d1c/d4a/f6e zero size 2024-09-17T01:52:06.177 INFO:tasks.workunit.client.1.smithi092.stdout:7/394: link d3/d6/d13/d21/d2e/d6e/f20 d3/d6/d13/d21/d2e/f85 0 2024-09-17T01:52:06.178 INFO:tasks.workunit.client.0.smithi031.stdout:6/625: creat d23/db4/d64/d67/fd9 x:0 0 0 2024-09-17T01:52:06.180 INFO:tasks.workunit.client.0.smithi031.stdout:8/462: fdatasync d0/df/d19/d3d/f5c 0 2024-09-17T01:52:06.184 INFO:tasks.workunit.client.1.smithi092.stdout:7/395: dread d3/d6/d13/f7d [0,4194304] 0 2024-09-17T01:52:06.186 INFO:tasks.workunit.client.0.smithi031.stdout:7/441: dread db/f10 [0,4194304] 0 2024-09-17T01:52:06.187 INFO:tasks.workunit.client.1.smithi092.stdout:0/409: creat d3/da/d1c/d47/f7c x:0 0 0 2024-09-17T01:52:06.187 INFO:tasks.workunit.client.0.smithi031.stdout:0/493: dwrite d0/d29/d33/d5b/f9f [0,4194304] 0 2024-09-17T01:52:06.188 INFO:tasks.workunit.client.0.smithi031.stdout:8/463: write d0/df/dd/f45 [4041145,105592] 0 2024-09-17T01:52:06.189 INFO:tasks.workunit.client.0.smithi031.stdout:2/546: symlink d1/d3/d2d/da6/lbf 0 2024-09-17T01:52:06.191 INFO:tasks.workunit.client.0.smithi031.stdout:8/464: write d0/df/f46 [216824,49347] 0 2024-09-17T01:52:06.193 INFO:tasks.workunit.client.1.smithi092.stdout:3/320: rmdir d4/d16/d1b 39 2024-09-17T01:52:06.193 INFO:tasks.workunit.client.0.smithi031.stdout:7/442: write db/d1c/f71 [622319,12846] 0 2024-09-17T01:52:06.194 INFO:tasks.workunit.client.0.smithi031.stdout:1/529: creat d4/d1a/d2d/fb4 x:0 0 0 2024-09-17T01:52:06.195 INFO:tasks.workunit.client.1.smithi092.stdout:7/396: creat d3/d6/d13/d21/d2e/d6e/f86 x:0 0 0 2024-09-17T01:52:06.198 INFO:tasks.workunit.client.1.smithi092.stdout:0/410: mkdir d3/d2e/d3b/d40/d7d 0 2024-09-17T01:52:06.198 INFO:tasks.workunit.client.0.smithi031.stdout:2/547: rmdir d1/db6 39 2024-09-17T01:52:06.198 INFO:tasks.workunit.client.0.smithi031.stdout:1/530: truncate d4/d1e/d40/d84/f85 335900 0 2024-09-17T01:52:06.199 INFO:tasks.workunit.client.1.smithi092.stdout:3/321: rmdir d4/d20/d39 39 2024-09-17T01:52:06.200 INFO:tasks.workunit.client.0.smithi031.stdout:4/657: truncate d8/d3a/d41/d64/d92/fb3 224235 0 2024-09-17T01:52:06.200 INFO:tasks.workunit.client.0.smithi031.stdout:2/548: readlink d1/d3/df/d11/d44/l47 0 2024-09-17T01:52:06.203 INFO:tasks.workunit.client.1.smithi092.stdout:3/322: dread d4/d13/f1d [4194304,4194304] 0 2024-09-17T01:52:06.204 INFO:tasks.workunit.client.1.smithi092.stdout:0/411: mknod d3/da/d15/d30/c7e 0 2024-09-17T01:52:06.208 INFO:tasks.workunit.client.1.smithi092.stdout:7/397: symlink d3/l87 0 2024-09-17T01:52:06.208 INFO:tasks.workunit.client.0.smithi031.stdout:9/413: write d3/d19/d1f/f21 [2314818,5019] 0 2024-09-17T01:52:06.208 INFO:tasks.workunit.client.0.smithi031.stdout:8/465: symlink d0/df/dd/d77/l88 0 2024-09-17T01:52:06.208 INFO:tasks.workunit.client.0.smithi031.stdout:6/626: write d23/db4/f5a [576786,103025] 0 2024-09-17T01:52:06.209 INFO:tasks.workunit.client.1.smithi092.stdout:0/412: creat d3/da/d1c/d47/d5f/f7f x:0 0 0 2024-09-17T01:52:06.210 INFO:tasks.workunit.client.0.smithi031.stdout:3/481: dwrite db/df/d1d/f4c [0,4194304] 0 2024-09-17T01:52:06.211 INFO:tasks.workunit.client.1.smithi092.stdout:0/413: stat d3/d2e/d3b/d48/c59 0 2024-09-17T01:52:06.213 INFO:tasks.workunit.client.1.smithi092.stdout:0/414: write d3/f4 [2799440,52987] 0 2024-09-17T01:52:06.213 INFO:tasks.workunit.client.1.smithi092.stdout:3/323: mkdir d4/d2f/d69 0 2024-09-17T01:52:06.214 INFO:tasks.workunit.client.0.smithi031.stdout:0/494: mkdir d0/d29/d33/d5/dad 0 2024-09-17T01:52:06.214 INFO:tasks.workunit.client.1.smithi092.stdout:3/324: chown d4/d2f/d44 22348973 1 2024-09-17T01:52:06.214 INFO:tasks.workunit.client.1.smithi092.stdout:4/353: sync 2024-09-17T01:52:06.214 INFO:tasks.workunit.client.1.smithi092.stdout:2/271: sync 2024-09-17T01:52:06.214 INFO:tasks.workunit.client.1.smithi092.stdout:6/319: sync 2024-09-17T01:52:06.215 INFO:tasks.workunit.client.1.smithi092.stdout:7/398: rename d3/d6/d13/f34 to d3/d6/d13/d40/d60/f88 0 2024-09-17T01:52:06.215 INFO:tasks.workunit.client.0.smithi031.stdout:4/658: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/fd7 x:0 0 0 2024-09-17T01:52:06.217 INFO:tasks.workunit.client.1.smithi092.stdout:4/354: chown d4/d13/d3b/d42/d76/f48 3253 1 2024-09-17T01:52:06.219 INFO:tasks.workunit.client.0.smithi031.stdout:4/659: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/lc5 47545068 1 2024-09-17T01:52:06.221 INFO:tasks.workunit.client.0.smithi031.stdout:4/660: fdatasync d8/d3a/d41/d64/d86/f94 0 2024-09-17T01:52:06.225 INFO:tasks.workunit.client.0.smithi031.stdout:1/531: dread d4/d1a/d2d/d18/f1b [0,4194304] 0 2024-09-17T01:52:06.225 INFO:tasks.workunit.client.1.smithi092.stdout:6/320: symlink d3/d10/d1a/d43/l62 0 2024-09-17T01:52:06.225 INFO:tasks.workunit.client.0.smithi031.stdout:6/627: creat d23/db4/d64/dc1/fda x:0 0 0 2024-09-17T01:52:06.226 INFO:tasks.workunit.client.1.smithi092.stdout:4/355: fdatasync d4/d13/d20/f29 0 2024-09-17T01:52:06.227 INFO:tasks.workunit.client.0.smithi031.stdout:6/628: chown d23/db4/d64/d67 0 1 2024-09-17T01:52:06.229 INFO:tasks.workunit.client.1.smithi092.stdout:2/272: creat d10/d55/f5b x:0 0 0 2024-09-17T01:52:06.230 INFO:tasks.workunit.client.0.smithi031.stdout:2/549: rename d1/f20 to d1/d3/d45/d4a/fc0 0 2024-09-17T01:52:06.231 INFO:tasks.workunit.client.0.smithi031.stdout:9/414: dread d3/d4/d29/f74 [0,4194304] 0 2024-09-17T01:52:06.231 INFO:tasks.workunit.client.0.smithi031.stdout:9/415: readlink d3/l32 0 2024-09-17T01:52:06.231 INFO:tasks.workunit.client.0.smithi031.stdout:3/482: truncate db/df/d1d/f48 838588 0 2024-09-17T01:52:06.231 INFO:tasks.workunit.client.1.smithi092.stdout:7/399: symlink d3/db/d26/d65/l89 0 2024-09-17T01:52:06.232 INFO:tasks.workunit.client.0.smithi031.stdout:0/495: symlink d0/d37/d6f/lae 0 2024-09-17T01:52:06.232 INFO:tasks.workunit.client.0.smithi031.stdout:9/416: chown d3/d10/l4e 0 1 2024-09-17T01:52:06.232 INFO:tasks.workunit.client.1.smithi092.stdout:4/356: chown d4/d5/d8/f34 25 1 2024-09-17T01:52:06.232 INFO:tasks.workunit.client.1.smithi092.stdout:3/325: dwrite d4/d16/d1b/f47 [4194304,4194304] 0 2024-09-17T01:52:06.234 INFO:tasks.workunit.client.1.smithi092.stdout:2/273: mkdir d10/d5c 0 2024-09-17T01:52:06.234 INFO:tasks.workunit.client.0.smithi031.stdout:0/496: dread - d0/d29/fa2 zero size 2024-09-17T01:52:06.235 INFO:tasks.workunit.client.1.smithi092.stdout:5/277: rmdir d0/de/d19/d1a/d1e/d3e 39 2024-09-17T01:52:06.235 INFO:tasks.workunit.client.0.smithi031.stdout:7/443: creat db/f81 x:0 0 0 2024-09-17T01:52:06.237 INFO:tasks.workunit.client.1.smithi092.stdout:6/321: mknod d3/d10/d1a/d49/c63 0 2024-09-17T01:52:06.237 INFO:tasks.workunit.client.0.smithi031.stdout:4/661: stat d8/d3a/d41/c8b 0 2024-09-17T01:52:06.239 INFO:tasks.workunit.client.1.smithi092.stdout:0/415: dread d3/da/d1c/d47/f51 [0,4194304] 0 2024-09-17T01:52:06.240 INFO:tasks.workunit.client.0.smithi031.stdout:3/483: dwrite db/df/d1d/d37/f4b [0,4194304] 0 2024-09-17T01:52:06.244 INFO:tasks.workunit.client.0.smithi031.stdout:7/444: chown db/d1c/c3d 5278215 1 2024-09-17T01:52:06.244 INFO:tasks.workunit.client.1.smithi092.stdout:7/400: mknod d3/d2b/c8a 0 2024-09-17T01:52:06.245 INFO:tasks.workunit.client.0.smithi031.stdout:7/445: write db/d1c/d46/f4f [754150,50520] 0 2024-09-17T01:52:06.245 INFO:tasks.workunit.client.1.smithi092.stdout:5/278: creat d0/de/d19/d3c/d41/f5e x:0 0 0 2024-09-17T01:52:06.246 INFO:tasks.workunit.client.1.smithi092.stdout:5/279: stat d0/c35 0 2024-09-17T01:52:06.248 INFO:tasks.workunit.client.0.smithi031.stdout:9/417: symlink d3/d10/d36/d79/l83 0 2024-09-17T01:52:06.248 INFO:tasks.workunit.client.1.smithi092.stdout:5/280: dread - d0/d50/f5b zero size 2024-09-17T01:52:06.250 INFO:tasks.workunit.client.0.smithi031.stdout:4/662: mkdir d8/d3a/d41/d64/d4d/d8f/dd8 0 2024-09-17T01:52:06.250 INFO:tasks.workunit.client.1.smithi092.stdout:3/326: dwrite d4/d16/f48 [0,4194304] 0 2024-09-17T01:52:06.251 INFO:tasks.workunit.client.1.smithi092.stdout:4/357: mkdir d4/d7b 0 2024-09-17T01:52:06.252 INFO:tasks.workunit.client.0.smithi031.stdout:4/663: dread - d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/fb4 zero size 2024-09-17T01:52:06.252 INFO:tasks.workunit.client.1.smithi092.stdout:0/416: chown d3/d2e/d3b/d40/f53 4 1 2024-09-17T01:52:06.254 INFO:tasks.workunit.client.0.smithi031.stdout:4/664: dread - d8/d3a/d41/d64/f8d zero size 2024-09-17T01:52:06.254 INFO:tasks.workunit.client.0.smithi031.stdout:0/497: dread - d0/d29/d33/d2a/d25/d38/f65 zero size 2024-09-17T01:52:06.255 INFO:tasks.workunit.client.1.smithi092.stdout:7/401: creat d3/d2b/d37/f8b x:0 0 0 2024-09-17T01:52:06.256 INFO:tasks.workunit.client.0.smithi031.stdout:8/466: getdents d0/df/d19/d3d 0 2024-09-17T01:52:06.256 INFO:tasks.workunit.client.1.smithi092.stdout:5/281: write d0/de/d19/d1a/d1e/f18 [1436025,40364] 0 2024-09-17T01:52:06.259 INFO:tasks.workunit.client.0.smithi031.stdout:1/532: truncate d4/d3d/d65/d78/f7d 549602 0 2024-09-17T01:52:06.260 INFO:tasks.workunit.client.0.smithi031.stdout:0/498: chown d0/d29/d33/d2a/d25/d30/d9c/fa0 6001 1 2024-09-17T01:52:06.260 INFO:tasks.workunit.client.1.smithi092.stdout:5/282: write d0/de/d19/d1a/f58 [796350,99681] 0 2024-09-17T01:52:06.261 INFO:tasks.workunit.client.0.smithi031.stdout:9/418: creat d3/d4/d41/d70/f84 x:0 0 0 2024-09-17T01:52:06.262 INFO:tasks.workunit.client.1.smithi092.stdout:4/358: dwrite d4/d5/d8/f68 [0,4194304] 0 2024-09-17T01:52:06.263 INFO:tasks.workunit.client.1.smithi092.stdout:0/417: read d3/f28 [1566062,96761] 0 2024-09-17T01:52:06.264 INFO:tasks.workunit.client.0.smithi031.stdout:3/484: link db/df/d1d/f49 db/df/d50/f8d 0 2024-09-17T01:52:06.265 INFO:tasks.workunit.client.0.smithi031.stdout:8/467: mknod d0/df/dd/d77/d78/c89 0 2024-09-17T01:52:06.266 INFO:tasks.workunit.client.0.smithi031.stdout:0/499: unlink d0/d29/d33/d5b/f94 0 2024-09-17T01:52:06.270 INFO:tasks.workunit.client.0.smithi031.stdout:2/550: dwrite d1/d3/d2d/db2/d1e/f39 [0,4194304] 0 2024-09-17T01:52:06.271 INFO:tasks.workunit.client.0.smithi031.stdout:9/419: write d3/d4/d29/f31 [813521,71115] 0 2024-09-17T01:52:06.272 INFO:tasks.workunit.client.1.smithi092.stdout:7/402: dwrite d3/db/d26/f6d [0,4194304] 0 2024-09-17T01:52:06.274 INFO:tasks.workunit.client.1.smithi092.stdout:3/327: dwrite d4/d20/d39/f5e [0,4194304] 0 2024-09-17T01:52:06.275 INFO:tasks.workunit.client.1.smithi092.stdout:7/403: readlink d3/d6/d13/d21/d2e/l7c 0 2024-09-17T01:52:06.276 INFO:tasks.workunit.client.1.smithi092.stdout:7/404: dread - d3/db/d26/f62 zero size 2024-09-17T01:52:06.276 INFO:tasks.workunit.client.1.smithi092.stdout:3/328: dread - d4/d16/d1b/f64 zero size 2024-09-17T01:52:06.278 INFO:tasks.workunit.client.0.smithi031.stdout:2/551: write d1/d3/df/d11/f2f [885703,892] 0 2024-09-17T01:52:06.278 INFO:tasks.workunit.client.0.smithi031.stdout:1/533: dwrite d4/d1e/f70 [4194304,4194304] 0 2024-09-17T01:52:06.281 INFO:tasks.workunit.client.0.smithi031.stdout:3/485: truncate db/df/d1d/f48 1593711 0 2024-09-17T01:52:06.281 INFO:tasks.workunit.client.0.smithi031.stdout:9/420: mknod d3/d19/d1f/c85 0 2024-09-17T01:52:06.283 INFO:tasks.workunit.client.1.smithi092.stdout:0/418: creat d3/d1d/f80 x:0 0 0 2024-09-17T01:52:06.284 INFO:tasks.workunit.client.0.smithi031.stdout:4/665: dwrite d8/d3a/d41/d64/d4f/fc0 [0,4194304] 0 2024-09-17T01:52:06.285 INFO:tasks.workunit.client.0.smithi031.stdout:1/534: readlink d4/l35 0 2024-09-17T01:52:06.287 INFO:tasks.workunit.client.0.smithi031.stdout:2/552: mkdir d1/d3/df/d18/d40/dc1 0 2024-09-17T01:52:06.289 INFO:tasks.workunit.client.0.smithi031.stdout:7/446: dread db/d1c/f1d [0,4194304] 0 2024-09-17T01:52:06.291 INFO:tasks.workunit.client.1.smithi092.stdout:0/419: mkdir d3/d2e/d55/d63/d81 0 2024-09-17T01:52:06.292 INFO:tasks.workunit.client.0.smithi031.stdout:9/421: unlink d3/d10/f63 0 2024-09-17T01:52:06.292 INFO:tasks.workunit.client.1.smithi092.stdout:0/420: chown d3/d2e/d55/f70 548 1 2024-09-17T01:52:06.294 INFO:tasks.workunit.client.1.smithi092.stdout:4/359: mkdir d4/d13/d3b/d42/d76/d35/d3e/d7c 0 2024-09-17T01:52:06.295 INFO:tasks.workunit.client.1.smithi092.stdout:4/360: dread - d4/d5/f33 zero size 2024-09-17T01:52:06.295 INFO:tasks.workunit.client.0.smithi031.stdout:3/486: symlink db/df/d1d/d37/l8e 0 2024-09-17T01:52:06.296 INFO:tasks.workunit.client.1.smithi092.stdout:8/310: sync 2024-09-17T01:52:06.296 INFO:tasks.workunit.client.1.smithi092.stdout:9/314: sync 2024-09-17T01:52:06.296 INFO:tasks.workunit.client.1.smithi092.stdout:1/450: sync 2024-09-17T01:52:06.296 INFO:tasks.workunit.client.0.smithi031.stdout:1/535: write d4/d1e/d3f/d72/d7e/d92/f94 [814527,37216] 0 2024-09-17T01:52:06.298 INFO:tasks.workunit.client.1.smithi092.stdout:7/405: unlink d3/d6/d13/d21/l22 0 2024-09-17T01:52:06.300 INFO:tasks.workunit.client.1.smithi092.stdout:5/283: creat d0/de/d19/d1a/d1e/f5f x:0 0 0 2024-09-17T01:52:06.301 INFO:tasks.workunit.client.1.smithi092.stdout:3/329: unlink d4/d13/d2e/d5f/f66 0 2024-09-17T01:52:06.302 INFO:tasks.workunit.client.1.smithi092.stdout:0/421: creat d3/d2e/d3b/f82 x:0 0 0 2024-09-17T01:52:06.304 INFO:tasks.workunit.client.0.smithi031.stdout:4/666: creat d8/d3a/d41/d64/d4d/d5a/d8c/fd9 x:0 0 0 2024-09-17T01:52:06.304 INFO:tasks.workunit.client.0.smithi031.stdout:2/553: dread d1/d3/d45/d4a/f57 [0,4194304] 0 2024-09-17T01:52:06.305 INFO:tasks.workunit.client.1.smithi092.stdout:0/422: stat d3/da/d1c/d4a/l5a 0 2024-09-17T01:52:06.305 INFO:tasks.workunit.client.1.smithi092.stdout:9/315: unlink d0/d7/d12/d34/d26/d54/l44 0 2024-09-17T01:52:06.306 INFO:tasks.workunit.client.1.smithi092.stdout:4/361: dwrite d4/d5/d8/f34 [0,4194304] 0 2024-09-17T01:52:06.310 INFO:tasks.workunit.client.0.smithi031.stdout:1/536: rename d4/d1a/d43/f4c to d4/d1e/d8d/fb5 0 2024-09-17T01:52:06.311 INFO:tasks.workunit.client.0.smithi031.stdout:9/422: dwrite d3/d4/d41/d70/f84 [0,4194304] 0 2024-09-17T01:52:06.311 INFO:tasks.workunit.client.1.smithi092.stdout:5/284: creat d0/de/d19/d1a/d1e/d29/f60 x:0 0 0 2024-09-17T01:52:06.312 INFO:tasks.workunit.client.0.smithi031.stdout:1/537: chown d4/l7f 168577 1 2024-09-17T01:52:06.313 INFO:tasks.workunit.client.0.smithi031.stdout:9/423: truncate d3/d10/f60 4642293 0 2024-09-17T01:52:06.314 INFO:tasks.workunit.client.1.smithi092.stdout:7/406: dwrite d3/db/d26/d6f/f79 [0,4194304] 0 2024-09-17T01:52:06.314 INFO:tasks.workunit.client.1.smithi092.stdout:0/423: mknod d3/d2e/d3b/d48/c83 0 2024-09-17T01:52:06.316 INFO:tasks.workunit.client.0.smithi031.stdout:1/538: fdatasync d4/d1a/d2d/d18/f2e 0 2024-09-17T01:52:06.322 INFO:tasks.workunit.client.0.smithi031.stdout:9/424: symlink d3/d10/d36/d79/l86 0 2024-09-17T01:52:06.323 INFO:tasks.workunit.client.0.smithi031.stdout:0/500: dread d0/d29/d33/d2a/d25/f27 [0,4194304] 0 2024-09-17T01:52:06.326 INFO:tasks.workunit.client.1.smithi092.stdout:9/316: fdatasync d0/df/f27 0 2024-09-17T01:52:06.327 INFO:tasks.workunit.client.0.smithi031.stdout:8/468: dread d0/df/d19/d3d/f49 [0,4194304] 0 2024-09-17T01:52:06.328 INFO:tasks.workunit.client.1.smithi092.stdout:6/322: dwrite d3/d10/d1a/f24 [0,4194304] 0 2024-09-17T01:52:06.328 INFO:tasks.workunit.client.0.smithi031.stdout:4/667: creat d8/d3a/fda x:0 0 0 2024-09-17T01:52:06.329 INFO:tasks.workunit.client.1.smithi092.stdout:4/362: mkdir d4/d7b/d7d 0 2024-09-17T01:52:06.330 INFO:tasks.workunit.client.0.smithi031.stdout:9/425: dread d3/d4/d29/f78 [0,4194304] 0 2024-09-17T01:52:06.332 INFO:tasks.workunit.client.1.smithi092.stdout:3/330: link d4/d16/l19 d4/d13/l6a 0 2024-09-17T01:52:06.334 INFO:tasks.workunit.client.0.smithi031.stdout:9/426: read - d3/d19/d1f/f6b zero size 2024-09-17T01:52:06.336 INFO:tasks.workunit.client.0.smithi031.stdout:3/487: truncate db/f34 3399334 0 2024-09-17T01:52:06.338 INFO:tasks.workunit.client.1.smithi092.stdout:4/363: rmdir d4/d13/d3b/d42/d76/d41 39 2024-09-17T01:52:06.338 INFO:tasks.workunit.client.0.smithi031.stdout:0/501: dwrite d0/d29/d33/d2a/d25/f26 [0,4194304] 0 2024-09-17T01:52:06.339 INFO:tasks.workunit.client.0.smithi031.stdout:7/447: dread db/d29/f5d [0,4194304] 0 2024-09-17T01:52:06.341 INFO:tasks.workunit.client.0.smithi031.stdout:8/469: creat d0/df/f8a x:0 0 0 2024-09-17T01:52:06.343 INFO:tasks.workunit.client.0.smithi031.stdout:3/488: creat db/df/d1d/d37/d3a/f8f x:0 0 0 2024-09-17T01:52:06.345 INFO:tasks.workunit.client.0.smithi031.stdout:4/668: truncate d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/fd7 582976 0 2024-09-17T01:52:06.345 INFO:tasks.workunit.client.1.smithi092.stdout:3/331: mknod d4/d20/d31/c6b 0 2024-09-17T01:52:06.347 INFO:tasks.workunit.client.0.smithi031.stdout:0/502: readlink d0/d29/d33/d2a/d25/d38/l3a 0 2024-09-17T01:52:06.348 INFO:tasks.workunit.client.0.smithi031.stdout:8/470: chown d0/d5/c12 44 1 2024-09-17T01:52:06.348 INFO:tasks.workunit.client.0.smithi031.stdout:8/471: fdatasync d0/f70 0 2024-09-17T01:52:06.348 INFO:tasks.workunit.client.1.smithi092.stdout:3/332: fdatasync d4/f18 0 2024-09-17T01:52:06.350 INFO:tasks.workunit.client.0.smithi031.stdout:2/554: dwrite d1/d3/d2d/db2/d1e/d2a/f67 [0,4194304] 0 2024-09-17T01:52:06.350 INFO:tasks.workunit.client.1.smithi092.stdout:4/364: symlink d4/d5/l7e 0 2024-09-17T01:52:06.351 INFO:tasks.workunit.client.0.smithi031.stdout:7/448: symlink db/l82 0 2024-09-17T01:52:06.352 INFO:tasks.workunit.client.1.smithi092.stdout:9/317: link d0/d5/d3e/c4d d0/df/d5d/c5e 0 2024-09-17T01:52:06.352 INFO:tasks.workunit.client.0.smithi031.stdout:4/669: rmdir d8/d3a/d41/d64/d92 39 2024-09-17T01:52:06.353 INFO:tasks.workunit.client.1.smithi092.stdout:5/285: getdents d0/de/d19/d1a/d1e/d3e/d4c 0 2024-09-17T01:52:06.354 INFO:tasks.workunit.client.0.smithi031.stdout:0/503: dread - d0/d29/d33/d2a/d25/d30/d9c/fa0 zero size 2024-09-17T01:52:06.356 INFO:tasks.workunit.client.1.smithi092.stdout:5/286: fsync d0/d23/f2c 0 2024-09-17T01:52:06.358 INFO:tasks.workunit.client.0.smithi031.stdout:3/489: creat db/df/f90 x:0 0 0 2024-09-17T01:52:06.358 INFO:tasks.workunit.client.1.smithi092.stdout:6/323: dwrite d3/d10/d1f/d21/d28/d2b/f2e [4194304,4194304] 0 2024-09-17T01:52:06.360 INFO:tasks.workunit.client.1.smithi092.stdout:2/274: dread d10/d15/f2b [0,4194304] 0 2024-09-17T01:52:06.361 INFO:tasks.workunit.client.0.smithi031.stdout:7/449: read db/d18/f48 [89876,40901] 0 2024-09-17T01:52:06.362 INFO:tasks.workunit.client.1.smithi092.stdout:4/365: creat d4/d13/d3b/d42/d76/d35/f7f x:0 0 0 2024-09-17T01:52:06.362 INFO:tasks.workunit.client.0.smithi031.stdout:2/555: creat d1/d3/df/d18/d9f/fc2 x:0 0 0 2024-09-17T01:52:06.364 INFO:tasks.workunit.client.0.smithi031.stdout:2/556: dread - d1/d3/df/d18/d40/d43/f79 zero size 2024-09-17T01:52:06.364 INFO:tasks.workunit.client.1.smithi092.stdout:7/407: dread d3/d6/d13/d40/f4f [0,4194304] 0 2024-09-17T01:52:06.365 INFO:tasks.workunit.client.1.smithi092.stdout:8/311: write f7 [2190769,114245] 0 2024-09-17T01:52:06.365 INFO:tasks.workunit.client.0.smithi031.stdout:2/557: read - d1/d3/d45/d4a/f6d zero size 2024-09-17T01:52:06.366 INFO:tasks.workunit.client.1.smithi092.stdout:6/324: mknod d3/d10/d1f/d21/d1e/c64 0 2024-09-17T01:52:06.368 INFO:tasks.workunit.client.1.smithi092.stdout:6/325: write d3/d10/d1f/d21/d28/f2c [529805,10939] 0 2024-09-17T01:52:06.370 INFO:tasks.workunit.client.1.smithi092.stdout:2/275: truncate d10/d1d/d2c/f3d 1042609 0 2024-09-17T01:52:06.370 INFO:tasks.workunit.client.1.smithi092.stdout:9/318: dread d0/d5/f2a [0,4194304] 0 2024-09-17T01:52:06.370 INFO:tasks.workunit.client.0.smithi031.stdout:0/504: mknod d0/d29/d33/d5/dad/caf 0 2024-09-17T01:52:06.371 INFO:tasks.workunit.client.0.smithi031.stdout:3/490: symlink db/df/d1c/l91 0 2024-09-17T01:52:06.371 INFO:tasks.workunit.client.1.smithi092.stdout:3/333: rename d4/d2f/d44/d3c/l51 to d4/d2f/l6c 0 2024-09-17T01:52:06.373 INFO:tasks.workunit.client.0.smithi031.stdout:8/472: getdents d0/df/dd 0 2024-09-17T01:52:06.376 INFO:tasks.workunit.client.0.smithi031.stdout:1/539: dread d4/d1e/f3b [0,4194304] 0 2024-09-17T01:52:06.376 INFO:tasks.workunit.client.0.smithi031.stdout:4/670: write d8/f14 [1332359,120310] 0 2024-09-17T01:52:06.377 INFO:tasks.workunit.client.1.smithi092.stdout:6/326: dwrite d3/f36 [0,4194304] 0 2024-09-17T01:52:06.379 INFO:tasks.workunit.client.0.smithi031.stdout:2/558: dwrite d1/d3/d2d/db2/d1e/d2a/f95 [0,4194304] 0 2024-09-17T01:52:06.379 INFO:tasks.workunit.client.0.smithi031.stdout:8/473: chown d0/df/dd/l30 65099802 1 2024-09-17T01:52:06.380 INFO:tasks.workunit.client.1.smithi092.stdout:2/276: stat d10/d3a/c45 0 2024-09-17T01:52:06.381 INFO:tasks.workunit.client.0.smithi031.stdout:1/540: write d4/d3d/d65/fa1 [104624,13035] 0 2024-09-17T01:52:06.381 INFO:tasks.workunit.client.1.smithi092.stdout:2/277: read d10/d1d/f26 [41627,125301] 0 2024-09-17T01:52:06.382 INFO:tasks.workunit.client.1.smithi092.stdout:9/319: rename d0/d5/l33 to d0/df/d5d/l5f 0 2024-09-17T01:52:06.383 INFO:tasks.workunit.client.1.smithi092.stdout:2/278: read - d10/d1d/d24/f4f zero size 2024-09-17T01:52:06.383 INFO:tasks.workunit.client.0.smithi031.stdout:7/450: getdents db/d29 0 2024-09-17T01:52:06.385 INFO:tasks.workunit.client.1.smithi092.stdout:4/366: mkdir d4/d13/d3b/d42/d76/d80 0 2024-09-17T01:52:06.385 INFO:tasks.workunit.client.0.smithi031.stdout:5/423: sync 2024-09-17T01:52:06.386 INFO:tasks.workunit.client.1.smithi092.stdout:3/334: rename d4/d20/d3f/c5b to d4/d20/d3f/c6d 0 2024-09-17T01:52:06.386 INFO:tasks.workunit.client.1.smithi092.stdout:3/335: fsync d4/d20/f42 0 2024-09-17T01:52:06.388 INFO:tasks.workunit.client.1.smithi092.stdout:7/408: unlink d3/c45 0 2024-09-17T01:52:06.390 INFO:tasks.workunit.client.0.smithi031.stdout:7/451: read db/d29/f4e [2040818,33190] 0 2024-09-17T01:52:06.390 INFO:tasks.workunit.client.0.smithi031.stdout:8/474: rmdir d0/d5/d6c 39 2024-09-17T01:52:06.391 INFO:tasks.workunit.client.1.smithi092.stdout:6/327: creat d3/d10/d1f/d21/f65 x:0 0 0 2024-09-17T01:52:06.391 INFO:tasks.workunit.client.0.smithi031.stdout:4/671: dread d8/d3a/d41/d64/d4d/d8f/f97 [0,4194304] 0 2024-09-17T01:52:06.393 INFO:tasks.workunit.client.0.smithi031.stdout:7/452: dread - db/f51 zero size 2024-09-17T01:52:06.395 INFO:tasks.workunit.client.1.smithi092.stdout:2/279: write d10/f1a [3607268,60082] 0 2024-09-17T01:52:06.395 INFO:tasks.workunit.client.1.smithi092.stdout:5/287: link d0/de/d19/d1a/d1e/d3e/d4c/l56 d0/de/d19/d1a/d1e/d29/l61 0 2024-09-17T01:52:06.395 INFO:tasks.workunit.client.0.smithi031.stdout:9/427: dread d3/d4/f2f [0,4194304] 0 2024-09-17T01:52:06.395 INFO:tasks.workunit.client.0.smithi031.stdout:1/541: rename d4/d1a/f33 to d4/d3d/d65/d78/fb6 0 2024-09-17T01:52:06.396 INFO:tasks.workunit.client.1.smithi092.stdout:2/280: write d10/d15/f48 [845196,68127] 0 2024-09-17T01:52:06.396 INFO:tasks.workunit.client.1.smithi092.stdout:5/288: read d0/de/d19/d1a/f34 [2309813,66302] 0 2024-09-17T01:52:06.397 INFO:tasks.workunit.client.0.smithi031.stdout:3/491: link db/df/f1e db/df/d1c/d6a/f92 0 2024-09-17T01:52:06.398 INFO:tasks.workunit.client.0.smithi031.stdout:5/424: truncate da/dc/f3a 757035 0 2024-09-17T01:52:06.398 INFO:tasks.workunit.client.1.smithi092.stdout:8/312: write d15/f1d [842974,121266] 0 2024-09-17T01:52:06.399 INFO:tasks.workunit.client.1.smithi092.stdout:3/336: truncate d4/d2f/f4f 699858 0 2024-09-17T01:52:06.399 INFO:tasks.workunit.client.1.smithi092.stdout:7/409: symlink d3/db/d26/d65/l8c 0 2024-09-17T01:52:06.401 INFO:tasks.workunit.client.0.smithi031.stdout:0/505: dwrite d0/d29/f63 [0,4194304] 0 2024-09-17T01:52:06.401 INFO:tasks.workunit.client.1.smithi092.stdout:3/337: write d4/d16/d1b/f64 [1017227,50882] 0 2024-09-17T01:52:06.401 INFO:tasks.workunit.client.1.smithi092.stdout:6/328: symlink d3/d10/d1a/d43/d5e/l66 0 2024-09-17T01:52:06.406 INFO:tasks.workunit.client.1.smithi092.stdout:5/289: symlink d0/de/d19/d1a/d24/l62 0 2024-09-17T01:52:06.408 INFO:tasks.workunit.client.1.smithi092.stdout:8/313: unlink f9 0 2024-09-17T01:52:06.409 INFO:tasks.workunit.client.1.smithi092.stdout:3/338: rmdir d4/d2f/d44/d3c 39 2024-09-17T01:52:06.409 INFO:tasks.workunit.client.0.smithi031.stdout:1/542: read d4/d3d/d65/d78/fb6 [478397,130900] 0 2024-09-17T01:52:06.410 INFO:tasks.workunit.client.0.smithi031.stdout:4/672: truncate d8/d3a/d41/d64/d92/fb3 1097718 0 2024-09-17T01:52:06.414 INFO:tasks.workunit.client.1.smithi092.stdout:3/339: chown d4/d13/d2e/c41 39500 1 2024-09-17T01:52:06.414 INFO:tasks.workunit.client.1.smithi092.stdout:3/340: read - d4/d13/f63 zero size 2024-09-17T01:52:06.414 INFO:tasks.workunit.client.1.smithi092.stdout:6/329: mknod d3/d10/d1f/d21/c67 0 2024-09-17T01:52:06.415 INFO:tasks.workunit.client.0.smithi031.stdout:7/453: getdents db/d18/d67 0 2024-09-17T01:52:06.415 INFO:tasks.workunit.client.0.smithi031.stdout:4/673: chown d8/d3a/d41/d64/f7d 512899222 1 2024-09-17T01:52:06.415 INFO:tasks.workunit.client.0.smithi031.stdout:3/492: link db/df/d1d/d37/c55 db/df/d1d/d37/d4a/c93 0 2024-09-17T01:52:06.415 INFO:tasks.workunit.client.0.smithi031.stdout:4/674: fsync d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f9f 0 2024-09-17T01:52:06.417 INFO:tasks.workunit.client.1.smithi092.stdout:9/320: dread d0/df/f18 [0,4194304] 0 2024-09-17T01:52:06.417 INFO:tasks.workunit.client.0.smithi031.stdout:3/493: creat db/df/d1d/d37/d4a/f94 x:0 0 0 2024-09-17T01:52:06.418 INFO:tasks.workunit.client.1.smithi092.stdout:9/321: stat d0/d7/d12/d34/d26/d54/d2e/f41 0 2024-09-17T01:52:06.418 INFO:tasks.workunit.client.0.smithi031.stdout:1/543: mkdir d4/d3d/d65/db7 0 2024-09-17T01:52:06.419 INFO:tasks.workunit.client.1.smithi092.stdout:5/290: rmdir d0/de/d19/d3c/d41 39 2024-09-17T01:52:06.421 INFO:tasks.workunit.client.1.smithi092.stdout:8/314: symlink d15/d32/d40/d4c/l62 0 2024-09-17T01:52:06.421 INFO:tasks.workunit.client.0.smithi031.stdout:3/494: fsync db/df/d1c/d6a/f8c 0 2024-09-17T01:52:06.422 INFO:tasks.workunit.client.0.smithi031.stdout:2/559: dwrite d1/d3/df/d11/f15 [0,4194304] 0 2024-09-17T01:52:06.423 INFO:tasks.workunit.client.1.smithi092.stdout:7/410: truncate d3/d6/d13/d21/d2e/f85 2290305 0 2024-09-17T01:52:06.425 INFO:tasks.workunit.client.0.smithi031.stdout:7/454: link db/f16 db/d1c/d41/d6c/f83 0 2024-09-17T01:52:06.425 INFO:tasks.workunit.client.1.smithi092.stdout:2/281: creat d10/f5d x:0 0 0 2024-09-17T01:52:06.426 INFO:tasks.workunit.client.1.smithi092.stdout:4/367: write d4/d5/d1d/d30/f5b [866732,38046] 0 2024-09-17T01:52:06.427 INFO:tasks.workunit.client.0.smithi031.stdout:1/544: creat d4/d1e/d40/d84/fb8 x:0 0 0 2024-09-17T01:52:06.427 INFO:tasks.workunit.client.1.smithi092.stdout:7/411: truncate d3/d6/d13/d21/d2e/d6e/f86 211491 0 2024-09-17T01:52:06.430 INFO:tasks.workunit.client.1.smithi092.stdout:5/291: unlink d0/de/d19/d1a/d1e/c45 0 2024-09-17T01:52:06.431 INFO:tasks.workunit.client.0.smithi031.stdout:4/675: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/fd7 [0,4194304] 0 2024-09-17T01:52:06.431 INFO:tasks.workunit.client.0.smithi031.stdout:7/455: rmdir db/d1c/d41/d6c 39 2024-09-17T01:52:06.431 INFO:tasks.workunit.client.1.smithi092.stdout:3/341: mknod d4/c6e 0 2024-09-17T01:52:06.432 INFO:tasks.workunit.client.1.smithi092.stdout:6/330: dread d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:06.432 INFO:tasks.workunit.client.0.smithi031.stdout:2/560: write d1/d3/d45/d4a/f6d [364606,93992] 0 2024-09-17T01:52:06.435 INFO:tasks.workunit.client.0.smithi031.stdout:5/425: dread da/dc/d2e/f68 [0,4194304] 0 2024-09-17T01:52:06.436 INFO:tasks.workunit.client.0.smithi031.stdout:7/456: symlink db/d29/l84 0 2024-09-17T01:52:06.438 INFO:tasks.workunit.client.0.smithi031.stdout:3/495: dwrite db/f7d [0,4194304] 0 2024-09-17T01:52:06.439 INFO:tasks.workunit.client.1.smithi092.stdout:4/368: chown d4/l73 697120220 1 2024-09-17T01:52:06.440 INFO:tasks.workunit.client.0.smithi031.stdout:3/496: chown db/df/d1d/c5d 6 1 2024-09-17T01:52:06.441 INFO:tasks.workunit.client.0.smithi031.stdout:4/676: rmdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36 39 2024-09-17T01:52:06.441 INFO:tasks.workunit.client.0.smithi031.stdout:1/545: dwrite d4/d1e/d40/fa8 [0,4194304] 0 2024-09-17T01:52:06.442 INFO:tasks.workunit.client.1.smithi092.stdout:6/331: dwrite d3/fa [4194304,4194304] 0 2024-09-17T01:52:06.442 INFO:tasks.workunit.client.1.smithi092.stdout:6/332: fsync d3/f33 0 2024-09-17T01:52:06.443 INFO:tasks.workunit.client.0.smithi031.stdout:5/426: rmdir da/dc/d2e/d82 39 2024-09-17T01:52:06.448 INFO:tasks.workunit.client.0.smithi031.stdout:1/546: creat d4/d1e/d40/d84/fb9 x:0 0 0 2024-09-17T01:52:06.449 INFO:tasks.workunit.client.0.smithi031.stdout:7/457: symlink db/d1c/d41/l85 0 2024-09-17T01:52:06.451 INFO:tasks.workunit.client.0.smithi031.stdout:3/497: dwrite db/d29/f4e [0,4194304] 0 2024-09-17T01:52:06.451 INFO:tasks.workunit.client.0.smithi031.stdout:4/677: fsync d8/d3a/d41/d64/f6c 0 2024-09-17T01:52:06.454 INFO:tasks.workunit.client.1.smithi092.stdout:3/342: mkdir d4/d13/d2e/d6f 0 2024-09-17T01:52:06.454 INFO:tasks.workunit.client.0.smithi031.stdout:4/678: write d8/d3a/d41/d64/d4d/dae/fcb [490438,67254] 0 2024-09-17T01:52:06.455 INFO:tasks.workunit.client.1.smithi092.stdout:8/315: write d15/d25/f30 [402964,62725] 0 2024-09-17T01:52:06.456 INFO:tasks.workunit.client.1.smithi092.stdout:9/322: write d0/d5/f45 [803860,90960] 0 2024-09-17T01:52:06.457 INFO:tasks.workunit.client.1.smithi092.stdout:6/333: fdatasync d3/d10/d1f/f32 0 2024-09-17T01:52:06.458 INFO:tasks.workunit.client.0.smithi031.stdout:7/458: creat db/d1c/d41/d72/f86 x:0 0 0 2024-09-17T01:52:06.460 INFO:tasks.workunit.client.0.smithi031.stdout:2/561: write d1/d3/d2d/f55 [736520,41056] 0 2024-09-17T01:52:06.462 INFO:tasks.workunit.client.0.smithi031.stdout:3/498: rename db/df/d1d/d37/d65/l78 to db/df/d1d/d37/d65/l95 0 2024-09-17T01:52:06.462 INFO:tasks.workunit.client.0.smithi031.stdout:4/679: fdatasync d8/d3a/d41/d64/d4d/d5a/fab 0 2024-09-17T01:52:06.462 INFO:tasks.workunit.client.0.smithi031.stdout:7/459: symlink db/d29/l87 0 2024-09-17T01:52:06.463 INFO:tasks.workunit.client.0.smithi031.stdout:0/506: dread d0/d29/d33/d5/d78/f79 [0,4194304] 0 2024-09-17T01:52:06.464 INFO:tasks.workunit.client.1.smithi092.stdout:7/412: rename d3/d6/d13/d21/c42 to d3/d6/d13/d40/c8d 0 2024-09-17T01:52:06.464 INFO:tasks.workunit.client.0.smithi031.stdout:2/562: write d1/d3/df/d11/d30/f37 [1262170,90333] 0 2024-09-17T01:52:06.467 INFO:tasks.workunit.client.1.smithi092.stdout:9/323: mknod d0/d5/d3e/c60 0 2024-09-17T01:52:06.469 INFO:tasks.workunit.client.1.smithi092.stdout:6/334: mknod d3/d10/d1f/c68 0 2024-09-17T01:52:06.470 INFO:tasks.workunit.client.0.smithi031.stdout:7/460: rename db/d18/d79 to db/d1c/d41/d69/d88 0 2024-09-17T01:52:06.470 INFO:tasks.workunit.client.0.smithi031.stdout:2/563: rename d1/d3 to d1/d3/df/d11/d44/dc3 22 2024-09-17T01:52:06.470 INFO:tasks.workunit.client.1.smithi092.stdout:2/282: link d10/l40 d10/d5c/l5e 0 2024-09-17T01:52:06.471 INFO:tasks.workunit.client.0.smithi031.stdout:3/499: truncate db/df/d1d/f49 2011804 0 2024-09-17T01:52:06.471 INFO:tasks.workunit.client.0.smithi031.stdout:3/500: fsync db/df/f54 0 2024-09-17T01:52:06.472 INFO:tasks.workunit.client.1.smithi092.stdout:9/324: dread d0/df/d17/f38 [0,4194304] 0 2024-09-17T01:52:06.472 INFO:tasks.workunit.client.1.smithi092.stdout:8/316: mkdir d15/d25/d2b/d63 0 2024-09-17T01:52:06.472 INFO:tasks.workunit.client.0.smithi031.stdout:3/501: fdatasync db/df/f54 0 2024-09-17T01:52:06.473 INFO:tasks.workunit.client.1.smithi092.stdout:9/325: readlink d0/d7/lc 0 2024-09-17T01:52:06.473 INFO:tasks.workunit.client.0.smithi031.stdout:0/507: creat d0/d29/d33/d2a/d25/d30/d4a/d90/fb0 x:0 0 0 2024-09-17T01:52:06.473 INFO:tasks.workunit.client.0.smithi031.stdout:4/680: fsync d8/d3a/d41/f60 0 2024-09-17T01:52:06.473 INFO:tasks.workunit.client.1.smithi092.stdout:7/413: mknod d3/db/d26/d83/c8e 0 2024-09-17T01:52:06.474 INFO:tasks.workunit.client.1.smithi092.stdout:6/335: dread d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:06.477 INFO:tasks.workunit.client.1.smithi092.stdout:3/343: getdents d4/d13 0 2024-09-17T01:52:06.477 INFO:tasks.workunit.client.0.smithi031.stdout:7/461: creat db/f89 x:0 0 0 2024-09-17T01:52:06.478 INFO:tasks.workunit.client.1.smithi092.stdout:2/283: mknod d10/c5f 0 2024-09-17T01:52:06.479 INFO:tasks.workunit.client.1.smithi092.stdout:8/317: mknod d15/d32/c64 0 2024-09-17T01:52:06.480 INFO:tasks.workunit.client.1.smithi092.stdout:8/318: readlink d15/d25/d2b/d3d/l58 0 2024-09-17T01:52:06.481 INFO:tasks.workunit.client.1.smithi092.stdout:7/414: symlink d3/d6/d13/d21/l8f 0 2024-09-17T01:52:06.481 INFO:tasks.workunit.client.0.smithi031.stdout:2/564: dwrite d1/d3/df/d11/f26 [0,4194304] 0 2024-09-17T01:52:06.481 INFO:tasks.workunit.client.0.smithi031.stdout:7/462: creat db/d1c/d46/f8a x:0 0 0 2024-09-17T01:52:06.482 INFO:tasks.workunit.client.1.smithi092.stdout:8/319: truncate d15/f1f 4464393 0 2024-09-17T01:52:06.483 INFO:tasks.workunit.client.0.smithi031.stdout:3/502: dwrite db/df/f31 [4194304,4194304] 0 2024-09-17T01:52:06.483 INFO:tasks.workunit.client.1.smithi092.stdout:3/344: fsync d4/d13/d2e/d5f/f5c 0 2024-09-17T01:52:06.484 INFO:tasks.workunit.client.1.smithi092.stdout:3/345: write d4/d16/d1b/f47 [2056298,1451] 0 2024-09-17T01:52:06.486 INFO:tasks.workunit.client.1.smithi092.stdout:6/336: creat d3/d10/d1f/d21/d28/d2b/f69 x:0 0 0 2024-09-17T01:52:06.487 INFO:tasks.workunit.client.1.smithi092.stdout:9/326: dread d0/df/f47 [0,4194304] 0 2024-09-17T01:52:06.488 INFO:tasks.workunit.client.0.smithi031.stdout:3/503: write db/df/d1c/d6a/f76 [4302921,46276] 0 2024-09-17T01:52:06.489 INFO:tasks.workunit.client.0.smithi031.stdout:7/463: truncate db/f16 525346 0 2024-09-17T01:52:06.490 INFO:tasks.workunit.client.1.smithi092.stdout:6/337: chown d3/d10/d1f/d21/d28/d2b/d48/d19 3296 1 2024-09-17T01:52:06.491 INFO:tasks.workunit.client.1.smithi092.stdout:7/415: symlink d3/d6/d13/d21/l90 0 2024-09-17T01:52:06.492 INFO:tasks.workunit.client.0.smithi031.stdout:2/565: dwrite d1/d3/d2d/db2/d1e/d2a/f67 [0,4194304] 0 2024-09-17T01:52:06.493 INFO:tasks.workunit.client.0.smithi031.stdout:7/464: symlink db/d1c/d46/l8b 0 2024-09-17T01:52:06.497 INFO:tasks.workunit.client.1.smithi092.stdout:8/320: mknod d15/d25/d2b/c65 0 2024-09-17T01:52:06.497 INFO:tasks.workunit.client.0.smithi031.stdout:3/504: getdents db/df/d1d/d37 0 2024-09-17T01:52:06.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/327: dread d0/df/f18 [0,4194304] 0 2024-09-17T01:52:06.500 INFO:tasks.workunit.client.0.smithi031.stdout:2/566: dread d1/d3/d2d/db2/d1e/d2a/f95 [0,4194304] 0 2024-09-17T01:52:06.501 INFO:tasks.workunit.client.0.smithi031.stdout:3/505: mkdir db/df/d1d/d37/d6c/d96 0 2024-09-17T01:52:06.504 INFO:tasks.workunit.client.0.smithi031.stdout:3/506: mkdir db/df/d1d/d37/d4a/d97 0 2024-09-17T01:52:06.504 INFO:tasks.workunit.client.1.smithi092.stdout:7/416: mknod d3/d6/d13/d21/d2e/d6e/c91 0 2024-09-17T01:52:06.505 INFO:tasks.workunit.client.0.smithi031.stdout:2/567: symlink d1/d3/d2d/db2/d1e/d21/d98/lc4 0 2024-09-17T01:52:06.506 INFO:tasks.workunit.client.1.smithi092.stdout:9/328: creat d0/d7/d12/d34/d26/f61 x:0 0 0 2024-09-17T01:52:06.507 INFO:tasks.workunit.client.1.smithi092.stdout:9/329: chown d0/d7/lc 2450 1 2024-09-17T01:52:06.508 INFO:tasks.workunit.client.0.smithi031.stdout:3/507: unlink db/df/d50/f7f 0 2024-09-17T01:52:06.508 INFO:tasks.workunit.client.1.smithi092.stdout:7/417: rmdir d3/d6/d13/d40/d61 39 2024-09-17T01:52:06.508 INFO:tasks.workunit.client.0.smithi031.stdout:3/508: dread - db/f79 zero size 2024-09-17T01:52:06.509 INFO:tasks.workunit.client.0.smithi031.stdout:4/681: dread d8/d3a/d41/d64/d4d/f71 [0,4194304] 0 2024-09-17T01:52:06.510 INFO:tasks.workunit.client.1.smithi092.stdout:8/321: symlink d15/d32/d40/l66 0 2024-09-17T01:52:06.510 INFO:tasks.workunit.client.0.smithi031.stdout:3/509: readlink db/df/d1d/l84 0 2024-09-17T01:52:06.511 INFO:tasks.workunit.client.1.smithi092.stdout:5/292: truncate d0/d23/f48 223877 0 2024-09-17T01:52:06.511 INFO:tasks.workunit.client.0.smithi031.stdout:1/547: write d4/d1e/d8d/fb5 [937104,40817] 0 2024-09-17T01:52:06.513 INFO:tasks.workunit.client.0.smithi031.stdout:3/510: creat db/df/d1d/d37/d6c/f98 x:0 0 0 2024-09-17T01:52:06.513 INFO:tasks.workunit.client.0.smithi031.stdout:4/682: getdents d8/d3a/d41/d64/d4d/d8f/dd8 0 2024-09-17T01:52:06.514 INFO:tasks.workunit.client.1.smithi092.stdout:7/418: rename d3/d6/d13/d21/d2e/c48 to d3/db/d26/d65/c92 0 2024-09-17T01:52:06.515 INFO:tasks.workunit.client.0.smithi031.stdout:2/568: getdents d1/d3/df 0 2024-09-17T01:52:06.516 INFO:tasks.workunit.client.1.smithi092.stdout:8/322: symlink d15/d25/d2b/d3d/l67 0 2024-09-17T01:52:06.516 INFO:tasks.workunit.client.1.smithi092.stdout:5/293: dread d0/de/d19/d1a/d1e/d3e/d4c/f49 [0,4194304] 0 2024-09-17T01:52:06.516 INFO:tasks.workunit.client.0.smithi031.stdout:2/569: read - d1/f8f zero size 2024-09-17T01:52:06.517 INFO:tasks.workunit.client.1.smithi092.stdout:9/330: symlink d0/d7/l62 0 2024-09-17T01:52:06.518 INFO:tasks.workunit.client.0.smithi031.stdout:3/511: rmdir db/df/d1d/d37/d6c/d6e 39 2024-09-17T01:52:06.521 INFO:tasks.workunit.client.0.smithi031.stdout:1/548: rename d4/c7 to d4/d3d/d65/d78/cba 0 2024-09-17T01:52:06.521 INFO:tasks.workunit.client.0.smithi031.stdout:4/683: rmdir d8/d3a/d41/d55 39 2024-09-17T01:52:06.522 INFO:tasks.workunit.client.1.smithi092.stdout:7/419: dread d3/db/f4a [0,4194304] 0 2024-09-17T01:52:06.523 INFO:tasks.workunit.client.0.smithi031.stdout:4/684: write d8/fba [295895,75767] 0 2024-09-17T01:52:06.524 INFO:tasks.workunit.client.1.smithi092.stdout:9/331: unlink d0/df/l5b 0 2024-09-17T01:52:06.526 INFO:tasks.workunit.client.0.smithi031.stdout:2/570: dwrite d1/d3/f25 [0,4194304] 0 2024-09-17T01:52:06.527 INFO:tasks.workunit.client.1.smithi092.stdout:8/323: dwrite f1 [0,4194304] 0 2024-09-17T01:52:06.528 INFO:tasks.workunit.client.0.smithi031.stdout:4/685: fsync d8/fba 0 2024-09-17T01:52:06.528 INFO:tasks.workunit.client.0.smithi031.stdout:2/571: stat d1/d3/df/d11/c31 0 2024-09-17T01:52:06.529 INFO:tasks.workunit.client.1.smithi092.stdout:9/332: write d0/d7/d12/d34/d26/d54/d2e/f41 [1068170,130128] 0 2024-09-17T01:52:06.534 INFO:tasks.workunit.client.1.smithi092.stdout:8/324: write d15/d32/d40/d42/f55 [1778743,98908] 0 2024-09-17T01:52:06.534 INFO:tasks.workunit.client.0.smithi031.stdout:1/549: dwrite d4/d1e/d3f/f7c [4194304,4194304] 0 2024-09-17T01:52:06.534 INFO:tasks.workunit.client.1.smithi092.stdout:5/294: getdents d0/de/d19/d1a/d1e/d29 0 2024-09-17T01:52:06.538 INFO:tasks.workunit.client.0.smithi031.stdout:1/550: write d4/d1e/f4b [2749433,38654] 0 2024-09-17T01:52:06.539 INFO:tasks.workunit.client.0.smithi031.stdout:4/686: fsync d8/d3a/d41/d64/d4d/d5a/d8c/d25/fbb 0 2024-09-17T01:52:06.541 INFO:tasks.workunit.client.0.smithi031.stdout:1/551: truncate d4/d1e/d3f/f60 1265535 0 2024-09-17T01:52:06.542 INFO:tasks.workunit.client.1.smithi092.stdout:8/325: rename d15/f23 to d15/d25/f68 0 2024-09-17T01:52:06.543 INFO:tasks.workunit.client.0.smithi031.stdout:4/687: fdatasync d8/d3a/d41/d64/d4f/fc0 0 2024-09-17T01:52:06.544 INFO:tasks.workunit.client.0.smithi031.stdout:2/572: rename d1/d3/d2d/db2/d1e/d21/d34/cb9 to d1/d3/d2d/db2/d1e/d4f/d92/cc5 0 2024-09-17T01:52:06.547 INFO:tasks.workunit.client.0.smithi031.stdout:7/465: dread db/f15 [0,4194304] 0 2024-09-17T01:52:06.547 INFO:tasks.workunit.client.0.smithi031.stdout:0/508: truncate d0/d29/d33/d2a/d25/d38/f5e 3915233 0 2024-09-17T01:52:06.548 INFO:tasks.workunit.client.1.smithi092.stdout:6/338: write d3/d10/d1f/f30 [268560,3669] 0 2024-09-17T01:52:06.549 INFO:tasks.workunit.client.0.smithi031.stdout:7/466: write db/f81 [682170,33187] 0 2024-09-17T01:52:06.549 INFO:tasks.workunit.client.1.smithi092.stdout:9/333: dwrite d0/f4c [0,4194304] 0 2024-09-17T01:52:06.549 INFO:tasks.workunit.client.1.smithi092.stdout:3/346: write d4/d2f/d44/d3c/f45 [1622473,41525] 0 2024-09-17T01:52:06.550 INFO:tasks.workunit.client.1.smithi092.stdout:8/326: unlink d15/d32/d40/d4c/l62 0 2024-09-17T01:52:06.553 INFO:tasks.workunit.client.0.smithi031.stdout:0/509: read d0/d29/d33/d2a/d25/d30/d4a/f54 [3770249,69881] 0 2024-09-17T01:52:06.553 INFO:tasks.workunit.client.1.smithi092.stdout:2/284: dwrite d10/d1d/d2c/f57 [0,4194304] 0 2024-09-17T01:52:06.553 INFO:tasks.workunit.client.1.smithi092.stdout:5/295: creat d0/de/d19/d1a/d1e/d3e/f63 x:0 0 0 2024-09-17T01:52:06.555 INFO:tasks.workunit.client.0.smithi031.stdout:7/467: fsync db/d1c/f1d 0 2024-09-17T01:52:06.559 INFO:tasks.workunit.client.1.smithi092.stdout:3/347: dread d4/d20/d39/f5e [0,4194304] 0 2024-09-17T01:52:06.561 INFO:tasks.workunit.client.1.smithi092.stdout:5/296: symlink d0/l64 0 2024-09-17T01:52:06.561 INFO:tasks.workunit.client.0.smithi031.stdout:2/573: dwrite d1/d3/df/d11/f13 [0,4194304] 0 2024-09-17T01:52:06.562 INFO:tasks.workunit.client.1.smithi092.stdout:5/297: write d0/de/d19/f1f [9203820,120449] 0 2024-09-17T01:52:06.565 INFO:tasks.workunit.client.0.smithi031.stdout:3/512: getdents db/df/d1d/d37/d4a 0 2024-09-17T01:52:06.566 INFO:tasks.workunit.client.1.smithi092.stdout:6/339: rename d3/d10/d1f/d21/d28/d2b/d48/d19 to d3/d10/d1a/d43/d6a 0 2024-09-17T01:52:06.568 INFO:tasks.workunit.client.0.smithi031.stdout:0/510: dwrite d0/d29/d33/d2a/d25/f26 [0,4194304] 0 2024-09-17T01:52:06.568 INFO:tasks.workunit.client.1.smithi092.stdout:6/340: write d3/d10/d1f/d21/d28/d2b/f2e [6339256,72370] 0 2024-09-17T01:52:06.569 INFO:tasks.workunit.client.1.smithi092.stdout:6/341: write d3/fa [5587284,76570] 0 2024-09-17T01:52:06.571 INFO:tasks.workunit.client.1.smithi092.stdout:8/327: fsync d15/d32/d40/d42/f4b 0 2024-09-17T01:52:06.572 INFO:tasks.workunit.client.1.smithi092.stdout:8/328: write d15/f1d [1315620,13357] 0 2024-09-17T01:52:06.573 INFO:tasks.workunit.client.1.smithi092.stdout:3/348: mkdir d4/d20/d39/d70 0 2024-09-17T01:52:06.575 INFO:tasks.workunit.client.0.smithi031.stdout:3/513: mkdir db/df/d1c/d99 0 2024-09-17T01:52:06.575 INFO:tasks.workunit.client.1.smithi092.stdout:5/298: fsync d0/fd 0 2024-09-17T01:52:06.577 INFO:tasks.workunit.client.1.smithi092.stdout:2/285: creat d10/d1d/d2c/d56/f60 x:0 0 0 2024-09-17T01:52:06.582 INFO:tasks.workunit.client.0.smithi031.stdout:2/574: dwrite d1/d3/d2d/f8b [0,4194304] 0 2024-09-17T01:52:06.583 INFO:tasks.workunit.client.0.smithi031.stdout:4/688: dread d8/d3a/d41/d64/d4d/d5a/f96 [0,4194304] 0 2024-09-17T01:52:06.584 INFO:tasks.workunit.client.0.smithi031.stdout:2/575: dread - d1/d3/df/d11/d30/f82 zero size 2024-09-17T01:52:06.584 INFO:tasks.workunit.client.0.smithi031.stdout:7/468: link db/l45 db/d1c/d41/d6c/l8c 0 2024-09-17T01:52:06.584 INFO:tasks.workunit.client.1.smithi092.stdout:7/420: truncate d3/d6/d13/d21/d2e/d6e/f71 428415 0 2024-09-17T01:52:06.586 INFO:tasks.workunit.client.1.smithi092.stdout:5/299: dwrite d0/de/d19/d1a/d1e/f12 [0,4194304] 0 2024-09-17T01:52:06.588 INFO:tasks.workunit.client.0.smithi031.stdout:2/576: stat d1/d3/d2d/db2 0 2024-09-17T01:52:06.588 INFO:tasks.workunit.client.0.smithi031.stdout:1/552: dread d4/d1a/d2d/f68 [0,4194304] 0 2024-09-17T01:52:06.590 INFO:tasks.workunit.client.0.smithi031.stdout:1/553: truncate d4/d1a/d2d/f8b 1625921 0 2024-09-17T01:52:06.591 INFO:tasks.workunit.client.1.smithi092.stdout:6/342: creat d3/d10/d1f/d21/d28/d2b/d48/d18/f6b x:0 0 0 2024-09-17T01:52:06.591 INFO:tasks.workunit.client.0.smithi031.stdout:1/554: dread - d4/d1a/faf zero size 2024-09-17T01:52:06.595 INFO:tasks.workunit.client.1.smithi092.stdout:3/349: rename d4/d2f/c37 to d4/d16/d1b/c71 0 2024-09-17T01:52:06.598 INFO:tasks.workunit.client.1.smithi092.stdout:7/421: fdatasync d3/d6/d13/f7d 0 2024-09-17T01:52:06.599 INFO:tasks.workunit.client.0.smithi031.stdout:7/469: unlink db/d1c/d41/c80 0 2024-09-17T01:52:06.599 INFO:tasks.workunit.client.0.smithi031.stdout:3/514: getdents db/df/d1c/d6a 0 2024-09-17T01:52:06.599 INFO:tasks.workunit.client.1.smithi092.stdout:6/343: rmdir d3/d10/d1f 39 2024-09-17T01:52:06.601 INFO:tasks.workunit.client.0.smithi031.stdout:4/689: dwrite d8/d3a/d41/f60 [0,4194304] 0 2024-09-17T01:52:06.601 INFO:tasks.workunit.client.0.smithi031.stdout:4/690: readlink d8/d9c/lbe 0 2024-09-17T01:52:06.604 INFO:tasks.workunit.client.0.smithi031.stdout:6/629: sync 2024-09-17T01:52:06.605 INFO:tasks.workunit.client.0.smithi031.stdout:1/555: getdents d4/d1e/d3f/d72/d7e/d92 0 2024-09-17T01:52:06.606 INFO:tasks.workunit.client.1.smithi092.stdout:7/422: truncate d3/db/d26/f43 935137 0 2024-09-17T01:52:06.607 INFO:tasks.workunit.client.0.smithi031.stdout:1/556: read - d4/d3d/d65/d78/f80 zero size 2024-09-17T01:52:06.607 INFO:tasks.workunit.client.1.smithi092.stdout:8/329: rename d15/d32/d40/d42/d43/c47 to d15/d32/d3b/c69 0 2024-09-17T01:52:06.608 INFO:tasks.workunit.client.1.smithi092.stdout:8/330: fsync d15/d32/d3b/f5d 0 2024-09-17T01:52:06.608 INFO:tasks.workunit.client.0.smithi031.stdout:1/557: dread - d4/d1a/d2d/d18/f1c zero size 2024-09-17T01:52:06.609 INFO:tasks.workunit.client.0.smithi031.stdout:3/515: rename db/d29/c5a to db/df/d1d/d37/d6c/c9a 0 2024-09-17T01:52:06.609 INFO:tasks.workunit.client.1.smithi092.stdout:8/331: write d15/d25/d27/f3e [2958772,68022] 0 2024-09-17T01:52:06.610 INFO:tasks.workunit.client.0.smithi031.stdout:6/630: symlink d23/db4/d8a/ldb 0 2024-09-17T01:52:06.611 INFO:tasks.workunit.client.0.smithi031.stdout:3/516: read db/df/f31 [1687396,43972] 0 2024-09-17T01:52:06.612 INFO:tasks.workunit.client.0.smithi031.stdout:4/691: mkdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb 0 2024-09-17T01:52:06.612 INFO:tasks.workunit.client.1.smithi092.stdout:2/286: rename d10/l38 to d10/l61 0 2024-09-17T01:52:06.613 INFO:tasks.workunit.client.0.smithi031.stdout:1/558: creat d4/d1e/d3f/d72/d7e/da2/fbb x:0 0 0 2024-09-17T01:52:06.613 INFO:tasks.workunit.client.0.smithi031.stdout:4/692: read d8/d3a/f40 [219965,67577] 0 2024-09-17T01:52:06.613 INFO:tasks.workunit.client.0.smithi031.stdout:0/511: write d0/d29/d33/d2a/d25/d38/f65 [922005,90468] 0 2024-09-17T01:52:06.614 INFO:tasks.workunit.client.1.smithi092.stdout:6/344: symlink d3/d10/d1f/d21/d28/d2b/l6c 0 2024-09-17T01:52:06.615 INFO:tasks.workunit.client.1.smithi092.stdout:7/423: chown d3/d2b/d3a/f3e 83732 1 2024-09-17T01:52:06.617 INFO:tasks.workunit.client.1.smithi092.stdout:7/424: dread - d3/d6/f64 zero size 2024-09-17T01:52:06.621 INFO:tasks.workunit.client.1.smithi092.stdout:8/332: rename d15/d25/d2b/f36 to d15/f6a 0 2024-09-17T01:52:06.621 INFO:tasks.workunit.client.1.smithi092.stdout:2/287: dwrite d10/d1d/d24/f4f [0,4194304] 0 2024-09-17T01:52:06.621 INFO:tasks.workunit.client.0.smithi031.stdout:3/517: fsync db/df/d1d/d37/f4d 0 2024-09-17T01:52:06.621 INFO:tasks.workunit.client.0.smithi031.stdout:0/512: read d0/d29/d33/d2a/d25/d30/d4a/f64 [2997856,109783] 0 2024-09-17T01:52:06.622 INFO:tasks.workunit.client.0.smithi031.stdout:0/513: dread - d0/d29/d33/d2a/d25/da5/fa8 zero size 2024-09-17T01:52:06.622 INFO:tasks.workunit.client.1.smithi092.stdout:6/345: mknod d3/d10/d1f/d21/d1e/d55/c6d 0 2024-09-17T01:52:06.622 INFO:tasks.workunit.client.1.smithi092.stdout:8/333: stat d15/d25/d27 0 2024-09-17T01:52:06.622 INFO:tasks.workunit.client.1.smithi092.stdout:2/288: stat d10/d1d/d24/f29 0 2024-09-17T01:52:06.624 INFO:tasks.workunit.client.0.smithi031.stdout:4/693: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f9f [0,4194304] 0 2024-09-17T01:52:06.626 INFO:tasks.workunit.client.0.smithi031.stdout:6/631: rename d23/l29 to d23/db4/d64/dc1/ldc 0 2024-09-17T01:52:06.628 INFO:tasks.workunit.client.0.smithi031.stdout:7/470: write db/d29/f2e [4545995,101178] 0 2024-09-17T01:52:06.628 INFO:tasks.workunit.client.0.smithi031.stdout:7/471: chown l7 3510 1 2024-09-17T01:52:06.629 INFO:tasks.workunit.client.0.smithi031.stdout:7/472: truncate db/f51 448799 0 2024-09-17T01:52:06.630 INFO:tasks.workunit.client.1.smithi092.stdout:7/425: dwrite d3/d2b/d37/f8b [0,4194304] 0 2024-09-17T01:52:06.635 INFO:tasks.workunit.client.1.smithi092.stdout:2/289: rename d10/d1d/d2d/f4e to d10/d1d/d24/f62 0 2024-09-17T01:52:06.635 INFO:tasks.workunit.client.1.smithi092.stdout:8/334: dwrite d15/d25/f5a [0,4194304] 0 2024-09-17T01:52:06.636 INFO:tasks.workunit.client.0.smithi031.stdout:7/473: dread db/f15 [0,4194304] 0 2024-09-17T01:52:06.636 INFO:tasks.workunit.client.0.smithi031.stdout:1/559: mkdir d4/d1e/d3f/d4d/da5/dbc 0 2024-09-17T01:52:06.641 INFO:tasks.workunit.client.0.smithi031.stdout:3/518: write db/df/d1d/d37/f4d [429278,82228] 0 2024-09-17T01:52:06.641 INFO:tasks.workunit.client.0.smithi031.stdout:3/519: chown db/d29 231363 1 2024-09-17T01:52:06.642 INFO:tasks.workunit.client.0.smithi031.stdout:1/560: readlink d4/d1e/l2b 0 2024-09-17T01:52:06.643 INFO:tasks.workunit.client.0.smithi031.stdout:3/520: stat db/df/d1c/l4f 0 2024-09-17T01:52:06.643 INFO:tasks.workunit.client.0.smithi031.stdout:1/561: stat d4/d1a/c56 0 2024-09-17T01:52:06.644 INFO:tasks.workunit.client.0.smithi031.stdout:7/474: creat db/d1c/d41/d72/f8d x:0 0 0 2024-09-17T01:52:06.645 INFO:tasks.workunit.client.0.smithi031.stdout:0/514: symlink d0/d29/d44/lb1 0 2024-09-17T01:52:06.646 INFO:tasks.workunit.client.1.smithi092.stdout:5/300: truncate d0/de/d19/d1a/d1e/f12 905533 0 2024-09-17T01:52:06.647 INFO:tasks.workunit.client.0.smithi031.stdout:0/515: read - d0/f7d zero size 2024-09-17T01:52:06.647 INFO:tasks.workunit.client.0.smithi031.stdout:3/521: mkdir db/d9b 0 2024-09-17T01:52:06.647 INFO:tasks.workunit.client.0.smithi031.stdout:1/562: rmdir d4/d3d/d65/d78 39 2024-09-17T01:52:06.648 INFO:tasks.workunit.client.1.smithi092.stdout:2/290: read d10/d1d/d2c/f57 [1071254,97806] 0 2024-09-17T01:52:06.648 INFO:tasks.workunit.client.0.smithi031.stdout:1/563: fsync d4/d1a/d2d/d18/f2e 0 2024-09-17T01:52:06.648 INFO:tasks.workunit.client.0.smithi031.stdout:0/516: write d0/f1f [894542,4761] 0 2024-09-17T01:52:06.649 INFO:tasks.workunit.client.0.smithi031.stdout:7/475: mkdir db/d1c/d8e 0 2024-09-17T01:52:06.650 INFO:tasks.workunit.client.0.smithi031.stdout:1/564: chown d4/d1e/d40/d84/fb9 4069348 1 2024-09-17T01:52:06.651 INFO:tasks.workunit.client.1.smithi092.stdout:2/291: dread - d10/f5d zero size 2024-09-17T01:52:06.652 INFO:tasks.workunit.client.1.smithi092.stdout:6/346: rename d3/d10/d1f/d21/d28/d2b/l6c to d3/d10/d1a/d43/d6a/d3d/l6e 0 2024-09-17T01:52:06.652 INFO:tasks.workunit.client.1.smithi092.stdout:3/350: dwrite d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:06.652 INFO:tasks.workunit.client.0.smithi031.stdout:0/517: symlink d0/d29/d33/d5/d48/d8c/lb2 0 2024-09-17T01:52:06.653 INFO:tasks.workunit.client.1.smithi092.stdout:7/426: dwrite d3/d6/d13/d21/d2e/d6e/f53 [0,4194304] 0 2024-09-17T01:52:06.655 INFO:tasks.workunit.client.0.smithi031.stdout:1/565: link d4/d1e/d40/d84/fa6 d4/d1e/d3f/d72/d7e/da2/fbd 0 2024-09-17T01:52:06.656 INFO:tasks.workunit.client.0.smithi031.stdout:1/566: chown d4/d1a/d2d/d18/f31 0 1 2024-09-17T01:52:06.657 INFO:tasks.workunit.client.1.smithi092.stdout:5/301: truncate d0/de/d19/d1a/d1e/f36 4984589 0 2024-09-17T01:52:06.657 INFO:tasks.workunit.client.1.smithi092.stdout:3/351: read d4/d20/d39/f5e [2267738,129146] 0 2024-09-17T01:52:06.658 INFO:tasks.workunit.client.0.smithi031.stdout:7/476: read db/d1c/f5c [881124,38531] 0 2024-09-17T01:52:06.661 INFO:tasks.workunit.client.0.smithi031.stdout:0/518: rename d0/d29/d33/d2a/d25/d30 to d0/d29/da7/db3 0 2024-09-17T01:52:06.661 INFO:tasks.workunit.client.1.smithi092.stdout:2/292: write d10/d3a/f3c [959550,63401] 0 2024-09-17T01:52:06.661 INFO:tasks.workunit.client.1.smithi092.stdout:2/293: stat d10/d3a/l59 0 2024-09-17T01:52:06.663 INFO:tasks.workunit.client.0.smithi031.stdout:4/694: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/fb1 [0,4194304] 0 2024-09-17T01:52:06.664 INFO:tasks.workunit.client.0.smithi031.stdout:7/477: truncate db/f15 4159479 0 2024-09-17T01:52:06.665 INFO:tasks.workunit.client.0.smithi031.stdout:0/519: readlink d0/d29/l36 0 2024-09-17T01:52:06.665 INFO:tasks.workunit.client.1.smithi092.stdout:3/352: mknod d4/d20/d3f/c72 0 2024-09-17T01:52:06.666 INFO:tasks.workunit.client.0.smithi031.stdout:1/567: symlink d4/d3d/d65/lbe 0 2024-09-17T01:52:06.666 INFO:tasks.workunit.client.0.smithi031.stdout:7/478: write db/d1c/f40 [30713,65586] 0 2024-09-17T01:52:06.667 INFO:tasks.workunit.client.1.smithi092.stdout:5/302: symlink d0/de/d19/d1a/l65 0 2024-09-17T01:52:06.668 INFO:tasks.workunit.client.0.smithi031.stdout:1/568: chown d4/d1e/f4b 868695 1 2024-09-17T01:52:06.669 INFO:tasks.workunit.client.0.smithi031.stdout:4/695: rmdir d8/d3a/d41/d64/d92 39 2024-09-17T01:52:06.670 INFO:tasks.workunit.client.1.smithi092.stdout:2/294: mkdir d10/d1d/d2d/d63 0 2024-09-17T01:52:06.671 INFO:tasks.workunit.client.1.smithi092.stdout:6/347: creat d3/d10/f6f x:0 0 0 2024-09-17T01:52:06.672 INFO:tasks.workunit.client.0.smithi031.stdout:7/479: read db/f1f [2634315,97806] 0 2024-09-17T01:52:06.672 INFO:tasks.workunit.client.0.smithi031.stdout:1/569: dread d4/d1e/d3f/d72/f7a [0,4194304] 0 2024-09-17T01:52:06.673 INFO:tasks.workunit.client.1.smithi092.stdout:7/427: dwrite d3/d6/d13/d40/d60/f88 [0,4194304] 0 2024-09-17T01:52:06.673 INFO:tasks.workunit.client.1.smithi092.stdout:5/303: dread - d0/de/d19/d3c/d41/f43 zero size 2024-09-17T01:52:06.673 INFO:tasks.workunit.client.0.smithi031.stdout:4/696: creat d8/d3a/d7e/fdc x:0 0 0 2024-09-17T01:52:06.674 INFO:tasks.workunit.client.1.smithi092.stdout:3/353: dread d4/d16/d1b/f47 [4194304,4194304] 0 2024-09-17T01:52:06.674 INFO:tasks.workunit.client.0.smithi031.stdout:1/570: readlink d4/d1e/d3f/d72/d7e/da2/la3 0 2024-09-17T01:52:06.675 INFO:tasks.workunit.client.0.smithi031.stdout:7/480: chown db/d1c/c36 614094636 1 2024-09-17T01:52:06.675 INFO:tasks.workunit.client.1.smithi092.stdout:2/295: creat d10/d55/f64 x:0 0 0 2024-09-17T01:52:06.677 INFO:tasks.workunit.client.1.smithi092.stdout:7/428: mkdir d3/d6/d13/d40/d60/d93 0 2024-09-17T01:52:06.679 INFO:tasks.workunit.client.0.smithi031.stdout:7/481: rmdir db/d18/d67 39 2024-09-17T01:52:06.679 INFO:tasks.workunit.client.1.smithi092.stdout:2/296: dread - d10/d15/f3e zero size 2024-09-17T01:52:06.679 INFO:tasks.workunit.client.1.smithi092.stdout:7/429: write d3/d2b/d37/f8b [5173575,83181] 0 2024-09-17T01:52:06.679 INFO:tasks.workunit.client.1.smithi092.stdout:3/354: mkdir d4/d73 0 2024-09-17T01:52:06.680 INFO:tasks.workunit.client.0.smithi031.stdout:0/520: dwrite d0/d29/d33/d5/fa [4194304,4194304] 0 2024-09-17T01:52:06.681 INFO:tasks.workunit.client.1.smithi092.stdout:5/304: creat d0/de/d19/d1a/d1e/d29/f66 x:0 0 0 2024-09-17T01:52:06.682 INFO:tasks.workunit.client.1.smithi092.stdout:7/430: write d3/d6/d13/d40/f6c [642494,47793] 0 2024-09-17T01:52:06.685 INFO:tasks.workunit.client.0.smithi031.stdout:4/697: rename d8/d3a/d41/d64/d4d/d8f/f95 to d8/d3a/d41/d64/d86/fdd 0 2024-09-17T01:52:06.685 INFO:tasks.workunit.client.1.smithi092.stdout:3/355: mkdir d4/d13/d2e/d74 0 2024-09-17T01:52:06.688 INFO:tasks.workunit.client.1.smithi092.stdout:5/305: symlink d0/l67 0 2024-09-17T01:52:06.689 INFO:tasks.workunit.client.1.smithi092.stdout:2/297: mknod d10/d5c/c65 0 2024-09-17T01:52:06.690 INFO:tasks.workunit.client.1.smithi092.stdout:3/356: rmdir d4/d2f/d44 39 2024-09-17T01:52:06.691 INFO:tasks.workunit.client.0.smithi031.stdout:0/521: rmdir d0/d29/d33 39 2024-09-17T01:52:06.695 INFO:tasks.workunit.client.1.smithi092.stdout:8/335: dwrite d15/d25/d27/f41 [0,4194304] 0 2024-09-17T01:52:06.695 INFO:tasks.workunit.client.1.smithi092.stdout:2/298: mkdir d10/d1d/d2c/d56/d66 0 2024-09-17T01:52:06.695 INFO:tasks.workunit.client.0.smithi031.stdout:7/482: symlink db/d18/d67/l8f 0 2024-09-17T01:52:06.696 INFO:tasks.workunit.client.1.smithi092.stdout:8/336: fdatasync d15/d32/d3b/f5d 0 2024-09-17T01:52:06.696 INFO:tasks.workunit.client.1.smithi092.stdout:2/299: write d10/f5d [639196,101316] 0 2024-09-17T01:52:06.698 INFO:tasks.workunit.client.0.smithi031.stdout:1/571: link d4/d1a/d2d/fa d4/dac/fbf 0 2024-09-17T01:52:06.700 INFO:tasks.workunit.client.1.smithi092.stdout:1/451: sync 2024-09-17T01:52:06.701 INFO:tasks.workunit.client.0.smithi031.stdout:0/522: dwrite d0/d29/da7/db3/f77 [0,4194304] 0 2024-09-17T01:52:06.701 INFO:tasks.workunit.client.1.smithi092.stdout:6/348: dread d3/d10/d1f/d21/f3b [0,4194304] 0 2024-09-17T01:52:06.702 INFO:tasks.workunit.client.1.smithi092.stdout:3/357: rmdir d4/d2f/d69 0 2024-09-17T01:52:06.702 INFO:tasks.workunit.client.0.smithi031.stdout:7/483: creat db/d1c/d41/d72/f90 x:0 0 0 2024-09-17T01:52:06.704 INFO:tasks.workunit.client.0.smithi031.stdout:4/698: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fc3 to d8/d3a/fde 0 2024-09-17T01:52:06.705 INFO:tasks.workunit.client.1.smithi092.stdout:1/452: symlink db/d6c/d7e/l8e 0 2024-09-17T01:52:06.706 INFO:tasks.workunit.client.0.smithi031.stdout:7/484: chown db/f51 14907 1 2024-09-17T01:52:06.707 INFO:tasks.workunit.client.1.smithi092.stdout:8/337: mkdir d15/d32/d40/d42/d6b 0 2024-09-17T01:52:06.708 INFO:tasks.workunit.client.1.smithi092.stdout:2/300: creat d10/d1d/d2c/d56/d66/f67 x:0 0 0 2024-09-17T01:52:06.709 INFO:tasks.workunit.client.1.smithi092.stdout:8/338: read d15/d25/f29 [1309008,89652] 0 2024-09-17T01:52:06.710 INFO:tasks.workunit.client.0.smithi031.stdout:0/523: mknod d0/d29/d33/d5b/cb4 0 2024-09-17T01:52:06.711 INFO:tasks.workunit.client.0.smithi031.stdout:7/485: mknod db/d1c/c91 0 2024-09-17T01:52:06.713 INFO:tasks.workunit.client.0.smithi031.stdout:1/572: dwrite d4/d1e/d40/d84/f97 [0,4194304] 0 2024-09-17T01:52:06.713 INFO:tasks.workunit.client.0.smithi031.stdout:4/699: mknod d8/d3a/d41/d64/d92/cdf 0 2024-09-17T01:52:06.713 INFO:tasks.workunit.client.0.smithi031.stdout:7/486: chown db/d1c/d46/f52 0 1 2024-09-17T01:52:06.714 INFO:tasks.workunit.client.0.smithi031.stdout:1/573: stat d4/dac 0 2024-09-17T01:52:06.715 INFO:tasks.workunit.client.1.smithi092.stdout:1/453: symlink db/d1d/d23/d34/l8f 0 2024-09-17T01:52:06.716 INFO:tasks.workunit.client.0.smithi031.stdout:0/524: truncate d0/d29/da7/db3/d4a/d90/d9b/fa9 646621 0 2024-09-17T01:52:06.718 INFO:tasks.workunit.client.0.smithi031.stdout:4/700: truncate d8/d3a/d41/d64/f7d 795097 0 2024-09-17T01:52:06.719 INFO:tasks.workunit.client.0.smithi031.stdout:7/487: dread db/f10 [0,4194304] 0 2024-09-17T01:52:06.720 INFO:tasks.workunit.client.1.smithi092.stdout:2/301: mknod d10/d15/c68 0 2024-09-17T01:52:06.721 INFO:tasks.workunit.client.0.smithi031.stdout:0/525: mknod d0/d29/da7/db3/d4a/d90/d9b/cb5 0 2024-09-17T01:52:06.722 INFO:tasks.workunit.client.0.smithi031.stdout:4/701: rename d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f9f to d8/d9c/fe0 0 2024-09-17T01:52:06.724 INFO:tasks.workunit.client.1.smithi092.stdout:5/306: dread d0/fc [0,4194304] 0 2024-09-17T01:52:06.724 INFO:tasks.workunit.client.1.smithi092.stdout:6/349: dread f1 [0,4194304] 0 2024-09-17T01:52:06.724 INFO:tasks.workunit.client.0.smithi031.stdout:0/526: dread - d0/f68 zero size 2024-09-17T01:52:06.725 INFO:tasks.workunit.client.1.smithi092.stdout:1/454: mknod db/d1d/d23/c90 0 2024-09-17T01:52:06.726 INFO:tasks.workunit.client.0.smithi031.stdout:0/527: chown d0/d29/da7/db3/d4a/f64 125 1 2024-09-17T01:52:06.726 INFO:tasks.workunit.client.0.smithi031.stdout:4/702: symlink d8/d3a/d41/d64/d86/le1 0 2024-09-17T01:52:06.727 INFO:tasks.workunit.client.1.smithi092.stdout:7/431: truncate d3/db/f54 2831285 0 2024-09-17T01:52:06.727 INFO:tasks.workunit.client.0.smithi031.stdout:7/488: link db/l82 db/l92 0 2024-09-17T01:52:06.728 INFO:tasks.workunit.client.1.smithi092.stdout:6/350: mkdir d3/d70 0 2024-09-17T01:52:06.729 INFO:tasks.workunit.client.1.smithi092.stdout:5/307: unlink d0/de/l2f 0 2024-09-17T01:52:06.730 INFO:tasks.workunit.client.0.smithi031.stdout:4/703: unlink d8/d3a/d41/d64/c1a 0 2024-09-17T01:52:06.731 INFO:tasks.workunit.client.0.smithi031.stdout:0/528: creat d0/d29/d33/d5/d48/d56/fb6 x:0 0 0 2024-09-17T01:52:06.732 INFO:tasks.workunit.client.1.smithi092.stdout:7/432: mknod d3/db/d26/c94 0 2024-09-17T01:52:06.733 INFO:tasks.workunit.client.0.smithi031.stdout:7/489: creat db/d18/f93 x:0 0 0 2024-09-17T01:52:06.734 INFO:tasks.workunit.client.0.smithi031.stdout:0/529: creat d0/d37/fb7 x:0 0 0 2024-09-17T01:52:06.734 INFO:tasks.workunit.client.1.smithi092.stdout:5/308: fdatasync d0/de/d19/d1a/d1e/f12 0 2024-09-17T01:52:06.735 INFO:tasks.workunit.client.0.smithi031.stdout:0/530: dread - d0/d29/fa2 zero size 2024-09-17T01:52:06.735 INFO:tasks.workunit.client.1.smithi092.stdout:7/433: symlink d3/d6/d13/d40/d6a/l95 0 2024-09-17T01:52:06.735 INFO:tasks.workunit.client.1.smithi092.stdout:1/455: dread db/d1d/f64 [0,4194304] 0 2024-09-17T01:52:06.736 INFO:tasks.workunit.client.0.smithi031.stdout:0/531: write d0/d29/da7/db3/d9c/fa0 [22491,54992] 0 2024-09-17T01:52:06.737 INFO:tasks.workunit.client.1.smithi092.stdout:6/351: dwrite d3/d10/d1f/d21/d28/d2b/d48/d18/f27 [4194304,4194304] 0 2024-09-17T01:52:06.738 INFO:tasks.workunit.client.1.smithi092.stdout:5/309: write d0/de/d19/d1a/d1e/f18 [1621279,92434] 0 2024-09-17T01:52:06.739 INFO:tasks.workunit.client.0.smithi031.stdout:0/532: readlink d0/d29/d44/l7b 0 2024-09-17T01:52:06.739 INFO:tasks.workunit.client.0.smithi031.stdout:7/490: symlink db/d29/l94 0 2024-09-17T01:52:06.739 INFO:tasks.workunit.client.0.smithi031.stdout:4/704: getdents d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91 0 2024-09-17T01:52:06.740 INFO:tasks.workunit.client.1.smithi092.stdout:6/352: chown d3/d10 0 1 2024-09-17T01:52:06.741 INFO:tasks.workunit.client.1.smithi092.stdout:1/456: fsync db/d3b/f48 0 2024-09-17T01:52:06.742 INFO:tasks.workunit.client.0.smithi031.stdout:7/491: mkdir db/d1c/d46/d95 0 2024-09-17T01:52:06.745 INFO:tasks.workunit.client.0.smithi031.stdout:0/533: creat d0/d29/fb8 x:0 0 0 2024-09-17T01:52:06.745 INFO:tasks.workunit.client.1.smithi092.stdout:7/434: creat d3/db/d26/d83/f96 x:0 0 0 2024-09-17T01:52:06.749 INFO:tasks.workunit.client.0.smithi031.stdout:4/705: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/fe2 x:0 0 0 2024-09-17T01:52:06.751 INFO:tasks.workunit.client.0.smithi031.stdout:0/534: mkdir d0/d37/db9 0 2024-09-17T01:52:06.751 INFO:tasks.workunit.client.1.smithi092.stdout:6/353: dwrite d3/d10/d1f/d21/d28/d2b/d48/d18/f27 [4194304,4194304] 0 2024-09-17T01:52:06.751 INFO:tasks.workunit.client.1.smithi092.stdout:5/310: mkdir d0/d50/d68 0 2024-09-17T01:52:06.751 INFO:tasks.workunit.client.0.smithi031.stdout:7/492: mknod db/d1c/d46/d95/c96 0 2024-09-17T01:52:06.752 INFO:tasks.workunit.client.1.smithi092.stdout:8/339: dread f14 [0,4194304] 0 2024-09-17T01:52:06.753 INFO:tasks.workunit.client.0.smithi031.stdout:4/706: mkdir d8/d3a/d41/d64/d4d/d5a/d79/de3 0 2024-09-17T01:52:06.754 INFO:tasks.workunit.client.1.smithi092.stdout:5/311: write d0/de/d19/d1a/d1e/d29/f66 [1005813,104119] 0 2024-09-17T01:52:06.754 INFO:tasks.workunit.client.0.smithi031.stdout:3/522: truncate db/df/d1d/d37/f4d 276402 0 2024-09-17T01:52:06.755 INFO:tasks.workunit.client.1.smithi092.stdout:1/457: rename db/d1d/d23/c79 to db/d6c/d7a/c91 0 2024-09-17T01:52:06.756 INFO:tasks.workunit.client.0.smithi031.stdout:4/707: write d8/fad [920555,63560] 0 2024-09-17T01:52:06.757 INFO:tasks.workunit.client.1.smithi092.stdout:6/354: symlink d3/d10/d1f/d21/d28/d2b/d48/d18/l71 0 2024-09-17T01:52:06.759 INFO:tasks.workunit.client.1.smithi092.stdout:6/355: readlink d3/d10/d1a/d43/d6a/d3d/l40 0 2024-09-17T01:52:06.761 INFO:tasks.workunit.client.0.smithi031.stdout:3/523: fdatasync db/df/d1d/d37/f72 0 2024-09-17T01:52:06.761 INFO:tasks.workunit.client.1.smithi092.stdout:5/312: fsync d0/de/d19/d1a/d1e/d3e/f59 0 2024-09-17T01:52:06.761 INFO:tasks.workunit.client.1.smithi092.stdout:2/302: dread d10/d1d/d2c/f39 [0,4194304] 0 2024-09-17T01:52:06.762 INFO:tasks.workunit.client.0.smithi031.stdout:1/574: write d4/d1a/d43/f51 [447062,38837] 0 2024-09-17T01:52:06.764 INFO:tasks.workunit.client.0.smithi031.stdout:4/708: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/fe4 x:0 0 0 2024-09-17T01:52:06.764 INFO:tasks.workunit.client.0.smithi031.stdout:4/709: chown d8/d3a/c74 260921 1 2024-09-17T01:52:06.764 INFO:tasks.workunit.client.1.smithi092.stdout:7/435: rename d3/db/f1e to d3/d6/d13/d21/d2e/f97 0 2024-09-17T01:52:06.766 INFO:tasks.workunit.client.1.smithi092.stdout:1/458: mknod db/d1d/d23/c92 0 2024-09-17T01:52:06.766 INFO:tasks.workunit.client.0.smithi031.stdout:0/535: getdents d0/d29/d33/d84 0 2024-09-17T01:52:06.767 INFO:tasks.workunit.client.0.smithi031.stdout:0/536: stat d0/d29/d33/d2a/d25/d38 0 2024-09-17T01:52:06.769 INFO:tasks.workunit.client.0.smithi031.stdout:3/524: creat db/df/d1d/d37/d65/f9c x:0 0 0 2024-09-17T01:52:06.770 INFO:tasks.workunit.client.0.smithi031.stdout:0/537: dread d0/d29/da7/db3/d4a/d90/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:06.771 INFO:tasks.workunit.client.1.smithi092.stdout:6/356: mkdir d3/d10/d1a/d43/d6a/d3d/d72 0 2024-09-17T01:52:06.771 INFO:tasks.workunit.client.0.smithi031.stdout:4/710: creat d8/d3a/d41/d64/d4f/fe5 x:0 0 0 2024-09-17T01:52:06.772 INFO:tasks.workunit.client.1.smithi092.stdout:7/436: rmdir d3/d6/d13/d40/d60 39 2024-09-17T01:52:06.773 INFO:tasks.workunit.client.0.smithi031.stdout:1/575: mknod d4/d1e/d40/daa/cc0 0 2024-09-17T01:52:06.773 INFO:tasks.workunit.client.0.smithi031.stdout:7/493: dread db/d1c/f63 [0,4194304] 0 2024-09-17T01:52:06.774 INFO:tasks.workunit.client.1.smithi092.stdout:7/437: truncate d3/d6/d13/d21/f5c 457179 0 2024-09-17T01:52:06.777 INFO:tasks.workunit.client.1.smithi092.stdout:2/303: rename cc to d10/d4c/c69 0 2024-09-17T01:52:06.777 INFO:tasks.workunit.client.1.smithi092.stdout:2/304: dread - d10/d55/f64 zero size 2024-09-17T01:52:06.778 INFO:tasks.workunit.client.0.smithi031.stdout:1/576: creat d4/d1e/d40/d84/fc1 x:0 0 0 2024-09-17T01:52:06.778 INFO:tasks.workunit.client.1.smithi092.stdout:8/340: getdents d15/d32/d3b 0 2024-09-17T01:52:06.778 INFO:tasks.workunit.client.1.smithi092.stdout:1/459: dread db/f5f [0,4194304] 0 2024-09-17T01:52:06.779 INFO:tasks.workunit.client.0.smithi031.stdout:0/538: dwrite d0/d29/d33/d5/fa [4194304,4194304] 0 2024-09-17T01:52:06.780 INFO:tasks.workunit.client.0.smithi031.stdout:1/577: dread - d4/d1e/d3f/d72/d7e/da2/fbd zero size 2024-09-17T01:52:06.781 INFO:tasks.workunit.client.0.smithi031.stdout:7/494: mknod db/d1c/d46/d95/c97 0 2024-09-17T01:52:06.782 INFO:tasks.workunit.client.1.smithi092.stdout:7/438: mkdir d3/db/d98 0 2024-09-17T01:52:06.783 INFO:tasks.workunit.client.0.smithi031.stdout:1/578: write d4/d3d/f57 [530973,90187] 0 2024-09-17T01:52:06.784 INFO:tasks.workunit.client.1.smithi092.stdout:7/439: chown d3/d6/d13/d40/d61/l67 17925540 1 2024-09-17T01:52:06.784 INFO:tasks.workunit.client.0.smithi031.stdout:4/711: mkdir d8/d3a/d41/de6 0 2024-09-17T01:52:06.784 INFO:tasks.workunit.client.0.smithi031.stdout:7/495: chown db/d1c/d41/c78 6354 1 2024-09-17T01:52:06.785 INFO:tasks.workunit.client.0.smithi031.stdout:4/712: chown d8/l6a 1022 1 2024-09-17T01:52:06.786 INFO:tasks.workunit.client.1.smithi092.stdout:7/440: write d3/d6/d13/d21/f38 [670736,61693] 0 2024-09-17T01:52:06.787 INFO:tasks.workunit.client.1.smithi092.stdout:2/305: rmdir d10/d4c 39 2024-09-17T01:52:06.788 INFO:tasks.workunit.client.0.smithi031.stdout:0/539: mkdir d0/d37/dba 0 2024-09-17T01:52:06.789 INFO:tasks.workunit.client.1.smithi092.stdout:5/313: dread d0/d23/f4d [0,4194304] 0 2024-09-17T01:52:06.789 INFO:tasks.workunit.client.1.smithi092.stdout:8/341: truncate d15/d25/f2d 572243 0 2024-09-17T01:52:06.790 INFO:tasks.workunit.client.0.smithi031.stdout:0/540: write d0/f8a [530169,115008] 0 2024-09-17T01:52:06.790 INFO:tasks.workunit.client.0.smithi031.stdout:0/541: stat d0/d29/da7/db3 0 2024-09-17T01:52:06.792 INFO:tasks.workunit.client.1.smithi092.stdout:7/441: creat d3/d6/d13/d21/d2e/d6e/f99 x:0 0 0 2024-09-17T01:52:06.794 INFO:tasks.workunit.client.0.smithi031.stdout:7/496: creat db/d1c/d41/d72/f98 x:0 0 0 2024-09-17T01:52:06.794 INFO:tasks.workunit.client.1.smithi092.stdout:1/460: link db/d1d/d4b/f7f db/d1d/d44/f93 0 2024-09-17T01:52:06.794 INFO:tasks.workunit.client.1.smithi092.stdout:2/306: dread - d10/d1d/d2c/d56/f60 zero size 2024-09-17T01:52:06.795 INFO:tasks.workunit.client.0.smithi031.stdout:3/525: dread db/f46 [0,4194304] 0 2024-09-17T01:52:06.795 INFO:tasks.workunit.client.0.smithi031.stdout:4/713: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/fe7 x:0 0 0 2024-09-17T01:52:06.795 INFO:tasks.workunit.client.1.smithi092.stdout:6/357: getdents d3/d10/d1a/d43 0 2024-09-17T01:52:06.797 INFO:tasks.workunit.client.1.smithi092.stdout:8/342: rename d15/l3a to d15/d25/d2b/d3d/l6c 0 2024-09-17T01:52:06.798 INFO:tasks.workunit.client.1.smithi092.stdout:6/358: dread - d3/d10/d1f/d21/f65 zero size 2024-09-17T01:52:06.799 INFO:tasks.workunit.client.0.smithi031.stdout:1/579: creat d4/d3d/d65/db7/fc2 x:0 0 0 2024-09-17T01:52:06.799 INFO:tasks.workunit.client.1.smithi092.stdout:7/442: read d3/d6/d13/d21/d2e/d6e/f20 [1948398,50669] 0 2024-09-17T01:52:06.799 INFO:tasks.workunit.client.0.smithi031.stdout:3/526: truncate db/df/f90 526557 0 2024-09-17T01:52:06.800 INFO:tasks.workunit.client.0.smithi031.stdout:4/714: fdatasync d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/fe4 0 2024-09-17T01:52:06.800 INFO:tasks.workunit.client.1.smithi092.stdout:2/307: write d10/f4b [285576,24250] 0 2024-09-17T01:52:06.802 INFO:tasks.workunit.client.1.smithi092.stdout:2/308: write d10/d1d/f53 [956964,53261] 0 2024-09-17T01:52:06.805 INFO:tasks.workunit.client.0.smithi031.stdout:7/497: dwrite db/d18/f6a [0,4194304] 0 2024-09-17T01:52:06.806 INFO:tasks.workunit.client.1.smithi092.stdout:5/314: link d0/de/d19/d1a/d1e/f1d d0/de/d19/f69 0 2024-09-17T01:52:06.806 INFO:tasks.workunit.client.1.smithi092.stdout:2/309: dread d10/f5d [0,4194304] 0 2024-09-17T01:52:06.807 INFO:tasks.workunit.client.0.smithi031.stdout:0/542: dread d0/d29/d33/d2a/d25/f3f [0,4194304] 0 2024-09-17T01:52:06.807 INFO:tasks.workunit.client.0.smithi031.stdout:3/527: mknod db/d9b/c9d 0 2024-09-17T01:52:06.807 INFO:tasks.workunit.client.1.smithi092.stdout:6/359: rename d3/d10/d1a/d43/d5e/d5d to d3/d10/d1a/d43/d5e/d73 0 2024-09-17T01:52:06.808 INFO:tasks.workunit.client.1.smithi092.stdout:2/310: chown d10/d1d/d2c/f3d 39774297 1 2024-09-17T01:52:06.809 INFO:tasks.workunit.client.1.smithi092.stdout:7/443: fdatasync d3/d6/d13/d40/f55 0 2024-09-17T01:52:06.809 INFO:tasks.workunit.client.0.smithi031.stdout:0/543: chown d0/d29/d33/d5/c40 284380207 1 2024-09-17T01:52:06.810 INFO:tasks.workunit.client.0.smithi031.stdout:4/715: creat d8/d3a/d41/de6/fe8 x:0 0 0 2024-09-17T01:52:06.813 INFO:tasks.workunit.client.0.smithi031.stdout:7/498: dread db/d29/f5d [0,4194304] 0 2024-09-17T01:52:06.814 INFO:tasks.workunit.client.1.smithi092.stdout:2/311: chown l7 5881288 1 2024-09-17T01:52:06.816 INFO:tasks.workunit.client.0.smithi031.stdout:4/716: dread f5 [0,4194304] 0 2024-09-17T01:52:06.817 INFO:tasks.workunit.client.0.smithi031.stdout:0/544: dread d0/d29/da7/db3/d4a/d90/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:06.817 INFO:tasks.workunit.client.0.smithi031.stdout:1/580: write d4/d3d/d65/f75 [981546,92275] 0 2024-09-17T01:52:06.818 INFO:tasks.workunit.client.0.smithi031.stdout:0/545: read - d0/d29/fa2 zero size 2024-09-17T01:52:06.818 INFO:tasks.workunit.client.0.smithi031.stdout:7/499: mkdir db/d1c/d99 0 2024-09-17T01:52:06.819 INFO:tasks.workunit.client.1.smithi092.stdout:5/315: rename d0/de/l14 to d0/de/d19/d1a/d1e/d52/l6a 0 2024-09-17T01:52:06.820 INFO:tasks.workunit.client.0.smithi031.stdout:3/528: truncate db/df/d1d/f7c 3536381 0 2024-09-17T01:52:06.821 INFO:tasks.workunit.client.0.smithi031.stdout:1/581: symlink d4/d3d/lc3 0 2024-09-17T01:52:06.822 INFO:tasks.workunit.client.1.smithi092.stdout:1/461: link db/d1d/d23/c92 db/d1d/d4b/c94 0 2024-09-17T01:52:06.824 INFO:tasks.workunit.client.0.smithi031.stdout:4/717: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ce9 0 2024-09-17T01:52:06.824 INFO:tasks.workunit.client.1.smithi092.stdout:6/360: symlink d3/d10/d1f/l74 0 2024-09-17T01:52:06.824 INFO:tasks.workunit.client.0.smithi031.stdout:1/582: dread d4/d1e/d3f/d72/f7a [0,4194304] 0 2024-09-17T01:52:06.826 INFO:tasks.workunit.client.1.smithi092.stdout:7/444: read d3/d6/d13/d21/d2e/d6e/f71 [373890,13797] 0 2024-09-17T01:52:06.827 INFO:tasks.workunit.client.0.smithi031.stdout:0/546: getdents d0/d29/d33/d5/d50 0 2024-09-17T01:52:06.827 INFO:tasks.workunit.client.0.smithi031.stdout:3/529: getdents db/df/d1d/d37/d3a 0 2024-09-17T01:52:06.828 INFO:tasks.workunit.client.1.smithi092.stdout:2/312: unlink d10/d15/f48 0 2024-09-17T01:52:06.829 INFO:tasks.workunit.client.1.smithi092.stdout:8/343: truncate d15/d25/f30 50512 0 2024-09-17T01:52:06.830 INFO:tasks.workunit.client.0.smithi031.stdout:4/718: dread d8/d3a/d41/d64/d92/fb3 [0,4194304] 0 2024-09-17T01:52:06.830 INFO:tasks.workunit.client.1.smithi092.stdout:8/344: write d15/d25/d27/f41 [1619191,130121] 0 2024-09-17T01:52:06.833 INFO:tasks.workunit.client.1.smithi092.stdout:6/361: creat d3/d10/d1a/d49/f75 x:0 0 0 2024-09-17T01:52:06.833 INFO:tasks.workunit.client.0.smithi031.stdout:0/547: rename d0/d37/d6f to d0/d29/da7/dbb 0 2024-09-17T01:52:06.834 INFO:tasks.workunit.client.0.smithi031.stdout:7/500: write db/d29/f3c [1682357,46955] 0 2024-09-17T01:52:06.835 INFO:tasks.workunit.client.0.smithi031.stdout:7/501: truncate db/d18/f7f 839068 0 2024-09-17T01:52:06.838 INFO:tasks.workunit.client.0.smithi031.stdout:1/583: truncate d4/d1e/d3f/f60 964900 0 2024-09-17T01:52:06.839 INFO:tasks.workunit.client.0.smithi031.stdout:1/584: write d4/d1e/d40/d84/fb8 [529694,103899] 0 2024-09-17T01:52:06.839 INFO:tasks.workunit.client.1.smithi092.stdout:2/313: rename d10/d15/f35 to d10/d1d/d2c/f6a 0 2024-09-17T01:52:06.840 INFO:tasks.workunit.client.1.smithi092.stdout:1/462: dread db/d1d/d23/f6f [0,4194304] 0 2024-09-17T01:52:06.840 INFO:tasks.workunit.client.0.smithi031.stdout:4/719: rename d8/d3a/d41/d64/d92/fb3 to d8/d3a/d41/de6/fea 0 2024-09-17T01:52:06.843 INFO:tasks.workunit.client.1.smithi092.stdout:5/316: dwrite d0/fc [4194304,4194304] 0 2024-09-17T01:52:06.844 INFO:tasks.workunit.client.0.smithi031.stdout:4/720: chown d8/d3a/d41/d55/c9e 352151 1 2024-09-17T01:52:06.845 INFO:tasks.workunit.client.1.smithi092.stdout:6/362: dread d3/d10/d1f/f32 [0,4194304] 0 2024-09-17T01:52:06.845 INFO:tasks.workunit.client.1.smithi092.stdout:0/424: sync 2024-09-17T01:52:06.847 INFO:tasks.workunit.client.0.smithi031.stdout:3/530: getdents db/d29 0 2024-09-17T01:52:06.847 INFO:tasks.workunit.client.1.smithi092.stdout:8/345: dwrite d15/d25/d27/f41 [0,4194304] 0 2024-09-17T01:52:06.848 INFO:tasks.workunit.client.1.smithi092.stdout:0/425: fsync d3/d2e/f5c 0 2024-09-17T01:52:06.849 INFO:tasks.workunit.client.0.smithi031.stdout:3/531: truncate db/df/d50/f75 1221980 0 2024-09-17T01:52:06.849 INFO:tasks.workunit.client.1.smithi092.stdout:2/314: unlink d10/d3a/f3c 0 2024-09-17T01:52:06.850 INFO:tasks.workunit.client.1.smithi092.stdout:6/363: write d3/d10/d1a/d43/d6a/d3d/f4f [81080,43433] 0 2024-09-17T01:52:06.850 INFO:tasks.workunit.client.0.smithi031.stdout:4/721: fsync d8/d3a/d41/d64/d4d/d5a/d8c/d25/f7a 0 2024-09-17T01:52:06.852 INFO:tasks.workunit.client.1.smithi092.stdout:1/463: rmdir db/d1d/d4b 39 2024-09-17T01:52:06.855 INFO:tasks.workunit.client.0.smithi031.stdout:3/532: truncate db/df/d1d/d37/d6c/d6e/f7e 341722 0 2024-09-17T01:52:06.856 INFO:tasks.workunit.client.1.smithi092.stdout:1/464: dread - db/d1d/d23/f89 zero size 2024-09-17T01:52:06.856 INFO:tasks.workunit.client.0.smithi031.stdout:4/722: read d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 [2844157,46841] 0 2024-09-17T01:52:06.860 INFO:tasks.workunit.client.1.smithi092.stdout:6/364: symlink d3/d10/d1f/d21/d28/d2b/d48/l76 0 2024-09-17T01:52:06.861 INFO:tasks.workunit.client.1.smithi092.stdout:0/426: dwrite d3/da/d1c/f43 [0,4194304] 0 2024-09-17T01:52:06.862 INFO:tasks.workunit.client.1.smithi092.stdout:6/365: readlink d3/d10/d1a/d43/l62 0 2024-09-17T01:52:06.863 INFO:tasks.workunit.client.0.smithi031.stdout:7/502: write db/f15 [419515,78328] 0 2024-09-17T01:52:06.863 INFO:tasks.workunit.client.0.smithi031.stdout:0/548: dread d0/f21 [0,4194304] 0 2024-09-17T01:52:06.864 INFO:tasks.workunit.client.1.smithi092.stdout:5/317: write d0/f53 [651282,80324] 0 2024-09-17T01:52:06.866 INFO:tasks.workunit.client.1.smithi092.stdout:2/315: dread d10/d1d/f53 [0,4194304] 0 2024-09-17T01:52:06.866 INFO:tasks.workunit.client.1.smithi092.stdout:8/346: symlink d15/d25/d27/l6d 0 2024-09-17T01:52:06.869 INFO:tasks.workunit.client.1.smithi092.stdout:0/427: dread d3/d2e/d55/f70 [0,4194304] 0 2024-09-17T01:52:06.872 INFO:tasks.workunit.client.1.smithi092.stdout:6/366: creat d3/d70/f77 x:0 0 0 2024-09-17T01:52:06.873 INFO:tasks.workunit.client.0.smithi031.stdout:0/549: unlink d0/d29/da7/db3/f6b 0 2024-09-17T01:52:06.873 INFO:tasks.workunit.client.1.smithi092.stdout:0/428: creat d3/d2e/f84 x:0 0 0 2024-09-17T01:52:06.874 INFO:tasks.workunit.client.0.smithi031.stdout:7/503: mkdir db/d1c/d41/d9a 0 2024-09-17T01:52:06.874 INFO:tasks.workunit.client.0.smithi031.stdout:3/533: dwrite db/df/f22 [4194304,4194304] 0 2024-09-17T01:52:06.876 INFO:tasks.workunit.client.1.smithi092.stdout:8/347: rmdir d15/d48 0 2024-09-17T01:52:06.877 INFO:tasks.workunit.client.0.smithi031.stdout:7/504: chown db/d29/f58 86465 1 2024-09-17T01:52:06.877 INFO:tasks.workunit.client.0.smithi031.stdout:1/585: dwrite d4/d1a/f25 [0,4194304] 0 2024-09-17T01:52:06.877 INFO:tasks.workunit.client.0.smithi031.stdout:4/723: dwrite d8/d3a/d41/d64/d4d/d8f/f97 [0,4194304] 0 2024-09-17T01:52:06.878 INFO:tasks.workunit.client.0.smithi031.stdout:0/550: fsync d0/d29/d33/d2a/d25/da5/fa8 0 2024-09-17T01:52:06.882 INFO:tasks.workunit.client.1.smithi092.stdout:5/318: rename d0/de/d19/d1a/d1e/d3e/d4c/f49 to d0/de/d19/f6b 0 2024-09-17T01:52:06.884 INFO:tasks.workunit.client.0.smithi031.stdout:4/724: creat d8/d3a/d7e/feb x:0 0 0 2024-09-17T01:52:06.885 INFO:tasks.workunit.client.0.smithi031.stdout:4/725: write d8/fc [3310158,3386] 0 2024-09-17T01:52:06.886 INFO:tasks.workunit.client.1.smithi092.stdout:0/429: symlink d3/d2e/d3b/d48/d76/l85 0 2024-09-17T01:52:06.886 INFO:tasks.workunit.client.1.smithi092.stdout:6/367: dwrite d3/d10/d1a/d43/f4a [0,4194304] 0 2024-09-17T01:52:06.890 INFO:tasks.workunit.client.0.smithi031.stdout:1/586: mknod d4/d1e/d3f/d72/d7e/da2/cc4 0 2024-09-17T01:52:06.890 INFO:tasks.workunit.client.0.smithi031.stdout:3/534: symlink db/df/d1d/d37/d4a/d97/l9e 0 2024-09-17T01:52:06.892 INFO:tasks.workunit.client.0.smithi031.stdout:3/535: chown db/df/d50/c5c 81130944 1 2024-09-17T01:52:06.892 INFO:tasks.workunit.client.1.smithi092.stdout:8/348: fdatasync d15/d25/f2d 0 2024-09-17T01:52:06.893 INFO:tasks.workunit.client.0.smithi031.stdout:4/726: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/cec 0 2024-09-17T01:52:06.897 INFO:tasks.workunit.client.1.smithi092.stdout:6/368: dread d3/d10/d1f/f30 [0,4194304] 0 2024-09-17T01:52:06.897 INFO:tasks.workunit.client.0.smithi031.stdout:1/587: rename d4/l12 to d4/d3d/d65/lc5 0 2024-09-17T01:52:06.898 INFO:tasks.workunit.client.1.smithi092.stdout:6/369: write d3/d10/d1f/f59 [218883,59779] 0 2024-09-17T01:52:06.899 INFO:tasks.workunit.client.1.smithi092.stdout:0/430: dread d3/d2e/d55/d63/f6d [0,4194304] 0 2024-09-17T01:52:06.902 INFO:tasks.workunit.client.0.smithi031.stdout:1/588: dread d4/d1e/f3b [0,4194304] 0 2024-09-17T01:52:06.903 INFO:tasks.workunit.client.0.smithi031.stdout:4/727: link d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/fb1 d8/d3a/d41/d64/d4d/d5a/d8c/d25/fed 0 2024-09-17T01:52:06.904 INFO:tasks.workunit.client.0.smithi031.stdout:1/589: fdatasync d4/d3d/d65/d78/f80 0 2024-09-17T01:52:06.905 INFO:tasks.workunit.client.1.smithi092.stdout:6/370: rmdir d3/d10/d1f/d21 39 2024-09-17T01:52:06.906 INFO:tasks.workunit.client.0.smithi031.stdout:1/590: creat d4/d1e/d3f/d4d/da5/fc6 x:0 0 0 2024-09-17T01:52:06.906 INFO:tasks.workunit.client.1.smithi092.stdout:1/465: dread db/d1d/f40 [0,4194304] 0 2024-09-17T01:52:06.908 INFO:tasks.workunit.client.0.smithi031.stdout:4/728: truncate d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fc4 1004044 0 2024-09-17T01:52:06.910 INFO:tasks.workunit.client.0.smithi031.stdout:1/591: creat d4/d1e/d3f/d72/fc7 x:0 0 0 2024-09-17T01:52:06.913 INFO:tasks.workunit.client.1.smithi092.stdout:1/466: fdatasync db/d1d/f22 0 2024-09-17T01:52:06.914 INFO:tasks.workunit.client.0.smithi031.stdout:1/592: write d4/d3d/d65/f75 [1216173,108339] 0 2024-09-17T01:52:06.914 INFO:tasks.workunit.client.0.smithi031.stdout:7/505: dwrite db/f10 [4194304,4194304] 0 2024-09-17T01:52:06.915 INFO:tasks.workunit.client.0.smithi031.stdout:0/551: dwrite d0/d29/da7/db3/d4a/f64 [0,4194304] 0 2024-09-17T01:52:06.918 INFO:tasks.workunit.client.1.smithi092.stdout:0/431: write d3/d1d/f32 [1850157,123916] 0 2024-09-17T01:52:06.918 INFO:tasks.workunit.client.0.smithi031.stdout:0/552: creat d0/d37/fbc x:0 0 0 2024-09-17T01:52:06.923 INFO:tasks.workunit.client.1.smithi092.stdout:5/319: dwrite d0/d23/f48 [0,4194304] 0 2024-09-17T01:52:06.925 INFO:tasks.workunit.client.0.smithi031.stdout:1/593: creat d4/d1e/d40/daa/fc8 x:0 0 0 2024-09-17T01:52:06.925 INFO:tasks.workunit.client.0.smithi031.stdout:4/729: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/fb4 [0,4194304] 0 2024-09-17T01:52:06.927 INFO:tasks.workunit.client.0.smithi031.stdout:7/506: rename db/l82 to db/d18/d67/l9b 0 2024-09-17T01:52:06.929 INFO:tasks.workunit.client.0.smithi031.stdout:4/730: stat d8/l59 0 2024-09-17T01:52:06.932 INFO:tasks.workunit.client.1.smithi092.stdout:0/432: dwrite d3/f5 [4194304,4194304] 0 2024-09-17T01:52:06.934 INFO:tasks.workunit.client.0.smithi031.stdout:1/594: dwrite d4/d1e/d3f/d72/f76 [0,4194304] 0 2024-09-17T01:52:06.936 INFO:tasks.workunit.client.0.smithi031.stdout:7/507: creat db/d1c/d41/d9a/f9c x:0 0 0 2024-09-17T01:52:06.936 INFO:tasks.workunit.client.0.smithi031.stdout:0/553: getdents d0/d29/da7/db3/d4a 0 2024-09-17T01:52:06.937 INFO:tasks.workunit.client.1.smithi092.stdout:0/433: creat d3/d1d/d6b/f86 x:0 0 0 2024-09-17T01:52:06.938 INFO:tasks.workunit.client.0.smithi031.stdout:7/508: dread - db/d29/f75 zero size 2024-09-17T01:52:06.940 INFO:tasks.workunit.client.1.smithi092.stdout:6/371: dread d3/d10/d1f/d21/d28/d2b/f2e [0,4194304] 0 2024-09-17T01:52:06.940 INFO:tasks.workunit.client.1.smithi092.stdout:0/434: mknod d3/d2e/d55/d63/d81/c87 0 2024-09-17T01:52:06.941 INFO:tasks.workunit.client.1.smithi092.stdout:6/372: chown d3/d10/d1a/d43/d5e 1071018079 1 2024-09-17T01:52:06.942 INFO:tasks.workunit.client.1.smithi092.stdout:6/373: chown d3/d10/d1f/d21/c67 32608639 1 2024-09-17T01:52:06.943 INFO:tasks.workunit.client.0.smithi031.stdout:7/509: dread db/d29/f4e [0,4194304] 0 2024-09-17T01:52:06.945 INFO:tasks.workunit.client.1.smithi092.stdout:0/435: link d3/da/d1c/l34 d3/d1d/l88 0 2024-09-17T01:52:06.945 INFO:tasks.workunit.client.0.smithi031.stdout:0/554: rename d0/d29/d33/c55 to d0/cbd 0 2024-09-17T01:52:06.946 INFO:tasks.workunit.client.0.smithi031.stdout:1/595: getdents d4/d1e/d5d/dae 0 2024-09-17T01:52:06.946 INFO:tasks.workunit.client.1.smithi092.stdout:0/436: fdatasync d3/d2e/d3b/d40/f54 0 2024-09-17T01:52:06.947 INFO:tasks.workunit.client.0.smithi031.stdout:7/510: creat db/d1c/d41/d6c/f9d x:0 0 0 2024-09-17T01:52:06.947 INFO:tasks.workunit.client.0.smithi031.stdout:1/596: chown d4/d1e/d3f/c46 59637953 1 2024-09-17T01:52:06.949 INFO:tasks.workunit.client.1.smithi092.stdout:6/374: dwrite d3/d10/d1a/d43/d6a/f50 [0,4194304] 0 2024-09-17T01:52:06.949 INFO:tasks.workunit.client.0.smithi031.stdout:0/555: write d0/f1f [2812438,24904] 0 2024-09-17T01:52:06.952 INFO:tasks.workunit.client.0.smithi031.stdout:1/597: mknod d4/d1e/d5d/dae/cc9 0 2024-09-17T01:52:06.954 INFO:tasks.workunit.client.0.smithi031.stdout:1/598: write d4/d1e/f49 [6706571,7866] 0 2024-09-17T01:52:06.955 INFO:tasks.workunit.client.1.smithi092.stdout:6/375: dwrite d3/d10/d1f/d21/f3b [0,4194304] 0 2024-09-17T01:52:06.956 INFO:tasks.workunit.client.0.smithi031.stdout:7/511: creat db/d18/f9e x:0 0 0 2024-09-17T01:52:06.958 INFO:tasks.workunit.client.1.smithi092.stdout:6/376: truncate d3/d10/d1f/d21/d28/d2b/d48/d18/f6b 366414 0 2024-09-17T01:52:06.958 INFO:tasks.workunit.client.0.smithi031.stdout:0/556: creat d0/d29/d33/d5/fbe x:0 0 0 2024-09-17T01:52:06.958 INFO:tasks.workunit.client.1.smithi092.stdout:6/377: readlink d3/d10/d1f/l74 0 2024-09-17T01:52:06.964 INFO:tasks.workunit.client.0.smithi031.stdout:7/512: creat db/d1c/f9f x:0 0 0 2024-09-17T01:52:06.965 INFO:tasks.workunit.client.0.smithi031.stdout:7/513: readlink db/l35 0 2024-09-17T01:52:06.966 INFO:tasks.workunit.client.0.smithi031.stdout:0/557: creat d0/d29/d33/d2a/d25/d38/fbf x:0 0 0 2024-09-17T01:52:06.973 INFO:tasks.workunit.client.0.smithi031.stdout:0/558: rename d0/f5c to d0/d29/d33/fc0 0 2024-09-17T01:52:06.976 INFO:tasks.workunit.client.1.smithi092.stdout:5/320: write d0/de/d19/f6b [455497,66006] 0 2024-09-17T01:52:06.976 INFO:tasks.workunit.client.1.smithi092.stdout:0/437: dread d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:06.977 INFO:tasks.workunit.client.1.smithi092.stdout:0/438: chown d3/da/f22 36501481 1 2024-09-17T01:52:06.978 INFO:tasks.workunit.client.1.smithi092.stdout:0/439: read d3/d2e/d55/d63/f6d [125765,109638] 0 2024-09-17T01:52:06.979 INFO:tasks.workunit.client.0.smithi031.stdout:1/599: dwrite d4/d1e/d5d/dae/f9f [0,4194304] 0 2024-09-17T01:52:06.980 INFO:tasks.workunit.client.1.smithi092.stdout:5/321: creat d0/de/d19/f6c x:0 0 0 2024-09-17T01:52:06.981 INFO:tasks.workunit.client.1.smithi092.stdout:0/440: creat d3/d2e/d3b/d72/f89 x:0 0 0 2024-09-17T01:52:06.981 INFO:tasks.workunit.client.1.smithi092.stdout:5/322: dread - d0/de/d19/d1a/d1e/d3e/f40 zero size 2024-09-17T01:52:06.982 INFO:tasks.workunit.client.0.smithi031.stdout:7/514: dwrite db/d18/f48 [0,4194304] 0 2024-09-17T01:52:06.983 INFO:tasks.workunit.client.1.smithi092.stdout:5/323: write d0/de/d19/d1a/d1e/f18 [2662309,93936] 0 2024-09-17T01:52:06.986 INFO:tasks.workunit.client.1.smithi092.stdout:5/324: creat d0/f6d x:0 0 0 2024-09-17T01:52:06.988 INFO:tasks.workunit.client.0.smithi031.stdout:7/515: mkdir db/d1c/d41/d6c/da0 0 2024-09-17T01:52:06.990 INFO:tasks.workunit.client.1.smithi092.stdout:5/325: creat d0/de/d19/d3c/d41/f6e x:0 0 0 2024-09-17T01:52:06.990 INFO:tasks.workunit.client.1.smithi092.stdout:0/441: dread d3/d2e/f5c [0,4194304] 0 2024-09-17T01:52:06.990 INFO:tasks.workunit.client.0.smithi031.stdout:0/559: truncate d0/d29/d33/d5/fa 2695280 0 2024-09-17T01:52:06.991 INFO:tasks.workunit.client.1.smithi092.stdout:5/326: chown d0/de 519 1 2024-09-17T01:52:06.992 INFO:tasks.workunit.client.0.smithi031.stdout:1/600: getdents d4/d1e/d3f/d72/d7e/da2 0 2024-09-17T01:52:06.992 INFO:tasks.workunit.client.0.smithi031.stdout:0/560: stat d0/d29/d33/d5/d48/f5a 0 2024-09-17T01:52:06.993 INFO:tasks.workunit.client.1.smithi092.stdout:5/327: unlink d0/l67 0 2024-09-17T01:52:06.993 INFO:tasks.workunit.client.1.smithi092.stdout:0/442: truncate d3/f28 3882457 0 2024-09-17T01:52:06.994 INFO:tasks.workunit.client.0.smithi031.stdout:0/561: chown d0/d29/d33/d5b/f9f 187229817 1 2024-09-17T01:52:06.994 INFO:tasks.workunit.client.1.smithi092.stdout:5/328: write d0/d50/f5b [258892,70627] 0 2024-09-17T01:52:06.994 INFO:tasks.workunit.client.0.smithi031.stdout:7/516: creat db/d18/d67/fa1 x:0 0 0 2024-09-17T01:52:06.995 INFO:tasks.workunit.client.0.smithi031.stdout:7/517: chown db/d18 858558485 1 2024-09-17T01:52:06.996 INFO:tasks.workunit.client.1.smithi092.stdout:5/329: creat d0/de/f6f x:0 0 0 2024-09-17T01:52:06.997 INFO:tasks.workunit.client.1.smithi092.stdout:0/443: symlink d3/d58/l8a 0 2024-09-17T01:52:06.997 INFO:tasks.workunit.client.1.smithi092.stdout:0/444: stat d3/d2e/d55/f67 0 2024-09-17T01:52:06.998 INFO:tasks.workunit.client.1.smithi092.stdout:5/330: mkdir d0/d50/d70 0 2024-09-17T01:52:06.999 INFO:tasks.workunit.client.1.smithi092.stdout:5/331: readlink d0/l16 0 2024-09-17T01:52:07.000 INFO:tasks.workunit.client.0.smithi031.stdout:1/601: dwrite d4/d1a/d2d/f8b [0,4194304] 0 2024-09-17T01:52:07.001 INFO:tasks.workunit.client.0.smithi031.stdout:7/518: read db/d1c/f5c [3428992,112299] 0 2024-09-17T01:52:07.003 INFO:tasks.workunit.client.0.smithi031.stdout:0/562: dwrite d0/d29/da7/db3/d4a/f6e [0,4194304] 0 2024-09-17T01:52:07.004 INFO:tasks.workunit.client.1.smithi092.stdout:5/332: link d0/d23/f4d d0/de/d19/d1a/d1e/f71 0 2024-09-17T01:52:07.008 INFO:tasks.workunit.client.0.smithi031.stdout:7/519: dread db/d18/f7f [0,4194304] 0 2024-09-17T01:52:07.013 INFO:tasks.workunit.client.0.smithi031.stdout:7/520: creat db/d1c/fa2 x:0 0 0 2024-09-17T01:52:07.015 INFO:tasks.workunit.client.0.smithi031.stdout:7/521: unlink db/c50 0 2024-09-17T01:52:07.016 INFO:tasks.workunit.client.1.smithi092.stdout:5/333: getdents d0 0 2024-09-17T01:52:07.018 INFO:tasks.workunit.client.0.smithi031.stdout:7/522: write db/d18/f93 [875753,57758] 0 2024-09-17T01:52:07.021 INFO:tasks.workunit.client.1.smithi092.stdout:0/445: truncate d3/da/d1c/f43 1243619 0 2024-09-17T01:52:07.021 INFO:tasks.workunit.client.0.smithi031.stdout:0/563: dwrite d0/d29/da7/db3/d4a/d90/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:07.022 INFO:tasks.workunit.client.1.smithi092.stdout:0/446: write d3/f4 [4474665,25138] 0 2024-09-17T01:52:07.023 INFO:tasks.workunit.client.0.smithi031.stdout:7/523: rename db/d18/f48 to db/d1c/d99/fa3 0 2024-09-17T01:52:07.025 INFO:tasks.workunit.client.1.smithi092.stdout:0/447: rename d3/d2e/d3b/f74 to d3/d2e/d3b/d40/d7d/f8b 0 2024-09-17T01:52:07.030 INFO:tasks.workunit.client.0.smithi031.stdout:0/564: creat d0/d29/d33/fc1 x:0 0 0 2024-09-17T01:52:07.034 INFO:tasks.workunit.client.1.smithi092.stdout:5/334: dwrite d0/de/d19/d1a/d1e/f1d [0,4194304] 0 2024-09-17T01:52:07.034 INFO:tasks.workunit.client.1.smithi092.stdout:0/448: link d3/da/d1c/f49 d3/da/d1c/f8c 0 2024-09-17T01:52:07.035 INFO:tasks.workunit.client.1.smithi092.stdout:5/335: rmdir d0/d23 39 2024-09-17T01:52:07.037 INFO:tasks.workunit.client.1.smithi092.stdout:5/336: write d0/de/f11 [4114999,75251] 0 2024-09-17T01:52:07.037 INFO:tasks.workunit.client.1.smithi092.stdout:0/449: mknod d3/da/d15/d30/c8d 0 2024-09-17T01:52:07.039 INFO:tasks.workunit.client.1.smithi092.stdout:0/450: write d3/da/d15/d30/f3c [743241,63165] 0 2024-09-17T01:52:07.039 INFO:tasks.workunit.client.0.smithi031.stdout:7/524: rename db/d1c/d46/f4c to db/d18/fa4 0 2024-09-17T01:52:07.040 INFO:tasks.workunit.client.0.smithi031.stdout:0/565: creat d0/d29/da7/db3/d4a/d86/fc2 x:0 0 0 2024-09-17T01:52:07.043 INFO:tasks.workunit.client.1.smithi092.stdout:5/337: rmdir d0/d50/d68 0 2024-09-17T01:52:07.045 INFO:tasks.workunit.client.1.smithi092.stdout:0/451: dwrite d3/f77 [4194304,4194304] 0 2024-09-17T01:52:07.046 INFO:tasks.workunit.client.1.smithi092.stdout:0/452: chown d3/d2e/d3b/d40/c65 647379959 1 2024-09-17T01:52:07.047 INFO:tasks.workunit.client.1.smithi092.stdout:5/338: mknod d0/de/c72 0 2024-09-17T01:52:07.050 INFO:tasks.workunit.client.1.smithi092.stdout:0/453: write d3/da/d1c/d47/f51 [4754482,43909] 0 2024-09-17T01:52:07.051 INFO:tasks.workunit.client.1.smithi092.stdout:5/339: creat d0/de/d19/d3c/d41/f73 x:0 0 0 2024-09-17T01:52:07.052 INFO:tasks.workunit.client.0.smithi031.stdout:7/525: symlink db/d1c/d41/d69/la5 0 2024-09-17T01:52:07.052 INFO:tasks.workunit.client.1.smithi092.stdout:5/340: truncate d0/de/f11 5516467 0 2024-09-17T01:52:07.053 INFO:tasks.workunit.client.0.smithi031.stdout:0/566: symlink d0/d29/d33/d5/d78/lc3 0 2024-09-17T01:52:07.054 INFO:tasks.workunit.client.0.smithi031.stdout:0/567: fsync d0/d29/d33/d5b/f9f 0 2024-09-17T01:52:07.054 INFO:tasks.workunit.client.0.smithi031.stdout:7/526: mkdir db/d1c/d46/d95/da6 0 2024-09-17T01:52:07.055 INFO:tasks.workunit.client.0.smithi031.stdout:0/568: stat d0/d29/da7/db3/c31 0 2024-09-17T01:52:07.059 INFO:tasks.workunit.client.0.smithi031.stdout:7/527: rename db/d1c/d41/d72 to db/d1c/d8e/da7 0 2024-09-17T01:52:07.059 INFO:tasks.workunit.client.0.smithi031.stdout:7/528: fdatasync db/d29/f75 0 2024-09-17T01:52:07.061 INFO:tasks.workunit.client.1.smithi092.stdout:0/454: write d3/da/f10 [4202793,96548] 0 2024-09-17T01:52:07.061 INFO:tasks.workunit.client.0.smithi031.stdout:7/529: write db/d29/f4a [1167947,20386] 0 2024-09-17T01:52:07.061 INFO:tasks.workunit.client.1.smithi092.stdout:5/341: truncate d0/de/d19/d1a/d1e/f1d 3994455 0 2024-09-17T01:52:07.062 INFO:tasks.workunit.client.0.smithi031.stdout:6/632: sync 2024-09-17T01:52:07.062 INFO:tasks.workunit.client.0.smithi031.stdout:9/428: sync 2024-09-17T01:52:07.062 INFO:tasks.workunit.client.0.smithi031.stdout:5/427: sync 2024-09-17T01:52:07.062 INFO:tasks.workunit.client.0.smithi031.stdout:2/577: sync 2024-09-17T01:52:07.062 INFO:tasks.workunit.client.0.smithi031.stdout:8/475: sync 2024-09-17T01:52:07.062 INFO:tasks.workunit.client.0.smithi031.stdout:0/569: creat d0/d29/da7/db3/d4a/d86/da1/fc4 x:0 0 0 2024-09-17T01:52:07.063 INFO:tasks.workunit.client.1.smithi092.stdout:0/455: dread d3/d2e/d55/f70 [0,4194304] 0 2024-09-17T01:52:07.064 INFO:tasks.workunit.client.1.smithi092.stdout:5/342: mkdir d0/de/d19/d1a/d1e/d74 0 2024-09-17T01:52:07.065 INFO:tasks.workunit.client.0.smithi031.stdout:0/570: fsync d0/d29/d33/fc0 0 2024-09-17T01:52:07.065 INFO:tasks.workunit.client.1.smithi092.stdout:0/456: mkdir d3/d58/d8e 0 2024-09-17T01:52:07.066 INFO:tasks.workunit.client.1.smithi092.stdout:0/457: dread - d3/d2e/d3b/d72/f89 zero size 2024-09-17T01:52:07.066 INFO:tasks.workunit.client.0.smithi031.stdout:0/571: chown d0/d29/d33/d5/dad 105 1 2024-09-17T01:52:07.067 INFO:tasks.workunit.client.0.smithi031.stdout:7/530: mknod db/d18/ca8 0 2024-09-17T01:52:07.069 INFO:tasks.workunit.client.1.smithi092.stdout:5/343: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:07.069 INFO:tasks.workunit.client.0.smithi031.stdout:7/531: fsync db/d1c/f40 0 2024-09-17T01:52:07.071 INFO:tasks.workunit.client.1.smithi092.stdout:5/344: fsync d0/de/d19/d1a/f58 0 2024-09-17T01:52:07.071 INFO:tasks.workunit.client.1.smithi092.stdout:0/458: rename d3/da/d1c/d47 to d3/d2e/d3b/d8f 0 2024-09-17T01:52:07.073 INFO:tasks.workunit.client.1.smithi092.stdout:0/459: chown d3/d2e/d3b/d48/f5b 5409 1 2024-09-17T01:52:07.076 INFO:tasks.workunit.client.0.smithi031.stdout:8/476: dwrite d0/df/dd/d77/d78/f7f [0,4194304] 0 2024-09-17T01:52:07.076 INFO:tasks.workunit.client.0.smithi031.stdout:2/578: dwrite d1/d3/d2d/db2/f1d [0,4194304] 0 2024-09-17T01:52:07.079 INFO:tasks.workunit.client.0.smithi031.stdout:7/532: chown db/d1c/d41/d6c/f9d 491515 1 2024-09-17T01:52:07.080 INFO:tasks.workunit.client.1.smithi092.stdout:0/460: mkdir d3/da/d15/d90 0 2024-09-17T01:52:07.082 INFO:tasks.workunit.client.0.smithi031.stdout:9/429: fdatasync d3/d19/d1f/f6d 0 2024-09-17T01:52:07.082 INFO:tasks.workunit.client.1.smithi092.stdout:5/345: rename d0/de/d19/d1a/f34 to d0/de/d19/d1a/d1e/f75 0 2024-09-17T01:52:07.083 INFO:tasks.workunit.client.0.smithi031.stdout:0/572: dwrite d0/f1f [0,4194304] 0 2024-09-17T01:52:07.084 INFO:tasks.workunit.client.1.smithi092.stdout:5/346: read d0/de/d19/d1a/d1e/f71 [2538254,47993] 0 2024-09-17T01:52:07.084 INFO:tasks.workunit.client.1.smithi092.stdout:0/461: read d3/d2e/d3b/d40/f53 [59004,17384] 0 2024-09-17T01:52:07.085 INFO:tasks.workunit.client.1.smithi092.stdout:5/347: read - d0/de/d19/d3c/d41/f6e zero size 2024-09-17T01:52:07.087 INFO:tasks.workunit.client.0.smithi031.stdout:7/533: write db/d18/f61 [4752962,2631] 0 2024-09-17T01:52:07.087 INFO:tasks.workunit.client.1.smithi092.stdout:0/462: dread d3/da/d15/f19 [0,4194304] 0 2024-09-17T01:52:07.088 INFO:tasks.workunit.client.1.smithi092.stdout:5/348: write d0/de/d19/d1a/d1e/f36 [4738111,23265] 0 2024-09-17T01:52:07.088 INFO:tasks.workunit.client.1.smithi092.stdout:9/334: sync 2024-09-17T01:52:07.088 INFO:tasks.workunit.client.1.smithi092.stdout:3/358: sync 2024-09-17T01:52:07.088 INFO:tasks.workunit.client.1.smithi092.stdout:4/369: sync 2024-09-17T01:52:07.089 INFO:tasks.workunit.client.0.smithi031.stdout:7/534: readlink db/l13 0 2024-09-17T01:52:07.090 INFO:tasks.workunit.client.0.smithi031.stdout:2/579: rename d1/f12 to d1/d3/d2d/db2/d1e/d4f/fc6 0 2024-09-17T01:52:07.093 INFO:tasks.workunit.client.0.smithi031.stdout:6/633: getdents d23/db4/d64/dc1 0 2024-09-17T01:52:07.094 INFO:tasks.workunit.client.0.smithi031.stdout:0/573: dwrite d0/d29/da7/db3/d4a/f6e [0,4194304] 0 2024-09-17T01:52:07.094 INFO:tasks.workunit.client.1.smithi092.stdout:9/335: write d0/df/f18 [3152024,119500] 0 2024-09-17T01:52:07.094 INFO:tasks.workunit.client.1.smithi092.stdout:4/370: readlink d4/d5/d1d/l23 0 2024-09-17T01:52:07.095 INFO:tasks.workunit.client.1.smithi092.stdout:4/371: chown d4/l73 42620 1 2024-09-17T01:52:07.096 INFO:tasks.workunit.client.0.smithi031.stdout:0/574: write d0/f7d [495259,17590] 0 2024-09-17T01:52:07.097 INFO:tasks.workunit.client.0.smithi031.stdout:5/428: getdents da/dc 0 2024-09-17T01:52:07.098 INFO:tasks.workunit.client.1.smithi092.stdout:9/336: chown d0/c3 314436 1 2024-09-17T01:52:07.100 INFO:tasks.workunit.client.0.smithi031.stdout:0/575: dread - d0/d29/da7/db3/d4a/d86/fc2 zero size 2024-09-17T01:52:07.100 INFO:tasks.workunit.client.1.smithi092.stdout:9/337: fdatasync d0/df/d17/f1c 0 2024-09-17T01:52:07.101 INFO:tasks.workunit.client.0.smithi031.stdout:9/430: fdatasync d3/d10/f48 0 2024-09-17T01:52:07.101 INFO:tasks.workunit.client.1.smithi092.stdout:3/359: link d4/d2f/d44/d3c/f3e d4/d13/d2e/f75 0 2024-09-17T01:52:07.102 INFO:tasks.workunit.client.1.smithi092.stdout:9/338: fdatasync d0/d7/d12/d34/f3a 0 2024-09-17T01:52:07.103 INFO:tasks.workunit.client.0.smithi031.stdout:8/477: creat d0/d5/d6c/f8b x:0 0 0 2024-09-17T01:52:07.104 INFO:tasks.workunit.client.0.smithi031.stdout:5/429: dread da/d42/d26/f45 [0,4194304] 0 2024-09-17T01:52:07.105 INFO:tasks.workunit.client.0.smithi031.stdout:8/478: stat d0/df/d19/d3d/c83 0 2024-09-17T01:52:07.106 INFO:tasks.workunit.client.1.smithi092.stdout:4/372: creat d4/d5/d1d/d30/d3f/d4b/f81 x:0 0 0 2024-09-17T01:52:07.107 INFO:tasks.workunit.client.1.smithi092.stdout:9/339: dread d0/df/f18 [0,4194304] 0 2024-09-17T01:52:07.108 INFO:tasks.workunit.client.0.smithi031.stdout:5/430: write da/dc/f73 [1426864,13566] 0 2024-09-17T01:52:07.108 INFO:tasks.workunit.client.0.smithi031.stdout:6/634: dread d23/d63/d47/f60 [0,4194304] 0 2024-09-17T01:52:07.108 INFO:tasks.workunit.client.1.smithi092.stdout:5/349: rename d0/de/d19/d1a/f58 to d0/de/d19/f76 0 2024-09-17T01:52:07.109 INFO:tasks.workunit.client.1.smithi092.stdout:9/340: chown d0/d7/d12/d34/d26/f61 1729751 1 2024-09-17T01:52:07.110 INFO:tasks.workunit.client.0.smithi031.stdout:0/576: creat d0/d29/d33/d2a/d25/da5/fc5 x:0 0 0 2024-09-17T01:52:07.111 INFO:tasks.workunit.client.0.smithi031.stdout:5/431: write da/dc/f73 [1364263,4109] 0 2024-09-17T01:52:07.111 INFO:tasks.workunit.client.1.smithi092.stdout:3/360: mknod d4/d2f/d44/d54/c76 0 2024-09-17T01:52:07.112 INFO:tasks.workunit.client.0.smithi031.stdout:2/580: dread d1/d3/d2d/db2/d1e/d21/f90 [0,4194304] 0 2024-09-17T01:52:07.112 INFO:tasks.workunit.client.0.smithi031.stdout:7/535: link db/d1c/f40 db/d1c/d41/d9a/fa9 0 2024-09-17T01:52:07.113 INFO:tasks.workunit.client.1.smithi092.stdout:5/350: mkdir d0/d77 0 2024-09-17T01:52:07.115 INFO:tasks.workunit.client.0.smithi031.stdout:7/536: dread - db/d1c/f9f zero size 2024-09-17T01:52:07.118 INFO:tasks.workunit.client.0.smithi031.stdout:7/537: write db/d18/f6a [92890,110713] 0 2024-09-17T01:52:07.120 INFO:tasks.workunit.client.0.smithi031.stdout:9/431: link d3/d19/d1f/f7b d3/d19/d1f/f87 0 2024-09-17T01:52:07.121 INFO:tasks.workunit.client.0.smithi031.stdout:9/432: chown d3/d19/d1f/f6b 865 1 2024-09-17T01:52:07.122 INFO:tasks.workunit.client.1.smithi092.stdout:9/341: dwrite d0/d5/d29/f55 [0,4194304] 0 2024-09-17T01:52:07.122 INFO:tasks.workunit.client.1.smithi092.stdout:4/373: dwrite d4/d13/d3b/d42/d76/d41/d67/f69 [0,4194304] 0 2024-09-17T01:52:07.123 INFO:tasks.workunit.client.1.smithi092.stdout:3/361: creat d4/d2f/d44/f77 x:0 0 0 2024-09-17T01:52:07.124 INFO:tasks.workunit.client.0.smithi031.stdout:9/433: write d3/d19/f65 [2846015,8474] 0 2024-09-17T01:52:07.125 INFO:tasks.workunit.client.0.smithi031.stdout:5/432: dwrite da/dc/d2e/d62/f78 [0,4194304] 0 2024-09-17T01:52:07.126 INFO:tasks.workunit.client.0.smithi031.stdout:2/581: symlink d1/d3/d2d/db2/d1e/d21/d34/lc7 0 2024-09-17T01:52:07.127 INFO:tasks.workunit.client.1.smithi092.stdout:0/463: truncate d3/da/f10 604814 0 2024-09-17T01:52:07.127 INFO:tasks.workunit.client.1.smithi092.stdout:5/351: dwrite d0/de/f11 [0,4194304] 0 2024-09-17T01:52:07.128 INFO:tasks.workunit.client.0.smithi031.stdout:6/635: mkdir d23/db4/d8a/dd5/ddd 0 2024-09-17T01:52:07.128 INFO:tasks.workunit.client.0.smithi031.stdout:5/433: write f5 [877555,29765] 0 2024-09-17T01:52:07.130 INFO:tasks.workunit.client.0.smithi031.stdout:9/434: read d3/d4/d41/d70/f84 [3506264,54737] 0 2024-09-17T01:52:07.130 INFO:tasks.workunit.client.1.smithi092.stdout:3/362: unlink d4/f60 0 2024-09-17T01:52:07.131 INFO:tasks.workunit.client.1.smithi092.stdout:9/342: symlink d0/df/d5d/l63 0 2024-09-17T01:52:07.134 INFO:tasks.workunit.client.1.smithi092.stdout:4/374: rename f2 to d4/d13/d3b/f82 0 2024-09-17T01:52:07.136 INFO:tasks.workunit.client.1.smithi092.stdout:0/464: dwrite d3/d2e/d3b/d48/f5b [0,4194304] 0 2024-09-17T01:52:07.139 INFO:tasks.workunit.client.0.smithi031.stdout:9/435: read d3/d19/f65 [3046560,7743] 0 2024-09-17T01:52:07.140 INFO:tasks.workunit.client.0.smithi031.stdout:8/479: creat d0/d5/d54/f8c x:0 0 0 2024-09-17T01:52:07.143 INFO:tasks.workunit.client.1.smithi092.stdout:3/363: mknod d4/d20/d31/c78 0 2024-09-17T01:52:07.143 INFO:tasks.workunit.client.0.smithi031.stdout:8/480: dread - d0/df/d19/d3d/f5f zero size 2024-09-17T01:52:07.144 INFO:tasks.workunit.client.1.smithi092.stdout:9/343: symlink d0/d7/d12/d34/d26/d54/l64 0 2024-09-17T01:52:07.144 INFO:tasks.workunit.client.0.smithi031.stdout:0/577: link d0/d29/d33/c49 d0/d37/dba/cc6 0 2024-09-17T01:52:07.145 INFO:tasks.workunit.client.1.smithi092.stdout:9/344: readlink d0/d7/d12/d34/d26/d54/l64 0 2024-09-17T01:52:07.146 INFO:tasks.workunit.client.1.smithi092.stdout:9/345: fdatasync d0/f4c 0 2024-09-17T01:52:07.147 INFO:tasks.workunit.client.0.smithi031.stdout:0/578: read d0/f7d [276911,95445] 0 2024-09-17T01:52:07.148 INFO:tasks.workunit.client.1.smithi092.stdout:4/375: symlink d4/d13/d3b/d42/d76/d41/l83 0 2024-09-17T01:52:07.148 INFO:tasks.workunit.client.1.smithi092.stdout:9/346: write d0/f4c [3946875,83411] 0 2024-09-17T01:52:07.149 INFO:tasks.workunit.client.0.smithi031.stdout:6/636: creat d23/db4/d64/dc1/fde x:0 0 0 2024-09-17T01:52:07.150 INFO:tasks.workunit.client.1.smithi092.stdout:3/364: mknod d4/d16/d1b/c79 0 2024-09-17T01:52:07.151 INFO:tasks.workunit.client.0.smithi031.stdout:8/481: mkdir d0/df/dd/d59/d8d 0 2024-09-17T01:52:07.151 INFO:tasks.workunit.client.0.smithi031.stdout:6/637: chown d23/db4/d6a/d70/db0/fb2 2420 1 2024-09-17T01:52:07.152 INFO:tasks.workunit.client.1.smithi092.stdout:3/365: write d4/d20/f42 [623102,111318] 0 2024-09-17T01:52:07.153 INFO:tasks.workunit.client.1.smithi092.stdout:9/347: stat d0/d7/d12/l4a 0 2024-09-17T01:52:07.154 INFO:tasks.workunit.client.0.smithi031.stdout:0/579: fdatasync d0/f21 0 2024-09-17T01:52:07.155 INFO:tasks.workunit.client.1.smithi092.stdout:3/366: symlink d4/d13/l7a 0 2024-09-17T01:52:07.156 INFO:tasks.workunit.client.1.smithi092.stdout:9/348: rmdir d0/d7 39 2024-09-17T01:52:07.156 INFO:tasks.workunit.client.0.smithi031.stdout:9/436: symlink d3/d19/l88 0 2024-09-17T01:52:07.159 INFO:tasks.workunit.client.1.smithi092.stdout:4/376: rmdir d4/d13/d3b/d42/d76/d80 0 2024-09-17T01:52:07.159 INFO:tasks.workunit.client.0.smithi031.stdout:2/582: write d1/d3/df/f8d [408680,62368] 0 2024-09-17T01:52:07.161 INFO:tasks.workunit.client.1.smithi092.stdout:9/349: mkdir d0/df/d17/d65 0 2024-09-17T01:52:07.161 INFO:tasks.workunit.client.0.smithi031.stdout:8/482: truncate d0/d5/d54/d60/f66 1168761 0 2024-09-17T01:52:07.162 INFO:tasks.workunit.client.0.smithi031.stdout:2/583: chown d1/d3/d2d/db2/d1e/d2a/d7f/fa9 282 1 2024-09-17T01:52:07.163 INFO:tasks.workunit.client.1.smithi092.stdout:3/367: dwrite d4/d16/f48 [0,4194304] 0 2024-09-17T01:52:07.164 INFO:tasks.workunit.client.0.smithi031.stdout:6/638: creat d23/fdf x:0 0 0 2024-09-17T01:52:07.167 INFO:tasks.workunit.client.1.smithi092.stdout:9/350: creat d0/df/f66 x:0 0 0 2024-09-17T01:52:07.167 INFO:tasks.workunit.client.0.smithi031.stdout:8/483: symlink d0/d5/l8e 0 2024-09-17T01:52:07.167 INFO:tasks.workunit.client.1.smithi092.stdout:3/368: mkdir d4/d73/d7b 0 2024-09-17T01:52:07.167 INFO:tasks.workunit.client.1.smithi092.stdout:3/369: chown d4/d20/d31 15 1 2024-09-17T01:52:07.168 INFO:tasks.workunit.client.1.smithi092.stdout:9/351: readlink d0/d7/lc 0 2024-09-17T01:52:07.169 INFO:tasks.workunit.client.0.smithi031.stdout:8/484: truncate d0/f70 62454 0 2024-09-17T01:52:07.172 INFO:tasks.workunit.client.1.smithi092.stdout:3/370: dread d4/d16/f48 [0,4194304] 0 2024-09-17T01:52:07.173 INFO:tasks.workunit.client.1.smithi092.stdout:3/371: stat d4/d13/l3d 0 2024-09-17T01:52:07.173 INFO:tasks.workunit.client.1.smithi092.stdout:9/352: rename d0/d5/d29/f40 to d0/df/f67 0 2024-09-17T01:52:07.176 INFO:tasks.workunit.client.1.smithi092.stdout:3/372: truncate d4/d13/d2e/d5f/f5c 1030843 0 2024-09-17T01:52:07.177 INFO:tasks.workunit.client.0.smithi031.stdout:8/485: write d0/df/d19/d3d/f3e [821182,44775] 0 2024-09-17T01:52:07.178 INFO:tasks.workunit.client.0.smithi031.stdout:8/486: chown d0 1559 1 2024-09-17T01:52:07.178 INFO:tasks.workunit.client.1.smithi092.stdout:9/353: getdents d0/d7/d12/d34/d26/d54/d2e 0 2024-09-17T01:52:07.181 INFO:tasks.workunit.client.0.smithi031.stdout:0/580: dwrite d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:52:07.182 INFO:tasks.workunit.client.0.smithi031.stdout:6/639: dread f5 [0,4194304] 0 2024-09-17T01:52:07.182 INFO:tasks.workunit.client.1.smithi092.stdout:3/373: creat d4/d20/f7c x:0 0 0 2024-09-17T01:52:07.184 INFO:tasks.workunit.client.0.smithi031.stdout:8/487: creat d0/d5/d6c/d6d/f8f x:0 0 0 2024-09-17T01:52:07.184 INFO:tasks.workunit.client.0.smithi031.stdout:0/581: truncate d0/d37/fbc 580688 0 2024-09-17T01:52:07.185 INFO:tasks.workunit.client.0.smithi031.stdout:6/640: symlink d23/d63/d47/d81/le0 0 2024-09-17T01:52:07.186 INFO:tasks.workunit.client.1.smithi092.stdout:3/374: creat d4/d20/d39/f7d x:0 0 0 2024-09-17T01:52:07.186 INFO:tasks.workunit.client.0.smithi031.stdout:8/488: write d0/df/dd/f51 [4917844,80408] 0 2024-09-17T01:52:07.188 INFO:tasks.workunit.client.1.smithi092.stdout:9/354: creat d0/df/d17/f68 x:0 0 0 2024-09-17T01:52:07.188 INFO:tasks.workunit.client.0.smithi031.stdout:6/641: truncate d23/d63/fd8 121742 0 2024-09-17T01:52:07.189 INFO:tasks.workunit.client.1.smithi092.stdout:3/375: creat d4/d73/f7e x:0 0 0 2024-09-17T01:52:07.190 INFO:tasks.workunit.client.0.smithi031.stdout:8/489: chown d0/d5/d54/l82 401258 1 2024-09-17T01:52:07.191 INFO:tasks.workunit.client.0.smithi031.stdout:0/582: truncate d0/d29/da7/db3/d4a/d86/da1/fc4 1038226 0 2024-09-17T01:52:07.193 INFO:tasks.workunit.client.1.smithi092.stdout:0/465: write d3/d2e/d3b/d40/f53 [1051407,106830] 0 2024-09-17T01:52:07.194 INFO:tasks.workunit.client.0.smithi031.stdout:9/437: dread d3/d4/f2f [0,4194304] 0 2024-09-17T01:52:07.194 INFO:tasks.workunit.client.1.smithi092.stdout:4/377: getdents d4/d13/d3b/d42/d76/d41 0 2024-09-17T01:52:07.195 INFO:tasks.workunit.client.0.smithi031.stdout:0/583: symlink d0/d29/da7/lc7 0 2024-09-17T01:52:07.195 INFO:tasks.workunit.client.0.smithi031.stdout:8/490: getdents d0/df/dd/d59/d8d 0 2024-09-17T01:52:07.197 INFO:tasks.workunit.client.1.smithi092.stdout:4/378: write d4/d5/f33 [998694,7529] 0 2024-09-17T01:52:07.197 INFO:tasks.workunit.client.1.smithi092.stdout:0/466: write d3/d1d/d6b/f86 [802999,100749] 0 2024-09-17T01:52:07.198 INFO:tasks.workunit.client.0.smithi031.stdout:0/584: write d0/d29/d33/d2a/d25/da5/fa8 [459488,116867] 0 2024-09-17T01:52:07.198 INFO:tasks.workunit.client.0.smithi031.stdout:8/491: fsync d0/df/dd/d77/d78/f7f 0 2024-09-17T01:52:07.199 INFO:tasks.workunit.client.0.smithi031.stdout:9/438: rmdir d3/d4/d68 0 2024-09-17T01:52:07.200 INFO:tasks.workunit.client.1.smithi092.stdout:3/376: dwrite d4/d20/d39/f7d [0,4194304] 0 2024-09-17T01:52:07.201 INFO:tasks.workunit.client.0.smithi031.stdout:9/439: chown d3/d19/f34 3 1 2024-09-17T01:52:07.204 INFO:tasks.workunit.client.0.smithi031.stdout:2/584: dread d1/f5 [0,4194304] 0 2024-09-17T01:52:07.204 INFO:tasks.workunit.client.1.smithi092.stdout:0/467: creat d3/da/d1c/f91 x:0 0 0 2024-09-17T01:52:07.205 INFO:tasks.workunit.client.0.smithi031.stdout:9/440: mknod d3/c89 0 2024-09-17T01:52:07.209 INFO:tasks.workunit.client.1.smithi092.stdout:4/379: rename d4/d13/d20/f2e to d4/d13/d3b/d42/d76/d35/f84 0 2024-09-17T01:52:07.211 INFO:tasks.workunit.client.1.smithi092.stdout:9/355: dread d0/d7/d12/d34/d26/d54/f24 [0,4194304] 0 2024-09-17T01:52:07.211 INFO:tasks.workunit.client.1.smithi092.stdout:4/380: write d4/d5/d1d/f3c [4515134,47118] 0 2024-09-17T01:52:07.211 INFO:tasks.workunit.client.1.smithi092.stdout:9/356: chown d0/d5 22549 1 2024-09-17T01:52:07.213 INFO:tasks.workunit.client.1.smithi092.stdout:4/381: chown d4/d5/c1f 0 1 2024-09-17T01:52:07.213 INFO:tasks.workunit.client.0.smithi031.stdout:8/492: dwrite d0/df/f46 [0,4194304] 0 2024-09-17T01:52:07.215 INFO:tasks.workunit.client.0.smithi031.stdout:6/642: dwrite d23/db4/d6a/d70/d74/fbc [0,4194304] 0 2024-09-17T01:52:07.215 INFO:tasks.workunit.client.0.smithi031.stdout:0/585: dwrite d0/d29/d33/d2a/d25/f26 [0,4194304] 0 2024-09-17T01:52:07.216 INFO:tasks.workunit.client.0.smithi031.stdout:2/585: link d1/d3/df/c22 d1/d3/df/d11/d30/cc8 0 2024-09-17T01:52:07.217 INFO:tasks.workunit.client.1.smithi092.stdout:3/377: mkdir d4/d2f/d44/d7f 0 2024-09-17T01:52:07.218 INFO:tasks.workunit.client.0.smithi031.stdout:0/586: readlink d0/d29/da7/dbb/lae 0 2024-09-17T01:52:07.218 INFO:tasks.workunit.client.0.smithi031.stdout:6/643: chown d23/db4/d6a/d70/d74/fb5 0 1 2024-09-17T01:52:07.218 INFO:tasks.workunit.client.1.smithi092.stdout:3/378: read d4/d13/d2e/f3b [45675,34649] 0 2024-09-17T01:52:07.218 INFO:tasks.workunit.client.1.smithi092.stdout:3/379: stat d4/d20 0 2024-09-17T01:52:07.221 INFO:tasks.workunit.client.0.smithi031.stdout:8/493: link d0/d5/f43 d0/df/d19/f90 0 2024-09-17T01:52:07.222 INFO:tasks.workunit.client.0.smithi031.stdout:2/586: symlink d1/d3/df/d11/lc9 0 2024-09-17T01:52:07.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/380: chown d4/d20/d39/l65 166772 1 2024-09-17T01:52:07.226 INFO:tasks.workunit.client.1.smithi092.stdout:9/357: mkdir d0/df/d69 0 2024-09-17T01:52:07.226 INFO:tasks.workunit.client.1.smithi092.stdout:9/358: stat d0/df/d17/c19 0 2024-09-17T01:52:07.231 INFO:tasks.workunit.client.1.smithi092.stdout:9/359: unlink d0/d5/f2a 0 2024-09-17T01:52:07.237 INFO:tasks.workunit.client.1.smithi092.stdout:3/381: creat d4/d16/f80 x:0 0 0 2024-09-17T01:52:07.237 INFO:tasks.workunit.client.1.smithi092.stdout:9/360: creat d0/d5/d29/f6a x:0 0 0 2024-09-17T01:52:07.237 INFO:tasks.workunit.client.1.smithi092.stdout:0/468: dread d3/d2e/d55/f67 [0,4194304] 0 2024-09-17T01:52:07.238 INFO:tasks.workunit.client.1.smithi092.stdout:3/382: creat d4/d20/f81 x:0 0 0 2024-09-17T01:52:07.239 INFO:tasks.workunit.client.1.smithi092.stdout:9/361: mkdir d0/d7/d12/d34/d26/d54/d6b 0 2024-09-17T01:52:07.240 INFO:tasks.workunit.client.1.smithi092.stdout:9/362: dread - d0/d7/d21/f50 zero size 2024-09-17T01:52:07.240 INFO:tasks.workunit.client.1.smithi092.stdout:3/383: symlink d4/d16/d1b/l82 0 2024-09-17T01:52:07.241 INFO:tasks.workunit.client.1.smithi092.stdout:9/363: dread - d0/f59 zero size 2024-09-17T01:52:07.242 INFO:tasks.workunit.client.1.smithi092.stdout:3/384: unlink d4/d20/c2a 0 2024-09-17T01:52:07.244 INFO:tasks.workunit.client.1.smithi092.stdout:3/385: unlink d4/c6e 0 2024-09-17T01:52:07.244 INFO:tasks.workunit.client.1.smithi092.stdout:3/386: dread - d4/d2f/f53 zero size 2024-09-17T01:52:07.245 INFO:tasks.workunit.client.1.smithi092.stdout:9/364: creat d0/f6c x:0 0 0 2024-09-17T01:52:07.245 INFO:tasks.workunit.client.1.smithi092.stdout:4/382: dread d4/d5/d8/f34 [0,4194304] 0 2024-09-17T01:52:07.248 INFO:tasks.workunit.client.1.smithi092.stdout:4/383: write d4/d13/d3b/d42/d76/f48 [2128421,15783] 0 2024-09-17T01:52:07.249 INFO:tasks.workunit.client.1.smithi092.stdout:4/384: write d4/f62 [3948975,49125] 0 2024-09-17T01:52:07.249 INFO:tasks.workunit.client.1.smithi092.stdout:3/387: mkdir d4/d2f/d44/d83 0 2024-09-17T01:52:07.251 INFO:tasks.workunit.client.1.smithi092.stdout:4/385: fsync d4/d13/d3b/d42/d76/d35/f7f 0 2024-09-17T01:52:07.252 INFO:tasks.workunit.client.1.smithi092.stdout:4/386: chown d4/d5/d1d/d30/d3f/d4b 5303149 1 2024-09-17T01:52:07.257 INFO:tasks.workunit.client.1.smithi092.stdout:4/387: rename d4/d13/d20/c38 to d4/d13/d3b/c85 0 2024-09-17T01:52:07.260 INFO:tasks.workunit.client.1.smithi092.stdout:4/388: truncate d4/d13/d3b/d42/d76/d35/f39 1045823 0 2024-09-17T01:52:07.263 INFO:tasks.workunit.client.0.smithi031.stdout:6/644: creat d23/d63/d47/fe1 x:0 0 0 2024-09-17T01:52:07.263 INFO:tasks.workunit.client.0.smithi031.stdout:8/494: symlink d0/df/dd/l91 0 2024-09-17T01:52:07.263 INFO:tasks.workunit.client.0.smithi031.stdout:6/645: fsync d23/db4/d8a/fcc 0 2024-09-17T01:52:07.263 INFO:tasks.workunit.client.1.smithi092.stdout:3/388: dread d4/d16/f24 [4194304,4194304] 0 2024-09-17T01:52:07.264 INFO:tasks.workunit.client.1.smithi092.stdout:4/389: creat d4/d13/d3b/d42/f86 x:0 0 0 2024-09-17T01:52:07.265 INFO:tasks.workunit.client.1.smithi092.stdout:9/365: dread d0/f6 [8388608,4194304] 0 2024-09-17T01:52:07.266 INFO:tasks.workunit.client.0.smithi031.stdout:8/495: creat d0/df/dd/d77/f92 x:0 0 0 2024-09-17T01:52:07.266 INFO:tasks.workunit.client.1.smithi092.stdout:9/366: write d0/d7/f36 [230481,499] 0 2024-09-17T01:52:07.267 INFO:tasks.workunit.client.0.smithi031.stdout:0/587: getdents d0/d29/da7 0 2024-09-17T01:52:07.267 INFO:tasks.workunit.client.1.smithi092.stdout:3/389: creat d4/d20/f84 x:0 0 0 2024-09-17T01:52:07.268 INFO:tasks.workunit.client.0.smithi031.stdout:0/588: chown d0/d29/da7/db3/f77 160 1 2024-09-17T01:52:07.269 INFO:tasks.workunit.client.1.smithi092.stdout:4/390: rename d4/d5/d8/f4e to d4/d13/d3b/d42/d76/d35/d3e/d7c/f87 0 2024-09-17T01:52:07.270 INFO:tasks.workunit.client.1.smithi092.stdout:3/390: stat d4/d13/d2e/c41 0 2024-09-17T01:52:07.271 INFO:tasks.workunit.client.1.smithi092.stdout:9/367: symlink d0/d7/l6d 0 2024-09-17T01:52:07.273 INFO:tasks.workunit.client.1.smithi092.stdout:4/391: dread d4/d5/f33 [0,4194304] 0 2024-09-17T01:52:07.274 INFO:tasks.workunit.client.1.smithi092.stdout:3/391: mknod d4/c85 0 2024-09-17T01:52:07.276 INFO:tasks.workunit.client.1.smithi092.stdout:4/392: mknod d4/d13/d3b/d42/d76/d41/c88 0 2024-09-17T01:52:07.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/646: dread d23/f36 [0,4194304] 0 2024-09-17T01:52:07.278 INFO:tasks.workunit.client.1.smithi092.stdout:9/368: dwrite d0/f6c [0,4194304] 0 2024-09-17T01:52:07.280 INFO:tasks.workunit.client.1.smithi092.stdout:4/393: unlink d4/d5/f79 0 2024-09-17T01:52:07.282 INFO:tasks.workunit.client.1.smithi092.stdout:3/392: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:52:07.284 INFO:tasks.workunit.client.1.smithi092.stdout:9/369: readlink d0/df/l53 0 2024-09-17T01:52:07.284 INFO:tasks.workunit.client.1.smithi092.stdout:9/370: fsync d0/d5/d29/f55 0 2024-09-17T01:52:07.286 INFO:tasks.workunit.client.1.smithi092.stdout:4/394: write d4/d13/d3b/f82 [3409419,33132] 0 2024-09-17T01:52:07.287 INFO:tasks.workunit.client.1.smithi092.stdout:3/393: truncate d4/f30 7439 0 2024-09-17T01:52:07.290 INFO:tasks.workunit.client.1.smithi092.stdout:9/371: rename d0/d7/d12/d34/c49 to d0/d7/d12/d34/c6e 0 2024-09-17T01:52:07.294 INFO:tasks.workunit.client.1.smithi092.stdout:9/372: unlink d0/d7/d12/l4a 0 2024-09-17T01:52:07.295 INFO:tasks.workunit.client.1.smithi092.stdout:4/395: dwrite d4/d13/d3b/d42/d76/d35/f7f [0,4194304] 0 2024-09-17T01:52:07.298 INFO:tasks.workunit.client.1.smithi092.stdout:4/396: write d4/d13/d3b/f78 [4327646,43500] 0 2024-09-17T01:52:07.300 INFO:tasks.workunit.client.1.smithi092.stdout:9/373: rename d0/d7/d12/d34/d26/f61 to d0/d7/d12/d34/d26/f6f 0 2024-09-17T01:52:07.303 INFO:tasks.workunit.client.1.smithi092.stdout:4/397: creat d4/d13/d3b/d42/d76/d35/d3e/d7c/f89 x:0 0 0 2024-09-17T01:52:07.304 INFO:tasks.workunit.client.1.smithi092.stdout:9/374: mknod d0/d7/d12/d34/d26/d54/d2e/c70 0 2024-09-17T01:52:07.306 INFO:tasks.workunit.client.1.smithi092.stdout:9/375: dread d0/df/f47 [0,4194304] 0 2024-09-17T01:52:07.312 INFO:tasks.workunit.client.1.smithi092.stdout:9/376: rename d0/d7/d12/d34/d26/d54/d2e/c70 to d0/d7/d21/c71 0 2024-09-17T01:52:07.312 INFO:tasks.workunit.client.1.smithi092.stdout:9/377: dread - d0/f5c zero size 2024-09-17T01:52:07.313 INFO:tasks.workunit.client.0.smithi031.stdout:2/587: getdents d1/d3/d45 0 2024-09-17T01:52:07.313 INFO:tasks.workunit.client.1.smithi092.stdout:9/378: chown d0/d7/d12/d34/d26/d54 86222 1 2024-09-17T01:52:07.314 INFO:tasks.workunit.client.0.smithi031.stdout:2/588: chown d1/d3/d45/f6b 108123 1 2024-09-17T01:52:07.315 INFO:tasks.workunit.client.0.smithi031.stdout:8/496: rmdir d0/df/dd/d77/d78 39 2024-09-17T01:52:07.316 INFO:tasks.workunit.client.1.smithi092.stdout:3/394: dread d4/d16/d1b/f47 [0,4194304] 0 2024-09-17T01:52:07.316 INFO:tasks.workunit.client.0.smithi031.stdout:8/497: write d0/df/dd/f45 [3848800,56957] 0 2024-09-17T01:52:07.318 INFO:tasks.workunit.client.1.smithi092.stdout:9/379: rename d0/df/f18 to d0/d7/d12/d34/f72 0 2024-09-17T01:52:07.319 INFO:tasks.workunit.client.0.smithi031.stdout:0/589: rename d0/d29/d33/d5/d78 to d0/d29/d33/d5/d48/d56/dc8 0 2024-09-17T01:52:07.320 INFO:tasks.workunit.client.0.smithi031.stdout:0/590: truncate d0/d29/d33/f35 5086214 0 2024-09-17T01:52:07.321 INFO:tasks.workunit.client.1.smithi092.stdout:3/395: creat d4/d20/f86 x:0 0 0 2024-09-17T01:52:07.322 INFO:tasks.workunit.client.0.smithi031.stdout:0/591: write d0/d29/da7/db3/d9c/fa0 [598484,19272] 0 2024-09-17T01:52:07.323 INFO:tasks.workunit.client.0.smithi031.stdout:0/592: write d0/d37/f81 [439471,24074] 0 2024-09-17T01:52:07.324 INFO:tasks.workunit.client.1.smithi092.stdout:4/398: dread d4/d13/d3b/f82 [0,4194304] 0 2024-09-17T01:52:07.325 INFO:tasks.workunit.client.1.smithi092.stdout:3/396: creat d4/d16/d1b/f87 x:0 0 0 2024-09-17T01:52:07.325 INFO:tasks.workunit.client.1.smithi092.stdout:9/380: dwrite d0/d7/d12/d34/d26/d54/d2e/f41 [0,4194304] 0 2024-09-17T01:52:07.326 INFO:tasks.workunit.client.0.smithi031.stdout:6/647: mknod d23/db4/d6a/d70/ce2 0 2024-09-17T01:52:07.327 INFO:tasks.workunit.client.0.smithi031.stdout:6/648: chown d23/d63/d47/l4d 510749 1 2024-09-17T01:52:07.328 INFO:tasks.workunit.client.1.smithi092.stdout:3/397: creat d4/d2f/d44/d54/f88 x:0 0 0 2024-09-17T01:52:07.329 INFO:tasks.workunit.client.1.smithi092.stdout:4/399: write d4/d13/d3b/d42/d76/d35/d3e/d7c/f87 [502067,1231] 0 2024-09-17T01:52:07.331 INFO:tasks.workunit.client.0.smithi031.stdout:8/498: dread d0/d5/f2f [0,4194304] 0 2024-09-17T01:52:07.331 INFO:tasks.workunit.client.1.smithi092.stdout:4/400: write d4/d5/d1d/d30/f5b [86357,88892] 0 2024-09-17T01:52:07.333 INFO:tasks.workunit.client.1.smithi092.stdout:4/401: write d4/d13/d3b/f6d [1952153,27298] 0 2024-09-17T01:52:07.337 INFO:tasks.workunit.client.0.smithi031.stdout:2/589: truncate d1/d3/d2d/db2/d1e/d2a/f95 3868425 0 2024-09-17T01:52:07.337 INFO:tasks.workunit.client.1.smithi092.stdout:9/381: dwrite d0/df/d17/f1c [0,4194304] 0 2024-09-17T01:52:07.338 INFO:tasks.workunit.client.1.smithi092.stdout:3/398: dread d4/d20/d39/f5e [0,4194304] 0 2024-09-17T01:52:07.339 INFO:tasks.workunit.client.1.smithi092.stdout:4/402: fdatasync d4/d5/f40 0 2024-09-17T01:52:07.339 INFO:tasks.workunit.client.1.smithi092.stdout:3/399: stat d4/f18 0 2024-09-17T01:52:07.341 INFO:tasks.workunit.client.0.smithi031.stdout:8/499: dwrite d0/df/d19/d3d/f3e [0,4194304] 0 2024-09-17T01:52:07.342 INFO:tasks.workunit.client.1.smithi092.stdout:3/400: write d4/d2f/f53 [795689,70116] 0 2024-09-17T01:52:07.343 INFO:tasks.workunit.client.0.smithi031.stdout:2/590: mkdir d1/d3/df/d11/d30/da1/dca 0 2024-09-17T01:52:07.345 INFO:tasks.workunit.client.1.smithi092.stdout:4/403: creat d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a x:0 0 0 2024-09-17T01:52:07.345 INFO:tasks.workunit.client.0.smithi031.stdout:6/649: dwrite d23/db4/f69 [0,4194304] 0 2024-09-17T01:52:07.351 INFO:tasks.workunit.client.0.smithi031.stdout:6/650: unlink d23/db4/d64/dc1/fd4 0 2024-09-17T01:52:07.354 INFO:tasks.workunit.client.0.smithi031.stdout:6/651: creat d23/d63/d47/d81/fe3 x:0 0 0 2024-09-17T01:52:07.356 INFO:tasks.workunit.client.0.smithi031.stdout:6/652: fdatasync d23/d63/f4f 0 2024-09-17T01:52:07.358 INFO:tasks.workunit.client.1.smithi092.stdout:9/382: dwrite d0/df/f47 [0,4194304] 0 2024-09-17T01:52:07.364 INFO:tasks.workunit.client.1.smithi092.stdout:9/383: rmdir d0/d7/d12/d34/d26/d54 39 2024-09-17T01:52:07.365 INFO:tasks.workunit.client.0.smithi031.stdout:8/500: dwrite d0/df/d19/f27 [0,4194304] 0 2024-09-17T01:52:07.366 INFO:tasks.workunit.client.1.smithi092.stdout:4/404: dwrite d4/d13/d3b/d42/d76/d35/f39 [0,4194304] 0 2024-09-17T01:52:07.366 INFO:tasks.workunit.client.1.smithi092.stdout:3/401: dwrite d4/d16/d1b/f21 [0,4194304] 0 2024-09-17T01:52:07.367 INFO:tasks.workunit.client.1.smithi092.stdout:7/445: sync 2024-09-17T01:52:07.367 INFO:tasks.workunit.client.0.smithi031.stdout:6/653: dwrite d23/db4/d6a/d91/fb6 [0,4194304] 0 2024-09-17T01:52:07.367 INFO:tasks.workunit.client.0.smithi031.stdout:8/501: fdatasync d0/d5/d6c/d6d/f72 0 2024-09-17T01:52:07.373 INFO:tasks.workunit.client.1.smithi092.stdout:9/384: mknod d0/d7/d12/d34/d26/c73 0 2024-09-17T01:52:07.374 INFO:tasks.workunit.client.1.smithi092.stdout:3/402: truncate d4/d13/d2e/d5f/f62 785759 0 2024-09-17T01:52:07.375 INFO:tasks.workunit.client.0.smithi031.stdout:8/502: unlink d0/df/d19/c35 0 2024-09-17T01:52:07.377 INFO:tasks.workunit.client.1.smithi092.stdout:4/405: creat d4/f8b x:0 0 0 2024-09-17T01:52:07.378 INFO:tasks.workunit.client.0.smithi031.stdout:8/503: write d0/df/f46 [1118115,92399] 0 2024-09-17T01:52:07.378 INFO:tasks.workunit.client.0.smithi031.stdout:6/654: mknod d23/db4/d6a/d70/ce4 0 2024-09-17T01:52:07.380 INFO:tasks.workunit.client.0.smithi031.stdout:8/504: write d0/d5/d6c/d6d/f8f [754356,84973] 0 2024-09-17T01:52:07.381 INFO:tasks.workunit.client.1.smithi092.stdout:9/385: creat d0/df/d5d/f74 x:0 0 0 2024-09-17T01:52:07.382 INFO:tasks.workunit.client.0.smithi031.stdout:6/655: mknod d23/db4/ce5 0 2024-09-17T01:52:07.382 INFO:tasks.workunit.client.1.smithi092.stdout:7/446: dwrite d3/d6/d13/d21/f38 [0,4194304] 0 2024-09-17T01:52:07.383 INFO:tasks.workunit.client.1.smithi092.stdout:4/406: rmdir d4/d13/d3b/d42/d76/d35 39 2024-09-17T01:52:07.385 INFO:tasks.workunit.client.1.smithi092.stdout:9/386: write d0/f5c [314273,107476] 0 2024-09-17T01:52:07.388 INFO:tasks.workunit.client.1.smithi092.stdout:3/403: dwrite d4/d13/f63 [0,4194304] 0 2024-09-17T01:52:07.388 INFO:tasks.workunit.client.0.smithi031.stdout:8/505: link d0/d5/d54/d60/l7e d0/df/d19/d86/l93 0 2024-09-17T01:52:07.389 INFO:tasks.workunit.client.0.smithi031.stdout:8/506: chown d0/l71 1484107 1 2024-09-17T01:52:07.390 INFO:tasks.workunit.client.1.smithi092.stdout:7/447: mkdir d3/db/d26/d65/d9a 0 2024-09-17T01:52:07.390 INFO:tasks.workunit.client.0.smithi031.stdout:6/656: read d23/db4/f58 [4328604,58158] 0 2024-09-17T01:52:07.391 INFO:tasks.workunit.client.1.smithi092.stdout:9/387: creat d0/d7/d21/f75 x:0 0 0 2024-09-17T01:52:07.394 INFO:tasks.workunit.client.1.smithi092.stdout:7/448: creat d3/d6/d13/d40/d6a/f9b x:0 0 0 2024-09-17T01:52:07.395 INFO:tasks.workunit.client.1.smithi092.stdout:3/404: mkdir d4/d13/d2e/d5f/d89 0 2024-09-17T01:52:07.395 INFO:tasks.workunit.client.0.smithi031.stdout:6/657: dread d23/db4/f69 [0,4194304] 0 2024-09-17T01:52:07.397 INFO:tasks.workunit.client.0.smithi031.stdout:6/658: read d23/d63/d47/d81/fca [1270942,101364] 0 2024-09-17T01:52:07.399 INFO:tasks.workunit.client.0.smithi031.stdout:6/659: symlink d23/db4/d8a/dd5/ddd/le6 0 2024-09-17T01:52:07.400 INFO:tasks.workunit.client.1.smithi092.stdout:4/407: getdents d4/d13/d3b/d42/d76/d35 0 2024-09-17T01:52:07.400 INFO:tasks.workunit.client.1.smithi092.stdout:3/405: mknod d4/d13/d2e/c8a 0 2024-09-17T01:52:07.401 INFO:tasks.workunit.client.1.smithi092.stdout:7/449: dread d3/d6/d13/d21/f38 [0,4194304] 0 2024-09-17T01:52:07.401 INFO:tasks.workunit.client.0.smithi031.stdout:6/660: mknod d23/db4/ce7 0 2024-09-17T01:52:07.402 INFO:tasks.workunit.client.1.smithi092.stdout:9/388: rmdir d0/df/d69 0 2024-09-17T01:52:07.403 INFO:tasks.workunit.client.0.smithi031.stdout:6/661: mknod d23/d63/d47/d81/ce8 0 2024-09-17T01:52:07.405 INFO:tasks.workunit.client.0.smithi031.stdout:6/662: mkdir d23/db4/d64/d67/de9 0 2024-09-17T01:52:07.405 INFO:tasks.workunit.client.1.smithi092.stdout:4/408: read d4/d13/d3b/f78 [3733249,122263] 0 2024-09-17T01:52:07.405 INFO:tasks.workunit.client.1.smithi092.stdout:7/450: write d3/db/f4a [1868418,77096] 0 2024-09-17T01:52:07.407 INFO:tasks.workunit.client.1.smithi092.stdout:9/389: creat d0/df/d5d/f76 x:0 0 0 2024-09-17T01:52:07.407 INFO:tasks.workunit.client.0.smithi031.stdout:6/663: truncate d23/f3b 165612 0 2024-09-17T01:52:07.407 INFO:tasks.workunit.client.0.smithi031.stdout:6/664: chown d23/l44 5388 1 2024-09-17T01:52:07.408 INFO:tasks.workunit.client.1.smithi092.stdout:7/451: write d3/d2b/d3a/f6b [83365,63927] 0 2024-09-17T01:52:07.408 INFO:tasks.workunit.client.0.smithi031.stdout:6/665: fsync d23/d63/f5d 0 2024-09-17T01:52:07.409 INFO:tasks.workunit.client.0.smithi031.stdout:6/666: chown c3 22 1 2024-09-17T01:52:07.411 INFO:tasks.workunit.client.1.smithi092.stdout:4/409: write d4/d13/d3b/d42/d76/d35/f84 [2133562,62803] 0 2024-09-17T01:52:07.412 INFO:tasks.workunit.client.0.smithi031.stdout:6/667: mknod d23/db4/d6a/d70/cea 0 2024-09-17T01:52:07.414 INFO:tasks.workunit.client.1.smithi092.stdout:7/452: getdents d3/d6/d13/d40/d61 0 2024-09-17T01:52:07.415 INFO:tasks.workunit.client.1.smithi092.stdout:9/390: dwrite d0/d5/d29/f55 [0,4194304] 0 2024-09-17T01:52:07.416 INFO:tasks.workunit.client.1.smithi092.stdout:4/410: mknod d4/d13/d3b/d42/d76/d35/d3e/c8c 0 2024-09-17T01:52:07.417 INFO:tasks.workunit.client.0.smithi031.stdout:8/507: dwrite d0/df/d19/d3d/f5c [0,4194304] 0 2024-09-17T01:52:07.418 INFO:tasks.workunit.client.1.smithi092.stdout:4/411: write d4/d5/d1d/f1a [223286,21210] 0 2024-09-17T01:52:07.419 INFO:tasks.workunit.client.1.smithi092.stdout:7/453: creat d3/d6/f9c x:0 0 0 2024-09-17T01:52:07.420 INFO:tasks.workunit.client.1.smithi092.stdout:4/412: write d4/d5/d1d/d30/f5b [676360,90701] 0 2024-09-17T01:52:07.424 INFO:tasks.workunit.client.0.smithi031.stdout:8/508: truncate d0/df/dd/d77/d78/f7f 3660913 0 2024-09-17T01:52:07.425 INFO:tasks.workunit.client.0.smithi031.stdout:8/509: fsync d0/f42 0 2024-09-17T01:52:07.429 INFO:tasks.workunit.client.1.smithi092.stdout:4/413: rename d4/d5/f33 to d4/d13/d3b/f8d 0 2024-09-17T01:52:07.430 INFO:tasks.workunit.client.0.smithi031.stdout:8/510: rename d0/df/d19/d3d to d0/d5/d6c/d6d/d94 0 2024-09-17T01:52:07.430 INFO:tasks.workunit.client.1.smithi092.stdout:7/454: truncate d3/db/d26/f43 288675 0 2024-09-17T01:52:07.433 INFO:tasks.workunit.client.0.smithi031.stdout:8/511: mknod d0/df/dd/d59/d8d/c95 0 2024-09-17T01:52:07.433 INFO:tasks.workunit.client.0.smithi031.stdout:6/668: rmdir d23 39 2024-09-17T01:52:07.435 INFO:tasks.workunit.client.1.smithi092.stdout:4/414: symlink d4/d13/d3b/d42/d76/d41/d67/l8e 0 2024-09-17T01:52:07.437 INFO:tasks.workunit.client.1.smithi092.stdout:3/406: dwrite d4/d2f/d44/d3c/f3e [0,4194304] 0 2024-09-17T01:52:07.440 INFO:tasks.workunit.client.0.smithi031.stdout:6/669: unlink d23/db4/d6a/d72/l7d 0 2024-09-17T01:52:07.440 INFO:tasks.workunit.client.0.smithi031.stdout:6/670: fsync f1e 0 2024-09-17T01:52:07.441 INFO:tasks.workunit.client.1.smithi092.stdout:7/455: creat d3/db/d26/d65/f9d x:0 0 0 2024-09-17T01:52:07.443 INFO:tasks.workunit.client.1.smithi092.stdout:7/456: write d3/d2b/d3a/d5a/f68 [1483722,99923] 0 2024-09-17T01:52:07.443 INFO:tasks.workunit.client.0.smithi031.stdout:6/671: unlink d23/d63/cb9 0 2024-09-17T01:52:07.445 INFO:tasks.workunit.client.0.smithi031.stdout:6/672: write d23/db4/d64/faf [384787,75781] 0 2024-09-17T01:52:07.447 INFO:tasks.workunit.client.1.smithi092.stdout:9/391: dwrite d0/df/f27 [0,4194304] 0 2024-09-17T01:52:07.449 INFO:tasks.workunit.client.0.smithi031.stdout:6/673: rename d23/d63/d47/dc2 to d23/db4/d6a/deb 0 2024-09-17T01:52:07.449 INFO:tasks.workunit.client.0.smithi031.stdout:6/674: chown d23/d63/fb8 61138 1 2024-09-17T01:52:07.451 INFO:tasks.workunit.client.0.smithi031.stdout:8/512: dread d0/d5/f11 [0,4194304] 0 2024-09-17T01:52:07.451 INFO:tasks.workunit.client.0.smithi031.stdout:6/675: write d23/f31 [5721228,88014] 0 2024-09-17T01:52:07.451 INFO:tasks.workunit.client.1.smithi092.stdout:3/407: dwrite d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T01:52:07.453 INFO:tasks.workunit.client.1.smithi092.stdout:4/415: dwrite d4/d13/d3b/d42/d76/d35/f7f [0,4194304] 0 2024-09-17T01:52:07.454 INFO:tasks.workunit.client.1.smithi092.stdout:4/416: fdatasync d4/f8b 0 2024-09-17T01:52:07.454 INFO:tasks.workunit.client.1.smithi092.stdout:9/392: write d0/d7/d12/d34/d26/d54/d2e/f41 [2462843,105196] 0 2024-09-17T01:52:07.456 INFO:tasks.workunit.client.1.smithi092.stdout:4/417: write d4/d5/d1d/f3c [4949729,94601] 0 2024-09-17T01:52:07.456 INFO:tasks.workunit.client.0.smithi031.stdout:6/676: unlink d23/db4/d8a/fc6 0 2024-09-17T01:52:07.458 INFO:tasks.workunit.client.0.smithi031.stdout:8/513: unlink d0/d5/c10 0 2024-09-17T01:52:07.461 INFO:tasks.workunit.client.0.smithi031.stdout:8/514: dread - d0/d5/d54/d60/f6b zero size 2024-09-17T01:52:07.462 INFO:tasks.workunit.client.1.smithi092.stdout:4/418: rename d4/d5/f70 to d4/d13/f8f 0 2024-09-17T01:52:07.462 INFO:tasks.workunit.client.0.smithi031.stdout:8/515: readlink d0/df/dd/l7b 0 2024-09-17T01:52:07.464 INFO:tasks.workunit.client.1.smithi092.stdout:9/393: dwrite d0/df/d5d/f76 [0,4194304] 0 2024-09-17T01:52:07.465 INFO:tasks.workunit.client.0.smithi031.stdout:6/677: creat d23/db4/fec x:0 0 0 2024-09-17T01:52:07.468 INFO:tasks.workunit.client.1.smithi092.stdout:9/394: chown d0/d7/d12/d34/d26/f6f 0 1 2024-09-17T01:52:07.468 INFO:tasks.workunit.client.1.smithi092.stdout:4/419: rename d4/d5/d1d/d30/d3f/d4b/l4d to d4/d13/l90 0 2024-09-17T01:52:07.476 INFO:tasks.workunit.client.1.smithi092.stdout:4/420: dwrite d4/d13/f2b [0,4194304] 0 2024-09-17T01:52:07.477 INFO:tasks.workunit.client.1.smithi092.stdout:4/421: dread d4/d13/d3b/f82 [4194304,4194304] 0 2024-09-17T01:52:07.481 INFO:tasks.workunit.client.1.smithi092.stdout:4/422: write d4/d13/d3b/d42/d76/d35/d3e/f43 [1156492,89529] 0 2024-09-17T01:52:07.486 INFO:tasks.workunit.client.1.smithi092.stdout:4/423: dwrite d4/d5/d1d/d30/f5b [0,4194304] 0 2024-09-17T01:52:07.488 INFO:tasks.workunit.client.1.smithi092.stdout:4/424: write d4/f62 [2776751,130751] 0 2024-09-17T01:52:07.499 INFO:tasks.workunit.client.1.smithi092.stdout:4/425: truncate d4/d13/f2b 3717560 0 2024-09-17T01:52:07.500 INFO:tasks.workunit.client.1.smithi092.stdout:4/426: truncate d4/d13/d3b/f47 663340 0 2024-09-17T01:52:07.502 INFO:tasks.workunit.client.1.smithi092.stdout:4/427: symlink d4/d5/d1d/d30/l91 0 2024-09-17T01:52:07.502 INFO:tasks.workunit.client.1.smithi092.stdout:4/428: stat d4/d5/d46/c66 0 2024-09-17T01:52:07.510 INFO:tasks.workunit.client.1.smithi092.stdout:4/429: dwrite d4/d13/f2b [0,4194304] 0 2024-09-17T01:52:07.511 INFO:tasks.workunit.client.1.smithi092.stdout:4/430: chown d4/d5/c1f 113913050 1 2024-09-17T01:52:07.513 INFO:tasks.workunit.client.1.smithi092.stdout:4/431: mkdir d4/d5/d8/d92 0 2024-09-17T01:52:07.516 INFO:tasks.workunit.client.1.smithi092.stdout:4/432: creat d4/d7b/d7d/f93 x:0 0 0 2024-09-17T01:52:07.525 INFO:tasks.workunit.client.1.smithi092.stdout:4/433: truncate d4/d13/d3b/f82 798552 0 2024-09-17T01:52:07.526 INFO:tasks.workunit.client.1.smithi092.stdout:4/434: read d4/d5/d1d/f1a [441931,34245] 0 2024-09-17T01:52:07.528 INFO:tasks.workunit.client.1.smithi092.stdout:4/435: creat d4/f94 x:0 0 0 2024-09-17T01:52:07.528 INFO:tasks.workunit.client.1.smithi092.stdout:4/436: readlink d4/d5/d46/l6f 0 2024-09-17T01:52:07.535 INFO:tasks.workunit.client.1.smithi092.stdout:4/437: truncate d4/d13/d3b/d42/d76/d35/f7f 2598147 0 2024-09-17T01:52:07.535 INFO:tasks.workunit.client.1.smithi092.stdout:4/438: chown d4/d5/d46 89506 1 2024-09-17T01:52:07.541 INFO:tasks.workunit.client.1.smithi092.stdout:4/439: dread d4/d13/d3b/f82 [0,4194304] 0 2024-09-17T01:52:07.546 INFO:tasks.workunit.client.1.smithi092.stdout:4/440: truncate d4/d13/d3b/d42/d76/d41/d67/f69 1954274 0 2024-09-17T01:52:07.546 INFO:tasks.workunit.client.1.smithi092.stdout:4/441: stat d4/d5 0 2024-09-17T01:52:07.546 INFO:tasks.workunit.client.1.smithi092.stdout:4/442: write d4/d13/d20/f29 [3163415,59753] 0 2024-09-17T01:52:07.552 INFO:tasks.workunit.client.1.smithi092.stdout:4/443: dread d4/d13/d3b/d42/d76/d41/d67/f69 [0,4194304] 0 2024-09-17T01:52:07.553 INFO:tasks.workunit.client.1.smithi092.stdout:4/444: creat d4/d7b/d7d/f95 x:0 0 0 2024-09-17T01:52:07.557 INFO:tasks.workunit.client.1.smithi092.stdout:4/445: link d4/d5/d1d/d30/l5d d4/d5/d8/l96 0 2024-09-17T01:52:07.558 INFO:tasks.workunit.client.1.smithi092.stdout:4/446: symlink d4/d5/l97 0 2024-09-17T01:52:07.560 INFO:tasks.workunit.client.1.smithi092.stdout:4/447: mkdir d4/d5/d8/d98 0 2024-09-17T01:52:07.564 INFO:tasks.workunit.client.1.smithi092.stdout:4/448: truncate d4/d13/f17 867613 0 2024-09-17T01:52:07.566 INFO:tasks.workunit.client.1.smithi092.stdout:4/449: mkdir d4/d5/d8/d99 0 2024-09-17T01:52:07.567 INFO:tasks.workunit.client.1.smithi092.stdout:4/450: write d4/d5/f6a [1661150,23820] 0 2024-09-17T01:52:07.572 INFO:tasks.workunit.client.1.smithi092.stdout:4/451: dwrite d4/d5/d1d/d30/f64 [0,4194304] 0 2024-09-17T01:52:07.576 INFO:tasks.workunit.client.1.smithi092.stdout:2/316: sync 2024-09-17T01:52:07.577 INFO:tasks.workunit.client.1.smithi092.stdout:2/317: write d10/d15/f47 [13265,5628] 0 2024-09-17T01:52:07.579 INFO:tasks.workunit.client.1.smithi092.stdout:4/452: dwrite d4/d5/d1d/d30/f5b [0,4194304] 0 2024-09-17T01:52:07.579 INFO:tasks.workunit.client.1.smithi092.stdout:2/318: mkdir d10/d1d/d24/d6b 0 2024-09-17T01:52:07.580 INFO:tasks.workunit.client.1.smithi092.stdout:4/453: read - d4/d13/d3b/d42/f86 zero size 2024-09-17T01:52:07.582 INFO:tasks.workunit.client.0.smithi031.stdout:4/731: sync 2024-09-17T01:52:07.582 INFO:tasks.workunit.client.0.smithi031.stdout:3/536: sync 2024-09-17T01:52:07.584 INFO:tasks.workunit.client.1.smithi092.stdout:2/319: creat d10/d4c/f6c x:0 0 0 2024-09-17T01:52:07.584 INFO:tasks.workunit.client.1.smithi092.stdout:2/320: fdatasync d10/d15/f47 0 2024-09-17T01:52:07.586 INFO:tasks.workunit.client.1.smithi092.stdout:4/454: rename d4/d5/d1d/f3c to d4/d5/d1d/d30/f9a 0 2024-09-17T01:52:07.587 INFO:tasks.workunit.client.0.smithi031.stdout:4/732: rename d8/f14 to d8/d3a/fee 0 2024-09-17T01:52:07.588 INFO:tasks.workunit.client.0.smithi031.stdout:4/733: read - d8/d3a/d41/de6/fe8 zero size 2024-09-17T01:52:07.589 INFO:tasks.workunit.client.1.smithi092.stdout:4/455: getdents d4/d5/d8/d98 0 2024-09-17T01:52:07.592 INFO:tasks.workunit.client.0.smithi031.stdout:4/734: creat d8/d3a/d41/d64/fef x:0 0 0 2024-09-17T01:52:07.592 INFO:tasks.workunit.client.1.smithi092.stdout:2/321: dwrite d10/d55/f64 [0,4194304] 0 2024-09-17T01:52:07.593 INFO:tasks.workunit.client.1.smithi092.stdout:4/456: rmdir d4/d13/d3b/d42/d76/d41/d67 39 2024-09-17T01:52:07.594 INFO:tasks.workunit.client.0.smithi031.stdout:4/735: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/ff0 x:0 0 0 2024-09-17T01:52:07.596 INFO:tasks.workunit.client.1.smithi092.stdout:4/457: symlink d4/d13/d3b/d42/d76/d35/d3e/l9b 0 2024-09-17T01:52:07.597 INFO:tasks.workunit.client.0.smithi031.stdout:4/736: unlink d8/d3a/d41/d64/d4f/fd0 0 2024-09-17T01:52:07.597 INFO:tasks.workunit.client.1.smithi092.stdout:4/458: read d4/d13/d3b/f6d [424403,89188] 0 2024-09-17T01:52:07.600 INFO:tasks.workunit.client.0.smithi031.stdout:4/737: dread - d8/d3a/d41/fa2 zero size 2024-09-17T01:52:07.602 INFO:tasks.workunit.client.0.smithi031.stdout:4/738: dread - d8/d3a/d41/d64/d4d/d5a/d8c/d25/fbb zero size 2024-09-17T01:52:07.602 INFO:tasks.workunit.client.1.smithi092.stdout:2/322: dwrite d10/d1d/d24/f62 [0,4194304] 0 2024-09-17T01:52:07.607 INFO:tasks.workunit.client.0.smithi031.stdout:4/739: rename d8/d3a/d41/d64/d86 to d8/d3a/d41/d64/d4d/d5a/df1 0 2024-09-17T01:52:07.607 INFO:tasks.workunit.client.1.smithi092.stdout:2/323: getdents d10/d1d 0 2024-09-17T01:52:07.608 INFO:tasks.workunit.client.0.smithi031.stdout:3/537: dread db/f34 [0,4194304] 0 2024-09-17T01:52:07.609 INFO:tasks.workunit.client.0.smithi031.stdout:4/740: dread - d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/ff0 zero size 2024-09-17T01:52:07.611 INFO:tasks.workunit.client.1.smithi092.stdout:2/324: rename d10/f4b to d10/d54/f6d 0 2024-09-17T01:52:07.611 INFO:tasks.workunit.client.0.smithi031.stdout:3/538: read db/df/d1d/d37/d77/f80 [462700,12970] 0 2024-09-17T01:52:07.612 INFO:tasks.workunit.client.0.smithi031.stdout:4/741: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/fe4 12867603 1 2024-09-17T01:52:07.623 INFO:tasks.workunit.client.1.smithi092.stdout:2/325: truncate d10/d1d/d2d/f31 30585 0 2024-09-17T01:52:07.625 INFO:tasks.workunit.client.0.smithi031.stdout:3/539: truncate db/f42 3678714 0 2024-09-17T01:52:07.632 INFO:tasks.workunit.client.0.smithi031.stdout:4/742: dread d8/fd6 [0,4194304] 0 2024-09-17T01:52:07.633 INFO:tasks.workunit.client.1.smithi092.stdout:2/326: dwrite d10/d1d/d2c/f57 [0,4194304] 0 2024-09-17T01:52:07.634 INFO:tasks.workunit.client.0.smithi031.stdout:3/540: dwrite db/f3e [4194304,4194304] 0 2024-09-17T01:52:07.636 INFO:tasks.workunit.client.0.smithi031.stdout:3/541: dread db/d29/f2e [4194304,4194304] 0 2024-09-17T01:52:07.636 INFO:tasks.workunit.client.0.smithi031.stdout:4/743: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f8e 2539 1 2024-09-17T01:52:07.637 INFO:tasks.workunit.client.0.smithi031.stdout:3/542: stat db/df/d1d/d37/d3a/l73 0 2024-09-17T01:52:07.642 INFO:tasks.workunit.client.0.smithi031.stdout:3/543: creat db/df/d1d/d37/d6c/d6e/f9f x:0 0 0 2024-09-17T01:52:07.644 INFO:tasks.workunit.client.0.smithi031.stdout:3/544: creat db/df/d50/fa0 x:0 0 0 2024-09-17T01:52:07.645 INFO:tasks.workunit.client.0.smithi031.stdout:3/545: rmdir db/df/d1c 39 2024-09-17T01:52:07.647 INFO:tasks.workunit.client.0.smithi031.stdout:1/602: sync 2024-09-17T01:52:07.647 INFO:tasks.workunit.client.0.smithi031.stdout:1/603: dread - d4/d1e/d3f/d72/d7e/da2/fb3 zero size 2024-09-17T01:52:07.648 INFO:tasks.workunit.client.0.smithi031.stdout:3/546: chown db/df/c2c 25759 1 2024-09-17T01:52:07.649 INFO:tasks.workunit.client.0.smithi031.stdout:4/744: truncate d8/d3a/d41/d64/fc9 2832567 0 2024-09-17T01:52:07.651 INFO:tasks.workunit.client.0.smithi031.stdout:4/745: mknod d8/d9c/cf2 0 2024-09-17T01:52:07.654 INFO:tasks.workunit.client.0.smithi031.stdout:4/746: fsync d8/d3a/d41/d64/d4d/d5a/d8c/d25/f47 0 2024-09-17T01:52:07.657 INFO:tasks.workunit.client.0.smithi031.stdout:1/604: write d4/d1e/d3f/f60 [57285,57414] 0 2024-09-17T01:52:07.661 INFO:tasks.workunit.client.0.smithi031.stdout:1/605: creat d4/d1e/d40/d77/fca x:0 0 0 2024-09-17T01:52:07.665 INFO:tasks.workunit.client.0.smithi031.stdout:4/747: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fc4 [0,4194304] 0 2024-09-17T01:52:07.667 INFO:tasks.workunit.client.0.smithi031.stdout:4/748: chown d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/l76 3 1 2024-09-17T01:52:07.672 INFO:tasks.workunit.client.0.smithi031.stdout:3/547: dread db/df/d1d/d37/d4a/f43 [4194304,4194304] 0 2024-09-17T01:52:07.674 INFO:tasks.workunit.client.0.smithi031.stdout:3/548: truncate db/f7d 4876630 0 2024-09-17T01:52:07.677 INFO:tasks.workunit.client.0.smithi031.stdout:3/549: mkdir db/df/d1d/d37/da1 0 2024-09-17T01:52:07.682 INFO:tasks.workunit.client.0.smithi031.stdout:1/606: dread d4/d1a/d2d/d18/f2e [0,4194304] 0 2024-09-17T01:52:07.683 INFO:tasks.workunit.client.0.smithi031.stdout:1/607: stat d4/d1e/d8d 0 2024-09-17T01:52:07.685 INFO:tasks.workunit.client.0.smithi031.stdout:4/749: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 [0,4194304] 0 2024-09-17T01:52:07.685 INFO:tasks.workunit.client.0.smithi031.stdout:1/608: truncate d4/d3d/d65/f75 1858890 0 2024-09-17T01:52:07.686 INFO:tasks.workunit.client.0.smithi031.stdout:4/750: write d8/d3a/d41/d64/d4d/d5a/fab [831080,68584] 0 2024-09-17T01:52:07.690 INFO:tasks.workunit.client.0.smithi031.stdout:4/751: read d8/d3a/d41/d64/d4d/d5a/df1/f94 [1764071,8840] 0 2024-09-17T01:52:07.691 INFO:tasks.workunit.client.0.smithi031.stdout:1/609: dwrite d4/d3d/d65/f75 [0,4194304] 0 2024-09-17T01:52:07.693 INFO:tasks.workunit.client.0.smithi031.stdout:1/610: creat d4/d1e/d40/fcb x:0 0 0 2024-09-17T01:52:07.697 INFO:tasks.workunit.client.0.smithi031.stdout:4/752: dread d8/d3a/fee [0,4194304] 0 2024-09-17T01:52:07.699 INFO:tasks.workunit.client.0.smithi031.stdout:3/550: dread db/f12 [0,4194304] 0 2024-09-17T01:52:07.699 INFO:tasks.workunit.client.0.smithi031.stdout:4/753: stat d8/d3a/d41/d64/d4d/d8f/fc1 0 2024-09-17T01:52:07.701 INFO:tasks.workunit.client.0.smithi031.stdout:1/611: dwrite d4/d1e/d8d/f9a [0,4194304] 0 2024-09-17T01:52:07.703 INFO:tasks.workunit.client.0.smithi031.stdout:3/551: creat db/df/d1d/d37/da1/fa2 x:0 0 0 2024-09-17T01:52:07.727 INFO:tasks.workunit.client.0.smithi031.stdout:3/552: dread f6 [0,4194304] 0 2024-09-17T01:52:07.764 INFO:tasks.workunit.client.0.smithi031.stdout:1/612: rmdir d4/d1e/d5d 39 2024-09-17T01:52:07.765 INFO:tasks.workunit.client.0.smithi031.stdout:4/754: mknod d8/d3a/d41/d64/d4d/dae/cf3 0 2024-09-17T01:52:07.766 INFO:tasks.workunit.client.0.smithi031.stdout:3/553: write db/f12 [3282607,50718] 0 2024-09-17T01:52:07.767 INFO:tasks.workunit.client.0.smithi031.stdout:4/755: chown d8/d3a/d41/d64/d4d/d5a/d79 0 1 2024-09-17T01:52:07.770 INFO:tasks.workunit.client.0.smithi031.stdout:1/613: link d4/d1e/l2b d4/d1e/d40/lcc 0 2024-09-17T01:52:07.771 INFO:tasks.workunit.client.0.smithi031.stdout:4/756: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/cf4 0 2024-09-17T01:52:07.771 INFO:tasks.workunit.client.0.smithi031.stdout:3/554: mkdir db/da3 0 2024-09-17T01:52:07.773 INFO:tasks.workunit.client.0.smithi031.stdout:4/757: symlink d8/d3a/d41/d64/d92/lf5 0 2024-09-17T01:52:07.774 INFO:tasks.workunit.client.0.smithi031.stdout:3/555: chown db/df/f39 97 1 2024-09-17T01:52:07.775 INFO:tasks.workunit.client.0.smithi031.stdout:4/758: symlink d8/d3a/d41/de6/lf6 0 2024-09-17T01:52:07.777 INFO:tasks.workunit.client.0.smithi031.stdout:3/556: rmdir db/df/d1d/d37/d3a 39 2024-09-17T01:52:07.780 INFO:tasks.workunit.client.0.smithi031.stdout:4/759: rename d8/d9c/lb5 to d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/lf7 0 2024-09-17T01:52:07.782 INFO:tasks.workunit.client.0.smithi031.stdout:4/760: write d8/d3a/d41/d64/d4d/d5a/f6e [1812476,23978] 0 2024-09-17T01:52:07.782 INFO:tasks.workunit.client.0.smithi031.stdout:3/557: mknod db/df/d1d/d37/d4a/ca4 0 2024-09-17T01:52:07.782 INFO:tasks.workunit.client.0.smithi031.stdout:1/614: write d4/d1e/d40/d84/fa6 [428930,51385] 0 2024-09-17T01:52:07.784 INFO:tasks.workunit.client.0.smithi031.stdout:1/615: read - d4/d1e/d3f/d72/d7e/d92/f99 zero size 2024-09-17T01:52:07.785 INFO:tasks.workunit.client.0.smithi031.stdout:4/761: mkdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/df8 0 2024-09-17T01:52:07.786 INFO:tasks.workunit.client.0.smithi031.stdout:3/558: symlink db/df/d1d/d37/d6c/d6e/la5 0 2024-09-17T01:52:07.788 INFO:tasks.workunit.client.0.smithi031.stdout:1/616: rename d4/d1e/d40/d77 to d4/d1e/d3f/d4d/dcd 0 2024-09-17T01:52:07.796 INFO:tasks.workunit.client.0.smithi031.stdout:4/762: symlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/lf9 0 2024-09-17T01:52:07.800 INFO:tasks.workunit.client.0.smithi031.stdout:3/559: dread db/df/d1d/f7c [0,4194304] 0 2024-09-17T01:52:07.804 INFO:tasks.workunit.client.0.smithi031.stdout:1/617: dread d4/d1e/f49 [0,4194304] 0 2024-09-17T01:52:07.804 INFO:tasks.workunit.client.0.smithi031.stdout:3/560: mknod db/df/d1d/d37/d6c/d6e/ca6 0 2024-09-17T01:52:07.805 INFO:tasks.workunit.client.0.smithi031.stdout:3/561: fdatasync db/f88 0 2024-09-17T01:52:07.807 INFO:tasks.workunit.client.0.smithi031.stdout:4/763: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/f47 [0,4194304] 0 2024-09-17T01:52:07.809 INFO:tasks.workunit.client.0.smithi031.stdout:1/618: getdents d4/d1e/d3f/d72/d7e/d92 0 2024-09-17T01:52:07.811 INFO:tasks.workunit.client.0.smithi031.stdout:3/562: creat db/fa7 x:0 0 0 2024-09-17T01:52:07.813 INFO:tasks.workunit.client.0.smithi031.stdout:1/619: mkdir d4/d1e/d40/daa/dce 0 2024-09-17T01:52:07.814 INFO:tasks.workunit.client.0.smithi031.stdout:4/764: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/cfa 0 2024-09-17T01:52:07.815 INFO:tasks.workunit.client.0.smithi031.stdout:4/765: dread - d8/d3a/d41/fa2 zero size 2024-09-17T01:52:07.815 INFO:tasks.workunit.client.0.smithi031.stdout:3/563: rename db/df/d1d/d37/l8e to db/da3/la8 0 2024-09-17T01:52:07.816 INFO:tasks.workunit.client.0.smithi031.stdout:1/620: readlink d4/d1e/l62 0 2024-09-17T01:52:07.818 INFO:tasks.workunit.client.0.smithi031.stdout:3/564: creat db/d9b/fa9 x:0 0 0 2024-09-17T01:52:07.820 INFO:tasks.workunit.client.0.smithi031.stdout:1/621: symlink d4/d1e/d40/daa/dce/lcf 0 2024-09-17T01:52:07.821 INFO:tasks.workunit.client.0.smithi031.stdout:1/622: fdatasync d4/d1a/d43/fad 0 2024-09-17T01:52:07.821 INFO:tasks.workunit.client.0.smithi031.stdout:1/623: stat d4/d1a/d2d/d18/d52 0 2024-09-17T01:52:07.823 INFO:tasks.workunit.client.0.smithi031.stdout:4/766: dwrite d8/fd6 [0,4194304] 0 2024-09-17T01:52:07.824 INFO:tasks.workunit.client.0.smithi031.stdout:4/767: chown d8/d3a/d41/d64 6784 1 2024-09-17T01:52:07.828 INFO:tasks.workunit.client.0.smithi031.stdout:4/768: write d8/d3a/d41/d64/d4d/d8f/fc1 [685650,81479] 0 2024-09-17T01:52:07.829 INFO:tasks.workunit.client.0.smithi031.stdout:1/624: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:52:07.833 INFO:tasks.workunit.client.0.smithi031.stdout:1/625: mkdir d4/d3d/d65/db7/dd0 0 2024-09-17T01:52:07.836 INFO:tasks.workunit.client.0.smithi031.stdout:4/769: getdents d8/d3a/d41 0 2024-09-17T01:52:07.837 INFO:tasks.workunit.client.0.smithi031.stdout:1/626: unlink d4/d1e/l45 0 2024-09-17T01:52:07.840 INFO:tasks.workunit.client.0.smithi031.stdout:1/627: creat d4/d1a/d2d/fd1 x:0 0 0 2024-09-17T01:52:07.842 INFO:tasks.workunit.client.0.smithi031.stdout:1/628: creat d4/d3d/fd2 x:0 0 0 2024-09-17T01:52:07.844 INFO:tasks.workunit.client.0.smithi031.stdout:1/629: mkdir d4/d1a/d43/d53/dd3 0 2024-09-17T01:52:07.857 INFO:tasks.workunit.client.1.smithi092.stdout:8/349: sync 2024-09-17T01:52:07.859 INFO:tasks.workunit.client.0.smithi031.stdout:4/770: dread d8/d9c/fe0 [0,4194304] 0 2024-09-17T01:52:07.860 INFO:tasks.workunit.client.0.smithi031.stdout:4/771: mknod d8/d3a/d41/d64/d4d/cfb 0 2024-09-17T01:52:07.861 INFO:tasks.workunit.client.1.smithi092.stdout:8/350: dread d15/d32/d40/d42/f4b [0,4194304] 0 2024-09-17T01:52:07.861 INFO:tasks.workunit.client.0.smithi031.stdout:7/538: sync 2024-09-17T01:52:07.861 INFO:tasks.workunit.client.0.smithi031.stdout:9/441: sync 2024-09-17T01:52:07.861 INFO:tasks.workunit.client.0.smithi031.stdout:5/434: sync 2024-09-17T01:52:07.862 INFO:tasks.workunit.client.0.smithi031.stdout:7/539: chown db/l3f 364351187 1 2024-09-17T01:52:07.863 INFO:tasks.workunit.client.0.smithi031.stdout:5/435: read da/d42/f8c [26792,26032] 0 2024-09-17T01:52:07.865 INFO:tasks.workunit.client.0.smithi031.stdout:4/772: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa1 [0,4194304] 0 2024-09-17T01:52:07.865 INFO:tasks.workunit.client.0.smithi031.stdout:9/442: unlink d3/d19/d1f/f7b 0 2024-09-17T01:52:07.865 INFO:tasks.workunit.client.0.smithi031.stdout:9/443: readlink d3/d4/d41/l54 0 2024-09-17T01:52:07.866 INFO:tasks.workunit.client.1.smithi092.stdout:8/351: dwrite fa [0,4194304] 0 2024-09-17T01:52:07.866 INFO:tasks.workunit.client.0.smithi031.stdout:7/540: unlink db/f1f 0 2024-09-17T01:52:07.866 INFO:tasks.workunit.client.0.smithi031.stdout:9/444: read d3/d10/f38 [1207215,78651] 0 2024-09-17T01:52:07.868 INFO:tasks.workunit.client.0.smithi031.stdout:5/436: creat da/dc/f96 x:0 0 0 2024-09-17T01:52:07.868 INFO:tasks.workunit.client.1.smithi092.stdout:8/352: mkdir d15/d25/d27/d6e 0 2024-09-17T01:52:07.869 INFO:tasks.workunit.client.1.smithi092.stdout:8/353: chown d15/d32/d40/d42/d43/c51 8 1 2024-09-17T01:52:07.869 INFO:tasks.workunit.client.0.smithi031.stdout:7/541: symlink db/d1c/d8e/laa 0 2024-09-17T01:52:07.870 INFO:tasks.workunit.client.0.smithi031.stdout:9/445: rmdir d3/d10/d36/d62 39 2024-09-17T01:52:07.870 INFO:tasks.workunit.client.1.smithi092.stdout:8/354: write d15/d25/d27/f3e [528955,129981] 0 2024-09-17T01:52:07.871 INFO:tasks.workunit.client.0.smithi031.stdout:4/773: mknod d8/d3a/d41/d64/d4d/d5a/cfc 0 2024-09-17T01:52:07.872 INFO:tasks.workunit.client.1.smithi092.stdout:8/355: write d15/d25/d27/f41 [1796811,109930] 0 2024-09-17T01:52:07.872 INFO:tasks.workunit.client.0.smithi031.stdout:5/437: creat da/d42/d12/d72/f97 x:0 0 0 2024-09-17T01:52:07.874 INFO:tasks.workunit.client.0.smithi031.stdout:7/542: unlink db/d1c/d46/d95/c96 0 2024-09-17T01:52:07.874 INFO:tasks.workunit.client.0.smithi031.stdout:5/438: read - da/d42/d26/f75 zero size 2024-09-17T01:52:07.876 INFO:tasks.workunit.client.0.smithi031.stdout:9/446: creat d3/d19/d80/f8a x:0 0 0 2024-09-17T01:52:07.876 INFO:tasks.workunit.client.0.smithi031.stdout:7/543: chown db/d1c/c91 17944065 1 2024-09-17T01:52:07.879 INFO:tasks.workunit.client.1.smithi092.stdout:8/356: dwrite d15/d25/f29 [0,4194304] 0 2024-09-17T01:52:07.880 INFO:tasks.workunit.client.0.smithi031.stdout:7/544: creat db/d1c/d41/d9a/fab x:0 0 0 2024-09-17T01:52:07.880 INFO:tasks.workunit.client.0.smithi031.stdout:4/774: dwrite d8/d3a/d41/de6/fe8 [0,4194304] 0 2024-09-17T01:52:07.884 INFO:tasks.workunit.client.0.smithi031.stdout:9/447: dwrite d3/d19/f34 [0,4194304] 0 2024-09-17T01:52:07.885 INFO:tasks.workunit.client.0.smithi031.stdout:4/775: mkdir d8/d3a/d41/d64/d4d/dfd 0 2024-09-17T01:52:07.891 INFO:tasks.workunit.client.0.smithi031.stdout:7/545: dwrite db/f51 [0,4194304] 0 2024-09-17T01:52:07.893 INFO:tasks.workunit.client.1.smithi092.stdout:8/357: write d15/d25/f68 [5179798,59433] 0 2024-09-17T01:52:07.893 INFO:tasks.workunit.client.0.smithi031.stdout:4/776: unlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d52/l62 0 2024-09-17T01:52:07.895 INFO:tasks.workunit.client.1.smithi092.stdout:8/358: mkdir d15/d6f 0 2024-09-17T01:52:07.897 INFO:tasks.workunit.client.1.smithi092.stdout:8/359: fsync d15/d32/d40/d42/f5f 0 2024-09-17T01:52:07.903 INFO:tasks.workunit.client.1.smithi092.stdout:8/360: dwrite fa [4194304,4194304] 0 2024-09-17T01:52:07.904 INFO:tasks.workunit.client.0.smithi031.stdout:4/777: creat d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/ffe x:0 0 0 2024-09-17T01:52:07.905 INFO:tasks.workunit.client.0.smithi031.stdout:4/778: write d8/d3a/d41/d64/d4d/d5a/d8c/d25/f26 [3258253,22883] 0 2024-09-17T01:52:07.906 INFO:tasks.workunit.client.1.smithi092.stdout:8/361: symlink d15/l70 0 2024-09-17T01:52:07.906 INFO:tasks.workunit.client.0.smithi031.stdout:4/779: dread - d8/d3a/fde zero size 2024-09-17T01:52:07.909 INFO:tasks.workunit.client.0.smithi031.stdout:4/780: fsync d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/fe4 0 2024-09-17T01:52:07.909 INFO:tasks.workunit.client.1.smithi092.stdout:8/362: rename d15/d25/f2d to d15/d32/d40/d42/d43/f71 0 2024-09-17T01:52:07.911 INFO:tasks.workunit.client.0.smithi031.stdout:4/781: readlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/l76 0 2024-09-17T01:52:07.911 INFO:tasks.workunit.client.1.smithi092.stdout:7/457: sync 2024-09-17T01:52:07.911 INFO:tasks.workunit.client.1.smithi092.stdout:5/352: sync 2024-09-17T01:52:07.911 INFO:tasks.workunit.client.1.smithi092.stdout:3/408: sync 2024-09-17T01:52:07.911 INFO:tasks.workunit.client.1.smithi092.stdout:2/327: sync 2024-09-17T01:52:07.912 INFO:tasks.workunit.client.1.smithi092.stdout:0/469: sync 2024-09-17T01:52:07.912 INFO:tasks.workunit.client.1.smithi092.stdout:1/467: sync 2024-09-17T01:52:07.912 INFO:tasks.workunit.client.0.smithi031.stdout:4/782: readlink d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/l76 0 2024-09-17T01:52:07.913 INFO:tasks.workunit.client.1.smithi092.stdout:5/353: chown d0/de/d19/d3c/d41/f73 3242 1 2024-09-17T01:52:07.914 INFO:tasks.workunit.client.1.smithi092.stdout:2/328: mkdir d10/d1d/d24/d6e 0 2024-09-17T01:52:07.915 INFO:tasks.workunit.client.1.smithi092.stdout:6/378: sync 2024-09-17T01:52:07.915 INFO:tasks.workunit.client.1.smithi092.stdout:9/395: sync 2024-09-17T01:52:07.915 INFO:tasks.workunit.client.1.smithi092.stdout:4/459: sync 2024-09-17T01:52:07.915 INFO:tasks.workunit.client.0.smithi031.stdout:4/783: fsync d8/d3a/d41/d64/d4d/d5a/d79/f80 0 2024-09-17T01:52:07.915 INFO:tasks.workunit.client.0.smithi031.stdout:5/439: mkdir da/dc/d98 0 2024-09-17T01:52:07.916 INFO:tasks.workunit.client.1.smithi092.stdout:7/458: symlink d3/db/d98/l9e 0 2024-09-17T01:52:07.917 INFO:tasks.workunit.client.0.smithi031.stdout:4/784: stat d8/d3a/d41/d64/d4d/d75 0 2024-09-17T01:52:07.917 INFO:tasks.workunit.client.1.smithi092.stdout:0/470: write d3/d1d/d6b/f6c [150634,75198] 0 2024-09-17T01:52:07.918 INFO:tasks.workunit.client.0.smithi031.stdout:9/448: dread d3/f8 [0,4194304] 0 2024-09-17T01:52:07.920 INFO:tasks.workunit.client.0.smithi031.stdout:5/440: stat da/dc/f16 0 2024-09-17T01:52:07.920 INFO:tasks.workunit.client.0.smithi031.stdout:4/785: chown d8/d3a/d41/d64/d4d/d5a/d79/de3 95599 1 2024-09-17T01:52:07.921 INFO:tasks.workunit.client.0.smithi031.stdout:5/441: dread - da/d4b/f65 zero size 2024-09-17T01:52:07.921 INFO:tasks.workunit.client.0.smithi031.stdout:9/449: rmdir d3/d4/d41 39 2024-09-17T01:52:07.922 INFO:tasks.workunit.client.0.smithi031.stdout:5/442: stat f8 0 2024-09-17T01:52:07.926 INFO:tasks.workunit.client.1.smithi092.stdout:2/329: write d10/f14 [683823,61580] 0 2024-09-17T01:52:07.926 INFO:tasks.workunit.client.1.smithi092.stdout:5/354: dread d0/de/f11 [0,4194304] 0 2024-09-17T01:52:07.927 INFO:tasks.workunit.client.0.smithi031.stdout:9/450: rename d3/d4/d29/f74 to d3/d19/d1f/d44/f8b 0 2024-09-17T01:52:07.928 INFO:tasks.workunit.client.0.smithi031.stdout:5/443: truncate da/d42/f5c 166486 0 2024-09-17T01:52:07.930 INFO:tasks.workunit.client.0.smithi031.stdout:4/786: dwrite d8/d3a/d41/d64/d4d/d8f/fcc [0,4194304] 0 2024-09-17T01:52:07.930 INFO:tasks.workunit.client.1.smithi092.stdout:1/468: dread db/d1d/d23/f3c [4194304,4194304] 0 2024-09-17T01:52:07.931 INFO:tasks.workunit.client.0.smithi031.stdout:9/451: symlink d3/d19/d1f/d44/l8c 0 2024-09-17T01:52:07.935 INFO:tasks.workunit.client.0.smithi031.stdout:5/444: creat da/d42/d12/f99 x:0 0 0 2024-09-17T01:52:07.940 INFO:tasks.workunit.client.1.smithi092.stdout:5/355: chown d0/de/d19/d1a/d1e/f2a 3 1 2024-09-17T01:52:07.941 INFO:tasks.workunit.client.0.smithi031.stdout:5/445: unlink da/dc/c13 0 2024-09-17T01:52:07.943 INFO:tasks.workunit.client.0.smithi031.stdout:9/452: dwrite d3/f2a [0,4194304] 0 2024-09-17T01:52:07.944 INFO:tasks.workunit.client.1.smithi092.stdout:0/471: dwrite d3/d1d/f80 [0,4194304] 0 2024-09-17T01:52:07.945 INFO:tasks.workunit.client.1.smithi092.stdout:3/409: write d4/d13/d2e/f3b [1134744,97892] 0 2024-09-17T01:52:07.945 INFO:tasks.workunit.client.0.smithi031.stdout:9/453: chown d3/d10/d36/d79 184852 1 2024-09-17T01:52:07.945 INFO:tasks.workunit.client.1.smithi092.stdout:9/396: dwrite d0/d5/f8 [0,4194304] 0 2024-09-17T01:52:07.946 INFO:tasks.workunit.client.1.smithi092.stdout:6/379: dwrite d3/d10/d1f/d21/d28/d2b/d48/d18/f27 [0,4194304] 0 2024-09-17T01:52:07.948 INFO:tasks.workunit.client.0.smithi031.stdout:4/787: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/fd4 [0,4194304] 0 2024-09-17T01:52:07.949 INFO:tasks.workunit.client.0.smithi031.stdout:5/446: mknod da/dc/d25/c9a 0 2024-09-17T01:52:07.951 INFO:tasks.workunit.client.0.smithi031.stdout:4/788: rename d8 to d8/d3a/d41/d64/d4f/dff 22 2024-09-17T01:52:07.952 INFO:tasks.workunit.client.1.smithi092.stdout:6/380: chown d3/d10/d1f/d21/d28/d2b 101 1 2024-09-17T01:52:07.954 INFO:tasks.workunit.client.1.smithi092.stdout:4/460: dwrite d4/d13/d3b/f6d [0,4194304] 0 2024-09-17T01:52:07.954 INFO:tasks.workunit.client.1.smithi092.stdout:5/356: mkdir d0/d50/d70/d78 0 2024-09-17T01:52:07.956 INFO:tasks.workunit.client.1.smithi092.stdout:9/397: unlink d0/f6c 0 2024-09-17T01:52:07.959 INFO:tasks.workunit.client.1.smithi092.stdout:8/363: truncate d15/d32/d40/d42/d43/f71 938873 0 2024-09-17T01:52:07.959 INFO:tasks.workunit.client.1.smithi092.stdout:3/410: fsync d4/d2f/f4f 0 2024-09-17T01:52:07.960 INFO:tasks.workunit.client.0.smithi031.stdout:4/789: chown d8/d3a/d41/d64/d4d/d5a/c6b 28978256 1 2024-09-17T01:52:07.961 INFO:tasks.workunit.client.0.smithi031.stdout:4/790: read - d8/d3a/d41/fa2 zero size 2024-09-17T01:52:07.962 INFO:tasks.workunit.client.1.smithi092.stdout:2/330: dwrite d10/d1d/d2d/f34 [0,4194304] 0 2024-09-17T01:52:07.963 INFO:tasks.workunit.client.0.smithi031.stdout:5/447: symlink da/dc/d2e/l9b 0 2024-09-17T01:52:07.963 INFO:tasks.workunit.client.1.smithi092.stdout:8/364: dread - d15/d32/d40/d4c/f5c zero size 2024-09-17T01:52:07.967 INFO:tasks.workunit.client.0.smithi031.stdout:4/791: mknod d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/c100 0 2024-09-17T01:52:07.967 INFO:tasks.workunit.client.1.smithi092.stdout:0/472: getdents d3/d2e/d3b 0 2024-09-17T01:52:07.970 INFO:tasks.workunit.client.1.smithi092.stdout:6/381: link d3/d10/d1f/d21/d1e/d55/c6d d3/d25/c78 0 2024-09-17T01:52:07.971 INFO:tasks.workunit.client.1.smithi092.stdout:2/331: write d10/d1d/d24/f4f [1652124,96635] 0 2024-09-17T01:52:07.971 INFO:tasks.workunit.client.1.smithi092.stdout:9/398: creat d0/d7/f77 x:0 0 0 2024-09-17T01:52:07.972 INFO:tasks.workunit.client.0.smithi031.stdout:5/448: rename da/d42/d26/f45 to da/d4b/f9c 0 2024-09-17T01:52:07.973 INFO:tasks.workunit.client.1.smithi092.stdout:4/461: dwrite d4/d13/d3b/f47 [0,4194304] 0 2024-09-17T01:52:07.974 INFO:tasks.workunit.client.1.smithi092.stdout:2/332: chown d10/d15/f2b 64002 1 2024-09-17T01:52:07.976 INFO:tasks.workunit.client.0.smithi031.stdout:4/792: dread f5 [0,4194304] 0 2024-09-17T01:52:07.976 INFO:tasks.workunit.client.1.smithi092.stdout:0/473: chown d3/d2e/d3b/d40/c65 851197 1 2024-09-17T01:52:07.976 INFO:tasks.workunit.client.1.smithi092.stdout:6/382: mknod d3/d10/d1a/d43/d6a/c79 0 2024-09-17T01:52:07.977 INFO:tasks.workunit.client.0.smithi031.stdout:4/793: fdatasync d8/d3a/d41/d64/f7d 0 2024-09-17T01:52:07.978 INFO:tasks.workunit.client.0.smithi031.stdout:5/449: unlink da/d42/d12/f99 0 2024-09-17T01:52:07.978 INFO:tasks.workunit.client.1.smithi092.stdout:0/474: chown d3/d2e/d55/d63/f6d 5375029 1 2024-09-17T01:52:07.979 INFO:tasks.workunit.client.1.smithi092.stdout:4/462: readlink d4/d5/d1d/l23 0 2024-09-17T01:52:07.982 INFO:tasks.workunit.client.1.smithi092.stdout:9/399: creat d0/d7/d12/d34/d26/d54/d6b/f78 x:0 0 0 2024-09-17T01:52:07.983 INFO:tasks.workunit.client.1.smithi092.stdout:9/400: read d0/df/f67 [2872666,33388] 0 2024-09-17T01:52:07.984 INFO:tasks.workunit.client.1.smithi092.stdout:9/401: write d0/df/d5d/f76 [1555778,47679] 0 2024-09-17T01:52:07.984 INFO:tasks.workunit.client.1.smithi092.stdout:4/463: rmdir d4/d13/d3b 39 2024-09-17T01:52:07.985 INFO:tasks.workunit.client.0.smithi031.stdout:4/794: dwrite d8/fd6 [0,4194304] 0 2024-09-17T01:52:07.985 INFO:tasks.workunit.client.1.smithi092.stdout:4/464: chown d4/d5 23 1 2024-09-17T01:52:07.993 INFO:tasks.workunit.client.0.smithi031.stdout:4/795: creat d8/d3a/d41/f101 x:0 0 0 2024-09-17T01:52:07.993 INFO:tasks.workunit.client.0.smithi031.stdout:5/450: creat da/d42/f9d x:0 0 0 2024-09-17T01:52:08.000 INFO:tasks.workunit.client.0.smithi031.stdout:5/451: rename da/d4b/c69 to da/d42/c9e 0 2024-09-17T01:52:08.002 INFO:tasks.workunit.client.0.smithi031.stdout:5/452: creat da/d42/d26/f9f x:0 0 0 2024-09-17T01:52:08.006 INFO:tasks.workunit.client.0.smithi031.stdout:4/796: symlink d8/d3a/d41/d64/d4f/l102 0 2024-09-17T01:52:08.008 INFO:tasks.workunit.client.0.smithi031.stdout:5/453: write da/d42/d12/f86 [3321921,100663] 0 2024-09-17T01:52:08.009 INFO:tasks.workunit.client.0.smithi031.stdout:5/454: dread - da/d42/d12/d64/f93 zero size 2024-09-17T01:52:08.012 INFO:tasks.workunit.client.0.smithi031.stdout:4/797: link d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/c85 d8/d3a/d41/d64/d4d/d5a/d8c/d25/d65/c103 0 2024-09-17T01:52:08.013 INFO:tasks.workunit.client.0.smithi031.stdout:4/798: truncate d8/fad 1473179 0 2024-09-17T01:52:08.016 INFO:tasks.workunit.client.0.smithi031.stdout:9/454: dread d3/d10/f60 [0,4194304] 0 2024-09-17T01:52:08.016 INFO:tasks.workunit.client.0.smithi031.stdout:5/455: write f4 [7283771,2106] 0 2024-09-17T01:52:08.018 INFO:tasks.workunit.client.0.smithi031.stdout:5/456: dread - da/d42/d12/d4a/f71 zero size 2024-09-17T01:52:08.019 INFO:tasks.workunit.client.0.smithi031.stdout:0/593: sync 2024-09-17T01:52:08.019 INFO:tasks.workunit.client.0.smithi031.stdout:2/591: sync 2024-09-17T01:52:08.022 INFO:tasks.workunit.client.0.smithi031.stdout:2/592: truncate d1/d3/df/f2b 5936605 0 2024-09-17T01:52:08.022 INFO:tasks.workunit.client.0.smithi031.stdout:5/457: mknod da/dc/d2e/d62/ca0 0 2024-09-17T01:52:08.024 INFO:tasks.workunit.client.0.smithi031.stdout:9/455: truncate d3/f2a 3664146 0 2024-09-17T01:52:08.024 INFO:tasks.workunit.client.0.smithi031.stdout:4/799: dwrite d8/d3a/d41/d64/d4f/fc0 [0,4194304] 0 2024-09-17T01:52:08.026 INFO:tasks.workunit.client.0.smithi031.stdout:5/458: fdatasync da/f74 0 2024-09-17T01:52:08.030 INFO:tasks.workunit.client.0.smithi031.stdout:9/456: symlink d3/d19/d1f/l8d 0 2024-09-17T01:52:08.031 INFO:tasks.workunit.client.0.smithi031.stdout:2/593: dread d1/d3/df/d18/f3b [0,4194304] 0 2024-09-17T01:52:08.031 INFO:tasks.workunit.client.0.smithi031.stdout:4/800: chown d8/d3a/d41/de6/fea 1519 1 2024-09-17T01:52:08.032 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:07 smithi031 ceph-mon[27673]: pgmap v14: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 54 MiB/s rd, 273 MiB/s wr, 486 op/s 2024-09-17T01:52:08.034 INFO:tasks.workunit.client.0.smithi031.stdout:2/594: creat d1/d3/df/d11/d30/fcb x:0 0 0 2024-09-17T01:52:08.035 INFO:tasks.workunit.client.0.smithi031.stdout:4/801: truncate d8/d3a/d41/f4a 723239 0 2024-09-17T01:52:08.039 INFO:tasks.workunit.client.0.smithi031.stdout:5/459: rename da/c24 to da/d42/d12/ca1 0 2024-09-17T01:52:08.050 INFO:tasks.workunit.client.0.smithi031.stdout:2/595: dwrite d1/f8f [0,4194304] 0 2024-09-17T01:52:08.063 INFO:tasks.workunit.client.1.smithi092.stdout:6/383: truncate d3/f36 1240780 0 2024-09-17T01:52:08.064 INFO:tasks.workunit.client.0.smithi031.stdout:4/802: dread d8/f16 [0,4194304] 0 2024-09-17T01:52:08.066 INFO:tasks.workunit.client.1.smithi092.stdout:7/459: dread d3/d6/d13/d21/f36 [0,4194304] 0 2024-09-17T01:52:08.066 INFO:tasks.workunit.client.0.smithi031.stdout:5/460: dread - da/d14/f6a zero size 2024-09-17T01:52:08.067 INFO:tasks.workunit.client.0.smithi031.stdout:5/461: dread - da/dc/d2e/f77 zero size 2024-09-17T01:52:08.067 INFO:tasks.workunit.client.1.smithi092.stdout:9/402: symlink d0/df/d17/l79 0 2024-09-17T01:52:08.068 INFO:tasks.workunit.client.0.smithi031.stdout:9/457: rename d3/d4/d29/c5a to d3/d47/c8e 0 2024-09-17T01:52:08.070 INFO:tasks.workunit.client.0.smithi031.stdout:5/462: rmdir da/d42/d26 39 2024-09-17T01:52:08.070 INFO:tasks.workunit.client.1.smithi092.stdout:1/469: dwrite db/fd [4194304,4194304] 0 2024-09-17T01:52:08.072 INFO:tasks.workunit.client.1.smithi092.stdout:5/357: dwrite d0/d23/f4d [0,4194304] 0 2024-09-17T01:52:08.073 INFO:tasks.workunit.client.0.smithi031.stdout:9/458: read d3/d19/f22 [2105235,32827] 0 2024-09-17T01:52:08.073 INFO:tasks.workunit.client.1.smithi092.stdout:6/384: creat d3/d10/d1a/d43/d5e/d73/f7a x:0 0 0 2024-09-17T01:52:08.073 INFO:tasks.workunit.client.0.smithi031.stdout:2/596: rename d1/d3/d2d/db2/d1e/d4f/d92/fb3 to d1/d3/d2d/d91/fcc 0 2024-09-17T01:52:08.074 INFO:tasks.workunit.client.1.smithi092.stdout:7/460: symlink d3/d6/d13/l9f 0 2024-09-17T01:52:08.075 INFO:tasks.workunit.client.0.smithi031.stdout:9/459: write d3/d19/f22 [215537,93299] 0 2024-09-17T01:52:08.077 INFO:tasks.workunit.client.1.smithi092.stdout:8/365: dread f1 [0,4194304] 0 2024-09-17T01:52:08.080 INFO:tasks.workunit.client.1.smithi092.stdout:1/470: write db/f83 [308019,61616] 0 2024-09-17T01:52:08.083 INFO:tasks.workunit.client.1.smithi092.stdout:5/358: write d0/de/d19/d1a/d1e/f36 [4928793,28784] 0 2024-09-17T01:52:08.084 INFO:tasks.workunit.client.1.smithi092.stdout:0/475: dread d3/da/d1c/f43 [0,4194304] 0 2024-09-17T01:52:08.086 INFO:tasks.workunit.client.1.smithi092.stdout:8/366: symlink d15/d32/d40/d4c/l72 0 2024-09-17T01:52:08.087 INFO:tasks.workunit.client.0.smithi031.stdout:5/463: mkdir da/dc/da2 0 2024-09-17T01:52:08.088 INFO:tasks.workunit.client.1.smithi092.stdout:9/403: dwrite d0/d7/f77 [0,4194304] 0 2024-09-17T01:52:08.088 INFO:tasks.workunit.client.1.smithi092.stdout:6/385: mknod d3/d10/d1f/d21/d28/d2b/c7b 0 2024-09-17T01:52:08.088 INFO:tasks.workunit.client.0.smithi031.stdout:9/460: mkdir d3/d10/d36/d8f 0 2024-09-17T01:52:08.089 INFO:tasks.workunit.client.1.smithi092.stdout:1/471: stat db/d1d/d23/f5a 0 2024-09-17T01:52:08.090 INFO:tasks.workunit.client.1.smithi092.stdout:8/367: chown d15/d32/d40/d42 0 1 2024-09-17T01:52:08.091 INFO:tasks.workunit.client.0.smithi031.stdout:9/461: write d3/d19/d1f/f6b [118111,60696] 0 2024-09-17T01:52:08.092 INFO:tasks.workunit.client.1.smithi092.stdout:5/359: mknod d0/d50/d70/c79 0 2024-09-17T01:52:08.094 INFO:tasks.workunit.client.0.smithi031.stdout:2/597: link d1/d3/df/d18/l80 d1/d3/d2d/db2/d1e/d4f/d92/lcd 0 2024-09-17T01:52:08.095 INFO:tasks.workunit.client.1.smithi092.stdout:8/368: readlink d15/l70 0 2024-09-17T01:52:08.096 INFO:tasks.workunit.client.1.smithi092.stdout:1/472: unlink db/d6c/d7e/f84 0 2024-09-17T01:52:08.097 INFO:tasks.workunit.client.0.smithi031.stdout:4/803: dread d8/d3a/f6f [0,4194304] 0 2024-09-17T01:52:08.097 INFO:tasks.workunit.client.1.smithi092.stdout:4/465: dread d4/d13/d3b/f78 [0,4194304] 0 2024-09-17T01:52:08.097 INFO:tasks.workunit.client.0.smithi031.stdout:9/462: creat d3/d19/d1f/d44/d64/f90 x:0 0 0 2024-09-17T01:52:08.099 INFO:tasks.workunit.client.1.smithi092.stdout:5/360: dread - d0/f6d zero size 2024-09-17T01:52:08.100 INFO:tasks.workunit.client.0.smithi031.stdout:5/464: symlink da/dc/la3 0 2024-09-17T01:52:08.100 INFO:tasks.workunit.client.1.smithi092.stdout:6/386: readlink d3/d10/d1a/d43/d6a/d3d/l6e 0 2024-09-17T01:52:08.100 INFO:tasks.workunit.client.1.smithi092.stdout:7/461: dwrite d3/d2b/d3a/d5a/f68 [0,4194304] 0 2024-09-17T01:52:08.101 INFO:tasks.workunit.client.1.smithi092.stdout:1/473: stat db/d6c/d7a 0 2024-09-17T01:52:08.105 INFO:tasks.workunit.client.1.smithi092.stdout:3/411: dread d4/d16/f24 [0,4194304] 0 2024-09-17T01:52:08.106 INFO:tasks.workunit.client.0.smithi031.stdout:4/804: fdatasync d8/f27 0 2024-09-17T01:52:08.110 INFO:tasks.workunit.client.1.smithi092.stdout:0/476: dwrite d3/d2e/d3b/d8f/d5f/f79 [0,4194304] 0 2024-09-17T01:52:08.115 INFO:tasks.workunit.client.1.smithi092.stdout:9/404: truncate d0/d7/f77 2606079 0 2024-09-17T01:52:08.120 INFO:tasks.workunit.client.1.smithi092.stdout:5/361: unlink d0/de/d19/f76 0 2024-09-17T01:52:08.121 INFO:tasks.workunit.client.1.smithi092.stdout:1/474: mknod db/d6c/c95 0 2024-09-17T01:52:08.122 INFO:tasks.workunit.client.1.smithi092.stdout:0/477: dwrite d3/f17 [8388608,4194304] 0 2024-09-17T01:52:08.127 INFO:tasks.workunit.client.1.smithi092.stdout:6/387: dwrite d3/d10/d1f/d21/d28/d2b/d48/f3e [0,4194304] 0 2024-09-17T01:52:08.129 INFO:tasks.workunit.client.1.smithi092.stdout:0/478: chown d3/da/d1c/d3a/c4b 2597 1 2024-09-17T01:52:08.131 INFO:tasks.workunit.client.1.smithi092.stdout:4/466: creat d4/d5/d1d/f9c x:0 0 0 2024-09-17T01:52:08.134 INFO:tasks.workunit.client.1.smithi092.stdout:5/362: symlink d0/de/d19/d1a/d1e/l7a 0 2024-09-17T01:52:08.135 INFO:tasks.workunit.client.1.smithi092.stdout:0/479: readlink d3/l2f 0 2024-09-17T01:52:08.143 INFO:tasks.workunit.client.1.smithi092.stdout:5/363: dwrite d0/de/d19/d1a/d1e/f5f [0,4194304] 0 2024-09-17T01:52:08.144 INFO:tasks.workunit.client.1.smithi092.stdout:0/480: dwrite d3/f17 [0,4194304] 0 2024-09-17T01:52:08.146 INFO:tasks.workunit.client.1.smithi092.stdout:8/369: dread d15/d25/f5a [0,4194304] 0 2024-09-17T01:52:08.146 INFO:tasks.workunit.client.1.smithi092.stdout:5/364: dread - d0/de/d19/d1a/d1e/d3e/f40 zero size 2024-09-17T01:52:08.151 INFO:tasks.workunit.client.0.smithi031.stdout:8/516: sync 2024-09-17T01:52:08.151 INFO:tasks.workunit.client.0.smithi031.stdout:6/678: sync 2024-09-17T01:52:08.153 INFO:tasks.workunit.client.1.smithi092.stdout:0/481: rename d3/da/d15/d30/c8d to d3/d2e/d3b/d8f/d5f/c92 0 2024-09-17T01:52:08.153 INFO:tasks.workunit.client.0.smithi031.stdout:9/463: symlink d3/d4/d41/l91 0 2024-09-17T01:52:08.155 INFO:tasks.workunit.client.1.smithi092.stdout:8/370: symlink d15/d32/d40/d4c/l73 0 2024-09-17T01:52:08.158 INFO:tasks.workunit.client.1.smithi092.stdout:5/365: dwrite d0/de/d19/f6b [0,4194304] 0 2024-09-17T01:52:08.160 INFO:tasks.workunit.client.0.smithi031.stdout:9/464: dwrite d3/d4/f7f [0,4194304] 0 2024-09-17T01:52:08.160 INFO:tasks.workunit.client.1.smithi092.stdout:9/405: fsync d0/d7/f77 0 2024-09-17T01:52:08.160 INFO:tasks.workunit.client.1.smithi092.stdout:6/388: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:08.161 INFO:tasks.workunit.client.0.smithi031.stdout:6/679: creat d23/d63/d47/fed x:0 0 0 2024-09-17T01:52:08.163 INFO:tasks.workunit.client.1.smithi092.stdout:7/462: write d3/d6/d13/d21/d2e/f97 [1040836,9053] 0 2024-09-17T01:52:08.163 INFO:tasks.workunit.client.1.smithi092.stdout:0/482: creat d3/d2e/d55/d63/f93 x:0 0 0 2024-09-17T01:52:08.165 INFO:tasks.workunit.client.1.smithi092.stdout:8/371: creat d15/f74 x:0 0 0 2024-09-17T01:52:08.165 INFO:tasks.workunit.client.1.smithi092.stdout:6/389: truncate d3/d10/d1a/f24 8408573 0 2024-09-17T01:52:08.168 INFO:tasks.workunit.client.1.smithi092.stdout:8/372: chown d15/c18 43083 1 2024-09-17T01:52:08.170 INFO:tasks.workunit.client.1.smithi092.stdout:0/483: rename d3/d1d/f32 to d3/d2e/d3b/f94 0 2024-09-17T01:52:08.172 INFO:tasks.workunit.client.0.smithi031.stdout:6/680: dwrite d23/db4/d6a/d72/fce [0,4194304] 0 2024-09-17T01:52:08.172 INFO:tasks.workunit.client.1.smithi092.stdout:6/390: chown d3/d10/d1a/d43/d6a/c79 1756906 1 2024-09-17T01:52:08.173 INFO:tasks.workunit.client.0.smithi031.stdout:6/681: chown d23/db4/d64/dc1 439 1 2024-09-17T01:52:08.173 INFO:tasks.workunit.client.1.smithi092.stdout:9/406: symlink d0/df/l7a 0 2024-09-17T01:52:08.174 INFO:tasks.workunit.client.0.smithi031.stdout:6/682: write d23/f31 [4335674,68017] 0 2024-09-17T01:52:08.175 INFO:tasks.workunit.client.0.smithi031.stdout:6/683: fsync d23/db4/d64/f78 0 2024-09-17T01:52:08.175 INFO:tasks.workunit.client.0.smithi031.stdout:8/517: rename d0/d5/d6c/d6d/d94/f3e to d0/df/dd/f96 0 2024-09-17T01:52:08.176 INFO:tasks.workunit.client.1.smithi092.stdout:7/463: mknod d3/d2b/d84/ca0 0 2024-09-17T01:52:08.176 INFO:tasks.workunit.client.0.smithi031.stdout:9/465: symlink d3/d10/d36/d62/l92 0 2024-09-17T01:52:08.178 INFO:tasks.workunit.client.1.smithi092.stdout:1/475: dread db/d1d/d23/f5a [0,4194304] 0 2024-09-17T01:52:08.180 INFO:tasks.workunit.client.1.smithi092.stdout:3/412: dwrite d4/f30 [0,4194304] 0 2024-09-17T01:52:08.181 INFO:tasks.workunit.client.1.smithi092.stdout:8/373: mknod d15/c75 0 2024-09-17T01:52:08.181 INFO:tasks.workunit.client.0.smithi031.stdout:6/684: mkdir d23/d63/d47/d81/dee 0 2024-09-17T01:52:08.183 INFO:tasks.workunit.client.1.smithi092.stdout:0/484: write d3/d2e/d3b/f94 [5056274,32755] 0 2024-09-17T01:52:08.183 INFO:tasks.workunit.client.1.smithi092.stdout:9/407: write d0/d7/f77 [1417014,21248] 0 2024-09-17T01:52:08.183 INFO:tasks.workunit.client.0.smithi031.stdout:9/466: symlink d3/d4/d41/d70/l93 0 2024-09-17T01:52:08.184 INFO:tasks.workunit.client.1.smithi092.stdout:4/467: dread d4/d5/d46/f50 [0,4194304] 0 2024-09-17T01:52:08.187 INFO:tasks.workunit.client.1.smithi092.stdout:4/468: write d4/d13/d20/f29 [2492261,29630] 0 2024-09-17T01:52:08.188 INFO:tasks.workunit.client.1.smithi092.stdout:7/464: mkdir d3/d6/da1 0 2024-09-17T01:52:08.189 INFO:tasks.workunit.client.1.smithi092.stdout:0/485: read d3/d2e/d55/f70 [224655,122478] 0 2024-09-17T01:52:08.189 INFO:tasks.workunit.client.1.smithi092.stdout:9/408: chown d0/df/f3c 89 1 2024-09-17T01:52:08.190 INFO:tasks.workunit.client.0.smithi031.stdout:6/685: symlink d23/d63/lef 0 2024-09-17T01:52:08.192 INFO:tasks.workunit.client.0.smithi031.stdout:2/598: write d1/d3/d2d/db2/d1e/d4f/fc6 [1192128,104214] 0 2024-09-17T01:52:08.192 INFO:tasks.workunit.client.1.smithi092.stdout:3/413: creat d4/d13/f8b x:0 0 0 2024-09-17T01:52:08.193 INFO:tasks.workunit.client.1.smithi092.stdout:6/391: rename d3/f36 to d3/d10/d1f/d21/f7c 0 2024-09-17T01:52:08.195 INFO:tasks.workunit.client.1.smithi092.stdout:6/392: dread - d3/d10/d1f/d21/f65 zero size 2024-09-17T01:52:08.196 INFO:tasks.workunit.client.0.smithi031.stdout:6/686: mkdir d23/d63/d47/df0 0 2024-09-17T01:52:08.197 INFO:tasks.workunit.client.0.smithi031.stdout:2/599: creat d1/d3/df/d66/fce x:0 0 0 2024-09-17T01:52:08.198 INFO:tasks.workunit.client.1.smithi092.stdout:4/469: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a [0,4194304] 0 2024-09-17T01:52:08.199 INFO:tasks.workunit.client.0.smithi031.stdout:9/467: dwrite d3/f8 [4194304,4194304] 0 2024-09-17T01:52:08.199 INFO:tasks.workunit.client.1.smithi092.stdout:8/374: mkdir d15/d25/d27/d6e/d76 0 2024-09-17T01:52:08.200 INFO:tasks.workunit.client.0.smithi031.stdout:6/687: write d23/d63/f5d [947158,87792] 0 2024-09-17T01:52:08.200 INFO:tasks.workunit.client.1.smithi092.stdout:7/465: readlink d3/d6/l5d 0 2024-09-17T01:52:08.200 INFO:tasks.workunit.client.1.smithi092.stdout:2/333: sync 2024-09-17T01:52:08.201 INFO:tasks.workunit.client.1.smithi092.stdout:7/466: fdatasync d3/db/d26/f3b 0 2024-09-17T01:52:08.202 INFO:tasks.workunit.client.1.smithi092.stdout:0/486: rmdir d3/da/d1c/d3a 39 2024-09-17T01:52:08.207 INFO:tasks.workunit.client.0.smithi031.stdout:4/805: dwrite d8/fd2 [4194304,4194304] 0 2024-09-17T01:52:08.207 INFO:tasks.workunit.client.0.smithi031.stdout:8/518: truncate d0/d5/f7d 499556 0 2024-09-17T01:52:08.208 INFO:tasks.workunit.client.0.smithi031.stdout:9/468: symlink d3/d4/d41/l94 0 2024-09-17T01:52:08.210 INFO:tasks.workunit.client.0.smithi031.stdout:9/469: dread - d3/d10/f48 zero size 2024-09-17T01:52:08.210 INFO:tasks.workunit.client.1.smithi092.stdout:6/393: rename d3/d10/d1f/l39 to d3/d10/d1a/d43/d5e/l7d 0 2024-09-17T01:52:08.210 INFO:tasks.workunit.client.0.smithi031.stdout:8/519: write d0/d5/d6c/d6d/d94/f5f [89158,118248] 0 2024-09-17T01:52:08.211 INFO:tasks.workunit.client.1.smithi092.stdout:2/334: dwrite d10/d1d/d2c/f3d [0,4194304] 0 2024-09-17T01:52:08.212 INFO:tasks.workunit.client.1.smithi092.stdout:8/375: rmdir d15/d32/d40/d42/d43 39 2024-09-17T01:52:08.213 INFO:tasks.workunit.client.1.smithi092.stdout:4/470: write d4/d5/d8/f34 [3664764,59058] 0 2024-09-17T01:52:08.215 INFO:tasks.workunit.client.1.smithi092.stdout:6/394: chown d3/d10/c3f 177573312 1 2024-09-17T01:52:08.215 INFO:tasks.workunit.client.1.smithi092.stdout:5/366: dwrite d0/de/d19/f69 [0,4194304] 0 2024-09-17T01:52:08.218 INFO:tasks.workunit.client.1.smithi092.stdout:6/395: chown d3/d10/d1f/d21/d28/d2b/d48/c51 928957 1 2024-09-17T01:52:08.221 INFO:tasks.workunit.client.0.smithi031.stdout:4/806: mknod d8/d3a/c104 0 2024-09-17T01:52:08.222 INFO:tasks.workunit.client.1.smithi092.stdout:7/467: symlink d3/db/d26/d6f/la2 0 2024-09-17T01:52:08.222 INFO:tasks.workunit.client.1.smithi092.stdout:6/396: chown d3/d10/d1f/d21/l58 556388760 1 2024-09-17T01:52:08.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/414: unlink d4/d13/c22 0 2024-09-17T01:52:08.222 INFO:tasks.workunit.client.1.smithi092.stdout:3/415: stat d4/d20/f84 0 2024-09-17T01:52:08.225 INFO:tasks.workunit.client.1.smithi092.stdout:1/476: getdents db/d1d/d23/d34 0 2024-09-17T01:52:08.226 INFO:tasks.workunit.client.0.smithi031.stdout:2/600: creat d1/d3/d2d/db2/d1e/d21/fcf x:0 0 0 2024-09-17T01:52:08.230 INFO:tasks.workunit.client.1.smithi092.stdout:3/416: dwrite d4/d20/d39/f7d [4194304,4194304] 0 2024-09-17T01:52:08.231 INFO:tasks.workunit.client.0.smithi031.stdout:6/688: getdents d23/d63/d47/d81 0 2024-09-17T01:52:08.231 INFO:tasks.workunit.client.0.smithi031.stdout:2/601: mkdir d1/d3/df/d11/d30/dd0 0 2024-09-17T01:52:08.231 INFO:tasks.workunit.client.0.smithi031.stdout:9/470: link d3/d4/d29/l52 d3/d10/d36/d79/l95 0 2024-09-17T01:52:08.232 INFO:tasks.workunit.client.0.smithi031.stdout:4/807: dwrite d8/d3a/d41/d64/d4d/d5a/d8c/d25/f47 [0,4194304] 0 2024-09-17T01:52:08.234 INFO:tasks.workunit.client.0.smithi031.stdout:4/808: write d8/d3a/d41/d64/d4f/fe5 [960468,4971] 0 2024-09-17T01:52:08.235 INFO:tasks.workunit.client.1.smithi092.stdout:5/367: unlink d0/d23/f27 0 2024-09-17T01:52:08.235 INFO:tasks.workunit.client.1.smithi092.stdout:0/487: symlink d3/l95 0 2024-09-17T01:52:08.236 INFO:tasks.workunit.client.0.smithi031.stdout:6/689: dread - d23/db4/d6a/d72/f96 zero size 2024-09-17T01:52:08.237 INFO:tasks.workunit.client.1.smithi092.stdout:9/409: creat d0/df/d17/f7b x:0 0 0 2024-09-17T01:52:08.237 INFO:tasks.workunit.client.0.smithi031.stdout:9/471: mkdir d3/d47/d96 0 2024-09-17T01:52:08.238 INFO:tasks.workunit.client.0.smithi031.stdout:9/472: stat d3/d19/d1f/d44/l8c 0 2024-09-17T01:52:08.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:07 smithi092 ceph-mon[33552]: pgmap v14: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 54 MiB/s rd, 273 MiB/s wr, 486 op/s 2024-09-17T01:52:08.239 INFO:tasks.workunit.client.1.smithi092.stdout:6/397: mkdir d3/d10/d1a/d49/d7e 0 2024-09-17T01:52:08.239 INFO:tasks.workunit.client.1.smithi092.stdout:5/368: stat d0/de/d19/d1a/d1e/f12 0 2024-09-17T01:52:08.240 INFO:tasks.workunit.client.0.smithi031.stdout:2/602: rename d1/d3/df/d18/f62 to d1/d3/df/d18/d40/db5/fd1 0 2024-09-17T01:52:08.240 INFO:tasks.workunit.client.1.smithi092.stdout:8/376: dwrite d15/d32/f59 [0,4194304] 0 2024-09-17T01:52:08.241 INFO:tasks.workunit.client.0.smithi031.stdout:4/809: dread d8/d9c/fe0 [0,4194304] 0 2024-09-17T01:52:08.241 INFO:tasks.workunit.client.0.smithi031.stdout:6/690: rmdir d23/db4/d6a/d70 39 2024-09-17T01:52:08.242 INFO:tasks.workunit.client.0.smithi031.stdout:9/473: truncate d3/d4/f27 1969182 0 2024-09-17T01:52:08.242 INFO:tasks.workunit.client.0.smithi031.stdout:2/603: dread - d1/d3/d2d/db2/f5e zero size 2024-09-17T01:52:08.243 INFO:tasks.workunit.client.0.smithi031.stdout:9/474: chown d3/d10/d36/d79 48326522 1 2024-09-17T01:52:08.244 INFO:tasks.workunit.client.0.smithi031.stdout:2/604: fsync d1/d3/df/d11/d30/f82 0 2024-09-17T01:52:08.244 INFO:tasks.workunit.client.0.smithi031.stdout:4/810: symlink d8/d3a/d41/d64/d4d/d5a/df1/l105 0 2024-09-17T01:52:08.245 INFO:tasks.workunit.client.0.smithi031.stdout:4/811: chown d8/d3a/c74 255880 1 2024-09-17T01:52:08.248 INFO:tasks.workunit.client.1.smithi092.stdout:6/398: fsync d3/d10/d1f/d21/d28/d2b/d48/d18/f6b 0 2024-09-17T01:52:08.248 INFO:tasks.workunit.client.1.smithi092.stdout:4/471: symlink d4/d13/d3b/d42/d76/d41/l9d 0 2024-09-17T01:52:08.248 INFO:tasks.workunit.client.0.smithi031.stdout:2/605: creat d1/d3/df/d66/fd2 x:0 0 0 2024-09-17T01:52:08.249 INFO:tasks.workunit.client.1.smithi092.stdout:5/369: unlink d0/de/d19/d3c/d41/f5e 0 2024-09-17T01:52:08.250 INFO:tasks.workunit.client.1.smithi092.stdout:7/468: creat d3/d6/d13/d40/d6a/fa3 x:0 0 0 2024-09-17T01:52:08.251 INFO:tasks.workunit.client.1.smithi092.stdout:2/335: creat d10/f6f x:0 0 0 2024-09-17T01:52:08.252 INFO:tasks.workunit.client.1.smithi092.stdout:2/336: write d10/d15/f3e [930427,13106] 0 2024-09-17T01:52:08.254 INFO:tasks.workunit.client.0.smithi031.stdout:9/475: dwrite d3/d4/f7f [0,4194304] 0 2024-09-17T01:52:08.256 INFO:tasks.workunit.client.1.smithi092.stdout:4/472: readlink d4/d13/d3b/d42/d76/d41/d67/l6e 0 2024-09-17T01:52:08.257 INFO:tasks.workunit.client.1.smithi092.stdout:4/473: chown d4/d13/f2b 131494068 1 2024-09-17T01:52:08.260 INFO:tasks.workunit.client.1.smithi092.stdout:5/370: unlink d0/de/d19/d1a/d1e/d3e/f40 0 2024-09-17T01:52:08.260 INFO:tasks.workunit.client.1.smithi092.stdout:3/417: creat d4/d16/f8c x:0 0 0 2024-09-17T01:52:08.260 INFO:tasks.workunit.client.0.smithi031.stdout:9/476: rename d3/d4/d29/f31 to d3/d19/d1f/d44/d64/f97 0 2024-09-17T01:52:08.261 INFO:tasks.workunit.client.1.smithi092.stdout:5/371: write d0/d23/f2c [2644013,14601] 0 2024-09-17T01:52:08.262 INFO:tasks.workunit.client.1.smithi092.stdout:0/488: rename d3/d2e/c4f to d3/da/d1c/c96 0 2024-09-17T01:52:08.263 INFO:tasks.workunit.client.0.smithi031.stdout:9/477: symlink d3/d19/d1f/l98 0 2024-09-17T01:52:08.264 INFO:tasks.workunit.client.1.smithi092.stdout:1/477: getdents db/d1d/d44 0 2024-09-17T01:52:08.265 INFO:tasks.workunit.client.1.smithi092.stdout:3/418: chown d4/ld 502 1 2024-09-17T01:52:08.266 INFO:tasks.workunit.client.0.smithi031.stdout:9/478: mkdir d3/d10/d36/d99 0 2024-09-17T01:52:08.266 INFO:tasks.workunit.client.0.smithi031.stdout:7/546: sync 2024-09-17T01:52:08.266 INFO:tasks.workunit.client.0.smithi031.stdout:3/565: sync 2024-09-17T01:52:08.266 INFO:tasks.workunit.client.0.smithi031.stdout:1/630: sync 2024-09-17T01:52:08.267 INFO:tasks.workunit.client.1.smithi092.stdout:8/377: creat d15/d32/d40/f77 x:0 0 0 2024-09-17T01:52:08.267 INFO:tasks.workunit.client.1.smithi092.stdout:0/489: chown d3/d2e/d3b/d72/d7a 61432592 1 2024-09-17T01:52:08.268 INFO:tasks.workunit.client.0.smithi031.stdout:1/631: fdatasync d4/d1a/d2d/f8b 0 2024-09-17T01:52:08.270 INFO:tasks.workunit.client.1.smithi092.stdout:5/372: chown d0/de/d19/d1a/d24/l62 86 1 2024-09-17T01:52:08.270 INFO:tasks.workunit.client.1.smithi092.stdout:4/474: dwrite d4/d13/d3b/f47 [0,4194304] 0 2024-09-17T01:52:08.270 INFO:tasks.workunit.client.1.smithi092.stdout:3/419: write d4/d2f/d44/f77 [141898,28341] 0 2024-09-17T01:52:08.271 INFO:tasks.workunit.client.1.smithi092.stdout:7/469: rename d3/db/d26/c30 to d3/db/d26/d6f/ca4 0 2024-09-17T01:52:08.271 INFO:tasks.workunit.client.0.smithi031.stdout:6/691: dread d23/d63/fc7 [0,4194304] 0 2024-09-17T01:52:08.272 INFO:tasks.workunit.client.0.smithi031.stdout:7/547: rmdir db/d1c 39 2024-09-17T01:52:08.274 INFO:tasks.workunit.client.0.smithi031.stdout:7/548: write db/d29/f58 [706894,126830] 0 2024-09-17T01:52:08.276 INFO:tasks.workunit.client.1.smithi092.stdout:8/378: stat d15/d25/d2b/d3d/l58 0 2024-09-17T01:52:08.276 INFO:tasks.workunit.client.1.smithi092.stdout:0/490: read d3/d1d/d6b/f86 [223703,94044] 0 2024-09-17T01:52:08.278 INFO:tasks.workunit.client.1.smithi092.stdout:1/478: mkdir db/d6c/d7e/d96 0 2024-09-17T01:52:08.278 INFO:tasks.workunit.client.1.smithi092.stdout:0/491: dread - d3/d2e/d3b/d72/f89 zero size 2024-09-17T01:52:08.278 INFO:tasks.workunit.client.0.smithi031.stdout:8/520: write d0/d5/f50 [281770,125720] 0 2024-09-17T01:52:08.280 INFO:tasks.workunit.client.1.smithi092.stdout:8/379: dread - d15/f74 zero size 2024-09-17T01:52:08.284 INFO:tasks.workunit.client.0.smithi031.stdout:7/549: write db/d1c/d41/d6c/f9d [207431,42575] 0 2024-09-17T01:52:08.285 INFO:tasks.workunit.client.1.smithi092.stdout:2/337: getdents d10/d1d/d2d 0 2024-09-17T01:52:08.285 INFO:tasks.workunit.client.1.smithi092.stdout:2/338: readlink d10/d1d/d24/l30 0 2024-09-17T01:52:08.286 INFO:tasks.workunit.client.0.smithi031.stdout:2/606: dread d1/db6/fbd [0,4194304] 0 2024-09-17T01:52:08.289 INFO:tasks.workunit.client.0.smithi031.stdout:6/692: symlink d23/dd1/lf1 0 2024-09-17T01:52:08.291 INFO:tasks.workunit.client.1.smithi092.stdout:5/373: creat d0/de/d19/d1a/f7b x:0 0 0 2024-09-17T01:52:08.292 INFO:tasks.workunit.client.0.smithi031.stdout:3/566: symlink db/df/d1c/d99/laa 0 2024-09-17T01:52:08.294 INFO:tasks.workunit.client.1.smithi092.stdout:0/492: dwrite d3/f77 [4194304,4194304] 0 2024-09-17T01:52:08.295 INFO:tasks.workunit.client.0.smithi031.stdout:7/550: mkdir db/d18/d67/dac 0 2024-09-17T01:52:08.295 INFO:tasks.workunit.client.0.smithi031.stdout:7/551: fsync db/d29/f58 0 2024-09-17T01:52:08.296 INFO:tasks.workunit.client.0.smithi031.stdout:9/479: link d3/d19/d1f/d44/d64/c6c d3/d4/d41/d70/c9a 0 2024-09-17T01:52:08.296 INFO:tasks.workunit.client.0.smithi031.stdout:7/552: readlink l6 0 2024-09-17T01:52:08.299 INFO:tasks.workunit.client.0.smithi031.stdout:9/480: write d3/f8 [178121,8980] 0 2024-09-17T01:52:08.300 INFO:tasks.workunit.client.1.smithi092.stdout:4/475: dwrite d4/d13/d3b/f8d [0,4194304] 0 2024-09-17T01:52:08.301 INFO:tasks.workunit.client.0.smithi031.stdout:1/632: creat d4/d3d/d65/fd4 x:0 0 0 2024-09-17T01:52:08.301 INFO:tasks.workunit.client.1.smithi092.stdout:6/399: dread d3/d10/d1a/d43/f4a [0,4194304] 0 2024-09-17T01:52:08.301 INFO:tasks.workunit.client.1.smithi092.stdout:9/410: dread d0/d7/d12/d34/d26/d54/f4e [0,4194304] 0 2024-09-17T01:52:08.302 INFO:tasks.workunit.client.1.smithi092.stdout:7/470: dwrite d3/db/d26/d65/f9d [0,4194304] 0 2024-09-17T01:52:08.303 INFO:tasks.workunit.client.0.smithi031.stdout:2/607: mknod d1/d3/d2d/d42/cd3 0 2024-09-17T01:52:08.304 INFO:tasks.workunit.client.1.smithi092.stdout:1/479: chown db/l16 1786023 1 2024-09-17T01:52:08.305 INFO:tasks.workunit.client.1.smithi092.stdout:4/476: readlink d4/d13/d20/l4c 0 2024-09-17T01:52:08.308 INFO:tasks.workunit.client.1.smithi092.stdout:6/400: stat d3/d10/d1f/d21/d28/d2b/f69 0 2024-09-17T01:52:08.311 INFO:tasks.workunit.client.0.smithi031.stdout:4/812: dwrite d8/d3a/d41/d64/d4d/f81 [0,4194304] 0 2024-09-17T01:52:08.311 INFO:tasks.workunit.client.1.smithi092.stdout:2/339: mkdir d10/d54/d70 0 2024-09-17T01:52:08.311 INFO:tasks.workunit.client.1.smithi092.stdout:7/471: write d3/db/d26/d83/f96 [4194,91246] 0 2024-09-17T01:52:08.312 INFO:tasks.workunit.client.1.smithi092.stdout:9/411: truncate d0/df/d5d/f76 5197452 0 2024-09-17T01:52:08.313 INFO:tasks.workunit.client.0.smithi031.stdout:7/553: dwrite db/f51 [0,4194304] 0 2024-09-17T01:52:08.314 INFO:tasks.workunit.client.1.smithi092.stdout:5/374: creat d0/de/d19/d1a/d1e/d29/f7c x:0 0 0 2024-09-17T01:52:08.314 INFO:tasks.workunit.client.0.smithi031.stdout:7/554: stat db/l13 0 2024-09-17T01:52:08.316 INFO:tasks.workunit.client.1.smithi092.stdout:2/340: truncate d10/f6f 372954 0 2024-09-17T01:52:08.316 INFO:tasks.workunit.client.0.smithi031.stdout:2/608: rmdir d1 39 2024-09-17T01:52:08.317 INFO:tasks.workunit.client.1.smithi092.stdout:2/341: fdatasync d10/f6f 0 2024-09-17T01:52:08.317 INFO:tasks.workunit.client.1.smithi092.stdout:9/412: dread d0/df/d17/f2f [0,4194304] 0 2024-09-17T01:52:08.318 INFO:tasks.workunit.client.0.smithi031.stdout:1/633: fsync d4/d1a/d2d/f68 0 2024-09-17T01:52:08.318 INFO:tasks.workunit.client.0.smithi031.stdout:1/634: stat d4/l32 0 2024-09-17T01:52:08.319 INFO:tasks.workunit.client.0.smithi031.stdout:3/567: creat db/d29/fab x:0 0 0 2024-09-17T01:52:08.319 INFO:tasks.workunit.client.1.smithi092.stdout:8/380: fdatasync d15/d25/f30 0 2024-09-17T01:52:08.319 INFO:tasks.workunit.client.1.smithi092.stdout:4/477: creat d4/d13/d3b/d42/d76/d41/d67/f9e x:0 0 0 2024-09-17T01:52:08.323 INFO:tasks.workunit.client.0.smithi031.stdout:8/521: link d0/f9 d0/d5/d54/d60/f97 0 2024-09-17T01:52:08.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/693: creat d23/db4/ff2 x:0 0 0 2024-09-17T01:52:08.325 INFO:tasks.workunit.client.1.smithi092.stdout:8/381: dread - d15/d32/f50 zero size 2024-09-17T01:52:08.327 INFO:tasks.workunit.client.1.smithi092.stdout:1/480: symlink db/d6c/d7e/d96/l97 0 2024-09-17T01:52:08.328 INFO:tasks.workunit.client.0.smithi031.stdout:8/522: fdatasync d0/d5/d6c/d6d/d94/f5c 0 2024-09-17T01:52:08.328 INFO:tasks.workunit.client.0.smithi031.stdout:2/609: chown d1/d3/d2d/d71/c86 134 1 2024-09-17T01:52:08.328 INFO:tasks.workunit.client.0.smithi031.stdout:6/694: read - d23/d63/fcd zero size 2024-09-17T01:52:08.328 INFO:tasks.workunit.client.0.smithi031.stdout:1/635: unlink d4/d1a/d2d/l24 0 2024-09-17T01:52:08.329 INFO:tasks.workunit.client.1.smithi092.stdout:9/413: dread - d0/d5/d29/f6a zero size 2024-09-17T01:52:08.329 INFO:tasks.workunit.client.1.smithi092.stdout:3/420: dread d4/d13/f14 [0,4194304] 0 2024-09-17T01:52:08.330 INFO:tasks.workunit.client.0.smithi031.stdout:3/568: symlink db/df/d1d/d37/d65/lac 0 2024-09-17T01:52:08.330 INFO:tasks.workunit.client.1.smithi092.stdout:2/342: rename d10/d3a/l59 to d10/d1d/d2c/d5a/l71 0 2024-09-17T01:52:08.330 INFO:tasks.workunit.client.0.smithi031.stdout:6/695: chown d23/d63/lef 247540498 1 2024-09-17T01:52:08.330 INFO:tasks.workunit.client.0.smithi031.stdout:7/555: creat db/d1c/fad x:0 0 0 2024-09-17T01:52:08.331 INFO:tasks.workunit.client.1.smithi092.stdout:5/375: symlink d0/d77/l7d 0 2024-09-17T01:52:08.333 INFO:tasks.workunit.client.0.smithi031.stdout:8/523: symlink d0/df/dd/d59/l98 0 2024-09-17T01:52:08.333 INFO:tasks.workunit.client.1.smithi092.stdout:9/414: fsync d0/d5/d29/f55 0 2024-09-17T01:52:08.335 INFO:tasks.workunit.client.0.smithi031.stdout:1/636: mknod d4/d1a/d43/cd5 0 2024-09-17T01:52:08.335 INFO:tasks.workunit.client.1.smithi092.stdout:4/478: chown d4/ce 7 1 2024-09-17T01:52:08.337 INFO:tasks.workunit.client.1.smithi092.stdout:0/493: dwrite d3/da/d1c/d3a/f66 [0,4194304] 0 2024-09-17T01:52:08.337 INFO:tasks.workunit.client.0.smithi031.stdout:2/610: creat d1/d3/d45/d4a/d96/fd4 x:0 0 0 2024-09-17T01:52:08.340 INFO:tasks.workunit.client.0.smithi031.stdout:8/524: rmdir d0/d5 39 2024-09-17T01:52:08.343 INFO:tasks.workunit.client.0.smithi031.stdout:6/696: dwrite d23/d63/f5d [0,4194304] 0 2024-09-17T01:52:08.344 INFO:tasks.workunit.client.0.smithi031.stdout:4/813: dread d8/d3a/d41/d64/d4d/d5a/d8c/d25/f47 [4194304,4194304] 0 2024-09-17T01:52:08.344 INFO:tasks.workunit.client.0.smithi031.stdout:7/556: mknod db/d1c/d46/cae 0 2024-09-17T01:52:08.344 INFO:tasks.workunit.client.1.smithi092.stdout:1/481: symlink db/d1d/d23/l98 0 2024-09-17T01:52:08.347 INFO:tasks.workunit.client.0.smithi031.stdout:6/697: stat d23/db4/c52 0 2024-09-17T01:52:08.348 INFO:tasks.workunit.client.1.smithi092.stdout:9/415: mkdir d0/d7c 0 2024-09-17T01:52:08.348 INFO:tasks.workunit.client.0.smithi031.stdout:1/637: mkdir d4/d3d/d65/d78/dd6 0 2024-09-17T01:52:08.349 INFO:tasks.workunit.client.1.smithi092.stdout:3/421: read d4/f2d [1705866,50399] 0 2024-09-17T01:52:08.350 INFO:tasks.workunit.client.1.smithi092.stdout:9/416: readlink d0/d7/d12/d34/d26/l48 0 2024-09-17T01:52:08.350 INFO:tasks.workunit.client.1.smithi092.stdout:4/479: read d4/d13/d20/f27 [1612540,115094] 0 2024-09-17T01:52:08.351 INFO:tasks.workunit.client.0.smithi031.stdout:9/481: dread d3/d10/f14 [4194304,4194304] 0 2024-09-17T01:52:08.353 INFO:tasks.workunit.client.0.smithi031.stdout:8/525: link d0/df/f65 d0/f99 0 2024-09-17T01:52:08.353 INFO:tasks.workunit.client.0.smithi031.stdout:7/557: truncate db/d1c/d41/d6c/f6d 653818 0 2024-09-17T01:52:08.354 INFO:tasks.workunit.client.0.smithi031.stdout:6/698: symlink d23/lf3 0 2024-09-17T01:52:08.355 INFO:tasks.workunit.client.0.smithi031.stdout:2/611: dwrite d1/d3/df/d11/f13 [4194304,4194304] 0 2024-09-17T01:52:08.356 INFO:tasks.workunit.client.0.smithi031.stdout:7/558: chown db/d1c/d41/l85 22408807 1 2024-09-17T01:52:08.357 INFO:tasks.workunit.client.0.smithi031.stdout:6/699: write d23/fdf [183200,16674] 0 2024-09-17T01:52:08.358 INFO:tasks.workunit.client.0.smithi031.stdout:7/559: readlink db/d29/l38 0 2024-09-17T01:52:08.358 INFO:tasks.workunit.client.0.smithi031.stdout:7/560: dread - db/d1c/d8e/da7/f8d zero size 2024-09-17T01:52:08.360 INFO:tasks.workunit.client.0.smithi031.stdout:7/561: fsync db/d1c/f71 0 2024-09-17T01:52:08.360 INFO:tasks.workunit.client.1.smithi092.stdout:2/343: write d10/d1d/d24/f62 [1569663,25117] 0 2024-09-17T01:52:08.361 INFO:tasks.workunit.client.1.smithi092.stdout:7/472: dwrite d3/d6/d13/d40/f55 [0,4194304] 0 2024-09-17T01:52:08.371 INFO:tasks.workunit.client.1.smithi092.stdout:2/344: creat d10/d4c/f72 x:0 0 0 2024-09-17T01:52:08.372 INFO:tasks.workunit.client.1.smithi092.stdout:4/480: symlink d4/d13/d3b/d42/l9f 0 2024-09-17T01:52:08.377 INFO:tasks.workunit.client.1.smithi092.stdout:5/376: dwrite d0/de/d19/d1a/d1e/d29/f7c [0,4194304] 0 2024-09-17T01:52:08.377 INFO:tasks.workunit.client.1.smithi092.stdout:1/482: fsync db/f87 0 2024-09-17T01:52:08.381 INFO:tasks.workunit.client.1.smithi092.stdout:6/401: dread d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:08.384 INFO:tasks.workunit.client.1.smithi092.stdout:4/481: creat d4/d13/d3b/d42/d76/d35/fa0 x:0 0 0 2024-09-17T01:52:08.388 INFO:tasks.workunit.client.0.smithi031.stdout:4/814: mkdir d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/d106 0 2024-09-17T01:52:08.389 INFO:tasks.workunit.client.1.smithi092.stdout:0/494: dwrite d3/f12 [0,4194304] 0 2024-09-17T01:52:08.391 INFO:tasks.workunit.client.0.smithi031.stdout:8/526: truncate d0/d5/d54/f8c 194291 0 2024-09-17T01:52:08.392 INFO:tasks.workunit.client.1.smithi092.stdout:9/417: creat d0/f7d x:0 0 0 2024-09-17T01:52:08.396 INFO:tasks.workunit.client.0.smithi031.stdout:9/482: creat d3/d10/d36/f9b x:0 0 0 2024-09-17T01:52:08.397 INFO:tasks.workunit.client.1.smithi092.stdout:5/377: dwrite d0/d50/f5b [0,4194304] 0 2024-09-17T01:52:08.397 INFO:tasks.workunit.client.1.smithi092.stdout:2/345: mknod d10/d54/d70/c73 0 2024-09-17T01:52:08.398 INFO:tasks.workunit.client.0.smithi031.stdout:2/612: creat d1/d3/d2d/db2/d1e/d21/fd5 x:0 0 0 2024-09-17T01:52:08.399 INFO:tasks.workunit.client.0.smithi031.stdout:9/483: fdatasync d3/d4/f5 0 2024-09-17T01:52:08.401 INFO:tasks.workunit.client.1.smithi092.stdout:2/346: dread - d10/d4c/f6c zero size 2024-09-17T01:52:08.401 INFO:tasks.workunit.client.0.smithi031.stdout:9/484: fdatasync d3/d19/d1f/f55 0 2024-09-17T01:52:08.402 INFO:tasks.workunit.client.1.smithi092.stdout:6/402: dwrite d3/d10/d1a/d43/d6a/f50 [0,4194304] 0 2024-09-17T01:52:08.402 INFO:tasks.workunit.client.0.smithi031.stdout:4/815: dread d8/d3a/f40 [0,4194304] 0 2024-09-17T01:52:08.403 INFO:tasks.workunit.client.0.smithi031.stdout:3/569: dwrite db/df/d1d/d37/d6c/f71 [0,4194304] 0 2024-09-17T01:52:08.404 INFO:tasks.workunit.client.0.smithi031.stdout:9/485: write d3/f1d [5003499,111114] 0 2024-09-17T01:52:08.408 INFO:tasks.workunit.client.1.smithi092.stdout:1/483: rename db/d1d/d44/f8a to db/d1d/d23/d88/f99 0 2024-09-17T01:52:08.409 INFO:tasks.workunit.client.0.smithi031.stdout:2/613: dwrite d1/d3/df/d11/f2f [0,4194304] 0 2024-09-17T01:52:08.409 INFO:tasks.workunit.client.1.smithi092.stdout:8/382: dread d15/d32/f38 [4194304,4194304] 0 2024-09-17T01:52:08.410 INFO:tasks.workunit.client.1.smithi092.stdout:5/378: truncate d0/de/d19/d1a/d1e/d3e/d4c/f5d 978024 0 2024-09-17T01:52:08.411 INFO:tasks.workunit.client.1.smithi092.stdout:9/418: unlink d0/df/l7a 0 2024-09-17T01:52:08.412 INFO:tasks.workunit.client.1.smithi092.stdout:2/347: mkdir d10/d1d/d2c/d74 0 2024-09-17T01:52:08.412 INFO:tasks.workunit.client.1.smithi092.stdout:0/495: rename d3/da/d1c/c60 to d3/d2e/d3b/d48/c97 0 2024-09-17T01:52:08.414 INFO:tasks.workunit.client.1.smithi092.stdout:0/496: fdatasync d3/d2e/f84 0 2024-09-17T01:52:08.415 INFO:tasks.workunit.client.0.smithi031.stdout:3/570: dwrite db/df/d1d/d37/d77/f8b [0,4194304] 0 2024-09-17T01:52:08.419 INFO:tasks.workunit.client.0.smithi031.stdout:3/571: mknod db/d82/cad 0 2024-09-17T01:52:08.420 INFO:tasks.workunit.client.0.smithi031.stdout:3/572: dread - db/fa7 zero size 2024-09-17T01:52:08.422 INFO:tasks.workunit.client.1.smithi092.stdout:5/379: mkdir d0/d7e 0 2024-09-17T01:52:08.422 INFO:tasks.workunit.client.0.smithi031.stdout:3/573: write db/d29/f2e [5124474,27249] 0 2024-09-17T01:52:08.424 INFO:tasks.workunit.client.1.smithi092.stdout:1/484: mkdir db/d1d/d4b/d9a 0 2024-09-17T01:52:08.424 INFO:tasks.workunit.client.1.smithi092.stdout:8/383: dwrite d15/d32/d40/d42/f5f [0,4194304] 0 2024-09-17T01:52:08.425 INFO:tasks.workunit.client.1.smithi092.stdout:7/473: dread d3/d6/d13/d40/d60/f88 [0,4194304] 0 2024-09-17T01:52:08.426 INFO:tasks.workunit.client.1.smithi092.stdout:1/485: readlink db/l16 0 2024-09-17T01:52:08.428 INFO:tasks.workunit.client.1.smithi092.stdout:4/482: link d4/d5/d8/l96 d4/d5/d8/d99/la1 0 2024-09-17T01:52:08.430 INFO:tasks.workunit.client.1.smithi092.stdout:6/403: link d3/d10/d1f/d21/d28/d2b/f69 d3/d10/d1a/f7f 0 2024-09-17T01:52:08.432 INFO:tasks.workunit.client.1.smithi092.stdout:1/486: readlink db/d1d/d23/l98 0 2024-09-17T01:52:08.443 INFO:tasks.workunit.client.0.smithi031.stdout:7/562: dwrite db/d1c/d41/d9a/fa9 [0,4194304] 0 2024-09-17T01:52:08.444 INFO:tasks.workunit.client.1.smithi092.stdout:6/404: truncate d3/fa 8996220 0 2024-09-17T01:52:08.444 INFO:tasks.workunit.client.0.smithi031.stdout:2/614: write d1/d3/d2d/db2/d1e/d21/d34/f93 [151390,128769] 0 2024-09-17T01:52:08.444 INFO:tasks.workunit.client.0.smithi031.stdout:7/563: fdatasync db/d18/f7b 0 2024-09-17T01:52:08.447 INFO:tasks.workunit.client.1.smithi092.stdout:7/474: dwrite d3/d6/d13/d40/f55 [0,4194304] 0 2024-09-17T01:52:08.448 INFO:tasks.workunit.client.1.smithi092.stdout:0/497: dwrite d3/d2e/d55/f6a [4194304,4194304] 0 2024-09-17T01:52:08.449 INFO:tasks.workunit.client.1.smithi092.stdout:5/380: dread d0/d50/f5b [0,4194304] 0 2024-09-17T01:52:08.449 INFO:tasks.workunit.client.0.smithi031.stdout:7/564: creat db/d1c/d41/faf x:0 0 0 2024-09-17T01:52:08.450 INFO:tasks.workunit.client.0.smithi031.stdout:2/615: getdents d1/d3/df/d18/d40 0 2024-09-17T01:52:08.451 INFO:tasks.workunit.client.0.smithi031.stdout:7/565: write db/d1c/d41/d9a/f9c [350046,10698] 0 2024-09-17T01:52:08.452 INFO:tasks.workunit.client.0.smithi031.stdout:5/465: sync 2024-09-17T01:52:08.452 INFO:tasks.workunit.client.0.smithi031.stdout:0/594: sync 2024-09-17T01:52:08.456 INFO:tasks.workunit.client.1.smithi092.stdout:7/475: chown d3/d6/d13/d40/f55 17475 1 2024-09-17T01:52:08.457 INFO:tasks.workunit.client.0.smithi031.stdout:9/486: dread d3/d19/d1f/f58 [0,4194304] 0 2024-09-17T01:52:08.461 INFO:tasks.workunit.client.0.smithi031.stdout:7/566: link db/f89 db/d1c/d41/d6c/fb0 0 2024-09-17T01:52:08.464 INFO:tasks.workunit.client.1.smithi092.stdout:1/487: dwrite db/d1d/d23/f5b [0,4194304] 0 2024-09-17T01:52:08.464 INFO:tasks.workunit.client.1.smithi092.stdout:0/498: fdatasync d3/d2e/d55/d63/f93 0 2024-09-17T01:52:08.464 INFO:tasks.workunit.client.1.smithi092.stdout:4/483: link d4/d13/f8f d4/d5/fa2 0 2024-09-17T01:52:08.464 INFO:tasks.workunit.client.0.smithi031.stdout:7/567: chown db/d1c/c91 2 1 2024-09-17T01:52:08.465 INFO:tasks.workunit.client.0.smithi031.stdout:5/466: dwrite da/dc/d2e/d82/f8b [0,4194304] 0 2024-09-17T01:52:08.468 INFO:tasks.workunit.client.0.smithi031.stdout:7/568: rmdir db/d1c/d41/d6c 39 2024-09-17T01:52:08.470 INFO:tasks.workunit.client.0.smithi031.stdout:7/569: write db/d18/f2f [1802393,47650] 0 2024-09-17T01:52:08.471 INFO:tasks.workunit.client.1.smithi092.stdout:0/499: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:52:08.472 INFO:tasks.workunit.client.1.smithi092.stdout:9/419: truncate d0/df/f47 2625703 0 2024-09-17T01:52:08.473 INFO:tasks.workunit.client.0.smithi031.stdout:7/570: truncate db/d18/f7f 25980 0 2024-09-17T01:52:08.474 INFO:tasks.workunit.client.0.smithi031.stdout:3/574: truncate db/df/f39 1600350 0 2024-09-17T01:52:08.475 INFO:tasks.workunit.client.1.smithi092.stdout:5/381: write d0/f53 [237239,126236] 0 2024-09-17T01:52:08.476 INFO:tasks.workunit.client.0.smithi031.stdout:7/571: fdatasync db/d1c/d41/f44 0 2024-09-17T01:52:08.481 INFO:tasks.workunit.client.0.smithi031.stdout:7/572: link db/d1c/d41/d69/c7d db/d1c/cb1 0 2024-09-17T01:52:08.481 INFO:tasks.workunit.client.0.smithi031.stdout:3/575: dwrite db/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:08.482 INFO:tasks.workunit.client.1.smithi092.stdout:5/382: fdatasync d0/de/d19/d1a/d1e/f5c 0 2024-09-17T01:52:08.482 INFO:tasks.workunit.client.1.smithi092.stdout:7/476: fdatasync d3/db/d26/f80 0 2024-09-17T01:52:08.482 INFO:tasks.workunit.client.1.smithi092.stdout:1/488: unlink db/d1d/d4b/f58 0 2024-09-17T01:52:08.482 INFO:tasks.workunit.client.1.smithi092.stdout:4/484: rmdir d4/d13/d3b/d42/d76/d35/d3e 39 2024-09-17T01:52:08.482 INFO:tasks.workunit.client.1.smithi092.stdout:2/348: dread fe [0,4194304] 0 2024-09-17T01:52:08.483 INFO:tasks.workunit.client.1.smithi092.stdout:4/485: chown d4/d5/d46 158903 1 2024-09-17T01:52:08.483 INFO:tasks.workunit.client.1.smithi092.stdout:4/486: chown d4/d5/d8 329 1 2024-09-17T01:52:08.484 INFO:tasks.workunit.client.0.smithi031.stdout:7/573: creat db/d1c/d8e/fb2 x:0 0 0 2024-09-17T01:52:08.485 INFO:tasks.workunit.client.1.smithi092.stdout:9/420: creat d0/d7/d12/d34/f7e x:0 0 0 2024-09-17T01:52:08.485 INFO:tasks.workunit.client.0.smithi031.stdout:7/574: stat db/d1c/f63 0 2024-09-17T01:52:08.486 INFO:tasks.workunit.client.0.smithi031.stdout:3/576: symlink db/df/d1c/d99/lae 0 2024-09-17T01:52:08.488 INFO:tasks.workunit.client.0.smithi031.stdout:2/616: fdatasync d1/d3/d2d/db2/d1e/d21/d34/f93 0 2024-09-17T01:52:08.490 INFO:tasks.workunit.client.1.smithi092.stdout:0/500: symlink d3/da/l98 0 2024-09-17T01:52:08.490 INFO:tasks.workunit.client.1.smithi092.stdout:0/501: readlink d3/d1d/l5e 0 2024-09-17T01:52:08.492 INFO:tasks.workunit.client.1.smithi092.stdout:0/502: stat d3/da/l98 0 2024-09-17T01:52:08.493 INFO:tasks.workunit.client.0.smithi031.stdout:7/575: link db/d1c/d41/f7e db/d1c/d41/d9a/fb3 0 2024-09-17T01:52:08.497 INFO:tasks.workunit.client.0.smithi031.stdout:7/576: creat db/d1c/fb4 x:0 0 0 2024-09-17T01:52:08.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/421: unlink d0/df/d17/l79 0 2024-09-17T01:52:08.501 INFO:tasks.workunit.client.0.smithi031.stdout:9/487: write d3/d19/d1f/f87 [4384692,51147] 0 2024-09-17T01:52:08.501 INFO:tasks.workunit.client.1.smithi092.stdout:4/487: creat d4/d5/d8/d92/fa3 x:0 0 0 2024-09-17T01:52:08.503 INFO:tasks.workunit.client.0.smithi031.stdout:5/467: write da/f58 [55347,91192] 0 2024-09-17T01:52:08.503 INFO:tasks.workunit.client.1.smithi092.stdout:0/503: mknod d3/da/d15/d90/c99 0 2024-09-17T01:52:08.503 INFO:tasks.workunit.client.1.smithi092.stdout:9/422: chown d0/d7/d12/d34/d26/c73 693548087 1 2024-09-17T01:52:08.504 INFO:tasks.workunit.client.0.smithi031.stdout:9/488: dread - d3/d10/d36/f9b zero size 2024-09-17T01:52:08.506 INFO:tasks.workunit.client.0.smithi031.stdout:7/577: dwrite db/f10 [4194304,4194304] 0 2024-09-17T01:52:08.506 INFO:tasks.workunit.client.0.smithi031.stdout:5/468: dread - da/d42/d12/d4a/f71 zero size 2024-09-17T01:52:08.508 INFO:tasks.workunit.client.0.smithi031.stdout:0/595: dwrite d0/d29/d33/d2a/d25/d38/f41 [4194304,4194304] 0 2024-09-17T01:52:08.508 INFO:tasks.workunit.client.1.smithi092.stdout:4/488: creat d4/d5/d1d/d30/d3f/d4b/fa4 x:0 0 0 2024-09-17T01:52:08.512 INFO:tasks.workunit.client.1.smithi092.stdout:0/504: creat d3/d2e/d3b/d8f/d5f/f9a x:0 0 0 2024-09-17T01:52:08.514 INFO:tasks.workunit.client.0.smithi031.stdout:0/596: creat d0/d29/d33/d5/d50/fc9 x:0 0 0 2024-09-17T01:52:08.516 INFO:tasks.workunit.client.0.smithi031.stdout:5/469: rename da/c15 to da/d42/d12/d4a/ca4 0 2024-09-17T01:52:08.517 INFO:tasks.workunit.client.0.smithi031.stdout:9/489: creat d3/d10/d36/f9c x:0 0 0 2024-09-17T01:52:08.518 INFO:tasks.workunit.client.0.smithi031.stdout:5/470: chown da/dc/l21 8289921 1 2024-09-17T01:52:08.519 INFO:tasks.workunit.client.1.smithi092.stdout:9/423: dwrite d0/d7/d12/d34/d26/d54/f4f [0,4194304] 0 2024-09-17T01:52:08.519 INFO:tasks.workunit.client.1.smithi092.stdout:4/489: rename d4/d5/d1d/d30/l91 to d4/d5/d1d/d30/d3f/d4b/la5 0 2024-09-17T01:52:08.520 INFO:tasks.workunit.client.1.smithi092.stdout:4/490: chown d4/d5/d1d/d30/d3f/d4b/f81 64384053 1 2024-09-17T01:52:08.520 INFO:tasks.workunit.client.0.smithi031.stdout:0/597: rename d0/d29/da7/db3/f57 to d0/d29/da7/dbb/fca 0 2024-09-17T01:52:08.520 INFO:tasks.workunit.client.0.smithi031.stdout:7/578: link db/d18/l43 db/d1c/d41/d9a/lb5 0 2024-09-17T01:52:08.522 INFO:tasks.workunit.client.0.smithi031.stdout:7/579: fsync db/d1c/fa2 0 2024-09-17T01:52:08.523 INFO:tasks.workunit.client.0.smithi031.stdout:7/580: dread - db/d1c/d41/faf zero size 2024-09-17T01:52:08.524 INFO:tasks.workunit.client.1.smithi092.stdout:0/505: read d3/da/f22 [3412491,24196] 0 2024-09-17T01:52:08.524 INFO:tasks.workunit.client.1.smithi092.stdout:0/506: readlink d3/d1d/l38 0 2024-09-17T01:52:08.524 INFO:tasks.workunit.client.0.smithi031.stdout:7/581: fdatasync db/d1c/f71 0 2024-09-17T01:52:08.525 INFO:tasks.workunit.client.0.smithi031.stdout:9/490: symlink d3/d4/l9d 0 2024-09-17T01:52:08.525 INFO:tasks.workunit.client.0.smithi031.stdout:5/471: creat da/dc/da2/fa5 x:0 0 0 2024-09-17T01:52:08.526 INFO:tasks.workunit.client.1.smithi092.stdout:6/405: dread f2 [0,4194304] 0 2024-09-17T01:52:08.527 INFO:tasks.workunit.client.0.smithi031.stdout:5/472: chown da/dc/d98 91796 1 2024-09-17T01:52:08.529 INFO:tasks.workunit.client.0.smithi031.stdout:7/582: stat db/d1c/l55 0 2024-09-17T01:52:08.530 INFO:tasks.workunit.client.0.smithi031.stdout:9/491: rmdir d3/d19 39 2024-09-17T01:52:08.530 INFO:tasks.workunit.client.1.smithi092.stdout:4/491: getdents d4/d5/d8/d98 0 2024-09-17T01:52:08.531 INFO:tasks.workunit.client.0.smithi031.stdout:0/598: dwrite d0/d29/da7/db3/d4a/d90/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:08.533 INFO:tasks.workunit.client.0.smithi031.stdout:9/492: readlink d3/d4/l5d 0 2024-09-17T01:52:08.538 INFO:tasks.workunit.client.0.smithi031.stdout:0/599: chown d0/cbd 5533862 1 2024-09-17T01:52:08.541 INFO:tasks.workunit.client.0.smithi031.stdout:9/493: creat d3/d10/d71/f9e x:0 0 0 2024-09-17T01:52:08.543 INFO:tasks.workunit.client.1.smithi092.stdout:2/349: dread d10/d1d/d2c/f39 [0,4194304] 0 2024-09-17T01:52:08.543 INFO:tasks.workunit.client.1.smithi092.stdout:2/350: chown d10/d1d/d2d/f52 115231381 1 2024-09-17T01:52:08.544 INFO:tasks.workunit.client.0.smithi031.stdout:7/583: rmdir db/d1c/d41/d69/d88 0 2024-09-17T01:52:08.545 INFO:tasks.workunit.client.0.smithi031.stdout:0/600: dwrite d0/d37/fbc [0,4194304] 0 2024-09-17T01:52:08.546 INFO:tasks.workunit.client.0.smithi031.stdout:0/601: fdatasync d0/f21 0 2024-09-17T01:52:08.547 INFO:tasks.workunit.client.0.smithi031.stdout:2/617: truncate d1/d3/f1c 291402 0 2024-09-17T01:52:08.548 INFO:tasks.workunit.client.1.smithi092.stdout:1/489: write db/d1d/d23/f45 [3588010,73564] 0 2024-09-17T01:52:08.549 INFO:tasks.workunit.client.0.smithi031.stdout:7/584: write db/d1c/f5c [4232155,56092] 0 2024-09-17T01:52:08.551 INFO:tasks.workunit.client.1.smithi092.stdout:5/383: truncate d0/de/f11 1844445 0 2024-09-17T01:52:08.551 INFO:tasks.workunit.client.0.smithi031.stdout:0/602: symlink d0/d29/d33/d5/d50/dac/lcb 0 2024-09-17T01:52:08.553 INFO:tasks.workunit.client.1.smithi092.stdout:9/424: getdents d0/d7/d12/d34 0 2024-09-17T01:52:08.555 INFO:tasks.workunit.client.0.smithi031.stdout:7/585: fsync db/f1a 0 2024-09-17T01:52:08.557 INFO:tasks.workunit.client.0.smithi031.stdout:9/494: dwrite d3/d10/f14 [8388608,4194304] 0 2024-09-17T01:52:08.558 INFO:tasks.workunit.client.1.smithi092.stdout:4/492: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/f89 [0,4194304] 0 2024-09-17T01:52:08.563 INFO:tasks.workunit.client.0.smithi031.stdout:7/586: fdatasync db/d1c/f63 0 2024-09-17T01:52:08.564 INFO:tasks.workunit.client.0.smithi031.stdout:2/618: link d1/d3/d2d/d71/c86 d1/d3/d2d/db2/d1e/d21/d34/d8a/cd6 0 2024-09-17T01:52:08.567 INFO:tasks.workunit.client.0.smithi031.stdout:7/587: mknod db/d1c/d41/d9a/cb6 0 2024-09-17T01:52:08.570 INFO:tasks.workunit.client.0.smithi031.stdout:2/619: link d1/d3/d2d/db2/d1e/f29 d1/fd7 0 2024-09-17T01:52:08.571 INFO:tasks.workunit.client.1.smithi092.stdout:0/507: creat d3/d2e/d3b/d8f/f9b x:0 0 0 2024-09-17T01:52:08.574 INFO:tasks.workunit.client.1.smithi092.stdout:5/384: mknod d0/de/d19/d3c/d41/c7f 0 2024-09-17T01:52:08.581 INFO:tasks.workunit.client.1.smithi092.stdout:1/490: dwrite db/d1d/d2e/f32 [0,4194304] 0 2024-09-17T01:52:08.582 INFO:tasks.workunit.client.1.smithi092.stdout:1/491: write db/d1d/f72 [445409,119936] 0 2024-09-17T01:52:08.585 INFO:tasks.workunit.client.1.smithi092.stdout:2/351: write d10/f5d [23510,104769] 0 2024-09-17T01:52:08.585 INFO:tasks.workunit.client.1.smithi092.stdout:0/508: chown d3/d2e/d3b/d40/f53 149087 1 2024-09-17T01:52:08.587 INFO:tasks.workunit.client.1.smithi092.stdout:4/493: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/f87 [0,4194304] 0 2024-09-17T01:52:08.590 INFO:tasks.workunit.client.1.smithi092.stdout:1/492: read - db/d1d/d23/f89 zero size 2024-09-17T01:52:08.594 INFO:tasks.workunit.client.1.smithi092.stdout:0/509: mkdir d3/d2e/d55/d63/d81/d9c 0 2024-09-17T01:52:08.596 INFO:tasks.workunit.client.1.smithi092.stdout:6/406: dwrite d3/d10/d1f/d21/d28/f54 [0,4194304] 0 2024-09-17T01:52:08.596 INFO:tasks.workunit.client.1.smithi092.stdout:9/425: dwrite d0/d7/d12/d34/d26/f6f [0,4194304] 0 2024-09-17T01:52:08.598 INFO:tasks.workunit.client.1.smithi092.stdout:0/510: chown d3/d58 5332742 1 2024-09-17T01:52:08.598 INFO:tasks.workunit.client.1.smithi092.stdout:5/385: rename d0/de/d19/d1a/d24/c37 to d0/de/d19/d1a/d1e/d3e/d4c/c80 0 2024-09-17T01:52:08.599 INFO:tasks.workunit.client.1.smithi092.stdout:4/494: symlink d4/d7b/la6 0 2024-09-17T01:52:08.602 INFO:tasks.workunit.client.1.smithi092.stdout:2/352: write d10/d1d/d2c/f6a [3615208,84111] 0 2024-09-17T01:52:08.604 INFO:tasks.workunit.client.1.smithi092.stdout:6/407: fdatasync d3/d10/d1f/d21/d1e/d55/f5b 0 2024-09-17T01:52:08.608 INFO:tasks.workunit.client.1.smithi092.stdout:4/495: symlink d4/d13/d3b/d42/d76/d35/d3e/d7c/la7 0 2024-09-17T01:52:08.608 INFO:tasks.workunit.client.1.smithi092.stdout:6/408: dread - d3/d10/d1f/d21/f65 zero size 2024-09-17T01:52:08.610 INFO:tasks.workunit.client.1.smithi092.stdout:4/496: write d4/f62 [4483043,48556] 0 2024-09-17T01:52:08.611 INFO:tasks.workunit.client.1.smithi092.stdout:2/353: mknod d10/d1d/d24/d6e/c75 0 2024-09-17T01:52:08.617 INFO:tasks.workunit.client.1.smithi092.stdout:0/511: rename d3/d1d/d6b/f86 to d3/d73/f9d 0 2024-09-17T01:52:08.619 INFO:tasks.workunit.client.1.smithi092.stdout:6/409: symlink d3/d70/l80 0 2024-09-17T01:52:08.622 INFO:tasks.workunit.client.1.smithi092.stdout:4/497: dwrite d4/d13/d3b/d42/d76/f48 [0,4194304] 0 2024-09-17T01:52:08.622 INFO:tasks.workunit.client.1.smithi092.stdout:2/354: creat d10/d1d/d2d/f76 x:0 0 0 2024-09-17T01:52:08.627 INFO:tasks.workunit.client.1.smithi092.stdout:4/498: write d4/d7b/d7d/f93 [195238,986] 0 2024-09-17T01:52:08.631 INFO:tasks.workunit.client.1.smithi092.stdout:6/410: unlink d3/d10/d1a/d43/f4a 0 2024-09-17T01:52:08.633 INFO:tasks.workunit.client.1.smithi092.stdout:0/512: dwrite d3/d1d/d6b/f6c [0,4194304] 0 2024-09-17T01:52:08.635 INFO:tasks.workunit.client.1.smithi092.stdout:2/355: unlink d10/d1d/f53 0 2024-09-17T01:52:08.635 INFO:tasks.workunit.client.1.smithi092.stdout:0/513: chown d3/d2e/d3b/d40/c44 67958 1 2024-09-17T01:52:08.637 INFO:tasks.workunit.client.0.smithi031.stdout:7/588: rename db/d1c/f40 to db/d18/fb7 0 2024-09-17T01:52:08.638 INFO:tasks.workunit.client.0.smithi031.stdout:5/473: truncate f4 7597705 0 2024-09-17T01:52:08.638 INFO:tasks.workunit.client.0.smithi031.stdout:7/589: write db/d29/f4a [963469,58855] 0 2024-09-17T01:52:08.639 INFO:tasks.workunit.client.1.smithi092.stdout:5/386: getdents d0/de/d19/d1a 0 2024-09-17T01:52:08.639 INFO:tasks.workunit.client.0.smithi031.stdout:2/620: truncate d1/d3/d2d/db2/d1e/d21/f90 937920 0 2024-09-17T01:52:08.639 INFO:tasks.workunit.client.0.smithi031.stdout:5/474: readlink da/dc/la3 0 2024-09-17T01:52:08.641 INFO:tasks.workunit.client.1.smithi092.stdout:5/387: chown d0/de/d19/d1a/d1e/d3e/f63 323349479 1 2024-09-17T01:52:08.645 INFO:tasks.workunit.client.1.smithi092.stdout:4/499: mknod d4/d13/d3b/d42/d76/d41/d67/ca8 0 2024-09-17T01:52:08.646 INFO:tasks.workunit.client.1.smithi092.stdout:1/493: truncate db/d1d/d23/f5b 3240593 0 2024-09-17T01:52:08.647 INFO:tasks.workunit.client.1.smithi092.stdout:9/426: dread d0/df/f67 [0,4194304] 0 2024-09-17T01:52:08.647 INFO:tasks.workunit.client.1.smithi092.stdout:2/356: dread d10/d15/f47 [0,4194304] 0 2024-09-17T01:52:08.649 INFO:tasks.workunit.client.1.smithi092.stdout:0/514: dwrite d3/da/d15/d30/f3c [0,4194304] 0 2024-09-17T01:52:08.650 INFO:tasks.workunit.client.1.smithi092.stdout:2/357: chown fd 118 1 2024-09-17T01:52:08.650 INFO:tasks.workunit.client.1.smithi092.stdout:1/494: write db/fd [3731390,7346] 0 2024-09-17T01:52:08.651 INFO:tasks.workunit.client.1.smithi092.stdout:9/427: write d0/d5/f45 [164612,115840] 0 2024-09-17T01:52:08.651 INFO:tasks.workunit.client.1.smithi092.stdout:5/388: link d0/de/d19/d1a/d1e/d3e/f63 d0/d50/d70/f81 0 2024-09-17T01:52:08.654 INFO:tasks.workunit.client.1.smithi092.stdout:9/428: write d0/d7/f77 [2800636,22994] 0 2024-09-17T01:52:08.655 INFO:tasks.workunit.client.1.smithi092.stdout:5/389: dread - d0/de/d19/d1a/f7b zero size 2024-09-17T01:52:08.662 INFO:tasks.workunit.client.0.smithi031.stdout:7/590: symlink db/lb8 0 2024-09-17T01:52:08.663 INFO:tasks.workunit.client.0.smithi031.stdout:5/475: fsync da/f6f 0 2024-09-17T01:52:08.664 INFO:tasks.workunit.client.1.smithi092.stdout:2/358: rename d10/d15 to d10/d1d/d24/d6b/d77 0 2024-09-17T01:52:08.664 INFO:tasks.workunit.client.0.smithi031.stdout:7/591: truncate db/d29/f75 750687 0 2024-09-17T01:52:08.666 INFO:tasks.workunit.client.1.smithi092.stdout:1/495: dwrite db/d1d/d23/f3c [0,4194304] 0 2024-09-17T01:52:08.667 INFO:tasks.workunit.client.1.smithi092.stdout:4/500: symlink d4/d5/d1d/d30/d3f/la9 0 2024-09-17T01:52:08.668 INFO:tasks.workunit.client.1.smithi092.stdout:6/411: rmdir d3/d10/d1a 39 2024-09-17T01:52:08.671 INFO:tasks.workunit.client.0.smithi031.stdout:5/476: creat da/d42/d26/fa6 x:0 0 0 2024-09-17T01:52:08.672 INFO:tasks.workunit.client.0.smithi031.stdout:7/592: dwrite db/d18/f93 [0,4194304] 0 2024-09-17T01:52:08.673 INFO:tasks.workunit.client.1.smithi092.stdout:9/429: dwrite d0/d5/d29/f55 [4194304,4194304] 0 2024-09-17T01:52:08.675 INFO:tasks.workunit.client.1.smithi092.stdout:5/390: dread d0/de/d19/d1a/d1e/f12 [0,4194304] 0 2024-09-17T01:52:08.677 INFO:tasks.workunit.client.1.smithi092.stdout:0/515: creat d3/da/f9e x:0 0 0 2024-09-17T01:52:08.681 INFO:tasks.workunit.client.0.smithi031.stdout:0/603: dwrite d0/d29/d33/d2a/d25/f27 [0,4194304] 0 2024-09-17T01:52:08.682 INFO:tasks.workunit.client.1.smithi092.stdout:0/516: read - d3/d2e/d3b/d40/d7d/f8b zero size 2024-09-17T01:52:08.683 INFO:tasks.workunit.client.1.smithi092.stdout:2/359: dwrite d10/d54/f6d [0,4194304] 0 2024-09-17T01:52:08.683 INFO:tasks.workunit.client.0.smithi031.stdout:0/604: write d0/f99 [554971,23338] 0 2024-09-17T01:52:08.684 INFO:tasks.workunit.client.0.smithi031.stdout:2/621: dread d1/d3/df/d11/d30/f7a [0,4194304] 0 2024-09-17T01:52:08.685 INFO:tasks.workunit.client.0.smithi031.stdout:7/593: unlink db/d18/c37 0 2024-09-17T01:52:08.685 INFO:tasks.workunit.client.0.smithi031.stdout:2/622: stat d1/d3/df/d11/d30/f6e 0 2024-09-17T01:52:08.686 INFO:tasks.workunit.client.1.smithi092.stdout:4/501: symlink d4/laa 0 2024-09-17T01:52:08.687 INFO:tasks.workunit.client.0.smithi031.stdout:5/477: symlink da/dc/la7 0 2024-09-17T01:52:08.690 INFO:tasks.workunit.client.0.smithi031.stdout:7/594: mkdir db/d1c/d46/db9 0 2024-09-17T01:52:08.691 INFO:tasks.workunit.client.1.smithi092.stdout:5/391: fsync d0/d50/d70/f81 0 2024-09-17T01:52:08.692 INFO:tasks.workunit.client.0.smithi031.stdout:0/605: mkdir d0/d29/d33/d5/d48/d56/dc8/dcc 0 2024-09-17T01:52:08.692 INFO:tasks.workunit.client.0.smithi031.stdout:7/595: chown db/d1c/d46/f4f 1781989 1 2024-09-17T01:52:08.693 INFO:tasks.workunit.client.1.smithi092.stdout:2/360: creat d10/d1d/d2c/d56/f78 x:0 0 0 2024-09-17T01:52:08.695 INFO:tasks.workunit.client.0.smithi031.stdout:7/596: dread - db/f89 zero size 2024-09-17T01:52:08.697 INFO:tasks.workunit.client.0.smithi031.stdout:5/478: dwrite da/f74 [0,4194304] 0 2024-09-17T01:52:08.698 INFO:tasks.workunit.client.0.smithi031.stdout:7/597: chown db/d29/f4e 6987 1 2024-09-17T01:52:08.701 INFO:tasks.workunit.client.0.smithi031.stdout:5/479: fdatasync da/dc/d2e/f68 0 2024-09-17T01:52:08.702 INFO:tasks.workunit.client.0.smithi031.stdout:7/598: mknod db/d1c/d8e/cba 0 2024-09-17T01:52:08.703 INFO:tasks.workunit.client.1.smithi092.stdout:5/392: mknod d0/d23/c82 0 2024-09-17T01:52:08.703 INFO:tasks.workunit.client.0.smithi031.stdout:5/480: dread - da/d14/f6a zero size 2024-09-17T01:52:08.704 INFO:tasks.workunit.client.1.smithi092.stdout:5/393: fdatasync d0/f6d 0 2024-09-17T01:52:08.704 INFO:tasks.workunit.client.0.smithi031.stdout:7/599: read - db/d18/f9e zero size 2024-09-17T01:52:08.705 INFO:tasks.workunit.client.0.smithi031.stdout:0/606: dwrite d0/d29/d33/d2a/d25/da5/fa8 [0,4194304] 0 2024-09-17T01:52:08.706 INFO:tasks.workunit.client.0.smithi031.stdout:5/481: truncate f8 1859383 0 2024-09-17T01:52:08.708 INFO:tasks.workunit.client.1.smithi092.stdout:5/394: dread - d0/de/d19/d3c/d41/f6e zero size 2024-09-17T01:52:08.708 INFO:tasks.workunit.client.1.smithi092.stdout:6/412: dwrite d3/d10/f57 [0,4194304] 0 2024-09-17T01:52:08.710 INFO:tasks.workunit.client.1.smithi092.stdout:1/496: dread db/d1d/d4b/f56 [0,4194304] 0 2024-09-17T01:52:08.710 INFO:tasks.workunit.client.1.smithi092.stdout:6/413: chown d3/f13 1 1 2024-09-17T01:52:08.712 INFO:tasks.workunit.client.0.smithi031.stdout:5/482: unlink da/d14/f1d 0 2024-09-17T01:52:08.714 INFO:tasks.workunit.client.1.smithi092.stdout:0/517: getdents d3/d1d 0 2024-09-17T01:52:08.716 INFO:tasks.workunit.client.0.smithi031.stdout:5/483: unlink da/f58 0 2024-09-17T01:52:08.717 INFO:tasks.workunit.client.0.smithi031.stdout:0/607: getdents d0/d29 0 2024-09-17T01:52:08.717 INFO:tasks.workunit.client.1.smithi092.stdout:0/518: read d3/d2e/d55/f70 [525563,125402] 0 2024-09-17T01:52:08.718 INFO:tasks.workunit.client.1.smithi092.stdout:4/502: getdents d4/d13/d3b/d42/d76/d35 0 2024-09-17T01:52:08.722 INFO:tasks.workunit.client.1.smithi092.stdout:5/395: rename d0/de/d19/d1a/d1e/f2a to d0/de/d19/d1a/d1e/d74/f83 0 2024-09-17T01:52:08.723 INFO:tasks.workunit.client.0.smithi031.stdout:0/608: dread d0/d29/f70 [0,4194304] 0 2024-09-17T01:52:08.724 INFO:tasks.workunit.client.0.smithi031.stdout:0/609: fdatasync d0/d29/f70 0 2024-09-17T01:52:08.726 INFO:tasks.workunit.client.1.smithi092.stdout:1/497: creat db/d1d/d23/d85/f9b x:0 0 0 2024-09-17T01:52:08.727 INFO:tasks.workunit.client.1.smithi092.stdout:5/396: mknod d0/de/d19/d1a/d1e/d29/c84 0 2024-09-17T01:52:08.728 INFO:tasks.workunit.client.1.smithi092.stdout:5/397: fdatasync d0/de/d19/d1a/d1e/f36 0 2024-09-17T01:52:08.728 INFO:tasks.workunit.client.1.smithi092.stdout:4/503: creat d4/d5/d1d/d30/d7a/fab x:0 0 0 2024-09-17T01:52:08.731 INFO:tasks.workunit.client.0.smithi031.stdout:0/610: dwrite d0/d29/f3e [0,4194304] 0 2024-09-17T01:52:08.731 INFO:tasks.workunit.client.1.smithi092.stdout:1/498: unlink db/d1d/d23/f3a 0 2024-09-17T01:52:08.733 INFO:tasks.workunit.client.0.smithi031.stdout:0/611: chown d0/d29/d33/d5/f62 919724121 1 2024-09-17T01:52:08.733 INFO:tasks.workunit.client.1.smithi092.stdout:4/504: mknod d4/d5/d8/d92/cac 0 2024-09-17T01:52:08.735 INFO:tasks.workunit.client.1.smithi092.stdout:1/499: mknod db/d6c/c9c 0 2024-09-17T01:52:08.735 INFO:tasks.workunit.client.0.smithi031.stdout:7/600: dwrite db/d1c/d41/d6c/fb0 [0,4194304] 0 2024-09-17T01:52:08.737 INFO:tasks.workunit.client.0.smithi031.stdout:0/612: read d0/d37/f81 [11208,39734] 0 2024-09-17T01:52:08.737 INFO:tasks.workunit.client.0.smithi031.stdout:7/601: read db/d1c/f71 [221317,127961] 0 2024-09-17T01:52:08.739 INFO:tasks.workunit.client.1.smithi092.stdout:5/398: dread d0/de/d19/d1a/d1e/d29/f66 [0,4194304] 0 2024-09-17T01:52:08.742 INFO:tasks.workunit.client.1.smithi092.stdout:5/399: creat d0/d7e/f85 x:0 0 0 2024-09-17T01:52:08.742 INFO:tasks.workunit.client.0.smithi031.stdout:0/613: rename d0/d29/d44/f66 to d0/d29/d33/d2a/fcd 0 2024-09-17T01:52:08.744 INFO:tasks.workunit.client.0.smithi031.stdout:0/614: write d0/d29/d33/d2a/f39 [1585204,24475] 0 2024-09-17T01:52:08.744 INFO:tasks.workunit.client.1.smithi092.stdout:5/400: truncate d0/de/d19/f6c 966932 0 2024-09-17T01:52:08.745 INFO:tasks.workunit.client.0.smithi031.stdout:0/615: chown d0/d29/d33/fc1 0 1 2024-09-17T01:52:08.746 INFO:tasks.workunit.client.0.smithi031.stdout:0/616: dread - d0/d29/d33/d5b/f9e zero size 2024-09-17T01:52:08.746 INFO:tasks.workunit.client.1.smithi092.stdout:9/430: truncate d0/f32 2960099 0 2024-09-17T01:52:08.747 INFO:tasks.workunit.client.0.smithi031.stdout:0/617: readlink d0/d29/da7/lc7 0 2024-09-17T01:52:08.748 INFO:tasks.workunit.client.1.smithi092.stdout:5/401: symlink d0/de/d19/d1a/d1e/d29/l86 0 2024-09-17T01:52:08.749 INFO:tasks.workunit.client.1.smithi092.stdout:6/414: write d3/f15 [4056895,94935] 0 2024-09-17T01:52:08.750 INFO:tasks.workunit.client.1.smithi092.stdout:5/402: fsync d0/de/d19/d3c/d41/f6e 0 2024-09-17T01:52:08.750 INFO:tasks.workunit.client.1.smithi092.stdout:6/415: chown d3/d70/l80 7 1 2024-09-17T01:52:08.751 INFO:tasks.workunit.client.1.smithi092.stdout:9/431: rename d0/df/d5d/l63 to d0/df/d17/d65/l7f 0 2024-09-17T01:52:08.752 INFO:tasks.workunit.client.1.smithi092.stdout:5/403: stat d0/de/d19/d1a/l65 0 2024-09-17T01:52:08.756 INFO:tasks.workunit.client.0.smithi031.stdout:2/623: write d1/d3/d2d/db2/d1e/d21/f90 [1666430,122908] 0 2024-09-17T01:52:08.758 INFO:tasks.workunit.client.0.smithi031.stdout:7/602: truncate db/f62 578071 0 2024-09-17T01:52:08.758 INFO:tasks.workunit.client.1.smithi092.stdout:5/404: mknod d0/c87 0 2024-09-17T01:52:08.759 INFO:tasks.workunit.client.1.smithi092.stdout:9/432: dwrite d0/f7d [0,4194304] 0 2024-09-17T01:52:08.761 INFO:tasks.workunit.client.1.smithi092.stdout:5/405: dread - d0/de/d19/d3c/d41/f43 zero size 2024-09-17T01:52:08.761 INFO:tasks.workunit.client.0.smithi031.stdout:7/603: mknod db/d1c/d99/cbb 0 2024-09-17T01:52:08.762 INFO:tasks.workunit.client.1.smithi092.stdout:0/519: dread d3/f28 [0,4194304] 0 2024-09-17T01:52:08.762 INFO:tasks.workunit.client.0.smithi031.stdout:0/618: truncate d0/d29/da7/db3/d4a/f64 847360 0 2024-09-17T01:52:08.762 INFO:tasks.workunit.client.1.smithi092.stdout:1/500: truncate db/d1d/d2e/f32 2527624 0 2024-09-17T01:52:08.766 INFO:tasks.workunit.client.1.smithi092.stdout:0/520: chown d3/da/d15/d30/f41 936181730 1 2024-09-17T01:52:08.768 INFO:tasks.workunit.client.1.smithi092.stdout:5/406: creat d0/de/d19/d1a/f88 x:0 0 0 2024-09-17T01:52:08.769 INFO:tasks.workunit.client.1.smithi092.stdout:4/505: dwrite d4/d13/d3b/f82 [0,4194304] 0 2024-09-17T01:52:08.769 INFO:tasks.workunit.client.1.smithi092.stdout:3/422: sync 2024-09-17T01:52:08.772 INFO:tasks.workunit.client.1.smithi092.stdout:1/501: creat db/d1d/d23/d85/f9d x:0 0 0 2024-09-17T01:52:08.774 INFO:tasks.workunit.client.0.smithi031.stdout:7/604: dread db/d29/f2e [4194304,4194304] 0 2024-09-17T01:52:08.774 INFO:tasks.workunit.client.0.smithi031.stdout:2/624: truncate d1/d3/d2d/db2/d1e/d2a/d7f/fa9 1108963 0 2024-09-17T01:52:08.778 INFO:tasks.workunit.client.0.smithi031.stdout:0/619: write d0/d29/d33/d5/f3b [4487972,35202] 0 2024-09-17T01:52:08.778 INFO:tasks.workunit.client.0.smithi031.stdout:2/625: mknod d1/d3/df/d11/d30/dd0/cd8 0 2024-09-17T01:52:08.779 INFO:tasks.workunit.client.0.smithi031.stdout:7/605: creat db/d1c/fbc x:0 0 0 2024-09-17T01:52:08.780 INFO:tasks.workunit.client.0.smithi031.stdout:0/620: fdatasync d0/d29/da7/db3/d4a/d90/d9b/fa9 0 2024-09-17T01:52:08.780 INFO:tasks.workunit.client.1.smithi092.stdout:0/521: rename d3/d2e/d3b/d8f/d5f/f9a to d3/d2e/d3b/d72/d7a/f9f 0 2024-09-17T01:52:08.781 INFO:tasks.workunit.client.1.smithi092.stdout:6/416: dread d3/d10/d1f/d21/f7c [0,4194304] 0 2024-09-17T01:52:08.782 INFO:tasks.workunit.client.0.smithi031.stdout:7/606: read db/d18/f61 [614983,49610] 0 2024-09-17T01:52:08.783 INFO:tasks.workunit.client.0.smithi031.stdout:7/607: stat db/d1c/d8e 0 2024-09-17T01:52:08.784 INFO:tasks.workunit.client.0.smithi031.stdout:7/608: dread - db/d1c/d46/f8a zero size 2024-09-17T01:52:08.784 INFO:tasks.workunit.client.0.smithi031.stdout:0/621: dread d0/f8a [0,4194304] 0 2024-09-17T01:52:08.785 INFO:tasks.workunit.client.1.smithi092.stdout:4/506: dread d4/d5/f40 [0,4194304] 0 2024-09-17T01:52:08.785 INFO:tasks.workunit.client.0.smithi031.stdout:0/622: fdatasync d0/d29/d33/d2a/d25/f27 0 2024-09-17T01:52:08.786 INFO:tasks.workunit.client.0.smithi031.stdout:2/626: rename d1/d3/f1c to d1/d7c/fd9 0 2024-09-17T01:52:08.788 INFO:tasks.workunit.client.1.smithi092.stdout:9/433: dread d0/f32 [0,4194304] 0 2024-09-17T01:52:08.788 INFO:tasks.workunit.client.1.smithi092.stdout:0/522: rmdir d3/da/d15 39 2024-09-17T01:52:08.788 INFO:tasks.workunit.client.1.smithi092.stdout:9/434: stat d0/df/l53 0 2024-09-17T01:52:08.790 INFO:tasks.workunit.client.0.smithi031.stdout:2/627: truncate d1/d3/df/d11/d30/f82 671761 0 2024-09-17T01:52:08.792 INFO:tasks.workunit.client.0.smithi031.stdout:0/623: getdents d0/d29/d33/d5/d50 0 2024-09-17T01:52:08.792 INFO:tasks.workunit.client.0.smithi031.stdout:7/609: dwrite db/d1c/fb4 [0,4194304] 0 2024-09-17T01:52:08.793 INFO:tasks.workunit.client.1.smithi092.stdout:6/417: readlink d3/d10/d1a/d43/l5a 0 2024-09-17T01:52:08.793 INFO:tasks.workunit.client.1.smithi092.stdout:4/507: symlink d4/d13/d3b/d42/lad 0 2024-09-17T01:52:08.794 INFO:tasks.workunit.client.0.smithi031.stdout:7/610: write db/d18/f6a [3370681,31715] 0 2024-09-17T01:52:08.795 INFO:tasks.workunit.client.1.smithi092.stdout:5/407: truncate d0/de/d19/d1a/d1e/f71 2869623 0 2024-09-17T01:52:08.796 INFO:tasks.workunit.client.1.smithi092.stdout:9/435: dwrite d0/d7/f77 [0,4194304] 0 2024-09-17T01:52:08.796 INFO:tasks.workunit.client.0.smithi031.stdout:0/624: dread - d0/d29/da7/db3/d4a/d86/fc2 zero size 2024-09-17T01:52:08.797 INFO:tasks.workunit.client.1.smithi092.stdout:9/436: readlink d0/d7/lc 0 2024-09-17T01:52:08.797 INFO:tasks.workunit.client.1.smithi092.stdout:4/508: chown d4/d13/d3b/d42/d76/d35/d3e/d7c 11516 1 2024-09-17T01:52:08.798 INFO:tasks.workunit.client.0.smithi031.stdout:0/625: stat d0/d29/d33/f13 0 2024-09-17T01:52:08.798 INFO:tasks.workunit.client.1.smithi092.stdout:1/502: rename db/d1d/c26 to db/d1d/d4b/c9e 0 2024-09-17T01:52:08.799 INFO:tasks.workunit.client.1.smithi092.stdout:3/423: truncate d4/d20/f26 747914 0 2024-09-17T01:52:08.800 INFO:tasks.workunit.client.0.smithi031.stdout:2/628: dwrite d1/f23 [0,4194304] 0 2024-09-17T01:52:08.800 INFO:tasks.workunit.client.0.smithi031.stdout:7/611: symlink db/d18/lbd 0 2024-09-17T01:52:08.800 INFO:tasks.workunit.client.1.smithi092.stdout:3/424: stat d4/d2f 0 2024-09-17T01:52:08.801 INFO:tasks.workunit.client.1.smithi092.stdout:4/509: stat d4/d5/d1d/d30/f64 0 2024-09-17T01:52:08.801 INFO:tasks.workunit.client.1.smithi092.stdout:4/510: stat d4/d5/c7 0 2024-09-17T01:52:08.801 INFO:tasks.workunit.client.0.smithi031.stdout:1/638: sync 2024-09-17T01:52:08.802 INFO:tasks.workunit.client.0.smithi031.stdout:0/626: creat d0/d29/d33/d2a/fce x:0 0 0 2024-09-17T01:52:08.802 INFO:tasks.workunit.client.0.smithi031.stdout:2/629: write d1/d3/f25 [2034751,64260] 0 2024-09-17T01:52:08.803 INFO:tasks.workunit.client.1.smithi092.stdout:0/523: symlink d3/d2e/d3b/la0 0 2024-09-17T01:52:08.805 INFO:tasks.workunit.client.1.smithi092.stdout:6/418: creat d3/d10/d1f/d21/f81 x:0 0 0 2024-09-17T01:52:08.806 INFO:tasks.workunit.client.0.smithi031.stdout:1/639: dread d4/d1e/d3f/d72/f7a [0,4194304] 0 2024-09-17T01:52:08.808 INFO:tasks.workunit.client.1.smithi092.stdout:3/425: mknod d4/d73/d7b/c8d 0 2024-09-17T01:52:08.808 INFO:tasks.workunit.client.1.smithi092.stdout:0/524: dwrite d3/da/fb [0,4194304] 0 2024-09-17T01:52:08.810 INFO:tasks.workunit.client.1.smithi092.stdout:5/408: creat d0/de/d19/f89 x:0 0 0 2024-09-17T01:52:08.811 INFO:tasks.workunit.client.0.smithi031.stdout:2/630: dread d1/d3/df/d11/d30/f7a [0,4194304] 0 2024-09-17T01:52:08.812 INFO:tasks.workunit.client.1.smithi092.stdout:4/511: rmdir d4/d5/d8/d98 0 2024-09-17T01:52:08.815 INFO:tasks.workunit.client.1.smithi092.stdout:0/525: creat d3/da/d1c/d4a/fa1 x:0 0 0 2024-09-17T01:52:08.817 INFO:tasks.workunit.client.1.smithi092.stdout:0/526: stat d3/d73/f75 0 2024-09-17T01:52:08.819 INFO:tasks.workunit.client.1.smithi092.stdout:0/527: read - d3/d2e/d3b/d8f/d5f/f7f zero size 2024-09-17T01:52:08.821 INFO:tasks.workunit.client.1.smithi092.stdout:6/419: creat d3/d10/d1f/d21/d28/f82 x:0 0 0 2024-09-17T01:52:08.824 INFO:tasks.workunit.client.1.smithi092.stdout:6/420: fsync d3/d10/d1f/d21/d28/d2b/d48/d18/f6b 0 2024-09-17T01:52:08.825 INFO:tasks.workunit.client.1.smithi092.stdout:0/528: creat d3/da/fa2 x:0 0 0 2024-09-17T01:52:08.830 INFO:tasks.workunit.client.1.smithi092.stdout:0/529: creat d3/d58/d8e/fa3 x:0 0 0 2024-09-17T01:52:08.832 INFO:tasks.workunit.client.1.smithi092.stdout:0/530: write d3/da/d1c/f91 [606473,86840] 0 2024-09-17T01:52:08.832 INFO:tasks.workunit.client.1.smithi092.stdout:6/421: link d3/d25/l3c d3/d10/d1a/d43/d6a/d3d/d72/l83 0 2024-09-17T01:52:08.833 INFO:tasks.workunit.client.1.smithi092.stdout:6/422: chown d3/d10/d1f/d21/d28/d2b/d48/l46 1793 1 2024-09-17T01:52:08.840 INFO:tasks.workunit.client.1.smithi092.stdout:9/437: write d0/df/d17/f38 [330297,48963] 0 2024-09-17T01:52:08.845 INFO:tasks.workunit.client.1.smithi092.stdout:5/409: write d0/d50/d70/f81 [139986,101599] 0 2024-09-17T01:52:08.845 INFO:tasks.workunit.client.1.smithi092.stdout:3/426: write d4/d13/d2e/d5f/f5c [1329362,9894] 0 2024-09-17T01:52:08.847 INFO:tasks.workunit.client.1.smithi092.stdout:9/438: dread d0/d7/d12/d34/d26/d54/f4f [0,4194304] 0 2024-09-17T01:52:08.851 INFO:tasks.workunit.client.1.smithi092.stdout:9/439: dread - d0/df/d5d/f74 zero size 2024-09-17T01:52:08.854 INFO:tasks.workunit.client.1.smithi092.stdout:4/512: dwrite d4/d13/f17 [0,4194304] 0 2024-09-17T01:52:08.857 INFO:tasks.workunit.client.1.smithi092.stdout:3/427: symlink d4/d20/d3f/l8e 0 2024-09-17T01:52:08.858 INFO:tasks.workunit.client.1.smithi092.stdout:6/423: truncate d3/fa 7780390 0 2024-09-17T01:52:08.858 INFO:tasks.workunit.client.1.smithi092.stdout:3/428: fdatasync d4/d20/f84 0 2024-09-17T01:52:08.860 INFO:tasks.workunit.client.1.smithi092.stdout:5/410: creat d0/de/d19/d3c/f8a x:0 0 0 2024-09-17T01:52:08.864 INFO:tasks.workunit.client.1.smithi092.stdout:9/440: mknod d0/df/c80 0 2024-09-17T01:52:08.865 INFO:tasks.workunit.client.1.smithi092.stdout:6/424: rmdir d3/d10/d1f/d21/d28/d2b/d48/d18 39 2024-09-17T01:52:08.867 INFO:tasks.workunit.client.1.smithi092.stdout:4/513: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a [0,4194304] 0 2024-09-17T01:52:08.867 INFO:tasks.workunit.client.1.smithi092.stdout:5/411: creat d0/de/d19/d1a/d1e/d74/f8b x:0 0 0 2024-09-17T01:52:08.872 INFO:tasks.workunit.client.1.smithi092.stdout:6/425: chown d3/d10/d1a/d43/d6a/d3d/l6e 11 1 2024-09-17T01:52:08.872 INFO:tasks.workunit.client.1.smithi092.stdout:5/412: chown d0/de/d19 184697 1 2024-09-17T01:52:08.872 INFO:tasks.workunit.client.1.smithi092.stdout:4/514: mkdir d4/d5/d1d/dae 0 2024-09-17T01:52:08.874 INFO:tasks.workunit.client.1.smithi092.stdout:5/413: fdatasync d0/de/d19/d1a/d1e/f36 0 2024-09-17T01:52:08.877 INFO:tasks.workunit.client.1.smithi092.stdout:9/441: dwrite d0/d7/f36 [0,4194304] 0 2024-09-17T01:52:08.879 INFO:tasks.workunit.client.1.smithi092.stdout:5/414: write d0/de/d19/f6b [755636,91740] 0 2024-09-17T01:52:08.879 INFO:tasks.workunit.client.1.smithi092.stdout:4/515: dread d4/d5/f40 [0,4194304] 0 2024-09-17T01:52:08.881 INFO:tasks.workunit.client.1.smithi092.stdout:5/415: readlink d0/de/d19/d1a/d1e/l3d 0 2024-09-17T01:52:08.888 INFO:tasks.workunit.client.1.smithi092.stdout:4/516: dread d4/d13/d3b/d42/d76/d35/d3e/d7c/f87 [0,4194304] 0 2024-09-17T01:52:08.892 INFO:tasks.workunit.client.1.smithi092.stdout:5/416: creat d0/de/d19/f8c x:0 0 0 2024-09-17T01:52:08.893 INFO:tasks.workunit.client.1.smithi092.stdout:9/442: link d0/d7/d12/d34/c42 d0/d7/d12/d34/d26/d54/d6b/c81 0 2024-09-17T01:52:08.894 INFO:tasks.workunit.client.0.smithi031.stdout:2/631: dwrite d1/d3/faf [0,4194304] 0 2024-09-17T01:52:08.894 INFO:tasks.workunit.client.1.smithi092.stdout:4/517: mkdir d4/d5/d8/d99/daf 0 2024-09-17T01:52:08.896 INFO:tasks.workunit.client.1.smithi092.stdout:5/417: fsync d0/de/d19/d1a/d1e/f4e 0 2024-09-17T01:52:08.897 INFO:tasks.workunit.client.0.smithi031.stdout:7/612: dwrite db/fe [0,4194304] 0 2024-09-17T01:52:08.898 INFO:tasks.workunit.client.0.smithi031.stdout:0/627: rename d0/d37/dba to d0/d37/db9/dcf 0 2024-09-17T01:52:08.899 INFO:tasks.workunit.client.0.smithi031.stdout:1/640: dread d4/d1e/d5d/f8f [0,4194304] 0 2024-09-17T01:52:08.900 INFO:tasks.workunit.client.1.smithi092.stdout:9/443: write d0/d7/d12/d34/d26/d54/f4e [2364071,85257] 0 2024-09-17T01:52:08.901 INFO:tasks.workunit.client.1.smithi092.stdout:4/518: symlink d4/d5/lb0 0 2024-09-17T01:52:08.907 INFO:tasks.workunit.client.0.smithi031.stdout:1/641: rmdir d4/d1e/d3f/d72 39 2024-09-17T01:52:08.907 INFO:tasks.workunit.client.1.smithi092.stdout:9/444: rename d0/d7/d12/d34/c6e to d0/d7/d12/d34/d26/d54/d2e/c82 0 2024-09-17T01:52:08.908 INFO:tasks.workunit.client.1.smithi092.stdout:6/426: dread d3/d10/d1a/f24 [0,4194304] 0 2024-09-17T01:52:08.911 INFO:tasks.workunit.client.0.smithi031.stdout:7/613: truncate db/d18/f7f 104028 0 2024-09-17T01:52:08.912 INFO:tasks.workunit.client.1.smithi092.stdout:4/519: dread d4/d5/f15 [0,4194304] 0 2024-09-17T01:52:08.913 INFO:tasks.workunit.client.1.smithi092.stdout:4/520: chown d4/d13/d3b/d42/d76 61 1 2024-09-17T01:52:08.913 INFO:tasks.workunit.client.1.smithi092.stdout:9/445: link d0/f7d d0/d7/d12/d34/d26/d54/f83 0 2024-09-17T01:52:08.913 INFO:tasks.workunit.client.0.smithi031.stdout:1/642: mknod d4/d1e/d3f/d4d/cd7 0 2024-09-17T01:52:08.914 INFO:tasks.workunit.client.1.smithi092.stdout:6/427: mknod d3/d10/d1a/d43/d6a/d3d/d72/c84 0 2024-09-17T01:52:08.914 INFO:tasks.workunit.client.1.smithi092.stdout:9/446: write d0/d7/d12/d34/f3a [120808,96308] 0 2024-09-17T01:52:08.916 INFO:tasks.workunit.client.1.smithi092.stdout:4/521: creat d4/d5/d8/d99/fb1 x:0 0 0 2024-09-17T01:52:08.917 INFO:tasks.workunit.client.1.smithi092.stdout:9/447: write d0/d7/d12/d34/f72 [5134185,115594] 0 2024-09-17T01:52:08.918 INFO:tasks.workunit.client.1.smithi092.stdout:9/448: stat d0/d7/d12/d34/d26/d54/f24 0 2024-09-17T01:52:08.921 INFO:tasks.workunit.client.0.smithi031.stdout:7/614: dwrite db/d1c/d41/d6c/f6d [0,4194304] 0 2024-09-17T01:52:08.923 INFO:tasks.workunit.client.0.smithi031.stdout:1/643: dwrite d4/d3d/d65/d78/f90 [0,4194304] 0 2024-09-17T01:52:08.923 INFO:tasks.workunit.client.1.smithi092.stdout:9/449: rmdir d0/d5/d3e 39 2024-09-17T01:52:08.925 INFO:tasks.workunit.client.1.smithi092.stdout:9/450: dread - d0/d7/d12/d34/f7e zero size 2024-09-17T01:52:08.926 INFO:tasks.workunit.client.1.smithi092.stdout:6/428: creat d3/d10/d1f/d21/d28/d2b/f85 x:0 0 0 2024-09-17T01:52:08.929 INFO:tasks.workunit.client.0.smithi031.stdout:1/644: read d4/d1e/d3f/d72/d7e/d92/f94 [477652,106081] 0 2024-09-17T01:52:08.931 INFO:tasks.workunit.client.1.smithi092.stdout:4/522: creat d4/d5/fb2 x:0 0 0 2024-09-17T01:52:08.934 INFO:tasks.workunit.client.1.smithi092.stdout:6/429: creat d3/d10/d1a/d43/d5e/f86 x:0 0 0 2024-09-17T01:52:08.936 INFO:tasks.workunit.client.1.smithi092.stdout:9/451: creat d0/df/f84 x:0 0 0 2024-09-17T01:52:08.937 INFO:tasks.workunit.client.1.smithi092.stdout:4/523: symlink d4/d5/d1d/d30/d7a/lb3 0 2024-09-17T01:52:08.940 INFO:tasks.workunit.client.0.smithi031.stdout:6/700: sync 2024-09-17T01:52:08.940 INFO:tasks.workunit.client.1.smithi092.stdout:4/524: rmdir d4/d13/d20 39 2024-09-17T01:52:08.941 INFO:tasks.workunit.client.1.smithi092.stdout:4/525: fdatasync d4/d13/f2b 0 2024-09-17T01:52:08.941 INFO:tasks.workunit.client.0.smithi031.stdout:6/701: fsync d23/f39 0 2024-09-17T01:52:08.942 INFO:tasks.workunit.client.1.smithi092.stdout:6/430: mknod d3/d10/d1f/d21/d28/c87 0 2024-09-17T01:52:08.943 INFO:tasks.workunit.client.0.smithi031.stdout:6/702: rmdir d23/db4/d64/dc1 39 2024-09-17T01:52:08.944 INFO:tasks.workunit.client.0.smithi031.stdout:6/703: symlink d23/db4/d64/d67/de9/lf4 0 2024-09-17T01:52:08.945 INFO:tasks.workunit.client.0.smithi031.stdout:6/704: rmdir d23/db4/d6a 39 2024-09-17T01:52:08.947 INFO:tasks.workunit.client.0.smithi031.stdout:6/705: mknod d23/d63/d47/df0/cf5 0 2024-09-17T01:52:08.952 INFO:tasks.workunit.client.0.smithi031.stdout:6/706: dwrite d23/d63/d47/f83 [0,4194304] 0 2024-09-17T01:52:08.952 INFO:tasks.workunit.client.1.smithi092.stdout:4/526: dread d4/d13/d3b/d42/d76/f48 [0,4194304] 0 2024-09-17T01:52:08.956 INFO:tasks.workunit.client.0.smithi031.stdout:7/615: rename db/d18/f6a to db/d1c/fbe 0 2024-09-17T01:52:08.957 INFO:tasks.workunit.client.1.smithi092.stdout:6/431: dread d3/f5 [0,4194304] 0 2024-09-17T01:52:08.957 INFO:tasks.workunit.client.0.smithi031.stdout:7/616: fsync db/f10 0 2024-09-17T01:52:08.958 INFO:tasks.workunit.client.1.smithi092.stdout:4/527: write d4/d13/d3b/f78 [2773838,72941] 0 2024-09-17T01:52:08.958 INFO:tasks.workunit.client.0.smithi031.stdout:0/628: write d0/f68 [966876,31347] 0 2024-09-17T01:52:08.959 INFO:tasks.workunit.client.1.smithi092.stdout:4/528: chown d4/d5/f6a 178 1 2024-09-17T01:52:08.963 INFO:tasks.workunit.client.0.smithi031.stdout:0/629: truncate d0/f21 2103962 0 2024-09-17T01:52:08.964 INFO:tasks.workunit.client.0.smithi031.stdout:1/645: getdents d4/d1e/d3f/d4d 0 2024-09-17T01:52:08.965 INFO:tasks.workunit.client.1.smithi092.stdout:6/432: unlink d3/d10/d1a/d43/d5e/f86 0 2024-09-17T01:52:08.967 INFO:tasks.workunit.client.0.smithi031.stdout:7/617: dwrite db/d1c/d41/d9a/f9c [0,4194304] 0 2024-09-17T01:52:08.969 INFO:tasks.workunit.client.0.smithi031.stdout:0/630: write d0/d29/d33/d5/f62 [257999,23032] 0 2024-09-17T01:52:08.971 INFO:tasks.workunit.client.0.smithi031.stdout:2/632: dwrite d1/d3/df/d18/d40/db5/fd1 [0,4194304] 0 2024-09-17T01:52:08.971 INFO:tasks.workunit.client.0.smithi031.stdout:1/646: mkdir d4/d1a/d43/d53/dd3/dd8 0 2024-09-17T01:52:08.971 INFO:tasks.workunit.client.1.smithi092.stdout:6/433: write d3/f5 [3824951,55741] 0 2024-09-17T01:52:08.972 INFO:tasks.workunit.client.0.smithi031.stdout:0/631: chown d0/d29/d33/d2a/d25/da5/fc5 242721289 1 2024-09-17T01:52:08.974 INFO:tasks.workunit.client.1.smithi092.stdout:4/529: symlink d4/d5/d1d/dae/lb4 0 2024-09-17T01:52:08.974 INFO:tasks.workunit.client.0.smithi031.stdout:1/647: truncate d4/d1e/d3f/d4d/dcd/fca 612383 0 2024-09-17T01:52:08.975 INFO:tasks.workunit.client.0.smithi031.stdout:1/648: read - d4/d3d/d65/d78/f80 zero size 2024-09-17T01:52:08.975 INFO:tasks.workunit.client.0.smithi031.stdout:2/633: unlink d1/d3/d2d/db2/d1e/d21/l3d 0 2024-09-17T01:52:08.976 INFO:tasks.workunit.client.1.smithi092.stdout:9/452: truncate d0/d7/d12/d34/d26/d54/f24 3551931 0 2024-09-17T01:52:08.976 INFO:tasks.workunit.client.0.smithi031.stdout:2/634: chown d1/d3/df/d11/f2f 146255181 1 2024-09-17T01:52:08.978 INFO:tasks.workunit.client.0.smithi031.stdout:0/632: mkdir d0/d29/d33/d5/d50/dac/dd0 0 2024-09-17T01:52:08.978 INFO:tasks.workunit.client.1.smithi092.stdout:9/453: truncate d0/d7/d21/f50 678057 0 2024-09-17T01:52:08.980 INFO:tasks.workunit.client.0.smithi031.stdout:1/649: creat d4/d1e/d3f/d72/d7e/fd9 x:0 0 0 2024-09-17T01:52:08.983 INFO:tasks.workunit.client.0.smithi031.stdout:6/707: write d23/f42 [1159070,75615] 0 2024-09-17T01:52:08.985 INFO:tasks.workunit.client.1.smithi092.stdout:9/454: rename d0/c14 to d0/d7/d12/d34/d26/d54/c85 0 2024-09-17T01:52:08.987 INFO:tasks.workunit.client.0.smithi031.stdout:8/527: sync 2024-09-17T01:52:08.987 INFO:tasks.workunit.client.0.smithi031.stdout:4/816: sync 2024-09-17T01:52:08.988 INFO:tasks.workunit.client.0.smithi031.stdout:0/633: dwrite d0/d29/d33/d2a/d25/d38/fbf [0,4194304] 0 2024-09-17T01:52:08.989 INFO:tasks.workunit.client.1.smithi092.stdout:9/455: rename d0/df/d17/d65 to d0/d7/d12/d86 0 2024-09-17T01:52:08.991 INFO:tasks.workunit.client.1.smithi092.stdout:9/456: chown d0/d7/d21/c71 1717059804 1 2024-09-17T01:52:08.993 INFO:tasks.workunit.client.0.smithi031.stdout:2/635: truncate d1/d3/d2d/db2/d1e/d2a/f95 3089583 0 2024-09-17T01:52:08.995 INFO:tasks.workunit.client.1.smithi092.stdout:9/457: creat d0/d7/d12/d34/d26/d54/f87 x:0 0 0 2024-09-17T01:52:08.996 INFO:tasks.workunit.client.1.smithi092.stdout:9/458: write d0/df/f66 [217570,43881] 0 2024-09-17T01:52:08.997 INFO:tasks.workunit.client.1.smithi092.stdout:9/459: stat d0/df/d5d 0 2024-09-17T01:52:08.997 INFO:tasks.workunit.client.0.smithi031.stdout:6/708: rmdir d23/db4/d6a/d72 39 2024-09-17T01:52:08.998 INFO:tasks.workunit.client.1.smithi092.stdout:4/530: truncate d4/d13/d3b/d42/d76/d35/d3e/d7c/f89 397310 0 2024-09-17T01:52:08.998 INFO:tasks.workunit.client.1.smithi092.stdout:9/460: chown d0/df/d17/f2f 0 1 2024-09-17T01:52:08.998 INFO:tasks.workunit.client.0.smithi031.stdout:8/528: symlink d0/df/dd/d59/d8d/l9a 0 2024-09-17T01:52:09.002 INFO:tasks.workunit.client.1.smithi092.stdout:4/531: link d4/l73 d4/d5/d8/d99/lb5 0 2024-09-17T01:52:09.003 INFO:tasks.workunit.client.1.smithi092.stdout:4/532: dread - d4/d5/d1d/d30/d7a/fab zero size 2024-09-17T01:52:09.004 INFO:tasks.workunit.client.0.smithi031.stdout:2/636: rename d1/fd7 to d1/d3/d2d/db2/d1e/d21/d34/fda 0 2024-09-17T01:52:09.005 INFO:tasks.workunit.client.0.smithi031.stdout:7/618: dread db/d18/f25 [0,4194304] 0 2024-09-17T01:52:09.005 INFO:tasks.workunit.client.0.smithi031.stdout:0/634: mkdir d0/d29/d33/d2a/d25/d38/dd1 0 2024-09-17T01:52:09.006 INFO:tasks.workunit.client.1.smithi092.stdout:4/533: creat d4/d13/fb6 x:0 0 0 2024-09-17T01:52:09.006 INFO:tasks.workunit.client.0.smithi031.stdout:0/635: readlink d0/d29/d33/l46 0 2024-09-17T01:52:09.007 INFO:tasks.workunit.client.0.smithi031.stdout:1/650: write d4/d1e/f47 [1671719,54331] 0 2024-09-17T01:52:09.007 INFO:tasks.workunit.client.0.smithi031.stdout:6/709: truncate d23/db4/f58 1033353 0 2024-09-17T01:52:09.008 INFO:tasks.workunit.client.1.smithi092.stdout:4/534: symlink d4/d13/d3b/d42/d76/d35/lb7 0 2024-09-17T01:52:09.008 INFO:tasks.workunit.client.0.smithi031.stdout:6/710: chown d23/d63 245949 1 2024-09-17T01:52:09.009 INFO:tasks.workunit.client.1.smithi092.stdout:4/535: rmdir d4/d13/d3b/d42/d76/d41 39 2024-09-17T01:52:09.010 INFO:tasks.workunit.client.0.smithi031.stdout:2/637: creat d1/d3/d45/d4a/d96/fdb x:0 0 0 2024-09-17T01:52:09.011 INFO:tasks.workunit.client.1.smithi092.stdout:4/536: mknod d4/d5/d1d/d30/d3f/cb8 0 2024-09-17T01:52:09.012 INFO:tasks.workunit.client.1.smithi092.stdout:9/461: dread d0/df/f66 [0,4194304] 0 2024-09-17T01:52:09.012 INFO:tasks.workunit.client.0.smithi031.stdout:0/636: mknod d0/d29/d33/d5/d48/d56/dc8/cd2 0 2024-09-17T01:52:09.014 INFO:tasks.workunit.client.0.smithi031.stdout:6/711: mkdir d23/db4/d8a/dd5/ddd/df6 0 2024-09-17T01:52:09.014 INFO:tasks.workunit.client.1.smithi092.stdout:9/462: creat d0/d7/d12/f88 x:0 0 0 2024-09-17T01:52:09.015 INFO:tasks.workunit.client.1.smithi092.stdout:4/537: creat d4/d5/fb9 x:0 0 0 2024-09-17T01:52:09.016 INFO:tasks.workunit.client.0.smithi031.stdout:4/817: getdents d8/d3a/d41/d64/d4d/d5a/d8c/d25/d36 0 2024-09-17T01:52:09.017 INFO:tasks.workunit.client.1.smithi092.stdout:9/463: mknod d0/df/d5d/c89 0 2024-09-17T01:52:09.017 INFO:tasks.workunit.client.1.smithi092.stdout:9/464: write d0/d7/d12/f88 [785347,33036] 0 2024-09-17T01:52:09.018 INFO:tasks.workunit.client.1.smithi092.stdout:4/538: chown d4/d13/d3b/d42/d76/d41/l9d 121762 1 2024-09-17T01:52:09.020 INFO:tasks.workunit.client.1.smithi092.stdout:9/465: write d0/df/f66 [687325,130780] 0 2024-09-17T01:52:09.020 INFO:tasks.workunit.client.1.smithi092.stdout:4/539: mknod d4/d7b/cba 0 2024-09-17T01:52:09.021 INFO:tasks.workunit.client.0.smithi031.stdout:8/529: rename d0/d5/d6c/d6d/d94 to d0/d5/d9b 0 2024-09-17T01:52:09.022 INFO:tasks.workunit.client.0.smithi031.stdout:8/530: write d0/df/dd/f45 [2218953,62776] 0 2024-09-17T01:52:09.022 INFO:tasks.workunit.client.1.smithi092.stdout:4/540: rmdir d4/d13/d3b/d42/d76/d41/d67 39 2024-09-17T01:52:09.024 INFO:tasks.workunit.client.0.smithi031.stdout:0/637: mknod d0/d29/d33/d5/d48/d8c/cd3 0 2024-09-17T01:52:09.025 INFO:tasks.workunit.client.1.smithi092.stdout:9/466: rename d0/d7/l6d to d0/d7/d12/d34/d26/d54/l8a 0 2024-09-17T01:52:09.026 INFO:tasks.workunit.client.0.smithi031.stdout:6/712: fdatasync f1c 0 2024-09-17T01:52:09.027 INFO:tasks.workunit.client.0.smithi031.stdout:4/818: readlink d8/l72 0 2024-09-17T01:52:09.030 INFO:tasks.workunit.client.0.smithi031.stdout:7/619: dread db/d1c/d41/f44 [0,4194304] 0 2024-09-17T01:52:09.031 INFO:tasks.workunit.client.1.smithi092.stdout:4/541: creat d4/d13/d3b/d42/d76/fbb x:0 0 0 2024-09-17T01:52:09.033 INFO:tasks.workunit.client.0.smithi031.stdout:8/531: unlink d0/df/dd/d77/d78/c89 0 2024-09-17T01:52:09.033 INFO:tasks.workunit.client.0.smithi031.stdout:1/651: dwrite d4/d1e/d40/f54 [0,4194304] 0 2024-09-17T01:52:09.035 INFO:tasks.workunit.client.0.smithi031.stdout:2/638: link d1/d3/d2d/db2/d1e/d21/c27 d1/d3/d45/d4a/d96/cdc 0 2024-09-17T01:52:09.036 INFO:tasks.workunit.client.1.smithi092.stdout:4/542: rename d4/d5/fb2 to d4/d13/d3b/d42/d76/d35/d3e/d7c/fbc 0 2024-09-17T01:52:09.038 INFO:tasks.workunit.client.0.smithi031.stdout:2/639: chown d1/d3/df/d66/cb4 223331 1 2024-09-17T01:52:09.039 INFO:tasks.workunit.client.0.smithi031.stdout:4/819: mknod d8/d3a/d41/d64/d4d/d8f/c107 0 2024-09-17T01:52:09.040 INFO:tasks.workunit.client.0.smithi031.stdout:7/620: dwrite db/d1c/d8e/da7/f8d [0,4194304] 0 2024-09-17T01:52:09.040 INFO:tasks.workunit.client.1.smithi092.stdout:9/467: write d0/d7/d12/d34/d26/d54/f83 [610742,66488] 0 2024-09-17T01:52:09.045 INFO:tasks.workunit.client.1.smithi092.stdout:4/543: dwrite d4/d13/d3b/d42/d76/d35/d3e/f43 [0,4194304] 0 2024-09-17T01:52:09.046 INFO:tasks.workunit.client.1.smithi092.stdout:9/468: creat d0/d7/d12/d34/d26/d54/f8b x:0 0 0 2024-09-17T01:52:09.046 INFO:tasks.workunit.client.1.smithi092.stdout:4/544: stat d4/d5/d46/f65 0 2024-09-17T01:52:09.050 INFO:tasks.workunit.client.1.smithi092.stdout:9/469: mknod d0/d5/c8c 0 2024-09-17T01:52:09.051 INFO:tasks.workunit.client.0.smithi031.stdout:2/640: mkdir d1/d3/df/d11/d30/ddd 0 2024-09-17T01:52:09.051 INFO:tasks.workunit.client.0.smithi031.stdout:4/820: mkdir d8/d3a/d41/d64/d4d/dae/d108 0 2024-09-17T01:52:09.051 INFO:tasks.workunit.client.1.smithi092.stdout:4/545: mkdir d4/dbd 0 2024-09-17T01:52:09.052 INFO:tasks.workunit.client.0.smithi031.stdout:2/641: write d1/d3/d2d/db2/d1e/d21/fd5 [551199,6695] 0 2024-09-17T01:52:09.054 INFO:tasks.workunit.client.0.smithi031.stdout:2/642: write d1/d3/faf [1652558,23222] 0 2024-09-17T01:52:09.054 INFO:tasks.workunit.client.1.smithi092.stdout:9/470: chown d0/d7/d12/d34/d26/d54/c85 1422844390 1 2024-09-17T01:52:09.056 INFO:tasks.workunit.client.1.smithi092.stdout:9/471: fsync d0/d5/d29/f55 0 2024-09-17T01:52:09.057 INFO:tasks.workunit.client.0.smithi031.stdout:2/643: truncate d1/d3/d2d/db2/d1e/d21/d34/fab 73189 0 2024-09-17T01:52:09.060 INFO:tasks.workunit.client.1.smithi092.stdout:4/546: dwrite d4/d5/d1d/d30/d3f/d4b/f81 [0,4194304] 0 2024-09-17T01:52:09.061 INFO:tasks.workunit.client.1.smithi092.stdout:4/547: chown d4/d13/d3b/c85 0 1 2024-09-17T01:52:09.062 INFO:tasks.workunit.client.1.smithi092.stdout:4/548: stat d4/d5/lb0 0 2024-09-17T01:52:09.063 INFO:tasks.workunit.client.1.smithi092.stdout:9/472: link d0/d7/d12/d34/f7e d0/d7/d12/d34/d26/d54/d2e/f8d 0 2024-09-17T01:52:09.064 INFO:tasks.workunit.client.0.smithi031.stdout:8/532: write d0/f99 [4552176,21366] 0 2024-09-17T01:52:09.066 INFO:tasks.workunit.client.0.smithi031.stdout:1/652: write d4/d3d/d65/f75 [4829793,70143] 0 2024-09-17T01:52:09.066 INFO:tasks.workunit.client.1.smithi092.stdout:9/473: creat d0/d7c/f8e x:0 0 0 2024-09-17T01:52:09.068 INFO:tasks.workunit.client.0.smithi031.stdout:1/653: write d4/d1e/d3f/d72/fc7 [473874,128585] 0 2024-09-17T01:52:09.069 INFO:tasks.workunit.client.1.smithi092.stdout:9/474: creat d0/d7/d12/f8f x:0 0 0 2024-09-17T01:52:09.069 INFO:tasks.workunit.client.1.smithi092.stdout:9/475: fsync d0/d7/f36 0 2024-09-17T01:52:09.069 INFO:tasks.workunit.client.0.smithi031.stdout:6/713: truncate d23/db4/d6a/d91/fb6 1651803 0 2024-09-17T01:52:09.071 INFO:tasks.workunit.client.1.smithi092.stdout:9/476: truncate d0/d7/d12/d34/d26/d54/f87 805988 0 2024-09-17T01:52:09.076 INFO:tasks.workunit.client.0.smithi031.stdout:7/621: write db/f1a [1218674,53775] 0 2024-09-17T01:52:09.076 INFO:tasks.workunit.client.0.smithi031.stdout:6/714: read d23/d63/f56 [1848925,89987] 0 2024-09-17T01:52:09.076 INFO:tasks.workunit.client.1.smithi092.stdout:8/384: sync 2024-09-17T01:52:09.078 INFO:tasks.workunit.client.1.smithi092.stdout:8/385: chown d15/l20 136306 1 2024-09-17T01:52:09.079 INFO:tasks.workunit.client.0.smithi031.stdout:2/644: mknod d1/d4c/cde 0 2024-09-17T01:52:09.079 INFO:tasks.workunit.client.1.smithi092.stdout:8/386: readlink d15/l70 0 2024-09-17T01:52:09.079 INFO:tasks.workunit.client.0.smithi031.stdout:8/533: mkdir d0/df/dd/d9c 0 2024-09-17T01:52:09.080 INFO:tasks.workunit.client.0.smithi031.stdout:8/534: readlink d0/l76 0 2024-09-17T01:52:09.081 INFO:tasks.workunit.client.1.smithi092.stdout:4/549: dwrite d4/d5/f15 [0,4194304] 0 2024-09-17T01:52:09.081 INFO:tasks.workunit.client.0.smithi031.stdout:1/654: creat d4/d3d/d65/d78/fda x:0 0 0 2024-09-17T01:52:09.081 INFO:tasks.workunit.client.1.smithi092.stdout:8/387: mkdir d15/d32/d3b/d78 0 2024-09-17T01:52:09.088 INFO:tasks.workunit.client.0.smithi031.stdout:2/645: truncate d1/d3/df/d11/d30/f6e 733821 0 2024-09-17T01:52:09.089 INFO:tasks.workunit.client.1.smithi092.stdout:8/388: dwrite d15/d25/d27/f3e [0,4194304] 0 2024-09-17T01:52:09.090 INFO:tasks.workunit.client.0.smithi031.stdout:2/646: fdatasync d1/d3/df/d11/f2f 0 2024-09-17T01:52:09.093 INFO:tasks.workunit.client.1.smithi092.stdout:8/389: creat d15/d32/d3b/f79 x:0 0 0 2024-09-17T01:52:09.093 INFO:tasks.workunit.client.0.smithi031.stdout:1/655: rename d4/d3d/d65/db7/dd0 to d4/d1e/d40/ddb 0 2024-09-17T01:52:09.097 INFO:tasks.workunit.client.0.smithi031.stdout:7/622: mkdir db/d1c/d46/db9/dbf 0 2024-09-17T01:52:09.098 INFO:tasks.workunit.client.0.smithi031.stdout:2/647: dwrite d1/d3/df/d11/f2f [0,4194304] 0 2024-09-17T01:52:09.099 INFO:tasks.workunit.client.1.smithi092.stdout:8/390: dwrite fa [0,4194304] 0 2024-09-17T01:52:09.099 INFO:tasks.workunit.client.0.smithi031.stdout:7/623: write db/d1c/f71 [1103386,34436] 0 2024-09-17T01:52:09.099 INFO:tasks.workunit.client.0.smithi031.stdout:2/648: truncate d1/f8f 4683674 0 2024-09-17T01:52:09.100 INFO:tasks.workunit.client.0.smithi031.stdout:8/535: mknod d0/df/dd/d77/c9d 0 2024-09-17T01:52:09.104 INFO:tasks.workunit.client.0.smithi031.stdout:1/656: creat d4/d1e/d40/d84/fdc x:0 0 0 2024-09-17T01:52:09.105 INFO:tasks.workunit.client.1.smithi092.stdout:4/550: dread d4/d13/d3b/f6d [0,4194304] 0 2024-09-17T01:52:09.106 INFO:tasks.workunit.client.0.smithi031.stdout:1/657: read d4/d1e/d3f/d4d/dcd/fca [306200,96467] 0 2024-09-17T01:52:09.107 INFO:tasks.workunit.client.1.smithi092.stdout:4/551: write d4/d13/d3b/f82 [2627459,64180] 0 2024-09-17T01:52:09.107 INFO:tasks.workunit.client.0.smithi031.stdout:7/624: write db/d29/f5d [2087985,78444] 0 2024-09-17T01:52:09.109 INFO:tasks.workunit.client.0.smithi031.stdout:1/658: fsync d4/d1a/d2d/d18/f2e 0 2024-09-17T01:52:09.110 INFO:tasks.workunit.client.0.smithi031.stdout:8/536: creat d0/d5/d9b/f9e x:0 0 0 2024-09-17T01:52:09.110 INFO:tasks.workunit.client.1.smithi092.stdout:4/552: mknod d4/d5/d1d/d30/cbe 0 2024-09-17T01:52:09.112 INFO:tasks.workunit.client.1.smithi092.stdout:4/553: stat d4/d13/d3b/d42/d76/d35/d3e/d7c/f89 0 2024-09-17T01:52:09.116 INFO:tasks.workunit.client.0.smithi031.stdout:8/537: creat d0/d5/d6c/d6d/f9f x:0 0 0 2024-09-17T01:52:09.117 INFO:tasks.workunit.client.1.smithi092.stdout:4/554: dread d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a [0,4194304] 0 2024-09-17T01:52:09.119 INFO:tasks.workunit.client.0.smithi031.stdout:7/625: dwrite db/d1c/fa2 [0,4194304] 0 2024-09-17T01:52:09.124 INFO:tasks.workunit.client.0.smithi031.stdout:1/659: creat d4/d1e/d3f/d4d/da5/dbc/fdd x:0 0 0 2024-09-17T01:52:09.125 INFO:tasks.workunit.client.1.smithi092.stdout:4/555: dwrite d4/d13/d3b/f78 [4194304,4194304] 0 2024-09-17T01:52:09.125 INFO:tasks.workunit.client.0.smithi031.stdout:1/660: chown d4/d1e/f49 14477221 1 2024-09-17T01:52:09.126 INFO:tasks.workunit.client.0.smithi031.stdout:7/626: dwrite db/f3a [0,4194304] 0 2024-09-17T01:52:09.126 INFO:tasks.workunit.client.0.smithi031.stdout:2/649: rename d1/d4c to d1/d3/d2d/db2/d1e/d21/ddf 0 2024-09-17T01:52:09.129 INFO:tasks.workunit.client.1.smithi092.stdout:4/556: readlink d4/d13/d20/l71 0 2024-09-17T01:52:09.130 INFO:tasks.workunit.client.0.smithi031.stdout:2/650: creat d1/d3/d2d/db2/fe0 x:0 0 0 2024-09-17T01:52:09.133 INFO:tasks.workunit.client.0.smithi031.stdout:2/651: chown d1/d3/df/d11/d30/l3a 10388594 1 2024-09-17T01:52:09.135 INFO:tasks.workunit.client.0.smithi031.stdout:4/821: truncate d8/d3a/d41/d64/d4f/fe5 269952 0 2024-09-17T01:52:09.136 INFO:tasks.workunit.client.0.smithi031.stdout:8/538: link d0/df/dd/c44 d0/df/ca0 0 2024-09-17T01:52:09.137 INFO:tasks.workunit.client.0.smithi031.stdout:7/627: dwrite db/d1c/d41/d6c/fb0 [0,4194304] 0 2024-09-17T01:52:09.138 INFO:tasks.workunit.client.1.smithi092.stdout:8/391: dread f1 [0,4194304] 0 2024-09-17T01:52:09.139 INFO:tasks.workunit.client.0.smithi031.stdout:2/652: creat d1/d3/d2d/d91/dad/fe1 x:0 0 0 2024-09-17T01:52:09.139 INFO:tasks.workunit.client.1.smithi092.stdout:8/392: write d15/d32/d40/d42/f5f [4995773,28283] 0 2024-09-17T01:52:09.142 INFO:tasks.workunit.client.1.smithi092.stdout:8/393: creat d15/d32/f7a x:0 0 0 2024-09-17T01:52:09.142 INFO:tasks.workunit.client.0.smithi031.stdout:4/822: truncate d8/f98 513045 0 2024-09-17T01:52:09.144 INFO:tasks.workunit.client.1.smithi092.stdout:8/394: creat d15/d32/d40/f7b x:0 0 0 2024-09-17T01:52:09.145 INFO:tasks.workunit.client.0.smithi031.stdout:2/653: creat d1/d3/df/d18/fe2 x:0 0 0 2024-09-17T01:52:09.145 INFO:tasks.workunit.client.1.smithi092.stdout:8/395: read f1 [3918904,42021] 0 2024-09-17T01:52:09.145 INFO:tasks.workunit.client.1.smithi092.stdout:8/396: stat d15/d25/d2b/d63 0 2024-09-17T01:52:09.146 INFO:tasks.workunit.client.0.smithi031.stdout:7/628: creat db/d1c/d41/d69/fc0 x:0 0 0 2024-09-17T01:52:09.149 INFO:tasks.workunit.client.0.smithi031.stdout:2/654: rmdir d1/d3/d2d/db2/d1e/d21/d98 39 2024-09-17T01:52:09.150 INFO:tasks.workunit.client.0.smithi031.stdout:7/629: mkdir db/d1c/d46/db9/dc1 0 2024-09-17T01:52:09.151 INFO:tasks.workunit.client.1.smithi092.stdout:8/397: dwrite d15/d32/d40/f7b [0,4194304] 0 2024-09-17T01:52:09.151 INFO:tasks.workunit.client.0.smithi031.stdout:7/630: fdatasync db/d1c/d46/f8a 0 2024-09-17T01:52:09.152 INFO:tasks.workunit.client.1.smithi092.stdout:8/398: rmdir d15/d25/d2b 39 2024-09-17T01:52:09.152 INFO:tasks.workunit.client.0.smithi031.stdout:7/631: write db/d1c/f5c [2384142,27165] 0 2024-09-17T01:52:09.154 INFO:tasks.workunit.client.1.smithi092.stdout:8/399: write d15/d32/d40/d42/f5f [3730674,112556] 0 2024-09-17T01:52:09.154 INFO:tasks.workunit.client.1.smithi092.stdout:8/400: fdatasync d15/d25/d27/f41 0 2024-09-17T01:52:09.156 INFO:tasks.workunit.client.1.smithi092.stdout:8/401: rmdir d15/d25 39 2024-09-17T01:52:09.157 INFO:tasks.workunit.client.0.smithi031.stdout:7/632: creat db/d1c/d41/d69/fc2 x:0 0 0 2024-09-17T01:52:09.157 INFO:tasks.workunit.client.0.smithi031.stdout:6/715: write d23/db4/d6a/d70/f88 [198052,16134] 0 2024-09-17T01:52:09.161 INFO:tasks.workunit.client.1.smithi092.stdout:8/402: unlink d15/d32/d40/d42/d43/c51 0 2024-09-17T01:52:09.162 INFO:tasks.workunit.client.0.smithi031.stdout:6/716: symlink d23/db4/d64/dc1/lf7 0 2024-09-17T01:52:09.163 INFO:tasks.workunit.client.0.smithi031.stdout:6/717: dread - d23/db4/d64/dc1/fde zero size 2024-09-17T01:52:09.163 INFO:tasks.workunit.client.1.smithi092.stdout:8/403: mkdir d15/d32/d3b/d78/d7c 0 2024-09-17T01:52:09.164 INFO:tasks.workunit.client.1.smithi092.stdout:4/557: write d4/d13/d3b/d42/d76/d35/f7f [1785595,41562] 0 2024-09-17T01:52:09.165 INFO:tasks.workunit.client.0.smithi031.stdout:6/718: mknod d23/d63/cf8 0 2024-09-17T01:52:09.166 INFO:tasks.workunit.client.1.smithi092.stdout:4/558: creat d4/d7b/d7d/fbf x:0 0 0 2024-09-17T01:52:09.166 INFO:tasks.workunit.client.1.smithi092.stdout:4/559: chown d4/d13/f17 720005 1 2024-09-17T01:52:09.168 INFO:tasks.workunit.client.0.smithi031.stdout:6/719: read d23/db4/d6a/d70/f7f [51707,120529] 0 2024-09-17T01:52:09.168 INFO:tasks.workunit.client.1.smithi092.stdout:4/560: truncate d4/d5/d8/f68 4746333 0 2024-09-17T01:52:09.169 INFO:tasks.workunit.client.0.smithi031.stdout:6/720: read - d23/db4/d64/dc1/fde zero size 2024-09-17T01:52:09.169 INFO:tasks.workunit.client.0.smithi031.stdout:6/721: readlink d23/db4/l87 0 2024-09-17T01:52:09.170 INFO:tasks.workunit.client.1.smithi092.stdout:4/561: mknod d4/d13/d3b/d42/d76/cc0 0 2024-09-17T01:52:09.173 INFO:tasks.workunit.client.1.smithi092.stdout:4/562: creat d4/d5/fc1 x:0 0 0 2024-09-17T01:52:09.176 INFO:tasks.workunit.client.0.smithi031.stdout:4/823: write d8/fb [3589507,9432] 0 2024-09-17T01:52:09.178 INFO:tasks.workunit.client.0.smithi031.stdout:2/655: write d1/d3/df/d18/f3b [628081,49425] 0 2024-09-17T01:52:09.181 INFO:tasks.workunit.client.0.smithi031.stdout:2/656: stat d1/d3/d2d/db2/d1e/f97 0 2024-09-17T01:52:09.181 INFO:tasks.workunit.client.0.smithi031.stdout:6/722: write d23/f39 [5369966,33686] 0 2024-09-17T01:52:09.182 INFO:tasks.workunit.client.0.smithi031.stdout:8/539: dread d0/f52 [0,4194304] 0 2024-09-17T01:52:09.184 INFO:tasks.workunit.client.1.smithi092.stdout:4/563: dwrite d4/d13/f8f [0,4194304] 0 2024-09-17T01:52:09.185 INFO:tasks.workunit.client.0.smithi031.stdout:4/824: link d8/c31 d8/d3a/d41/d64/d4d/d75/c109 0 2024-09-17T01:52:09.186 INFO:tasks.workunit.client.1.smithi092.stdout:4/564: write d4/d7b/d7d/f93 [351656,31991] 0 2024-09-17T01:52:09.187 INFO:tasks.workunit.client.1.smithi092.stdout:4/565: chown d4/d5/c7 25186 1 2024-09-17T01:52:09.187 INFO:tasks.workunit.client.0.smithi031.stdout:7/633: dwrite db/d1c/f21 [0,4194304] 0 2024-09-17T01:52:09.187 INFO:tasks.workunit.client.0.smithi031.stdout:6/723: rename l2 to d23/d63/d47/df0/lf9 0 2024-09-17T01:52:09.190 INFO:tasks.workunit.client.0.smithi031.stdout:3/577: sync 2024-09-17T01:52:09.190 INFO:tasks.workunit.client.0.smithi031.stdout:5/484: sync 2024-09-17T01:52:09.191 INFO:tasks.workunit.client.0.smithi031.stdout:9/495: sync 2024-09-17T01:52:09.193 INFO:tasks.workunit.client.0.smithi031.stdout:7/634: chown db/d18/d67 263296 1 2024-09-17T01:52:09.194 INFO:tasks.workunit.client.1.smithi092.stdout:4/566: dwrite d4/d5/fa2 [0,4194304] 0 2024-09-17T01:52:09.195 INFO:tasks.workunit.client.1.smithi092.stdout:4/567: chown d4/d7b/d7d/f93 13 1 2024-09-17T01:52:09.195 INFO:tasks.workunit.client.0.smithi031.stdout:3/578: chown db/df/d1d/d37/d4a/f43 1732 1 2024-09-17T01:52:09.196 INFO:tasks.workunit.client.0.smithi031.stdout:6/724: chown d23/db4/d64/d67/ca6 1018104 1 2024-09-17T01:52:09.196 INFO:tasks.workunit.client.0.smithi031.stdout:9/496: chown d3/d10/d36/d8f 249516 1 2024-09-17T01:52:09.198 INFO:tasks.workunit.client.0.smithi031.stdout:6/725: fdatasync d23/db4/d8a/fcc 0 2024-09-17T01:52:09.199 INFO:tasks.workunit.client.1.smithi092.stdout:4/568: mknod d4/d5/d8/d99/daf/cc2 0 2024-09-17T01:52:09.200 INFO:tasks.workunit.client.0.smithi031.stdout:2/657: dwrite d1/d3/df/d11/f2f [0,4194304] 0 2024-09-17T01:52:09.202 INFO:tasks.workunit.client.1.smithi092.stdout:4/569: rmdir d4/d5/d1d/d30/d3f 39 2024-09-17T01:52:09.205 INFO:tasks.workunit.client.0.smithi031.stdout:7/635: dread db/d1c/d41/d6c/f9d [0,4194304] 0 2024-09-17T01:52:09.205 INFO:tasks.workunit.client.0.smithi031.stdout:4/825: rename d8/d3a/d41 to d8/d3a/d10a 0 2024-09-17T01:52:09.206 INFO:tasks.workunit.client.1.smithi092.stdout:4/570: mkdir d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3 0 2024-09-17T01:52:09.209 INFO:tasks.workunit.client.1.smithi092.stdout:4/571: creat d4/d5/fc4 x:0 0 0 2024-09-17T01:52:09.211 INFO:tasks.workunit.client.0.smithi031.stdout:2/658: mkdir d1/d3/df/d11/d30/ddd/de3 0 2024-09-17T01:52:09.212 INFO:tasks.workunit.client.1.smithi092.stdout:4/572: mknod d4/d5/d1d/d30/d3f/d4b/cc5 0 2024-09-17T01:52:09.213 INFO:tasks.workunit.client.0.smithi031.stdout:9/497: truncate d3/d4/f27 2077136 0 2024-09-17T01:52:09.216 INFO:tasks.workunit.client.0.smithi031.stdout:8/540: dread d0/df/f2b [0,4194304] 0 2024-09-17T01:52:09.216 INFO:tasks.workunit.client.0.smithi031.stdout:7/636: creat db/d1c/d99/fc3 x:0 0 0 2024-09-17T01:52:09.218 INFO:tasks.workunit.client.0.smithi031.stdout:5/485: dwrite da/d42/d26/fa6 [0,4194304] 0 2024-09-17T01:52:09.225 INFO:tasks.workunit.client.0.smithi031.stdout:4/826: dread d8/fad [0,4194304] 0 2024-09-17T01:52:09.226 INFO:tasks.workunit.client.0.smithi031.stdout:6/726: dwrite d23/db4/d64/dc1/fde [0,4194304] 0 2024-09-17T01:52:09.227 INFO:tasks.workunit.client.0.smithi031.stdout:5/486: unlink da/l5b 0 2024-09-17T01:52:09.228 INFO:tasks.workunit.client.0.smithi031.stdout:3/579: dwrite db/f5f [0,4194304] 0 2024-09-17T01:52:09.231 INFO:tasks.workunit.client.0.smithi031.stdout:2/659: dread d1/d3/faf [0,4194304] 0 2024-09-17T01:52:09.237 INFO:tasks.workunit.client.0.smithi031.stdout:3/580: chown db/c2d 12927 1 2024-09-17T01:52:09.240 INFO:tasks.workunit.client.0.smithi031.stdout:5/487: creat da/dc/d2e/d82/d92/fa8 x:0 0 0 2024-09-17T01:52:09.241 INFO:tasks.workunit.client.1.smithi092.stdout:4/573: dread d4/d5/d1d/f1a [0,4194304] 0 2024-09-17T01:52:09.241 INFO:tasks.workunit.client.0.smithi031.stdout:5/488: chown da/d42/f5c 0 1 2024-09-17T01:52:09.243 INFO:tasks.workunit.client.0.smithi031.stdout:2/660: creat d1/d3/d2d/d91/dad/fe4 x:0 0 0 2024-09-17T01:52:09.254 INFO:tasks.workunit.client.0.smithi031.stdout:9/498: link d3/d19/d1f/l3c d3/d10/l9f 0 2024-09-17T01:52:09.260 INFO:tasks.workunit.client.0.smithi031.stdout:5/489: creat da/fa9 x:0 0 0 2024-09-17T01:52:09.260 INFO:tasks.workunit.client.0.smithi031.stdout:3/581: dwrite db/f1f [0,4194304] 0 2024-09-17T01:52:09.263 INFO:tasks.workunit.client.0.smithi031.stdout:4/827: dwrite d8/f27 [0,4194304] 0 2024-09-17T01:52:09.265 INFO:tasks.workunit.client.0.smithi031.stdout:2/661: getdents d1/d3/df/d11 0 2024-09-17T01:52:09.267 INFO:tasks.workunit.client.0.smithi031.stdout:6/727: dwrite d23/d63/f59 [0,4194304] 0 2024-09-17T01:52:09.268 INFO:tasks.workunit.client.0.smithi031.stdout:8/541: dread d0/d5/d54/f84 [0,4194304] 0 2024-09-17T01:52:09.272 INFO:tasks.workunit.client.0.smithi031.stdout:5/490: creat da/d42/d12/d4a/faa x:0 0 0 2024-09-17T01:52:09.280 INFO:tasks.workunit.client.0.smithi031.stdout:8/542: mknod d0/df/ca1 0 2024-09-17T01:52:09.281 INFO:tasks.workunit.client.0.smithi031.stdout:3/582: dwrite db/df/d1d/d37/da1/fa2 [0,4194304] 0 2024-09-17T01:52:09.281 INFO:tasks.workunit.client.0.smithi031.stdout:6/728: dread d23/db4/d6a/d70/f88 [0,4194304] 0 2024-09-17T01:52:09.282 INFO:tasks.workunit.client.0.smithi031.stdout:9/499: rename d3/d10 to d3/d4/da0 0 2024-09-17T01:52:09.284 INFO:tasks.workunit.client.0.smithi031.stdout:2/662: unlink d1/d3/df/d18/d40/d43/f79 0 2024-09-17T01:52:09.286 INFO:tasks.workunit.client.1.smithi092.stdout:4/574: dread d4/d5/d1d/d30/f64 [0,4194304] 0 2024-09-17T01:52:09.287 INFO:tasks.workunit.client.0.smithi031.stdout:5/491: symlink da/d42/lab 0 2024-09-17T01:52:09.290 INFO:tasks.workunit.client.0.smithi031.stdout:3/583: dwrite db/d29/fab [0,4194304] 0 2024-09-17T01:52:09.294 INFO:tasks.workunit.client.1.smithi092.stdout:4/575: dwrite d4/d5/d1d/d30/f9a [0,4194304] 0 2024-09-17T01:52:09.295 INFO:tasks.workunit.client.0.smithi031.stdout:9/500: chown d3/d4/f27 641186 1 2024-09-17T01:52:09.295 INFO:tasks.workunit.client.0.smithi031.stdout:8/543: mkdir d0/d5/da2 0 2024-09-17T01:52:09.295 INFO:tasks.workunit.client.0.smithi031.stdout:2/663: rmdir d1/d3/d2d/db2/d1e/d4f/d92 39 2024-09-17T01:52:09.296 INFO:tasks.workunit.client.0.smithi031.stdout:6/729: mkdir d23/db4/d6a/dfa 0 2024-09-17T01:52:09.298 INFO:tasks.workunit.client.1.smithi092.stdout:4/576: mkdir d4/d13/d3b/d42/d76/d41/dc6 0 2024-09-17T01:52:09.298 INFO:tasks.workunit.client.0.smithi031.stdout:9/501: fdatasync d3/d4/f5 0 2024-09-17T01:52:09.301 INFO:tasks.workunit.client.0.smithi031.stdout:9/502: dread - d3/d4/da0/d71/f9e zero size 2024-09-17T01:52:09.301 INFO:tasks.workunit.client.0.smithi031.stdout:3/584: rename db/df/d1d/f4c to db/d29/faf 0 2024-09-17T01:52:09.301 INFO:tasks.workunit.client.0.smithi031.stdout:4/828: dwrite d8/fd [4194304,4194304] 0 2024-09-17T01:52:09.301 INFO:tasks.workunit.client.1.smithi092.stdout:4/577: unlink d4/d13/d3b/d42/d76/d35/d3e/d7c/fbc 0 2024-09-17T01:52:09.305 INFO:tasks.workunit.client.0.smithi031.stdout:4/829: fsync d8/d3a/d10a/f4a 0 2024-09-17T01:52:09.306 INFO:tasks.workunit.client.0.smithi031.stdout:6/730: read d23/d63/d47/f83 [332474,103059] 0 2024-09-17T01:52:09.309 INFO:tasks.workunit.client.0.smithi031.stdout:9/503: write d3/d4/da0/f38 [3439934,13040] 0 2024-09-17T01:52:09.310 INFO:tasks.workunit.client.0.smithi031.stdout:8/544: creat d0/df/d19/d86/fa3 x:0 0 0 2024-09-17T01:52:09.311 INFO:tasks.workunit.client.0.smithi031.stdout:2/664: mknod d1/d3/d2d/db2/d1e/ce5 0 2024-09-17T01:52:09.314 INFO:tasks.workunit.client.0.smithi031.stdout:2/665: read - d1/d3/df/d18/fe2 zero size 2024-09-17T01:52:09.317 INFO:tasks.workunit.client.1.smithi092.stdout:4/578: rmdir d4/d13/d3b/d42/d76/d35/d3e/d7c 39 2024-09-17T01:52:09.317 INFO:tasks.workunit.client.0.smithi031.stdout:2/666: read - d1/d3/d2d/d91/dad/fe4 zero size 2024-09-17T01:52:09.319 INFO:tasks.workunit.client.0.smithi031.stdout:6/731: symlink d23/lfb 0 2024-09-17T01:52:09.322 INFO:tasks.workunit.client.0.smithi031.stdout:4/830: dread d8/d3a/d10a/d64/d4d/f71 [0,4194304] 0 2024-09-17T01:52:09.324 INFO:tasks.workunit.client.0.smithi031.stdout:2/667: mknod d1/d3/d2d/db2/d1e/d21/ddf/ce6 0 2024-09-17T01:52:09.328 INFO:tasks.workunit.client.1.smithi092.stdout:7/477: sync 2024-09-17T01:52:09.330 INFO:tasks.workunit.client.1.smithi092.stdout:2/361: sync 2024-09-17T01:52:09.330 INFO:tasks.workunit.client.1.smithi092.stdout:4/579: truncate d4/d5/d1d/d30/d3f/d4b/f81 2177099 0 2024-09-17T01:52:09.332 INFO:tasks.workunit.client.1.smithi092.stdout:4/580: unlink d4/d13/d20/c28 0 2024-09-17T01:52:09.332 INFO:tasks.workunit.client.1.smithi092.stdout:2/362: truncate d10/d1d/d2c/d56/d66/f67 856090 0 2024-09-17T01:52:09.336 INFO:tasks.workunit.client.1.smithi092.stdout:7/478: link d3/d6/d13/d40/c8d d3/db/d26/d83/ca5 0 2024-09-17T01:52:09.337 INFO:tasks.workunit.client.1.smithi092.stdout:2/363: dread d10/f5d [0,4194304] 0 2024-09-17T01:52:09.338 INFO:tasks.workunit.client.1.smithi092.stdout:2/364: readlink d10/d4c/l50 0 2024-09-17T01:52:09.339 INFO:tasks.workunit.client.1.smithi092.stdout:7/479: fdatasync d3/d6/d13/d21/d2e/f59 0 2024-09-17T01:52:09.341 INFO:tasks.workunit.client.1.smithi092.stdout:7/480: read d3/f4b [501181,89564] 0 2024-09-17T01:52:09.342 INFO:tasks.workunit.client.1.smithi092.stdout:4/581: dwrite d4/d5/d1d/d30/d7a/fab [0,4194304] 0 2024-09-17T01:52:09.342 INFO:tasks.workunit.client.1.smithi092.stdout:2/365: mknod d10/d1d/d2d/c79 0 2024-09-17T01:52:09.346 INFO:tasks.workunit.client.1.smithi092.stdout:7/481: mkdir d3/db/d26/d83/da6 0 2024-09-17T01:52:09.349 INFO:tasks.workunit.client.1.smithi092.stdout:4/582: write d4/d5/d1d/d30/f64 [2375786,129671] 0 2024-09-17T01:52:09.350 INFO:tasks.workunit.client.1.smithi092.stdout:2/366: mkdir d10/d1d/d2c/d5a/d7a 0 2024-09-17T01:52:09.350 INFO:tasks.workunit.client.1.smithi092.stdout:4/583: dread - d4/d7b/d7d/fbf zero size 2024-09-17T01:52:09.351 INFO:tasks.workunit.client.1.smithi092.stdout:4/584: dread - d4/d5/d1d/f9c zero size 2024-09-17T01:52:09.352 INFO:tasks.workunit.client.1.smithi092.stdout:2/367: truncate d10/d1d/d24/f29 4092504 0 2024-09-17T01:52:09.352 INFO:tasks.workunit.client.1.smithi092.stdout:7/482: rename d3/d2b/d3a/d5a to d3/d2b/d84/da7 0 2024-09-17T01:52:09.355 INFO:tasks.workunit.client.1.smithi092.stdout:4/585: rmdir d4/d5/d1d 39 2024-09-17T01:52:09.360 INFO:tasks.workunit.client.1.smithi092.stdout:7/483: creat d3/d6/da1/fa8 x:0 0 0 2024-09-17T01:52:09.360 INFO:tasks.workunit.client.0.smithi031.stdout:0/638: sync 2024-09-17T01:52:09.363 INFO:tasks.workunit.client.1.smithi092.stdout:2/368: rename d10/f19 to d10/d1d/d2c/d5a/d7a/f7b 0 2024-09-17T01:52:09.364 INFO:tasks.workunit.client.1.smithi092.stdout:2/369: chown d10/d1d/d2c/d74 2651393 1 2024-09-17T01:52:09.365 INFO:tasks.workunit.client.1.smithi092.stdout:7/484: creat d3/db/d98/fa9 x:0 0 0 2024-09-17T01:52:09.368 INFO:tasks.workunit.client.1.smithi092.stdout:4/586: rename d4/d5/d1d/d30/d3f/d4b/fa4 to d4/d13/d3b/d42/fc7 0 2024-09-17T01:52:09.370 INFO:tasks.workunit.client.1.smithi092.stdout:4/587: write d4/d7b/d7d/f93 [838362,45685] 0 2024-09-17T01:52:09.370 INFO:tasks.workunit.client.1.smithi092.stdout:7/485: creat d3/d6/d13/d21/d2e/faa x:0 0 0 2024-09-17T01:52:09.370 INFO:tasks.workunit.client.1.smithi092.stdout:7/486: chown d3/d2b/d84 463892526 1 2024-09-17T01:52:09.371 INFO:tasks.workunit.client.1.smithi092.stdout:4/588: readlink d4/d13/d3b/d42/l9f 0 2024-09-17T01:52:09.373 INFO:tasks.workunit.client.1.smithi092.stdout:2/370: getdents d10/d1d/d2c/d5a 0 2024-09-17T01:52:09.377 INFO:tasks.workunit.client.1.smithi092.stdout:2/371: creat d10/d1d/d2c/d5a/d7a/f7c x:0 0 0 2024-09-17T01:52:09.377 INFO:tasks.workunit.client.1.smithi092.stdout:2/372: dread - d10/d4c/f6c zero size 2024-09-17T01:52:09.378 INFO:tasks.workunit.client.1.smithi092.stdout:4/589: dwrite d4/d13/d3b/d42/d76/d35/f7f [0,4194304] 0 2024-09-17T01:52:09.383 INFO:tasks.workunit.client.1.smithi092.stdout:7/487: write d3/fc [6506176,78513] 0 2024-09-17T01:52:09.384 INFO:tasks.workunit.client.1.smithi092.stdout:4/590: dread d4/d5/fa2 [0,4194304] 0 2024-09-17T01:52:09.385 INFO:tasks.workunit.client.1.smithi092.stdout:4/591: readlink d4/d5/lb0 0 2024-09-17T01:52:09.385 INFO:tasks.workunit.client.1.smithi092.stdout:7/488: stat c1 0 2024-09-17T01:52:09.386 INFO:tasks.workunit.client.1.smithi092.stdout:4/592: dread - d4/d5/d46/f65 zero size 2024-09-17T01:52:09.386 INFO:tasks.workunit.client.1.smithi092.stdout:7/489: chown d3/db/d98 4913602 1 2024-09-17T01:52:09.387 INFO:tasks.workunit.client.1.smithi092.stdout:7/490: write d3/d2b/d3a/f6b [427546,91079] 0 2024-09-17T01:52:09.389 INFO:tasks.workunit.client.1.smithi092.stdout:7/491: dread - d3/db/d7b/f81 zero size 2024-09-17T01:52:09.390 INFO:tasks.workunit.client.1.smithi092.stdout:2/373: write d10/d1d/d24/d6b/d77/f33 [2932439,54390] 0 2024-09-17T01:52:09.392 INFO:tasks.workunit.client.1.smithi092.stdout:4/593: getdents d4/d7b 0 2024-09-17T01:52:09.393 INFO:tasks.workunit.client.1.smithi092.stdout:4/594: readlink d4/d13/d3b/d42/d76/d35/d3e/l9b 0 2024-09-17T01:52:09.394 INFO:tasks.workunit.client.1.smithi092.stdout:2/374: creat d10/d1d/d2c/f7d x:0 0 0 2024-09-17T01:52:09.395 INFO:tasks.workunit.client.1.smithi092.stdout:2/375: chown d10/d1d/d2c/f6a 9356 1 2024-09-17T01:52:09.395 INFO:tasks.workunit.client.1.smithi092.stdout:4/595: mkdir d4/d7b/dc8 0 2024-09-17T01:52:09.400 INFO:tasks.workunit.client.0.smithi031.stdout:3/585: getdents db/df/d1d/d37/d4a/d97 0 2024-09-17T01:52:09.400 INFO:tasks.workunit.client.0.smithi031.stdout:3/586: rename db/df/d1c to db/df/d1c/d99/db0 22 2024-09-17T01:52:09.401 INFO:tasks.workunit.client.0.smithi031.stdout:5/492: write da/d4b/f9c [181412,71964] 0 2024-09-17T01:52:09.401 INFO:tasks.workunit.client.1.smithi092.stdout:2/376: dwrite d10/d4c/f72 [0,4194304] 0 2024-09-17T01:52:09.402 INFO:tasks.workunit.client.0.smithi031.stdout:4/831: chown d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/c87 121005943 1 2024-09-17T01:52:09.405 INFO:tasks.workunit.client.0.smithi031.stdout:0/639: symlink d0/d29/da7/db3/d4a/d86/da1/ld4 0 2024-09-17T01:52:09.406 INFO:tasks.workunit.client.1.smithi092.stdout:2/377: rename d10/d54/f6d to d10/d55/f7e 0 2024-09-17T01:52:09.408 INFO:tasks.workunit.client.0.smithi031.stdout:5/493: rename da/dc/d2e to da/d14/dac 0 2024-09-17T01:52:09.412 INFO:tasks.workunit.client.1.smithi092.stdout:4/596: dread d4/d5/d46/f50 [0,4194304] 0 2024-09-17T01:52:09.412 INFO:tasks.workunit.client.1.smithi092.stdout:2/378: write fd [3390747,43007] 0 2024-09-17T01:52:09.413 INFO:tasks.workunit.client.0.smithi031.stdout:4/832: mkdir d8/d3a/d10a/d64/d4d/d5a/d79/d10b 0 2024-09-17T01:52:09.413 INFO:tasks.workunit.client.0.smithi031.stdout:0/640: dwrite d0/d29/d33/d5b/f9f [0,4194304] 0 2024-09-17T01:52:09.413 INFO:tasks.workunit.client.1.smithi092.stdout:4/597: fsync d4/d5/d1d/d30/d7a/fab 0 2024-09-17T01:52:09.413 INFO:tasks.workunit.client.1.smithi092.stdout:2/379: fdatasync d10/d1d/d2c/f39 0 2024-09-17T01:52:09.414 INFO:tasks.workunit.client.0.smithi031.stdout:5/494: truncate da/d42/d12/d4a/f60 4492559 0 2024-09-17T01:52:09.415 INFO:tasks.workunit.client.1.smithi092.stdout:4/598: write d4/d13/d3b/f78 [8305509,98434] 0 2024-09-17T01:52:09.415 INFO:tasks.workunit.client.0.smithi031.stdout:5/495: chown da/d42/d12/d64 1537866391 1 2024-09-17T01:52:09.416 INFO:tasks.workunit.client.1.smithi092.stdout:2/380: mknod d10/d54/c7f 0 2024-09-17T01:52:09.419 INFO:tasks.workunit.client.1.smithi092.stdout:4/599: read d4/d5/d8/f68 [4390449,79729] 0 2024-09-17T01:52:09.419 INFO:tasks.workunit.client.0.smithi031.stdout:0/641: mknod d0/d29/da7/db3/d9c/cd5 0 2024-09-17T01:52:09.420 INFO:tasks.workunit.client.0.smithi031.stdout:8/545: write d0/d5/d54/d60/f66 [161288,36667] 0 2024-09-17T01:52:09.421 INFO:tasks.workunit.client.1.smithi092.stdout:2/381: fdatasync d10/d1d/d24/d6b/d77/f16 0 2024-09-17T01:52:09.423 INFO:tasks.workunit.client.0.smithi031.stdout:9/504: truncate d3/d19/d1f/d44/f8b 1358909 0 2024-09-17T01:52:09.423 INFO:tasks.workunit.client.1.smithi092.stdout:2/382: write d10/d1d/d2c/f3d [162340,81548] 0 2024-09-17T01:52:09.426 INFO:tasks.workunit.client.1.smithi092.stdout:2/383: dread d10/d1d/d2c/d56/d66/f67 [0,4194304] 0 2024-09-17T01:52:09.427 INFO:tasks.workunit.client.1.smithi092.stdout:4/600: symlink d4/d5/lc9 0 2024-09-17T01:52:09.428 INFO:tasks.workunit.client.1.smithi092.stdout:4/601: read - d4/d5/d8/d92/fa3 zero size 2024-09-17T01:52:09.429 INFO:tasks.workunit.client.0.smithi031.stdout:5/496: rename da/d42/d26/l54 to da/d42/d12/d72/lad 0 2024-09-17T01:52:09.430 INFO:tasks.workunit.client.0.smithi031.stdout:9/505: symlink d3/d4/da0/d71/la1 0 2024-09-17T01:52:09.431 INFO:tasks.workunit.client.1.smithi092.stdout:2/384: unlink d10/f6f 0 2024-09-17T01:52:09.432 INFO:tasks.workunit.client.1.smithi092.stdout:4/602: creat d4/d13/d3b/fca x:0 0 0 2024-09-17T01:52:09.432 INFO:tasks.workunit.client.0.smithi031.stdout:5/497: symlink da/d14/lae 0 2024-09-17T01:52:09.433 INFO:tasks.workunit.client.1.smithi092.stdout:4/603: fsync d4/d7b/d7d/f93 0 2024-09-17T01:52:09.433 INFO:tasks.workunit.client.1.smithi092.stdout:2/385: mkdir d10/d4c/d80 0 2024-09-17T01:52:09.435 INFO:tasks.workunit.client.1.smithi092.stdout:4/604: symlink d4/d5/d8/lcb 0 2024-09-17T01:52:09.436 INFO:tasks.workunit.client.1.smithi092.stdout:4/605: dread - d4/d5/fb9 zero size 2024-09-17T01:52:09.437 INFO:tasks.workunit.client.1.smithi092.stdout:2/386: mkdir d10/d5c/d81 0 2024-09-17T01:52:09.438 INFO:tasks.workunit.client.0.smithi031.stdout:5/498: truncate da/dc/f27 1325505 0 2024-09-17T01:52:09.439 INFO:tasks.workunit.client.1.smithi092.stdout:4/606: creat d4/d13/d20/fcc x:0 0 0 2024-09-17T01:52:09.439 INFO:tasks.workunit.client.0.smithi031.stdout:3/587: truncate db/df/d1d/d37/f4b 11355 0 2024-09-17T01:52:09.443 INFO:tasks.workunit.client.0.smithi031.stdout:0/642: write d0/d29/da7/db3/d4a/f6c [4425888,51479] 0 2024-09-17T01:52:09.444 INFO:tasks.workunit.client.1.smithi092.stdout:2/387: dwrite d10/d1d/d2c/f7d [0,4194304] 0 2024-09-17T01:52:09.444 INFO:tasks.workunit.client.0.smithi031.stdout:3/588: mkdir db/df/d1d/d37/d6c/d96/db1 0 2024-09-17T01:52:09.444 INFO:tasks.workunit.client.0.smithi031.stdout:0/643: rename d0/d29/d33 to d0/d29/d33/d5b/dd6 22 2024-09-17T01:52:09.446 INFO:tasks.workunit.client.1.smithi092.stdout:4/607: rename d4/d13/l90 to d4/d5/d46/lcd 0 2024-09-17T01:52:09.447 INFO:tasks.workunit.client.0.smithi031.stdout:4/833: truncate d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/fb4 2193041 0 2024-09-17T01:52:09.447 INFO:tasks.workunit.client.1.smithi092.stdout:2/388: mknod d10/d1d/c82 0 2024-09-17T01:52:09.449 INFO:tasks.workunit.client.1.smithi092.stdout:4/608: chown d4/d13/d3b/d42/d76/d35/f84 16186388 1 2024-09-17T01:52:09.451 INFO:tasks.workunit.client.1.smithi092.stdout:2/389: symlink d10/d1d/d2c/d56/d66/l83 0 2024-09-17T01:52:09.451 INFO:tasks.workunit.client.0.smithi031.stdout:8/546: truncate d0/df/f65 2841371 0 2024-09-17T01:52:09.453 INFO:tasks.workunit.client.0.smithi031.stdout:2/668: write d1/d3/df/d18/d40/d43/f6a [1332545,100668] 0 2024-09-17T01:52:09.453 INFO:tasks.workunit.client.0.smithi031.stdout:9/506: dread d3/d19/d1f/f87 [0,4194304] 0 2024-09-17T01:52:09.454 INFO:tasks.workunit.client.0.smithi031.stdout:4/834: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/f10c x:0 0 0 2024-09-17T01:52:09.457 INFO:tasks.workunit.client.1.smithi092.stdout:4/609: dwrite d4/d7b/d7d/f93 [0,4194304] 0 2024-09-17T01:52:09.458 INFO:tasks.workunit.client.1.smithi092.stdout:4/610: stat d4/d5/c2f 0 2024-09-17T01:52:09.458 INFO:tasks.workunit.client.0.smithi031.stdout:2/669: chown d1/d3/d2d/l51 6 1 2024-09-17T01:52:09.459 INFO:tasks.workunit.client.0.smithi031.stdout:5/499: dread da/d4b/f4d [0,4194304] 0 2024-09-17T01:52:09.461 INFO:tasks.workunit.client.0.smithi031.stdout:4/835: dread d8/f27 [0,4194304] 0 2024-09-17T01:52:09.465 INFO:tasks.workunit.client.0.smithi031.stdout:2/670: rmdir d1/d3/df/d11 39 2024-09-17T01:52:09.465 INFO:tasks.workunit.client.1.smithi092.stdout:4/611: dwrite d4/d5/fc1 [0,4194304] 0 2024-09-17T01:52:09.466 INFO:tasks.workunit.client.0.smithi031.stdout:8/547: link d0/df/d19/c2a d0/d5/da2/ca4 0 2024-09-17T01:52:09.467 INFO:tasks.workunit.client.1.smithi092.stdout:4/612: write d4/d13/d3b/f47 [4798755,110611] 0 2024-09-17T01:52:09.468 INFO:tasks.workunit.client.0.smithi031.stdout:2/671: write d1/d3/d2d/db2/f1d [3522661,94152] 0 2024-09-17T01:52:09.472 INFO:tasks.workunit.client.0.smithi031.stdout:0/644: truncate d0/d29/d33/d2a/f23 220709 0 2024-09-17T01:52:09.473 INFO:tasks.workunit.client.0.smithi031.stdout:3/589: dwrite db/fe [0,4194304] 0 2024-09-17T01:52:09.474 INFO:tasks.workunit.client.0.smithi031.stdout:3/590: chown db/df/l5e 3600 1 2024-09-17T01:52:09.476 INFO:tasks.workunit.client.0.smithi031.stdout:9/507: creat d3/d4/da0/d36/fa2 x:0 0 0 2024-09-17T01:52:09.478 INFO:tasks.workunit.client.0.smithi031.stdout:5/500: rename da/d42/d12/d72/f88 to da/d42/d12/d72/faf 0 2024-09-17T01:52:09.481 INFO:tasks.workunit.client.1.smithi092.stdout:2/390: dread d10/d1d/d2c/d5a/d7a/f7b [0,4194304] 0 2024-09-17T01:52:09.486 INFO:tasks.workunit.client.0.smithi031.stdout:0/645: rename d0/d29/d33/d5/d50 to d0/d29/da7/db3/d4a/d86/dd7 0 2024-09-17T01:52:09.487 INFO:tasks.workunit.client.0.smithi031.stdout:3/591: mknod db/df/d50/cb2 0 2024-09-17T01:52:09.489 INFO:tasks.workunit.client.0.smithi031.stdout:3/592: read db/d29/f2e [904440,106421] 0 2024-09-17T01:52:09.489 INFO:tasks.workunit.client.0.smithi031.stdout:4/836: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/db0/f10d x:0 0 0 2024-09-17T01:52:09.492 INFO:tasks.workunit.client.0.smithi031.stdout:8/548: link d0/df/dd/c75 d0/df/d19/d86/ca5 0 2024-09-17T01:52:09.496 INFO:tasks.workunit.client.0.smithi031.stdout:4/837: creat d8/d3a/d10a/d64/d4f/f10e x:0 0 0 2024-09-17T01:52:09.497 INFO:tasks.workunit.client.0.smithi031.stdout:5/501: dwrite da/d42/f8c [0,4194304] 0 2024-09-17T01:52:09.500 INFO:tasks.workunit.client.0.smithi031.stdout:9/508: rename d3/d19/d1f/f87 to d3/fa3 0 2024-09-17T01:52:09.504 INFO:tasks.workunit.client.0.smithi031.stdout:8/549: dwrite d0/d5/d54/d60/f66 [0,4194304] 0 2024-09-17T01:52:09.505 INFO:tasks.workunit.client.0.smithi031.stdout:9/509: chown d3/d19/d1f/l98 1 1 2024-09-17T01:52:09.506 INFO:tasks.workunit.client.0.smithi031.stdout:2/672: rename d1/d3/d2d/d42/cd3 to d1/d3/df/d11/d30/ddd/ce7 0 2024-09-17T01:52:09.508 INFO:tasks.workunit.client.0.smithi031.stdout:3/593: dread f6 [0,4194304] 0 2024-09-17T01:52:09.510 INFO:tasks.workunit.client.0.smithi031.stdout:8/550: fsync d0/df/d19/f31 0 2024-09-17T01:52:09.512 INFO:tasks.workunit.client.0.smithi031.stdout:8/551: write d0/d5/d54/d60/f66 [2398734,109382] 0 2024-09-17T01:52:09.513 INFO:tasks.workunit.client.0.smithi031.stdout:1/661: sync 2024-09-17T01:52:09.514 INFO:tasks.workunit.client.0.smithi031.stdout:1/662: chown d4/d1e/d3f/d4d/da5 237827808 1 2024-09-17T01:52:09.516 INFO:tasks.workunit.client.0.smithi031.stdout:0/646: dread d0/d29/da7/db3/f77 [0,4194304] 0 2024-09-17T01:52:09.518 INFO:tasks.workunit.client.0.smithi031.stdout:2/673: mknod d1/d3/ce8 0 2024-09-17T01:52:09.519 INFO:tasks.workunit.client.0.smithi031.stdout:9/510: creat d3/d19/fa4 x:0 0 0 2024-09-17T01:52:09.520 INFO:tasks.workunit.client.0.smithi031.stdout:2/674: chown d1/d3/df/d18/d40/db5 4992 1 2024-09-17T01:52:09.521 INFO:tasks.workunit.client.0.smithi031.stdout:1/663: dwrite d4/d1e/d3f/d72/d7e/fa9 [0,4194304] 0 2024-09-17T01:52:09.522 INFO:tasks.workunit.client.0.smithi031.stdout:9/511: readlink d3/d4/da0/d36/d79/l83 0 2024-09-17T01:52:09.522 INFO:tasks.workunit.client.0.smithi031.stdout:2/675: chown d1/d3/d2d/f46 131 1 2024-09-17T01:52:09.524 INFO:tasks.workunit.client.0.smithi031.stdout:3/594: symlink db/df/d1d/d37/d6c/lb3 0 2024-09-17T01:52:09.525 INFO:tasks.workunit.client.0.smithi031.stdout:5/502: rename da/d14/dac/d82/d92/fa8 to da/d42/fb0 0 2024-09-17T01:52:09.526 INFO:tasks.workunit.client.1.smithi092.stdout:2/391: write d10/d1d/d2c/f42 [5476,63999] 0 2024-09-17T01:52:09.529 INFO:tasks.workunit.client.0.smithi031.stdout:0/647: creat d0/d29/da7/db3/d4a/d86/dd7/dac/fd8 x:0 0 0 2024-09-17T01:52:09.531 INFO:tasks.workunit.client.0.smithi031.stdout:2/676: dwrite d1/d3/d2d/db2/f28 [4194304,4194304] 0 2024-09-17T01:52:09.532 INFO:tasks.workunit.client.1.smithi092.stdout:1/503: sync 2024-09-17T01:52:09.533 INFO:tasks.workunit.client.1.smithi092.stdout:2/392: dwrite d10/d1d/d2c/f3d [0,4194304] 0 2024-09-17T01:52:09.534 INFO:tasks.workunit.client.0.smithi031.stdout:9/512: symlink d3/d4/da0/d71/la5 0 2024-09-17T01:52:09.534 INFO:tasks.workunit.client.1.smithi092.stdout:2/393: fdatasync d10/d1d/d2c/d56/f60 0 2024-09-17T01:52:09.536 INFO:tasks.workunit.client.1.smithi092.stdout:1/504: dread db/d1d/d23/f4c [0,4194304] 0 2024-09-17T01:52:09.536 INFO:tasks.workunit.client.1.smithi092.stdout:1/505: chown db/d6c 453 1 2024-09-17T01:52:09.540 INFO:tasks.workunit.client.1.smithi092.stdout:1/506: creat db/d1d/d23/d88/f9f x:0 0 0 2024-09-17T01:52:09.540 INFO:tasks.workunit.client.0.smithi031.stdout:1/664: rename d4/d1e/f4f to d4/d1a/d43/fde 0 2024-09-17T01:52:09.542 INFO:tasks.workunit.client.0.smithi031.stdout:5/503: mknod da/dc/da2/cb1 0 2024-09-17T01:52:09.543 INFO:tasks.workunit.client.0.smithi031.stdout:0/648: creat d0/d29/da7/db3/d4a/d86/fd9 x:0 0 0 2024-09-17T01:52:09.544 INFO:tasks.workunit.client.1.smithi092.stdout:1/507: rename db/d1d/l49 to db/d6c/d8b/la0 0 2024-09-17T01:52:09.545 INFO:tasks.workunit.client.0.smithi031.stdout:2/677: mkdir d1/d3/d2d/da6/de9 0 2024-09-17T01:52:09.546 INFO:tasks.workunit.client.0.smithi031.stdout:2/678: readlink d1/d3/df/d11/l32 0 2024-09-17T01:52:09.547 INFO:tasks.workunit.client.1.smithi092.stdout:1/508: mkdir db/d1d/d23/da1 0 2024-09-17T01:52:09.548 INFO:tasks.workunit.client.0.smithi031.stdout:1/665: chown d4/d1e/c30 69664 1 2024-09-17T01:52:09.550 INFO:tasks.workunit.client.1.smithi092.stdout:1/509: link db/f83 db/d3b/fa2 0 2024-09-17T01:52:09.551 INFO:tasks.workunit.client.0.smithi031.stdout:0/649: symlink d0/d29/da7/db3/d4a/d90/lda 0 2024-09-17T01:52:09.551 INFO:tasks.workunit.client.1.smithi092.stdout:1/510: chown db/d1d/d23/d88 623345 1 2024-09-17T01:52:09.551 INFO:tasks.workunit.client.1.smithi092.stdout:1/511: fsync db/d1d/d44/f52 0 2024-09-17T01:52:09.552 INFO:tasks.workunit.client.0.smithi031.stdout:3/595: creat db/df/d1d/fb4 x:0 0 0 2024-09-17T01:52:09.553 INFO:tasks.workunit.client.1.smithi092.stdout:1/512: fsync db/d1d/d23/d88/f99 0 2024-09-17T01:52:09.553 INFO:tasks.workunit.client.0.smithi031.stdout:3/596: chown db/df 4293 1 2024-09-17T01:52:09.554 INFO:tasks.workunit.client.0.smithi031.stdout:9/513: rename d3/d19/d1f/l3c to d3/d19/d1f/d44/d64/la6 0 2024-09-17T01:52:09.556 INFO:tasks.workunit.client.1.smithi092.stdout:1/513: unlink db/d1d/d4b/c94 0 2024-09-17T01:52:09.556 INFO:tasks.workunit.client.0.smithi031.stdout:1/666: dwrite d4/d1e/d3f/d72/d7e/da2/fbd [0,4194304] 0 2024-09-17T01:52:09.557 INFO:tasks.workunit.client.1.smithi092.stdout:1/514: mknod db/d6c/d7a/ca3 0 2024-09-17T01:52:09.558 INFO:tasks.workunit.client.1.smithi092.stdout:1/515: symlink db/d6c/d7e/la4 0 2024-09-17T01:52:09.560 INFO:tasks.workunit.client.0.smithi031.stdout:9/514: dread d3/d4/f27 [0,4194304] 0 2024-09-17T01:52:09.562 INFO:tasks.workunit.client.0.smithi031.stdout:3/597: mknod db/df/d1c/d6a/cb5 0 2024-09-17T01:52:09.562 INFO:tasks.workunit.client.1.smithi092.stdout:1/516: rename db/d1d/d2e/d62/l71 to db/d6c/d7a/la5 0 2024-09-17T01:52:09.564 INFO:tasks.workunit.client.0.smithi031.stdout:2/679: link d1/d3/df/d11/d30/f7a d1/d3/df/d11/d30/ddd/de3/fea 0 2024-09-17T01:52:09.564 INFO:tasks.workunit.client.1.smithi092.stdout:1/517: mknod db/d1d/d4b/ca6 0 2024-09-17T01:52:09.566 INFO:tasks.workunit.client.1.smithi092.stdout:2/394: dread d10/d55/f64 [0,4194304] 0 2024-09-17T01:52:09.566 INFO:tasks.workunit.client.0.smithi031.stdout:8/552: dwrite d0/d5/fa [4194304,4194304] 0 2024-09-17T01:52:09.566 INFO:tasks.workunit.client.0.smithi031.stdout:1/667: creat d4/d1e/d3f/d4d/fdf x:0 0 0 2024-09-17T01:52:09.566 INFO:tasks.workunit.client.0.smithi031.stdout:2/680: chown d1/d3/df/d11/d44/l47 1699 1 2024-09-17T01:52:09.567 INFO:tasks.workunit.client.1.smithi092.stdout:1/518: creat db/d6c/d7e/fa7 x:0 0 0 2024-09-17T01:52:09.568 INFO:tasks.workunit.client.1.smithi092.stdout:1/519: fdatasync db/d1d/d23/f3c 0 2024-09-17T01:52:09.568 INFO:tasks.workunit.client.1.smithi092.stdout:2/395: unlink d10/d1d/c82 0 2024-09-17T01:52:09.570 INFO:tasks.workunit.client.1.smithi092.stdout:2/396: mkdir d10/d55/d84 0 2024-09-17T01:52:09.571 INFO:tasks.workunit.client.0.smithi031.stdout:8/553: truncate d0/d5/d6c/d6d/f72 32749 0 2024-09-17T01:52:09.571 INFO:tasks.workunit.client.0.smithi031.stdout:8/554: chown d0/l76 1227321 1 2024-09-17T01:52:09.572 INFO:tasks.workunit.client.1.smithi092.stdout:1/520: creat db/d1d/d4b/fa8 x:0 0 0 2024-09-17T01:52:09.572 INFO:tasks.workunit.client.0.smithi031.stdout:5/504: link da/dc/f27 da/dc/d98/fb2 0 2024-09-17T01:52:09.573 INFO:tasks.workunit.client.1.smithi092.stdout:2/397: read d10/d1d/d24/f62 [2419232,38344] 0 2024-09-17T01:52:09.573 INFO:tasks.workunit.client.0.smithi031.stdout:9/515: dread d3/d19/d1f/f55 [0,4194304] 0 2024-09-17T01:52:09.574 INFO:tasks.workunit.client.1.smithi092.stdout:1/521: creat db/d1d/d23/d55/fa9 x:0 0 0 2024-09-17T01:52:09.575 INFO:tasks.workunit.client.0.smithi031.stdout:2/681: creat d1/d3/d2d/d91/feb x:0 0 0 2024-09-17T01:52:09.575 INFO:tasks.workunit.client.1.smithi092.stdout:2/398: creat d10/d5c/f85 x:0 0 0 2024-09-17T01:52:09.576 INFO:tasks.workunit.client.0.smithi031.stdout:5/505: truncate da/d4b/f65 661914 0 2024-09-17T01:52:09.577 INFO:tasks.workunit.client.0.smithi031.stdout:8/555: unlink d0/d5/f2f 0 2024-09-17T01:52:09.578 INFO:tasks.workunit.client.1.smithi092.stdout:1/522: creat db/faa x:0 0 0 2024-09-17T01:52:09.578 INFO:tasks.workunit.client.1.smithi092.stdout:2/399: mknod d10/d1d/d2c/c86 0 2024-09-17T01:52:09.579 INFO:tasks.workunit.client.0.smithi031.stdout:1/668: dwrite d4/d1e/d3f/d72/d7e/d92/f99 [0,4194304] 0 2024-09-17T01:52:09.580 INFO:tasks.workunit.client.0.smithi031.stdout:9/516: fsync d3/d19/f22 0 2024-09-17T01:52:09.581 INFO:tasks.workunit.client.1.smithi092.stdout:2/400: creat d10/d5c/d81/f87 x:0 0 0 2024-09-17T01:52:09.584 INFO:tasks.workunit.client.1.smithi092.stdout:2/401: symlink d10/d1d/d2c/d74/l88 0 2024-09-17T01:52:09.585 INFO:tasks.workunit.client.0.smithi031.stdout:5/506: rename da/d42/d12/d72/faf to da/d4b/fb3 0 2024-09-17T01:52:09.588 INFO:tasks.workunit.client.0.smithi031.stdout:5/507: chown da/d42/d26/c83 411 1 2024-09-17T01:52:09.588 INFO:tasks.workunit.client.0.smithi031.stdout:8/556: dwrite d0/d5/d9b/f5c [0,4194304] 0 2024-09-17T01:52:09.590 INFO:tasks.workunit.client.0.smithi031.stdout:5/508: write da/d42/d26/f75 [1029744,128673] 0 2024-09-17T01:52:09.592 INFO:tasks.workunit.client.0.smithi031.stdout:8/557: readlink d0/df/d19/l4a 0 2024-09-17T01:52:09.593 INFO:tasks.workunit.client.0.smithi031.stdout:1/669: rename d4/d1e/d3f/d72/c96 to d4/d1e/d3f/d4d/da5/dbc/ce0 0 2024-09-17T01:52:09.593 INFO:tasks.workunit.client.1.smithi092.stdout:1/523: getdents db/d1d/d2e/d62 0 2024-09-17T01:52:09.597 INFO:tasks.workunit.client.0.smithi031.stdout:1/670: fdatasync d4/d3d/d65/fa1 0 2024-09-17T01:52:09.598 INFO:tasks.workunit.client.1.smithi092.stdout:1/524: truncate db/d1d/d23/f25 3501018 0 2024-09-17T01:52:09.599 INFO:tasks.workunit.client.0.smithi031.stdout:2/682: dread d1/d3/f7 [0,4194304] 0 2024-09-17T01:52:09.599 INFO:tasks.workunit.client.0.smithi031.stdout:3/598: dread db/df/f1e [4194304,4194304] 0 2024-09-17T01:52:09.600 INFO:tasks.workunit.client.1.smithi092.stdout:1/525: truncate db/d1d/d44/f52 2103232 0 2024-09-17T01:52:09.601 INFO:tasks.workunit.client.0.smithi031.stdout:1/671: creat d4/d1a/d43/d53/dd3/fe1 x:0 0 0 2024-09-17T01:52:09.602 INFO:tasks.workunit.client.0.smithi031.stdout:3/599: write db/df/d1d/d37/d6c/f98 [269434,69239] 0 2024-09-17T01:52:09.602 INFO:tasks.workunit.client.1.smithi092.stdout:1/526: symlink db/d1d/d23/d55/lab 0 2024-09-17T01:52:09.605 INFO:tasks.workunit.client.0.smithi031.stdout:5/509: dread f5 [0,4194304] 0 2024-09-17T01:52:09.606 INFO:tasks.workunit.client.1.smithi092.stdout:2/402: dwrite d10/d1d/f26 [0,4194304] 0 2024-09-17T01:52:09.607 INFO:tasks.workunit.client.0.smithi031.stdout:2/683: read d1/d3/d2d/db2/d1e/d2a/d7f/fa9 [81369,27688] 0 2024-09-17T01:52:09.607 INFO:tasks.workunit.client.0.smithi031.stdout:3/600: fsync db/f7d 0 2024-09-17T01:52:09.608 INFO:tasks.workunit.client.0.smithi031.stdout:1/672: rename d4/l32 to d4/d1e/d5d/dae/le2 0 2024-09-17T01:52:09.609 INFO:tasks.workunit.client.1.smithi092.stdout:2/403: symlink d10/d3a/l89 0 2024-09-17T01:52:09.609 INFO:tasks.workunit.client.0.smithi031.stdout:0/650: dwrite d0/d29/d33/d5/f3c [0,4194304] 0 2024-09-17T01:52:09.610 INFO:tasks.workunit.client.1.smithi092.stdout:2/404: rmdir d10/d54 39 2024-09-17T01:52:09.610 INFO:tasks.workunit.client.0.smithi031.stdout:2/684: chown d1/d3/df/d18/d40/d43 377586833 1 2024-09-17T01:52:09.611 INFO:tasks.workunit.client.1.smithi092.stdout:2/405: symlink d10/d55/l8a 0 2024-09-17T01:52:09.612 INFO:tasks.workunit.client.0.smithi031.stdout:1/673: stat d4/d1e/d3f/d72/d7e/da2/fb3 0 2024-09-17T01:52:09.614 INFO:tasks.workunit.client.1.smithi092.stdout:2/406: rename d10/d1d/d2c/d56/d66/f67 to d10/d1d/f8b 0 2024-09-17T01:52:09.615 INFO:tasks.workunit.client.0.smithi031.stdout:9/517: truncate d3/d19/d1f/f21 1028913 0 2024-09-17T01:52:09.616 INFO:tasks.workunit.client.1.smithi092.stdout:2/407: symlink d10/d4c/d80/l8c 0 2024-09-17T01:52:09.617 INFO:tasks.workunit.client.1.smithi092.stdout:2/408: write d10/d1d/d2c/f3d [2724213,31307] 0 2024-09-17T01:52:09.623 INFO:tasks.workunit.client.1.smithi092.stdout:1/527: dread db/d1d/d23/f5b [0,4194304] 0 2024-09-17T01:52:09.624 INFO:tasks.workunit.client.1.smithi092.stdout:2/409: rename d10/d1d/d2d to d10/d8d 0 2024-09-17T01:52:09.626 INFO:tasks.workunit.client.1.smithi092.stdout:1/528: symlink db/d1d/d2e/d62/lac 0 2024-09-17T01:52:09.626 INFO:tasks.workunit.client.0.smithi031.stdout:0/651: creat d0/d29/d33/d5/d48/d56/dc8/dcc/fdb x:0 0 0 2024-09-17T01:52:09.626 INFO:tasks.workunit.client.1.smithi092.stdout:2/410: write d10/d1d/d24/f29 [2290659,63382] 0 2024-09-17T01:52:09.627 INFO:tasks.workunit.client.0.smithi031.stdout:0/652: dread d0/f8a [0,4194304] 0 2024-09-17T01:52:09.627 INFO:tasks.workunit.client.0.smithi031.stdout:3/601: rmdir db/df/d1d/d37/d6c/d96/db1 0 2024-09-17T01:52:09.629 INFO:tasks.workunit.client.1.smithi092.stdout:1/529: rename db/d3b/fa2 to db/d3b/fad 0 2024-09-17T01:52:09.630 INFO:tasks.workunit.client.1.smithi092.stdout:2/411: creat d10/d4c/f8e x:0 0 0 2024-09-17T01:52:09.630 INFO:tasks.workunit.client.1.smithi092.stdout:1/530: dread - db/d1d/d23/d85/f9d zero size 2024-09-17T01:52:09.632 INFO:tasks.workunit.client.1.smithi092.stdout:2/412: write d10/d1d/d2c/f3d [462737,13028] 0 2024-09-17T01:52:09.633 INFO:tasks.workunit.client.0.smithi031.stdout:2/685: getdents d1 0 2024-09-17T01:52:09.636 INFO:tasks.workunit.client.1.smithi092.stdout:1/531: rename db/d1d/d4b/fa8 to db/d6c/d7e/d82/fae 0 2024-09-17T01:52:09.636 INFO:tasks.workunit.client.0.smithi031.stdout:3/602: truncate db/df/d1d/d37/f4b 233946 0 2024-09-17T01:52:09.636 INFO:tasks.workunit.client.1.smithi092.stdout:2/413: mkdir d10/d8d/d8f 0 2024-09-17T01:52:09.637 INFO:tasks.workunit.client.1.smithi092.stdout:1/532: mknod db/d3b/caf 0 2024-09-17T01:52:09.638 INFO:tasks.workunit.client.1.smithi092.stdout:2/414: creat d10/d5c/d81/f90 x:0 0 0 2024-09-17T01:52:09.639 INFO:tasks.workunit.client.1.smithi092.stdout:1/533: fdatasync db/f87 0 2024-09-17T01:52:09.640 INFO:tasks.workunit.client.0.smithi031.stdout:2/686: fdatasync d1/d7c/fd9 0 2024-09-17T01:52:09.640 INFO:tasks.workunit.client.0.smithi031.stdout:5/510: dread f8 [0,4194304] 0 2024-09-17T01:52:09.642 INFO:tasks.workunit.client.0.smithi031.stdout:1/674: dwrite d4/d1e/d3f/d72/f7a [0,4194304] 0 2024-09-17T01:52:09.643 INFO:tasks.workunit.client.1.smithi092.stdout:2/415: dread d10/d55/f7e [0,4194304] 0 2024-09-17T01:52:09.643 INFO:tasks.workunit.client.0.smithi031.stdout:9/518: dwrite d3/d4/f27 [0,4194304] 0 2024-09-17T01:52:09.644 INFO:tasks.workunit.client.1.smithi092.stdout:2/416: truncate d10/d55/f5b 786260 0 2024-09-17T01:52:09.644 INFO:tasks.workunit.client.1.smithi092.stdout:1/534: creat db/d1d/d23/d34/fb0 x:0 0 0 2024-09-17T01:52:09.645 INFO:tasks.workunit.client.1.smithi092.stdout:2/417: chown d10/d1d/d24/d6b/d77/f2b 30 1 2024-09-17T01:52:09.646 INFO:tasks.workunit.client.1.smithi092.stdout:1/535: write db/d1d/d44/f52 [1899402,115679] 0 2024-09-17T01:52:09.649 INFO:tasks.workunit.client.0.smithi031.stdout:3/603: unlink db/df/d1d/d37/d6c/f98 0 2024-09-17T01:52:09.651 INFO:tasks.workunit.client.0.smithi031.stdout:0/653: dwrite d0/d29/d33/d5b/f6d [0,4194304] 0 2024-09-17T01:52:09.653 INFO:tasks.workunit.client.0.smithi031.stdout:3/604: chown db/df/l5e 8344500 1 2024-09-17T01:52:09.654 INFO:tasks.workunit.client.0.smithi031.stdout:9/519: write d3/d19/d1f/d44/d64/f90 [407615,65231] 0 2024-09-17T01:52:09.654 INFO:tasks.workunit.client.0.smithi031.stdout:1/675: creat d4/d1a/d43/fe3 x:0 0 0 2024-09-17T01:52:09.654 INFO:tasks.workunit.client.1.smithi092.stdout:1/536: rename db/d1d/d23/f25 to db/d1d/d4b/d9a/fb1 0 2024-09-17T01:52:09.657 INFO:tasks.workunit.client.1.smithi092.stdout:1/537: truncate db/d1d/d23/f5b 1388357 0 2024-09-17T01:52:09.658 INFO:tasks.workunit.client.1.smithi092.stdout:2/418: dread d10/d1d/d24/d6b/d77/f3e [0,4194304] 0 2024-09-17T01:52:09.659 INFO:tasks.workunit.client.0.smithi031.stdout:0/654: creat d0/d29/d33/fdc x:0 0 0 2024-09-17T01:52:09.663 INFO:tasks.workunit.client.0.smithi031.stdout:1/676: mkdir d4/d3d/de4 0 2024-09-17T01:52:09.663 INFO:tasks.workunit.client.0.smithi031.stdout:9/520: creat d3/d19/d1f/fa7 x:0 0 0 2024-09-17T01:52:09.663 INFO:tasks.workunit.client.0.smithi031.stdout:3/605: write db/df/d1d/d37/d3a/f8f [376588,21774] 0 2024-09-17T01:52:09.663 INFO:tasks.workunit.client.0.smithi031.stdout:5/511: dwrite da/d14/dac/d62/f78 [0,4194304] 0 2024-09-17T01:52:09.665 INFO:tasks.workunit.client.0.smithi031.stdout:1/677: fsync d4/d1e/d3f/d72/d7e/fa9 0 2024-09-17T01:52:09.665 INFO:tasks.workunit.client.1.smithi092.stdout:2/419: dwrite d10/d4c/f8e [0,4194304] 0 2024-09-17T01:52:09.668 INFO:tasks.workunit.client.1.smithi092.stdout:2/420: symlink d10/d8d/l91 0 2024-09-17T01:52:09.670 INFO:tasks.workunit.client.0.smithi031.stdout:5/512: mkdir da/d4b/db4 0 2024-09-17T01:52:09.671 INFO:tasks.workunit.client.1.smithi092.stdout:2/421: creat d10/d1d/d24/f92 x:0 0 0 2024-09-17T01:52:09.672 INFO:tasks.workunit.client.0.smithi031.stdout:3/606: mknod db/df/d1d/d37/d6c/d6e/cb6 0 2024-09-17T01:52:09.673 INFO:tasks.workunit.client.0.smithi031.stdout:2/687: write d1/d3/df/d11/d30/fa8 [651942,6393] 0 2024-09-17T01:52:09.675 INFO:tasks.workunit.client.1.smithi092.stdout:2/422: write d10/f5d [1364329,28181] 0 2024-09-17T01:52:09.675 INFO:tasks.workunit.client.0.smithi031.stdout:9/521: creat d3/d4/d29/fa8 x:0 0 0 2024-09-17T01:52:09.676 INFO:tasks.workunit.client.0.smithi031.stdout:2/688: write d1/d3/d2d/f38 [7928316,124182] 0 2024-09-17T01:52:09.677 INFO:tasks.workunit.client.1.smithi092.stdout:2/423: mkdir d10/d8d/d8f/d93 0 2024-09-17T01:52:09.678 INFO:tasks.workunit.client.0.smithi031.stdout:9/522: write d3/f11 [5406923,33854] 0 2024-09-17T01:52:09.680 INFO:tasks.workunit.client.0.smithi031.stdout:5/513: rename da/d42/d12/c1b to da/d14/dac/d62/cb5 0 2024-09-17T01:52:09.683 INFO:tasks.workunit.client.0.smithi031.stdout:0/655: write d0/d29/d33/d5/f85 [153806,42183] 0 2024-09-17T01:52:09.687 INFO:tasks.workunit.client.0.smithi031.stdout:5/514: unlink da/d42/d12/l5a 0 2024-09-17T01:52:09.688 INFO:tasks.workunit.client.0.smithi031.stdout:3/607: link db/df/d1d/d37/d65/f9c db/df/d1d/d37/da1/fb7 0 2024-09-17T01:52:09.688 INFO:tasks.workunit.client.0.smithi031.stdout:2/689: getdents d1/d3/d2d/da6/de9 0 2024-09-17T01:52:09.690 INFO:tasks.workunit.client.0.smithi031.stdout:0/656: symlink d0/d29/d33/d5/d48/d56/dc8/ldd 0 2024-09-17T01:52:09.692 INFO:tasks.workunit.client.0.smithi031.stdout:0/657: write d0/d29/d33/d2a/d25/d38/f65 [814371,42403] 0 2024-09-17T01:52:09.695 INFO:tasks.workunit.client.0.smithi031.stdout:1/678: dread d4/f10 [0,4194304] 0 2024-09-17T01:52:09.695 INFO:tasks.workunit.client.1.smithi092.stdout:2/424: rmdir d10/d1d/d24 39 2024-09-17T01:52:09.697 INFO:tasks.workunit.client.0.smithi031.stdout:5/515: rename da/dc/l38 to da/dc/lb6 0 2024-09-17T01:52:09.698 INFO:tasks.workunit.client.1.smithi092.stdout:1/538: dread db/f87 [0,4194304] 0 2024-09-17T01:52:09.698 INFO:tasks.workunit.client.1.smithi092.stdout:2/425: write d10/d8d/f34 [1098705,82985] 0 2024-09-17T01:52:09.698 INFO:tasks.workunit.client.1.smithi092.stdout:2/426: write d10/d8d/f52 [4302672,29372] 0 2024-09-17T01:52:09.699 INFO:tasks.workunit.client.0.smithi031.stdout:3/608: getdents db/d9b 0 2024-09-17T01:52:09.699 INFO:tasks.workunit.client.1.smithi092.stdout:1/539: rmdir db/d1d 39 2024-09-17T01:52:09.701 INFO:tasks.workunit.client.0.smithi031.stdout:0/658: rename d0/d29/da7/db3/d4a/d90 to d0/d29/d33/d2a/dde 0 2024-09-17T01:52:09.705 INFO:tasks.workunit.client.1.smithi092.stdout:2/427: dwrite d10/d1d/d2c/f57 [0,4194304] 0 2024-09-17T01:52:09.705 INFO:tasks.workunit.client.0.smithi031.stdout:5/516: rename da/dc/da2/fa5 to da/dc/d98/fb7 0 2024-09-17T01:52:09.707 INFO:tasks.workunit.client.0.smithi031.stdout:9/523: dread d3/f11 [0,4194304] 0 2024-09-17T01:52:09.708 INFO:tasks.workunit.client.1.smithi092.stdout:2/428: creat d10/d4c/f94 x:0 0 0 2024-09-17T01:52:09.709 INFO:tasks.workunit.client.1.smithi092.stdout:1/540: dwrite db/d1d/d4b/f56 [0,4194304] 0 2024-09-17T01:52:09.709 INFO:tasks.workunit.client.0.smithi031.stdout:0/659: symlink d0/d37/db9/dcf/ldf 0 2024-09-17T01:52:09.710 INFO:tasks.workunit.client.1.smithi092.stdout:2/429: read d10/d1d/d2c/f39 [3301123,57297] 0 2024-09-17T01:52:09.711 INFO:tasks.workunit.client.1.smithi092.stdout:2/430: write d10/d4c/f6c [433191,53305] 0 2024-09-17T01:52:09.711 INFO:tasks.workunit.client.1.smithi092.stdout:1/541: creat db/d1d/d23/d88/fb2 x:0 0 0 2024-09-17T01:52:09.712 INFO:tasks.workunit.client.0.smithi031.stdout:2/690: dread d1/d3/d2d/db2/f1d [0,4194304] 0 2024-09-17T01:52:09.714 INFO:tasks.workunit.client.0.smithi031.stdout:2/691: readlink d1/d3/d2d/da6/lbf 0 2024-09-17T01:52:09.715 INFO:tasks.workunit.client.1.smithi092.stdout:2/431: rename d10/d1d/d2c/d74 to d10/d4c/d80/d95 0 2024-09-17T01:52:09.716 INFO:tasks.workunit.client.0.smithi031.stdout:1/679: getdents d4/d1a 0 2024-09-17T01:52:09.717 INFO:tasks.workunit.client.1.smithi092.stdout:2/432: rmdir d10/d4c/d80 39 2024-09-17T01:52:09.719 INFO:tasks.workunit.client.1.smithi092.stdout:2/433: chown d10/d54 97 1 2024-09-17T01:52:09.723 INFO:tasks.workunit.client.0.smithi031.stdout:0/660: rename d0/d29/da7/db3/d4a/d86/dd7/fc9 to d0/d29/d33/d2a/dde/d9b/fe0 0 2024-09-17T01:52:09.725 INFO:tasks.workunit.client.1.smithi092.stdout:2/434: rename d10/d1d/d24/d6b to d10/d1d/d96 0 2024-09-17T01:52:09.725 INFO:tasks.workunit.client.0.smithi031.stdout:0/661: truncate d0/d29/d33/d5/d48/d56/fb6 300803 0 2024-09-17T01:52:09.727 INFO:tasks.workunit.client.0.smithi031.stdout:3/609: truncate db/df/d50/f75 933730 0 2024-09-17T01:52:09.727 INFO:tasks.workunit.client.1.smithi092.stdout:2/435: mkdir d10/d3a/d97 0 2024-09-17T01:52:09.727 INFO:tasks.workunit.client.1.smithi092.stdout:1/542: dread db/d1d/d44/f4e [0,4194304] 0 2024-09-17T01:52:09.728 INFO:tasks.workunit.client.0.smithi031.stdout:1/680: mknod d4/d1a/d43/d53/ce5 0 2024-09-17T01:52:09.730 INFO:tasks.workunit.client.1.smithi092.stdout:2/436: unlink d10/d1d/d96/d77/f16 0 2024-09-17T01:52:09.730 INFO:tasks.workunit.client.0.smithi031.stdout:5/517: creat da/fb8 x:0 0 0 2024-09-17T01:52:09.731 INFO:tasks.workunit.client.1.smithi092.stdout:1/543: mkdir db/d6c/db3 0 2024-09-17T01:52:09.732 INFO:tasks.workunit.client.0.smithi031.stdout:5/518: chown da/d42/d26/c83 42 1 2024-09-17T01:52:09.733 INFO:tasks.workunit.client.0.smithi031.stdout:7/637: sync 2024-09-17T01:52:09.733 INFO:tasks.workunit.client.0.smithi031.stdout:6/732: sync 2024-09-17T01:52:09.733 INFO:tasks.workunit.client.1.smithi092.stdout:1/544: creat db/d6c/d7a/fb4 x:0 0 0 2024-09-17T01:52:09.734 INFO:tasks.workunit.client.0.smithi031.stdout:0/662: dwrite d0/d29/fa2 [0,4194304] 0 2024-09-17T01:52:09.735 INFO:tasks.workunit.client.1.smithi092.stdout:1/545: chown db/d1d/d44/c53 10791 1 2024-09-17T01:52:09.737 INFO:tasks.workunit.client.1.smithi092.stdout:2/437: dwrite d10/d5c/d81/f90 [0,4194304] 0 2024-09-17T01:52:09.738 INFO:tasks.workunit.client.0.smithi031.stdout:3/610: dread db/df/d1d/d37/d6c/d6e/f85 [0,4194304] 0 2024-09-17T01:52:09.738 INFO:tasks.workunit.client.0.smithi031.stdout:9/524: write d3/d19/d1f/f21 [43082,94915] 0 2024-09-17T01:52:09.739 INFO:tasks.workunit.client.0.smithi031.stdout:7/638: truncate db/d29/f3c 2156111 0 2024-09-17T01:52:09.741 INFO:tasks.workunit.client.1.smithi092.stdout:2/438: write d10/d1d/d2c/d5a/d7a/f7c [762849,111987] 0 2024-09-17T01:52:09.741 INFO:tasks.workunit.client.0.smithi031.stdout:9/525: readlink d3/d19/l35 0 2024-09-17T01:52:09.746 INFO:tasks.workunit.client.0.smithi031.stdout:2/692: dwrite d1/d3/df/d18/d40/f7e [0,4194304] 0 2024-09-17T01:52:09.746 INFO:tasks.workunit.client.1.smithi092.stdout:1/546: dwrite db/d1d/d23/d55/f61 [0,4194304] 0 2024-09-17T01:52:09.746 INFO:tasks.workunit.client.0.smithi031.stdout:3/611: write db/df/d1d/fb4 [584039,88452] 0 2024-09-17T01:52:09.750 INFO:tasks.workunit.client.0.smithi031.stdout:1/681: truncate d4/d1e/f49 5741372 0 2024-09-17T01:52:09.751 INFO:tasks.workunit.client.1.smithi092.stdout:1/547: rename db/d1d/d44 to db/d1d/db5 0 2024-09-17T01:52:09.752 INFO:tasks.workunit.client.1.smithi092.stdout:1/548: write db/d1d/d4b/f56 [3828822,56973] 0 2024-09-17T01:52:09.755 INFO:tasks.workunit.client.0.smithi031.stdout:0/663: link d0/d29/d33/d2a/f7f d0/d29/d33/d5/d48/d56/dc8/fe1 0 2024-09-17T01:52:09.756 INFO:tasks.workunit.client.0.smithi031.stdout:6/733: link d23/d63/lef d23/db4/d6a/d70/lfc 0 2024-09-17T01:52:09.759 INFO:tasks.workunit.client.0.smithi031.stdout:2/693: rename d1/d3/d2d/fb0 to d1/d3/d2d/db2/d1e/d2a/fec 0 2024-09-17T01:52:09.761 INFO:tasks.workunit.client.1.smithi092.stdout:1/549: dwrite db/d6c/d7e/d82/fae [0,4194304] 0 2024-09-17T01:52:09.762 INFO:tasks.workunit.client.0.smithi031.stdout:9/526: symlink d3/d4/da0/d36/d8f/la9 0 2024-09-17T01:52:09.764 INFO:tasks.workunit.client.0.smithi031.stdout:5/519: dwrite da/dc/f3e [0,4194304] 0 2024-09-17T01:52:09.764 INFO:tasks.workunit.client.0.smithi031.stdout:3/612: symlink db/df/d1d/d37/d6c/d96/lb8 0 2024-09-17T01:52:09.765 INFO:tasks.workunit.client.1.smithi092.stdout:1/550: dread db/d1d/db5/f4e [0,4194304] 0 2024-09-17T01:52:09.767 INFO:tasks.workunit.client.1.smithi092.stdout:1/551: chown db/d3b/c81 14 1 2024-09-17T01:52:09.769 INFO:tasks.workunit.client.0.smithi031.stdout:1/682: mkdir d4/d3d/d65/db7/de6 0 2024-09-17T01:52:09.770 INFO:tasks.workunit.client.1.smithi092.stdout:1/552: creat db/d6c/d7e/d96/fb6 x:0 0 0 2024-09-17T01:52:09.770 INFO:tasks.workunit.client.0.smithi031.stdout:6/734: truncate d23/d63/f56 98123 0 2024-09-17T01:52:09.770 INFO:tasks.workunit.client.0.smithi031.stdout:0/664: write d0/f8a [1361698,88533] 0 2024-09-17T01:52:09.772 INFO:tasks.workunit.client.1.smithi092.stdout:1/553: creat db/d3b/fb7 x:0 0 0 2024-09-17T01:52:09.773 INFO:tasks.workunit.client.0.smithi031.stdout:9/527: mknod d3/d4/da0/caa 0 2024-09-17T01:52:09.774 INFO:tasks.workunit.client.0.smithi031.stdout:3/613: write db/df/d50/f62 [4306854,67782] 0 2024-09-17T01:52:09.774 INFO:tasks.workunit.client.0.smithi031.stdout:0/665: write d0/d29/d33/fdc [183520,107152] 0 2024-09-17T01:52:09.775 INFO:tasks.workunit.client.1.smithi092.stdout:1/554: dread db/d1d/d23/f4c [0,4194304] 0 2024-09-17T01:52:09.777 INFO:tasks.workunit.client.1.smithi092.stdout:1/555: fdatasync db/d1d/d23/d55/f61 0 2024-09-17T01:52:09.777 INFO:tasks.workunit.client.1.smithi092.stdout:1/556: chown db/d1d/d23 26929516 1 2024-09-17T01:52:09.778 INFO:tasks.workunit.client.0.smithi031.stdout:5/520: fsync da/dc/f27 0 2024-09-17T01:52:09.778 INFO:tasks.workunit.client.0.smithi031.stdout:6/735: symlink d23/db4/d64/lfd 0 2024-09-17T01:52:09.778 INFO:tasks.workunit.client.0.smithi031.stdout:0/666: chown d0/d29/d33/d2a/c4e 979584489 1 2024-09-17T01:52:09.779 INFO:tasks.workunit.client.0.smithi031.stdout:0/667: readlink d0/d29/d44/l74 0 2024-09-17T01:52:09.781 INFO:tasks.workunit.client.0.smithi031.stdout:9/528: rename d3/d19/d1f/f55 to d3/d4/da0/d36/d79/fab 0 2024-09-17T01:52:09.782 INFO:tasks.workunit.client.0.smithi031.stdout:5/521: mknod da/d14/cb9 0 2024-09-17T01:52:09.782 INFO:tasks.workunit.client.0.smithi031.stdout:9/529: chown d3/d19/d1f/c85 28 1 2024-09-17T01:52:09.783 INFO:tasks.workunit.client.0.smithi031.stdout:5/522: dread - da/d42/d12/d64/f93 zero size 2024-09-17T01:52:09.784 INFO:tasks.workunit.client.1.smithi092.stdout:1/557: dwrite db/d6c/d7e/d96/fb6 [0,4194304] 0 2024-09-17T01:52:09.784 INFO:tasks.workunit.client.0.smithi031.stdout:9/530: fdatasync d3/d19/d1f/f21 0 2024-09-17T01:52:09.784 INFO:tasks.workunit.client.0.smithi031.stdout:3/614: mknod db/df/d1d/d37/d65/cb9 0 2024-09-17T01:52:09.785 INFO:tasks.workunit.client.0.smithi031.stdout:5/523: chown da/d42/f8c 0 1 2024-09-17T01:52:09.785 INFO:tasks.workunit.client.0.smithi031.stdout:0/668: truncate d0/d37/f8f 620221 0 2024-09-17T01:52:09.789 INFO:tasks.workunit.client.0.smithi031.stdout:3/615: mkdir db/df/d1d/d37/d4a/d97/dba 0 2024-09-17T01:52:09.790 INFO:tasks.workunit.client.1.smithi092.stdout:2/439: dread d10/d1d/d96/d77/f33 [0,4194304] 0 2024-09-17T01:52:09.791 INFO:tasks.workunit.client.0.smithi031.stdout:0/669: mkdir d0/d29/d33/d5/d48/d8c/de2 0 2024-09-17T01:52:09.791 INFO:tasks.workunit.client.1.smithi092.stdout:1/558: truncate db/d1d/d23/f5c 2933948 0 2024-09-17T01:52:09.793 INFO:tasks.workunit.client.1.smithi092.stdout:2/440: creat d10/d3a/d97/f98 x:0 0 0 2024-09-17T01:52:09.794 INFO:tasks.workunit.client.1.smithi092.stdout:2/441: read d10/d1d/d2c/d5a/d7a/f7b [318685,79424] 0 2024-09-17T01:52:09.794 INFO:tasks.workunit.client.1.smithi092.stdout:1/559: symlink db/d1d/d4b/d9a/lb8 0 2024-09-17T01:52:09.795 INFO:tasks.workunit.client.0.smithi031.stdout:3/616: dread f6 [0,4194304] 0 2024-09-17T01:52:09.795 INFO:tasks.workunit.client.0.smithi031.stdout:1/683: unlink d4/d1a/d2d/d18/f31 0 2024-09-17T01:52:09.796 INFO:tasks.workunit.client.1.smithi092.stdout:2/442: dread d10/d1d/d96/d77/f3e [0,4194304] 0 2024-09-17T01:52:09.798 INFO:tasks.workunit.client.1.smithi092.stdout:2/443: creat d10/d5c/d81/f99 x:0 0 0 2024-09-17T01:52:09.798 INFO:tasks.workunit.client.0.smithi031.stdout:1/684: chown d4/d1a/d2d/d18/d52/f63 1259756859 1 2024-09-17T01:52:09.798 INFO:tasks.workunit.client.0.smithi031.stdout:5/524: dwrite da/d42/d12/d64/f93 [0,4194304] 0 2024-09-17T01:52:09.799 INFO:tasks.workunit.client.0.smithi031.stdout:0/670: mknod d0/d29/da7/db3/d4a/d86/da1/ce3 0 2024-09-17T01:52:09.800 INFO:tasks.workunit.client.1.smithi092.stdout:2/444: symlink d10/d1d/d96/l9a 0 2024-09-17T01:52:09.800 INFO:tasks.workunit.client.0.smithi031.stdout:5/525: write da/d42/d26/f9f [437453,105607] 0 2024-09-17T01:52:09.803 INFO:tasks.workunit.client.0.smithi031.stdout:6/736: link d23/db4/d6a/d72/f73 d23/db4/d6a/ffe 0 2024-09-17T01:52:09.805 INFO:tasks.workunit.client.0.smithi031.stdout:6/737: truncate d23/fcf 132714 0 2024-09-17T01:52:09.806 INFO:tasks.workunit.client.1.smithi092.stdout:2/445: dwrite d10/d8d/f76 [0,4194304] 0 2024-09-17T01:52:09.808 INFO:tasks.workunit.client.1.smithi092.stdout:2/446: write d10/d1d/d2c/f7d [4366571,79995] 0 2024-09-17T01:52:09.811 INFO:tasks.workunit.client.0.smithi031.stdout:5/526: creat da/d4b/fba x:0 0 0 2024-09-17T01:52:09.812 INFO:tasks.workunit.client.0.smithi031.stdout:3/617: truncate db/df/f39 1319504 0 2024-09-17T01:52:09.814 INFO:tasks.workunit.client.1.smithi092.stdout:2/447: link d10/d55/f64 d10/d1d/d96/d77/f9b 0 2024-09-17T01:52:09.814 INFO:tasks.workunit.client.0.smithi031.stdout:1/685: creat d4/d3d/de4/fe7 x:0 0 0 2024-09-17T01:52:09.815 INFO:tasks.workunit.client.0.smithi031.stdout:2/694: truncate d1/d3/df/d11/f26 474535 0 2024-09-17T01:52:09.815 INFO:tasks.workunit.client.1.smithi092.stdout:2/448: fdatasync d10/f1a 0 2024-09-17T01:52:09.819 INFO:tasks.workunit.client.0.smithi031.stdout:1/686: truncate d4/d1a/d2d/fd1 775559 0 2024-09-17T01:52:09.820 INFO:tasks.workunit.client.0.smithi031.stdout:0/671: dread d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:52:09.820 INFO:tasks.workunit.client.0.smithi031.stdout:3/618: creat db/da3/fbb x:0 0 0 2024-09-17T01:52:09.821 INFO:tasks.workunit.client.1.smithi092.stdout:2/449: getdents d10/d1d/d2c/d56/d66 0 2024-09-17T01:52:09.821 INFO:tasks.workunit.client.0.smithi031.stdout:2/695: read d1/d3/d2d/db2/d1e/d4f/f9a [260084,111366] 0 2024-09-17T01:52:09.825 INFO:tasks.workunit.client.1.smithi092.stdout:2/450: rename d10/d54/d70 to d10/d1d/d96/d77/d9c 0 2024-09-17T01:52:09.826 INFO:tasks.workunit.client.0.smithi031.stdout:6/738: rename d23/db4/ce7 to d23/cff 0 2024-09-17T01:52:09.827 INFO:tasks.workunit.client.1.smithi092.stdout:2/451: unlink d10/d1d/d2c/c37 0 2024-09-17T01:52:09.829 INFO:tasks.workunit.client.1.smithi092.stdout:2/452: rmdir d10/d1d/d96/d77 39 2024-09-17T01:52:09.829 INFO:tasks.workunit.client.0.smithi031.stdout:6/739: write d23/db4/d6a/d70/d74/fb1 [172296,101931] 0 2024-09-17T01:52:09.832 INFO:tasks.workunit.client.1.smithi092.stdout:2/453: dread d10/d4c/f6c [0,4194304] 0 2024-09-17T01:52:09.832 INFO:tasks.workunit.client.0.smithi031.stdout:6/740: write d23/db4/d64/f78 [55630,18261] 0 2024-09-17T01:52:09.833 INFO:tasks.workunit.client.0.smithi031.stdout:9/531: dwrite d3/d19/d1f/f6d [0,4194304] 0 2024-09-17T01:52:09.833 INFO:tasks.workunit.client.1.smithi092.stdout:2/454: truncate d10/d1d/d24/f43 499124 0 2024-09-17T01:52:09.834 INFO:tasks.workunit.client.0.smithi031.stdout:9/532: stat d3 0 2024-09-17T01:52:09.835 INFO:tasks.workunit.client.1.smithi092.stdout:2/455: chown d10/d1d/d96/d77/f3e 128484 1 2024-09-17T01:52:09.836 INFO:tasks.workunit.client.1.smithi092.stdout:2/456: chown d10/d1d/d96/l9a 174850 1 2024-09-17T01:52:09.837 INFO:tasks.workunit.client.1.smithi092.stdout:2/457: read fe [969823,14008] 0 2024-09-17T01:52:09.839 INFO:tasks.workunit.client.1.smithi092.stdout:2/458: creat d10/d1d/d24/d6e/f9d x:0 0 0 2024-09-17T01:52:09.841 INFO:tasks.workunit.client.1.smithi092.stdout:2/459: mkdir d10/d8d/d9e 0 2024-09-17T01:52:09.841 INFO:tasks.workunit.client.0.smithi031.stdout:5/527: link da/f49 da/dc/fbb 0 2024-09-17T01:52:09.844 INFO:tasks.workunit.client.0.smithi031.stdout:6/741: mknod d23/db4/d64/d67/de9/c100 0 2024-09-17T01:52:09.845 INFO:tasks.workunit.client.0.smithi031.stdout:6/742: write d23/fdf [776103,117276] 0 2024-09-17T01:52:09.847 INFO:tasks.workunit.client.0.smithi031.stdout:0/672: link d0/d29/d44/lb1 d0/d29/d33/d2a/d25/d38/dd1/le4 0 2024-09-17T01:52:09.847 INFO:tasks.workunit.client.0.smithi031.stdout:6/743: write d23/f42 [1570747,78831] 0 2024-09-17T01:52:09.848 INFO:tasks.workunit.client.0.smithi031.stdout:6/744: write d23/db4/f8b [762344,92706] 0 2024-09-17T01:52:09.849 INFO:tasks.workunit.client.0.smithi031.stdout:0/673: write d0/d29/f63 [2848299,50011] 0 2024-09-17T01:52:09.851 INFO:tasks.workunit.client.0.smithi031.stdout:5/528: mknod da/d14/cbc 0 2024-09-17T01:52:09.851 INFO:tasks.workunit.client.0.smithi031.stdout:6/745: chown d23/db4/d64/d67/l82 0 1 2024-09-17T01:52:09.853 INFO:tasks.workunit.client.0.smithi031.stdout:6/746: readlink d23/db4/d8a/dd5/ddd/le6 0 2024-09-17T01:52:09.853 INFO:tasks.workunit.client.0.smithi031.stdout:2/696: dread d1/d3/d2d/db2/d1e/d2a/f67 [0,4194304] 0 2024-09-17T01:52:09.854 INFO:tasks.workunit.client.0.smithi031.stdout:2/697: write d1/d3/df/d18/fe2 [485383,57597] 0 2024-09-17T01:52:09.855 INFO:tasks.workunit.client.1.smithi092.stdout:2/460: dread d10/d1d/d24/f43 [0,4194304] 0 2024-09-17T01:52:09.859 INFO:tasks.workunit.client.0.smithi031.stdout:0/674: creat d0/d29/da7/db3/d4a/d86/fe5 x:0 0 0 2024-09-17T01:52:09.859 INFO:tasks.workunit.client.0.smithi031.stdout:3/619: write db/df/d1d/d37/f4d [496396,3594] 0 2024-09-17T01:52:09.860 INFO:tasks.workunit.client.0.smithi031.stdout:0/675: readlink d0/d29/d33/d5/d48/d56/dc8/lc3 0 2024-09-17T01:52:09.861 INFO:tasks.workunit.client.1.smithi092.stdout:2/461: dread f5 [0,4194304] 0 2024-09-17T01:52:09.863 INFO:tasks.workunit.client.1.smithi092.stdout:2/462: write d10/f2a [3265536,104715] 0 2024-09-17T01:52:09.864 INFO:tasks.workunit.client.1.smithi092.stdout:2/463: read d10/d4c/f72 [2233212,113626] 0 2024-09-17T01:52:09.864 INFO:tasks.workunit.client.0.smithi031.stdout:6/747: mknod d23/d63/d47/d81/dee/c101 0 2024-09-17T01:52:09.866 INFO:tasks.workunit.client.0.smithi031.stdout:9/533: link d3/d4/da0/d36/c3a d3/d4/cac 0 2024-09-17T01:52:09.867 INFO:tasks.workunit.client.0.smithi031.stdout:9/534: fdatasync d3/d19/d1f/f6b 0 2024-09-17T01:52:09.868 INFO:tasks.workunit.client.0.smithi031.stdout:9/535: fdatasync d3/d4/da0/d71/f9e 0 2024-09-17T01:52:09.868 INFO:tasks.workunit.client.0.smithi031.stdout:9/536: readlink d3/d19/d1f/l45 0 2024-09-17T01:52:09.869 INFO:tasks.workunit.client.0.smithi031.stdout:5/529: creat da/fbd x:0 0 0 2024-09-17T01:52:09.871 INFO:tasks.workunit.client.0.smithi031.stdout:6/748: creat d23/d63/d47/df0/f102 x:0 0 0 2024-09-17T01:52:09.873 INFO:tasks.workunit.client.0.smithi031.stdout:2/698: link d1/d3/d2d/d71/l8e d1/d3/d2d/db2/d1e/d2a/d7f/led 0 2024-09-17T01:52:09.879 INFO:tasks.workunit.client.0.smithi031.stdout:0/676: creat d0/d29/d33/d2a/d25/fe6 x:0 0 0 2024-09-17T01:52:09.881 INFO:tasks.workunit.client.0.smithi031.stdout:2/699: unlink d1/d3/df/d11/f13 0 2024-09-17T01:52:09.881 INFO:tasks.workunit.client.0.smithi031.stdout:9/537: rmdir d3/d4/da0/d36 39 2024-09-17T01:52:09.882 INFO:tasks.workunit.client.0.smithi031.stdout:4/838: sync 2024-09-17T01:52:09.882 INFO:tasks.workunit.client.0.smithi031.stdout:8/558: sync 2024-09-17T01:52:09.885 INFO:tasks.workunit.client.0.smithi031.stdout:4/839: stat d8/d3a/d10a/d64/d4d/d75 0 2024-09-17T01:52:09.888 INFO:tasks.workunit.client.0.smithi031.stdout:2/700: mknod d1/d3/d2d/db2/d1e/d2a/d7f/cee 0 2024-09-17T01:52:09.890 INFO:tasks.workunit.client.0.smithi031.stdout:3/620: write db/df/d1d/f48 [2004126,70252] 0 2024-09-17T01:52:09.891 INFO:tasks.workunit.client.0.smithi031.stdout:6/749: link d23/db4/d64/d67/l82 d23/db4/d6a/d72/l103 0 2024-09-17T01:52:09.891 INFO:tasks.workunit.client.0.smithi031.stdout:8/559: dwrite d0/d5/d9b/f9e [0,4194304] 0 2024-09-17T01:52:09.897 INFO:tasks.workunit.client.0.smithi031.stdout:8/560: readlink d0/l76 0 2024-09-17T01:52:09.897 INFO:tasks.workunit.client.0.smithi031.stdout:9/538: creat d3/d47/d96/fad x:0 0 0 2024-09-17T01:52:09.897 INFO:tasks.workunit.client.0.smithi031.stdout:9/539: readlink d3/d19/d1f/l98 0 2024-09-17T01:52:09.898 INFO:tasks.workunit.client.0.smithi031.stdout:9/540: stat d3/d4/f2f 0 2024-09-17T01:52:09.900 INFO:tasks.workunit.client.0.smithi031.stdout:4/840: dwrite d8/d3a/d10a/d64/d4d/d5a/d79/f80 [0,4194304] 0 2024-09-17T01:52:09.903 INFO:tasks.workunit.client.0.smithi031.stdout:8/561: mknod d0/df/dd/d59/d8d/ca6 0 2024-09-17T01:52:09.906 INFO:tasks.workunit.client.0.smithi031.stdout:0/677: dread d0/d29/d33/d2a/d25/da5/fa8 [0,4194304] 0 2024-09-17T01:52:09.908 INFO:tasks.workunit.client.0.smithi031.stdout:5/530: dwrite da/dc/f3a [0,4194304] 0 2024-09-17T01:52:09.910 INFO:tasks.workunit.client.0.smithi031.stdout:0/678: chown d0/d29/d33/l46 251 1 2024-09-17T01:52:09.918 INFO:tasks.workunit.client.0.smithi031.stdout:5/531: dread da/d14/dac/f4c [0,4194304] 0 2024-09-17T01:52:09.920 INFO:tasks.workunit.client.0.smithi031.stdout:9/541: mknod d3/cae 0 2024-09-17T01:52:09.923 INFO:tasks.workunit.client.0.smithi031.stdout:8/562: mknod d0/df/dd/d59/d8d/ca7 0 2024-09-17T01:52:09.924 INFO:tasks.workunit.client.0.smithi031.stdout:3/621: dwrite db/f46 [4194304,4194304] 0 2024-09-17T01:52:09.924 INFO:tasks.workunit.client.0.smithi031.stdout:8/563: stat d0/l26 0 2024-09-17T01:52:09.925 INFO:tasks.workunit.client.0.smithi031.stdout:0/679: symlink d0/d29/da7/db3/d4a/d86/da1/le7 0 2024-09-17T01:52:09.926 INFO:tasks.workunit.client.0.smithi031.stdout:2/701: getdents d1/d3/d2d/d71 0 2024-09-17T01:52:09.928 INFO:tasks.workunit.client.0.smithi031.stdout:5/532: rmdir da/d42/d12/d4a 39 2024-09-17T01:52:09.930 INFO:tasks.workunit.client.0.smithi031.stdout:9/542: creat d3/d19/d80/faf x:0 0 0 2024-09-17T01:52:09.931 INFO:tasks.workunit.client.1.smithi092.stdout:0/531: sync 2024-09-17T01:52:09.931 INFO:tasks.workunit.client.1.smithi092.stdout:3/429: sync 2024-09-17T01:52:09.932 INFO:tasks.workunit.client.1.smithi092.stdout:3/430: write d4/d13/f63 [3752896,33977] 0 2024-09-17T01:52:09.934 INFO:tasks.workunit.client.1.smithi092.stdout:0/532: creat d3/d58/fa4 x:0 0 0 2024-09-17T01:52:09.934 INFO:tasks.workunit.client.0.smithi031.stdout:0/680: chown d0/d29/d33/d2a/d25/d38/l80 6191638 1 2024-09-17T01:52:09.935 INFO:tasks.workunit.client.1.smithi092.stdout:0/533: chown d3/d2e/c78 4 1 2024-09-17T01:52:09.935 INFO:tasks.workunit.client.1.smithi092.stdout:0/534: write d3/da/d1c/d4a/f6e [200262,113971] 0 2024-09-17T01:52:09.936 INFO:tasks.workunit.client.0.smithi031.stdout:0/681: chown d0/d29/d33/fc0 33284779 1 2024-09-17T01:52:09.936 INFO:tasks.workunit.client.1.smithi092.stdout:0/535: chown d3/da/d1c/d3a/l4c 983086296 1 2024-09-17T01:52:09.938 INFO:tasks.workunit.client.0.smithi031.stdout:4/841: dwrite d8/f16 [0,4194304] 0 2024-09-17T01:52:09.940 INFO:tasks.workunit.client.0.smithi031.stdout:9/543: write d3/d19/d1f/f23 [9032712,57040] 0 2024-09-17T01:52:09.943 INFO:tasks.workunit.client.1.smithi092.stdout:0/536: link d3/da/d15/l5d d3/da/d1c/d3a/la5 0 2024-09-17T01:52:09.945 INFO:tasks.workunit.client.1.smithi092.stdout:3/431: dread d4/d2f/f53 [0,4194304] 0 2024-09-17T01:52:09.945 INFO:tasks.workunit.client.0.smithi031.stdout:3/622: link db/f79 db/df/d1d/d37/d6c/d6e/fbc 0 2024-09-17T01:52:09.945 INFO:tasks.workunit.client.0.smithi031.stdout:4/842: fdatasync d8/d3a/fde 0 2024-09-17T01:52:09.946 INFO:tasks.workunit.client.1.smithi092.stdout:0/537: symlink d3/d2e/d55/la6 0 2024-09-17T01:52:09.946 INFO:tasks.workunit.client.0.smithi031.stdout:0/682: truncate d0/d29/f70 191110 0 2024-09-17T01:52:09.946 INFO:tasks.workunit.client.1.smithi092.stdout:0/538: chown d3/da/d1c/f45 699 1 2024-09-17T01:52:09.948 INFO:tasks.workunit.client.0.smithi031.stdout:8/564: rename d0/d5/d54/d60/l7e to d0/df/la8 0 2024-09-17T01:52:09.949 INFO:tasks.workunit.client.0.smithi031.stdout:3/623: rmdir db/df/d1d/d37/d3a 39 2024-09-17T01:52:09.950 INFO:tasks.workunit.client.0.smithi031.stdout:4/843: mknod d8/d3a/d10a/d64/d4d/d75/c10f 0 2024-09-17T01:52:09.953 INFO:tasks.workunit.client.0.smithi031.stdout:8/565: fsync d0/f52 0 2024-09-17T01:52:09.954 INFO:tasks.workunit.client.0.smithi031.stdout:5/533: write da/dc/f27 [1850761,116110] 0 2024-09-17T01:52:09.955 INFO:tasks.workunit.client.0.smithi031.stdout:8/566: chown d0/df/ca1 1261066967 1 2024-09-17T01:52:09.956 INFO:tasks.workunit.client.0.smithi031.stdout:4/844: mkdir d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/d110 0 2024-09-17T01:52:09.956 INFO:tasks.workunit.client.0.smithi031.stdout:2/702: write d1/d3/d2d/db2/d1e/d2a/f95 [3617599,1601] 0 2024-09-17T01:52:09.957 INFO:tasks.workunit.client.0.smithi031.stdout:8/567: chown d0/df/dd/d59/l98 1596 1 2024-09-17T01:52:09.958 INFO:tasks.workunit.client.1.smithi092.stdout:3/432: truncate d4/d16/f48 3372574 0 2024-09-17T01:52:09.962 INFO:tasks.workunit.client.0.smithi031.stdout:5/534: rename da/d42/d12/c2d to da/dc/d98/cbe 0 2024-09-17T01:52:09.962 INFO:tasks.workunit.client.1.smithi092.stdout:3/433: getdents d4/d16/d1b 0 2024-09-17T01:52:09.963 INFO:tasks.workunit.client.1.smithi092.stdout:3/434: read - d4/d16/d1b/f87 zero size 2024-09-17T01:52:09.965 INFO:tasks.workunit.client.0.smithi031.stdout:9/544: write d3/d19/f65 [3992622,85793] 0 2024-09-17T01:52:09.965 INFO:tasks.workunit.client.1.smithi092.stdout:3/435: readlink d4/d16/l19 0 2024-09-17T01:52:09.966 INFO:tasks.workunit.client.1.smithi092.stdout:0/539: dread d3/f12 [0,4194304] 0 2024-09-17T01:52:09.966 INFO:tasks.workunit.client.0.smithi031.stdout:4/845: write d8/d3a/d10a/f60 [4849409,17150] 0 2024-09-17T01:52:09.967 INFO:tasks.workunit.client.1.smithi092.stdout:3/436: write d4/d16/d1b/f55 [1496164,62482] 0 2024-09-17T01:52:09.969 INFO:tasks.workunit.client.1.smithi092.stdout:0/540: unlink d3/d58/fa4 0 2024-09-17T01:52:09.970 INFO:tasks.workunit.client.0.smithi031.stdout:2/703: dwrite d1/d3/d2d/d42/f83 [0,4194304] 0 2024-09-17T01:52:09.973 INFO:tasks.workunit.client.0.smithi031.stdout:8/568: dwrite d0/df/d19/d86/fa3 [0,4194304] 0 2024-09-17T01:52:09.973 INFO:tasks.workunit.client.0.smithi031.stdout:9/545: fsync d3/d19/d1f/f58 0 2024-09-17T01:52:09.973 INFO:tasks.workunit.client.0.smithi031.stdout:5/535: mkdir da/d42/d12/d4a/dbf 0 2024-09-17T01:52:09.980 INFO:tasks.workunit.client.0.smithi031.stdout:0/683: dread d0/d29/d33/d5/f62 [0,4194304] 0 2024-09-17T01:52:09.980 INFO:tasks.workunit.client.0.smithi031.stdout:4/846: write d8/d3a/d10a/d64/d4d/d8f/fcc [2915014,22016] 0 2024-09-17T01:52:09.981 INFO:tasks.workunit.client.1.smithi092.stdout:0/541: write d3/d2e/d3b/d8f/f52 [800807,54127] 0 2024-09-17T01:52:09.982 INFO:tasks.workunit.client.1.smithi092.stdout:3/437: dread d4/d2f/d44/d3c/f3e [0,4194304] 0 2024-09-17T01:52:09.983 INFO:tasks.workunit.client.1.smithi092.stdout:0/542: mkdir d3/d2e/d3b/da7 0 2024-09-17T01:52:09.986 INFO:tasks.workunit.client.0.smithi031.stdout:9/546: write d3/d4/da0/d36/f6e [5139588,129372] 0 2024-09-17T01:52:09.991 INFO:tasks.workunit.client.0.smithi031.stdout:2/704: link d1/d3/d2d/d91/fcc d1/d3/d2d/db2/d1e/d4f/d92/fef 0 2024-09-17T01:52:09.997 INFO:tasks.workunit.client.0.smithi031.stdout:4/847: dwrite d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/ff0 [0,4194304] 0 2024-09-17T01:52:09.997 INFO:tasks.workunit.client.1.smithi092.stdout:0/543: truncate d3/f12 994784 0 2024-09-17T01:52:09.998 INFO:tasks.workunit.client.0.smithi031.stdout:9/547: rename d3/d19/d1f/d44/d64/c6c to d3/d19/cb0 0 2024-09-17T01:52:09.999 INFO:tasks.workunit.client.1.smithi092.stdout:0/544: write d3/d2e/d3b/d72/f89 [1042408,37111] 0 2024-09-17T01:52:09.999 INFO:tasks.workunit.client.0.smithi031.stdout:5/536: dread da/d42/d12/f86 [0,4194304] 0 2024-09-17T01:52:10.000 INFO:tasks.workunit.client.0.smithi031.stdout:2/705: creat d1/d3/d2d/ff0 x:0 0 0 2024-09-17T01:52:10.000 INFO:tasks.workunit.client.1.smithi092.stdout:0/545: write d3/d2e/d3b/f82 [316820,112599] 0 2024-09-17T01:52:10.002 INFO:tasks.workunit.client.0.smithi031.stdout:4/848: chown d8/d3a/d10a/d64/d4f/fe5 3 1 2024-09-17T01:52:10.003 INFO:tasks.workunit.client.0.smithi031.stdout:4/849: chown d8/d3a/d7e 11 1 2024-09-17T01:52:10.004 INFO:tasks.workunit.client.0.smithi031.stdout:9/548: symlink d3/d4/da0/d36/d79/lb1 0 2024-09-17T01:52:10.005 INFO:tasks.workunit.client.0.smithi031.stdout:9/549: fdatasync d3/d4/f27 0 2024-09-17T01:52:10.007 INFO:tasks.workunit.client.1.smithi092.stdout:0/546: write d3/da/d15/d30/f3c [4910722,65096] 0 2024-09-17T01:52:10.008 INFO:tasks.workunit.client.0.smithi031.stdout:5/537: creat da/d4b/d6c/fc0 x:0 0 0 2024-09-17T01:52:10.011 INFO:tasks.workunit.client.1.smithi092.stdout:0/547: rmdir d3/d1d/d6b 39 2024-09-17T01:52:10.014 INFO:tasks.workunit.client.0.smithi031.stdout:5/538: chown da/d42/d12/d4a/f71 50962 1 2024-09-17T01:52:10.014 INFO:tasks.workunit.client.0.smithi031.stdout:0/684: truncate d0/d29/fa2 4056117 0 2024-09-17T01:52:10.015 INFO:tasks.workunit.client.1.smithi092.stdout:0/548: rename d3/da/d1c/l34 to d3/d2e/d3b/d72/la8 0 2024-09-17T01:52:10.019 INFO:tasks.workunit.client.0.smithi031.stdout:2/706: write d1/d3/df/d11/d30/db1/fb7 [97890,100935] 0 2024-09-17T01:52:10.021 INFO:tasks.workunit.client.0.smithi031.stdout:9/550: dwrite d3/d4/da0/d71/f9e [0,4194304] 0 2024-09-17T01:52:10.024 INFO:tasks.workunit.client.0.smithi031.stdout:9/551: chown d3/d19/d1f/c3d 3577945 1 2024-09-17T01:52:10.026 INFO:tasks.workunit.client.0.smithi031.stdout:2/707: dread - d1/d3/d2d/ff0 zero size 2024-09-17T01:52:10.028 INFO:tasks.workunit.client.0.smithi031.stdout:8/569: dwrite d0/d5/d54/d60/f62 [0,4194304] 0 2024-09-17T01:52:10.030 INFO:tasks.workunit.client.0.smithi031.stdout:0/685: mknod d0/d29/d33/d2a/d25/d38/ce8 0 2024-09-17T01:52:10.033 INFO:tasks.workunit.client.0.smithi031.stdout:4/850: dread d8/fd [0,4194304] 0 2024-09-17T01:52:10.035 INFO:tasks.workunit.client.0.smithi031.stdout:5/539: dwrite da/d42/d26/fa6 [0,4194304] 0 2024-09-17T01:52:10.035 INFO:tasks.workunit.client.1.smithi092.stdout:0/549: dwrite d3/d73/f9d [0,4194304] 0 2024-09-17T01:52:10.039 INFO:tasks.workunit.client.0.smithi031.stdout:9/552: truncate d3/d19/d1f/f58 3373670 0 2024-09-17T01:52:10.040 INFO:tasks.workunit.client.1.smithi092.stdout:0/550: creat d3/da/d15/d30/fa9 x:0 0 0 2024-09-17T01:52:10.042 INFO:tasks.workunit.client.1.smithi092.stdout:0/551: creat d3/d2e/d3b/faa x:0 0 0 2024-09-17T01:52:10.043 INFO:tasks.workunit.client.0.smithi031.stdout:9/553: write d3/d4/da0/d71/f9e [3833445,34122] 0 2024-09-17T01:52:10.046 INFO:tasks.workunit.client.0.smithi031.stdout:2/708: getdents d1/d3/d2d 0 2024-09-17T01:52:10.047 INFO:tasks.workunit.client.0.smithi031.stdout:4/851: creat d8/d3a/d10a/d64/f111 x:0 0 0 2024-09-17T01:52:10.048 INFO:tasks.workunit.client.0.smithi031.stdout:0/686: dwrite d0/d29/da7/db3/d4a/d86/fd9 [0,4194304] 0 2024-09-17T01:52:10.051 INFO:tasks.workunit.client.0.smithi031.stdout:9/554: mkdir d3/d4/da0/d36/d62/db2 0 2024-09-17T01:52:10.061 INFO:tasks.workunit.client.0.smithi031.stdout:5/540: dwrite da/dc/f73 [0,4194304] 0 2024-09-17T01:52:10.061 INFO:tasks.workunit.client.0.smithi031.stdout:9/555: chown d3/d4/f2f 486743 1 2024-09-17T01:52:10.069 INFO:tasks.workunit.client.1.smithi092.stdout:0/552: truncate d3/da/d15/d30/f3c 4058612 0 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:9/477: sync 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:6/434: sync 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:5/418: sync 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:7/492: sync 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:4/613: sync 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:1/560: sync 2024-09-17T01:52:10.070 INFO:tasks.workunit.client.1.smithi092.stdout:8/404: sync 2024-09-17T01:52:10.072 INFO:tasks.workunit.client.1.smithi092.stdout:9/478: chown d0/d7/l62 1068984 1 2024-09-17T01:52:10.072 INFO:tasks.workunit.client.0.smithi031.stdout:2/709: creat d1/d3/df/d11/d30/ddd/ff1 x:0 0 0 2024-09-17T01:52:10.072 INFO:tasks.workunit.client.0.smithi031.stdout:8/570: dread d0/d5/d9b/f49 [0,4194304] 0 2024-09-17T01:52:10.073 INFO:tasks.workunit.client.1.smithi092.stdout:5/419: truncate d0/de/f6f 226687 0 2024-09-17T01:52:10.075 INFO:tasks.workunit.client.0.smithi031.stdout:8/571: write d0/df/dd/f51 [1987709,27791] 0 2024-09-17T01:52:10.075 INFO:tasks.workunit.client.0.smithi031.stdout:5/541: chown da/d42/d12/d72/lad 202014 1 2024-09-17T01:52:10.077 INFO:tasks.workunit.client.1.smithi092.stdout:5/420: chown d0/de/d19/d1a/d1e/d74/f83 38994 1 2024-09-17T01:52:10.078 INFO:tasks.workunit.client.0.smithi031.stdout:0/687: creat d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/fe9 x:0 0 0 2024-09-17T01:52:10.080 INFO:tasks.workunit.client.0.smithi031.stdout:9/556: mkdir d3/d4/da0/d36/d99/db3 0 2024-09-17T01:52:10.081 INFO:tasks.workunit.client.1.smithi092.stdout:8/405: symlink d15/d32/d40/d42/d6b/l7d 0 2024-09-17T01:52:10.081 INFO:tasks.workunit.client.0.smithi031.stdout:8/572: stat d0/d5/c34 0 2024-09-17T01:52:10.082 INFO:tasks.workunit.client.1.smithi092.stdout:4/614: dwrite d4/d13/d3b/f6d [4194304,4194304] 0 2024-09-17T01:52:10.082 INFO:tasks.workunit.client.1.smithi092.stdout:1/561: link l9 db/d1d/d2e/lb9 0 2024-09-17T01:52:10.083 INFO:tasks.workunit.client.1.smithi092.stdout:1/562: fdatasync db/faa 0 2024-09-17T01:52:10.084 INFO:tasks.workunit.client.0.smithi031.stdout:0/688: creat d0/d29/d33/d5/d48/d56/fea x:0 0 0 2024-09-17T01:52:10.085 INFO:tasks.workunit.client.0.smithi031.stdout:9/557: dread d3/d19/d1f/f6b [0,4194304] 0 2024-09-17T01:52:10.086 INFO:tasks.workunit.client.1.smithi092.stdout:5/421: mkdir d0/de/d19/d3c/d41/d8d 0 2024-09-17T01:52:10.086 INFO:tasks.workunit.client.0.smithi031.stdout:2/710: rename d1/d3/d2d/d71/l8e to d1/d3/d2d/da6/de9/lf2 0 2024-09-17T01:52:10.086 INFO:tasks.workunit.client.0.smithi031.stdout:9/558: dread - d3/d4/da0/d36/f9b zero size 2024-09-17T01:52:10.087 INFO:tasks.workunit.client.0.smithi031.stdout:5/542: symlink da/d42/d12/lc1 0 2024-09-17T01:52:10.089 INFO:tasks.workunit.client.0.smithi031.stdout:8/573: mkdir d0/df/dd/da9 0 2024-09-17T01:52:10.089 INFO:tasks.workunit.client.1.smithi092.stdout:1/563: creat db/d6c/d8b/fba x:0 0 0 2024-09-17T01:52:10.091 INFO:tasks.workunit.client.0.smithi031.stdout:4/852: getdents d8/d3a/d10a/d64/d4d/d8f 0 2024-09-17T01:52:10.091 INFO:tasks.workunit.client.0.smithi031.stdout:2/711: truncate d1/d3/d2d/db2/d1e/d21/fcf 291699 0 2024-09-17T01:52:10.092 INFO:tasks.workunit.client.0.smithi031.stdout:0/689: creat d0/d37/db9/feb x:0 0 0 2024-09-17T01:52:10.092 INFO:tasks.workunit.client.0.smithi031.stdout:9/559: mknod d3/d4c/cb4 0 2024-09-17T01:52:10.093 INFO:tasks.workunit.client.1.smithi092.stdout:1/564: dread - db/d1d/d23/f89 zero size 2024-09-17T01:52:10.094 INFO:tasks.workunit.client.1.smithi092.stdout:4/615: dwrite d4/d13/d3b/d42/d76/d35/f84 [0,4194304] 0 2024-09-17T01:52:10.095 INFO:tasks.workunit.client.0.smithi031.stdout:0/690: fsync d0/d29/d33/d2a/fce 0 2024-09-17T01:52:10.095 INFO:tasks.workunit.client.0.smithi031.stdout:8/574: rmdir d0/df/dd/d59 39 2024-09-17T01:52:10.095 INFO:tasks.workunit.client.1.smithi092.stdout:4/616: chown d4/d5/d8/lcb 1816266 1 2024-09-17T01:52:10.096 INFO:tasks.workunit.client.0.smithi031.stdout:2/712: creat d1/d3/df/d11/d30/ddd/ff3 x:0 0 0 2024-09-17T01:52:10.096 INFO:tasks.workunit.client.1.smithi092.stdout:9/479: rename d0/df/d5d/f74 to d0/d7/d12/d34/d26/f90 0 2024-09-17T01:52:10.097 INFO:tasks.workunit.client.0.smithi031.stdout:5/543: mkdir da/d14/dac/dc2 0 2024-09-17T01:52:10.103 INFO:tasks.workunit.client.0.smithi031.stdout:2/713: write d1/d3/d2d/db2/d1e/d4f/fc6 [1446883,21815] 0 2024-09-17T01:52:10.103 INFO:tasks.workunit.client.0.smithi031.stdout:8/575: creat d0/d5/da2/faa x:0 0 0 2024-09-17T01:52:10.104 INFO:tasks.workunit.client.1.smithi092.stdout:6/435: dread d3/d10/d1a/d43/d6a/f50 [0,4194304] 0 2024-09-17T01:52:10.105 INFO:tasks.workunit.client.1.smithi092.stdout:5/422: rename d0/de/d19/d1a/f25 to d0/de/f8e 0 2024-09-17T01:52:10.106 INFO:tasks.workunit.client.0.smithi031.stdout:9/560: dwrite d3/d19/f22 [4194304,4194304] 0 2024-09-17T01:52:10.107 INFO:tasks.workunit.client.1.smithi092.stdout:7/493: dwrite d3/d6/d13/d21/d2e/d6e/f20 [0,4194304] 0 2024-09-17T01:52:10.109 INFO:tasks.workunit.client.1.smithi092.stdout:9/480: link d0/d7/d12/d34/f56 d0/d5/d29/f91 0 2024-09-17T01:52:10.110 INFO:tasks.workunit.client.0.smithi031.stdout:2/714: chown d1/d3/d2d/db2/d1e/d21/l35 111390 1 2024-09-17T01:52:10.110 INFO:tasks.workunit.client.0.smithi031.stdout:0/691: dread d0/d29/d33/d5b/f6d [0,4194304] 0 2024-09-17T01:52:10.111 INFO:tasks.workunit.client.0.smithi031.stdout:8/576: truncate d0/df/d19/f33 6690949 0 2024-09-17T01:52:10.111 INFO:tasks.workunit.client.0.smithi031.stdout:0/692: readlink d0/d29/l36 0 2024-09-17T01:52:10.112 INFO:tasks.workunit.client.0.smithi031.stdout:9/561: mkdir d3/d19/db5 0 2024-09-17T01:52:10.113 INFO:tasks.workunit.client.1.smithi092.stdout:7/494: dread d3/d6/d13/d21/d2e/f59 [0,4194304] 0 2024-09-17T01:52:10.113 INFO:tasks.workunit.client.0.smithi031.stdout:8/577: fsync d0/df/dd/f51 0 2024-09-17T01:52:10.114 INFO:tasks.workunit.client.0.smithi031.stdout:2/715: creat d1/d3/d2d/d91/ff4 x:0 0 0 2024-09-17T01:52:10.116 INFO:tasks.workunit.client.1.smithi092.stdout:4/617: dwrite d4/d5/d1d/f1a [0,4194304] 0 2024-09-17T01:52:10.117 INFO:tasks.workunit.client.1.smithi092.stdout:5/423: unlink d0/d23/l38 0 2024-09-17T01:52:10.118 INFO:tasks.workunit.client.1.smithi092.stdout:6/436: creat d3/d10/d1a/d43/d6a/d3d/f88 x:0 0 0 2024-09-17T01:52:10.118 INFO:tasks.workunit.client.0.smithi031.stdout:4/853: dread d8/fc [0,4194304] 0 2024-09-17T01:52:10.118 INFO:tasks.workunit.client.1.smithi092.stdout:4/618: write d4/d13/d20/f29 [736377,34446] 0 2024-09-17T01:52:10.119 INFO:tasks.workunit.client.0.smithi031.stdout:0/693: mkdir d0/d29/d33/d5/dec 0 2024-09-17T01:52:10.121 INFO:tasks.workunit.client.1.smithi092.stdout:7/495: creat d3/d2b/d84/fab x:0 0 0 2024-09-17T01:52:10.121 INFO:tasks.workunit.client.0.smithi031.stdout:8/578: chown d0/df/dd/d59/l7c 13 1 2024-09-17T01:52:10.125 INFO:tasks.workunit.client.0.smithi031.stdout:0/694: creat d0/d29/da7/db3/d9c/fed x:0 0 0 2024-09-17T01:52:10.125 INFO:tasks.workunit.client.1.smithi092.stdout:9/481: link d0/df/f84 d0/d7/d12/d34/d26/d54/d6b/f92 0 2024-09-17T01:52:10.126 INFO:tasks.workunit.client.1.smithi092.stdout:5/424: readlink d0/de/d19/d1a/d1e/d3e/d4c/l56 0 2024-09-17T01:52:10.127 INFO:tasks.workunit.client.1.smithi092.stdout:1/565: write db/f5f [1382113,129891] 0 2024-09-17T01:52:10.128 INFO:tasks.workunit.client.1.smithi092.stdout:7/496: symlink d3/d2b/d84/lac 0 2024-09-17T01:52:10.128 INFO:tasks.workunit.client.0.smithi031.stdout:0/695: write d0/d29/da7/db3/d4a/d86/da1/fc4 [1807277,68813] 0 2024-09-17T01:52:10.129 INFO:tasks.workunit.client.1.smithi092.stdout:8/406: dread d15/d25/f5a [0,4194304] 0 2024-09-17T01:52:10.130 INFO:tasks.workunit.client.0.smithi031.stdout:4/854: mknod d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/c112 0 2024-09-17T01:52:10.130 INFO:tasks.workunit.client.0.smithi031.stdout:8/579: dread d0/d5/f7d [0,4194304] 0 2024-09-17T01:52:10.132 INFO:tasks.workunit.client.1.smithi092.stdout:6/437: dwrite d3/d10/d1a/d49/f75 [0,4194304] 0 2024-09-17T01:52:10.132 INFO:tasks.workunit.client.0.smithi031.stdout:2/716: creat d1/d3/df/d11/d44/ff5 x:0 0 0 2024-09-17T01:52:10.134 INFO:tasks.workunit.client.1.smithi092.stdout:8/407: chown d15/f74 10 1 2024-09-17T01:52:10.137 INFO:tasks.workunit.client.1.smithi092.stdout:9/482: getdents d0 0 2024-09-17T01:52:10.137 INFO:tasks.workunit.client.0.smithi031.stdout:0/696: dread d0/d29/d33/d5/f62 [0,4194304] 0 2024-09-17T01:52:10.141 INFO:tasks.workunit.client.0.smithi031.stdout:4/855: write d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/fbd [215354,38735] 0 2024-09-17T01:52:10.142 INFO:tasks.workunit.client.0.smithi031.stdout:0/697: chown d0/d29/d33/d5/d48/d56/dc8/ldd 2178948 1 2024-09-17T01:52:10.142 INFO:tasks.workunit.client.1.smithi092.stdout:8/408: write d15/f1e [3570931,88000] 0 2024-09-17T01:52:10.143 INFO:tasks.workunit.client.0.smithi031.stdout:8/580: creat d0/d5/fab x:0 0 0 2024-09-17T01:52:10.145 INFO:tasks.workunit.client.1.smithi092.stdout:4/619: dwrite d4/d5/fa2 [0,4194304] 0 2024-09-17T01:52:10.145 INFO:tasks.workunit.client.1.smithi092.stdout:8/409: fdatasync f7 0 2024-09-17T01:52:10.146 INFO:tasks.workunit.client.0.smithi031.stdout:8/581: fsync d0/d5/d9b/f5c 0 2024-09-17T01:52:10.146 INFO:tasks.workunit.client.0.smithi031.stdout:0/698: chown d0/d29/da7/db3/d4a/d86/dd7/c6a 1100 1 2024-09-17T01:52:10.148 INFO:tasks.workunit.client.1.smithi092.stdout:5/425: dwrite d0/de/d19/d1a/d1e/d29/f7c [0,4194304] 0 2024-09-17T01:52:10.151 INFO:tasks.workunit.client.0.smithi031.stdout:0/699: creat d0/d29/d33/d5/d48/d8c/fee x:0 0 0 2024-09-17T01:52:10.151 INFO:tasks.workunit.client.1.smithi092.stdout:1/566: dwrite db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:10.154 INFO:tasks.workunit.client.0.smithi031.stdout:8/582: creat d0/df/dd/d59/d8d/fac x:0 0 0 2024-09-17T01:52:10.156 INFO:tasks.workunit.client.1.smithi092.stdout:8/410: creat d15/d32/d3b/f7e x:0 0 0 2024-09-17T01:52:10.159 INFO:tasks.workunit.client.1.smithi092.stdout:6/438: write d3/d10/d1f/d21/d28/f2f [1046778,100295] 0 2024-09-17T01:52:10.159 INFO:tasks.workunit.client.1.smithi092.stdout:1/567: unlink db/d1d/d23/d85/f9d 0 2024-09-17T01:52:10.160 INFO:tasks.workunit.client.0.smithi031.stdout:7/639: sync 2024-09-17T01:52:10.162 INFO:tasks.workunit.client.1.smithi092.stdout:1/568: mknod db/d6c/cbb 0 2024-09-17T01:52:10.162 INFO:tasks.workunit.client.1.smithi092.stdout:9/483: dwrite d0/d5/d29/f55 [4194304,4194304] 0 2024-09-17T01:52:10.164 INFO:tasks.workunit.client.0.smithi031.stdout:8/583: rename d0/df/dd/d59/d8d/ca7 to d0/df/d19/d86/cad 0 2024-09-17T01:52:10.166 INFO:tasks.workunit.client.0.smithi031.stdout:0/700: truncate d0/d29/da7/db3/d4a/f54 1246189 0 2024-09-17T01:52:10.167 INFO:tasks.workunit.client.1.smithi092.stdout:1/569: rmdir db/d1d/d2e 39 2024-09-17T01:52:10.168 INFO:tasks.workunit.client.1.smithi092.stdout:5/426: dwrite d0/de/d19/d1a/d1e/f36 [4194304,4194304] 0 2024-09-17T01:52:10.169 INFO:tasks.workunit.client.0.smithi031.stdout:8/584: fsync d0/d5/d9b/f49 0 2024-09-17T01:52:10.169 INFO:tasks.workunit.client.1.smithi092.stdout:8/411: getdents d15/d25 0 2024-09-17T01:52:10.170 INFO:tasks.workunit.client.1.smithi092.stdout:6/439: mknod d3/d10/d1f/d21/d1e/c89 0 2024-09-17T01:52:10.170 INFO:tasks.workunit.client.1.smithi092.stdout:9/484: dread - d0/d7/d12/d34/d26/d54/d2e/f8d zero size 2024-09-17T01:52:10.171 INFO:tasks.workunit.client.0.smithi031.stdout:8/585: chown d0/d5/d9b/f5f 1326364 1 2024-09-17T01:52:10.172 INFO:tasks.workunit.client.0.smithi031.stdout:4/856: dread d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fd4 [0,4194304] 0 2024-09-17T01:52:10.173 INFO:tasks.workunit.client.1.smithi092.stdout:4/620: dwrite d4/d13/d3b/d42/d76/d41/d67/f9e [0,4194304] 0 2024-09-17T01:52:10.173 INFO:tasks.workunit.client.1.smithi092.stdout:1/570: mknod db/d1d/d4b/d9a/cbc 0 2024-09-17T01:52:10.176 INFO:tasks.workunit.client.0.smithi031.stdout:5/544: write da/d42/f5c [226984,87922] 0 2024-09-17T01:52:10.180 INFO:tasks.workunit.client.1.smithi092.stdout:2/464: sync 2024-09-17T01:52:10.180 INFO:tasks.workunit.client.1.smithi092.stdout:3/438: sync 2024-09-17T01:52:10.180 INFO:tasks.workunit.client.1.smithi092.stdout:9/485: read d0/df/f66 [532366,49810] 0 2024-09-17T01:52:10.182 INFO:tasks.workunit.client.1.smithi092.stdout:2/465: fsync d10/f2a 0 2024-09-17T01:52:10.183 INFO:tasks.workunit.client.0.smithi031.stdout:5/545: mkdir da/d14/dac/d82/dc3 0 2024-09-17T01:52:10.185 INFO:tasks.workunit.client.0.smithi031.stdout:4/857: creat d8/d3a/f113 x:0 0 0 2024-09-17T01:52:10.185 INFO:tasks.workunit.client.1.smithi092.stdout:9/486: chown d0/f32 30546312 1 2024-09-17T01:52:10.188 INFO:tasks.workunit.client.1.smithi092.stdout:2/466: write d10/d1d/d2c/f3d [1643635,78583] 0 2024-09-17T01:52:10.188 INFO:tasks.workunit.client.1.smithi092.stdout:3/439: fsync d4/d13/d2e/f75 0 2024-09-17T01:52:10.190 INFO:tasks.workunit.client.0.smithi031.stdout:9/562: dwrite d3/f2a [0,4194304] 0 2024-09-17T01:52:10.190 INFO:tasks.workunit.client.0.smithi031.stdout:5/546: rename da/d42/d12/d72/lad to da/d42/d12/d72/lc4 0 2024-09-17T01:52:10.191 INFO:tasks.workunit.client.1.smithi092.stdout:4/621: dwrite d4/d5/fa2 [4194304,4194304] 0 2024-09-17T01:52:10.191 INFO:tasks.workunit.client.1.smithi092.stdout:7/497: dread d3/d6/d13/d40/f4f [0,4194304] 0 2024-09-17T01:52:10.192 INFO:tasks.workunit.client.1.smithi092.stdout:6/440: dwrite d3/d10/d1a/d43/d6a/d3d/f88 [0,4194304] 0 2024-09-17T01:52:10.193 INFO:tasks.workunit.client.1.smithi092.stdout:9/487: read d0/d7/d12/d34/d26/d54/f4e [1301804,73161] 0 2024-09-17T01:52:10.193 INFO:tasks.workunit.client.0.smithi031.stdout:4/858: unlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/ffe 0 2024-09-17T01:52:10.195 INFO:tasks.workunit.client.1.smithi092.stdout:4/622: chown d4/d13/d3b/d42/f86 50 1 2024-09-17T01:52:10.195 INFO:tasks.workunit.client.0.smithi031.stdout:9/563: write d3/d19/d1f/d44/d64/f97 [6285388,4470] 0 2024-09-17T01:52:10.196 INFO:tasks.workunit.client.1.smithi092.stdout:9/488: write d0/f4c [4300633,124692] 0 2024-09-17T01:52:10.197 INFO:tasks.workunit.client.1.smithi092.stdout:3/440: read d4/d16/f24 [7348286,103550] 0 2024-09-17T01:52:10.198 INFO:tasks.workunit.client.1.smithi092.stdout:4/623: chown d4/d5/d8/d99/daf/cc2 0 1 2024-09-17T01:52:10.198 INFO:tasks.workunit.client.0.smithi031.stdout:9/564: write d3/d4/f7f [3802329,39940] 0 2024-09-17T01:52:10.199 INFO:tasks.workunit.client.0.smithi031.stdout:2/717: dwrite d1/d3/d2d/db2/d1e/d21/ddf/f73 [0,4194304] 0 2024-09-17T01:52:10.200 INFO:tasks.workunit.client.1.smithi092.stdout:4/624: write d4/d13/f17 [3462729,34430] 0 2024-09-17T01:52:10.201 INFO:tasks.workunit.client.0.smithi031.stdout:9/565: chown d3/d4/d29 32424 1 2024-09-17T01:52:10.202 INFO:tasks.workunit.client.0.smithi031.stdout:1/687: sync 2024-09-17T01:52:10.202 INFO:tasks.workunit.client.0.smithi031.stdout:1/688: stat d4/l27 0 2024-09-17T01:52:10.203 INFO:tasks.workunit.client.1.smithi092.stdout:6/441: chown d3/d10/d1f/d21/d28/d2b/d48/l46 3646 1 2024-09-17T01:52:10.203 INFO:tasks.workunit.client.1.smithi092.stdout:2/467: getdents d10/d3a 0 2024-09-17T01:52:10.204 INFO:tasks.workunit.client.1.smithi092.stdout:3/441: write d4/d73/f7e [117199,30589] 0 2024-09-17T01:52:10.205 INFO:tasks.workunit.client.0.smithi031.stdout:9/566: dread - d3/d4/da0/d36/f9c zero size 2024-09-17T01:52:10.206 INFO:tasks.workunit.client.1.smithi092.stdout:4/625: creat d4/d5/d8/d99/daf/fce x:0 0 0 2024-09-17T01:52:10.207 INFO:tasks.workunit.client.0.smithi031.stdout:2/718: mknod d1/d7c/cf6 0 2024-09-17T01:52:10.208 INFO:tasks.workunit.client.0.smithi031.stdout:4/859: rename d8/d9c/fbc to d8/d3a/d7e/f114 0 2024-09-17T01:52:10.209 INFO:tasks.workunit.client.1.smithi092.stdout:6/442: write d3/d10/d1f/d21/d28/f54 [4628835,108073] 0 2024-09-17T01:52:10.209 INFO:tasks.workunit.client.1.smithi092.stdout:3/442: mkdir d4/d73/d8f 0 2024-09-17T01:52:10.211 INFO:tasks.workunit.client.0.smithi031.stdout:1/689: symlink d4/d1e/d3f/d72/d7e/d92/le8 0 2024-09-17T01:52:10.212 INFO:tasks.workunit.client.1.smithi092.stdout:3/443: write d4/d16/d1b/f55 [3537907,101928] 0 2024-09-17T01:52:10.214 INFO:tasks.workunit.client.1.smithi092.stdout:3/444: stat d4/d73/d8f 0 2024-09-17T01:52:10.216 INFO:tasks.workunit.client.0.smithi031.stdout:4/860: write d8/d3a/d10a/d64/d4d/f81 [1945808,114311] 0 2024-09-17T01:52:10.216 INFO:tasks.workunit.client.1.smithi092.stdout:9/489: dwrite d0/d7/d12/d34/d26/d54/d6b/f78 [0,4194304] 0 2024-09-17T01:52:10.218 INFO:tasks.workunit.client.0.smithi031.stdout:9/567: dwrite d3/d4/d29/fa8 [0,4194304] 0 2024-09-17T01:52:10.219 INFO:tasks.workunit.client.0.smithi031.stdout:1/690: creat d4/d1e/d40/fe9 x:0 0 0 2024-09-17T01:52:10.219 INFO:tasks.workunit.client.1.smithi092.stdout:4/626: mkdir d4/d5/d8/d99/dcf 0 2024-09-17T01:52:10.221 INFO:tasks.workunit.client.0.smithi031.stdout:4/861: write d8/d3a/d10a/d64/d4d/d5a/d79/f80 [3695078,111097] 0 2024-09-17T01:52:10.222 INFO:tasks.workunit.client.0.smithi031.stdout:7/640: dread db/d1c/d46/f60 [0,4194304] 0 2024-09-17T01:52:10.223 INFO:tasks.workunit.client.1.smithi092.stdout:3/445: creat d4/d2f/d44/d3c/f90 x:0 0 0 2024-09-17T01:52:10.224 INFO:tasks.workunit.client.0.smithi031.stdout:0/701: truncate d0/f99 302628 0 2024-09-17T01:52:10.227 INFO:tasks.workunit.client.0.smithi031.stdout:8/586: write d0/d5/d9b/f4b [393765,72063] 0 2024-09-17T01:52:10.227 INFO:tasks.workunit.client.1.smithi092.stdout:2/468: link d10/f14 d10/d1d/d96/d77/f9f 0 2024-09-17T01:52:10.229 INFO:tasks.workunit.client.0.smithi031.stdout:9/568: rmdir d3/d4/da0/d36/d8f 39 2024-09-17T01:52:10.230 INFO:tasks.workunit.client.1.smithi092.stdout:9/490: dwrite d0/df/d17/f51 [0,4194304] 0 2024-09-17T01:52:10.234 INFO:tasks.workunit.client.1.smithi092.stdout:4/627: dread d4/d5/d1d/d30/d7a/fab [0,4194304] 0 2024-09-17T01:52:10.235 INFO:tasks.workunit.client.1.smithi092.stdout:3/446: dread d4/d2f/d44/d3c/f3e [0,4194304] 0 2024-09-17T01:52:10.236 INFO:tasks.workunit.client.0.smithi031.stdout:7/641: creat db/d1c/d41/d6c/fc4 x:0 0 0 2024-09-17T01:52:10.236 INFO:tasks.workunit.client.1.smithi092.stdout:1/571: dwrite db/d3b/f54 [0,4194304] 0 2024-09-17T01:52:10.237 INFO:tasks.workunit.client.0.smithi031.stdout:0/702: dwrite d0/d29/da7/db3/d4a/d86/fc2 [0,4194304] 0 2024-09-17T01:52:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:09 smithi092 ceph-mon[33552]: pgmap v15: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 223 MiB/s wr, 375 op/s 2024-09-17T01:52:10.239 INFO:tasks.workunit.client.0.smithi031.stdout:8/587: truncate d0/df/d19/f31 1002673 0 2024-09-17T01:52:10.241 INFO:tasks.workunit.client.0.smithi031.stdout:6/750: sync 2024-09-17T01:52:10.241 INFO:tasks.workunit.client.0.smithi031.stdout:3/624: sync 2024-09-17T01:52:10.243 INFO:tasks.workunit.client.1.smithi092.stdout:4/628: write d4/d5/f15 [3817678,72015] 0 2024-09-17T01:52:10.245 INFO:tasks.workunit.client.1.smithi092.stdout:7/498: dwrite d3/db/f15 [0,4194304] 0 2024-09-17T01:52:10.245 INFO:tasks.workunit.client.0.smithi031.stdout:8/588: mknod d0/d5/d6c/cae 0 2024-09-17T01:52:10.247 INFO:tasks.workunit.client.0.smithi031.stdout:9/569: mknod d3/d4/d29/cb6 0 2024-09-17T01:52:10.248 INFO:tasks.workunit.client.0.smithi031.stdout:1/691: creat d4/d3d/d65/fea x:0 0 0 2024-09-17T01:52:10.249 INFO:tasks.workunit.client.1.smithi092.stdout:9/491: dwrite d0/df/f27 [0,4194304] 0 2024-09-17T01:52:10.250 INFO:tasks.workunit.client.1.smithi092.stdout:3/447: dwrite d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T01:52:10.251 INFO:tasks.workunit.client.1.smithi092.stdout:1/572: unlink db/d1d/d2e/d62/c65 0 2024-09-17T01:52:10.251 INFO:tasks.workunit.client.1.smithi092.stdout:4/629: truncate d4/f1e 5192613 0 2024-09-17T01:52:10.252 INFO:tasks.workunit.client.0.smithi031.stdout:5/547: dread da/d14/dac/d82/f8b [0,4194304] 0 2024-09-17T01:52:10.253 INFO:tasks.workunit.client.1.smithi092.stdout:4/630: chown d4/d13/d3b/l61 0 1 2024-09-17T01:52:10.253 INFO:tasks.workunit.client.1.smithi092.stdout:7/499: read d3/db/d26/f43 [44898,93240] 0 2024-09-17T01:52:10.254 INFO:tasks.workunit.client.0.smithi031.stdout:5/548: fdatasync da/d42/d26/f9f 0 2024-09-17T01:52:10.255 INFO:tasks.workunit.client.0.smithi031.stdout:3/625: symlink db/df/d1d/d37/d77/lbd 0 2024-09-17T01:52:10.256 INFO:tasks.workunit.client.1.smithi092.stdout:9/492: mkdir d0/d7/d12/d86/d93 0 2024-09-17T01:52:10.257 INFO:tasks.workunit.client.1.smithi092.stdout:3/448: mkdir d4/d13/d2e/d91 0 2024-09-17T01:52:10.258 INFO:tasks.workunit.client.0.smithi031.stdout:0/703: creat d0/d29/d33/d2a/d25/d38/fef x:0 0 0 2024-09-17T01:52:10.259 INFO:tasks.workunit.client.0.smithi031.stdout:9/570: creat d3/d19/d1f/fb7 x:0 0 0 2024-09-17T01:52:10.261 INFO:tasks.workunit.client.1.smithi092.stdout:3/449: mkdir d4/d73/d8f/d92 0 2024-09-17T01:52:10.262 INFO:tasks.workunit.client.1.smithi092.stdout:3/450: chown d4/f30 4559 1 2024-09-17T01:52:10.263 INFO:tasks.workunit.client.0.smithi031.stdout:8/589: dwrite d0/f70 [0,4194304] 0 2024-09-17T01:52:10.264 INFO:tasks.workunit.client.1.smithi092.stdout:4/631: link d4/d13/d3b/l5e d4/d5/ld0 0 2024-09-17T01:52:10.266 INFO:tasks.workunit.client.1.smithi092.stdout:9/493: read d0/f32 [2293404,76448] 0 2024-09-17T01:52:10.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:09 smithi031 ceph-mon[27673]: pgmap v15: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 223 MiB/s wr, 375 op/s 2024-09-17T01:52:10.267 INFO:tasks.workunit.client.1.smithi092.stdout:7/500: dwrite d3/d6/d13/d40/d60/f88 [4194304,4194304] 0 2024-09-17T01:52:10.267 INFO:tasks.workunit.client.0.smithi031.stdout:4/862: link d8/d3a/d10a/d64/d4d/d5a/df1/fdd d8/d3a/d10a/d64/d4d/d5a/d79/d10b/f115 0 2024-09-17T01:52:10.269 INFO:tasks.workunit.client.0.smithi031.stdout:1/692: rmdir d4/d1e/d3f/d4d/da5 39 2024-09-17T01:52:10.274 INFO:tasks.workunit.client.1.smithi092.stdout:9/494: write d0/d5/d29/f52 [668513,31163] 0 2024-09-17T01:52:10.274 INFO:tasks.workunit.client.1.smithi092.stdout:3/451: dwrite d4/f61 [0,4194304] 0 2024-09-17T01:52:10.275 INFO:tasks.workunit.client.1.smithi092.stdout:3/452: chown d4/c85 44457 1 2024-09-17T01:52:10.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/751: creat d23/d63/f104 x:0 0 0 2024-09-17T01:52:10.278 INFO:tasks.workunit.client.0.smithi031.stdout:7/642: getdents db/d18/d67 0 2024-09-17T01:52:10.279 INFO:tasks.workunit.client.1.smithi092.stdout:3/453: truncate d4/d20/f86 975675 0 2024-09-17T01:52:10.280 INFO:tasks.workunit.client.0.smithi031.stdout:8/590: creat d0/df/dd/d59/d8d/faf x:0 0 0 2024-09-17T01:52:10.281 INFO:tasks.workunit.client.0.smithi031.stdout:7/643: truncate db/d1c/d46/f8a 882798 0 2024-09-17T01:52:10.282 INFO:tasks.workunit.client.1.smithi092.stdout:7/501: mkdir d3/d6/d13/d40/d6a/dad 0 2024-09-17T01:52:10.283 INFO:tasks.workunit.client.0.smithi031.stdout:2/719: write d1/d3/d2d/db2/d1e/f97 [503189,15210] 0 2024-09-17T01:52:10.283 INFO:tasks.workunit.client.0.smithi031.stdout:7/644: chown db/d1c/d41/faf 15699363 1 2024-09-17T01:52:10.285 INFO:tasks.workunit.client.1.smithi092.stdout:3/454: creat d4/d20/d39/f93 x:0 0 0 2024-09-17T01:52:10.286 INFO:tasks.workunit.client.0.smithi031.stdout:4/863: mknod d8/d3a/d10a/d64/d92/c116 0 2024-09-17T01:52:10.287 INFO:tasks.workunit.client.1.smithi092.stdout:9/495: mknod d0/d5/c94 0 2024-09-17T01:52:10.288 INFO:tasks.workunit.client.0.smithi031.stdout:5/549: creat da/d14/dac/dc2/fc5 x:0 0 0 2024-09-17T01:52:10.290 INFO:tasks.workunit.client.0.smithi031.stdout:5/550: chown da/d4b/fba 12048 1 2024-09-17T01:52:10.290 INFO:tasks.workunit.client.1.smithi092.stdout:3/455: creat d4/d73/d7b/f94 x:0 0 0 2024-09-17T01:52:10.291 INFO:tasks.workunit.client.0.smithi031.stdout:8/591: chown d0/df/dd/d59/c5a 0 1 2024-09-17T01:52:10.292 INFO:tasks.workunit.client.1.smithi092.stdout:9/496: symlink d0/d5/d29/l95 0 2024-09-17T01:52:10.294 INFO:tasks.workunit.client.0.smithi031.stdout:7/645: rename db/d18/f7b to db/d1c/d46/d95/fc5 0 2024-09-17T01:52:10.295 INFO:tasks.workunit.client.1.smithi092.stdout:7/502: rmdir d3/d6/d13/d40/d60/d76 0 2024-09-17T01:52:10.298 INFO:tasks.workunit.client.0.smithi031.stdout:9/571: link d3/d19/d1f/d44/d64/f97 d3/d4/fb8 0 2024-09-17T01:52:10.298 INFO:tasks.workunit.client.1.smithi092.stdout:9/497: rename d0/d7/d12/d34/d26/d54/d2e to d0/d7/d12/d86/d93/d96 0 2024-09-17T01:52:10.299 INFO:tasks.workunit.client.1.smithi092.stdout:3/456: mkdir d4/d20/d39/d70/d95 0 2024-09-17T01:52:10.299 INFO:tasks.workunit.client.0.smithi031.stdout:5/551: write da/d14/dac/d82/f8b [259557,91602] 0 2024-09-17T01:52:10.301 INFO:tasks.workunit.client.1.smithi092.stdout:7/503: rename d3/d6/d13/d21/l8f to d3/d6/d13/d40/d6a/dad/lae 0 2024-09-17T01:52:10.302 INFO:tasks.workunit.client.0.smithi031.stdout:5/552: truncate da/d42/f9d 409396 0 2024-09-17T01:52:10.302 INFO:tasks.workunit.client.0.smithi031.stdout:8/592: mkdir d0/d5/d6c/db0 0 2024-09-17T01:52:10.302 INFO:tasks.workunit.client.1.smithi092.stdout:9/498: rename d0 to d0/d7/d21/d97 22 2024-09-17T01:52:10.303 INFO:tasks.workunit.client.0.smithi031.stdout:5/553: readlink da/d42/d12/d72/l7c 0 2024-09-17T01:52:10.304 INFO:tasks.workunit.client.1.smithi092.stdout:9/499: stat d0/d7/d12/d34/d26/d54/f87 0 2024-09-17T01:52:10.305 INFO:tasks.workunit.client.0.smithi031.stdout:9/572: dwrite d3/d19/f34 [0,4194304] 0 2024-09-17T01:52:10.306 INFO:tasks.workunit.client.1.smithi092.stdout:3/457: dwrite d4/d20/f7c [0,4194304] 0 2024-09-17T01:52:10.307 INFO:tasks.workunit.client.0.smithi031.stdout:0/704: getdents d0/d29/da7/db3/d9c 0 2024-09-17T01:52:10.307 INFO:tasks.workunit.client.1.smithi092.stdout:9/500: read d0/df/d17/f51 [1906363,62986] 0 2024-09-17T01:52:10.310 INFO:tasks.workunit.client.0.smithi031.stdout:0/705: fdatasync d0/d29/da7/db3/d4a/d86/fd9 0 2024-09-17T01:52:10.310 INFO:tasks.workunit.client.1.smithi092.stdout:3/458: mknod d4/d2f/d44/d3c/c96 0 2024-09-17T01:52:10.311 INFO:tasks.workunit.client.1.smithi092.stdout:4/632: dread d4/d13/d20/f29 [4194304,4194304] 0 2024-09-17T01:52:10.313 INFO:tasks.workunit.client.0.smithi031.stdout:0/706: dread - d0/d29/d33/d5/d48/d56/dc8/dcc/fdb zero size 2024-09-17T01:52:10.314 INFO:tasks.workunit.client.1.smithi092.stdout:9/501: mkdir d0/d7/d12/d98 0 2024-09-17T01:52:10.315 INFO:tasks.workunit.client.1.smithi092.stdout:1/573: dread db/d1d/d2e/d62/f86 [0,4194304] 0 2024-09-17T01:52:10.315 INFO:tasks.workunit.client.0.smithi031.stdout:0/707: chown d0/d29/d33/d5/d48/f5a 134 1 2024-09-17T01:52:10.318 INFO:tasks.workunit.client.1.smithi092.stdout:1/574: truncate db/d1d/db5/f52 2796708 0 2024-09-17T01:52:10.318 INFO:tasks.workunit.client.1.smithi092.stdout:1/575: dread - db/d6c/d8b/fba zero size 2024-09-17T01:52:10.320 INFO:tasks.workunit.client.0.smithi031.stdout:7/646: getdents db 0 2024-09-17T01:52:10.323 INFO:tasks.workunit.client.1.smithi092.stdout:9/502: creat d0/d7/d12/f99 x:0 0 0 2024-09-17T01:52:10.325 INFO:tasks.workunit.client.0.smithi031.stdout:0/708: creat d0/d37/ff0 x:0 0 0 2024-09-17T01:52:10.327 INFO:tasks.workunit.client.0.smithi031.stdout:7/647: mknod db/d1c/d41/d9a/cc6 0 2024-09-17T01:52:10.327 INFO:tasks.workunit.client.1.smithi092.stdout:9/503: dread - d0/d7/d21/f75 zero size 2024-09-17T01:52:10.327 INFO:tasks.workunit.client.1.smithi092.stdout:4/633: dwrite d4/d5/d8/d92/fa3 [0,4194304] 0 2024-09-17T01:52:10.329 INFO:tasks.workunit.client.1.smithi092.stdout:4/634: readlink d4/d13/d3b/l61 0 2024-09-17T01:52:10.329 INFO:tasks.workunit.client.0.smithi031.stdout:0/709: mkdir d0/d29/d33/d5/d48/df1 0 2024-09-17T01:52:10.329 INFO:tasks.workunit.client.1.smithi092.stdout:3/459: getdents d4/d73 0 2024-09-17T01:52:10.333 INFO:tasks.workunit.client.0.smithi031.stdout:6/752: write d23/d63/d47/fbf [739989,5836] 0 2024-09-17T01:52:10.334 INFO:tasks.workunit.client.1.smithi092.stdout:3/460: symlink d4/d20/d39/l97 0 2024-09-17T01:52:10.335 INFO:tasks.workunit.client.0.smithi031.stdout:6/753: stat f5 0 2024-09-17T01:52:10.336 INFO:tasks.workunit.client.1.smithi092.stdout:3/461: chown d4/d20/f42 20 1 2024-09-17T01:52:10.337 INFO:tasks.workunit.client.1.smithi092.stdout:9/504: symlink d0/df/d17/l9a 0 2024-09-17T01:52:10.337 INFO:tasks.workunit.client.0.smithi031.stdout:4/864: write d8/f11 [1297494,10341] 0 2024-09-17T01:52:10.338 INFO:tasks.workunit.client.0.smithi031.stdout:9/573: dread d3/d4/f2f [0,4194304] 0 2024-09-17T01:52:10.338 INFO:tasks.workunit.client.1.smithi092.stdout:4/635: dwrite d4/d5/f40 [0,4194304] 0 2024-09-17T01:52:10.339 INFO:tasks.workunit.client.1.smithi092.stdout:9/505: chown d0/d7/d12/f8f 5401361 1 2024-09-17T01:52:10.339 INFO:tasks.workunit.client.1.smithi092.stdout:4/636: fdatasync d4/d13/d3b/d42/f86 0 2024-09-17T01:52:10.340 INFO:tasks.workunit.client.0.smithi031.stdout:4/865: stat d8/cc2 0 2024-09-17T01:52:10.342 INFO:tasks.workunit.client.1.smithi092.stdout:3/462: mknod d4/d16/d1b/c98 0 2024-09-17T01:52:10.342 INFO:tasks.workunit.client.1.smithi092.stdout:7/504: rmdir d3/d6/d13/d40 39 2024-09-17T01:52:10.343 INFO:tasks.workunit.client.1.smithi092.stdout:9/506: fdatasync d0/d5/f8 0 2024-09-17T01:52:10.346 INFO:tasks.workunit.client.0.smithi031.stdout:7/648: dwrite db/d18/d67/fa1 [0,4194304] 0 2024-09-17T01:52:10.347 INFO:tasks.workunit.client.1.smithi092.stdout:3/463: mkdir d4/d2f/d44/d54/d99 0 2024-09-17T01:52:10.347 INFO:tasks.workunit.client.0.smithi031.stdout:3/626: dwrite db/f11 [0,4194304] 0 2024-09-17T01:52:10.348 INFO:tasks.workunit.client.0.smithi031.stdout:9/574: mkdir d3/d19/d80/db9 0 2024-09-17T01:52:10.349 INFO:tasks.workunit.client.1.smithi092.stdout:9/507: rmdir d0/d7/d12/d86/d93 39 2024-09-17T01:52:10.350 INFO:tasks.workunit.client.1.smithi092.stdout:7/505: dwrite d3/db/f4a [0,4194304] 0 2024-09-17T01:52:10.353 INFO:tasks.workunit.client.1.smithi092.stdout:9/508: read d0/d7/d12/d34/d26/d54/f87 [306489,101554] 0 2024-09-17T01:52:10.353 INFO:tasks.workunit.client.1.smithi092.stdout:4/637: link d4/d5/f15 d4/d13/d3b/d42/d76/fd1 0 2024-09-17T01:52:10.354 INFO:tasks.workunit.client.0.smithi031.stdout:5/554: dread da/f49 [0,4194304] 0 2024-09-17T01:52:10.354 INFO:tasks.workunit.client.0.smithi031.stdout:0/710: rename d0/d29/d33/c5f to d0/d29/d33/d2a/d25/d38/cf2 0 2024-09-17T01:52:10.355 INFO:tasks.workunit.client.1.smithi092.stdout:3/464: read d4/f30 [3228069,81999] 0 2024-09-17T01:52:10.357 INFO:tasks.workunit.client.0.smithi031.stdout:8/593: dread d0/df/d19/f33 [0,4194304] 0 2024-09-17T01:52:10.357 INFO:tasks.workunit.client.1.smithi092.stdout:4/638: read d4/d13/d3b/f8d [1893636,85894] 0 2024-09-17T01:52:10.358 INFO:tasks.workunit.client.0.smithi031.stdout:6/754: truncate d23/db4/f58 17649 0 2024-09-17T01:52:10.358 INFO:tasks.workunit.client.0.smithi031.stdout:5/555: dread - da/d14/dac/d82/d92/f94 zero size 2024-09-17T01:52:10.359 INFO:tasks.workunit.client.1.smithi092.stdout:7/506: dread d3/f4b [0,4194304] 0 2024-09-17T01:52:10.362 INFO:tasks.workunit.client.0.smithi031.stdout:5/556: chown da/f74 41363583 1 2024-09-17T01:52:10.364 INFO:tasks.workunit.client.0.smithi031.stdout:0/711: write d0/d29/d33/d2a/d25/d38/f41 [6641698,113169] 0 2024-09-17T01:52:10.365 INFO:tasks.workunit.client.1.smithi092.stdout:3/465: write d4/d13/d2e/d5f/f62 [1183237,53648] 0 2024-09-17T01:52:10.366 INFO:tasks.workunit.client.1.smithi092.stdout:1/576: truncate db/d1d/f2a 1232304 0 2024-09-17T01:52:10.366 INFO:tasks.workunit.client.0.smithi031.stdout:8/594: truncate d0/d5/f50 1245301 0 2024-09-17T01:52:10.367 INFO:tasks.workunit.client.1.smithi092.stdout:4/639: truncate d4/d5/d8/d99/fb1 225412 0 2024-09-17T01:52:10.367 INFO:tasks.workunit.client.1.smithi092.stdout:9/509: dread d0/d5/d29/f55 [4194304,4194304] 0 2024-09-17T01:52:10.367 INFO:tasks.workunit.client.0.smithi031.stdout:4/866: rmdir d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/df8 0 2024-09-17T01:52:10.368 INFO:tasks.workunit.client.1.smithi092.stdout:9/510: write d0/df/f67 [2115239,76943] 0 2024-09-17T01:52:10.371 INFO:tasks.workunit.client.1.smithi092.stdout:1/577: write db/d1d/d2e/d62/f86 [3432396,30069] 0 2024-09-17T01:52:10.371 INFO:tasks.workunit.client.0.smithi031.stdout:7/649: getdents db/d1c/d41/d69 0 2024-09-17T01:52:10.372 INFO:tasks.workunit.client.0.smithi031.stdout:8/595: fdatasync d0/d5/f5d 0 2024-09-17T01:52:10.372 INFO:tasks.workunit.client.0.smithi031.stdout:5/557: rename da/d4b/fb3 to da/d14/dac/d82/dc3/fc6 0 2024-09-17T01:52:10.374 INFO:tasks.workunit.client.1.smithi092.stdout:3/466: creat d4/d2f/f9a x:0 0 0 2024-09-17T01:52:10.374 INFO:tasks.workunit.client.1.smithi092.stdout:3/467: stat d4/d2f/c34 0 2024-09-17T01:52:10.375 INFO:tasks.workunit.client.0.smithi031.stdout:3/627: dwrite db/f3e [8388608,4194304] 0 2024-09-17T01:52:10.375 INFO:tasks.workunit.client.1.smithi092.stdout:1/578: creat db/d6c/d7e/d82/fbd x:0 0 0 2024-09-17T01:52:10.375 INFO:tasks.workunit.client.0.smithi031.stdout:7/650: read db/f15 [1290813,30165] 0 2024-09-17T01:52:10.377 INFO:tasks.workunit.client.0.smithi031.stdout:3/628: chown db/d9b 11 1 2024-09-17T01:52:10.378 INFO:tasks.workunit.client.1.smithi092.stdout:4/640: link d4/d5/d1d/d30/d7a/fab d4/d5/fd2 0 2024-09-17T01:52:10.378 INFO:tasks.workunit.client.0.smithi031.stdout:8/596: truncate d0/f70 4636690 0 2024-09-17T01:52:10.378 INFO:tasks.workunit.client.1.smithi092.stdout:9/511: creat d0/d7/d12/d86/f9b x:0 0 0 2024-09-17T01:52:10.379 INFO:tasks.workunit.client.0.smithi031.stdout:5/558: symlink da/d42/lc7 0 2024-09-17T01:52:10.379 INFO:tasks.workunit.client.1.smithi092.stdout:3/468: rmdir d4/d2f/d44/d3c 39 2024-09-17T01:52:10.380 INFO:tasks.workunit.client.0.smithi031.stdout:5/559: readlink da/dc/l21 0 2024-09-17T01:52:10.383 INFO:tasks.workunit.client.1.smithi092.stdout:1/579: rename db/d1d/db5/f52 to db/d1d/d2e/d62/fbe 0 2024-09-17T01:52:10.386 INFO:tasks.workunit.client.1.smithi092.stdout:9/512: rmdir d0/d7/d12/d34/d26/d54/d6b 39 2024-09-17T01:52:10.386 INFO:tasks.workunit.client.0.smithi031.stdout:7/651: dread db/d18/f7f [0,4194304] 0 2024-09-17T01:52:10.388 INFO:tasks.workunit.client.1.smithi092.stdout:3/469: dwrite d4/d2f/f9a [0,4194304] 0 2024-09-17T01:52:10.389 INFO:tasks.workunit.client.0.smithi031.stdout:0/712: dread d0/d29/d33/d2a/d25/f7a [0,4194304] 0 2024-09-17T01:52:10.390 INFO:tasks.workunit.client.0.smithi031.stdout:5/560: write da/d14/dac/d82/dc3/fc6 [734899,58971] 0 2024-09-17T01:52:10.392 INFO:tasks.workunit.client.0.smithi031.stdout:3/629: dwrite db/df/d1d/d37/d4a/f94 [0,4194304] 0 2024-09-17T01:52:10.392 INFO:tasks.workunit.client.1.smithi092.stdout:3/470: chown d4/d13/d2e/c41 830180 1 2024-09-17T01:52:10.394 INFO:tasks.workunit.client.0.smithi031.stdout:8/597: dwrite d0/f42 [0,4194304] 0 2024-09-17T01:52:10.395 INFO:tasks.workunit.client.0.smithi031.stdout:7/652: rename db/d29/l38 to db/lc7 0 2024-09-17T01:52:10.396 INFO:tasks.workunit.client.1.smithi092.stdout:1/580: dwrite db/d1d/d23/f89 [0,4194304] 0 2024-09-17T01:52:10.399 INFO:tasks.workunit.client.0.smithi031.stdout:9/575: dread d3/d4/d29/f78 [0,4194304] 0 2024-09-17T01:52:10.399 INFO:tasks.workunit.client.1.smithi092.stdout:3/471: creat d4/d13/d2e/d43/f9b x:0 0 0 2024-09-17T01:52:10.401 INFO:tasks.workunit.client.0.smithi031.stdout:9/576: dread - d3/d19/d80/faf zero size 2024-09-17T01:52:10.402 INFO:tasks.workunit.client.0.smithi031.stdout:5/561: creat da/d42/d12/d72/fc8 x:0 0 0 2024-09-17T01:52:10.403 INFO:tasks.workunit.client.1.smithi092.stdout:4/641: dread d4/d13/d20/f27 [0,4194304] 0 2024-09-17T01:52:10.406 INFO:tasks.workunit.client.0.smithi031.stdout:5/562: dread - da/d42/d12/d72/fc8 zero size 2024-09-17T01:52:10.406 INFO:tasks.workunit.client.0.smithi031.stdout:9/577: dread - d3/d4/da0/f48 zero size 2024-09-17T01:52:10.406 INFO:tasks.workunit.client.0.smithi031.stdout:5/563: dread - da/d4b/d6c/fc0 zero size 2024-09-17T01:52:10.406 INFO:tasks.workunit.client.0.smithi031.stdout:3/630: creat db/df/d1d/d37/d6c/d6e/fbe x:0 0 0 2024-09-17T01:52:10.407 INFO:tasks.workunit.client.1.smithi092.stdout:1/581: mkdir db/d1d/d23/da1/dbf 0 2024-09-17T01:52:10.408 INFO:tasks.workunit.client.1.smithi092.stdout:4/642: write d4/d13/d20/f27 [842983,50134] 0 2024-09-17T01:52:10.411 INFO:tasks.workunit.client.1.smithi092.stdout:4/643: dread - d4/d13/d3b/d42/fc7 zero size 2024-09-17T01:52:10.412 INFO:tasks.workunit.client.0.smithi031.stdout:6/755: dread d23/f39 [0,4194304] 0 2024-09-17T01:52:10.413 INFO:tasks.workunit.client.0.smithi031.stdout:0/713: mknod d0/d29/d33/d5/cf3 0 2024-09-17T01:52:10.415 INFO:tasks.workunit.client.1.smithi092.stdout:3/472: rename d4/d16/d1b/f64 to d4/d20/d3f/f9c 0 2024-09-17T01:52:10.416 INFO:tasks.workunit.client.1.smithi092.stdout:7/507: dwrite d3/d6/d13/f7d [0,4194304] 0 2024-09-17T01:52:10.417 INFO:tasks.workunit.client.1.smithi092.stdout:7/508: fsync d3/db/d26/d83/f96 0 2024-09-17T01:52:10.419 INFO:tasks.workunit.client.1.smithi092.stdout:4/644: fdatasync d4/d5/fd2 0 2024-09-17T01:52:10.421 INFO:tasks.workunit.client.0.smithi031.stdout:0/714: symlink d0/d29/d33/d5/lf4 0 2024-09-17T01:52:10.421 INFO:tasks.workunit.client.1.smithi092.stdout:3/473: write d4/f2d [1437684,8820] 0 2024-09-17T01:52:10.423 INFO:tasks.workunit.client.1.smithi092.stdout:7/509: chown d3/db/f54 4265 1 2024-09-17T01:52:10.423 INFO:tasks.workunit.client.0.smithi031.stdout:3/631: getdents db/df/d1d/d37/d3a 0 2024-09-17T01:52:10.423 INFO:tasks.workunit.client.0.smithi031.stdout:5/564: creat da/dc/fc9 x:0 0 0 2024-09-17T01:52:10.426 INFO:tasks.workunit.client.1.smithi092.stdout:3/474: mknod d4/d13/d2e/d5f/c9d 0 2024-09-17T01:52:10.427 INFO:tasks.workunit.client.0.smithi031.stdout:0/715: symlink d0/d29/da7/db3/d9c/lf5 0 2024-09-17T01:52:10.427 INFO:tasks.workunit.client.0.smithi031.stdout:4/867: dwrite d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/db0/f10d [0,4194304] 0 2024-09-17T01:52:10.428 INFO:tasks.workunit.client.1.smithi092.stdout:4/645: creat d4/d5/fd3 x:0 0 0 2024-09-17T01:52:10.429 INFO:tasks.workunit.client.0.smithi031.stdout:3/632: rmdir db/df/d1c/d99 39 2024-09-17T01:52:10.430 INFO:tasks.workunit.client.1.smithi092.stdout:3/475: mkdir d4/d73/d8f/d9e 0 2024-09-17T01:52:10.430 INFO:tasks.workunit.client.0.smithi031.stdout:5/565: stat da/dc/c57 0 2024-09-17T01:52:10.431 INFO:tasks.workunit.client.1.smithi092.stdout:9/513: write d0/d7/d12/d34/d26/d54/f87 [508840,113841] 0 2024-09-17T01:52:10.433 INFO:tasks.workunit.client.1.smithi092.stdout:4/646: mkdir d4/d5/d8/d99/dd4 0 2024-09-17T01:52:10.433 INFO:tasks.workunit.client.1.smithi092.stdout:7/510: dwrite d3/d6/d13/d40/f55 [0,4194304] 0 2024-09-17T01:52:10.433 INFO:tasks.workunit.client.1.smithi092.stdout:4/647: chown d4/d7b 2090 1 2024-09-17T01:52:10.436 INFO:tasks.workunit.client.0.smithi031.stdout:5/566: symlink da/d4b/d6c/lca 0 2024-09-17T01:52:10.436 INFO:tasks.workunit.client.1.smithi092.stdout:3/476: unlink d4/d13/d2e/f3b 0 2024-09-17T01:52:10.436 INFO:tasks.workunit.client.1.smithi092.stdout:7/511: truncate d3/d2b/d84/fab 719001 0 2024-09-17T01:52:10.437 INFO:tasks.workunit.client.1.smithi092.stdout:1/582: dread db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:10.437 INFO:tasks.workunit.client.0.smithi031.stdout:7/653: fsync db/d18/f2f 0 2024-09-17T01:52:10.439 INFO:tasks.workunit.client.1.smithi092.stdout:7/512: dread - d3/d6/d13/d21/d2e/d6e/f99 zero size 2024-09-17T01:52:10.439 INFO:tasks.workunit.client.1.smithi092.stdout:3/477: readlink d4/d2f/d44/l68 0 2024-09-17T01:52:10.440 INFO:tasks.workunit.client.1.smithi092.stdout:7/513: chown d3/l87 119 1 2024-09-17T01:52:10.440 INFO:tasks.workunit.client.1.smithi092.stdout:7/514: chown d3/d2b/d3a/c7e 287 1 2024-09-17T01:52:10.442 INFO:tasks.workunit.client.0.smithi031.stdout:0/716: rename d0/d29/d33/d2a/c4e to d0/d29/d33/d2a/d25/d38/dd1/cf6 0 2024-09-17T01:52:10.444 INFO:tasks.workunit.client.0.smithi031.stdout:9/578: write d3/d4/d41/f7a [508178,107273] 0 2024-09-17T01:52:10.445 INFO:tasks.workunit.client.1.smithi092.stdout:1/583: creat db/d1d/d2e/d62/fc0 x:0 0 0 2024-09-17T01:52:10.445 INFO:tasks.workunit.client.1.smithi092.stdout:7/515: dread d3/d6/d13/d21/d2e/f85 [0,4194304] 0 2024-09-17T01:52:10.446 INFO:tasks.workunit.client.0.smithi031.stdout:8/598: dwrite d0/f9 [0,4194304] 0 2024-09-17T01:52:10.449 INFO:tasks.workunit.client.1.smithi092.stdout:3/478: mkdir d4/d20/d9f 0 2024-09-17T01:52:10.453 INFO:tasks.workunit.client.0.smithi031.stdout:6/756: dread d23/db4/d6a/d70/db0/fb2 [0,4194304] 0 2024-09-17T01:52:10.453 INFO:tasks.workunit.client.0.smithi031.stdout:4/868: link d8/fd6 d8/d3a/d10a/d64/d4d/dfd/f117 0 2024-09-17T01:52:10.453 INFO:tasks.workunit.client.1.smithi092.stdout:9/514: getdents d0/d5 0 2024-09-17T01:52:10.454 INFO:tasks.workunit.client.0.smithi031.stdout:8/599: readlink d0/l2e 0 2024-09-17T01:52:10.455 INFO:tasks.workunit.client.1.smithi092.stdout:1/584: creat db/d6c/db3/fc1 x:0 0 0 2024-09-17T01:52:10.455 INFO:tasks.workunit.client.0.smithi031.stdout:3/633: write db/df/d1c/d6a/f92 [8919795,97636] 0 2024-09-17T01:52:10.456 INFO:tasks.workunit.client.0.smithi031.stdout:8/600: fdatasync d0/d5/d6c/d6d/f72 0 2024-09-17T01:52:10.456 INFO:tasks.workunit.client.1.smithi092.stdout:3/479: creat d4/d73/d8f/d92/fa0 x:0 0 0 2024-09-17T01:52:10.458 INFO:tasks.workunit.client.0.smithi031.stdout:5/567: symlink da/d42/d12/lcb 0 2024-09-17T01:52:10.458 INFO:tasks.workunit.client.0.smithi031.stdout:9/579: symlink d3/d4/da0/d36/d99/lba 0 2024-09-17T01:52:10.458 INFO:tasks.workunit.client.1.smithi092.stdout:0/553: sync 2024-09-17T01:52:10.459 INFO:tasks.workunit.client.0.smithi031.stdout:5/568: readlink da/dc/d25/l5e 0 2024-09-17T01:52:10.460 INFO:tasks.workunit.client.1.smithi092.stdout:7/516: dwrite d3/d6/d13/d21/d2e/d6e/f20 [0,4194304] 0 2024-09-17T01:52:10.461 INFO:tasks.workunit.client.0.smithi031.stdout:5/569: chown da/d4b/d6c 53516 1 2024-09-17T01:52:10.461 INFO:tasks.workunit.client.0.smithi031.stdout:0/717: symlink d0/d29/d33/d5/lf7 0 2024-09-17T01:52:10.462 INFO:tasks.workunit.client.1.smithi092.stdout:9/515: creat d0/d7/d12/d34/d26/d54/f9c x:0 0 0 2024-09-17T01:52:10.463 INFO:tasks.workunit.client.0.smithi031.stdout:8/601: mkdir d0/df/dd/d59/db1 0 2024-09-17T01:52:10.463 INFO:tasks.workunit.client.0.smithi031.stdout:4/869: read d8/d3a/fa9 [58145,63558] 0 2024-09-17T01:52:10.465 INFO:tasks.workunit.client.1.smithi092.stdout:7/517: write d3/d2b/d84/fab [1687394,68155] 0 2024-09-17T01:52:10.465 INFO:tasks.workunit.client.0.smithi031.stdout:4/870: stat d8/d3a/fde 0 2024-09-17T01:52:10.466 INFO:tasks.workunit.client.0.smithi031.stdout:3/634: creat db/df/d1d/d37/da1/fbf x:0 0 0 2024-09-17T01:52:10.467 INFO:tasks.workunit.client.0.smithi031.stdout:4/871: fdatasync d8/d3a/d10a/f101 0 2024-09-17T01:52:10.467 INFO:tasks.workunit.client.0.smithi031.stdout:7/654: write db/d18/f7f [101047,128967] 0 2024-09-17T01:52:10.468 INFO:tasks.workunit.client.1.smithi092.stdout:1/585: dwrite db/d6c/d7e/fa7 [0,4194304] 0 2024-09-17T01:52:10.468 INFO:tasks.workunit.client.1.smithi092.stdout:7/518: chown d3 0 1 2024-09-17T01:52:10.468 INFO:tasks.workunit.client.1.smithi092.stdout:1/586: fdatasync db/d1d/d23/d88/fb2 0 2024-09-17T01:52:10.469 INFO:tasks.workunit.client.0.smithi031.stdout:5/570: dread da/d42/f5c [0,4194304] 0 2024-09-17T01:52:10.469 INFO:tasks.workunit.client.0.smithi031.stdout:6/757: mkdir d23/db4/d6a/deb/d105 0 2024-09-17T01:52:10.472 INFO:tasks.workunit.client.1.smithi092.stdout:4/648: write d4/d5/d1d/d30/d3f/d4b/f81 [2145651,564] 0 2024-09-17T01:52:10.473 INFO:tasks.workunit.client.1.smithi092.stdout:3/480: getdents d4/d16/d1b 0 2024-09-17T01:52:10.474 INFO:tasks.workunit.client.1.smithi092.stdout:0/554: truncate d3/da/d15/f4e 1074690 0 2024-09-17T01:52:10.479 INFO:tasks.workunit.client.0.smithi031.stdout:4/872: write d8/d3a/d10a/d64/d4d/d5a/f96 [4867674,75014] 0 2024-09-17T01:52:10.481 INFO:tasks.workunit.client.1.smithi092.stdout:4/649: fsync d4/d13/d3b/d42/d76/d35/f84 0 2024-09-17T01:52:10.481 INFO:tasks.workunit.client.0.smithi031.stdout:5/571: creat da/d14/dac/d82/dc3/fcc x:0 0 0 2024-09-17T01:52:10.482 INFO:tasks.workunit.client.1.smithi092.stdout:1/587: dwrite db/d6c/d7e/d82/fbd [0,4194304] 0 2024-09-17T01:52:10.482 INFO:tasks.workunit.client.1.smithi092.stdout:3/481: read d4/d20/d39/f7d [1798562,75604] 0 2024-09-17T01:52:10.483 INFO:tasks.workunit.client.0.smithi031.stdout:7/655: rename db/d1c/f9f to db/d1c/d41/d6c/da0/fc8 0 2024-09-17T01:52:10.485 INFO:tasks.workunit.client.1.smithi092.stdout:0/555: getdents d3/d2e/d3b/d72/d7a 0 2024-09-17T01:52:10.485 INFO:tasks.workunit.client.0.smithi031.stdout:7/656: read - db/d1c/d41/d69/fc2 zero size 2024-09-17T01:52:10.485 INFO:tasks.workunit.client.0.smithi031.stdout:9/580: getdents d3/d4/d41/d70 0 2024-09-17T01:52:10.486 INFO:tasks.workunit.client.0.smithi031.stdout:6/758: fdatasync d23/db4/f58 0 2024-09-17T01:52:10.487 INFO:tasks.workunit.client.1.smithi092.stdout:9/516: dread d0/df/f3c [0,4194304] 0 2024-09-17T01:52:10.488 INFO:tasks.workunit.client.1.smithi092.stdout:7/519: dread d3/db/f5e [0,4194304] 0 2024-09-17T01:52:10.489 INFO:tasks.workunit.client.0.smithi031.stdout:3/635: dread db/df/d50/f75 [0,4194304] 0 2024-09-17T01:52:10.489 INFO:tasks.workunit.client.1.smithi092.stdout:9/517: chown d0/df/d5d/c89 3 1 2024-09-17T01:52:10.490 INFO:tasks.workunit.client.1.smithi092.stdout:3/482: creat d4/d2f/d44/d3c/fa1 x:0 0 0 2024-09-17T01:52:10.490 INFO:tasks.workunit.client.0.smithi031.stdout:5/572: fdatasync da/f6f 0 2024-09-17T01:52:10.490 INFO:tasks.workunit.client.1.smithi092.stdout:0/556: mkdir d3/da/d15/dab 0 2024-09-17T01:52:10.491 INFO:tasks.workunit.client.0.smithi031.stdout:3/636: chown db/df/d1d/d37/d4a/f33 3291 1 2024-09-17T01:52:10.492 INFO:tasks.workunit.client.0.smithi031.stdout:9/581: fsync d3/d19/d1f/d44/f8b 0 2024-09-17T01:52:10.493 INFO:tasks.workunit.client.1.smithi092.stdout:0/557: readlink d3/da/d1c/d4a/l64 0 2024-09-17T01:52:10.494 INFO:tasks.workunit.client.0.smithi031.stdout:6/759: symlink d23/db4/d6a/d91/l106 0 2024-09-17T01:52:10.495 INFO:tasks.workunit.client.1.smithi092.stdout:1/588: dread db/d1d/d23/f6f [0,4194304] 0 2024-09-17T01:52:10.497 INFO:tasks.workunit.client.1.smithi092.stdout:5/427: sync 2024-09-17T01:52:10.498 INFO:tasks.workunit.client.1.smithi092.stdout:9/518: truncate d0/d7/d12/d34/f7e 495145 0 2024-09-17T01:52:10.501 INFO:tasks.workunit.client.0.smithi031.stdout:8/602: dread d0/df/f46 [0,4194304] 0 2024-09-17T01:52:10.501 INFO:tasks.workunit.client.0.smithi031.stdout:7/657: rename db/f16 to db/d1c/d46/fc9 0 2024-09-17T01:52:10.501 INFO:tasks.workunit.client.1.smithi092.stdout:1/589: fsync db/d1d/db5/f4e 0 2024-09-17T01:52:10.502 INFO:tasks.workunit.client.0.smithi031.stdout:8/603: chown d0/d5/d6c 1764964 1 2024-09-17T01:52:10.503 INFO:tasks.workunit.client.1.smithi092.stdout:3/483: rmdir d4/d2f 39 2024-09-17T01:52:10.505 INFO:tasks.workunit.client.1.smithi092.stdout:0/558: dwrite d3/da/d15/d30/fa9 [0,4194304] 0 2024-09-17T01:52:10.505 INFO:tasks.workunit.client.0.smithi031.stdout:0/718: write d0/d29/d33/d5/d48/d56/dc8/fe1 [1295746,67616] 0 2024-09-17T01:52:10.505 INFO:tasks.workunit.client.0.smithi031.stdout:6/760: dwrite f1a [4194304,4194304] 0 2024-09-17T01:52:10.508 INFO:tasks.workunit.client.1.smithi092.stdout:1/590: readlink db/l59 0 2024-09-17T01:52:10.508 INFO:tasks.workunit.client.1.smithi092.stdout:9/519: mkdir d0/df/d17/d9d 0 2024-09-17T01:52:10.509 INFO:tasks.workunit.client.0.smithi031.stdout:3/637: symlink db/df/d1c/d99/lc0 0 2024-09-17T01:52:10.509 INFO:tasks.workunit.client.1.smithi092.stdout:7/520: truncate d3/db/d26/f6d 810808 0 2024-09-17T01:52:10.511 INFO:tasks.workunit.client.0.smithi031.stdout:4/873: dread d8/d3a/d10a/de6/fe8 [0,4194304] 0 2024-09-17T01:52:10.511 INFO:tasks.workunit.client.1.smithi092.stdout:3/484: creat d4/d13/d2e/d43/fa2 x:0 0 0 2024-09-17T01:52:10.512 INFO:tasks.workunit.client.1.smithi092.stdout:0/559: creat d3/d2e/d55/d63/d81/fac x:0 0 0 2024-09-17T01:52:10.513 INFO:tasks.workunit.client.1.smithi092.stdout:5/428: dwrite d0/de/d19/d1a/d1e/f12 [0,4194304] 0 2024-09-17T01:52:10.514 INFO:tasks.workunit.client.0.smithi031.stdout:4/874: write d8/d3a/d10a/d64/d4f/f10e [803366,99021] 0 2024-09-17T01:52:10.515 INFO:tasks.workunit.client.0.smithi031.stdout:9/582: mknod d3/d4/d29/cbb 0 2024-09-17T01:52:10.516 INFO:tasks.workunit.client.0.smithi031.stdout:0/719: symlink d0/d29/d33/d2a/dde/d9b/lf8 0 2024-09-17T01:52:10.516 INFO:tasks.workunit.client.1.smithi092.stdout:4/650: dread d4/f62 [0,4194304] 0 2024-09-17T01:52:10.520 INFO:tasks.workunit.client.1.smithi092.stdout:7/521: mkdir d3/d6/d13/d40/daf 0 2024-09-17T01:52:10.520 INFO:tasks.workunit.client.1.smithi092.stdout:0/560: dread - d3/d2e/d3b/d72/d7a/f9f zero size 2024-09-17T01:52:10.520 INFO:tasks.workunit.client.0.smithi031.stdout:6/761: mknod d23/db4/d6a/dfa/c107 0 2024-09-17T01:52:10.522 INFO:tasks.workunit.client.1.smithi092.stdout:1/591: getdents db/d6c 0 2024-09-17T01:52:10.522 INFO:tasks.workunit.client.0.smithi031.stdout:8/604: fsync d0/d5/f5e 0 2024-09-17T01:52:10.524 INFO:tasks.workunit.client.0.smithi031.stdout:9/583: creat d3/d4/d41/fbc x:0 0 0 2024-09-17T01:52:10.524 INFO:tasks.workunit.client.0.smithi031.stdout:5/573: write da/d42/d26/f39 [4153771,35442] 0 2024-09-17T01:52:10.525 INFO:tasks.workunit.client.1.smithi092.stdout:5/429: dread d0/de/d19/f6c [0,4194304] 0 2024-09-17T01:52:10.526 INFO:tasks.workunit.client.1.smithi092.stdout:9/520: dwrite d0/df/f27 [0,4194304] 0 2024-09-17T01:52:10.526 INFO:tasks.workunit.client.0.smithi031.stdout:5/574: chown da/d4b/c5f 6251835 1 2024-09-17T01:52:10.526 INFO:tasks.workunit.client.0.smithi031.stdout:0/720: chown d0/d29/d33/d2a/d25/d38/c5d 460 1 2024-09-17T01:52:10.528 INFO:tasks.workunit.client.0.smithi031.stdout:4/875: mknod d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/c118 0 2024-09-17T01:52:10.528 INFO:tasks.workunit.client.0.smithi031.stdout:5/575: fdatasync da/d42/d12/d4a/f71 0 2024-09-17T01:52:10.529 INFO:tasks.workunit.client.1.smithi092.stdout:1/592: creat db/d6c/d7e/d96/fc2 x:0 0 0 2024-09-17T01:52:10.529 INFO:tasks.workunit.client.1.smithi092.stdout:5/430: dread - d0/de/d19/f8c zero size 2024-09-17T01:52:10.530 INFO:tasks.workunit.client.0.smithi031.stdout:6/762: symlink d23/db4/d6a/dfa/l108 0 2024-09-17T01:52:10.530 INFO:tasks.workunit.client.1.smithi092.stdout:3/485: dread d4/d20/f7c [0,4194304] 0 2024-09-17T01:52:10.531 INFO:tasks.workunit.client.0.smithi031.stdout:7/658: chown db/d18/f7f 5 1 2024-09-17T01:52:10.531 INFO:tasks.workunit.client.1.smithi092.stdout:1/593: fsync db/d1d/d23/f3c 0 2024-09-17T01:52:10.532 INFO:tasks.workunit.client.0.smithi031.stdout:5/576: write da/dc/d98/fb2 [1865117,51249] 0 2024-09-17T01:52:10.534 INFO:tasks.workunit.client.0.smithi031.stdout:3/638: link db/df/d1d/d37/d4a/c6d db/df/d1c/d99/cc1 0 2024-09-17T01:52:10.536 INFO:tasks.workunit.client.1.smithi092.stdout:0/561: dwrite d3/d2e/d3b/d40/f53 [0,4194304] 0 2024-09-17T01:52:10.536 INFO:tasks.workunit.client.1.smithi092.stdout:7/522: link d3/d6/d13/lf d3/db/d26/d65/lb0 0 2024-09-17T01:52:10.537 INFO:tasks.workunit.client.0.smithi031.stdout:8/605: creat d0/df/d19/fb2 x:0 0 0 2024-09-17T01:52:10.537 INFO:tasks.workunit.client.0.smithi031.stdout:9/584: rmdir d3/d19/d1f/d44/d64 39 2024-09-17T01:52:10.538 INFO:tasks.workunit.client.0.smithi031.stdout:3/639: dread - db/df/d1d/d37/d65/f9c zero size 2024-09-17T01:52:10.538 INFO:tasks.workunit.client.1.smithi092.stdout:9/521: mknod d0/d7/d12/d34/d26/d54/c9e 0 2024-09-17T01:52:10.541 INFO:tasks.workunit.client.1.smithi092.stdout:1/594: write db/d1d/d23/f5a [3756288,18098] 0 2024-09-17T01:52:10.542 INFO:tasks.workunit.client.1.smithi092.stdout:3/486: mkdir d4/d20/d39/d70/d95/da3 0 2024-09-17T01:52:10.545 INFO:tasks.workunit.client.1.smithi092.stdout:7/523: creat d3/db/d26/d83/da6/fb1 x:0 0 0 2024-09-17T01:52:10.545 INFO:tasks.workunit.client.1.smithi092.stdout:5/431: dwrite d0/de/d19/d1a/d1e/f12 [4194304,4194304] 0 2024-09-17T01:52:10.546 INFO:tasks.workunit.client.0.smithi031.stdout:8/606: chown d0/df/dd/d77/f92 31711 1 2024-09-17T01:52:10.546 INFO:tasks.workunit.client.0.smithi031.stdout:7/659: dwrite db/d18/f9e [0,4194304] 0 2024-09-17T01:52:10.551 INFO:tasks.workunit.client.1.smithi092.stdout:1/595: write db/d1d/d23/f6f [1151902,93096] 0 2024-09-17T01:52:10.551 INFO:tasks.workunit.client.1.smithi092.stdout:7/524: mkdir d3/db/db2 0 2024-09-17T01:52:10.551 INFO:tasks.workunit.client.0.smithi031.stdout:4/876: dread d8/d3a/d10a/d64/d4f/f56 [0,4194304] 0 2024-09-17T01:52:10.552 INFO:tasks.workunit.client.1.smithi092.stdout:5/432: dread d0/d50/d70/f81 [0,4194304] 0 2024-09-17T01:52:10.553 INFO:tasks.workunit.client.1.smithi092.stdout:7/525: chown d3/db/d26/c94 0 1 2024-09-17T01:52:10.554 INFO:tasks.workunit.client.1.smithi092.stdout:3/487: readlink d4/d20/d3f/l59 0 2024-09-17T01:52:10.555 INFO:tasks.workunit.client.0.smithi031.stdout:4/877: fsync d8/d3a/d10a/d64/d4d/d8f/f97 0 2024-09-17T01:52:10.555 INFO:tasks.workunit.client.0.smithi031.stdout:6/763: dwrite d23/db4/f69 [0,4194304] 0 2024-09-17T01:52:10.556 INFO:tasks.workunit.client.1.smithi092.stdout:1/596: write db/d1d/d23/d34/fb0 [658541,98572] 0 2024-09-17T01:52:10.557 INFO:tasks.workunit.client.1.smithi092.stdout:3/488: chown d4/d20/d39/d70 2981 1 2024-09-17T01:52:10.560 INFO:tasks.workunit.client.0.smithi031.stdout:3/640: rename db/df/d1d/d37/da1 to db/df/d1d/d37/d77/dc2 0 2024-09-17T01:52:10.560 INFO:tasks.workunit.client.0.smithi031.stdout:4/878: chown d8/d3a/d10a/d64/d4d/d5a/fab 901955305 1 2024-09-17T01:52:10.560 INFO:tasks.workunit.client.1.smithi092.stdout:7/526: write d3/db/d26/d83/da6/fb1 [595182,45893] 0 2024-09-17T01:52:10.563 INFO:tasks.workunit.client.1.smithi092.stdout:1/597: write db/f5f [173927,89435] 0 2024-09-17T01:52:10.564 INFO:tasks.workunit.client.0.smithi031.stdout:0/721: link d0/d29/da7/l91 d0/d29/d33/d2a/lf9 0 2024-09-17T01:52:10.564 INFO:tasks.workunit.client.1.smithi092.stdout:3/489: write d4/d2f/d44/d3c/f3e [752721,4762] 0 2024-09-17T01:52:10.565 INFO:tasks.workunit.client.1.smithi092.stdout:4/651: dread d4/d5/d1d/d30/f64 [0,4194304] 0 2024-09-17T01:52:10.565 INFO:tasks.workunit.client.1.smithi092.stdout:1/598: stat db/d6c/d7e/la4 0 2024-09-17T01:52:10.566 INFO:tasks.workunit.client.0.smithi031.stdout:6/764: unlink d23/dd1/lf1 0 2024-09-17T01:52:10.566 INFO:tasks.workunit.client.0.smithi031.stdout:0/722: write d0/d29/d33/d5/f3b [6683521,76918] 0 2024-09-17T01:52:10.568 INFO:tasks.workunit.client.1.smithi092.stdout:7/527: symlink d3/d6/d13/d40/d60/lb3 0 2024-09-17T01:52:10.568 INFO:tasks.workunit.client.1.smithi092.stdout:3/490: write d4/d16/d1b/f87 [1033794,123269] 0 2024-09-17T01:52:10.569 INFO:tasks.workunit.client.0.smithi031.stdout:0/723: fsync d0/d29/d33/d5/d48/d56/fb6 0 2024-09-17T01:52:10.569 INFO:tasks.workunit.client.0.smithi031.stdout:8/607: link d0/d5/d54/d60/f80 d0/d5/d6c/db0/fb3 0 2024-09-17T01:52:10.569 INFO:tasks.workunit.client.0.smithi031.stdout:4/879: fdatasync d8/d3a/d10a/d64/d4d/fa4 0 2024-09-17T01:52:10.570 INFO:tasks.workunit.client.1.smithi092.stdout:1/599: mkdir db/d1d/d23/da1/dc3 0 2024-09-17T01:52:10.570 INFO:tasks.workunit.client.0.smithi031.stdout:7/660: symlink db/d1c/d8e/lca 0 2024-09-17T01:52:10.571 INFO:tasks.workunit.client.1.smithi092.stdout:5/433: getdents d0/de/d19/d1a/d24 0 2024-09-17T01:52:10.572 INFO:tasks.workunit.client.0.smithi031.stdout:8/608: truncate d0/d5/d6c/d6d/f9f 150626 0 2024-09-17T01:52:10.573 INFO:tasks.workunit.client.1.smithi092.stdout:7/528: symlink d3/db/d98/lb4 0 2024-09-17T01:52:10.573 INFO:tasks.workunit.client.1.smithi092.stdout:5/434: write d0/d7e/f85 [226025,71093] 0 2024-09-17T01:52:10.574 INFO:tasks.workunit.client.1.smithi092.stdout:3/491: symlink d4/d13/d2e/la4 0 2024-09-17T01:52:10.574 INFO:tasks.workunit.client.0.smithi031.stdout:7/661: write db/d1c/d99/fa3 [2898240,103801] 0 2024-09-17T01:52:10.575 INFO:tasks.workunit.client.1.smithi092.stdout:7/529: stat d3/db/d7b 0 2024-09-17T01:52:10.575 INFO:tasks.workunit.client.1.smithi092.stdout:1/600: symlink db/d1d/db5/lc4 0 2024-09-17T01:52:10.576 INFO:tasks.workunit.client.0.smithi031.stdout:5/577: dread da/d42/d12/d64/f93 [0,4194304] 0 2024-09-17T01:52:10.576 INFO:tasks.workunit.client.0.smithi031.stdout:5/578: chown da/d14/dac/d82 2 1 2024-09-17T01:52:10.577 INFO:tasks.workunit.client.1.smithi092.stdout:4/652: getdents d4/d5/d1d 0 2024-09-17T01:52:10.578 INFO:tasks.workunit.client.1.smithi092.stdout:0/562: dwrite d3/da/d15/d30/f3c [0,4194304] 0 2024-09-17T01:52:10.579 INFO:tasks.workunit.client.1.smithi092.stdout:0/563: chown d3/d2e/d55/d63 0 1 2024-09-17T01:52:10.581 INFO:tasks.workunit.client.1.smithi092.stdout:5/435: mkdir d0/d50/d70/d78/d8f 0 2024-09-17T01:52:10.582 INFO:tasks.workunit.client.1.smithi092.stdout:3/492: dread d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T01:52:10.583 INFO:tasks.workunit.client.1.smithi092.stdout:4/653: creat d4/d5/d1d/dae/fd5 x:0 0 0 2024-09-17T01:52:10.585 INFO:tasks.workunit.client.1.smithi092.stdout:5/436: unlink d0/d23/c5a 0 2024-09-17T01:52:10.586 INFO:tasks.workunit.client.1.smithi092.stdout:3/493: write d4/d20/d39/f5e [42530,68722] 0 2024-09-17T01:52:10.587 INFO:tasks.workunit.client.1.smithi092.stdout:0/564: mkdir d3/d1d/d6b/dad 0 2024-09-17T01:52:10.587 INFO:tasks.workunit.client.1.smithi092.stdout:3/494: readlink d4/d13/d2e/la4 0 2024-09-17T01:52:10.588 INFO:tasks.workunit.client.1.smithi092.stdout:0/565: write d3/d2e/d55/d63/d81/fac [137708,39927] 0 2024-09-17T01:52:10.591 INFO:tasks.workunit.client.1.smithi092.stdout:5/437: mkdir d0/d7e/d90 0 2024-09-17T01:52:10.592 INFO:tasks.workunit.client.1.smithi092.stdout:0/566: chown d3/da/d1c/d3a/c4b 2 1 2024-09-17T01:52:10.592 INFO:tasks.workunit.client.1.smithi092.stdout:5/438: read - d0/de/d19/f8c zero size 2024-09-17T01:52:10.594 INFO:tasks.workunit.client.1.smithi092.stdout:3/495: link d4/c8 d4/d2f/d44/d54/ca5 0 2024-09-17T01:52:10.596 INFO:tasks.workunit.client.1.smithi092.stdout:5/439: symlink d0/de/d19/l91 0 2024-09-17T01:52:10.596 INFO:tasks.workunit.client.1.smithi092.stdout:5/440: fdatasync d0/de/d19/d1a/f88 0 2024-09-17T01:52:10.598 INFO:tasks.workunit.client.1.smithi092.stdout:0/567: rename d3/d2e/c62 to d3/d1d/cae 0 2024-09-17T01:52:10.600 INFO:tasks.workunit.client.1.smithi092.stdout:0/568: symlink d3/d58/laf 0 2024-09-17T01:52:10.602 INFO:tasks.workunit.client.1.smithi092.stdout:4/654: dread d4/d5/d1d/d30/d3f/d4b/f81 [0,4194304] 0 2024-09-17T01:52:10.604 INFO:tasks.workunit.client.1.smithi092.stdout:3/496: rmdir d4/d13/d2e/d91 0 2024-09-17T01:52:10.608 INFO:tasks.workunit.client.1.smithi092.stdout:0/569: symlink d3/lb0 0 2024-09-17T01:52:10.610 INFO:tasks.workunit.client.1.smithi092.stdout:3/497: mknod d4/d20/d39/d70/d95/da3/ca6 0 2024-09-17T01:52:10.611 INFO:tasks.workunit.client.1.smithi092.stdout:1/601: truncate db/d1d/d2e/d62/f86 1430054 0 2024-09-17T01:52:10.612 INFO:tasks.workunit.client.1.smithi092.stdout:0/570: mkdir d3/d2e/d3b/d8f/d5f/db1 0 2024-09-17T01:52:10.614 INFO:tasks.workunit.client.1.smithi092.stdout:4/655: rename d4/d5/f6a to d4/d5/fd6 0 2024-09-17T01:52:10.617 INFO:tasks.workunit.client.1.smithi092.stdout:1/602: dwrite db/d1d/d4b/f56 [0,4194304] 0 2024-09-17T01:52:10.619 INFO:tasks.workunit.client.1.smithi092.stdout:0/571: fdatasync d3/da/d1c/f43 0 2024-09-17T01:52:10.623 INFO:tasks.workunit.client.1.smithi092.stdout:5/441: truncate d0/de/d19/d1a/d1e/f1d 2438334 0 2024-09-17T01:52:10.625 INFO:tasks.workunit.client.1.smithi092.stdout:1/603: unlink db/d1d/f40 0 2024-09-17T01:52:10.628 INFO:tasks.workunit.client.1.smithi092.stdout:4/656: symlink d4/d13/d3b/d42/d76/d35/d3e/ld7 0 2024-09-17T01:52:10.634 INFO:tasks.workunit.client.1.smithi092.stdout:4/657: symlink d4/d5/d8/d92/ld8 0 2024-09-17T01:52:10.635 INFO:tasks.workunit.client.1.smithi092.stdout:5/442: dwrite d0/de/d19/d1a/d1e/d74/f83 [0,4194304] 0 2024-09-17T01:52:10.643 INFO:tasks.workunit.client.1.smithi092.stdout:3/498: dwrite d4/d20/f26 [0,4194304] 0 2024-09-17T01:52:10.644 INFO:tasks.workunit.client.1.smithi092.stdout:0/572: dread d3/d2e/d3b/d40/f54 [0,4194304] 0 2024-09-17T01:52:10.644 INFO:tasks.workunit.client.1.smithi092.stdout:3/499: chown d4/d20/d39/l5d 65 1 2024-09-17T01:52:10.646 INFO:tasks.workunit.client.0.smithi031.stdout:4/880: rmdir d8/d3a/d10a/d64/d4d/d8f 39 2024-09-17T01:52:10.646 INFO:tasks.workunit.client.1.smithi092.stdout:1/604: write db/d1d/f2a [466684,71908] 0 2024-09-17T01:52:10.646 INFO:tasks.workunit.client.1.smithi092.stdout:0/573: chown d3/da/c18 0 1 2024-09-17T01:52:10.646 INFO:tasks.workunit.client.1.smithi092.stdout:3/500: chown d4/d20/d3f/l8e 171501300 1 2024-09-17T01:52:10.647 INFO:tasks.workunit.client.1.smithi092.stdout:3/501: chown d4/d13/l6a 52 1 2024-09-17T01:52:10.648 INFO:tasks.workunit.client.0.smithi031.stdout:0/724: symlink d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/lfa 0 2024-09-17T01:52:10.648 INFO:tasks.workunit.client.1.smithi092.stdout:3/502: read d4/d20/f26 [2126459,98182] 0 2024-09-17T01:52:10.649 INFO:tasks.workunit.client.1.smithi092.stdout:1/605: creat db/d6c/d7e/fc5 x:0 0 0 2024-09-17T01:52:10.649 INFO:tasks.workunit.client.1.smithi092.stdout:1/606: chown db/d6c 18 1 2024-09-17T01:52:10.651 INFO:tasks.workunit.client.1.smithi092.stdout:5/443: rename d0/d23/f48 to d0/de/d19/f92 0 2024-09-17T01:52:10.651 INFO:tasks.workunit.client.0.smithi031.stdout:8/609: creat d0/df/dd/d77/d78/fb4 x:0 0 0 2024-09-17T01:52:10.653 INFO:tasks.workunit.client.0.smithi031.stdout:8/610: chown d0/l76 93261 1 2024-09-17T01:52:10.654 INFO:tasks.workunit.client.1.smithi092.stdout:4/658: link d4/d13/d3b/d42/d76/cc0 d4/cd9 0 2024-09-17T01:52:10.654 INFO:tasks.workunit.client.0.smithi031.stdout:5/579: write da/dc/f16 [954431,11071] 0 2024-09-17T01:52:10.657 INFO:tasks.workunit.client.1.smithi092.stdout:3/503: symlink d4/d73/la7 0 2024-09-17T01:52:10.657 INFO:tasks.workunit.client.1.smithi092.stdout:5/444: dread d0/de/d19/d1a/d1e/f12 [4194304,4194304] 0 2024-09-17T01:52:10.657 INFO:tasks.workunit.client.0.smithi031.stdout:4/881: rename d8/d3a/d10a/d64/d4d/d5a/d8c/d25/fed to d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/d110/f119 0 2024-09-17T01:52:10.657 INFO:tasks.workunit.client.0.smithi031.stdout:9/585: dwrite d3/d4/fb8 [0,4194304] 0 2024-09-17T01:52:10.658 INFO:tasks.workunit.client.1.smithi092.stdout:5/445: stat d0/de/f8e 0 2024-09-17T01:52:10.659 INFO:tasks.workunit.client.1.smithi092.stdout:5/446: read - d0/de/d19/d1a/d1e/d29/f60 zero size 2024-09-17T01:52:10.660 INFO:tasks.workunit.client.0.smithi031.stdout:0/725: creat d0/d29/da7/db3/d4a/d86/dd7/ffb x:0 0 0 2024-09-17T01:52:10.660 INFO:tasks.workunit.client.1.smithi092.stdout:5/447: readlink d0/de/d19/l20 0 2024-09-17T01:52:10.662 INFO:tasks.workunit.client.1.smithi092.stdout:5/448: write d0/de/d19/d1a/d1e/f36 [161320,11854] 0 2024-09-17T01:52:10.662 INFO:tasks.workunit.client.0.smithi031.stdout:7/662: creat db/d1c/d46/db9/dc1/fcb x:0 0 0 2024-09-17T01:52:10.663 INFO:tasks.workunit.client.1.smithi092.stdout:0/574: getdents d3/da/d1c 0 2024-09-17T01:52:10.663 INFO:tasks.workunit.client.1.smithi092.stdout:5/449: chown d0/f6d 3435918 1 2024-09-17T01:52:10.665 INFO:tasks.workunit.client.1.smithi092.stdout:5/450: write d0/de/d19/d1a/f7b [834549,23315] 0 2024-09-17T01:52:10.667 INFO:tasks.workunit.client.1.smithi092.stdout:1/607: getdents db/d1d/db5 0 2024-09-17T01:52:10.667 INFO:tasks.workunit.client.0.smithi031.stdout:5/580: mknod da/d4b/ccd 0 2024-09-17T01:52:10.668 INFO:tasks.workunit.client.1.smithi092.stdout:1/608: fsync db/d1d/d23/d88/fb2 0 2024-09-17T01:52:10.668 INFO:tasks.workunit.client.0.smithi031.stdout:9/586: dwrite d3/d19/d80/faf [0,4194304] 0 2024-09-17T01:52:10.669 INFO:tasks.workunit.client.1.smithi092.stdout:3/504: creat d4/d2f/fa8 x:0 0 0 2024-09-17T01:52:10.669 INFO:tasks.workunit.client.0.smithi031.stdout:4/882: fdatasync d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa1 0 2024-09-17T01:52:10.670 INFO:tasks.workunit.client.1.smithi092.stdout:0/575: symlink d3/da/d1c/d3a/lb2 0 2024-09-17T01:52:10.671 INFO:tasks.workunit.client.0.smithi031.stdout:3/641: truncate db/fe 2061771 0 2024-09-17T01:52:10.671 INFO:tasks.workunit.client.1.smithi092.stdout:4/659: getdents d4/d13/d3b/d42/d76/d35 0 2024-09-17T01:52:10.673 INFO:tasks.workunit.client.1.smithi092.stdout:4/660: chown d4/d5/d1d/f1a 6 1 2024-09-17T01:52:10.673 INFO:tasks.workunit.client.0.smithi031.stdout:7/663: readlink db/d1c/l5f 0 2024-09-17T01:52:10.674 INFO:tasks.workunit.client.1.smithi092.stdout:4/661: chown d4/d5/d8/d92/fa3 8769 1 2024-09-17T01:52:10.675 INFO:tasks.workunit.client.0.smithi031.stdout:8/611: fsync d0/d5/f40 0 2024-09-17T01:52:10.676 INFO:tasks.workunit.client.1.smithi092.stdout:3/505: mknod d4/d73/d8f/ca9 0 2024-09-17T01:52:10.678 INFO:tasks.workunit.client.0.smithi031.stdout:3/642: mkdir db/df/d1c/d6a/dc3 0 2024-09-17T01:52:10.678 INFO:tasks.workunit.client.0.smithi031.stdout:5/581: dwrite da/d14/f89 [0,4194304] 0 2024-09-17T01:52:10.680 INFO:tasks.workunit.client.1.smithi092.stdout:1/609: mknod db/cc6 0 2024-09-17T01:52:10.683 INFO:tasks.workunit.client.1.smithi092.stdout:4/662: rmdir d4/d5 39 2024-09-17T01:52:10.684 INFO:tasks.workunit.client.0.smithi031.stdout:0/726: link d0/d29/d33/d84/f97 d0/d29/da7/ffc 0 2024-09-17T01:52:10.686 INFO:tasks.workunit.client.0.smithi031.stdout:5/582: mkdir da/d4b/dce 0 2024-09-17T01:52:10.687 INFO:tasks.workunit.client.1.smithi092.stdout:0/576: link d3/d2e/d3b/d40/f54 d3/da/d1c/fb3 0 2024-09-17T01:52:10.689 INFO:tasks.workunit.client.0.smithi031.stdout:4/883: rename d8/d3a/d10a/d55 to d8/d3a/d10a/d64/d4d/d75/d11a 0 2024-09-17T01:52:10.689 INFO:tasks.workunit.client.1.smithi092.stdout:3/506: symlink d4/laa 0 2024-09-17T01:52:10.690 INFO:tasks.workunit.client.1.smithi092.stdout:1/610: dwrite db/d6c/d7e/d82/fae [0,4194304] 0 2024-09-17T01:52:10.691 INFO:tasks.workunit.client.1.smithi092.stdout:1/611: read - db/d3b/fb7 zero size 2024-09-17T01:52:10.692 INFO:tasks.workunit.client.1.smithi092.stdout:1/612: stat db/d1d/d23 0 2024-09-17T01:52:10.692 INFO:tasks.workunit.client.1.smithi092.stdout:4/663: mkdir d4/d5/d1d/d30/d7a/dda 0 2024-09-17T01:52:10.692 INFO:tasks.workunit.client.0.smithi031.stdout:5/583: creat da/d14/dac/d62/fcf x:0 0 0 2024-09-17T01:52:10.693 INFO:tasks.workunit.client.0.smithi031.stdout:5/584: chown da/d42/d26/f39 11518 1 2024-09-17T01:52:10.694 INFO:tasks.workunit.client.1.smithi092.stdout:3/507: symlink d4/d20/d39/d70/d95/lab 0 2024-09-17T01:52:10.694 INFO:tasks.workunit.client.0.smithi031.stdout:3/643: fsync db/df/d1d/d37/f4b 0 2024-09-17T01:52:10.694 INFO:tasks.workunit.client.1.smithi092.stdout:1/613: creat db/d1d/d23/d55/fc7 x:0 0 0 2024-09-17T01:52:10.695 INFO:tasks.workunit.client.1.smithi092.stdout:4/664: write d4/d13/d3b/d42/d76/f48 [1756457,116274] 0 2024-09-17T01:52:10.696 INFO:tasks.workunit.client.1.smithi092.stdout:1/614: chown db/d1d/d23/d55/c63 300 1 2024-09-17T01:52:10.696 INFO:tasks.workunit.client.1.smithi092.stdout:1/615: fsync db/d1d/f72 0 2024-09-17T01:52:10.697 INFO:tasks.workunit.client.0.smithi031.stdout:0/727: creat d0/d29/d33/d5/dec/ffd x:0 0 0 2024-09-17T01:52:10.698 INFO:tasks.workunit.client.1.smithi092.stdout:4/665: readlink d4/d5/d8/l53 0 2024-09-17T01:52:10.699 INFO:tasks.workunit.client.1.smithi092.stdout:3/508: getdents d4/d13/d2e/d43 0 2024-09-17T01:52:10.700 INFO:tasks.workunit.client.0.smithi031.stdout:0/728: truncate d0/d29/d33/d5/fbe 157549 0 2024-09-17T01:52:10.701 INFO:tasks.workunit.client.1.smithi092.stdout:5/451: write d0/de/d19/d1a/d1e/f1d [1098823,48439] 0 2024-09-17T01:52:10.702 INFO:tasks.workunit.client.0.smithi031.stdout:5/585: creat da/d4b/d6c/fd0 x:0 0 0 2024-09-17T01:52:10.703 INFO:tasks.workunit.client.0.smithi031.stdout:5/586: dread - da/dc/fc9 zero size 2024-09-17T01:52:10.706 INFO:tasks.workunit.client.0.smithi031.stdout:5/587: fsync da/d4b/f65 0 2024-09-17T01:52:10.706 INFO:tasks.workunit.client.0.smithi031.stdout:0/729: truncate d0/d37/f87 1927691 0 2024-09-17T01:52:10.707 INFO:tasks.workunit.client.1.smithi092.stdout:5/452: chown d0/de/d19/f1f 45256850 1 2024-09-17T01:52:10.707 INFO:tasks.workunit.client.1.smithi092.stdout:1/616: link db/d6c/d7e/d82/fae db/d1d/d23/d88/fc8 0 2024-09-17T01:52:10.708 INFO:tasks.workunit.client.0.smithi031.stdout:9/587: dread d3/f15 [0,4194304] 0 2024-09-17T01:52:10.708 INFO:tasks.workunit.client.1.smithi092.stdout:1/617: dread - db/d3b/fb7 zero size 2024-09-17T01:52:10.708 INFO:tasks.workunit.client.1.smithi092.stdout:1/618: dread - db/d1d/d23/d55/fa9 zero size 2024-09-17T01:52:10.710 INFO:tasks.workunit.client.1.smithi092.stdout:3/509: link d4/d2f/d44/d3c/f90 d4/d20/d39/fac 0 2024-09-17T01:52:10.711 INFO:tasks.workunit.client.1.smithi092.stdout:5/453: symlink d0/d7e/l93 0 2024-09-17T01:52:10.712 INFO:tasks.workunit.client.1.smithi092.stdout:5/454: write d0/d7e/f85 [707345,46096] 0 2024-09-17T01:52:10.716 INFO:tasks.workunit.client.1.smithi092.stdout:3/510: mkdir d4/d20/d39/d70/d95/dad 0 2024-09-17T01:52:10.717 INFO:tasks.workunit.client.1.smithi092.stdout:3/511: chown d4/d16/f80 3966 1 2024-09-17T01:52:10.719 INFO:tasks.workunit.client.1.smithi092.stdout:5/455: rename d0/de/d19/d1a/d1e/d29/l61 to d0/d7e/l94 0 2024-09-17T01:52:10.720 INFO:tasks.workunit.client.1.smithi092.stdout:4/666: link d4/c22 d4/d13/d3b/d42/cdb 0 2024-09-17T01:52:10.721 INFO:tasks.workunit.client.1.smithi092.stdout:5/456: chown d0/de/d19/d1a/d1e/f1b 7836610 1 2024-09-17T01:52:10.722 INFO:tasks.workunit.client.0.smithi031.stdout:5/588: mknod da/dc/d25/cd1 0 2024-09-17T01:52:10.722 INFO:tasks.workunit.client.1.smithi092.stdout:4/667: creat d4/d5/d8/fdc x:0 0 0 2024-09-17T01:52:10.723 INFO:tasks.workunit.client.1.smithi092.stdout:1/619: rmdir db/d6c/d7e/d82 39 2024-09-17T01:52:10.724 INFO:tasks.workunit.client.0.smithi031.stdout:8/612: rename d0/df/d19/d86/l93 to d0/d5/d54/lb5 0 2024-09-17T01:52:10.725 INFO:tasks.workunit.client.1.smithi092.stdout:3/512: link d4/d13/f8b d4/d2f/d44/fae 0 2024-09-17T01:52:10.725 INFO:tasks.workunit.client.0.smithi031.stdout:0/730: mknod d0/d29/da7/db3/cfe 0 2024-09-17T01:52:10.726 INFO:tasks.workunit.client.1.smithi092.stdout:5/457: mknod d0/d50/d70/c95 0 2024-09-17T01:52:10.728 INFO:tasks.workunit.client.0.smithi031.stdout:8/613: rmdir d0/df/dd 39 2024-09-17T01:52:10.729 INFO:tasks.workunit.client.1.smithi092.stdout:3/513: write d4/d20/f7c [1359270,88793] 0 2024-09-17T01:52:10.729 INFO:tasks.workunit.client.0.smithi031.stdout:4/884: dwrite d8/d3a/d10a/d64/f21 [4194304,4194304] 0 2024-09-17T01:52:10.731 INFO:tasks.workunit.client.1.smithi092.stdout:5/458: mknod d0/de/d19/d1a/d1e/d29/c96 0 2024-09-17T01:52:10.731 INFO:tasks.workunit.client.1.smithi092.stdout:8/412: sync 2024-09-17T01:52:10.732 INFO:tasks.workunit.client.1.smithi092.stdout:6/443: sync 2024-09-17T01:52:10.732 INFO:tasks.workunit.client.1.smithi092.stdout:2/469: sync 2024-09-17T01:52:10.732 INFO:tasks.workunit.client.0.smithi031.stdout:3/644: truncate db/f46 288529 0 2024-09-17T01:52:10.733 INFO:tasks.workunit.client.1.smithi092.stdout:8/413: fdatasync d15/f1a 0 2024-09-17T01:52:10.733 INFO:tasks.workunit.client.1.smithi092.stdout:4/668: mkdir d4/d5/d1d/d30/ddd 0 2024-09-17T01:52:10.733 INFO:tasks.workunit.client.1.smithi092.stdout:0/577: write d3/da/d1c/f43 [2073143,44269] 0 2024-09-17T01:52:10.734 INFO:tasks.workunit.client.0.smithi031.stdout:9/588: truncate d3/d19/f65 3967042 0 2024-09-17T01:52:10.735 INFO:tasks.workunit.client.1.smithi092.stdout:2/470: chown d10/d1d/d2c/f42 1436195 1 2024-09-17T01:52:10.735 INFO:tasks.workunit.client.1.smithi092.stdout:4/669: chown d4/d5/d8 22729 1 2024-09-17T01:52:10.735 INFO:tasks.workunit.client.1.smithi092.stdout:3/514: mkdir d4/d16/d1b/daf 0 2024-09-17T01:52:10.736 INFO:tasks.workunit.client.1.smithi092.stdout:1/620: link db/d1d/f22 db/d1d/d23/d88/fc9 0 2024-09-17T01:52:10.736 INFO:tasks.workunit.client.0.smithi031.stdout:0/731: truncate d0/d29/d33/f28 1144983 0 2024-09-17T01:52:10.736 INFO:tasks.workunit.client.0.smithi031.stdout:3/645: read db/df/d1d/d37/d4a/f94 [795958,25091] 0 2024-09-17T01:52:10.739 INFO:tasks.workunit.client.0.smithi031.stdout:5/589: creat da/d14/dac/d82/fd2 x:0 0 0 2024-09-17T01:52:10.739 INFO:tasks.workunit.client.1.smithi092.stdout:4/670: write d4/d5/d1d/dae/fd5 [952754,114120] 0 2024-09-17T01:52:10.739 INFO:tasks.workunit.client.1.smithi092.stdout:5/459: truncate d0/de/d19/d1a/d1e/d29/f60 385469 0 2024-09-17T01:52:10.739 INFO:tasks.workunit.client.0.smithi031.stdout:5/590: fsync da/fb8 0 2024-09-17T01:52:10.740 INFO:tasks.workunit.client.1.smithi092.stdout:1/621: chown db/d6c/d7a/la5 466 1 2024-09-17T01:52:10.740 INFO:tasks.workunit.client.0.smithi031.stdout:5/591: stat da/d42 0 2024-09-17T01:52:10.741 INFO:tasks.workunit.client.0.smithi031.stdout:4/885: dwrite d8/d3a/d10a/d64/d4f/fc0 [0,4194304] 0 2024-09-17T01:52:10.742 INFO:tasks.workunit.client.1.smithi092.stdout:8/414: rename d15/l2a to d15/d32/l7f 0 2024-09-17T01:52:10.743 INFO:tasks.workunit.client.1.smithi092.stdout:0/578: creat d3/da/d1c/d4a/fb4 x:0 0 0 2024-09-17T01:52:10.750 INFO:tasks.workunit.client.1.smithi092.stdout:2/471: creat d10/d4c/d80/d95/fa0 x:0 0 0 2024-09-17T01:52:10.750 INFO:tasks.workunit.client.0.smithi031.stdout:8/614: mkdir d0/df/db6 0 2024-09-17T01:52:10.750 INFO:tasks.workunit.client.0.smithi031.stdout:3/646: mknod db/df/d1d/d37/d4a/d97/cc4 0 2024-09-17T01:52:10.751 INFO:tasks.workunit.client.1.smithi092.stdout:1/622: unlink db/d1d/d4b/ca6 0 2024-09-17T01:52:10.751 INFO:tasks.workunit.client.1.smithi092.stdout:3/515: dread d4/d13/d2e/d5f/f62 [0,4194304] 0 2024-09-17T01:52:10.753 INFO:tasks.workunit.client.0.smithi031.stdout:5/592: truncate da/d42/d12/f20 1493373 0 2024-09-17T01:52:10.753 INFO:tasks.workunit.client.1.smithi092.stdout:4/671: write d4/d5/d1d/d30/f64 [1215317,84964] 0 2024-09-17T01:52:10.754 INFO:tasks.workunit.client.0.smithi031.stdout:9/589: unlink d3/d19/cb0 0 2024-09-17T01:52:10.755 INFO:tasks.workunit.client.1.smithi092.stdout:2/472: write d10/d5c/d81/f87 [279148,108871] 0 2024-09-17T01:52:10.759 INFO:tasks.workunit.client.1.smithi092.stdout:6/444: dread d3/d10/d1a/f24 [4194304,4194304] 0 2024-09-17T01:52:10.760 INFO:tasks.workunit.client.0.smithi031.stdout:5/593: dread - da/d14/dac/d62/f6b zero size 2024-09-17T01:52:10.761 INFO:tasks.workunit.client.1.smithi092.stdout:4/672: readlink d4/d13/d3b/d42/d76/d35/lb7 0 2024-09-17T01:52:10.761 INFO:tasks.workunit.client.0.smithi031.stdout:9/590: symlink d3/d19/d1f/lbd 0 2024-09-17T01:52:10.763 INFO:tasks.workunit.client.1.smithi092.stdout:8/415: dwrite d15/f1f [4194304,4194304] 0 2024-09-17T01:52:10.765 INFO:tasks.workunit.client.1.smithi092.stdout:0/579: dwrite d3/d2e/f84 [0,4194304] 0 2024-09-17T01:52:10.765 INFO:tasks.workunit.client.0.smithi031.stdout:0/732: rename d0/d29/da7/db3/d9c to d0/d29/d33/dff 0 2024-09-17T01:52:10.767 INFO:tasks.workunit.client.0.smithi031.stdout:4/886: creat d8/d3a/d10a/d64/d4d/f11b x:0 0 0 2024-09-17T01:52:10.768 INFO:tasks.workunit.client.0.smithi031.stdout:0/733: chown d0/d29/da7/db3/l83 1287013 1 2024-09-17T01:52:10.768 INFO:tasks.workunit.client.1.smithi092.stdout:2/473: creat d10/d8d/d63/fa1 x:0 0 0 2024-09-17T01:52:10.768 INFO:tasks.workunit.client.0.smithi031.stdout:9/591: dwrite d3/d19/fa4 [0,4194304] 0 2024-09-17T01:52:10.769 INFO:tasks.workunit.client.0.smithi031.stdout:9/592: stat d3/cae 0 2024-09-17T01:52:10.770 INFO:tasks.workunit.client.0.smithi031.stdout:4/887: stat d8/d3a/d10a/d64/d4f/caf 0 2024-09-17T01:52:10.770 INFO:tasks.workunit.client.0.smithi031.stdout:9/593: chown d3/d4/l7c 38 1 2024-09-17T01:52:10.773 INFO:tasks.workunit.client.1.smithi092.stdout:8/416: stat d15/d32/d40/d42/d6b 0 2024-09-17T01:52:10.776 INFO:tasks.workunit.client.0.smithi031.stdout:8/615: rename d0/df/dd/d59/d8d to d0/d5/d6c/db0/db7 0 2024-09-17T01:52:10.777 INFO:tasks.workunit.client.1.smithi092.stdout:2/474: read d10/d55/f5b [616286,76305] 0 2024-09-17T01:52:10.779 INFO:tasks.workunit.client.0.smithi031.stdout:0/734: symlink d0/d29/d33/d2a/dde/l100 0 2024-09-17T01:52:10.780 INFO:tasks.workunit.client.1.smithi092.stdout:1/623: dwrite db/d3b/fb7 [0,4194304] 0 2024-09-17T01:52:10.781 INFO:tasks.workunit.client.1.smithi092.stdout:3/516: dwrite d4/d2f/f53 [0,4194304] 0 2024-09-17T01:52:10.782 INFO:tasks.workunit.client.0.smithi031.stdout:9/594: dwrite d3/d19/f22 [8388608,4194304] 0 2024-09-17T01:52:10.783 INFO:tasks.workunit.client.0.smithi031.stdout:4/888: fdatasync d8/d3a/d10a/d64/f2f 0 2024-09-17T01:52:10.784 INFO:tasks.workunit.client.0.smithi031.stdout:3/647: write db/f34 [3951945,2517] 0 2024-09-17T01:52:10.785 INFO:tasks.workunit.client.0.smithi031.stdout:8/616: truncate d0/d5/d6c/d6d/f8f 1244890 0 2024-09-17T01:52:10.788 INFO:tasks.workunit.client.0.smithi031.stdout:0/735: write d0/d29/d33/d5/fa [3810147,32068] 0 2024-09-17T01:52:10.789 INFO:tasks.workunit.client.0.smithi031.stdout:3/648: dread db/df/f44 [0,4194304] 0 2024-09-17T01:52:10.793 INFO:tasks.workunit.client.0.smithi031.stdout:0/736: write d0/d29/da7/db3/d4a/d86/dd7/ffb [80471,101314] 0 2024-09-17T01:52:10.793 INFO:tasks.workunit.client.0.smithi031.stdout:5/594: getdents da/d42/d12 0 2024-09-17T01:52:10.793 INFO:tasks.workunit.client.0.smithi031.stdout:3/649: truncate db/df/d1d/fb4 1640654 0 2024-09-17T01:52:10.794 INFO:tasks.workunit.client.1.smithi092.stdout:4/673: dwrite d4/d5/fb9 [0,4194304] 0 2024-09-17T01:52:10.796 INFO:tasks.workunit.client.0.smithi031.stdout:3/650: chown db/df/d1d/d37/d4a/ca4 855901 1 2024-09-17T01:52:10.797 INFO:tasks.workunit.client.1.smithi092.stdout:0/580: dwrite d3/d2e/d55/d63/d81/fac [0,4194304] 0 2024-09-17T01:52:10.799 INFO:tasks.workunit.client.1.smithi092.stdout:5/460: dwrite d0/d23/f4d [0,4194304] 0 2024-09-17T01:52:10.800 INFO:tasks.workunit.client.0.smithi031.stdout:9/595: mknod d3/d4/da0/d36/d8f/cbe 0 2024-09-17T01:52:10.801 INFO:tasks.workunit.client.1.smithi092.stdout:5/461: dread - d0/de/d19/d1a/d1e/f4e zero size 2024-09-17T01:52:10.801 INFO:tasks.workunit.client.0.smithi031.stdout:5/595: rmdir da/d42/d12/d4a 39 2024-09-17T01:52:10.802 INFO:tasks.workunit.client.1.smithi092.stdout:5/462: write d0/f6d [81178,101184] 0 2024-09-17T01:52:10.803 INFO:tasks.workunit.client.0.smithi031.stdout:5/596: truncate da/d14/f3b 1041998 0 2024-09-17T01:52:10.804 INFO:tasks.workunit.client.0.smithi031.stdout:8/617: rename d0/d5/f43 to d0/df/dd/d59/fb8 0 2024-09-17T01:52:10.804 INFO:tasks.workunit.client.1.smithi092.stdout:2/475: rename cf to d10/d1d/d2c/d56/ca2 0 2024-09-17T01:52:10.805 INFO:tasks.workunit.client.0.smithi031.stdout:8/618: chown d0/d5/c34 7210492 1 2024-09-17T01:52:10.809 INFO:tasks.workunit.client.0.smithi031.stdout:0/737: read d0/d29/d33/d2a/d25/d38/f5e [3645094,23093] 0 2024-09-17T01:52:10.815 INFO:tasks.workunit.client.0.smithi031.stdout:5/597: chown da/d42/d12/d72/fc8 267806013 1 2024-09-17T01:52:10.817 INFO:tasks.workunit.client.0.smithi031.stdout:9/596: link d3/f1d d3/d19/d1f/d44/d64/fbf 0 2024-09-17T01:52:10.818 INFO:tasks.workunit.client.0.smithi031.stdout:0/738: rename d0/d29/l60 to d0/d29/da7/dbb/l101 0 2024-09-17T01:52:10.819 INFO:tasks.workunit.client.0.smithi031.stdout:5/598: mknod da/d4b/cd3 0 2024-09-17T01:52:10.820 INFO:tasks.workunit.client.0.smithi031.stdout:9/597: mknod d3/d19/d1f/cc0 0 2024-09-17T01:52:10.824 INFO:tasks.workunit.client.0.smithi031.stdout:9/598: symlink d3/d19/d1f/d44/d64/lc1 0 2024-09-17T01:52:10.824 INFO:tasks.workunit.client.0.smithi031.stdout:5/599: link da/d14/cb9 da/d4b/db4/cd4 0 2024-09-17T01:52:10.827 INFO:tasks.workunit.client.0.smithi031.stdout:9/599: readlink d3/d4/da0/d36/d79/l86 0 2024-09-17T01:52:10.827 INFO:tasks.workunit.client.0.smithi031.stdout:0/739: dwrite d0/d29/d33/d5/d48/d56/fea [0,4194304] 0 2024-09-17T01:52:10.827 INFO:tasks.workunit.client.0.smithi031.stdout:5/600: chown da/d42/d12/f41 1076063718 1 2024-09-17T01:52:10.828 INFO:tasks.workunit.client.0.smithi031.stdout:9/600: chown d3/d19/d1f/d44/d64/fbf 512 1 2024-09-17T01:52:10.833 INFO:tasks.workunit.client.0.smithi031.stdout:3/651: dread db/df/d1d/f49 [0,4194304] 0 2024-09-17T01:52:10.838 INFO:tasks.workunit.client.0.smithi031.stdout:0/740: dwrite d0/d29/da7/db3/d4a/f6e [0,4194304] 0 2024-09-17T01:52:10.839 INFO:tasks.workunit.client.0.smithi031.stdout:5/601: dwrite da/d14/dac/f77 [0,4194304] 0 2024-09-17T01:52:10.841 INFO:tasks.workunit.client.0.smithi031.stdout:3/652: creat db/df/d1c/d6a/fc5 x:0 0 0 2024-09-17T01:52:10.842 INFO:tasks.workunit.client.0.smithi031.stdout:4/889: write d8/f98 [568241,119829] 0 2024-09-17T01:52:10.846 INFO:tasks.workunit.client.0.smithi031.stdout:5/602: symlink da/d4b/dce/ld5 0 2024-09-17T01:52:10.847 INFO:tasks.workunit.client.0.smithi031.stdout:5/603: write da/dc/fc9 [326425,46341] 0 2024-09-17T01:52:10.848 INFO:tasks.workunit.client.0.smithi031.stdout:3/653: symlink db/df/d1d/d37/lc6 0 2024-09-17T01:52:10.851 INFO:tasks.workunit.client.1.smithi092.stdout:3/517: creat d4/d20/fb0 x:0 0 0 2024-09-17T01:52:10.853 INFO:tasks.workunit.client.1.smithi092.stdout:5/463: write d0/de/d19/d1a/d1e/d3e/d4c/f5d [161719,42908] 0 2024-09-17T01:52:10.853 INFO:tasks.workunit.client.1.smithi092.stdout:1/624: write db/d1d/f22 [1912003,12234] 0 2024-09-17T01:52:10.854 INFO:tasks.workunit.client.1.smithi092.stdout:3/518: stat d4/d20/d39/l97 0 2024-09-17T01:52:10.854 INFO:tasks.workunit.client.1.smithi092.stdout:6/445: dread d3/f3a [0,4194304] 0 2024-09-17T01:52:10.855 INFO:tasks.workunit.client.1.smithi092.stdout:4/674: creat d4/d13/fde x:0 0 0 2024-09-17T01:52:10.856 INFO:tasks.workunit.client.0.smithi031.stdout:3/654: creat db/df/d50/fc7 x:0 0 0 2024-09-17T01:52:10.857 INFO:tasks.workunit.client.0.smithi031.stdout:4/890: rename d8/d3a/d10a/d64/fef to d8/d3a/d10a/d64/d4d/d5a/d8c/d25/f11c 0 2024-09-17T01:52:10.859 INFO:tasks.workunit.client.1.smithi092.stdout:2/476: dwrite d10/f2a [0,4194304] 0 2024-09-17T01:52:10.859 INFO:tasks.workunit.client.0.smithi031.stdout:5/604: mknod da/d14/dac/cd6 0 2024-09-17T01:52:10.861 INFO:tasks.workunit.client.1.smithi092.stdout:3/519: symlink d4/d20/lb1 0 2024-09-17T01:52:10.864 INFO:tasks.workunit.client.0.smithi031.stdout:4/891: rename d8/d3a/d10a/d64/d4f/l102 to d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/db0/l11d 0 2024-09-17T01:52:10.865 INFO:tasks.workunit.client.1.smithi092.stdout:6/446: rename d3/d10/d1f/d21/d28/d2b/f85 to d3/d70/f8a 0 2024-09-17T01:52:10.865 INFO:tasks.workunit.client.1.smithi092.stdout:1/625: symlink db/d1d/d23/da1/dbf/lca 0 2024-09-17T01:52:10.865 INFO:tasks.workunit.client.0.smithi031.stdout:9/601: truncate d3/d4/da0/d36/f6e 2933811 0 2024-09-17T01:52:10.867 INFO:tasks.workunit.client.0.smithi031.stdout:5/605: dwrite da/d42/d26/f9f [0,4194304] 0 2024-09-17T01:52:10.868 INFO:tasks.workunit.client.1.smithi092.stdout:0/581: dread d3/d2e/d3b/f94 [0,4194304] 0 2024-09-17T01:52:10.869 INFO:tasks.workunit.client.1.smithi092.stdout:1/626: write db/d1d/d23/d88/fb2 [483264,13652] 0 2024-09-17T01:52:10.871 INFO:tasks.workunit.client.1.smithi092.stdout:4/675: rename d4/d13/d3b/d42/d76/d41/d67 to d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf 0 2024-09-17T01:52:10.872 INFO:tasks.workunit.client.1.smithi092.stdout:3/520: mkdir d4/d20/d9f/db2 0 2024-09-17T01:52:10.873 INFO:tasks.workunit.client.0.smithi031.stdout:4/892: unlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/l9a 0 2024-09-17T01:52:10.874 INFO:tasks.workunit.client.1.smithi092.stdout:5/464: link d0/de/d19/d1a/d1e/d3e/d4c/c80 d0/d77/c97 0 2024-09-17T01:52:10.875 INFO:tasks.workunit.client.0.smithi031.stdout:3/655: rename db/df/d1c to db/df/dc8 0 2024-09-17T01:52:10.877 INFO:tasks.workunit.client.1.smithi092.stdout:1/627: unlink db/d6c/d7a/la5 0 2024-09-17T01:52:10.879 INFO:tasks.workunit.client.0.smithi031.stdout:9/602: creat d3/d4/fc2 x:0 0 0 2024-09-17T01:52:10.879 INFO:tasks.workunit.client.1.smithi092.stdout:4/676: mkdir d4/d13/d20/de0 0 2024-09-17T01:52:10.882 INFO:tasks.workunit.client.0.smithi031.stdout:4/893: truncate d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/f5b 3454363 0 2024-09-17T01:52:10.882 INFO:tasks.workunit.client.1.smithi092.stdout:3/521: unlink d4/d2f/d44/l68 0 2024-09-17T01:52:10.884 INFO:tasks.workunit.client.1.smithi092.stdout:5/465: fdatasync d0/de/f8e 0 2024-09-17T01:52:10.885 INFO:tasks.workunit.client.1.smithi092.stdout:1/628: symlink db/d6c/lcb 0 2024-09-17T01:52:10.885 INFO:tasks.workunit.client.1.smithi092.stdout:5/466: fsync d0/de/d19/f1f 0 2024-09-17T01:52:10.887 INFO:tasks.workunit.client.1.smithi092.stdout:5/467: fdatasync d0/de/d19/f1f 0 2024-09-17T01:52:10.888 INFO:tasks.workunit.client.0.smithi031.stdout:3/656: link db/df/d50/f63 db/da3/fc9 0 2024-09-17T01:52:10.889 INFO:tasks.workunit.client.1.smithi092.stdout:0/582: rename d3/l69 to d3/d2e/d3b/d8f/lb5 0 2024-09-17T01:52:10.890 INFO:tasks.workunit.client.1.smithi092.stdout:2/477: dread d10/d1d/d96/d77/f9b [0,4194304] 0 2024-09-17T01:52:10.890 INFO:tasks.workunit.client.1.smithi092.stdout:3/522: symlink d4/d2f/d44/lb3 0 2024-09-17T01:52:10.891 INFO:tasks.workunit.client.1.smithi092.stdout:3/523: stat d4/d20/f7c 0 2024-09-17T01:52:10.892 INFO:tasks.workunit.client.1.smithi092.stdout:1/629: mknod db/d1d/d23/da1/ccc 0 2024-09-17T01:52:10.893 INFO:tasks.workunit.client.1.smithi092.stdout:5/468: mknod d0/de/d19/d3c/d41/c98 0 2024-09-17T01:52:10.894 INFO:tasks.workunit.client.1.smithi092.stdout:5/469: dread - d0/de/d19/d3c/f8a zero size 2024-09-17T01:52:10.895 INFO:tasks.workunit.client.0.smithi031.stdout:2/720: sync 2024-09-17T01:52:10.895 INFO:tasks.workunit.client.0.smithi031.stdout:1/693: sync 2024-09-17T01:52:10.895 INFO:tasks.workunit.client.0.smithi031.stdout:3/657: fdatasync db/f12 0 2024-09-17T01:52:10.895 INFO:tasks.workunit.client.0.smithi031.stdout:5/606: dwrite da/d42/d12/f20 [0,4194304] 0 2024-09-17T01:52:10.896 INFO:tasks.workunit.client.1.smithi092.stdout:5/470: chown d0/de/d19/d1a/d1e/d29 30 1 2024-09-17T01:52:10.896 INFO:tasks.workunit.client.1.smithi092.stdout:4/677: rename d4/d5/d1d/d30/f9a to d4/d5/d46/fe1 0 2024-09-17T01:52:10.898 INFO:tasks.workunit.client.1.smithi092.stdout:5/471: write d0/de/d19/d1a/d1e/d3e/d4c/f5d [1615550,79859] 0 2024-09-17T01:52:10.898 INFO:tasks.workunit.client.1.smithi092.stdout:2/478: mkdir d10/d8d/d63/da3 0 2024-09-17T01:52:10.900 INFO:tasks.workunit.client.1.smithi092.stdout:3/524: mknod d4/d73/d8f/d92/cb4 0 2024-09-17T01:52:10.900 INFO:tasks.workunit.client.1.smithi092.stdout:6/447: write d3/d10/d1f/d21/d28/d2b/f41 [3699121,13414] 0 2024-09-17T01:52:10.901 INFO:tasks.workunit.client.0.smithi031.stdout:3/658: dread db/df/d1d/f49 [0,4194304] 0 2024-09-17T01:52:10.902 INFO:tasks.workunit.client.1.smithi092.stdout:3/525: fsync d4/d2f/f9a 0 2024-09-17T01:52:10.902 INFO:tasks.workunit.client.1.smithi092.stdout:4/678: fsync d4/f62 0 2024-09-17T01:52:10.903 INFO:tasks.workunit.client.1.smithi092.stdout:4/679: fsync d4/d13/f8f 0 2024-09-17T01:52:10.904 INFO:tasks.workunit.client.1.smithi092.stdout:4/680: stat d4/d5/fa2 0 2024-09-17T01:52:10.904 INFO:tasks.workunit.client.1.smithi092.stdout:2/479: mknod d10/d4c/d80/d95/ca4 0 2024-09-17T01:52:10.905 INFO:tasks.workunit.client.0.smithi031.stdout:1/694: unlink d4/l35 0 2024-09-17T01:52:10.905 INFO:tasks.workunit.client.0.smithi031.stdout:9/603: dwrite d3/d19/d1f/f58 [0,4194304] 0 2024-09-17T01:52:10.906 INFO:tasks.workunit.client.1.smithi092.stdout:5/472: rename d0/de/d19/l20 to d0/d7e/d90/l99 0 2024-09-17T01:52:10.907 INFO:tasks.workunit.client.0.smithi031.stdout:2/721: fsync d1/d7c/fd9 0 2024-09-17T01:52:10.909 INFO:tasks.workunit.client.1.smithi092.stdout:6/448: unlink d3/f5 0 2024-09-17T01:52:10.912 INFO:tasks.workunit.client.1.smithi092.stdout:0/583: creat d3/d2e/d3b/d8f/fb6 x:0 0 0 2024-09-17T01:52:10.913 INFO:tasks.workunit.client.0.smithi031.stdout:5/607: creat da/d4b/db4/fd7 x:0 0 0 2024-09-17T01:52:10.916 INFO:tasks.workunit.client.1.smithi092.stdout:5/473: rmdir d0/d50 39 2024-09-17T01:52:10.917 INFO:tasks.workunit.client.1.smithi092.stdout:2/480: rename d10/d55/l8a to d10/d5c/la5 0 2024-09-17T01:52:10.917 INFO:tasks.workunit.client.0.smithi031.stdout:9/604: symlink d3/lc3 0 2024-09-17T01:52:10.918 INFO:tasks.workunit.client.0.smithi031.stdout:4/894: dwrite d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/d110/f119 [0,4194304] 0 2024-09-17T01:52:10.918 INFO:tasks.workunit.client.0.smithi031.stdout:2/722: chown d1/d3/df/d11/c53 3230 1 2024-09-17T01:52:10.918 INFO:tasks.workunit.client.0.smithi031.stdout:1/695: dwrite d4/d1e/d40/fa8 [0,4194304] 0 2024-09-17T01:52:10.918 INFO:tasks.workunit.client.1.smithi092.stdout:6/449: truncate d3/f6 934759 0 2024-09-17T01:52:10.920 INFO:tasks.workunit.client.1.smithi092.stdout:1/630: dread db/d1d/d23/d55/f61 [0,4194304] 0 2024-09-17T01:52:10.920 INFO:tasks.workunit.client.1.smithi092.stdout:4/681: dwrite d4/d13/d20/f29 [0,4194304] 0 2024-09-17T01:52:10.921 INFO:tasks.workunit.client.1.smithi092.stdout:0/584: creat d3/d2e/d3b/d48/d76/fb7 x:0 0 0 2024-09-17T01:52:10.924 INFO:tasks.workunit.client.1.smithi092.stdout:2/481: chown d10/d4c/c69 11400 1 2024-09-17T01:52:10.925 INFO:tasks.workunit.client.0.smithi031.stdout:2/723: truncate d1/d3/df/d11/d30/f82 1442387 0 2024-09-17T01:52:10.925 INFO:tasks.workunit.client.1.smithi092.stdout:5/474: mkdir d0/de/d19/d1a/d1e/d52/d9a 0 2024-09-17T01:52:10.925 INFO:tasks.workunit.client.0.smithi031.stdout:5/608: creat da/d42/fd8 x:0 0 0 2024-09-17T01:52:10.927 INFO:tasks.workunit.client.0.smithi031.stdout:9/605: symlink d3/d4/da0/d36/lc4 0 2024-09-17T01:52:10.928 INFO:tasks.workunit.client.1.smithi092.stdout:5/475: fdatasync d0/de/d19/d1a/d1e/d74/f8b 0 2024-09-17T01:52:10.929 INFO:tasks.workunit.client.1.smithi092.stdout:1/631: rmdir db/d6c 39 2024-09-17T01:52:10.929 INFO:tasks.workunit.client.0.smithi031.stdout:5/609: creat da/d4b/dce/fd9 x:0 0 0 2024-09-17T01:52:10.931 INFO:tasks.workunit.client.0.smithi031.stdout:5/610: dread - da/d4b/d6c/fd0 zero size 2024-09-17T01:52:10.932 INFO:tasks.workunit.client.0.smithi031.stdout:5/611: chown da/d4b/ccd 3997848 1 2024-09-17T01:52:10.933 INFO:tasks.workunit.client.0.smithi031.stdout:2/724: rename d1/d3/df/d11/d30/f4d to d1/d3/df/d11/d44/ff7 0 2024-09-17T01:52:10.933 INFO:tasks.workunit.client.0.smithi031.stdout:4/895: write d8/d3a/f40 [2086433,36130] 0 2024-09-17T01:52:10.935 INFO:tasks.workunit.client.0.smithi031.stdout:1/696: write d4/d1e/d3f/d4d/dcd/fca [846482,30801] 0 2024-09-17T01:52:10.936 INFO:tasks.workunit.client.1.smithi092.stdout:2/482: write d10/d1d/d96/d77/f3e [171633,83400] 0 2024-09-17T01:52:10.940 INFO:tasks.workunit.client.1.smithi092.stdout:2/483: truncate d10/d1d/d24/d6e/f9d 291982 0 2024-09-17T01:52:10.941 INFO:tasks.workunit.client.0.smithi031.stdout:2/725: symlink d1/d3/d2d/db2/d1e/d21/d98/lf8 0 2024-09-17T01:52:10.943 INFO:tasks.workunit.client.1.smithi092.stdout:1/632: write db/d6c/d7e/d96/fb6 [319899,95190] 0 2024-09-17T01:52:10.944 INFO:tasks.workunit.client.0.smithi031.stdout:4/896: fdatasync d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/f5b 0 2024-09-17T01:52:10.944 INFO:tasks.workunit.client.1.smithi092.stdout:3/526: write d4/d13/f8b [423991,71320] 0 2024-09-17T01:52:10.944 INFO:tasks.workunit.client.1.smithi092.stdout:4/682: dwrite d4/d13/d3b/d42/fc7 [0,4194304] 0 2024-09-17T01:52:10.945 INFO:tasks.workunit.client.1.smithi092.stdout:3/527: readlink d4/l9 0 2024-09-17T01:52:10.946 INFO:tasks.workunit.client.0.smithi031.stdout:3/659: dread db/df/f22 [4194304,4194304] 0 2024-09-17T01:52:10.947 INFO:tasks.workunit.client.0.smithi031.stdout:2/726: unlink d1/d3/d2d/f55 0 2024-09-17T01:52:10.947 INFO:tasks.workunit.client.1.smithi092.stdout:0/585: dread d3/da/f10 [0,4194304] 0 2024-09-17T01:52:10.948 INFO:tasks.workunit.client.0.smithi031.stdout:9/606: dread d3/d4/f5 [0,4194304] 0 2024-09-17T01:52:10.949 INFO:tasks.workunit.client.1.smithi092.stdout:2/484: mkdir d10/d5c/d81/da6 0 2024-09-17T01:52:10.949 INFO:tasks.workunit.client.1.smithi092.stdout:5/476: getdents d0/de/d19/d1a/d1e/d52/d9a 0 2024-09-17T01:52:10.949 INFO:tasks.workunit.client.0.smithi031.stdout:1/697: dwrite d4/d1e/d3f/d72/fc7 [0,4194304] 0 2024-09-17T01:52:10.950 INFO:tasks.workunit.client.1.smithi092.stdout:5/477: fdatasync d0/de/d19/d1a/d1e/f4e 0 2024-09-17T01:52:10.951 INFO:tasks.workunit.client.1.smithi092.stdout:3/528: rename d4/d13/d2e/c8a to d4/d2f/d44/d3c/cb5 0 2024-09-17T01:52:10.951 INFO:tasks.workunit.client.1.smithi092.stdout:0/586: write d3/da/d1c/f43 [2376358,11661] 0 2024-09-17T01:52:10.954 INFO:tasks.workunit.client.0.smithi031.stdout:9/607: write d3/d4/d41/fbc [498283,84527] 0 2024-09-17T01:52:10.954 INFO:tasks.workunit.client.1.smithi092.stdout:2/485: stat d10/d1d/d2c/f7d 0 2024-09-17T01:52:10.955 INFO:tasks.workunit.client.0.smithi031.stdout:4/897: symlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/d110/l11e 0 2024-09-17T01:52:10.955 INFO:tasks.workunit.client.1.smithi092.stdout:2/486: stat d10/d1d/d96/d77 0 2024-09-17T01:52:10.956 INFO:tasks.workunit.client.1.smithi092.stdout:3/529: write d4/d2f/d44/d3c/fa1 [224272,3060] 0 2024-09-17T01:52:10.960 INFO:tasks.workunit.client.0.smithi031.stdout:2/727: symlink d1/d3/df/d11/d30/da1/dca/lf9 0 2024-09-17T01:52:10.960 INFO:tasks.workunit.client.0.smithi031.stdout:1/698: truncate d4/d1e/d40/d84/fdc 936520 0 2024-09-17T01:52:10.961 INFO:tasks.workunit.client.1.smithi092.stdout:3/530: write d4/d20/f42 [418829,28082] 0 2024-09-17T01:52:10.962 INFO:tasks.workunit.client.1.smithi092.stdout:0/587: creat d3/d2e/d3b/d48/d76/fb8 x:0 0 0 2024-09-17T01:52:10.964 INFO:tasks.workunit.client.0.smithi031.stdout:1/699: dread - d4/d1e/d40/d84/fb9 zero size 2024-09-17T01:52:10.964 INFO:tasks.workunit.client.0.smithi031.stdout:3/660: dwrite db/fa7 [0,4194304] 0 2024-09-17T01:52:10.965 INFO:tasks.workunit.client.0.smithi031.stdout:9/608: unlink d3/d19/d1f/fb7 0 2024-09-17T01:52:10.965 INFO:tasks.workunit.client.0.smithi031.stdout:5/612: dread da/dc/f27 [0,4194304] 0 2024-09-17T01:52:10.965 INFO:tasks.workunit.client.1.smithi092.stdout:3/531: stat d4/d2f/d44/fae 0 2024-09-17T01:52:10.966 INFO:tasks.workunit.client.1.smithi092.stdout:0/588: chown d3/d1d/d6b 1 1 2024-09-17T01:52:10.966 INFO:tasks.workunit.client.1.smithi092.stdout:4/683: dwrite d4/d5/d1d/d30/d3f/d4b/f81 [0,4194304] 0 2024-09-17T01:52:10.966 INFO:tasks.workunit.client.0.smithi031.stdout:1/700: fsync d4/d1a/d43/f51 0 2024-09-17T01:52:10.967 INFO:tasks.workunit.client.1.smithi092.stdout:4/684: stat d4/d5/d8/fdc 0 2024-09-17T01:52:10.967 INFO:tasks.workunit.client.1.smithi092.stdout:0/589: fsync d3/d2e/d3b/d8f/f51 0 2024-09-17T01:52:10.967 INFO:tasks.workunit.client.1.smithi092.stdout:2/487: dread d10/d55/f64 [0,4194304] 0 2024-09-17T01:52:10.968 INFO:tasks.workunit.client.1.smithi092.stdout:6/450: write d3/d10/d1f/d21/d28/d2b/f69 [856780,89892] 0 2024-09-17T01:52:10.970 INFO:tasks.workunit.client.0.smithi031.stdout:5/613: unlink da/fbd 0 2024-09-17T01:52:10.972 INFO:tasks.workunit.client.0.smithi031.stdout:5/614: read - da/d14/dac/d62/fcf zero size 2024-09-17T01:52:10.972 INFO:tasks.workunit.client.1.smithi092.stdout:0/590: creat d3/d2e/d3b/fb9 x:0 0 0 2024-09-17T01:52:10.974 INFO:tasks.workunit.client.0.smithi031.stdout:3/661: creat db/df/d1d/d37/d65/fca x:0 0 0 2024-09-17T01:52:10.975 INFO:tasks.workunit.client.0.smithi031.stdout:1/701: mknod d4/d1e/d3f/d72/d7e/d92/ceb 0 2024-09-17T01:52:10.975 INFO:tasks.workunit.client.1.smithi092.stdout:4/685: mkdir d4/d5/d8/de2 0 2024-09-17T01:52:10.980 INFO:tasks.workunit.client.0.smithi031.stdout:3/662: rename db/df/d1d/d37/d3a to db/df/dc8/d6a/d83/dcb 0 2024-09-17T01:52:10.981 INFO:tasks.workunit.client.1.smithi092.stdout:6/451: creat d3/d10/d1f/d21/d28/d2b/f8b x:0 0 0 2024-09-17T01:52:10.984 INFO:tasks.workunit.client.1.smithi092.stdout:3/532: dwrite d4/d13/d2e/d43/f9b [0,4194304] 0 2024-09-17T01:52:10.988 INFO:tasks.workunit.client.1.smithi092.stdout:2/488: dread d10/d1d/d96/d77/f9f [0,4194304] 0 2024-09-17T01:52:10.989 INFO:tasks.workunit.client.1.smithi092.stdout:0/591: dwrite d3/d2e/d55/d63/f93 [0,4194304] 0 2024-09-17T01:52:10.989 INFO:tasks.workunit.client.1.smithi092.stdout:2/489: stat l7 0 2024-09-17T01:52:10.990 INFO:tasks.workunit.client.0.smithi031.stdout:3/663: mknod db/df/d1d/ccc 0 2024-09-17T01:52:10.992 INFO:tasks.workunit.client.1.smithi092.stdout:5/478: truncate d0/d23/f2c 3970438 0 2024-09-17T01:52:10.992 INFO:tasks.workunit.client.0.smithi031.stdout:5/615: getdents da/d14/dac/d82 0 2024-09-17T01:52:10.993 INFO:tasks.workunit.client.1.smithi092.stdout:4/686: dwrite d4/d13/d3b/d42/d76/fbb [0,4194304] 0 2024-09-17T01:52:10.995 INFO:tasks.workunit.client.1.smithi092.stdout:0/592: mkdir d3/da/d15/dba 0 2024-09-17T01:52:10.996 INFO:tasks.workunit.client.0.smithi031.stdout:3/664: creat db/df/dc8/d6a/fcd x:0 0 0 2024-09-17T01:52:10.997 INFO:tasks.workunit.client.1.smithi092.stdout:2/490: truncate d10/d1d/f8b 1485832 0 2024-09-17T01:52:10.998 INFO:tasks.workunit.client.1.smithi092.stdout:5/479: mkdir d0/de/d19/d1a/d24/d9b 0 2024-09-17T01:52:11.001 INFO:tasks.workunit.client.1.smithi092.stdout:2/491: mknod d10/d1d/d2c/d56/ca7 0 2024-09-17T01:52:11.002 INFO:tasks.workunit.client.1.smithi092.stdout:6/452: dread d3/d10/d1f/d21/d28/d2b/d48/d18/f6b [0,4194304] 0 2024-09-17T01:52:11.003 INFO:tasks.workunit.client.0.smithi031.stdout:5/616: dwrite da/dc/fc9 [0,4194304] 0 2024-09-17T01:52:11.003 INFO:tasks.workunit.client.1.smithi092.stdout:3/533: dwrite d4/d73/f7e [0,4194304] 0 2024-09-17T01:52:11.005 INFO:tasks.workunit.client.0.smithi031.stdout:4/898: write f5 [2136086,61021] 0 2024-09-17T01:52:11.005 INFO:tasks.workunit.client.0.smithi031.stdout:5/617: dread - da/d14/dac/dc2/fc5 zero size 2024-09-17T01:52:11.006 INFO:tasks.workunit.client.1.smithi092.stdout:3/534: readlink d4/d73/la7 0 2024-09-17T01:52:11.007 INFO:tasks.workunit.client.0.smithi031.stdout:3/665: truncate db/df/f39 1290979 0 2024-09-17T01:52:11.008 INFO:tasks.workunit.client.1.smithi092.stdout:2/492: mkdir d10/d3a/d97/da8 0 2024-09-17T01:52:11.008 INFO:tasks.workunit.client.1.smithi092.stdout:5/480: dread d0/de/d19/f6c [0,4194304] 0 2024-09-17T01:52:11.008 INFO:tasks.workunit.client.1.smithi092.stdout:6/453: chown d3/d10/d1f/d21/d28/d2b/d48/l76 4 1 2024-09-17T01:52:11.009 INFO:tasks.workunit.client.0.smithi031.stdout:3/666: dread - db/df/d50/fa0 zero size 2024-09-17T01:52:11.010 INFO:tasks.workunit.client.0.smithi031.stdout:4/899: rename d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c to d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/d11f 22 2024-09-17T01:52:11.010 INFO:tasks.workunit.client.0.smithi031.stdout:2/728: mknod d1/d3/d2d/db2/d1e/d4f/cfa 0 2024-09-17T01:52:11.011 INFO:tasks.workunit.client.1.smithi092.stdout:2/493: write d10/d5c/f85 [253783,95040] 0 2024-09-17T01:52:11.012 INFO:tasks.workunit.client.0.smithi031.stdout:3/667: chown db/df/d1d/d37/d4a/f94 2977 1 2024-09-17T01:52:11.012 INFO:tasks.workunit.client.1.smithi092.stdout:4/687: dwrite d4/d13/d3b/d42/d76/f48 [0,4194304] 0 2024-09-17T01:52:11.013 INFO:tasks.workunit.client.0.smithi031.stdout:5/618: symlink da/d14/dac/d62/lda 0 2024-09-17T01:52:11.015 INFO:tasks.workunit.client.1.smithi092.stdout:2/494: chown d10/d1d/d96/d77/f9b 107 1 2024-09-17T01:52:11.015 INFO:tasks.workunit.client.0.smithi031.stdout:5/619: truncate da/d4b/f9c 1614060 0 2024-09-17T01:52:11.016 INFO:tasks.workunit.client.0.smithi031.stdout:9/609: write d3/d19/d1f/d44/d64/f97 [247956,51375] 0 2024-09-17T01:52:11.016 INFO:tasks.workunit.client.1.smithi092.stdout:3/535: rmdir d4/d2f/d44/d7f 0 2024-09-17T01:52:11.017 INFO:tasks.workunit.client.0.smithi031.stdout:5/620: write da/dc/d98/fb2 [2472254,89579] 0 2024-09-17T01:52:11.019 INFO:tasks.workunit.client.0.smithi031.stdout:9/610: write d3/d19/d80/faf [1787438,24648] 0 2024-09-17T01:52:11.020 INFO:tasks.workunit.client.0.smithi031.stdout:1/702: truncate d4/d1e/d40/fa8 1307349 0 2024-09-17T01:52:11.022 INFO:tasks.workunit.client.1.smithi092.stdout:3/536: write d4/d13/d2e/d5f/f62 [676939,121567] 0 2024-09-17T01:52:11.024 INFO:tasks.workunit.client.1.smithi092.stdout:4/688: rename d4/d13/c56 to d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/ce3 0 2024-09-17T01:52:11.025 INFO:tasks.workunit.client.0.smithi031.stdout:2/729: rename d1/d3/df/d11/d44 to d1/d3/d45/dfb 0 2024-09-17T01:52:11.025 INFO:tasks.workunit.client.1.smithi092.stdout:6/454: getdents d3/d10/d1a/d43/d6a/d3d 0 2024-09-17T01:52:11.025 INFO:tasks.workunit.client.0.smithi031.stdout:2/730: readlink d1/d3/d2d/db2/d1e/d21/ddf/l60 0 2024-09-17T01:52:11.027 INFO:tasks.workunit.client.1.smithi092.stdout:3/537: unlink d4/d20/c38 0 2024-09-17T01:52:11.028 INFO:tasks.workunit.client.0.smithi031.stdout:9/611: mkdir d3/d4/da0/d36/d8f/dc5 0 2024-09-17T01:52:11.029 INFO:tasks.workunit.client.1.smithi092.stdout:3/538: read - d4/d2f/d44/d3c/f90 zero size 2024-09-17T01:52:11.029 INFO:tasks.workunit.client.1.smithi092.stdout:2/495: dwrite d10/d1d/d2c/f4d [0,4194304] 0 2024-09-17T01:52:11.029 INFO:tasks.workunit.client.0.smithi031.stdout:1/703: creat d4/d1e/d3f/d4d/dcd/fec x:0 0 0 2024-09-17T01:52:11.030 INFO:tasks.workunit.client.0.smithi031.stdout:4/900: link d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/c112 d8/d3a/d7e/c120 0 2024-09-17T01:52:11.031 INFO:tasks.workunit.client.0.smithi031.stdout:1/704: chown d4/l27 2755 1 2024-09-17T01:52:11.031 INFO:tasks.workunit.client.1.smithi092.stdout:4/689: link d4/d5/c1f d4/d5/d46/ce4 0 2024-09-17T01:52:11.032 INFO:tasks.workunit.client.1.smithi092.stdout:3/539: fsync d4/d13/d2e/d5f/f5c 0 2024-09-17T01:52:11.033 INFO:tasks.workunit.client.1.smithi092.stdout:4/690: write d4/d5/fc4 [682463,19241] 0 2024-09-17T01:52:11.033 INFO:tasks.workunit.client.1.smithi092.stdout:3/540: truncate d4/d13/f8b 1494934 0 2024-09-17T01:52:11.034 INFO:tasks.workunit.client.0.smithi031.stdout:4/901: write d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fd7 [4344231,31859] 0 2024-09-17T01:52:11.034 INFO:tasks.workunit.client.0.smithi031.stdout:2/731: rename d1/f14 to d1/d3/df/ffc 0 2024-09-17T01:52:11.036 INFO:tasks.workunit.client.1.smithi092.stdout:3/541: rmdir d4/d20/d3f 39 2024-09-17T01:52:11.038 INFO:tasks.workunit.client.0.smithi031.stdout:9/612: creat d3/d4/fc6 x:0 0 0 2024-09-17T01:52:11.041 INFO:tasks.workunit.client.0.smithi031.stdout:4/902: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/f121 x:0 0 0 2024-09-17T01:52:11.042 INFO:tasks.workunit.client.0.smithi031.stdout:1/705: rmdir d4/d3d/d65/db7/de6 0 2024-09-17T01:52:11.044 INFO:tasks.workunit.client.1.smithi092.stdout:4/691: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a [0,4194304] 0 2024-09-17T01:52:11.044 INFO:tasks.workunit.client.0.smithi031.stdout:9/613: mknod d3/d4/da0/d36/d8f/cc7 0 2024-09-17T01:52:11.045 INFO:tasks.workunit.client.0.smithi031.stdout:1/706: write d4/d1a/d2d/d18/f1c [949295,5167] 0 2024-09-17T01:52:11.049 INFO:tasks.workunit.client.0.smithi031.stdout:3/668: dread db/df/dc8/d6a/f76 [0,4194304] 0 2024-09-17T01:52:11.050 INFO:tasks.workunit.client.0.smithi031.stdout:3/669: dread - db/f79 zero size 2024-09-17T01:52:11.054 INFO:tasks.workunit.client.0.smithi031.stdout:1/707: chown d4/d1e/d3f/d72/d7e/d92/f99 3 1 2024-09-17T01:52:11.054 INFO:tasks.workunit.client.0.smithi031.stdout:3/670: readlink db/df/d1d/d37/d6c/lb3 0 2024-09-17T01:52:11.056 INFO:tasks.workunit.client.0.smithi031.stdout:4/903: dwrite d8/d3a/f40 [0,4194304] 0 2024-09-17T01:52:11.062 INFO:tasks.workunit.client.1.smithi092.stdout:2/496: creat d10/d1d/d96/d77/fa9 x:0 0 0 2024-09-17T01:52:11.062 INFO:tasks.workunit.client.1.smithi092.stdout:2/497: readlink d10/d1d/l44 0 2024-09-17T01:52:11.065 INFO:tasks.workunit.client.0.smithi031.stdout:1/708: fsync d4/d1e/d3f/d72/d7e/d92/fa0 0 2024-09-17T01:52:11.065 INFO:tasks.workunit.client.0.smithi031.stdout:5/621: write da/d14/f6a [454869,3928] 0 2024-09-17T01:52:11.067 INFO:tasks.workunit.client.0.smithi031.stdout:3/671: dread db/df/d50/f51 [4194304,4194304] 0 2024-09-17T01:52:11.069 INFO:tasks.workunit.client.0.smithi031.stdout:3/672: dread - db/df/f23 zero size 2024-09-17T01:52:11.073 INFO:tasks.workunit.client.0.smithi031.stdout:5/622: dwrite da/d14/dac/d82/f8b [4194304,4194304] 0 2024-09-17T01:52:11.087 INFO:tasks.workunit.client.1.smithi092.stdout:4/692: rmdir d4/d7b 39 2024-09-17T01:52:11.087 INFO:tasks.workunit.client.0.smithi031.stdout:1/709: creat d4/d1a/fed x:0 0 0 2024-09-17T01:52:11.090 INFO:tasks.workunit.client.1.smithi092.stdout:2/498: fsync d10/d1d/d24/f43 0 2024-09-17T01:52:11.090 INFO:tasks.workunit.client.0.smithi031.stdout:5/623: write da/d4b/f4d [3453811,71918] 0 2024-09-17T01:52:11.092 INFO:tasks.workunit.client.0.smithi031.stdout:9/614: getdents d3/d4/d29 0 2024-09-17T01:52:11.094 INFO:tasks.workunit.client.0.smithi031.stdout:9/615: write d3/d19/d80/faf [1781821,118834] 0 2024-09-17T01:52:11.094 INFO:tasks.workunit.client.0.smithi031.stdout:4/904: unlink d8/d3a/d7e/c120 0 2024-09-17T01:52:11.095 INFO:tasks.workunit.client.1.smithi092.stdout:4/693: write d4/d5/fd6 [2965644,118389] 0 2024-09-17T01:52:11.104 INFO:tasks.workunit.client.0.smithi031.stdout:3/673: creat db/df/d1d/fce x:0 0 0 2024-09-17T01:52:11.105 INFO:tasks.workunit.client.0.smithi031.stdout:4/905: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/f122 x:0 0 0 2024-09-17T01:52:11.108 INFO:tasks.workunit.client.0.smithi031.stdout:9/616: dread d3/d19/d1f/f21 [0,4194304] 0 2024-09-17T01:52:11.111 INFO:tasks.workunit.client.0.smithi031.stdout:9/617: write d3/d19/d1f/d44/d64/f90 [1181395,68635] 0 2024-09-17T01:52:11.111 INFO:tasks.workunit.client.0.smithi031.stdout:4/906: mkdir d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/d106/d123 0 2024-09-17T01:52:11.116 INFO:tasks.workunit.client.0.smithi031.stdout:3/674: link db/f81 db/df/d1d/d37/d77/fcf 0 2024-09-17T01:52:11.118 INFO:tasks.workunit.client.0.smithi031.stdout:3/675: chown db/d9b/fa9 1 1 2024-09-17T01:52:11.119 INFO:tasks.workunit.client.0.smithi031.stdout:4/907: unlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/fb1 0 2024-09-17T01:52:11.119 INFO:tasks.workunit.client.0.smithi031.stdout:9/618: dwrite d3/d19/d1f/f21 [0,4194304] 0 2024-09-17T01:52:11.125 INFO:tasks.workunit.client.0.smithi031.stdout:4/908: readlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/lce 0 2024-09-17T01:52:11.125 INFO:tasks.workunit.client.0.smithi031.stdout:9/619: symlink d3/d19/d80/lc8 0 2024-09-17T01:52:11.125 INFO:tasks.workunit.client.0.smithi031.stdout:4/909: truncate d8/d3a/d10a/d64/f8d 453795 0 2024-09-17T01:52:11.125 INFO:tasks.workunit.client.1.smithi092.stdout:2/499: fsync d10/d55/f5b 0 2024-09-17T01:52:11.126 INFO:tasks.workunit.client.1.smithi092.stdout:6/455: truncate d3/d10/d1f/d21/d28/d2b/d48/f3e 1348848 0 2024-09-17T01:52:11.126 INFO:tasks.workunit.client.0.smithi031.stdout:9/620: write d3/d19/d1f/f58 [3055321,56035] 0 2024-09-17T01:52:11.127 INFO:tasks.workunit.client.0.smithi031.stdout:9/621: chown d3/d19/f22 3419 1 2024-09-17T01:52:11.128 INFO:tasks.workunit.client.1.smithi092.stdout:2/500: truncate d10/d8d/d63/fa1 318047 0 2024-09-17T01:52:11.130 INFO:tasks.workunit.client.0.smithi031.stdout:3/676: link db/df/d1d/d37/d77/dc2/fb7 db/d82/fd0 0 2024-09-17T01:52:11.136 INFO:tasks.workunit.client.1.smithi092.stdout:4/694: creat d4/d5/d8/d99/dd4/fe5 x:0 0 0 2024-09-17T01:52:11.138 INFO:tasks.workunit.client.0.smithi031.stdout:3/677: rename db/c36 to db/df/dc8/cd1 0 2024-09-17T01:52:11.141 INFO:tasks.workunit.client.1.smithi092.stdout:2/501: dread d10/d1d/d2c/d5a/d7a/f7c [0,4194304] 0 2024-09-17T01:52:11.143 INFO:tasks.workunit.client.0.smithi031.stdout:1/710: dwrite d4/d3d/d65/d78/f7d [0,4194304] 0 2024-09-17T01:52:11.145 INFO:tasks.workunit.client.1.smithi092.stdout:6/456: rename d3/d10/d1a to d3/d10/d8c 0 2024-09-17T01:52:11.146 INFO:tasks.workunit.client.1.smithi092.stdout:6/457: dread - d3/d10/d8c/d43/d5e/d73/f7a zero size 2024-09-17T01:52:11.147 INFO:tasks.workunit.client.1.smithi092.stdout:2/502: mkdir d10/d4c/d80/d95/daa 0 2024-09-17T01:52:11.147 INFO:tasks.workunit.client.0.smithi031.stdout:5/624: dwrite da/d42/d12/f23 [0,4194304] 0 2024-09-17T01:52:11.147 INFO:tasks.workunit.client.1.smithi092.stdout:2/503: fdatasync d10/d8d/f31 0 2024-09-17T01:52:11.149 INFO:tasks.workunit.client.0.smithi031.stdout:4/910: write d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/fa1 [601779,42073] 0 2024-09-17T01:52:11.149 INFO:tasks.workunit.client.0.smithi031.stdout:3/678: read db/f81 [3022396,37738] 0 2024-09-17T01:52:11.151 INFO:tasks.workunit.client.0.smithi031.stdout:1/711: write d4/d1e/d3f/d4d/da5/dbc/fdd [1020652,114878] 0 2024-09-17T01:52:11.153 INFO:tasks.workunit.client.1.smithi092.stdout:6/458: mknod d3/d10/d1f/d21/d28/d2b/d48/c8d 0 2024-09-17T01:52:11.153 INFO:tasks.workunit.client.0.smithi031.stdout:9/622: dread d3/d4/da0/f60 [0,4194304] 0 2024-09-17T01:52:11.153 INFO:tasks.workunit.client.0.smithi031.stdout:5/625: dread - da/d42/d12/d4a/f71 zero size 2024-09-17T01:52:11.156 INFO:tasks.workunit.client.0.smithi031.stdout:4/911: readlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/l76 0 2024-09-17T01:52:11.158 INFO:tasks.workunit.client.0.smithi031.stdout:9/623: creat d3/d4/d29/fc9 x:0 0 0 2024-09-17T01:52:11.158 INFO:tasks.workunit.client.1.smithi092.stdout:2/504: rename d10/d1d/d2c/c86 to d10/d1d/d2c/d56/d66/cab 0 2024-09-17T01:52:11.160 INFO:tasks.workunit.client.0.smithi031.stdout:5/626: unlink da/d42/l31 0 2024-09-17T01:52:11.162 INFO:tasks.workunit.client.0.smithi031.stdout:4/912: creat d8/d3a/d10a/d64/d4d/d5a/df1/f124 x:0 0 0 2024-09-17T01:52:11.162 INFO:tasks.workunit.client.1.smithi092.stdout:2/505: mknod d10/d1d/d2c/d56/cac 0 2024-09-17T01:52:11.164 INFO:tasks.workunit.client.0.smithi031.stdout:3/679: dwrite db/df/dc8/d6a/fc5 [0,4194304] 0 2024-09-17T01:52:11.166 INFO:tasks.workunit.client.1.smithi092.stdout:2/506: rmdir d10/d5c/d81 39 2024-09-17T01:52:11.166 INFO:tasks.workunit.client.0.smithi031.stdout:4/913: fsync d8/d3a/d10a/d64/d4d/d5a/d8c/fd9 0 2024-09-17T01:52:11.166 INFO:tasks.workunit.client.0.smithi031.stdout:5/627: mkdir da/d14/dac/d82/dc3/ddb 0 2024-09-17T01:52:11.169 INFO:tasks.workunit.client.1.smithi092.stdout:2/507: mknod d10/d54/cad 0 2024-09-17T01:52:11.169 INFO:tasks.workunit.client.0.smithi031.stdout:5/628: write da/d14/dac/f68 [647325,3277] 0 2024-09-17T01:52:11.169 INFO:tasks.workunit.client.1.smithi092.stdout:2/508: chown d10/d8d/f31 299987254 1 2024-09-17T01:52:11.170 INFO:tasks.workunit.client.1.smithi092.stdout:6/459: getdents d3/d10/d8c/d43/d6a 0 2024-09-17T01:52:11.171 INFO:tasks.workunit.client.1.smithi092.stdout:2/509: chown f5 105275 1 2024-09-17T01:52:11.172 INFO:tasks.workunit.client.1.smithi092.stdout:4/695: dread d4/d5/f15 [0,4194304] 0 2024-09-17T01:52:11.174 INFO:tasks.workunit.client.1.smithi092.stdout:6/460: mkdir d3/d8e 0 2024-09-17T01:52:11.175 INFO:tasks.workunit.client.0.smithi031.stdout:9/624: link d3/d4/da0/d36/lc4 d3/d4/da0/d36/d62/db2/lca 0 2024-09-17T01:52:11.176 INFO:tasks.workunit.client.0.smithi031.stdout:4/914: fdatasync d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/fb4 0 2024-09-17T01:52:11.177 INFO:tasks.workunit.client.1.smithi092.stdout:2/510: mkdir d10/d1d/d96/d77/d9c/dae 0 2024-09-17T01:52:11.178 INFO:tasks.workunit.client.0.smithi031.stdout:1/712: dread d4/d1e/d3f/d72/d7e/da2/fa4 [4194304,4194304] 0 2024-09-17T01:52:11.179 INFO:tasks.workunit.client.0.smithi031.stdout:5/629: chown da/d42/d12/d64/l67 226 1 2024-09-17T01:52:11.179 INFO:tasks.workunit.client.1.smithi092.stdout:4/696: dread d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a [0,4194304] 0 2024-09-17T01:52:11.181 INFO:tasks.workunit.client.1.smithi092.stdout:6/461: read d3/d10/d8c/d43/d6a/d3d/f88 [2271627,64350] 0 2024-09-17T01:52:11.182 INFO:tasks.workunit.client.1.smithi092.stdout:6/462: fdatasync d3/d10/d1f/f59 0 2024-09-17T01:52:11.182 INFO:tasks.workunit.client.1.smithi092.stdout:2/511: creat d10/d1d/d24/d6e/faf x:0 0 0 2024-09-17T01:52:11.184 INFO:tasks.workunit.client.1.smithi092.stdout:2/512: chown d10/d1d/d24/f4f 21190 1 2024-09-17T01:52:11.184 INFO:tasks.workunit.client.0.smithi031.stdout:5/630: rename da/d4b/ccd to da/d42/d12/d4a/cdc 0 2024-09-17T01:52:11.185 INFO:tasks.workunit.client.0.smithi031.stdout:9/625: rmdir d3/d4/da0/d36/d8f/dc5 0 2024-09-17T01:52:11.186 INFO:tasks.workunit.client.1.smithi092.stdout:6/463: mkdir d3/d10/d8c/d43/d5e/d73/d8f 0 2024-09-17T01:52:11.187 INFO:tasks.workunit.client.0.smithi031.stdout:4/915: creat d8/d3a/d10a/f125 x:0 0 0 2024-09-17T01:52:11.187 INFO:tasks.workunit.client.1.smithi092.stdout:2/513: fsync d10/d1d/d96/d77/f2b 0 2024-09-17T01:52:11.189 INFO:tasks.workunit.client.0.smithi031.stdout:6/765: sync 2024-09-17T01:52:11.190 INFO:tasks.workunit.client.1.smithi092.stdout:2/514: unlink d10/d1d/d96/d77/d9c/c73 0 2024-09-17T01:52:11.191 INFO:tasks.workunit.client.0.smithi031.stdout:6/766: fdatasync f1d 0 2024-09-17T01:52:11.191 INFO:tasks.workunit.client.1.smithi092.stdout:2/515: write d10/f5d [1929395,95155] 0 2024-09-17T01:52:11.195 INFO:tasks.workunit.client.1.smithi092.stdout:2/516: mknod d10/d1d/d24/cb0 0 2024-09-17T01:52:11.195 INFO:tasks.workunit.client.0.smithi031.stdout:4/916: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/f126 x:0 0 0 2024-09-17T01:52:11.196 INFO:tasks.workunit.client.1.smithi092.stdout:2/517: symlink d10/d1d/d2c/lb1 0 2024-09-17T01:52:11.197 INFO:tasks.workunit.client.0.smithi031.stdout:1/713: write d4/d1e/d3f/d4d/f6f [4692285,75915] 0 2024-09-17T01:52:11.198 INFO:tasks.workunit.client.1.smithi092.stdout:2/518: dread - d10/d5c/d81/f99 zero size 2024-09-17T01:52:11.199 INFO:tasks.workunit.client.1.smithi092.stdout:2/519: fdatasync d10/d1d/f26 0 2024-09-17T01:52:11.199 INFO:tasks.workunit.client.1.smithi092.stdout:2/520: chown d10/d55 11117 1 2024-09-17T01:52:11.200 INFO:tasks.workunit.client.1.smithi092.stdout:2/521: read - d10/d4c/f94 zero size 2024-09-17T01:52:11.201 INFO:tasks.workunit.client.1.smithi092.stdout:2/522: read d10/d1d/d2c/d5a/d7a/f7c [385044,55084] 0 2024-09-17T01:52:11.201 INFO:tasks.workunit.client.0.smithi031.stdout:9/626: truncate d3/d4/fb8 827285 0 2024-09-17T01:52:11.201 INFO:tasks.workunit.client.0.smithi031.stdout:5/631: write da/f49 [2524370,98944] 0 2024-09-17T01:52:11.202 INFO:tasks.workunit.client.1.smithi092.stdout:2/523: write d10/d4c/d80/d95/fa0 [476093,111094] 0 2024-09-17T01:52:11.203 INFO:tasks.workunit.client.0.smithi031.stdout:3/680: dwrite db/df/d1d/d37/d6c/d6e/fbc [0,4194304] 0 2024-09-17T01:52:11.203 INFO:tasks.workunit.client.1.smithi092.stdout:2/524: write d10/d8d/f31 [1051860,20133] 0 2024-09-17T01:52:11.209 INFO:tasks.workunit.client.0.smithi031.stdout:4/917: dread d8/d3a/d10a/d64/d4d/f71 [0,4194304] 0 2024-09-17T01:52:11.213 INFO:tasks.workunit.client.1.smithi092.stdout:6/464: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:52:11.214 INFO:tasks.workunit.client.0.smithi031.stdout:3/681: rename db/df/dc8/d99/lc0 to db/df/d1d/d37/d65/ld2 0 2024-09-17T01:52:11.215 INFO:tasks.workunit.client.0.smithi031.stdout:9/627: symlink d3/d4/da0/d36/d99/db3/lcb 0 2024-09-17T01:52:11.217 INFO:tasks.workunit.client.0.smithi031.stdout:9/628: dread - d3/d4/fc2 zero size 2024-09-17T01:52:11.218 INFO:tasks.workunit.client.0.smithi031.stdout:6/767: dread d23/db4/d6a/d70/f7f [0,4194304] 0 2024-09-17T01:52:11.219 INFO:tasks.workunit.client.0.smithi031.stdout:1/714: rename d4/d3d/d65/d78/dd6 to d4/d1a/d43/d53/dd3/dee 0 2024-09-17T01:52:11.220 INFO:tasks.workunit.client.0.smithi031.stdout:6/768: fsync d23/f31 0 2024-09-17T01:52:11.221 INFO:tasks.workunit.client.1.smithi092.stdout:6/465: dwrite d3/d10/f6f [0,4194304] 0 2024-09-17T01:52:11.225 INFO:tasks.workunit.client.0.smithi031.stdout:1/715: fdatasync d4/d1a/d43/d53/f73 0 2024-09-17T01:52:11.227 INFO:tasks.workunit.client.0.smithi031.stdout:4/918: getdents d8/d3a/d10a/d64 0 2024-09-17T01:52:11.228 INFO:tasks.workunit.client.0.smithi031.stdout:6/769: fsync d23/db4/d6a/d70/d74/f99 0 2024-09-17T01:52:11.229 INFO:tasks.workunit.client.0.smithi031.stdout:3/682: creat db/df/d1d/fd3 x:0 0 0 2024-09-17T01:52:11.231 INFO:tasks.workunit.client.0.smithi031.stdout:6/770: readlink d23/d63/la2 0 2024-09-17T01:52:11.234 INFO:tasks.workunit.client.0.smithi031.stdout:6/771: write d23/db4/d6a/d70/db0/fd6 [657349,20607] 0 2024-09-17T01:52:11.237 INFO:tasks.workunit.client.0.smithi031.stdout:4/919: symlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/d106/d123/l127 0 2024-09-17T01:52:11.239 INFO:tasks.workunit.client.0.smithi031.stdout:6/772: rmdir d23/db4/d6a/d70/db0 39 2024-09-17T01:52:11.240 INFO:tasks.workunit.client.0.smithi031.stdout:3/683: dread db/df/dc8/d6a/f76 [0,4194304] 0 2024-09-17T01:52:11.241 INFO:tasks.workunit.client.0.smithi031.stdout:4/920: mknod d8/d3a/d10a/d64/c128 0 2024-09-17T01:52:11.243 INFO:tasks.workunit.client.0.smithi031.stdout:6/773: fdatasync d23/db4/d6a/d91/fa7 0 2024-09-17T01:52:11.245 INFO:tasks.workunit.client.0.smithi031.stdout:6/774: rmdir d23/db4/d6a/dfa 39 2024-09-17T01:52:11.246 INFO:tasks.workunit.client.0.smithi031.stdout:1/716: write d4/d1e/f88 [605740,2237] 0 2024-09-17T01:52:11.249 INFO:tasks.workunit.client.0.smithi031.stdout:3/684: rename db/df/dc8/d99 to db/df/d1d/d37/d6c/d6e/dd4 0 2024-09-17T01:52:11.251 INFO:tasks.workunit.client.1.smithi092.stdout:6/466: dread d3/d10/d8c/d43/d6a/d3d/f88 [0,4194304] 0 2024-09-17T01:52:11.251 INFO:tasks.workunit.client.0.smithi031.stdout:9/629: dread d3/d19/f34 [0,4194304] 0 2024-09-17T01:52:11.252 INFO:tasks.workunit.client.1.smithi092.stdout:6/467: chown d3/d10/d1f/d21/d28/f2c 111986502 1 2024-09-17T01:52:11.252 INFO:tasks.workunit.client.1.smithi092.stdout:6/468: stat d3/d10/d1f/d21/d28/f82 0 2024-09-17T01:52:11.253 INFO:tasks.workunit.client.0.smithi031.stdout:1/717: unlink d4/d1e/d40/fe9 0 2024-09-17T01:52:11.255 INFO:tasks.workunit.client.0.smithi031.stdout:1/718: chown d4/d1a/d43/fad 1 1 2024-09-17T01:52:11.257 INFO:tasks.workunit.client.0.smithi031.stdout:3/685: dwrite db/f1f [4194304,4194304] 0 2024-09-17T01:52:11.258 INFO:tasks.workunit.client.0.smithi031.stdout:9/630: creat d3/d47/d96/fcc x:0 0 0 2024-09-17T01:52:11.258 INFO:tasks.workunit.client.0.smithi031.stdout:6/775: write d23/d63/f49 [323215,125811] 0 2024-09-17T01:52:11.259 INFO:tasks.workunit.client.0.smithi031.stdout:9/631: rename d3/d19 to d3/d19/db5/dcd 22 2024-09-17T01:52:11.260 INFO:tasks.workunit.client.0.smithi031.stdout:1/719: creat d4/d3d/de4/fef x:0 0 0 2024-09-17T01:52:11.261 INFO:tasks.workunit.client.0.smithi031.stdout:6/776: write d23/db4/d6a/d70/d74/fb1 [1296315,105698] 0 2024-09-17T01:52:11.265 INFO:tasks.workunit.client.0.smithi031.stdout:3/686: creat db/df/d1d/d37/d77/fd5 x:0 0 0 2024-09-17T01:52:11.265 INFO:tasks.workunit.client.0.smithi031.stdout:1/720: write d4/d1e/d3f/d72/fc7 [2234813,42408] 0 2024-09-17T01:52:11.265 INFO:tasks.workunit.client.0.smithi031.stdout:9/632: mknod d3/d4/da0/d36/d99/cce 0 2024-09-17T01:52:11.266 INFO:tasks.workunit.client.0.smithi031.stdout:4/921: dread - d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f73 zero size 2024-09-17T01:52:11.266 INFO:tasks.workunit.client.0.smithi031.stdout:6/777: stat d23/db4/d8a/dd5 0 2024-09-17T01:52:11.267 INFO:tasks.workunit.client.0.smithi031.stdout:4/922: stat d8/cc2 0 2024-09-17T01:52:11.268 INFO:tasks.workunit.client.0.smithi031.stdout:9/633: read - d3/d19/d80/f8a zero size 2024-09-17T01:52:11.268 INFO:tasks.workunit.client.0.smithi031.stdout:1/721: readlink d4/d3d/d65/lc5 0 2024-09-17T01:52:11.270 INFO:tasks.workunit.client.0.smithi031.stdout:9/634: stat d3/d4c/f4f 0 2024-09-17T01:52:11.274 INFO:tasks.workunit.client.0.smithi031.stdout:4/923: stat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fd4 0 2024-09-17T01:52:11.274 INFO:tasks.workunit.client.0.smithi031.stdout:9/635: chown d3/d4/da0/d71/f9e 3 1 2024-09-17T01:52:11.275 INFO:tasks.workunit.client.0.smithi031.stdout:1/722: creat d4/d1a/d2d/d18/ff0 x:0 0 0 2024-09-17T01:52:11.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/778: dwrite d23/db4/d64/faf [0,4194304] 0 2024-09-17T01:52:11.279 INFO:tasks.workunit.client.0.smithi031.stdout:9/636: read d3/fa3 [131257,9940] 0 2024-09-17T01:52:11.282 INFO:tasks.workunit.client.0.smithi031.stdout:3/687: dwrite db/df/d1d/d37/d77/fd5 [0,4194304] 0 2024-09-17T01:52:11.284 INFO:tasks.workunit.client.0.smithi031.stdout:4/924: dread d8/f11 [0,4194304] 0 2024-09-17T01:52:11.284 INFO:tasks.workunit.client.0.smithi031.stdout:1/723: symlink d4/d1a/d43/lf1 0 2024-09-17T01:52:11.286 INFO:tasks.workunit.client.0.smithi031.stdout:9/637: creat d3/d4/da0/d36/d62/fcf x:0 0 0 2024-09-17T01:52:11.287 INFO:tasks.workunit.client.0.smithi031.stdout:6/779: write d23/db4/d6a/d70/f88 [315062,62506] 0 2024-09-17T01:52:11.287 INFO:tasks.workunit.client.0.smithi031.stdout:3/688: mknod db/df/d1d/d37/d65/cd6 0 2024-09-17T01:52:11.290 INFO:tasks.workunit.client.0.smithi031.stdout:1/724: mknod d4/d1a/d43/d53/dd3/dee/cf2 0 2024-09-17T01:52:11.291 INFO:tasks.workunit.client.0.smithi031.stdout:6/780: creat d23/dd1/f109 x:0 0 0 2024-09-17T01:52:11.293 INFO:tasks.workunit.client.0.smithi031.stdout:4/925: mknod d8/d3a/c129 0 2024-09-17T01:52:11.295 INFO:tasks.workunit.client.0.smithi031.stdout:3/689: unlink db/d29/faf 0 2024-09-17T01:52:11.298 INFO:tasks.workunit.client.0.smithi031.stdout:3/690: write db/f7d [3191175,8493] 0 2024-09-17T01:52:11.301 INFO:tasks.workunit.client.0.smithi031.stdout:1/725: dwrite d4/d3d/d65/d78/f80 [0,4194304] 0 2024-09-17T01:52:11.301 INFO:tasks.workunit.client.0.smithi031.stdout:4/926: mkdir d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/db0/d12a 0 2024-09-17T01:52:11.303 INFO:tasks.workunit.client.0.smithi031.stdout:9/638: write d3/f42 [4909124,1718] 0 2024-09-17T01:52:11.307 INFO:tasks.workunit.client.0.smithi031.stdout:3/691: chown db/df/d1d/d37/d6c/d6e/dd4/laa 1179 1 2024-09-17T01:52:11.307 INFO:tasks.workunit.client.0.smithi031.stdout:1/726: write d4/d1a/d2d/d18/f1c [893160,117301] 0 2024-09-17T01:52:11.309 INFO:tasks.workunit.client.0.smithi031.stdout:1/727: fsync d4/d3d/d65/db7/fc2 0 2024-09-17T01:52:11.310 INFO:tasks.workunit.client.0.smithi031.stdout:6/781: dwrite d23/db4/d8a/fcc [0,4194304] 0 2024-09-17T01:52:11.311 INFO:tasks.workunit.client.0.smithi031.stdout:4/927: creat d8/d3a/d10a/d64/d92/f12b x:0 0 0 2024-09-17T01:52:11.313 INFO:tasks.workunit.client.0.smithi031.stdout:9/639: mkdir d3/d4/da0/d36/d79/dd0 0 2024-09-17T01:52:11.316 INFO:tasks.workunit.client.0.smithi031.stdout:9/640: write d3/d19/d1f/f58 [4915550,113799] 0 2024-09-17T01:52:11.316 INFO:tasks.workunit.client.0.smithi031.stdout:3/692: mkdir db/df/d1d/d37/d6c/d6e/dd4/dd7 0 2024-09-17T01:52:11.316 INFO:tasks.workunit.client.0.smithi031.stdout:6/782: readlink d23/l3a 0 2024-09-17T01:52:11.317 INFO:tasks.workunit.client.0.smithi031.stdout:9/641: fsync d3/d19/d1f/fa7 0 2024-09-17T01:52:11.318 INFO:tasks.workunit.client.0.smithi031.stdout:3/693: dread - db/df/d50/f63 zero size 2024-09-17T01:52:11.319 INFO:tasks.workunit.client.0.smithi031.stdout:6/783: chown d23/db4/d6a/dfa 4 1 2024-09-17T01:52:11.319 INFO:tasks.workunit.client.0.smithi031.stdout:9/642: chown d3/d19/d80/faf 56782163 1 2024-09-17T01:52:11.320 INFO:tasks.workunit.client.0.smithi031.stdout:3/694: dread - db/df/d1d/d37/d65/fca zero size 2024-09-17T01:52:11.328 INFO:tasks.workunit.client.0.smithi031.stdout:9/643: link d3/d4/d29/cb6 d3/d4/d29/cd1 0 2024-09-17T01:52:11.333 INFO:tasks.workunit.client.0.smithi031.stdout:9/644: dwrite d3/d4/da0/f60 [0,4194304] 0 2024-09-17T01:52:11.339 INFO:tasks.workunit.client.0.smithi031.stdout:9/645: rename d3/d4/d41/d70/l93 to d3/d4/da0/d36/d99/db3/ld2 0 2024-09-17T01:52:11.341 INFO:tasks.workunit.client.0.smithi031.stdout:9/646: symlink d3/d4/da0/d36/d79/dd0/ld3 0 2024-09-17T01:52:11.341 INFO:tasks.workunit.client.0.smithi031.stdout:7/664: sync 2024-09-17T01:52:11.341 INFO:tasks.workunit.client.0.smithi031.stdout:0/741: sync 2024-09-17T01:52:11.341 INFO:tasks.workunit.client.0.smithi031.stdout:8/619: sync 2024-09-17T01:52:11.341 INFO:tasks.workunit.client.0.smithi031.stdout:2/732: sync 2024-09-17T01:52:11.343 INFO:tasks.workunit.client.1.smithi092.stdout:9/522: sync 2024-09-17T01:52:11.343 INFO:tasks.workunit.client.0.smithi031.stdout:8/620: write d0/d5/d9b/f4b [1211232,69239] 0 2024-09-17T01:52:11.344 INFO:tasks.workunit.client.0.smithi031.stdout:8/621: chown d0/df/db6 28776856 1 2024-09-17T01:52:11.345 INFO:tasks.workunit.client.1.smithi092.stdout:9/523: write d0/d7/d12/d86/d93/d96/f41 [536647,53792] 0 2024-09-17T01:52:11.345 INFO:tasks.workunit.client.0.smithi031.stdout:2/733: dread - d1/d3/df/d18/d9f/fc2 zero size 2024-09-17T01:52:11.346 INFO:tasks.workunit.client.0.smithi031.stdout:7/665: write db/d18/fb7 [2208363,24091] 0 2024-09-17T01:52:11.348 INFO:tasks.workunit.client.0.smithi031.stdout:7/666: write db/d1c/d41/d9a/fab [940199,8326] 0 2024-09-17T01:52:11.348 INFO:tasks.workunit.client.0.smithi031.stdout:2/734: chown d1/d3/df/d11/d30/dd0/cd8 0 1 2024-09-17T01:52:11.349 INFO:tasks.workunit.client.1.smithi092.stdout:9/524: fdatasync d0/d7/d12/d34/d26/d54/d6b/f92 0 2024-09-17T01:52:11.350 INFO:tasks.workunit.client.1.smithi092.stdout:9/525: write d0/d5/f8 [1187517,80859] 0 2024-09-17T01:52:11.351 INFO:tasks.workunit.client.1.smithi092.stdout:9/526: stat d0/f6 0 2024-09-17T01:52:11.353 INFO:tasks.workunit.client.0.smithi031.stdout:7/667: link db/d1c/f1d db/d1c/d46/d95/da6/fcc 0 2024-09-17T01:52:11.356 INFO:tasks.workunit.client.0.smithi031.stdout:2/735: rename d1/d3/d2d/db2/f1f to d1/d3/df/d18/d40/dc1/ffd 0 2024-09-17T01:52:11.359 INFO:tasks.workunit.client.0.smithi031.stdout:7/668: creat db/d1c/d41/d9a/fcd x:0 0 0 2024-09-17T01:52:11.360 INFO:tasks.workunit.client.0.smithi031.stdout:2/736: dread - d1/d3/d2d/d91/dad/fe1 zero size 2024-09-17T01:52:11.361 INFO:tasks.workunit.client.0.smithi031.stdout:7/669: creat db/d1c/d46/db9/dbf/fce x:0 0 0 2024-09-17T01:52:11.363 INFO:tasks.workunit.client.0.smithi031.stdout:2/737: truncate d1/d3/d2d/ff0 303717 0 2024-09-17T01:52:11.365 INFO:tasks.workunit.client.0.smithi031.stdout:7/670: creat db/fcf x:0 0 0 2024-09-17T01:52:11.366 INFO:tasks.workunit.client.0.smithi031.stdout:0/742: dread d0/d29/d33/d5/d48/f5a [0,4194304] 0 2024-09-17T01:52:11.374 INFO:tasks.workunit.client.0.smithi031.stdout:6/784: write d23/f5b [1514659,27653] 0 2024-09-17T01:52:11.375 INFO:tasks.workunit.client.0.smithi031.stdout:2/738: dwrite d1/d3/d2d/db2/d1e/d21/f90 [0,4194304] 0 2024-09-17T01:52:11.375 INFO:tasks.workunit.client.0.smithi031.stdout:1/728: dread d4/d1e/d8d/fb5 [0,4194304] 0 2024-09-17T01:52:11.376 INFO:tasks.workunit.client.1.smithi092.stdout:9/527: truncate d0/d5/d29/f55 4808496 0 2024-09-17T01:52:11.376 INFO:tasks.workunit.client.0.smithi031.stdout:7/671: rename db/d1c/d41/c6e to db/d18/d67/dac/cd0 0 2024-09-17T01:52:11.378 INFO:tasks.workunit.client.1.smithi092.stdout:9/528: read d0/d7/d12/d34/d26/f6f [327098,54382] 0 2024-09-17T01:52:11.378 INFO:tasks.workunit.client.0.smithi031.stdout:1/729: chown d4/d3d/d65/fa1 934 1 2024-09-17T01:52:11.380 INFO:tasks.workunit.client.1.smithi092.stdout:9/529: readlink d0/d5/d29/l39 0 2024-09-17T01:52:11.380 INFO:tasks.workunit.client.0.smithi031.stdout:0/743: getdents d0/d29/d33/d2a/d25/da5 0 2024-09-17T01:52:11.380 INFO:tasks.workunit.client.1.smithi092.stdout:9/530: chown d0/d7/d12/c43 432961330 1 2024-09-17T01:52:11.381 INFO:tasks.workunit.client.1.smithi092.stdout:9/531: write d0/f5c [361610,80845] 0 2024-09-17T01:52:11.382 INFO:tasks.workunit.client.0.smithi031.stdout:3/695: dread db/f11 [0,4194304] 0 2024-09-17T01:52:11.383 INFO:tasks.workunit.client.1.smithi092.stdout:9/532: write d0/d7/d12/d34/d26/d54/d6b/f78 [1509346,115151] 0 2024-09-17T01:52:11.384 INFO:tasks.workunit.client.0.smithi031.stdout:7/672: write db/f3a [4406710,124645] 0 2024-09-17T01:52:11.385 INFO:tasks.workunit.client.0.smithi031.stdout:3/696: stat db/df/d1d/d37/d77/fd5 0 2024-09-17T01:52:11.387 INFO:tasks.workunit.client.1.smithi092.stdout:9/533: unlink d0/d7/d12/d86/d93/d96/c3d 0 2024-09-17T01:52:11.387 INFO:tasks.workunit.client.0.smithi031.stdout:1/730: rename d4/d3d/d65/fd4 to d4/d3d/d65/d78/ff3 0 2024-09-17T01:52:11.390 INFO:tasks.workunit.client.0.smithi031.stdout:8/622: write d0/df/dd/d59/f6f [358053,114495] 0 2024-09-17T01:52:11.390 INFO:tasks.workunit.client.0.smithi031.stdout:2/739: write d1/f5 [721626,80227] 0 2024-09-17T01:52:11.392 INFO:tasks.workunit.client.1.smithi092.stdout:9/534: creat d0/d7/d12/d34/d26/d54/f9f x:0 0 0 2024-09-17T01:52:11.392 INFO:tasks.workunit.client.1.smithi092.stdout:9/535: fsync d0/f5c 0 2024-09-17T01:52:11.394 INFO:tasks.workunit.client.0.smithi031.stdout:9/647: dwrite d3/fb [0,4194304] 0 2024-09-17T01:52:11.396 INFO:tasks.workunit.client.0.smithi031.stdout:0/744: mkdir d0/d29/d33/d2a/d25/d102 0 2024-09-17T01:52:11.399 INFO:tasks.workunit.client.1.smithi092.stdout:9/536: dwrite d0/df/f27 [4194304,4194304] 0 2024-09-17T01:52:11.400 INFO:tasks.workunit.client.1.smithi092.stdout:9/537: readlink d0/d7/d12/d34/d26/d54/l64 0 2024-09-17T01:52:11.400 INFO:tasks.workunit.client.0.smithi031.stdout:7/673: symlink db/d1c/d8e/ld1 0 2024-09-17T01:52:11.401 INFO:tasks.workunit.client.1.smithi092.stdout:9/538: truncate d0/df/d17/f68 119832 0 2024-09-17T01:52:11.402 INFO:tasks.workunit.client.0.smithi031.stdout:1/731: mknod d4/d1a/d43/d53/cf4 0 2024-09-17T01:52:11.405 INFO:tasks.workunit.client.0.smithi031.stdout:2/740: creat d1/d3/d45/d4a/d96/ffe x:0 0 0 2024-09-17T01:52:11.406 INFO:tasks.workunit.client.0.smithi031.stdout:1/732: read d4/d1e/d3f/d72/d7e/da2/fbd [1928618,37141] 0 2024-09-17T01:52:11.411 INFO:tasks.workunit.client.0.smithi031.stdout:7/674: creat db/d1c/d46/db9/dc1/fd2 x:0 0 0 2024-09-17T01:52:11.412 INFO:tasks.workunit.client.0.smithi031.stdout:9/648: mkdir d3/d4/da0/d36/d62/db2/dd4 0 2024-09-17T01:52:11.414 INFO:tasks.workunit.client.0.smithi031.stdout:6/785: dwrite d23/fbd [0,4194304] 0 2024-09-17T01:52:11.415 INFO:tasks.workunit.client.1.smithi092.stdout:9/539: write d0/df/d17/f51 [4761822,50665] 0 2024-09-17T01:52:11.418 INFO:tasks.workunit.client.1.smithi092.stdout:9/540: getdents d0/d7/d12/d34/d26/d54 0 2024-09-17T01:52:11.419 INFO:tasks.workunit.client.1.smithi092.stdout:9/541: chown d0/d7/d12/d34/d26/d54/f4e 7905 1 2024-09-17T01:52:11.420 INFO:tasks.workunit.client.0.smithi031.stdout:0/745: link d0/d29/da7/db3/d4a/d86/dd7/ffb d0/d29/d33/f103 0 2024-09-17T01:52:11.420 INFO:tasks.workunit.client.1.smithi092.stdout:9/542: chown d0/df/f84 3198491 1 2024-09-17T01:52:11.421 INFO:tasks.workunit.client.0.smithi031.stdout:3/697: dread db/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:11.422 INFO:tasks.workunit.client.1.smithi092.stdout:9/543: fdatasync d0/df/d17/f51 0 2024-09-17T01:52:11.424 INFO:tasks.workunit.client.0.smithi031.stdout:8/623: write d0/d5/f5e [5225506,114142] 0 2024-09-17T01:52:11.424 INFO:tasks.workunit.client.0.smithi031.stdout:9/649: rmdir d3/d4/da0/d36/d62/db2 39 2024-09-17T01:52:11.424 INFO:tasks.workunit.client.1.smithi092.stdout:9/544: creat d0/d7/d12/d34/d26/d54/fa0 x:0 0 0 2024-09-17T01:52:11.427 INFO:tasks.workunit.client.1.smithi092.stdout:9/545: write d0/d7/d12/d34/d26/f6f [4808016,106965] 0 2024-09-17T01:52:11.427 INFO:tasks.workunit.client.0.smithi031.stdout:0/746: chown d0/d29/d33/d5/c12 0 1 2024-09-17T01:52:11.427 INFO:tasks.workunit.client.1.smithi092.stdout:9/546: readlink d0/d7/l62 0 2024-09-17T01:52:11.429 INFO:tasks.workunit.client.0.smithi031.stdout:7/675: creat db/d1c/d46/d95/da6/fd3 x:0 0 0 2024-09-17T01:52:11.431 INFO:tasks.workunit.client.0.smithi031.stdout:3/698: mknod db/d9b/cd8 0 2024-09-17T01:52:11.431 INFO:tasks.workunit.client.0.smithi031.stdout:2/741: dwrite d1/d3/d2d/db2/d1e/d21/fcf [0,4194304] 0 2024-09-17T01:52:11.432 INFO:tasks.workunit.client.0.smithi031.stdout:9/650: readlink d3/d4/da0/d36/d8f/la9 0 2024-09-17T01:52:11.434 INFO:tasks.workunit.client.0.smithi031.stdout:3/699: truncate db/df/d1d/fd3 323870 0 2024-09-17T01:52:11.434 INFO:tasks.workunit.client.0.smithi031.stdout:1/733: dwrite d4/d1e/d3f/d72/d7e/da2/fbb [0,4194304] 0 2024-09-17T01:52:11.437 INFO:tasks.workunit.client.1.smithi092.stdout:9/547: creat d0/d7/d12/d34/d26/d54/d6b/fa1 x:0 0 0 2024-09-17T01:52:11.439 INFO:tasks.workunit.client.0.smithi031.stdout:8/624: rmdir d0/df/dd/d77 39 2024-09-17T01:52:11.440 INFO:tasks.workunit.client.0.smithi031.stdout:7/676: readlink db/l12 0 2024-09-17T01:52:11.441 INFO:tasks.workunit.client.0.smithi031.stdout:1/734: dread d4/d1e/d40/d84/fdc [0,4194304] 0 2024-09-17T01:52:11.442 INFO:tasks.workunit.client.0.smithi031.stdout:0/747: mkdir d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/d104 0 2024-09-17T01:52:11.444 INFO:tasks.workunit.client.1.smithi092.stdout:9/548: dwrite d0/d7/d12/d34/d26/d54/d6b/f78 [0,4194304] 0 2024-09-17T01:52:11.445 INFO:tasks.workunit.client.0.smithi031.stdout:2/742: mknod d1/d3/df/d18/d9f/cff 0 2024-09-17T01:52:11.447 INFO:tasks.workunit.client.1.smithi092.stdout:9/549: write d0/d7/d12/d34/d26/d54/f83 [1070830,46467] 0 2024-09-17T01:52:11.449 INFO:tasks.workunit.client.1.smithi092.stdout:9/550: write d0/d5/d29/f52 [1141708,9733] 0 2024-09-17T01:52:11.451 INFO:tasks.workunit.client.0.smithi031.stdout:2/743: write d1/d3/d2d/db2/f28 [2587554,120777] 0 2024-09-17T01:52:11.452 INFO:tasks.workunit.client.0.smithi031.stdout:8/625: creat d0/d5/d6c/db0/fb9 x:0 0 0 2024-09-17T01:52:11.452 INFO:tasks.workunit.client.1.smithi092.stdout:9/551: creat d0/df/fa2 x:0 0 0 2024-09-17T01:52:11.453 INFO:tasks.workunit.client.1.smithi092.stdout:9/552: dread - d0/df/fa2 zero size 2024-09-17T01:52:11.456 INFO:tasks.workunit.client.0.smithi031.stdout:3/700: rename db/f6b to db/df/d1d/d37/d65/fd9 0 2024-09-17T01:52:11.456 INFO:tasks.workunit.client.1.smithi092.stdout:9/553: rename d0/df/d5d/c5e to d0/df/d17/d9d/ca3 0 2024-09-17T01:52:11.457 INFO:tasks.workunit.client.0.smithi031.stdout:2/744: fdatasync d1/d3/d45/d4a/f6d 0 2024-09-17T01:52:11.457 INFO:tasks.workunit.client.0.smithi031.stdout:6/786: dwrite d23/db4/d6a/d72/f96 [0,4194304] 0 2024-09-17T01:52:11.459 INFO:tasks.workunit.client.0.smithi031.stdout:7/677: dwrite db/d1c/fad [0,4194304] 0 2024-09-17T01:52:11.459 INFO:tasks.workunit.client.1.smithi092.stdout:9/554: rename d0/df/d17/f68 to d0/df/d17/d9d/fa4 0 2024-09-17T01:52:11.460 INFO:tasks.workunit.client.0.smithi031.stdout:9/651: write d3/f11 [2003413,49546] 0 2024-09-17T01:52:11.460 INFO:tasks.workunit.client.0.smithi031.stdout:8/626: rmdir d0/d5/d54 39 2024-09-17T01:52:11.463 INFO:tasks.workunit.client.1.smithi092.stdout:9/555: getdents d0/d7/d21 0 2024-09-17T01:52:11.464 INFO:tasks.workunit.client.0.smithi031.stdout:9/652: dread - d3/d4/da0/d36/f9b zero size 2024-09-17T01:52:11.465 INFO:tasks.workunit.client.0.smithi031.stdout:1/735: rename d4/d1e/d3f/d72/f76 to d4/d1e/d5d/dae/ff5 0 2024-09-17T01:52:11.469 INFO:tasks.workunit.client.0.smithi031.stdout:7/678: mkdir db/d1c/d41/d6c/da0/dd4 0 2024-09-17T01:52:11.470 INFO:tasks.workunit.client.1.smithi092.stdout:9/556: dread d0/df/d17/f38 [0,4194304] 0 2024-09-17T01:52:11.471 INFO:tasks.workunit.client.0.smithi031.stdout:7/679: fsync db/d1c/d41/d69/fc0 0 2024-09-17T01:52:11.472 INFO:tasks.workunit.client.0.smithi031.stdout:9/653: mknod d3/d4/da0/d36/d79/dd0/cd5 0 2024-09-17T01:52:11.474 INFO:tasks.workunit.client.0.smithi031.stdout:2/745: rmdir d1/d3/d2d/da6/de9 39 2024-09-17T01:52:11.474 INFO:tasks.workunit.client.0.smithi031.stdout:9/654: write d3/d19/d1f/d44/d64/f90 [1094415,38323] 0 2024-09-17T01:52:11.475 INFO:tasks.workunit.client.0.smithi031.stdout:0/748: dread d0/d29/da7/db3/d4a/d86/fd9 [0,4194304] 0 2024-09-17T01:52:11.476 INFO:tasks.workunit.client.1.smithi092.stdout:9/557: dwrite d0/f4c [4194304,4194304] 0 2024-09-17T01:52:11.476 INFO:tasks.workunit.client.0.smithi031.stdout:1/736: fdatasync d4/d1e/d40/d84/fa6 0 2024-09-17T01:52:11.477 INFO:tasks.workunit.client.1.smithi092.stdout:9/558: write d0/f59 [870284,34312] 0 2024-09-17T01:52:11.477 INFO:tasks.workunit.client.0.smithi031.stdout:9/655: fsync d3/d4/da0/f60 0 2024-09-17T01:52:11.479 INFO:tasks.workunit.client.0.smithi031.stdout:7/680: creat db/d1c/d46/fd5 x:0 0 0 2024-09-17T01:52:11.480 INFO:tasks.workunit.client.0.smithi031.stdout:2/746: mkdir d1/d3/df/d18/d40/d43/d100 0 2024-09-17T01:52:11.481 INFO:tasks.workunit.client.0.smithi031.stdout:0/749: truncate d0/d37/f81 893753 0 2024-09-17T01:52:11.486 INFO:tasks.workunit.client.0.smithi031.stdout:6/787: rename d23/db4/d6a/d70/cea to d23/d63/c10a 0 2024-09-17T01:52:11.488 INFO:tasks.workunit.client.1.smithi092.stdout:9/559: dread d0/df/f47 [0,4194304] 0 2024-09-17T01:52:11.489 INFO:tasks.workunit.client.1.smithi092.stdout:9/560: chown d0/df/d17/f7b 437297 1 2024-09-17T01:52:11.490 INFO:tasks.workunit.client.0.smithi031.stdout:6/788: mkdir d23/db4/d6a/deb/d10b 0 2024-09-17T01:52:11.491 INFO:tasks.workunit.client.0.smithi031.stdout:9/656: creat d3/d19/db5/fd6 x:0 0 0 2024-09-17T01:52:11.491 INFO:tasks.workunit.client.1.smithi092.stdout:9/561: unlink d0/d7/d12/d86/f9b 0 2024-09-17T01:52:11.493 INFO:tasks.workunit.client.0.smithi031.stdout:6/789: creat d23/d63/d47/df0/f10c x:0 0 0 2024-09-17T01:52:11.495 INFO:tasks.workunit.client.0.smithi031.stdout:6/790: chown d23/db4/d64/d67/de9/lf4 65 1 2024-09-17T01:52:11.495 INFO:tasks.workunit.client.0.smithi031.stdout:3/701: rename db/df/d1d/d37/d6c/c87 to db/df/d1d/d37/cda 0 2024-09-17T01:52:11.495 INFO:tasks.workunit.client.0.smithi031.stdout:7/681: getdents db/d1c/d46/db9 0 2024-09-17T01:52:11.497 INFO:tasks.workunit.client.0.smithi031.stdout:9/657: symlink d3/d4c/ld7 0 2024-09-17T01:52:11.498 INFO:tasks.workunit.client.0.smithi031.stdout:9/658: write d3/d4/da0/d36/f9c [871126,23100] 0 2024-09-17T01:52:11.501 INFO:tasks.workunit.client.0.smithi031.stdout:7/682: chown db/d29/f4e 1074770995 1 2024-09-17T01:52:11.503 INFO:tasks.workunit.client.0.smithi031.stdout:0/750: rename d0/d29/da7/db3/d4a/l69 to d0/d37/db9/l105 0 2024-09-17T01:52:11.508 INFO:tasks.workunit.client.0.smithi031.stdout:7/683: mkdir db/d1c/d41/d69/dd6 0 2024-09-17T01:52:11.509 INFO:tasks.workunit.client.0.smithi031.stdout:1/737: dwrite d4/d1a/d2d/f38 [0,4194304] 0 2024-09-17T01:52:11.509 INFO:tasks.workunit.client.0.smithi031.stdout:9/659: dread d3/d4/da0/f60 [0,4194304] 0 2024-09-17T01:52:11.510 INFO:tasks.workunit.client.0.smithi031.stdout:2/747: rename d1/d3/d2d/db2/d1e/d21/d34/fab to d1/d3/df/d11/d30/da1/dca/f101 0 2024-09-17T01:52:11.511 INFO:tasks.workunit.client.0.smithi031.stdout:1/738: read d4/d1e/f49 [2724725,126733] 0 2024-09-17T01:52:11.511 INFO:tasks.workunit.client.0.smithi031.stdout:0/751: readlink d0/d29/d33/d2a/d25/d38/l51 0 2024-09-17T01:52:11.514 INFO:tasks.workunit.client.0.smithi031.stdout:2/748: chown d1/d3/d2d/d91/feb 1384 1 2024-09-17T01:52:11.519 INFO:tasks.workunit.client.0.smithi031.stdout:0/752: mkdir d0/d37/db9/dcf/d106 0 2024-09-17T01:52:11.519 INFO:tasks.workunit.client.0.smithi031.stdout:1/739: fdatasync d4/d1e/d3f/d72/f7a 0 2024-09-17T01:52:11.520 INFO:tasks.workunit.client.0.smithi031.stdout:2/749: chown d1/d3/df/d11/d30/f7a 6 1 2024-09-17T01:52:11.522 INFO:tasks.workunit.client.0.smithi031.stdout:7/684: creat db/d1c/d41/fd7 x:0 0 0 2024-09-17T01:52:11.523 INFO:tasks.workunit.client.0.smithi031.stdout:6/791: dwrite d23/db4/d6a/d91/fb6 [0,4194304] 0 2024-09-17T01:52:11.524 INFO:tasks.workunit.client.0.smithi031.stdout:1/740: readlink d4/d1a/d43/lf1 0 2024-09-17T01:52:11.526 INFO:tasks.workunit.client.0.smithi031.stdout:0/753: write d0/d29/da7/db3/d4a/f6c [2428845,1795] 0 2024-09-17T01:52:11.527 INFO:tasks.workunit.client.0.smithi031.stdout:7/685: chown db/d1c/f5c 57037 1 2024-09-17T01:52:11.532 INFO:tasks.workunit.client.0.smithi031.stdout:9/660: dwrite d3/d4/da0/d36/f9b [0,4194304] 0 2024-09-17T01:52:11.536 INFO:tasks.workunit.client.0.smithi031.stdout:0/754: write d0/d29/d33/d2a/d25/f27 [379767,97836] 0 2024-09-17T01:52:11.537 INFO:tasks.workunit.client.0.smithi031.stdout:2/750: symlink d1/d3/d2d/db2/d1e/d4f/l102 0 2024-09-17T01:52:11.537 INFO:tasks.workunit.client.0.smithi031.stdout:0/755: readlink d0/d29/l36 0 2024-09-17T01:52:11.537 INFO:tasks.workunit.client.0.smithi031.stdout:9/661: unlink d3/d19/d1f/d44/c56 0 2024-09-17T01:52:11.538 INFO:tasks.workunit.client.0.smithi031.stdout:1/741: read d4/d1a/d2d/d18/f6c [396112,60510] 0 2024-09-17T01:52:11.538 INFO:tasks.workunit.client.0.smithi031.stdout:9/662: write d3/d4/d41/fbc [870810,83021] 0 2024-09-17T01:52:11.540 INFO:tasks.workunit.client.0.smithi031.stdout:0/756: read d0/d29/d33/d2a/d25/da5/fa8 [620787,126313] 0 2024-09-17T01:52:11.541 INFO:tasks.workunit.client.0.smithi031.stdout:9/663: chown d3/d4/l9d 215162 1 2024-09-17T01:52:11.541 INFO:tasks.workunit.client.0.smithi031.stdout:6/792: unlink d23/d63/d47/c7c 0 2024-09-17T01:52:11.543 INFO:tasks.workunit.client.0.smithi031.stdout:6/793: chown d23/db4/d6a/dfa/l108 14650707 1 2024-09-17T01:52:11.544 INFO:tasks.workunit.client.0.smithi031.stdout:1/742: creat d4/d1e/d8d/ff6 x:0 0 0 2024-09-17T01:52:11.546 INFO:tasks.workunit.client.0.smithi031.stdout:7/686: write db/d1c/d41/d6c/f9d [1122607,17184] 0 2024-09-17T01:52:11.548 INFO:tasks.workunit.client.0.smithi031.stdout:6/794: creat d23/db4/d8a/f10d x:0 0 0 2024-09-17T01:52:11.549 INFO:tasks.workunit.client.0.smithi031.stdout:0/757: creat d0/d29/d33/d2a/d25/d102/f107 x:0 0 0 2024-09-17T01:52:11.549 INFO:tasks.workunit.client.0.smithi031.stdout:1/743: rmdir d4/d1e/d3f/d4d/da5 39 2024-09-17T01:52:11.550 INFO:tasks.workunit.client.0.smithi031.stdout:1/744: stat d4/d1e/d5d/dae/lb2 0 2024-09-17T01:52:11.551 INFO:tasks.workunit.client.0.smithi031.stdout:0/758: readlink d0/d29/da7/db3/d4a/d86/dd7/dac/lcb 0 2024-09-17T01:52:11.551 INFO:tasks.workunit.client.0.smithi031.stdout:2/751: creat d1/f103 x:0 0 0 2024-09-17T01:52:11.553 INFO:tasks.workunit.client.0.smithi031.stdout:9/664: mkdir d3/d4/da0/d36/d62/dd8 0 2024-09-17T01:52:11.553 INFO:tasks.workunit.client.0.smithi031.stdout:0/759: chown d0/d29/d33/d2a/d25/d38/fbf 1147 1 2024-09-17T01:52:11.553 INFO:tasks.workunit.client.0.smithi031.stdout:7/687: fsync db/d1c/d41/d6c/da0/fc8 0 2024-09-17T01:52:11.555 INFO:tasks.workunit.client.0.smithi031.stdout:0/760: dread - d0/d37/db9/feb zero size 2024-09-17T01:52:11.556 INFO:tasks.workunit.client.0.smithi031.stdout:0/761: chown d0/d29/da7/db3/c31 1702273 1 2024-09-17T01:52:11.557 INFO:tasks.workunit.client.0.smithi031.stdout:1/745: fsync d4/d1e/d3f/d72/d7e/da2/fbd 0 2024-09-17T01:52:11.559 INFO:tasks.workunit.client.0.smithi031.stdout:7/688: mknod db/d1c/d41/d6c/cd8 0 2024-09-17T01:52:11.560 INFO:tasks.workunit.client.0.smithi031.stdout:7/689: fsync db/d1c/d41/d6c/fc4 0 2024-09-17T01:52:11.563 INFO:tasks.workunit.client.0.smithi031.stdout:0/762: creat d0/d29/d33/d5/d48/d56/f108 x:0 0 0 2024-09-17T01:52:11.566 INFO:tasks.workunit.client.0.smithi031.stdout:6/795: getdents d23/db4/d8a/dd5 0 2024-09-17T01:52:11.568 INFO:tasks.workunit.client.0.smithi031.stdout:0/763: rmdir d0/d29/d44 39 2024-09-17T01:52:11.569 INFO:tasks.workunit.client.0.smithi031.stdout:0/764: chown d0/d29/da7/db3 874 1 2024-09-17T01:52:11.572 INFO:tasks.workunit.client.0.smithi031.stdout:9/665: getdents d3/d4/da0/d36/d79 0 2024-09-17T01:52:11.573 INFO:tasks.workunit.client.0.smithi031.stdout:6/796: dread d23/d63/f76 [0,4194304] 0 2024-09-17T01:52:11.573 INFO:tasks.workunit.client.0.smithi031.stdout:0/765: symlink d0/d29/d33/dff/l109 0 2024-09-17T01:52:11.576 INFO:tasks.workunit.client.0.smithi031.stdout:6/797: chown d23/d63/fd8 497313 1 2024-09-17T01:52:11.576 INFO:tasks.workunit.client.0.smithi031.stdout:7/690: write db/d1c/d41/d9a/fb3 [9978,33891] 0 2024-09-17T01:52:11.576 INFO:tasks.workunit.client.0.smithi031.stdout:9/666: write d3/d19/d1f/f23 [7752271,71459] 0 2024-09-17T01:52:11.578 INFO:tasks.workunit.client.0.smithi031.stdout:2/752: dwrite d1/d3/fa7 [0,4194304] 0 2024-09-17T01:52:11.578 INFO:tasks.workunit.client.0.smithi031.stdout:7/691: stat db/d1c/d46/db9 0 2024-09-17T01:52:11.580 INFO:tasks.workunit.client.0.smithi031.stdout:6/798: stat d23/db4/d6a/d70/d74/c9c 0 2024-09-17T01:52:11.584 INFO:tasks.workunit.client.0.smithi031.stdout:7/692: readlink db/d1c/d8e/da7/l77 0 2024-09-17T01:52:11.584 INFO:tasks.workunit.client.0.smithi031.stdout:2/753: truncate d1/d3/df/d11/d30/fcb 46877 0 2024-09-17T01:52:11.586 INFO:tasks.workunit.client.0.smithi031.stdout:7/693: chown db/d1c/d41/d9a/f9c 215413464 1 2024-09-17T01:52:11.588 INFO:tasks.workunit.client.0.smithi031.stdout:9/667: dread d3/d19/d1f/f58 [0,4194304] 0 2024-09-17T01:52:11.589 INFO:tasks.workunit.client.0.smithi031.stdout:7/694: chown db/lc7 1026254793 1 2024-09-17T01:52:11.589 INFO:tasks.workunit.client.0.smithi031.stdout:2/754: truncate d1/d3/d2d/db2/d1e/d4f/d92/fef 1424916 0 2024-09-17T01:52:11.590 INFO:tasks.workunit.client.0.smithi031.stdout:7/695: chown db/f3a 17678 1 2024-09-17T01:52:11.591 INFO:tasks.workunit.client.0.smithi031.stdout:9/668: unlink d3/f11 0 2024-09-17T01:52:11.594 INFO:tasks.workunit.client.0.smithi031.stdout:7/696: mknod db/d1c/d41/d69/dd6/cd9 0 2024-09-17T01:52:11.597 INFO:tasks.workunit.client.0.smithi031.stdout:2/755: getdents d1/d3/d2d/db2/d1e/d21/d34/d8a 0 2024-09-17T01:52:11.597 INFO:tasks.workunit.client.0.smithi031.stdout:7/697: rmdir db/d1c/d46/db9/dc1 39 2024-09-17T01:52:11.598 INFO:tasks.workunit.client.0.smithi031.stdout:5/632: sync 2024-09-17T01:52:11.603 INFO:tasks.workunit.client.0.smithi031.stdout:5/633: chown da/f49 103462084 1 2024-09-17T01:52:11.603 INFO:tasks.workunit.client.0.smithi031.stdout:7/698: fdatasync db/d1c/d41/d6c/f9d 0 2024-09-17T01:52:11.603 INFO:tasks.workunit.client.0.smithi031.stdout:6/799: dwrite d23/db4/d6a/d91/fa7 [0,4194304] 0 2024-09-17T01:52:11.604 INFO:tasks.workunit.client.0.smithi031.stdout:5/634: chown da/d42/l4f 51 1 2024-09-17T01:52:11.607 INFO:tasks.workunit.client.0.smithi031.stdout:2/756: getdents d1 0 2024-09-17T01:52:11.609 INFO:tasks.workunit.client.0.smithi031.stdout:9/669: dread d3/f42 [0,4194304] 0 2024-09-17T01:52:11.611 INFO:tasks.workunit.client.0.smithi031.stdout:7/699: unlink db/d1c/fad 0 2024-09-17T01:52:11.612 INFO:tasks.workunit.client.0.smithi031.stdout:6/800: read - d23/db4/d6a/deb/fad zero size 2024-09-17T01:52:11.613 INFO:tasks.workunit.client.0.smithi031.stdout:5/635: mkdir da/d14/dac/d82/ddd 0 2024-09-17T01:52:11.617 INFO:tasks.workunit.client.0.smithi031.stdout:2/757: rmdir d1/d3/df/d11/d30/da1 39 2024-09-17T01:52:11.620 INFO:tasks.workunit.client.0.smithi031.stdout:6/801: truncate d23/db4/d6a/d70/d74/f99 1044781 0 2024-09-17T01:52:11.623 INFO:tasks.workunit.client.0.smithi031.stdout:5/636: symlink da/d42/d12/d4a/dbf/lde 0 2024-09-17T01:52:11.625 INFO:tasks.workunit.client.0.smithi031.stdout:2/758: dwrite d1/d3/df/d66/fce [0,4194304] 0 2024-09-17T01:52:11.627 INFO:tasks.workunit.client.0.smithi031.stdout:6/802: creat d23/db4/d6a/d70/d74/f10e x:0 0 0 2024-09-17T01:52:11.627 INFO:tasks.workunit.client.0.smithi031.stdout:2/759: stat d1/d3/d2d/db2/d1e/d21/ddf 0 2024-09-17T01:52:11.627 INFO:tasks.workunit.client.0.smithi031.stdout:6/803: write d23/d63/f49 [1344546,12793] 0 2024-09-17T01:52:11.630 INFO:tasks.workunit.client.0.smithi031.stdout:7/700: creat db/d1c/fda x:0 0 0 2024-09-17T01:52:11.633 INFO:tasks.workunit.client.0.smithi031.stdout:5/637: chown da/d14/dac/d62/cb5 6 1 2024-09-17T01:52:11.634 INFO:tasks.workunit.client.0.smithi031.stdout:5/638: write da/f74 [5021235,66062] 0 2024-09-17T01:52:11.639 INFO:tasks.workunit.client.0.smithi031.stdout:7/701: link db/d1c/d41/d6c/fb0 db/d1c/d41/d6c/da0/dd4/fdb 0 2024-09-17T01:52:11.640 INFO:tasks.workunit.client.0.smithi031.stdout:5/639: creat da/d14/dac/d62/fdf x:0 0 0 2024-09-17T01:52:11.642 INFO:tasks.workunit.client.0.smithi031.stdout:9/670: creat d3/d4/da0/d36/d62/db2/fd9 x:0 0 0 2024-09-17T01:52:11.644 INFO:tasks.workunit.client.0.smithi031.stdout:5/640: mknod da/d4b/ce0 0 2024-09-17T01:52:11.646 INFO:tasks.workunit.client.0.smithi031.stdout:9/671: chown d3/d19/d1f/d44/f57 155867449 1 2024-09-17T01:52:11.652 INFO:tasks.workunit.client.0.smithi031.stdout:6/804: dread f20 [0,4194304] 0 2024-09-17T01:52:11.653 INFO:tasks.workunit.client.0.smithi031.stdout:9/672: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:52:11.653 INFO:tasks.workunit.client.0.smithi031.stdout:7/702: dread db/d1c/d99/fa3 [0,4194304] 0 2024-09-17T01:52:11.655 INFO:tasks.workunit.client.0.smithi031.stdout:6/805: mkdir d23/db4/d6a/d70/d74/d10f 0 2024-09-17T01:52:11.655 INFO:tasks.workunit.client.0.smithi031.stdout:7/703: stat db/d18/f2f 0 2024-09-17T01:52:11.656 INFO:tasks.workunit.client.0.smithi031.stdout:6/806: chown d23/db4/d6a/d72/fce 10276 1 2024-09-17T01:52:11.656 INFO:tasks.workunit.client.0.smithi031.stdout:9/673: mkdir d3/d4/da0/d71/dda 0 2024-09-17T01:52:11.658 INFO:tasks.workunit.client.0.smithi031.stdout:7/704: creat db/d1c/d41/d6c/fdc x:0 0 0 2024-09-17T01:52:11.658 INFO:tasks.workunit.client.0.smithi031.stdout:9/674: dread - d3/d4/da0/d36/d62/db2/fd9 zero size 2024-09-17T01:52:11.663 INFO:tasks.workunit.client.0.smithi031.stdout:6/807: truncate d23/f35 570008 0 2024-09-17T01:52:11.664 INFO:tasks.workunit.client.0.smithi031.stdout:6/808: dread - d23/db4/d8a/fd7 zero size 2024-09-17T01:52:11.665 INFO:tasks.workunit.client.0.smithi031.stdout:6/809: write d23/fcf [284763,117628] 0 2024-09-17T01:52:11.666 INFO:tasks.workunit.client.0.smithi031.stdout:7/705: rename db/d1c/d46/db9 to db/d18/d67/dac/ddd 0 2024-09-17T01:52:11.668 INFO:tasks.workunit.client.0.smithi031.stdout:6/810: symlink d23/d63/d47/d81/dee/l110 0 2024-09-17T01:52:11.668 INFO:tasks.workunit.client.0.smithi031.stdout:7/706: symlink db/d1c/d99/lde 0 2024-09-17T01:52:11.669 INFO:tasks.workunit.client.0.smithi031.stdout:6/811: dread - d23/d63/f7e zero size 2024-09-17T01:52:11.669 INFO:tasks.workunit.client.0.smithi031.stdout:6/812: chown d23/d63/d47/l9a 915144 1 2024-09-17T01:52:11.674 INFO:tasks.workunit.client.0.smithi031.stdout:6/813: rename d23/d63/d47/d81/dee/c101 to d23/db4/d6a/deb/d105/c111 0 2024-09-17T01:52:11.675 INFO:tasks.workunit.client.0.smithi031.stdout:7/707: dwrite db/d1c/d41/d6c/fc4 [0,4194304] 0 2024-09-17T01:52:11.678 INFO:tasks.workunit.client.0.smithi031.stdout:6/814: truncate d23/db4/f5e 779569 0 2024-09-17T01:52:11.679 INFO:tasks.workunit.client.0.smithi031.stdout:7/708: dread db/d1c/d46/f52 [0,4194304] 0 2024-09-17T01:52:11.681 INFO:tasks.workunit.client.0.smithi031.stdout:6/815: write d23/db4/d6a/d70/db0/fd6 [63112,49209] 0 2024-09-17T01:52:11.682 INFO:tasks.workunit.client.0.smithi031.stdout:7/709: creat db/d1c/d41/d9a/fdf x:0 0 0 2024-09-17T01:52:11.683 INFO:tasks.workunit.client.0.smithi031.stdout:7/710: chown db/d1c/fb4 0 1 2024-09-17T01:52:11.688 INFO:tasks.workunit.client.0.smithi031.stdout:7/711: mknod db/d1c/d41/d6c/da0/ce0 0 2024-09-17T01:52:11.690 INFO:tasks.workunit.client.0.smithi031.stdout:7/712: symlink db/d18/d67/dac/ddd/dbf/le1 0 2024-09-17T01:52:11.692 INFO:tasks.workunit.client.0.smithi031.stdout:7/713: mkdir db/d1c/de2 0 2024-09-17T01:52:11.694 INFO:tasks.workunit.client.0.smithi031.stdout:6/816: write d23/d63/d47/f6f [1935671,30776] 0 2024-09-17T01:52:11.696 INFO:tasks.workunit.client.0.smithi031.stdout:6/817: write d23/db4/d6a/d70/f88 [661588,42678] 0 2024-09-17T01:52:11.696 INFO:tasks.workunit.client.0.smithi031.stdout:7/714: mknod db/d18/d67/dac/ddd/ce3 0 2024-09-17T01:52:11.697 INFO:tasks.workunit.client.0.smithi031.stdout:7/715: chown db/d1c/d41/d69/fc2 607 1 2024-09-17T01:52:11.698 INFO:tasks.workunit.client.0.smithi031.stdout:6/818: symlink d23/db4/d6a/d70/db0/l112 0 2024-09-17T01:52:11.702 INFO:tasks.workunit.client.0.smithi031.stdout:7/716: dread db/d18/f61 [4194304,4194304] 0 2024-09-17T01:52:11.703 INFO:tasks.workunit.client.0.smithi031.stdout:7/717: chown db/d18/l43 44 1 2024-09-17T01:52:11.705 INFO:tasks.workunit.client.0.smithi031.stdout:6/819: write d23/db4/d6a/d70/d74/fb5 [288540,9760] 0 2024-09-17T01:52:11.707 INFO:tasks.workunit.client.0.smithi031.stdout:6/820: symlink d23/db4/d6a/d91/l113 0 2024-09-17T01:52:11.712 INFO:tasks.workunit.client.0.smithi031.stdout:6/821: getdents d23/db4/d6a/d91 0 2024-09-17T01:52:11.713 INFO:tasks.workunit.client.0.smithi031.stdout:6/822: stat d23/f42 0 2024-09-17T01:52:11.714 INFO:tasks.workunit.client.0.smithi031.stdout:6/823: chown d23/db4/d6a/d70/d74/fb5 161063690 1 2024-09-17T01:52:11.716 INFO:tasks.workunit.client.0.smithi031.stdout:7/718: dread db/f15 [0,4194304] 0 2024-09-17T01:52:11.718 INFO:tasks.workunit.client.0.smithi031.stdout:6/824: rename d23/d63/f76 to d23/db4/d6a/f114 0 2024-09-17T01:52:11.719 INFO:tasks.workunit.client.0.smithi031.stdout:7/719: mkdir db/d1c/d99/de4 0 2024-09-17T01:52:11.720 INFO:tasks.workunit.client.1.smithi092.stdout:8/417: sync 2024-09-17T01:52:11.720 INFO:tasks.workunit.client.1.smithi092.stdout:7/530: sync 2024-09-17T01:52:11.721 INFO:tasks.workunit.client.0.smithi031.stdout:6/825: mkdir d23/d63/d115 0 2024-09-17T01:52:11.721 INFO:tasks.workunit.client.0.smithi031.stdout:7/720: write db/d1c/d8e/da7/f86 [296781,87570] 0 2024-09-17T01:52:11.721 INFO:tasks.workunit.client.1.smithi092.stdout:8/418: rename d15/d25/d2b/d3d to d15/d25/d2b/d3d/d80 22 2024-09-17T01:52:11.723 INFO:tasks.workunit.client.1.smithi092.stdout:8/419: symlink d15/d25/d27/d6e/l81 0 2024-09-17T01:52:11.724 INFO:tasks.workunit.client.1.smithi092.stdout:8/420: chown d15/f1d 201961 1 2024-09-17T01:52:11.725 INFO:tasks.workunit.client.0.smithi031.stdout:7/721: dread db/f62 [0,4194304] 0 2024-09-17T01:52:11.727 INFO:tasks.workunit.client.0.smithi031.stdout:7/722: unlink db/d1c/l5f 0 2024-09-17T01:52:11.728 INFO:tasks.workunit.client.0.smithi031.stdout:6/826: write d23/d63/f34 [925575,62951] 0 2024-09-17T01:52:11.729 INFO:tasks.workunit.client.0.smithi031.stdout:6/827: chown d23/db4/d6a/deb 430920776 1 2024-09-17T01:52:11.729 INFO:tasks.workunit.client.0.smithi031.stdout:7/723: mkdir db/d1c/d99/de5 0 2024-09-17T01:52:11.730 INFO:tasks.workunit.client.0.smithi031.stdout:7/724: stat db/f81 0 2024-09-17T01:52:11.731 INFO:tasks.workunit.client.1.smithi092.stdout:8/421: truncate d15/d32/f38 77023 0 2024-09-17T01:52:11.731 INFO:tasks.workunit.client.1.smithi092.stdout:7/531: dwrite d3/db/f5e [0,4194304] 0 2024-09-17T01:52:11.732 INFO:tasks.workunit.client.1.smithi092.stdout:7/532: fsync d3/d6/d13/d21/d2e/f59 0 2024-09-17T01:52:11.737 INFO:tasks.workunit.client.0.smithi031.stdout:6/828: dwrite d23/d63/d47/f60 [0,4194304] 0 2024-09-17T01:52:11.737 INFO:tasks.workunit.client.1.smithi092.stdout:8/422: dread d15/f21 [0,4194304] 0 2024-09-17T01:52:11.740 INFO:tasks.workunit.client.0.smithi031.stdout:7/725: dwrite db/d18/f25 [4194304,4194304] 0 2024-09-17T01:52:11.740 INFO:tasks.workunit.client.1.smithi092.stdout:8/423: creat d15/d32/d3b/d78/f82 x:0 0 0 2024-09-17T01:52:11.741 INFO:tasks.workunit.client.1.smithi092.stdout:8/424: fsync d15/d32/d40/f77 0 2024-09-17T01:52:11.748 INFO:tasks.workunit.client.0.smithi031.stdout:6/829: creat d23/d63/d47/d81/dee/f116 x:0 0 0 2024-09-17T01:52:11.749 INFO:tasks.workunit.client.1.smithi092.stdout:7/533: dread d3/db/d26/d6f/f79 [0,4194304] 0 2024-09-17T01:52:11.755 INFO:tasks.workunit.client.1.smithi092.stdout:7/534: dwrite d3/d6/f9c [0,4194304] 0 2024-09-17T01:52:11.757 INFO:tasks.workunit.client.1.smithi092.stdout:7/535: chown d3/db/d26/d83 5751 1 2024-09-17T01:52:11.779 INFO:tasks.workunit.client.0.smithi031.stdout:6/830: write d23/d63/f5d [4916474,109682] 0 2024-09-17T01:52:11.779 INFO:tasks.workunit.client.0.smithi031.stdout:7/726: read db/d29/f4a [462542,25226] 0 2024-09-17T01:52:11.781 INFO:tasks.workunit.client.1.smithi092.stdout:8/425: dwrite d15/d25/f30 [0,4194304] 0 2024-09-17T01:52:11.782 INFO:tasks.workunit.client.0.smithi031.stdout:6/831: creat d23/db4/f117 x:0 0 0 2024-09-17T01:52:11.787 INFO:tasks.workunit.client.1.smithi092.stdout:8/426: dwrite d15/d32/d40/d42/f55 [0,4194304] 0 2024-09-17T01:52:11.815 INFO:tasks.workunit.client.0.smithi031.stdout:7/727: getdents db/d1c/d41/d6c/da0/dd4 0 2024-09-17T01:52:11.816 INFO:tasks.workunit.client.1.smithi092.stdout:0/593: sync 2024-09-17T01:52:11.816 INFO:tasks.workunit.client.1.smithi092.stdout:1/633: sync 2024-09-17T01:52:11.816 INFO:tasks.workunit.client.1.smithi092.stdout:1/634: fsync db/d3b/fb7 0 2024-09-17T01:52:11.820 INFO:tasks.workunit.client.1.smithi092.stdout:0/594: link d3/d2e/d55/d63/f6d d3/d73/fbb 0 2024-09-17T01:52:11.821 INFO:tasks.workunit.client.1.smithi092.stdout:0/595: fsync d3/d2e/d3b/fb9 0 2024-09-17T01:52:11.821 INFO:tasks.workunit.client.0.smithi031.stdout:7/728: dread db/d1c/d46/fc9 [0,4194304] 0 2024-09-17T01:52:11.822 INFO:tasks.workunit.client.1.smithi092.stdout:1/635: creat db/d1d/d2e/fcd x:0 0 0 2024-09-17T01:52:11.822 INFO:tasks.workunit.client.0.smithi031.stdout:6/832: dwrite d23/f3b [0,4194304] 0 2024-09-17T01:52:11.823 INFO:tasks.workunit.client.1.smithi092.stdout:8/427: fdatasync d15/d32/d40/d42/f55 0 2024-09-17T01:52:11.824 INFO:tasks.workunit.client.0.smithi031.stdout:6/833: chown d23/db4/fec 0 1 2024-09-17T01:52:11.825 INFO:tasks.workunit.client.0.smithi031.stdout:7/729: write db/d1c/d41/d9a/fa9 [3510816,119964] 0 2024-09-17T01:52:11.825 INFO:tasks.workunit.client.1.smithi092.stdout:1/636: dread db/d1d/d23/d88/fb2 [0,4194304] 0 2024-09-17T01:52:11.827 INFO:tasks.workunit.client.1.smithi092.stdout:8/428: write d15/d32/f59 [1204379,124837] 0 2024-09-17T01:52:11.827 INFO:tasks.workunit.client.0.smithi031.stdout:6/834: symlink d23/db4/d6a/deb/l118 0 2024-09-17T01:52:11.827 INFO:tasks.workunit.client.0.smithi031.stdout:6/835: chown d23/d63/d47/f6f 5 1 2024-09-17T01:52:11.828 INFO:tasks.workunit.client.0.smithi031.stdout:7/730: creat db/d18/d67/dac/fe6 x:0 0 0 2024-09-17T01:52:11.828 INFO:tasks.workunit.client.0.smithi031.stdout:6/836: stat d23/db4/c66 0 2024-09-17T01:52:11.829 INFO:tasks.workunit.client.1.smithi092.stdout:8/429: readlink d15/d32/d40/d42/d6b/l7d 0 2024-09-17T01:52:11.829 INFO:tasks.workunit.client.0.smithi031.stdout:6/837: chown d23/fbd 13375 1 2024-09-17T01:52:11.829 INFO:tasks.workunit.client.0.smithi031.stdout:7/731: truncate db/d29/f75 1046596 0 2024-09-17T01:52:11.830 INFO:tasks.workunit.client.0.smithi031.stdout:6/838: readlink d23/db4/d64/lfd 0 2024-09-17T01:52:11.830 INFO:tasks.workunit.client.1.smithi092.stdout:0/596: write d3/da/d1c/f8c [1245934,71368] 0 2024-09-17T01:52:11.832 INFO:tasks.workunit.client.1.smithi092.stdout:8/430: mkdir d15/d25/d27/d6e/d76/d83 0 2024-09-17T01:52:11.835 INFO:tasks.workunit.client.1.smithi092.stdout:8/431: read fa [7619363,40372] 0 2024-09-17T01:52:11.835 INFO:tasks.workunit.client.1.smithi092.stdout:0/597: getdents d3/d2e/d55/d63/d81/d9c 0 2024-09-17T01:52:11.836 INFO:tasks.workunit.client.1.smithi092.stdout:1/637: dwrite db/d1d/d23/d88/fc8 [0,4194304] 0 2024-09-17T01:52:11.837 INFO:tasks.workunit.client.1.smithi092.stdout:1/638: write db/d1d/d2e/d62/fc0 [641270,13993] 0 2024-09-17T01:52:11.837 INFO:tasks.workunit.client.0.smithi031.stdout:7/732: dread db/d1c/f1d [4194304,4194304] 0 2024-09-17T01:52:11.843 INFO:tasks.workunit.client.0.smithi031.stdout:6/839: dwrite d23/db4/d6a/d70/f7f [0,4194304] 0 2024-09-17T01:52:11.843 INFO:tasks.workunit.client.1.smithi092.stdout:8/432: write ff [1917303,95834] 0 2024-09-17T01:52:11.844 INFO:tasks.workunit.client.1.smithi092.stdout:1/639: truncate db/f5f 880764 0 2024-09-17T01:52:11.846 INFO:tasks.workunit.client.0.smithi031.stdout:7/733: dread db/d1c/d41/d9a/fab [0,4194304] 0 2024-09-17T01:52:11.846 INFO:tasks.workunit.client.1.smithi092.stdout:8/433: creat d15/d32/d3b/d78/d7c/f84 x:0 0 0 2024-09-17T01:52:11.847 INFO:tasks.workunit.client.0.smithi031.stdout:7/734: write db/d1c/f21 [3105427,99648] 0 2024-09-17T01:52:11.849 INFO:tasks.workunit.client.0.smithi031.stdout:6/840: getdents d23/db4/d6a/deb/d10b 0 2024-09-17T01:52:11.851 INFO:tasks.workunit.client.0.smithi031.stdout:7/735: write db/d18/d67/dac/ddd/dc1/fd2 [773311,76801] 0 2024-09-17T01:52:11.853 INFO:tasks.workunit.client.0.smithi031.stdout:7/736: chown db/d1c/d41/f4b 2 1 2024-09-17T01:52:11.853 INFO:tasks.workunit.client.0.smithi031.stdout:6/841: getdents d23/db4/d6a/deb 0 2024-09-17T01:52:11.855 INFO:tasks.workunit.client.0.smithi031.stdout:7/737: mkdir db/d1c/d41/d69/de7 0 2024-09-17T01:52:11.855 INFO:tasks.workunit.client.0.smithi031.stdout:6/842: write d23/db4/d64/f78 [64450,102031] 0 2024-09-17T01:52:11.856 INFO:tasks.workunit.client.0.smithi031.stdout:6/843: chown d23/d63/la2 7 1 2024-09-17T01:52:11.857 INFO:tasks.workunit.client.0.smithi031.stdout:6/844: write d23/d63/d47/d81/dee/f116 [883125,97933] 0 2024-09-17T01:52:11.857 INFO:tasks.workunit.client.0.smithi031.stdout:7/738: truncate db/d29/f4a 1302745 0 2024-09-17T01:52:11.859 INFO:tasks.workunit.client.0.smithi031.stdout:6/845: fsync d23/f30 0 2024-09-17T01:52:11.861 INFO:tasks.workunit.client.0.smithi031.stdout:7/739: creat db/d1c/d41/d69/de7/fe8 x:0 0 0 2024-09-17T01:52:11.862 INFO:tasks.workunit.client.0.smithi031.stdout:7/740: creat db/d29/fe9 x:0 0 0 2024-09-17T01:52:11.863 INFO:tasks.workunit.client.0.smithi031.stdout:6/846: symlink d23/l119 0 2024-09-17T01:52:11.864 INFO:tasks.workunit.client.0.smithi031.stdout:6/847: fdatasync d23/d63/d47/f6f 0 2024-09-17T01:52:11.864 INFO:tasks.workunit.client.0.smithi031.stdout:7/741: creat db/d1c/d41/d9a/fea x:0 0 0 2024-09-17T01:52:11.866 INFO:tasks.workunit.client.0.smithi031.stdout:7/742: readlink db/d18/d67/dac/ddd/dbf/le1 0 2024-09-17T01:52:11.866 INFO:tasks.workunit.client.0.smithi031.stdout:6/848: chown d23/db4/d6a/d72/lc4 132 1 2024-09-17T01:52:11.872 INFO:tasks.workunit.client.0.smithi031.stdout:6/849: creat d23/db4/d8a/dd5/ddd/df6/f11a x:0 0 0 2024-09-17T01:52:11.872 INFO:tasks.workunit.client.0.smithi031.stdout:7/743: dwrite db/d18/f93 [0,4194304] 0 2024-09-17T01:52:11.875 INFO:tasks.workunit.client.0.smithi031.stdout:6/850: mkdir d23/d63/d11b 0 2024-09-17T01:52:11.876 INFO:tasks.workunit.client.0.smithi031.stdout:7/744: creat db/d1c/de2/feb x:0 0 0 2024-09-17T01:52:11.877 INFO:tasks.workunit.client.0.smithi031.stdout:6/851: write d23/db4/d6a/d70/db0/fd6 [1534867,16447] 0 2024-09-17T01:52:11.878 INFO:tasks.workunit.client.0.smithi031.stdout:7/745: readlink db/l17 0 2024-09-17T01:52:11.880 INFO:tasks.workunit.client.0.smithi031.stdout:6/852: mknod d23/db4/d6a/d72/c11c 0 2024-09-17T01:52:11.884 INFO:tasks.workunit.client.0.smithi031.stdout:4/928: sync 2024-09-17T01:52:11.885 INFO:tasks.workunit.client.0.smithi031.stdout:7/746: getdents db 0 2024-09-17T01:52:11.886 INFO:tasks.workunit.client.0.smithi031.stdout:6/853: getdents d23/db4/d6a/d70 0 2024-09-17T01:52:11.888 INFO:tasks.workunit.client.0.smithi031.stdout:6/854: write d23/db4/d6a/d70/f7f [3134366,85870] 0 2024-09-17T01:52:11.888 INFO:tasks.workunit.client.0.smithi031.stdout:4/929: chown d8/d3a/d10a/d64/d4d/d5a/d79/d10b/f115 1027 1 2024-09-17T01:52:11.889 INFO:tasks.workunit.client.0.smithi031.stdout:6/855: stat d23/lf3 0 2024-09-17T01:52:11.890 INFO:tasks.workunit.client.0.smithi031.stdout:6/856: write d23/db4/d6a/d70/f7f [2416817,15459] 0 2024-09-17T01:52:11.891 INFO:tasks.workunit.client.0.smithi031.stdout:6/857: fdatasync f1e 0 2024-09-17T01:52:11.891 INFO:tasks.workunit.client.0.smithi031.stdout:7/747: rename db/d1c/fb4 to db/d1c/fec 0 2024-09-17T01:52:11.892 INFO:tasks.workunit.client.0.smithi031.stdout:6/858: write d23/f42 [1370632,75128] 0 2024-09-17T01:52:11.893 INFO:tasks.workunit.client.0.smithi031.stdout:6/859: fdatasync d23/db4/d8a/dd5/ddd/df6/f11a 0 2024-09-17T01:52:11.895 INFO:tasks.workunit.client.0.smithi031.stdout:4/930: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/f12c x:0 0 0 2024-09-17T01:52:11.898 INFO:tasks.workunit.client.0.smithi031.stdout:6/860: mkdir d23/d63/d11b/d11d 0 2024-09-17T01:52:11.901 INFO:tasks.workunit.client.0.smithi031.stdout:7/748: getdents db/d29 0 2024-09-17T01:52:11.902 INFO:tasks.workunit.client.0.smithi031.stdout:6/861: mknod d23/db4/d6a/deb/d105/c11e 0 2024-09-17T01:52:11.903 INFO:tasks.workunit.client.0.smithi031.stdout:7/749: mkdir db/d1c/d8e/ded 0 2024-09-17T01:52:11.905 INFO:tasks.workunit.client.0.smithi031.stdout:6/862: unlink d23/db4/d6a/d70/db0/l112 0 2024-09-17T01:52:11.907 INFO:tasks.workunit.client.0.smithi031.stdout:7/750: truncate db/d18/f27 1062954 0 2024-09-17T01:52:11.908 INFO:tasks.workunit.client.0.smithi031.stdout:7/751: mkdir db/d18/d67/dee 0 2024-09-17T01:52:11.910 INFO:tasks.workunit.client.0.smithi031.stdout:6/863: unlink d23/f35 0 2024-09-17T01:52:11.910 INFO:tasks.workunit.client.1.smithi092.stdout:1/640: dwrite db/d6c/d7e/d96/fc2 [0,4194304] 0 2024-09-17T01:52:11.914 INFO:tasks.workunit.client.0.smithi031.stdout:6/864: fdatasync d23/d63/f56 0 2024-09-17T01:52:11.915 INFO:tasks.workunit.client.0.smithi031.stdout:7/752: dwrite db/d1c/d41/faf [0,4194304] 0 2024-09-17T01:52:11.922 INFO:tasks.workunit.client.0.smithi031.stdout:6/865: rename d23/d63/d47/f4c to d23/db4/d6a/d70/d74/f11f 0 2024-09-17T01:52:11.923 INFO:tasks.workunit.client.1.smithi092.stdout:1/641: dread db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:11.927 INFO:tasks.workunit.client.1.smithi092.stdout:1/642: getdents db/d6c/d7e/d96 0 2024-09-17T01:52:11.929 INFO:tasks.workunit.client.1.smithi092.stdout:8/434: dread d15/d25/f68 [0,4194304] 0 2024-09-17T01:52:11.933 INFO:tasks.workunit.client.1.smithi092.stdout:1/643: link db/d1d/d4b/l8d db/d1d/d4b/d9a/lce 0 2024-09-17T01:52:11.934 INFO:tasks.workunit.client.1.smithi092.stdout:1/644: chown db/d6c/d7e/l8e 223279 1 2024-09-17T01:52:11.944 INFO:tasks.workunit.client.1.smithi092.stdout:8/435: dwrite d15/d32/f38 [0,4194304] 0 2024-09-17T01:52:11.945 INFO:tasks.workunit.client.1.smithi092.stdout:1/645: dwrite db/f5f [0,4194304] 0 2024-09-17T01:52:11.945 INFO:tasks.workunit.client.1.smithi092.stdout:8/436: fsync d15/d32/d40/d42/f5f 0 2024-09-17T01:52:11.954 INFO:tasks.workunit.client.1.smithi092.stdout:8/437: dwrite d15/d32/f59 [4194304,4194304] 0 2024-09-17T01:52:11.955 INFO:tasks.workunit.client.1.smithi092.stdout:8/438: write d15/f74 [29656,53634] 0 2024-09-17T01:52:11.957 INFO:tasks.workunit.client.1.smithi092.stdout:8/439: mknod d15/d32/d40/d4c/c85 0 2024-09-17T01:52:11.958 INFO:tasks.workunit.client.1.smithi092.stdout:8/440: mknod d15/d32/d40/d42/d43/c86 0 2024-09-17T01:52:11.961 INFO:tasks.workunit.client.1.smithi092.stdout:8/441: mkdir d15/d25/d27/d87 0 2024-09-17T01:52:11.964 INFO:tasks.workunit.client.1.smithi092.stdout:1/646: dread db/d1d/d23/d88/fc9 [0,4194304] 0 2024-09-17T01:52:11.964 INFO:tasks.workunit.client.1.smithi092.stdout:8/442: creat d15/d32/d40/d42/d43/f88 x:0 0 0 2024-09-17T01:52:11.965 INFO:tasks.workunit.client.1.smithi092.stdout:1/647: readlink db/d1d/d23/l98 0 2024-09-17T01:52:11.966 INFO:tasks.workunit.client.1.smithi092.stdout:8/443: truncate d15/d32/d3b/f7e 920102 0 2024-09-17T01:52:11.966 INFO:tasks.workunit.client.1.smithi092.stdout:8/444: chown d15/f1a 304564203 1 2024-09-17T01:52:11.967 INFO:tasks.workunit.client.1.smithi092.stdout:1/648: chown db/d1d/d23/d34/c3e 321 1 2024-09-17T01:52:11.968 INFO:tasks.workunit.client.1.smithi092.stdout:1/649: fdatasync db/d1d/d23/d88/fc8 0 2024-09-17T01:52:11.971 INFO:tasks.workunit.client.1.smithi092.stdout:9/562: sync 2024-09-17T01:52:11.971 INFO:tasks.workunit.client.1.smithi092.stdout:2/525: sync 2024-09-17T01:52:11.971 INFO:tasks.workunit.client.1.smithi092.stdout:4/697: sync 2024-09-17T01:52:11.971 INFO:tasks.workunit.client.1.smithi092.stdout:6/469: sync 2024-09-17T01:52:11.971 INFO:tasks.workunit.client.1.smithi092.stdout:3/542: sync 2024-09-17T01:52:11.971 INFO:tasks.workunit.client.1.smithi092.stdout:5/481: sync 2024-09-17T01:52:11.973 INFO:tasks.workunit.client.1.smithi092.stdout:6/470: fsync f1 0 2024-09-17T01:52:11.975 INFO:tasks.workunit.client.1.smithi092.stdout:2/526: mknod d10/d1d/d96/d77/d9c/cb2 0 2024-09-17T01:52:11.976 INFO:tasks.workunit.client.1.smithi092.stdout:1/650: dread db/d1d/f72 [0,4194304] 0 2024-09-17T01:52:11.977 INFO:tasks.workunit.client.1.smithi092.stdout:8/445: dwrite d15/d25/f68 [0,4194304] 0 2024-09-17T01:52:11.977 INFO:tasks.workunit.client.1.smithi092.stdout:3/543: getdents d4/d16/d1b/daf 0 2024-09-17T01:52:11.977 INFO:tasks.workunit.client.1.smithi092.stdout:5/482: write d0/de/d19/d1a/d1e/d29/f7c [1858154,27113] 0 2024-09-17T01:52:11.980 INFO:tasks.workunit.client.1.smithi092.stdout:4/698: unlink d4/d13/d3b/d42/d76/d35/d3e/d7c/f89 0 2024-09-17T01:52:12.007 INFO:tasks.workunit.client.1.smithi092.stdout:7/536: sync 2024-09-17T01:52:12.008 INFO:tasks.workunit.client.0.smithi031.stdout:7/753: dread db/d1c/d46/f4f [0,4194304] 0 2024-09-17T01:52:12.010 INFO:tasks.workunit.client.0.smithi031.stdout:6/866: dread d23/db4/f58 [0,4194304] 0 2024-09-17T01:52:12.010 INFO:tasks.workunit.client.0.smithi031.stdout:7/754: symlink db/d18/d67/dac/ddd/dbf/lef 0 2024-09-17T01:52:12.011 INFO:tasks.workunit.client.0.smithi031.stdout:6/867: write f1e [2339394,128366] 0 2024-09-17T01:52:12.012 INFO:tasks.workunit.client.0.smithi031.stdout:7/755: fdatasync db/d1c/d41/d9a/fab 0 2024-09-17T01:52:12.013 INFO:tasks.workunit.client.0.smithi031.stdout:7/756: chown db/d1c/d99/de5 6976185 1 2024-09-17T01:52:12.014 INFO:tasks.workunit.client.1.smithi092.stdout:9/563: fsync d0/d7/d12/d34/d26/d54/f24 0 2024-09-17T01:52:12.014 INFO:tasks.workunit.client.0.smithi031.stdout:6/868: dread f20 [0,4194304] 0 2024-09-17T01:52:12.015 INFO:tasks.workunit.client.0.smithi031.stdout:6/869: stat d23/db4/d6a/deb/d10b 0 2024-09-17T01:52:12.016 INFO:tasks.workunit.client.0.smithi031.stdout:6/870: stat d23/db4/d6a/dfa/c107 0 2024-09-17T01:52:12.019 INFO:tasks.workunit.client.0.smithi031.stdout:6/871: read - d23/d63/d47/df0/f102 zero size 2024-09-17T01:52:12.022 INFO:tasks.workunit.client.1.smithi092.stdout:3/544: creat d4/d20/d9f/db2/fb6 x:0 0 0 2024-09-17T01:52:12.022 INFO:tasks.workunit.client.0.smithi031.stdout:6/872: read d23/db4/d6a/d70/d74/fb5 [220713,95848] 0 2024-09-17T01:52:12.022 INFO:tasks.workunit.client.1.smithi092.stdout:7/537: mknod d3/d6/d13/d40/cb5 0 2024-09-17T01:52:12.026 INFO:tasks.workunit.client.1.smithi092.stdout:1/651: getdents db 0 2024-09-17T01:52:12.026 INFO:tasks.workunit.client.1.smithi092.stdout:4/699: mknod d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3/ce6 0 2024-09-17T01:52:12.026 INFO:tasks.workunit.client.1.smithi092.stdout:5/483: dwrite d0/de/d19/d1a/d1e/d74/f8b [0,4194304] 0 2024-09-17T01:52:12.027 INFO:tasks.workunit.client.0.smithi031.stdout:7/757: dread db/d1c/d41/d6c/fb0 [0,4194304] 0 2024-09-17T01:52:12.030 INFO:tasks.workunit.client.1.smithi092.stdout:7/538: readlink d3/d6/d13/d40/l7a 0 2024-09-17T01:52:12.031 INFO:tasks.workunit.client.1.smithi092.stdout:3/545: write d4/d16/d1b/f87 [1744450,129642] 0 2024-09-17T01:52:12.032 INFO:tasks.workunit.client.0.smithi031.stdout:6/873: dwrite d23/f30 [4194304,4194304] 0 2024-09-17T01:52:12.032 INFO:tasks.workunit.client.1.smithi092.stdout:1/652: rmdir db/d1d/d23 39 2024-09-17T01:52:12.034 INFO:tasks.workunit.client.1.smithi092.stdout:2/527: dwrite d10/d55/f7e [0,4194304] 0 2024-09-17T01:52:12.034 INFO:tasks.workunit.client.1.smithi092.stdout:8/446: dwrite d15/f34 [0,4194304] 0 2024-09-17T01:52:12.036 INFO:tasks.workunit.client.0.smithi031.stdout:6/874: symlink d23/dd1/l120 0 2024-09-17T01:52:12.036 INFO:tasks.workunit.client.1.smithi092.stdout:9/564: dwrite d0/f5c [0,4194304] 0 2024-09-17T01:52:12.040 INFO:tasks.workunit.client.1.smithi092.stdout:7/539: chown d3/d6/d13/d21/d2e/d6e 57806 1 2024-09-17T01:52:12.040 INFO:tasks.workunit.client.1.smithi092.stdout:9/565: readlink d0/d7/d12/d34/d26/l46 0 2024-09-17T01:52:12.040 INFO:tasks.workunit.client.1.smithi092.stdout:2/528: write d10/d1d/d2c/f3d [2560106,19740] 0 2024-09-17T01:52:12.047 INFO:tasks.workunit.client.1.smithi092.stdout:7/540: rename d3/db/l1a to d3/d6/d13/d40/d6a/lb6 0 2024-09-17T01:52:12.048 INFO:tasks.workunit.client.1.smithi092.stdout:4/700: dwrite d4/d13/d3b/d42/d76/d35/f7f [4194304,4194304] 0 2024-09-17T01:52:12.049 INFO:tasks.workunit.client.1.smithi092.stdout:3/546: mkdir d4/d13/d2e/d6f/db7 0 2024-09-17T01:52:12.051 INFO:tasks.workunit.client.1.smithi092.stdout:1/653: fsync db/d1d/d23/d88/fb2 0 2024-09-17T01:52:12.055 INFO:tasks.workunit.client.0.smithi031.stdout:6/875: dread d23/db4/d64/d67/f7a [0,4194304] 0 2024-09-17T01:52:12.056 INFO:tasks.workunit.client.1.smithi092.stdout:1/654: chown db/d6c/d7a/ca3 3519135 1 2024-09-17T01:52:12.057 INFO:tasks.workunit.client.0.smithi031.stdout:6/876: write d23/db4/d6a/d72/f96 [800462,30789] 0 2024-09-17T01:52:12.057 INFO:tasks.workunit.client.1.smithi092.stdout:2/529: rename d10/d5c/d81/da6 to d10/d4c/d80/d95/db3 0 2024-09-17T01:52:12.060 INFO:tasks.workunit.client.1.smithi092.stdout:9/566: link d0/df/d17/f51 d0/d7/d21/fa5 0 2024-09-17T01:52:12.060 INFO:tasks.workunit.client.0.smithi031.stdout:6/877: creat d23/db4/d6a/d70/f121 x:0 0 0 2024-09-17T01:52:12.061 INFO:tasks.workunit.client.1.smithi092.stdout:7/541: dread d3/f4b [0,4194304] 0 2024-09-17T01:52:12.061 INFO:tasks.workunit.client.1.smithi092.stdout:4/701: unlink d4/d5/d46/ce4 0 2024-09-17T01:52:12.061 INFO:tasks.workunit.client.1.smithi092.stdout:3/547: dwrite d4/d2f/d44/d3c/f45 [0,4194304] 0 2024-09-17T01:52:12.062 INFO:tasks.workunit.client.0.smithi031.stdout:6/878: getdents d23/d63/d115 0 2024-09-17T01:52:12.064 INFO:tasks.workunit.client.1.smithi092.stdout:2/530: creat d10/d3a/d97/da8/fb4 x:0 0 0 2024-09-17T01:52:12.065 INFO:tasks.workunit.client.1.smithi092.stdout:7/542: write d3/d6/d13/d21/f5c [1202491,64303] 0 2024-09-17T01:52:12.065 INFO:tasks.workunit.client.1.smithi092.stdout:9/567: symlink d0/df/d5d/la6 0 2024-09-17T01:52:12.065 INFO:tasks.workunit.client.1.smithi092.stdout:3/548: write d4/d20/f7c [3215950,27056] 0 2024-09-17T01:52:12.069 INFO:tasks.workunit.client.1.smithi092.stdout:4/702: fsync d4/d7b/d7d/fbf 0 2024-09-17T01:52:12.069 INFO:tasks.workunit.client.1.smithi092.stdout:7/543: write d3/d6/d13/f7d [4515364,4433] 0 2024-09-17T01:52:12.071 INFO:tasks.workunit.client.1.smithi092.stdout:1/655: getdents db 0 2024-09-17T01:52:12.072 INFO:tasks.workunit.client.1.smithi092.stdout:4/703: chown d4/d5/fd3 1349 1 2024-09-17T01:52:12.072 INFO:tasks.workunit.client.1.smithi092.stdout:9/568: dread - d0/d7/d12/d34/d26/d54/f9c zero size 2024-09-17T01:52:12.072 INFO:tasks.workunit.client.1.smithi092.stdout:2/531: truncate d10/d1d/d2c/d5a/d7a/f7c 1076060 0 2024-09-17T01:52:12.073 INFO:tasks.workunit.client.1.smithi092.stdout:2/532: readlink d10/d1d/d24/l30 0 2024-09-17T01:52:12.074 INFO:tasks.workunit.client.1.smithi092.stdout:9/569: chown d0/d7/d12/d86/d93/d96 34090709 1 2024-09-17T01:52:12.075 INFO:tasks.workunit.client.1.smithi092.stdout:3/549: rename d4/d16/d1b/c4d to d4/d2f/d44/d54/cb8 0 2024-09-17T01:52:12.075 INFO:tasks.workunit.client.1.smithi092.stdout:2/533: write d10/d8d/f76 [2285755,83704] 0 2024-09-17T01:52:12.076 INFO:tasks.workunit.client.1.smithi092.stdout:1/656: creat db/d1d/db5/fcf x:0 0 0 2024-09-17T01:52:12.078 INFO:tasks.workunit.client.1.smithi092.stdout:9/570: rmdir d0/d5/d3e 39 2024-09-17T01:52:12.079 INFO:tasks.workunit.client.0.smithi031.stdout:6/879: dwrite d23/d63/f104 [0,4194304] 0 2024-09-17T01:52:12.079 INFO:tasks.workunit.client.1.smithi092.stdout:9/571: stat d0/d7/d12/d34 0 2024-09-17T01:52:12.080 INFO:tasks.workunit.client.1.smithi092.stdout:2/534: creat d10/d1d/d2c/fb5 x:0 0 0 2024-09-17T01:52:12.082 INFO:tasks.workunit.client.1.smithi092.stdout:3/550: rename d4/l10 to d4/d2f/d44/d3c/lb9 0 2024-09-17T01:52:12.082 INFO:tasks.workunit.client.1.smithi092.stdout:2/535: write d10/d1d/d2c/f57 [4820184,40978] 0 2024-09-17T01:52:12.088 INFO:tasks.workunit.client.1.smithi092.stdout:2/536: readlink d10/d5c/l5e 0 2024-09-17T01:52:12.089 INFO:tasks.workunit.client.1.smithi092.stdout:2/537: write d10/f2a [1105027,78422] 0 2024-09-17T01:52:12.091 INFO:tasks.workunit.client.1.smithi092.stdout:4/704: link d4/d5/d1d/d30/d3f/d4b/cc5 d4/d5/d8/d99/ce7 0 2024-09-17T01:52:12.091 INFO:tasks.workunit.client.1.smithi092.stdout:3/551: dwrite d4/d13/f8b [0,4194304] 0 2024-09-17T01:52:12.096 INFO:tasks.workunit.client.1.smithi092.stdout:8/447: truncate d15/d25/f68 898266 0 2024-09-17T01:52:12.096 INFO:tasks.workunit.client.1.smithi092.stdout:1/657: creat db/d1d/fd0 x:0 0 0 2024-09-17T01:52:12.100 INFO:tasks.workunit.client.1.smithi092.stdout:4/705: read d4/d5/fd2 [2141327,43712] 0 2024-09-17T01:52:12.102 INFO:tasks.workunit.client.1.smithi092.stdout:9/572: creat d0/d7/d12/d34/d26/d54/fa7 x:0 0 0 2024-09-17T01:52:12.102 INFO:tasks.workunit.client.1.smithi092.stdout:4/706: write d4/d5/fc4 [853999,50568] 0 2024-09-17T01:52:12.104 INFO:tasks.workunit.client.1.smithi092.stdout:1/658: dwrite db/d1d/db5/f4e [0,4194304] 0 2024-09-17T01:52:12.106 INFO:tasks.workunit.client.1.smithi092.stdout:1/659: readlink db/d3b/l6a 0 2024-09-17T01:52:12.106 INFO:tasks.workunit.client.0.smithi031.stdout:6/880: truncate f1a 5637772 0 2024-09-17T01:52:12.106 INFO:tasks.workunit.client.1.smithi092.stdout:1/660: readlink db/d1d/d23/da1/dbf/lca 0 2024-09-17T01:52:12.107 INFO:tasks.workunit.client.1.smithi092.stdout:3/552: rename d4/d20/d9f/db2 to d4/d73/dba 0 2024-09-17T01:52:12.108 INFO:tasks.workunit.client.1.smithi092.stdout:3/553: dread - d4/d16/f80 zero size 2024-09-17T01:52:12.108 INFO:tasks.workunit.client.0.smithi031.stdout:6/881: unlink d23/d63/d47/f60 0 2024-09-17T01:52:12.110 INFO:tasks.workunit.client.1.smithi092.stdout:3/554: dread - d4/d16/f80 zero size 2024-09-17T01:52:12.110 INFO:tasks.workunit.client.1.smithi092.stdout:1/661: write db/d1d/d23/d88/fc8 [2889848,122916] 0 2024-09-17T01:52:12.113 INFO:tasks.workunit.client.1.smithi092.stdout:4/707: mkdir d4/d13/d3b/d42/d76/d35/de8 0 2024-09-17T01:52:12.116 INFO:tasks.workunit.client.0.smithi031.stdout:6/882: dwrite d23/d63/d47/df0/f10c [0,4194304] 0 2024-09-17T01:52:12.119 INFO:tasks.workunit.client.1.smithi092.stdout:7/544: truncate d3/d6/d13/d21/d2e/f97 153624 0 2024-09-17T01:52:12.120 INFO:tasks.workunit.client.0.smithi031.stdout:6/883: mknod d23/db4/d64/d67/c122 0 2024-09-17T01:52:12.121 INFO:tasks.workunit.client.1.smithi092.stdout:7/545: stat d3/d2b/d37 0 2024-09-17T01:52:12.121 INFO:tasks.workunit.client.1.smithi092.stdout:8/448: creat d15/f89 x:0 0 0 2024-09-17T01:52:12.122 INFO:tasks.workunit.client.1.smithi092.stdout:8/449: read d15/f21 [458872,35456] 0 2024-09-17T01:52:12.122 INFO:tasks.workunit.client.1.smithi092.stdout:2/538: getdents d10/d4c/d80/d95 0 2024-09-17T01:52:12.127 INFO:tasks.workunit.client.1.smithi092.stdout:1/662: mkdir db/d6c/d7e/dd1 0 2024-09-17T01:52:12.127 INFO:tasks.workunit.client.1.smithi092.stdout:1/663: stat db/d1d/d23/d88 0 2024-09-17T01:52:12.128 INFO:tasks.workunit.client.1.smithi092.stdout:3/555: creat d4/d73/d8f/d9e/fbb x:0 0 0 2024-09-17T01:52:12.129 INFO:tasks.workunit.client.1.smithi092.stdout:9/573: creat d0/d7/d12/d34/d26/d54/fa8 x:0 0 0 2024-09-17T01:52:12.132 INFO:tasks.workunit.client.1.smithi092.stdout:7/546: readlink d3/d6/d13/d40/d6a/lb6 0 2024-09-17T01:52:12.133 INFO:tasks.workunit.client.1.smithi092.stdout:8/450: creat d15/d32/d3b/f8a x:0 0 0 2024-09-17T01:52:12.136 INFO:tasks.workunit.client.1.smithi092.stdout:4/708: mknod d4/d13/d3b/d42/d76/d41/dc6/ce9 0 2024-09-17T01:52:12.137 INFO:tasks.workunit.client.1.smithi092.stdout:1/664: rename db/d1d/f64 to db/d1d/d4b/fd2 0 2024-09-17T01:52:12.138 INFO:tasks.workunit.client.1.smithi092.stdout:1/665: fsync db/f5f 0 2024-09-17T01:52:12.139 INFO:tasks.workunit.client.1.smithi092.stdout:3/556: symlink d4/d13/d2e/lbc 0 2024-09-17T01:52:12.139 INFO:tasks.workunit.client.1.smithi092.stdout:3/557: chown d4/d20/f86 153505574 1 2024-09-17T01:52:12.140 INFO:tasks.workunit.client.1.smithi092.stdout:3/558: chown d4/d20/d39/d70/d95 171 1 2024-09-17T01:52:12.141 INFO:tasks.workunit.client.0.smithi031.stdout:6/884: dread d23/f30 [0,4194304] 0 2024-09-17T01:52:12.141 INFO:tasks.workunit.client.1.smithi092.stdout:3/559: write d4/d13/d2e/d43/f9b [2015046,22881] 0 2024-09-17T01:52:12.144 INFO:tasks.workunit.client.0.smithi031.stdout:6/885: creat d23/db4/d64/dc1/f123 x:0 0 0 2024-09-17T01:52:12.145 INFO:tasks.workunit.client.0.smithi031.stdout:6/886: read - d23/dd1/f109 zero size 2024-09-17T01:52:12.148 INFO:tasks.workunit.client.0.smithi031.stdout:6/887: symlink d23/d63/d47/l124 0 2024-09-17T01:52:12.148 INFO:tasks.workunit.client.1.smithi092.stdout:7/547: mkdir d3/d6/d13/db7 0 2024-09-17T01:52:12.149 INFO:tasks.workunit.client.1.smithi092.stdout:7/548: fdatasync d3/db/f4a 0 2024-09-17T01:52:12.149 INFO:tasks.workunit.client.1.smithi092.stdout:8/451: mkdir d15/d6f/d8b 0 2024-09-17T01:52:12.149 INFO:tasks.workunit.client.1.smithi092.stdout:0/598: sync 2024-09-17T01:52:12.150 INFO:tasks.workunit.client.0.smithi031.stdout:6/888: creat d23/f125 x:0 0 0 2024-09-17T01:52:12.150 INFO:tasks.workunit.client.1.smithi092.stdout:8/452: fdatasync d15/d32/d40/f7b 0 2024-09-17T01:52:12.151 INFO:tasks.workunit.client.0.smithi031.stdout:6/889: fsync d23/f30 0 2024-09-17T01:52:12.153 INFO:tasks.workunit.client.0.smithi031.stdout:6/890: rmdir d23/db4/d6a/d72 39 2024-09-17T01:52:12.154 INFO:tasks.workunit.client.1.smithi092.stdout:8/453: write d15/d25/d27/f3e [1088311,81715] 0 2024-09-17T01:52:12.154 INFO:tasks.workunit.client.1.smithi092.stdout:0/599: fsync d3/d2e/d3b/fb9 0 2024-09-17T01:52:12.155 INFO:tasks.workunit.client.0.smithi031.stdout:6/891: mknod d23/d63/d47/c126 0 2024-09-17T01:52:12.155 INFO:tasks.workunit.client.1.smithi092.stdout:4/709: rmdir d4 39 2024-09-17T01:52:12.155 INFO:tasks.workunit.client.1.smithi092.stdout:8/454: write d15/f1d [1889655,106151] 0 2024-09-17T01:52:12.156 INFO:tasks.workunit.client.1.smithi092.stdout:2/539: dread d10/d8d/f52 [0,4194304] 0 2024-09-17T01:52:12.158 INFO:tasks.workunit.client.1.smithi092.stdout:8/455: write d15/d32/d3b/d78/f82 [228299,42017] 0 2024-09-17T01:52:12.160 INFO:tasks.workunit.client.1.smithi092.stdout:2/540: dread - d10/d3a/d97/da8/fb4 zero size 2024-09-17T01:52:12.160 INFO:tasks.workunit.client.0.smithi031.stdout:8/627: sync 2024-09-17T01:52:12.161 INFO:tasks.workunit.client.0.smithi031.stdout:6/892: dwrite d23/d63/fcd [0,4194304] 0 2024-09-17T01:52:12.165 INFO:tasks.workunit.client.1.smithi092.stdout:9/574: write d0/df/d17/f2f [663842,34963] 0 2024-09-17T01:52:12.166 INFO:tasks.workunit.client.0.smithi031.stdout:6/893: rename d23/db4/d6a/deb/l118 to d23/db4/d64/dc1/l127 0 2024-09-17T01:52:12.167 INFO:tasks.workunit.client.1.smithi092.stdout:0/600: dwrite d3/d2e/d3b/d8f/f51 [0,4194304] 0 2024-09-17T01:52:12.168 INFO:tasks.workunit.client.1.smithi092.stdout:7/549: rename d3/d6/d13/d40/d6a/lb6 to d3/db/d26/d6f/lb8 0 2024-09-17T01:52:12.170 INFO:tasks.workunit.client.0.smithi031.stdout:6/894: symlink d23/db4/d6a/dfa/l128 0 2024-09-17T01:52:12.170 INFO:tasks.workunit.client.0.smithi031.stdout:6/895: stat d23/l25 0 2024-09-17T01:52:12.174 INFO:tasks.workunit.client.0.smithi031.stdout:8/628: dread d0/df/f2b [0,4194304] 0 2024-09-17T01:52:12.174 INFO:tasks.workunit.client.0.smithi031.stdout:6/896: mkdir d23/db4/d64/d67/d129 0 2024-09-17T01:52:12.174 INFO:tasks.workunit.client.1.smithi092.stdout:2/541: creat d10/d8d/d8f/fb6 x:0 0 0 2024-09-17T01:52:12.176 INFO:tasks.workunit.client.1.smithi092.stdout:8/456: symlink d15/d25/d2b/d3d/l8c 0 2024-09-17T01:52:12.177 INFO:tasks.workunit.client.0.smithi031.stdout:8/629: dread - d0/df/dd/d77/f92 zero size 2024-09-17T01:52:12.178 INFO:tasks.workunit.client.1.smithi092.stdout:9/575: rmdir d0/df/d17 39 2024-09-17T01:52:12.179 INFO:tasks.workunit.client.0.smithi031.stdout:8/630: creat d0/df/d19/fba x:0 0 0 2024-09-17T01:52:12.182 INFO:tasks.workunit.client.1.smithi092.stdout:0/601: creat d3/d2e/d3b/fbc x:0 0 0 2024-09-17T01:52:12.182 INFO:tasks.workunit.client.1.smithi092.stdout:9/576: write d0/d7/d21/f75 [479500,68452] 0 2024-09-17T01:52:12.183 INFO:tasks.workunit.client.1.smithi092.stdout:1/666: write db/d1d/d2e/f32 [3421586,38428] 0 2024-09-17T01:52:12.184 INFO:tasks.workunit.client.0.smithi031.stdout:8/631: getdents d0/d5/d54/d60 0 2024-09-17T01:52:12.188 INFO:tasks.workunit.client.1.smithi092.stdout:2/542: dwrite d10/d1d/d2c/d5a/d7a/f7b [0,4194304] 0 2024-09-17T01:52:12.189 INFO:tasks.workunit.client.1.smithi092.stdout:1/667: mkdir db/d6c/d7e/d96/dd3 0 2024-09-17T01:52:12.189 INFO:tasks.workunit.client.1.smithi092.stdout:3/560: dwrite d4/d2f/d44/d3c/f90 [0,4194304] 0 2024-09-17T01:52:12.192 INFO:tasks.workunit.client.1.smithi092.stdout:2/543: readlink d10/d8d/l3b 0 2024-09-17T01:52:12.192 INFO:tasks.workunit.client.0.smithi031.stdout:8/632: dwrite d0/df/dd/d77/f92 [0,4194304] 0 2024-09-17T01:52:12.195 INFO:tasks.workunit.client.1.smithi092.stdout:9/577: fsync d0/df/f84 0 2024-09-17T01:52:12.198 INFO:tasks.workunit.client.0.smithi031.stdout:8/633: write d0/d5/fa [2605759,77158] 0 2024-09-17T01:52:12.199 INFO:tasks.workunit.client.1.smithi092.stdout:4/710: creat d4/d5/d1d/d30/d3f/fea x:0 0 0 2024-09-17T01:52:12.202 INFO:tasks.workunit.client.1.smithi092.stdout:7/550: write d3/db/d26/f80 [659186,101069] 0 2024-09-17T01:52:12.205 INFO:tasks.workunit.client.1.smithi092.stdout:1/668: rename db/d1d/d4b/d9a/cbc to db/d6c/db3/cd4 0 2024-09-17T01:52:12.208 INFO:tasks.workunit.client.1.smithi092.stdout:9/578: mkdir d0/d7c/da9 0 2024-09-17T01:52:12.211 INFO:tasks.workunit.client.1.smithi092.stdout:0/602: creat d3/d2e/d55/d63/d81/d9c/fbd x:0 0 0 2024-09-17T01:52:12.211 INFO:tasks.workunit.client.0.smithi031.stdout:6/897: dread d23/f5c [0,4194304] 0 2024-09-17T01:52:12.211 INFO:tasks.workunit.client.1.smithi092.stdout:8/457: truncate f1 2979165 0 2024-09-17T01:52:12.212 INFO:tasks.workunit.client.0.smithi031.stdout:6/898: write d23/d63/d47/df0/f10c [4598018,24311] 0 2024-09-17T01:52:12.212 INFO:tasks.workunit.client.1.smithi092.stdout:0/603: chown d3/d2e/d3b/d40/f53 308 1 2024-09-17T01:52:12.213 INFO:tasks.workunit.client.1.smithi092.stdout:7/551: mknod d3/d6/d13/d40/d60/cb9 0 2024-09-17T01:52:12.214 INFO:tasks.workunit.client.1.smithi092.stdout:1/669: mkdir db/d6c/d7a/dd5 0 2024-09-17T01:52:12.215 INFO:tasks.workunit.client.0.smithi031.stdout:6/899: creat d23/d63/d11b/f12a x:0 0 0 2024-09-17T01:52:12.216 INFO:tasks.workunit.client.0.smithi031.stdout:6/900: dread - d23/db4/d8a/f10d zero size 2024-09-17T01:52:12.216 INFO:tasks.workunit.client.1.smithi092.stdout:4/711: mknod d4/dbd/ceb 0 2024-09-17T01:52:12.218 INFO:tasks.workunit.client.1.smithi092.stdout:1/670: write db/d1d/d2e/d62/fc0 [1679182,63753] 0 2024-09-17T01:52:12.218 INFO:tasks.workunit.client.0.smithi031.stdout:6/901: symlink d23/d63/d47/d81/dee/l12b 0 2024-09-17T01:52:12.219 INFO:tasks.workunit.client.1.smithi092.stdout:1/671: stat db/d6c/d7a/dd5 0 2024-09-17T01:52:12.219 INFO:tasks.workunit.client.0.smithi031.stdout:6/902: chown d23/d63/d47/c61 221 1 2024-09-17T01:52:12.220 INFO:tasks.workunit.client.1.smithi092.stdout:7/552: write d3/d6/d13/d21/f38 [212199,28287] 0 2024-09-17T01:52:12.220 INFO:tasks.workunit.client.1.smithi092.stdout:3/561: getdents d4/d73/d8f/d92 0 2024-09-17T01:52:12.220 INFO:tasks.workunit.client.1.smithi092.stdout:0/604: dwrite d3/da/d1c/f43 [0,4194304] 0 2024-09-17T01:52:12.222 INFO:tasks.workunit.client.0.smithi031.stdout:6/903: creat d23/db4/d8a/dd5/ddd/f12c x:0 0 0 2024-09-17T01:52:12.222 INFO:tasks.workunit.client.1.smithi092.stdout:1/672: write db/d6c/d7e/d96/fb6 [34714,92003] 0 2024-09-17T01:52:12.234 INFO:tasks.workunit.client.0.smithi031.stdout:6/904: dwrite d23/d63/d47/fbf [0,4194304] 0 2024-09-17T01:52:12.236 INFO:tasks.workunit.client.0.smithi031.stdout:8/634: dwrite d0/df/d19/f90 [4194304,4194304] 0 2024-09-17T01:52:12.237 INFO:tasks.workunit.client.0.smithi031.stdout:6/905: chown d23/d63/d47/l97 1 1 2024-09-17T01:52:12.238 INFO:tasks.workunit.client.0.smithi031.stdout:8/635: readlink d0/d5/l8e 0 2024-09-17T01:52:12.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:11 smithi092 ceph-mon[33552]: pgmap v16: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 100 MiB/s rd, 331 MiB/s wr, 561 op/s 2024-09-17T01:52:12.239 INFO:tasks.workunit.client.0.smithi031.stdout:6/906: chown d23/db4/d64/d67 131147545 1 2024-09-17T01:52:12.239 INFO:tasks.workunit.client.0.smithi031.stdout:6/907: chown d23/d63/f104 1 1 2024-09-17T01:52:12.241 INFO:tasks.workunit.client.0.smithi031.stdout:8/636: mkdir d0/d5/d54/d60/dbb 0 2024-09-17T01:52:12.245 INFO:tasks.workunit.client.0.smithi031.stdout:6/908: creat d23/db4/d6a/d70/d74/f12d x:0 0 0 2024-09-17T01:52:12.249 INFO:tasks.workunit.client.0.smithi031.stdout:8/637: dread d0/df/d19/f33 [4194304,4194304] 0 2024-09-17T01:52:12.251 INFO:tasks.workunit.client.0.smithi031.stdout:6/909: dread d23/db4/d6a/d70/f7f [0,4194304] 0 2024-09-17T01:52:12.253 INFO:tasks.workunit.client.0.smithi031.stdout:6/910: write d23/db4/d6a/d70/db0/fd6 [511096,99277] 0 2024-09-17T01:52:12.255 INFO:tasks.workunit.client.0.smithi031.stdout:6/911: mkdir d23/db4/d64/dc1/d12e 0 2024-09-17T01:52:12.257 INFO:tasks.workunit.client.0.smithi031.stdout:6/912: creat d23/db4/d6a/dfa/f12f x:0 0 0 2024-09-17T01:52:12.260 INFO:tasks.workunit.client.0.smithi031.stdout:6/913: rename d23/db4/f8b to d23/db4/d6a/f130 0 2024-09-17T01:52:12.263 INFO:tasks.workunit.client.0.smithi031.stdout:6/914: getdents d23/dd1 0 2024-09-17T01:52:12.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:11 smithi031 ceph-mon[27673]: pgmap v16: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 100 MiB/s rd, 331 MiB/s wr, 561 op/s 2024-09-17T01:52:12.265 INFO:tasks.workunit.client.0.smithi031.stdout:6/915: creat d23/d63/d11b/d11d/f131 x:0 0 0 2024-09-17T01:52:12.270 INFO:tasks.workunit.client.0.smithi031.stdout:6/916: dwrite f1e [0,4194304] 0 2024-09-17T01:52:12.272 INFO:tasks.workunit.client.0.smithi031.stdout:6/917: write d23/db4/d8a/fcc [3846727,59920] 0 2024-09-17T01:52:12.275 INFO:tasks.workunit.client.0.smithi031.stdout:6/918: symlink d23/d63/d11b/l132 0 2024-09-17T01:52:12.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/919: symlink d23/db4/d8a/l133 0 2024-09-17T01:52:12.280 INFO:tasks.workunit.client.0.smithi031.stdout:6/920: dread - d23/db4/d6a/d70/db0/fc0 zero size 2024-09-17T01:52:12.280 INFO:tasks.workunit.client.0.smithi031.stdout:3/702: sync 2024-09-17T01:52:12.280 INFO:tasks.workunit.client.0.smithi031.stdout:1/746: sync 2024-09-17T01:52:12.281 INFO:tasks.workunit.client.0.smithi031.stdout:1/747: dread - d4/d1a/d43/d53/dd3/fe1 zero size 2024-09-17T01:52:12.284 INFO:tasks.workunit.client.1.smithi092.stdout:9/579: getdents d0/d7/d12/d34/d26/d54/d6b 0 2024-09-17T01:52:12.284 INFO:tasks.workunit.client.0.smithi031.stdout:6/921: symlink d23/db4/l134 0 2024-09-17T01:52:12.285 INFO:tasks.workunit.client.1.smithi092.stdout:0/605: write d3/d2e/d3b/d8f/fb6 [164875,87114] 0 2024-09-17T01:52:12.285 INFO:tasks.workunit.client.1.smithi092.stdout:6/471: sync 2024-09-17T01:52:12.285 INFO:tasks.workunit.client.0.smithi031.stdout:3/703: mkdir db/df/dc8/d6a/dc3/ddb 0 2024-09-17T01:52:12.286 INFO:tasks.workunit.client.1.smithi092.stdout:3/562: creat d4/d16/d1b/fbd x:0 0 0 2024-09-17T01:52:12.286 INFO:tasks.workunit.client.0.smithi031.stdout:1/748: mkdir d4/d1a/d43/d53/dd3/df7 0 2024-09-17T01:52:12.287 INFO:tasks.workunit.client.0.smithi031.stdout:3/704: rmdir db/d9b 39 2024-09-17T01:52:12.290 INFO:tasks.workunit.client.0.smithi031.stdout:6/922: creat d23/db4/d64/dc1/d12e/f135 x:0 0 0 2024-09-17T01:52:12.294 INFO:tasks.workunit.client.0.smithi031.stdout:3/705: mkdir db/df/dc8/d6a/dc3/ddb/ddc 0 2024-09-17T01:52:12.294 INFO:tasks.workunit.client.0.smithi031.stdout:3/706: stat db/df/f31 0 2024-09-17T01:52:12.295 INFO:tasks.workunit.client.0.smithi031.stdout:1/749: dwrite d4/d1e/f47 [0,4194304] 0 2024-09-17T01:52:12.295 INFO:tasks.workunit.client.1.smithi092.stdout:1/673: unlink db/d1d/fd0 0 2024-09-17T01:52:12.298 INFO:tasks.workunit.client.1.smithi092.stdout:7/553: rename d3/db/d26/d65/l89 to d3/d6/d13/d40/d61/lba 0 2024-09-17T01:52:12.300 INFO:tasks.workunit.client.1.smithi092.stdout:2/544: dread d10/d3a/f3f [0,4194304] 0 2024-09-17T01:52:12.301 INFO:tasks.workunit.client.0.smithi031.stdout:3/707: mkdir db/df/dc8/d6a/ddd 0 2024-09-17T01:52:12.301 INFO:tasks.workunit.client.1.smithi092.stdout:7/554: write d3/d6/d13/d21/d2e/d6e/f20 [4771881,25116] 0 2024-09-17T01:52:12.303 INFO:tasks.workunit.client.1.smithi092.stdout:0/606: creat d3/d2e/d3b/d72/fbe x:0 0 0 2024-09-17T01:52:12.307 INFO:tasks.workunit.client.1.smithi092.stdout:9/580: unlink d0/df/f27 0 2024-09-17T01:52:12.309 INFO:tasks.workunit.client.0.smithi031.stdout:2/760: sync 2024-09-17T01:52:12.309 INFO:tasks.workunit.client.0.smithi031.stdout:5/641: sync 2024-09-17T01:52:12.309 INFO:tasks.workunit.client.0.smithi031.stdout:0/766: sync 2024-09-17T01:52:12.309 INFO:tasks.workunit.client.0.smithi031.stdout:4/931: sync 2024-09-17T01:52:12.309 INFO:tasks.workunit.client.0.smithi031.stdout:7/758: sync 2024-09-17T01:52:12.309 INFO:tasks.workunit.client.0.smithi031.stdout:8/638: write d0/f99 [1982307,72110] 0 2024-09-17T01:52:12.310 INFO:tasks.workunit.client.0.smithi031.stdout:0/767: chown d0/d29/d33/d5/d48/d8c/de2 1648851 1 2024-09-17T01:52:12.310 INFO:tasks.workunit.client.1.smithi092.stdout:6/472: creat d3/d10/d8c/d43/d5e/d73/f90 x:0 0 0 2024-09-17T01:52:12.311 INFO:tasks.workunit.client.0.smithi031.stdout:3/708: read - db/df/d1d/d37/d65/fd9 zero size 2024-09-17T01:52:12.314 INFO:tasks.workunit.client.0.smithi031.stdout:5/642: creat da/d4b/d6c/fe1 x:0 0 0 2024-09-17T01:52:12.314 INFO:tasks.workunit.client.0.smithi031.stdout:9/675: sync 2024-09-17T01:52:12.315 INFO:tasks.workunit.client.0.smithi031.stdout:8/639: write d0/df/dd/f45 [2541423,119479] 0 2024-09-17T01:52:12.316 INFO:tasks.workunit.client.0.smithi031.stdout:7/759: chown db/d1c/de2/feb 31787 1 2024-09-17T01:52:12.318 INFO:tasks.workunit.client.0.smithi031.stdout:2/761: truncate d1/d3/df/d66/fd2 811810 0 2024-09-17T01:52:12.318 INFO:tasks.workunit.client.0.smithi031.stdout:5/643: write da/fb8 [204450,81064] 0 2024-09-17T01:52:12.318 INFO:tasks.workunit.client.1.smithi092.stdout:6/473: dwrite d3/d10/d8c/d43/d5e/d73/f90 [0,4194304] 0 2024-09-17T01:52:12.321 INFO:tasks.workunit.client.1.smithi092.stdout:2/545: truncate f5 1390563 0 2024-09-17T01:52:12.321 INFO:tasks.workunit.client.1.smithi092.stdout:8/458: truncate d15/d25/f5a 2038953 0 2024-09-17T01:52:12.322 INFO:tasks.workunit.client.1.smithi092.stdout:2/546: dread - d10/d5c/d81/f99 zero size 2024-09-17T01:52:12.323 INFO:tasks.workunit.client.0.smithi031.stdout:7/760: write db/d1c/d8e/da7/f86 [550056,75895] 0 2024-09-17T01:52:12.325 INFO:tasks.workunit.client.1.smithi092.stdout:8/459: dread - d15/d32/d3b/f8a zero size 2024-09-17T01:52:12.325 INFO:tasks.workunit.client.1.smithi092.stdout:7/555: symlink d3/d2b/d37/lbb 0 2024-09-17T01:52:12.326 INFO:tasks.workunit.client.1.smithi092.stdout:6/474: dread d3/d10/d1f/f32 [0,4194304] 0 2024-09-17T01:52:12.328 INFO:tasks.workunit.client.0.smithi031.stdout:7/761: write db/d1c/d41/d9a/fa9 [527254,56564] 0 2024-09-17T01:52:12.328 INFO:tasks.workunit.client.0.smithi031.stdout:0/768: creat d0/d29/d33/d5/d48/df1/f10a x:0 0 0 2024-09-17T01:52:12.333 INFO:tasks.workunit.client.0.smithi031.stdout:8/640: symlink d0/df/dd/da9/lbc 0 2024-09-17T01:52:12.335 INFO:tasks.workunit.client.1.smithi092.stdout:2/547: dread d10/d1d/d2c/f42 [0,4194304] 0 2024-09-17T01:52:12.335 INFO:tasks.workunit.client.0.smithi031.stdout:9/676: dread d3/d4/fb8 [0,4194304] 0 2024-09-17T01:52:12.336 INFO:tasks.workunit.client.0.smithi031.stdout:5/644: truncate da/d14/dac/d62/f6b 173471 0 2024-09-17T01:52:12.336 INFO:tasks.workunit.client.1.smithi092.stdout:8/460: dwrite d15/d32/d3b/d78/d7c/f84 [0,4194304] 0 2024-09-17T01:52:12.340 INFO:tasks.workunit.client.1.smithi092.stdout:1/674: dread db/d1d/d23/f89 [0,4194304] 0 2024-09-17T01:52:12.342 INFO:tasks.workunit.client.0.smithi031.stdout:6/923: dread f1c [0,4194304] 0 2024-09-17T01:52:12.342 INFO:tasks.workunit.client.1.smithi092.stdout:2/548: dread d10/d5c/f85 [0,4194304] 0 2024-09-17T01:52:12.343 INFO:tasks.workunit.client.1.smithi092.stdout:0/607: creat d3/d2e/d3b/d8f/fbf x:0 0 0 2024-09-17T01:52:12.343 INFO:tasks.workunit.client.1.smithi092.stdout:3/563: dwrite d4/f28 [0,4194304] 0 2024-09-17T01:52:12.344 INFO:tasks.workunit.client.1.smithi092.stdout:9/581: mkdir d0/d5/d3e/daa 0 2024-09-17T01:52:12.347 INFO:tasks.workunit.client.0.smithi031.stdout:5/645: creat da/d42/d12/d4a/fe2 x:0 0 0 2024-09-17T01:52:12.347 INFO:tasks.workunit.client.1.smithi092.stdout:2/549: read d10/d1d/d96/d77/f9b [782558,113252] 0 2024-09-17T01:52:12.347 INFO:tasks.workunit.client.1.smithi092.stdout:9/582: dread - d0/df/fa2 zero size 2024-09-17T01:52:12.348 INFO:tasks.workunit.client.1.smithi092.stdout:3/564: write d4/d16/d1b/fbd [400735,123339] 0 2024-09-17T01:52:12.348 INFO:tasks.workunit.client.0.smithi031.stdout:3/709: write db/f46 [1083427,5129] 0 2024-09-17T01:52:12.349 INFO:tasks.workunit.client.0.smithi031.stdout:0/769: rename d0/d29/d33/f28 to d0/d29/d33/d84/f10b 0 2024-09-17T01:52:12.352 INFO:tasks.workunit.client.1.smithi092.stdout:6/475: rename d3/d25/c78 to d3/c91 0 2024-09-17T01:52:12.353 INFO:tasks.workunit.client.0.smithi031.stdout:2/762: write d1/db6/fbd [2214247,92148] 0 2024-09-17T01:52:12.353 INFO:tasks.workunit.client.0.smithi031.stdout:9/677: write d3/fa3 [1714584,130374] 0 2024-09-17T01:52:12.355 INFO:tasks.workunit.client.1.smithi092.stdout:1/675: dwrite db/d3b/f48 [0,4194304] 0 2024-09-17T01:52:12.355 INFO:tasks.workunit.client.1.smithi092.stdout:3/565: chown d4/d2f/d44/l40 550 1 2024-09-17T01:52:12.355 INFO:tasks.workunit.client.1.smithi092.stdout:8/461: mkdir d15/d32/d40/d42/d43/d8d 0 2024-09-17T01:52:12.356 INFO:tasks.workunit.client.0.smithi031.stdout:4/932: truncate d8/d3a/d10a/d64/d4f/fc0 688790 0 2024-09-17T01:52:12.359 INFO:tasks.workunit.client.0.smithi031.stdout:1/750: dwrite d4/d1a/d2d/fa [4194304,4194304] 0 2024-09-17T01:52:12.360 INFO:tasks.workunit.client.1.smithi092.stdout:0/608: write d3/d2e/d3b/f94 [5131236,76559] 0 2024-09-17T01:52:12.360 INFO:tasks.workunit.client.1.smithi092.stdout:3/566: chown d4/d2f/f4f 70836787 1 2024-09-17T01:52:12.361 INFO:tasks.workunit.client.0.smithi031.stdout:6/924: dwrite d23/d63/d47/d81/fe3 [0,4194304] 0 2024-09-17T01:52:12.363 INFO:tasks.workunit.client.1.smithi092.stdout:2/550: write d10/d1d/d2c/f42 [1415773,65414] 0 2024-09-17T01:52:12.363 INFO:tasks.workunit.client.0.smithi031.stdout:7/762: getdents db/d1c 0 2024-09-17T01:52:12.367 INFO:tasks.workunit.client.1.smithi092.stdout:3/567: fdatasync d4/d13/d2e/d43/fa2 0 2024-09-17T01:52:12.367 INFO:tasks.workunit.client.1.smithi092.stdout:0/609: write d3/d73/f9d [3787300,130097] 0 2024-09-17T01:52:12.369 INFO:tasks.workunit.client.0.smithi031.stdout:4/933: chown d8/d3a/d10a/d64/d4d/fa4 15850762 1 2024-09-17T01:52:12.370 INFO:tasks.workunit.client.0.smithi031.stdout:6/925: read - d23/db4/d64/dc1/f123 zero size 2024-09-17T01:52:12.370 INFO:tasks.workunit.client.0.smithi031.stdout:8/641: link d0/l26 d0/d5/d54/lbd 0 2024-09-17T01:52:12.372 INFO:tasks.workunit.client.0.smithi031.stdout:0/770: read - d0/d29/d33/d2a/dde/fb0 zero size 2024-09-17T01:52:12.372 INFO:tasks.workunit.client.0.smithi031.stdout:5/646: creat da/d14/dac/d82/dc3/fe3 x:0 0 0 2024-09-17T01:52:12.374 INFO:tasks.workunit.client.0.smithi031.stdout:1/751: creat d4/d1e/d3f/d72/d7e/da2/ff8 x:0 0 0 2024-09-17T01:52:12.375 INFO:tasks.workunit.client.0.smithi031.stdout:3/710: rename db/df/f1e to db/df/d1d/d37/d4a/d97/dba/fde 0 2024-09-17T01:52:12.375 INFO:tasks.workunit.client.1.smithi092.stdout:8/462: dwrite d15/d25/f30 [0,4194304] 0 2024-09-17T01:52:12.376 INFO:tasks.workunit.client.1.smithi092.stdout:2/551: read d10/d1d/d2c/f6a [3650315,119247] 0 2024-09-17T01:52:12.377 INFO:tasks.workunit.client.0.smithi031.stdout:9/678: unlink d3/d4/d29/l52 0 2024-09-17T01:52:12.379 INFO:tasks.workunit.client.1.smithi092.stdout:9/583: unlink d0/d7/d12/d34/d26/d54/d6b/fa1 0 2024-09-17T01:52:12.380 INFO:tasks.workunit.client.0.smithi031.stdout:7/763: mknod db/d1c/d41/d6c/da0/dd4/cf0 0 2024-09-17T01:52:12.380 INFO:tasks.workunit.client.1.smithi092.stdout:1/676: dread db/d1d/d2e/d62/fbe [0,4194304] 0 2024-09-17T01:52:12.380 INFO:tasks.workunit.client.1.smithi092.stdout:8/463: write d15/d25/f30 [320985,35167] 0 2024-09-17T01:52:12.383 INFO:tasks.workunit.client.1.smithi092.stdout:3/568: mkdir d4/d73/dba/dbe 0 2024-09-17T01:52:12.384 INFO:tasks.workunit.client.0.smithi031.stdout:4/934: dwrite d8/d3a/d10a/d64/d4d/d5a/d79/f80 [0,4194304] 0 2024-09-17T01:52:12.385 INFO:tasks.workunit.client.0.smithi031.stdout:8/642: dwrite d0/df/d19/f27 [0,4194304] 0 2024-09-17T01:52:12.389 INFO:tasks.workunit.client.1.smithi092.stdout:7/556: truncate d3/db/f15 5696362 0 2024-09-17T01:52:12.390 INFO:tasks.workunit.client.1.smithi092.stdout:7/557: fdatasync d3/d2b/d3a/f6b 0 2024-09-17T01:52:12.392 INFO:tasks.workunit.client.1.smithi092.stdout:7/558: chown d3/d2b/d37/l49 25265 1 2024-09-17T01:52:12.393 INFO:tasks.workunit.client.1.smithi092.stdout:7/559: chown d3/d6/d13/d21/d2e/d6e/f86 29 1 2024-09-17T01:52:12.393 INFO:tasks.workunit.client.0.smithi031.stdout:0/771: unlink d0/d29/d33/d5/cf3 0 2024-09-17T01:52:12.395 INFO:tasks.workunit.client.0.smithi031.stdout:1/752: mkdir d4/d1e/d8d/df9 0 2024-09-17T01:52:12.395 INFO:tasks.workunit.client.0.smithi031.stdout:7/764: readlink db/l45 0 2024-09-17T01:52:12.400 INFO:tasks.workunit.client.0.smithi031.stdout:5/647: rename da/d14/dac/d62/fdf to da/d14/dac/d82/dc3/ddb/fe4 0 2024-09-17T01:52:12.401 INFO:tasks.workunit.client.0.smithi031.stdout:6/926: mknod d23/db4/c136 0 2024-09-17T01:52:12.402 INFO:tasks.workunit.client.0.smithi031.stdout:5/648: fdatasync da/dc/f3a 0 2024-09-17T01:52:12.405 INFO:tasks.workunit.client.0.smithi031.stdout:7/765: dwrite db/d1c/d41/f7e [0,4194304] 0 2024-09-17T01:52:12.406 INFO:tasks.workunit.client.0.smithi031.stdout:2/763: link d1/d3/d2d/db2/d1e/d21/c27 d1/d3/d45/c104 0 2024-09-17T01:52:12.406 INFO:tasks.workunit.client.0.smithi031.stdout:0/772: readlink d0/d29/da7/dbb/l101 0 2024-09-17T01:52:12.408 INFO:tasks.workunit.client.0.smithi031.stdout:7/766: fsync db/d1c/d41/d9a/fcd 0 2024-09-17T01:52:12.410 INFO:tasks.workunit.client.0.smithi031.stdout:0/773: write d0/d29/d33/d5/d48/d56/fea [1568223,51573] 0 2024-09-17T01:52:12.411 INFO:tasks.workunit.client.1.smithi092.stdout:0/610: creat d3/d2e/d55/d63/fc0 x:0 0 0 2024-09-17T01:52:12.411 INFO:tasks.workunit.client.1.smithi092.stdout:0/611: chown d3/c46 456588969 1 2024-09-17T01:52:12.412 INFO:tasks.workunit.client.1.smithi092.stdout:6/476: creat d3/d10/d1f/d21/d28/d2b/d48/f92 x:0 0 0 2024-09-17T01:52:12.414 INFO:tasks.workunit.client.0.smithi031.stdout:5/649: mknod da/d14/dac/d82/dc3/ddb/ce5 0 2024-09-17T01:52:12.415 INFO:tasks.workunit.client.1.smithi092.stdout:3/569: mkdir d4/d73/d8f/d92/dbf 0 2024-09-17T01:52:12.415 INFO:tasks.workunit.client.0.smithi031.stdout:6/927: truncate d23/db4/d64/d67/f7a 1367281 0 2024-09-17T01:52:12.418 INFO:tasks.workunit.client.1.smithi092.stdout:7/560: rename d3/d2b/d3a/f6b to d3/db/d7b/fbc 0 2024-09-17T01:52:12.421 INFO:tasks.workunit.client.1.smithi092.stdout:1/677: dwrite db/d1d/f22 [0,4194304] 0 2024-09-17T01:52:12.421 INFO:tasks.workunit.client.1.smithi092.stdout:1/678: fdatasync db/fd 0 2024-09-17T01:52:12.422 INFO:tasks.workunit.client.0.smithi031.stdout:1/753: creat d4/d1e/d3f/d4d/da5/ffa x:0 0 0 2024-09-17T01:52:12.423 INFO:tasks.workunit.client.1.smithi092.stdout:7/561: chown d3/db/d26/d83/da6/fb1 7 1 2024-09-17T01:52:12.423 INFO:tasks.workunit.client.1.smithi092.stdout:0/612: mkdir d3/d2e/d55/d63/dc1 0 2024-09-17T01:52:12.423 INFO:tasks.workunit.client.1.smithi092.stdout:2/552: mknod d10/d1d/d96/d77/d9c/dae/cb7 0 2024-09-17T01:52:12.424 INFO:tasks.workunit.client.0.smithi031.stdout:1/754: write d4/d1e/f88 [393091,66830] 0 2024-09-17T01:52:12.425 INFO:tasks.workunit.client.1.smithi092.stdout:0/613: stat d3/d2e/d3b/d72/d7a 0 2024-09-17T01:52:12.427 INFO:tasks.workunit.client.1.smithi092.stdout:6/477: creat d3/d10/d1f/d21/d1e/d55/f93 x:0 0 0 2024-09-17T01:52:12.427 INFO:tasks.workunit.client.0.smithi031.stdout:7/767: creat db/d1c/ff1 x:0 0 0 2024-09-17T01:52:12.428 INFO:tasks.workunit.client.1.smithi092.stdout:1/679: dread db/d1d/db5/f6b [0,4194304] 0 2024-09-17T01:52:12.429 INFO:tasks.workunit.client.0.smithi031.stdout:9/679: creat d3/d19/d1f/d44/fdb x:0 0 0 2024-09-17T01:52:12.430 INFO:tasks.workunit.client.0.smithi031.stdout:3/711: getdents db/df/dc8/d6a/dc3/ddb 0 2024-09-17T01:52:12.430 INFO:tasks.workunit.client.1.smithi092.stdout:2/553: mknod d10/d3a/d97/cb8 0 2024-09-17T01:52:12.431 INFO:tasks.workunit.client.0.smithi031.stdout:9/680: write d3/d4/da0/d71/f9e [1206343,57847] 0 2024-09-17T01:52:12.431 INFO:tasks.workunit.client.0.smithi031.stdout:5/650: creat da/d14/fe6 x:0 0 0 2024-09-17T01:52:12.432 INFO:tasks.workunit.client.1.smithi092.stdout:0/614: write d3/d2e/f5c [1910425,54086] 0 2024-09-17T01:52:12.435 INFO:tasks.workunit.client.1.smithi092.stdout:9/584: link d0/d7/d21/fa5 d0/d7/fab 0 2024-09-17T01:52:12.436 INFO:tasks.workunit.client.1.smithi092.stdout:7/562: mknod d3/d6/d13/db7/cbd 0 2024-09-17T01:52:12.438 INFO:tasks.workunit.client.0.smithi031.stdout:1/755: unlink d4/d1e/d3f/d72/d7e/d92/le8 0 2024-09-17T01:52:12.438 INFO:tasks.workunit.client.1.smithi092.stdout:1/680: rmdir db/d1d/d23/d88 39 2024-09-17T01:52:12.441 INFO:tasks.workunit.client.1.smithi092.stdout:3/570: mkdir d4/d20/d3f/dc0 0 2024-09-17T01:52:12.446 INFO:tasks.workunit.client.0.smithi031.stdout:4/935: dwrite d8/fad [0,4194304] 0 2024-09-17T01:52:12.449 INFO:tasks.workunit.client.1.smithi092.stdout:3/571: creat d4/d13/d2e/fc1 x:0 0 0 2024-09-17T01:52:12.450 INFO:tasks.workunit.client.1.smithi092.stdout:9/585: mknod d0/d5/cac 0 2024-09-17T01:52:12.451 INFO:tasks.workunit.client.0.smithi031.stdout:5/651: chown da/d42/d12/c48 4067444 1 2024-09-17T01:52:12.452 INFO:tasks.workunit.client.0.smithi031.stdout:3/712: truncate db/df/d1d/f7c 4183018 0 2024-09-17T01:52:12.453 INFO:tasks.workunit.client.0.smithi031.stdout:2/764: dwrite d1/d3/df/d11/d30/f37 [0,4194304] 0 2024-09-17T01:52:12.455 INFO:tasks.workunit.client.0.smithi031.stdout:0/774: write d0/d29/d33/d5/f98 [461654,71798] 0 2024-09-17T01:52:12.458 INFO:tasks.workunit.client.1.smithi092.stdout:3/572: rename d4/d16/l58 to d4/d13/d2e/d5f/d89/lc2 0 2024-09-17T01:52:12.459 INFO:tasks.workunit.client.1.smithi092.stdout:3/573: write d4/d16/d1b/fbd [484336,96331] 0 2024-09-17T01:52:12.461 INFO:tasks.workunit.client.0.smithi031.stdout:4/936: write d8/d3a/d7e/f114 [5035884,129637] 0 2024-09-17T01:52:12.461 INFO:tasks.workunit.client.1.smithi092.stdout:2/554: getdents d10/d5c 0 2024-09-17T01:52:12.462 INFO:tasks.workunit.client.1.smithi092.stdout:0/615: getdents d3/d2e/d55/d63/d81/d9c 0 2024-09-17T01:52:12.463 INFO:tasks.workunit.client.1.smithi092.stdout:2/555: chown d10/d3a/l89 434 1 2024-09-17T01:52:12.463 INFO:tasks.workunit.client.1.smithi092.stdout:0/616: dread - d3/d58/d8e/fa3 zero size 2024-09-17T01:52:12.464 INFO:tasks.workunit.client.1.smithi092.stdout:5/484: sync 2024-09-17T01:52:12.465 INFO:tasks.workunit.client.1.smithi092.stdout:5/485: dread - d0/de/d19/f89 zero size 2024-09-17T01:52:12.466 INFO:tasks.workunit.client.0.smithi031.stdout:5/652: mkdir da/d42/d12/d4a/dbf/de7 0 2024-09-17T01:52:12.468 INFO:tasks.workunit.client.0.smithi031.stdout:6/928: truncate d23/d63/d47/df0/f10c 2637126 0 2024-09-17T01:52:12.468 INFO:tasks.workunit.client.1.smithi092.stdout:0/617: symlink d3/d2e/d3b/d40/d7d/lc2 0 2024-09-17T01:52:12.469 INFO:tasks.workunit.client.0.smithi031.stdout:3/713: stat db/df/d1d/d37/d4a/c66 0 2024-09-17T01:52:12.471 INFO:tasks.workunit.client.0.smithi031.stdout:2/765: creat d1/d3/d2d/d91/f105 x:0 0 0 2024-09-17T01:52:12.471 INFO:tasks.workunit.client.1.smithi092.stdout:9/586: link d0/d7/d12/d34/d26/d54/f8b d0/d7/d12/d34/fad 0 2024-09-17T01:52:12.472 INFO:tasks.workunit.client.1.smithi092.stdout:1/681: dread db/d1d/d4b/d9a/fb1 [0,4194304] 0 2024-09-17T01:52:12.473 INFO:tasks.workunit.client.0.smithi031.stdout:2/766: write d1/d3/df/d11/d30/ddd/ff3 [87267,9080] 0 2024-09-17T01:52:12.474 INFO:tasks.workunit.client.1.smithi092.stdout:1/682: write db/d1d/f72 [163000,1268] 0 2024-09-17T01:52:12.475 INFO:tasks.workunit.client.1.smithi092.stdout:2/556: mkdir d10/db9 0 2024-09-17T01:52:12.477 INFO:tasks.workunit.client.1.smithi092.stdout:1/683: stat db/d1d/d23/f89 0 2024-09-17T01:52:12.477 INFO:tasks.workunit.client.1.smithi092.stdout:0/618: fdatasync d3/f28 0 2024-09-17T01:52:12.477 INFO:tasks.workunit.client.0.smithi031.stdout:6/929: mknod d23/dd1/c137 0 2024-09-17T01:52:12.480 INFO:tasks.workunit.client.1.smithi092.stdout:1/684: read - db/d1d/db5/fcf zero size 2024-09-17T01:52:12.482 INFO:tasks.workunit.client.0.smithi031.stdout:9/681: getdents d3/d4/d41 0 2024-09-17T01:52:12.483 INFO:tasks.workunit.client.1.smithi092.stdout:0/619: chown d3/d58/c71 0 1 2024-09-17T01:52:12.485 INFO:tasks.workunit.client.1.smithi092.stdout:8/464: write f1 [71460,86185] 0 2024-09-17T01:52:12.486 INFO:tasks.workunit.client.1.smithi092.stdout:9/587: dwrite d0/d7/d12/d86/d93/d96/f41 [4194304,4194304] 0 2024-09-17T01:52:12.489 INFO:tasks.workunit.client.0.smithi031.stdout:4/937: rename d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/c85 to d8/d3a/d10a/d64/d92/c12d 0 2024-09-17T01:52:12.490 INFO:tasks.workunit.client.0.smithi031.stdout:1/756: link d4/d1a/l28 d4/d1e/d40/ddb/lfb 0 2024-09-17T01:52:12.492 INFO:tasks.workunit.client.0.smithi031.stdout:3/714: write db/df/dc8/d6a/f8c [285871,6386] 0 2024-09-17T01:52:12.492 INFO:tasks.workunit.client.1.smithi092.stdout:3/574: dread d4/d20/d39/f7d [0,4194304] 0 2024-09-17T01:52:12.493 INFO:tasks.workunit.client.1.smithi092.stdout:2/557: dwrite d10/d1d/d24/d6e/f9d [0,4194304] 0 2024-09-17T01:52:12.494 INFO:tasks.workunit.client.0.smithi031.stdout:3/715: fdatasync db/d29/fab 0 2024-09-17T01:52:12.494 INFO:tasks.workunit.client.0.smithi031.stdout:6/930: mkdir d23/db4/d6a/d70/db0/d138 0 2024-09-17T01:52:12.498 INFO:tasks.workunit.client.1.smithi092.stdout:5/486: dread d0/de/d19/f6b [0,4194304] 0 2024-09-17T01:52:12.498 INFO:tasks.workunit.client.1.smithi092.stdout:8/465: mkdir d15/d32/d40/d4c/d8e 0 2024-09-17T01:52:12.499 INFO:tasks.workunit.client.0.smithi031.stdout:0/775: creat d0/d29/f10c x:0 0 0 2024-09-17T01:52:12.500 INFO:tasks.workunit.client.1.smithi092.stdout:6/478: write d3/d10/d8c/d43/d5e/f5f [254387,125023] 0 2024-09-17T01:52:12.500 INFO:tasks.workunit.client.0.smithi031.stdout:9/682: rename l0 to d3/d19/db5/ldc 0 2024-09-17T01:52:12.501 INFO:tasks.workunit.client.1.smithi092.stdout:0/620: creat d3/d2e/d3b/d8f/fc3 x:0 0 0 2024-09-17T01:52:12.504 INFO:tasks.workunit.client.1.smithi092.stdout:2/558: readlink d10/l49 0 2024-09-17T01:52:12.505 INFO:tasks.workunit.client.0.smithi031.stdout:5/653: link da/d42/d26/f39 da/d14/dac/fe8 0 2024-09-17T01:52:12.508 INFO:tasks.workunit.client.0.smithi031.stdout:2/767: truncate d1/d3/d45/d4a/fc0 2447840 0 2024-09-17T01:52:12.509 INFO:tasks.workunit.client.1.smithi092.stdout:7/563: dwrite d3/db/d26/f72 [0,4194304] 0 2024-09-17T01:52:12.509 INFO:tasks.workunit.client.1.smithi092.stdout:2/559: read d10/d55/f5b [734901,88131] 0 2024-09-17T01:52:12.510 INFO:tasks.workunit.client.0.smithi031.stdout:6/931: truncate d23/db4/d6a/d72/fce 4642860 0 2024-09-17T01:52:12.510 INFO:tasks.workunit.client.1.smithi092.stdout:0/621: write d3/da/d15/d30/fa9 [2700283,123366] 0 2024-09-17T01:52:12.510 INFO:tasks.workunit.client.0.smithi031.stdout:9/683: stat d3/d4/d41/d70/f84 0 2024-09-17T01:52:12.513 INFO:tasks.workunit.client.1.smithi092.stdout:6/479: creat d3/d10/d8c/d43/d5e/d73/f94 x:0 0 0 2024-09-17T01:52:12.516 INFO:tasks.workunit.client.0.smithi031.stdout:7/768: truncate db/d1c/d41/d9a/fb3 1316113 0 2024-09-17T01:52:12.516 INFO:tasks.workunit.client.1.smithi092.stdout:5/487: read d0/fc [1755192,45342] 0 2024-09-17T01:52:12.516 INFO:tasks.workunit.client.1.smithi092.stdout:7/564: dread - d3/d6/d13/d21/d2e/d6e/f99 zero size 2024-09-17T01:52:12.518 INFO:tasks.workunit.client.0.smithi031.stdout:2/768: rmdir d1/d3/d45 39 2024-09-17T01:52:12.519 INFO:tasks.workunit.client.1.smithi092.stdout:8/466: dread f1 [0,4194304] 0 2024-09-17T01:52:12.519 INFO:tasks.workunit.client.1.smithi092.stdout:6/480: truncate d3/d10/d1f/d21/f81 128148 0 2024-09-17T01:52:12.520 INFO:tasks.workunit.client.1.smithi092.stdout:0/622: mknod d3/da/d15/d30/cc4 0 2024-09-17T01:52:12.520 INFO:tasks.workunit.client.1.smithi092.stdout:3/575: getdents d4/d13/d2e/d6f 0 2024-09-17T01:52:12.522 INFO:tasks.workunit.client.1.smithi092.stdout:3/576: write d4/d2f/d44/fae [3757703,13259] 0 2024-09-17T01:52:12.522 INFO:tasks.workunit.client.1.smithi092.stdout:3/577: fdatasync d4/d20/f7c 0 2024-09-17T01:52:12.523 INFO:tasks.workunit.client.0.smithi031.stdout:1/757: write d4/d1e/d3f/d72/d7e/da2/fa4 [3674312,64964] 0 2024-09-17T01:52:12.524 INFO:tasks.workunit.client.1.smithi092.stdout:2/560: rename d10/d1d/d2c/f4d to d10/d1d/d24/fba 0 2024-09-17T01:52:12.525 INFO:tasks.workunit.client.0.smithi031.stdout:9/684: creat d3/d19/d80/fdd x:0 0 0 2024-09-17T01:52:12.525 INFO:tasks.workunit.client.1.smithi092.stdout:3/578: readlink d4/d20/d39/l5d 0 2024-09-17T01:52:12.528 INFO:tasks.workunit.client.1.smithi092.stdout:6/481: creat d3/d10/d8c/d43/d6a/d3d/f95 x:0 0 0 2024-09-17T01:52:12.528 INFO:tasks.workunit.client.0.smithi031.stdout:7/769: stat db/d1c/d46/d95/da6/fcc 0 2024-09-17T01:52:12.530 INFO:tasks.workunit.client.0.smithi031.stdout:4/938: dwrite d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/fb4 [0,4194304] 0 2024-09-17T01:52:12.530 INFO:tasks.workunit.client.1.smithi092.stdout:1/685: truncate db/d6c/d7e/d82/fae 162257 0 2024-09-17T01:52:12.530 INFO:tasks.workunit.client.0.smithi031.stdout:3/716: creat db/df/d1d/d37/fdf x:0 0 0 2024-09-17T01:52:12.532 INFO:tasks.workunit.client.1.smithi092.stdout:1/686: truncate db/d1d/d23/d55/fa9 150462 0 2024-09-17T01:52:12.533 INFO:tasks.workunit.client.0.smithi031.stdout:6/932: dwrite f5 [0,4194304] 0 2024-09-17T01:52:12.534 INFO:tasks.workunit.client.1.smithi092.stdout:5/488: rename d0/de/d19/d1a/d1e/d29/c47 to d0/d7e/c9c 0 2024-09-17T01:52:12.537 INFO:tasks.workunit.client.0.smithi031.stdout:5/654: creat da/d42/fe9 x:0 0 0 2024-09-17T01:52:12.538 INFO:tasks.workunit.client.0.smithi031.stdout:5/655: readlink da/d14/dac/d62/lda 0 2024-09-17T01:52:12.540 INFO:tasks.workunit.client.0.smithi031.stdout:2/769: creat d1/d3/df/d18/d40/d43/d100/f106 x:0 0 0 2024-09-17T01:52:12.541 INFO:tasks.workunit.client.0.smithi031.stdout:0/776: link d0/d29/d33/d84/f10b d0/d29/d33/d2a/dde/d9b/f10d 0 2024-09-17T01:52:12.542 INFO:tasks.workunit.client.1.smithi092.stdout:7/565: creat d3/fbe x:0 0 0 2024-09-17T01:52:12.542 INFO:tasks.workunit.client.0.smithi031.stdout:5/656: truncate da/d42/d26/f39 4285458 0 2024-09-17T01:52:12.545 INFO:tasks.workunit.client.1.smithi092.stdout:0/623: creat d3/da/d1c/fc5 x:0 0 0 2024-09-17T01:52:12.546 INFO:tasks.workunit.client.0.smithi031.stdout:1/758: mkdir d4/d1e/d8d/df9/dfc 0 2024-09-17T01:52:12.547 INFO:tasks.workunit.client.1.smithi092.stdout:6/482: symlink d3/d10/l96 0 2024-09-17T01:52:12.548 INFO:tasks.workunit.client.0.smithi031.stdout:8/643: sync 2024-09-17T01:52:12.551 INFO:tasks.workunit.client.1.smithi092.stdout:8/467: dwrite d15/d32/d3b/f5d [0,4194304] 0 2024-09-17T01:52:12.551 INFO:tasks.workunit.client.1.smithi092.stdout:5/489: mknod d0/de/d19/d1a/d1e/d3e/c9d 0 2024-09-17T01:52:12.553 INFO:tasks.workunit.client.0.smithi031.stdout:4/939: symlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/l12e 0 2024-09-17T01:52:12.553 INFO:tasks.workunit.client.0.smithi031.stdout:6/933: rmdir d23/db4/d8a/dd5/ddd/df6 39 2024-09-17T01:52:12.553 INFO:tasks.workunit.client.1.smithi092.stdout:7/566: creat d3/db/db2/fbf x:0 0 0 2024-09-17T01:52:12.555 INFO:tasks.workunit.client.1.smithi092.stdout:1/687: link db/l16 db/d1d/db5/ld6 0 2024-09-17T01:52:12.556 INFO:tasks.workunit.client.1.smithi092.stdout:3/579: write d4/d16/d1b/f47 [6318713,118952] 0 2024-09-17T01:52:12.557 INFO:tasks.workunit.client.1.smithi092.stdout:0/624: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:52:12.560 INFO:tasks.workunit.client.0.smithi031.stdout:7/770: dwrite db/d1c/f5c [0,4194304] 0 2024-09-17T01:52:12.560 INFO:tasks.workunit.client.0.smithi031.stdout:0/777: rmdir d0 39 2024-09-17T01:52:12.561 INFO:tasks.workunit.client.1.smithi092.stdout:6/483: write d3/d10/d8c/f24 [5476337,125451] 0 2024-09-17T01:52:12.563 INFO:tasks.workunit.client.0.smithi031.stdout:5/657: mknod da/d14/dac/d82/dc3/ddb/cea 0 2024-09-17T01:52:12.563 INFO:tasks.workunit.client.0.smithi031.stdout:2/770: dwrite d1/d3/df/d18/d40/d43/d100/f106 [0,4194304] 0 2024-09-17T01:52:12.564 INFO:tasks.workunit.client.1.smithi092.stdout:0/625: chown d3/da/d15/d30/cc4 1187178869 1 2024-09-17T01:52:12.566 INFO:tasks.workunit.client.0.smithi031.stdout:8/644: rename d0/df/c4d to d0/df/dd/d59/cbe 0 2024-09-17T01:52:12.567 INFO:tasks.workunit.client.1.smithi092.stdout:8/468: creat d15/d25/d27/d87/f8f x:0 0 0 2024-09-17T01:52:12.567 INFO:tasks.workunit.client.1.smithi092.stdout:7/567: symlink d3/d6/d13/d40/daf/lc0 0 2024-09-17T01:52:12.568 INFO:tasks.workunit.client.1.smithi092.stdout:6/484: read d3/d10/d1f/f59 [108664,53805] 0 2024-09-17T01:52:12.569 INFO:tasks.workunit.client.0.smithi031.stdout:5/658: write da/d4b/d6c/fd0 [208728,80468] 0 2024-09-17T01:52:12.570 INFO:tasks.workunit.client.0.smithi031.stdout:6/934: symlink d23/dd1/l139 0 2024-09-17T01:52:12.570 INFO:tasks.workunit.client.1.smithi092.stdout:0/626: write d3/da/d1c/f49 [929411,8058] 0 2024-09-17T01:52:12.570 INFO:tasks.workunit.client.0.smithi031.stdout:9/685: dwrite d3/d4/da0/f48 [0,4194304] 0 2024-09-17T01:52:12.573 INFO:tasks.workunit.client.0.smithi031.stdout:7/771: creat db/ff2 x:0 0 0 2024-09-17T01:52:12.575 INFO:tasks.workunit.client.0.smithi031.stdout:4/940: creat d8/d3a/d10a/d64/d4d/d5a/df1/f12f x:0 0 0 2024-09-17T01:52:12.577 INFO:tasks.workunit.client.0.smithi031.stdout:7/772: write db/d1c/d46/f8a [1899469,127709] 0 2024-09-17T01:52:12.578 INFO:tasks.workunit.client.1.smithi092.stdout:7/568: symlink d3/d6/d13/d40/lc1 0 2024-09-17T01:52:12.578 INFO:tasks.workunit.client.1.smithi092.stdout:3/580: dwrite d4/d20/d3f/f9c [0,4194304] 0 2024-09-17T01:52:12.579 INFO:tasks.workunit.client.1.smithi092.stdout:3/581: stat d4/d16 0 2024-09-17T01:52:12.581 INFO:tasks.workunit.client.0.smithi031.stdout:3/717: link db/df/f23 db/d9b/fe0 0 2024-09-17T01:52:12.581 INFO:tasks.workunit.client.0.smithi031.stdout:7/773: fdatasync db/d29/f2e 0 2024-09-17T01:52:12.582 INFO:tasks.workunit.client.1.smithi092.stdout:6/485: rename d3/f15 to d3/d10/d8c/d43/d6a/f97 0 2024-09-17T01:52:12.582 INFO:tasks.workunit.client.1.smithi092.stdout:8/469: truncate fa 4507419 0 2024-09-17T01:52:12.582 INFO:tasks.workunit.client.0.smithi031.stdout:4/941: rename d8/d3a/d7e/feb to d8/d3a/d10a/de6/f130 0 2024-09-17T01:52:12.585 INFO:tasks.workunit.client.0.smithi031.stdout:9/686: link d3/d4/f7f d3/d19/d1f/d44/d64/fde 0 2024-09-17T01:52:12.589 INFO:tasks.workunit.client.1.smithi092.stdout:6/486: truncate d3/d10/d8c/d43/d5e/d73/f94 394305 0 2024-09-17T01:52:12.590 INFO:tasks.workunit.client.0.smithi031.stdout:0/778: rename d0/d29/d33/d5b/f9f to d0/d29/d33/d5/d48/d56/dc8/f10e 0 2024-09-17T01:52:12.591 INFO:tasks.workunit.client.1.smithi092.stdout:7/569: mkdir d3/d6/dc2 0 2024-09-17T01:52:12.591 INFO:tasks.workunit.client.0.smithi031.stdout:3/718: truncate db/df/f90 892338 0 2024-09-17T01:52:12.591 INFO:tasks.workunit.client.1.smithi092.stdout:3/582: dread d4/f28 [0,4194304] 0 2024-09-17T01:52:12.593 INFO:tasks.workunit.client.1.smithi092.stdout:7/570: fdatasync d3/d6/d13/d21/d2e/d6e/f20 0 2024-09-17T01:52:12.593 INFO:tasks.workunit.client.0.smithi031.stdout:2/771: getdents d1/d3/df/d18/d40/db5 0 2024-09-17T01:52:12.594 INFO:tasks.workunit.client.1.smithi092.stdout:8/470: truncate d15/d32/d40/f7b 4100543 0 2024-09-17T01:52:12.597 INFO:tasks.workunit.client.0.smithi031.stdout:4/942: write d8/d3a/d10a/d64/d4d/d5a/d8c/d25/f11c [1027408,114133] 0 2024-09-17T01:52:12.598 INFO:tasks.workunit.client.1.smithi092.stdout:7/571: creat d3/d6/d13/d40/d61/fc3 x:0 0 0 2024-09-17T01:52:12.599 INFO:tasks.workunit.client.0.smithi031.stdout:7/774: creat db/d1c/de2/ff3 x:0 0 0 2024-09-17T01:52:12.601 INFO:tasks.workunit.client.0.smithi031.stdout:0/779: mkdir d0/d29/da7/d10f 0 2024-09-17T01:52:12.603 INFO:tasks.workunit.client.0.smithi031.stdout:9/687: creat d3/d4/da0/d36/d62/db2/dd4/fdf x:0 0 0 2024-09-17T01:52:12.605 INFO:tasks.workunit.client.1.smithi092.stdout:1/688: write db/d1d/d23/d55/f7b [241928,15010] 0 2024-09-17T01:52:12.606 INFO:tasks.workunit.client.1.smithi092.stdout:7/572: dread d3/d2b/d84/fab [0,4194304] 0 2024-09-17T01:52:12.608 INFO:tasks.workunit.client.0.smithi031.stdout:0/780: fdatasync d0/d29/d33/fc1 0 2024-09-17T01:52:12.609 INFO:tasks.workunit.client.1.smithi092.stdout:1/689: truncate db/d1d/d4b/d9a/fb1 254535 0 2024-09-17T01:52:12.610 INFO:tasks.workunit.client.0.smithi031.stdout:9/688: truncate d3/d4/da0/d36/fa2 196430 0 2024-09-17T01:52:12.610 INFO:tasks.workunit.client.0.smithi031.stdout:2/772: mkdir d1/d3/d2d/da6/d107 0 2024-09-17T01:52:12.610 INFO:tasks.workunit.client.0.smithi031.stdout:1/759: dwrite d4/d1e/d3f/d4d/da5/fc6 [0,4194304] 0 2024-09-17T01:52:12.610 INFO:tasks.workunit.client.1.smithi092.stdout:1/690: dread - db/d1d/d2e/fcd zero size 2024-09-17T01:52:12.611 INFO:tasks.workunit.client.1.smithi092.stdout:1/691: fdatasync db/d1d/d23/d85/f9b 0 2024-09-17T01:52:12.614 INFO:tasks.workunit.client.1.smithi092.stdout:1/692: symlink db/d6c/d7e/d82/ld7 0 2024-09-17T01:52:12.614 INFO:tasks.workunit.client.0.smithi031.stdout:4/943: creat d8/d3a/d10a/d64/d4d/d8f/f131 x:0 0 0 2024-09-17T01:52:12.614 INFO:tasks.workunit.client.0.smithi031.stdout:8/645: write d0/df/d19/f33 [1613141,108412] 0 2024-09-17T01:52:12.615 INFO:tasks.workunit.client.1.smithi092.stdout:7/573: link d3/d6/d13/d21/d2e/d6e/f53 d3/d6/d13/d21/d2e/d6e/fc4 0 2024-09-17T01:52:12.615 INFO:tasks.workunit.client.0.smithi031.stdout:5/659: write da/d42/d26/f34 [4850552,59584] 0 2024-09-17T01:52:12.619 INFO:tasks.workunit.client.0.smithi031.stdout:6/935: write f1c [840948,16476] 0 2024-09-17T01:52:12.619 INFO:tasks.workunit.client.0.smithi031.stdout:1/760: rmdir d4/d1e/d3f 39 2024-09-17T01:52:12.620 INFO:tasks.workunit.client.1.smithi092.stdout:1/693: dread db/d3b/fad [0,4194304] 0 2024-09-17T01:52:12.621 INFO:tasks.workunit.client.1.smithi092.stdout:7/574: mkdir d3/d6/dc2/dc5 0 2024-09-17T01:52:12.622 INFO:tasks.workunit.client.1.smithi092.stdout:1/694: write db/d1d/d2e/d62/fc0 [688901,85371] 0 2024-09-17T01:52:12.623 INFO:tasks.workunit.client.1.smithi092.stdout:0/627: truncate d3/f4 4049314 0 2024-09-17T01:52:12.624 INFO:tasks.workunit.client.0.smithi031.stdout:9/689: dwrite d3/d19/d1f/fa7 [0,4194304] 0 2024-09-17T01:52:12.625 INFO:tasks.workunit.client.1.smithi092.stdout:7/575: truncate d3/db/d98/fa9 261651 0 2024-09-17T01:52:12.628 INFO:tasks.workunit.client.1.smithi092.stdout:6/487: dread d3/fa [0,4194304] 0 2024-09-17T01:52:12.628 INFO:tasks.workunit.client.1.smithi092.stdout:0/628: creat d3/d2e/d3b/d48/fc6 x:0 0 0 2024-09-17T01:52:12.630 INFO:tasks.workunit.client.0.smithi031.stdout:6/936: creat d23/db4/d64/dc1/f13a x:0 0 0 2024-09-17T01:52:12.631 INFO:tasks.workunit.client.1.smithi092.stdout:1/695: rename db/d6c/lcb to db/d1d/d23/da1/dbf/ld8 0 2024-09-17T01:52:12.632 INFO:tasks.workunit.client.1.smithi092.stdout:7/576: creat d3/d6/da1/fc6 x:0 0 0 2024-09-17T01:52:12.633 INFO:tasks.workunit.client.1.smithi092.stdout:6/488: mknod d3/d10/d1f/d21/d28/d2b/d48/d18/c98 0 2024-09-17T01:52:12.637 INFO:tasks.workunit.client.0.smithi031.stdout:5/660: dwrite da/d4b/dce/fd9 [0,4194304] 0 2024-09-17T01:52:12.640 INFO:tasks.workunit.client.1.smithi092.stdout:4/712: sync 2024-09-17T01:52:12.640 INFO:tasks.workunit.client.0.smithi031.stdout:8/646: link d0/df/d19/f90 d0/d5/d54/fbf 0 2024-09-17T01:52:12.642 INFO:tasks.workunit.client.0.smithi031.stdout:4/944: write d8/d3a/d10a/d64/d4d/fa4 [597119,127326] 0 2024-09-17T01:52:12.644 INFO:tasks.workunit.client.0.smithi031.stdout:6/937: truncate f1a 4399396 0 2024-09-17T01:52:12.645 INFO:tasks.workunit.client.1.smithi092.stdout:4/713: mknod d4/d5/d8/d99/daf/cec 0 2024-09-17T01:52:12.647 INFO:tasks.workunit.client.0.smithi031.stdout:2/773: dwrite d1/d3/d2d/f8b [0,4194304] 0 2024-09-17T01:52:12.648 INFO:tasks.workunit.client.0.smithi031.stdout:5/661: creat da/dc/da2/feb x:0 0 0 2024-09-17T01:52:12.649 INFO:tasks.workunit.client.1.smithi092.stdout:6/489: rename d3/d10/d1f/d21/d28/d2b/f41 to d3/d10/d1f/d21/d28/f99 0 2024-09-17T01:52:12.649 INFO:tasks.workunit.client.1.smithi092.stdout:8/471: truncate d15/d32/d3b/d78/d7c/f84 870220 0 2024-09-17T01:52:12.654 INFO:tasks.workunit.client.1.smithi092.stdout:4/714: rename d4/d13/d3b/d42/d76/d41/l83 to d4/d5/d8/d99/dcf/led 0 2024-09-17T01:52:12.654 INFO:tasks.workunit.client.0.smithi031.stdout:8/647: mkdir d0/d5/d54/d60/dbb/dc0 0 2024-09-17T01:52:12.656 INFO:tasks.workunit.client.1.smithi092.stdout:6/490: rmdir d3/d10/d8c/d49 39 2024-09-17T01:52:12.656 INFO:tasks.workunit.client.0.smithi031.stdout:4/945: dread - d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/f10c zero size 2024-09-17T01:52:12.657 INFO:tasks.workunit.client.0.smithi031.stdout:5/662: readlink da/d42/d12/lcb 0 2024-09-17T01:52:12.659 INFO:tasks.workunit.client.0.smithi031.stdout:1/761: dread d4/d1e/f70 [0,4194304] 0 2024-09-17T01:52:12.659 INFO:tasks.workunit.client.0.smithi031.stdout:8/648: chown d0/d5/d6c/db0/db7/c95 2701431 1 2024-09-17T01:52:12.659 INFO:tasks.workunit.client.1.smithi092.stdout:8/472: unlink d15/d25/f29 0 2024-09-17T01:52:12.660 INFO:tasks.workunit.client.1.smithi092.stdout:4/715: chown d4/c22 23400298 1 2024-09-17T01:52:12.661 INFO:tasks.workunit.client.0.smithi031.stdout:2/774: link d1/d3/df/d11/d30/db1/fb7 d1/d3/d2d/d91/f108 0 2024-09-17T01:52:12.663 INFO:tasks.workunit.client.1.smithi092.stdout:6/491: readlink d3/d10/d8c/d43/d6a/l2a 0 2024-09-17T01:52:12.663 INFO:tasks.workunit.client.0.smithi031.stdout:1/762: symlink d4/d3d/de4/lfd 0 2024-09-17T01:52:12.665 INFO:tasks.workunit.client.1.smithi092.stdout:6/492: readlink d3/d10/l96 0 2024-09-17T01:52:12.665 INFO:tasks.workunit.client.0.smithi031.stdout:4/946: creat d8/d3a/d10a/d64/d4d/d5a/d79/f132 x:0 0 0 2024-09-17T01:52:12.666 INFO:tasks.workunit.client.1.smithi092.stdout:4/716: write d4/d5/d1d/d30/d3f/fea [361464,66705] 0 2024-09-17T01:52:12.666 INFO:tasks.workunit.client.0.smithi031.stdout:9/690: dread d3/d4/da0/f38 [0,4194304] 0 2024-09-17T01:52:12.666 INFO:tasks.workunit.client.0.smithi031.stdout:8/649: mknod d0/d5/d54/d60/dbb/cc1 0 2024-09-17T01:52:12.669 INFO:tasks.workunit.client.0.smithi031.stdout:6/938: link d23/db4/d6a/dac/f85 d23/db4/d6a/d70/db0/d138/f13b 0 2024-09-17T01:52:12.670 INFO:tasks.workunit.client.0.smithi031.stdout:8/650: rmdir d0/df/dd/d59 39 2024-09-17T01:52:12.670 INFO:tasks.workunit.client.1.smithi092.stdout:8/473: rename d15/d32/d40/f77 to d15/d32/d40/d42/d43/f90 0 2024-09-17T01:52:12.672 INFO:tasks.workunit.client.0.smithi031.stdout:9/691: unlink d3/d4/da0/d36/d99/db3/lcb 0 2024-09-17T01:52:12.673 INFO:tasks.workunit.client.1.smithi092.stdout:4/717: dwrite d4/d13/d3b/f47 [4194304,4194304] 0 2024-09-17T01:52:12.674 INFO:tasks.workunit.client.1.smithi092.stdout:4/718: write d4/d13/d3b/f78 [1391189,113956] 0 2024-09-17T01:52:12.675 INFO:tasks.workunit.client.1.smithi092.stdout:4/719: fdatasync d4/f8b 0 2024-09-17T01:52:12.676 INFO:tasks.workunit.client.0.smithi031.stdout:5/663: creat da/d14/dac/fec x:0 0 0 2024-09-17T01:52:12.677 INFO:tasks.workunit.client.0.smithi031.stdout:4/947: write d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fd4 [2266306,119535] 0 2024-09-17T01:52:12.678 INFO:tasks.workunit.client.1.smithi092.stdout:4/720: dread - d4/d13/d3b/fca zero size 2024-09-17T01:52:12.678 INFO:tasks.workunit.client.1.smithi092.stdout:7/577: truncate d3/d6/d13/d40/f55 3370677 0 2024-09-17T01:52:12.678 INFO:tasks.workunit.client.1.smithi092.stdout:1/696: dwrite db/f83 [0,4194304] 0 2024-09-17T01:52:12.681 INFO:tasks.workunit.client.0.smithi031.stdout:8/651: dwrite d0/df/dd/d77/f92 [0,4194304] 0 2024-09-17T01:52:12.681 INFO:tasks.workunit.client.0.smithi031.stdout:9/692: rename d3/d4/d29/fc9 to d3/d19/d1f/d44/d64/fe0 0 2024-09-17T01:52:12.682 INFO:tasks.workunit.client.0.smithi031.stdout:6/939: dread d23/db4/d6a/f114 [0,4194304] 0 2024-09-17T01:52:12.690 INFO:tasks.workunit.client.1.smithi092.stdout:1/697: unlink db/l3d 0 2024-09-17T01:52:12.691 INFO:tasks.workunit.client.1.smithi092.stdout:1/698: chown db/d1d/d23/d34/fb0 75 1 2024-09-17T01:52:12.692 INFO:tasks.workunit.client.1.smithi092.stdout:8/474: creat d15/d32/f91 x:0 0 0 2024-09-17T01:52:12.698 INFO:tasks.workunit.client.1.smithi092.stdout:4/721: write d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/f9e [3786093,6554] 0 2024-09-17T01:52:12.699 INFO:tasks.workunit.client.1.smithi092.stdout:4/722: chown d4/ce 704518 1 2024-09-17T01:52:12.701 INFO:tasks.workunit.client.1.smithi092.stdout:4/723: stat d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/ca8 0 2024-09-17T01:52:12.704 INFO:tasks.workunit.client.1.smithi092.stdout:7/578: creat d3/d6/fc7 x:0 0 0 2024-09-17T01:52:12.705 INFO:tasks.workunit.client.1.smithi092.stdout:7/579: chown d3/d6/d13/d21/d2e/d6e/f99 160 1 2024-09-17T01:52:12.706 INFO:tasks.workunit.client.1.smithi092.stdout:8/475: dread d15/d32/d40/d42/f45 [0,4194304] 0 2024-09-17T01:52:12.708 INFO:tasks.workunit.client.1.smithi092.stdout:1/699: creat db/d1d/d23/d88/fd9 x:0 0 0 2024-09-17T01:52:12.709 INFO:tasks.workunit.client.1.smithi092.stdout:4/724: creat d4/d13/d3b/fee x:0 0 0 2024-09-17T01:52:12.711 INFO:tasks.workunit.client.1.smithi092.stdout:7/580: mkdir d3/d6/d13/d40/d6a/dc8 0 2024-09-17T01:52:12.714 INFO:tasks.workunit.client.1.smithi092.stdout:1/700: mknod db/cda 0 2024-09-17T01:52:12.714 INFO:tasks.workunit.client.1.smithi092.stdout:6/493: truncate d3/d10/d1f/f52 226459 0 2024-09-17T01:52:12.717 INFO:tasks.workunit.client.1.smithi092.stdout:4/725: rename d4/d13/d20/l25 to d4/d13/d3b/lef 0 2024-09-17T01:52:12.718 INFO:tasks.workunit.client.1.smithi092.stdout:6/494: rename d3/d10/d8c to d3/d10/d8c/d43/d9a 22 2024-09-17T01:52:12.719 INFO:tasks.workunit.client.1.smithi092.stdout:4/726: read - d4/d5/d8/d99/daf/fce zero size 2024-09-17T01:52:12.719 INFO:tasks.workunit.client.1.smithi092.stdout:8/476: chown d15/d25/d27/d49 506697641 1 2024-09-17T01:52:12.720 INFO:tasks.workunit.client.1.smithi092.stdout:4/727: chown d4/d13/fb6 115874 1 2024-09-17T01:52:12.721 INFO:tasks.workunit.client.1.smithi092.stdout:4/728: write d4/d13/d20/f27 [1601222,19792] 0 2024-09-17T01:52:12.733 INFO:tasks.workunit.client.1.smithi092.stdout:1/701: truncate db/d1d/db5/f4e 1918065 0 2024-09-17T01:52:12.735 INFO:tasks.workunit.client.1.smithi092.stdout:4/729: truncate d4/d5/fb9 2428531 0 2024-09-17T01:52:12.739 INFO:tasks.workunit.client.1.smithi092.stdout:6/495: dwrite d3/d10/d1f/f32 [0,4194304] 0 2024-09-17T01:52:12.740 INFO:tasks.workunit.client.1.smithi092.stdout:1/702: fdatasync db/d1d/d23/d88/fc8 0 2024-09-17T01:52:12.741 INFO:tasks.workunit.client.1.smithi092.stdout:4/730: creat d4/d7b/ff0 x:0 0 0 2024-09-17T01:52:12.744 INFO:tasks.workunit.client.1.smithi092.stdout:6/496: chown d3/d25/f60 284156 1 2024-09-17T01:52:12.744 INFO:tasks.workunit.client.1.smithi092.stdout:8/477: dwrite d15/d25/f68 [0,4194304] 0 2024-09-17T01:52:12.746 INFO:tasks.workunit.client.1.smithi092.stdout:4/731: write d4/d7b/d7d/fbf [746463,12823] 0 2024-09-17T01:52:12.746 INFO:tasks.workunit.client.0.smithi031.stdout:5/664: mkdir da/ded 0 2024-09-17T01:52:12.747 INFO:tasks.workunit.client.0.smithi031.stdout:2/775: getdents d1/d3/d2d/d42 0 2024-09-17T01:52:12.749 INFO:tasks.workunit.client.0.smithi031.stdout:6/940: creat d23/db4/d64/d67/de9/f13c x:0 0 0 2024-09-17T01:52:12.751 INFO:tasks.workunit.client.1.smithi092.stdout:6/497: chown d3/d10/d1f/d21/d1e/d55/f5b 311685 1 2024-09-17T01:52:12.751 INFO:tasks.workunit.client.1.smithi092.stdout:1/703: mknod db/d6c/d7e/d82/cdb 0 2024-09-17T01:52:12.751 INFO:tasks.workunit.client.0.smithi031.stdout:4/948: truncate d8/d3a/d10a/d64/f2d 403656 0 2024-09-17T01:52:12.753 INFO:tasks.workunit.client.0.smithi031.stdout:5/665: stat da/d42/d12/f19 0 2024-09-17T01:52:12.754 INFO:tasks.workunit.client.0.smithi031.stdout:2/776: rmdir d1/d3/d2d/d91 39 2024-09-17T01:52:12.756 INFO:tasks.workunit.client.0.smithi031.stdout:6/941: mknod d23/db4/d64/d67/de9/c13d 0 2024-09-17T01:52:12.756 INFO:tasks.workunit.client.1.smithi092.stdout:6/498: mknod d3/d10/d8c/d43/d5e/d73/d8f/c9b 0 2024-09-17T01:52:12.760 INFO:tasks.workunit.client.0.smithi031.stdout:5/666: creat da/d42/d12/d64/fee x:0 0 0 2024-09-17T01:52:12.760 INFO:tasks.workunit.client.1.smithi092.stdout:8/478: rename d15/d25/d27/f41 to d15/d32/d40/d42/f92 0 2024-09-17T01:52:12.760 INFO:tasks.workunit.client.1.smithi092.stdout:4/732: dwrite d4/d5/d46/f50 [0,4194304] 0 2024-09-17T01:52:12.762 INFO:tasks.workunit.client.0.smithi031.stdout:5/667: symlink da/d4b/db4/lef 0 2024-09-17T01:52:12.764 INFO:tasks.workunit.client.1.smithi092.stdout:6/499: getdents d3/d10/d8c/d43/d6a/d3d/d72 0 2024-09-17T01:52:12.766 INFO:tasks.workunit.client.0.smithi031.stdout:5/668: symlink da/d14/dac/dc2/lf0 0 2024-09-17T01:52:12.767 INFO:tasks.workunit.client.1.smithi092.stdout:6/500: chown d3/l22 6513963 1 2024-09-17T01:52:12.769 INFO:tasks.workunit.client.0.smithi031.stdout:5/669: symlink da/d14/dac/d62/lf1 0 2024-09-17T01:52:12.770 INFO:tasks.workunit.client.1.smithi092.stdout:4/733: dwrite d4/d5/d46/f50 [0,4194304] 0 2024-09-17T01:52:12.771 INFO:tasks.workunit.client.0.smithi031.stdout:5/670: fsync da/f6f 0 2024-09-17T01:52:12.771 INFO:tasks.workunit.client.0.smithi031.stdout:6/942: dread d23/f5b [0,4194304] 0 2024-09-17T01:52:12.771 INFO:tasks.workunit.client.0.smithi031.stdout:5/671: fdatasync da/d42/d12/d72/fc8 0 2024-09-17T01:52:12.772 INFO:tasks.workunit.client.1.smithi092.stdout:6/501: rmdir d3/d10/d8c/d43/d6a/d3d 39 2024-09-17T01:52:12.773 INFO:tasks.workunit.client.1.smithi092.stdout:4/734: dread - d4/d13/d3b/fca zero size 2024-09-17T01:52:12.774 INFO:tasks.workunit.client.1.smithi092.stdout:8/479: dwrite d15/d32/d40/d42/f92 [0,4194304] 0 2024-09-17T01:52:12.776 INFO:tasks.workunit.client.0.smithi031.stdout:6/943: mkdir d23/d13e 0 2024-09-17T01:52:12.779 INFO:tasks.workunit.client.1.smithi092.stdout:1/704: dread db/fd [4194304,4194304] 0 2024-09-17T01:52:12.780 INFO:tasks.workunit.client.0.smithi031.stdout:6/944: unlink d23/db4/d6a/dac/lcb 0 2024-09-17T01:52:12.780 INFO:tasks.workunit.client.1.smithi092.stdout:6/502: rename d3/f13 to d3/d25/f9c 0 2024-09-17T01:52:12.781 INFO:tasks.workunit.client.1.smithi092.stdout:4/735: creat d4/d5/d1d/d30/d3f/d4b/ff1 x:0 0 0 2024-09-17T01:52:12.782 INFO:tasks.workunit.client.0.smithi031.stdout:6/945: mkdir d23/db4/d6a/dfa/d13f 0 2024-09-17T01:52:12.782 INFO:tasks.workunit.client.1.smithi092.stdout:4/736: chown d4/d5/d46/f50 120723451 1 2024-09-17T01:52:12.783 INFO:tasks.workunit.client.1.smithi092.stdout:1/705: mknod db/d1d/d23/d85/cdc 0 2024-09-17T01:52:12.785 INFO:tasks.workunit.client.1.smithi092.stdout:8/480: mkdir d15/d32/d40/d42/d93 0 2024-09-17T01:52:12.785 INFO:tasks.workunit.client.0.smithi031.stdout:6/946: rmdir d23/d63/d47/d81/dee 39 2024-09-17T01:52:12.786 INFO:tasks.workunit.client.0.smithi031.stdout:6/947: chown d23/fbb 371466 1 2024-09-17T01:52:12.786 INFO:tasks.workunit.client.1.smithi092.stdout:4/737: rmdir d4/d5/d8/d99 39 2024-09-17T01:52:12.788 INFO:tasks.workunit.client.1.smithi092.stdout:1/706: mknod db/d1d/d23/d55/cdd 0 2024-09-17T01:52:12.790 INFO:tasks.workunit.client.0.smithi031.stdout:6/948: creat d23/db4/d6a/d70/f140 x:0 0 0 2024-09-17T01:52:12.790 INFO:tasks.workunit.client.1.smithi092.stdout:8/481: unlink d15/d25/d27/d87/f8f 0 2024-09-17T01:52:12.793 INFO:tasks.workunit.client.0.smithi031.stdout:6/949: link d23/db4/d6a/d70/f140 d23/d63/d47/df0/f141 0 2024-09-17T01:52:12.793 INFO:tasks.workunit.client.0.smithi031.stdout:6/950: stat f5 0 2024-09-17T01:52:12.794 INFO:tasks.workunit.client.1.smithi092.stdout:1/707: creat db/d6c/db3/fde x:0 0 0 2024-09-17T01:52:12.799 INFO:tasks.workunit.client.0.smithi031.stdout:3/719: sync 2024-09-17T01:52:12.799 INFO:tasks.workunit.client.1.smithi092.stdout:4/738: dwrite d4/d5/d46/fe1 [0,4194304] 0 2024-09-17T01:52:12.800 INFO:tasks.workunit.client.0.smithi031.stdout:3/720: write db/df/d1d/d37/d77/f8b [2972117,73043] 0 2024-09-17T01:52:12.803 INFO:tasks.workunit.client.0.smithi031.stdout:3/721: chown db/df/d1d/d37/d6c/d96/lb8 644 1 2024-09-17T01:52:12.803 INFO:tasks.workunit.client.1.smithi092.stdout:6/503: dwrite f2 [0,4194304] 0 2024-09-17T01:52:12.804 INFO:tasks.workunit.client.1.smithi092.stdout:8/482: dread d15/f1d [0,4194304] 0 2024-09-17T01:52:12.806 INFO:tasks.workunit.client.1.smithi092.stdout:1/708: dwrite db/d3b/f48 [0,4194304] 0 2024-09-17T01:52:12.806 INFO:tasks.workunit.client.0.smithi031.stdout:8/652: write d0/df/f8a [263763,95250] 0 2024-09-17T01:52:12.810 INFO:tasks.workunit.client.0.smithi031.stdout:3/722: rename db/df/d1d/fd3 to db/df/d1d/d37/d77/dc2/fe1 0 2024-09-17T01:52:12.812 INFO:tasks.workunit.client.1.smithi092.stdout:4/739: dwrite d4/d5/f40 [0,4194304] 0 2024-09-17T01:52:12.815 INFO:tasks.workunit.client.1.smithi092.stdout:1/709: mknod db/d6c/d8b/cdf 0 2024-09-17T01:52:12.817 INFO:tasks.workunit.client.1.smithi092.stdout:8/483: truncate d15/d32/d40/d42/f5f 5162394 0 2024-09-17T01:52:12.817 INFO:tasks.workunit.client.1.smithi092.stdout:6/504: link d3/d10/d1f/d21/d28/l37 d3/d70/l9d 0 2024-09-17T01:52:12.818 INFO:tasks.workunit.client.0.smithi031.stdout:3/723: fsync db/df/d50/f8d 0 2024-09-17T01:52:12.819 INFO:tasks.workunit.client.1.smithi092.stdout:6/505: write d3/d10/d1f/d21/d28/f54 [3069363,39190] 0 2024-09-17T01:52:12.820 INFO:tasks.workunit.client.1.smithi092.stdout:6/506: chown d3/c4 56240 1 2024-09-17T01:52:12.822 INFO:tasks.workunit.client.1.smithi092.stdout:1/710: unlink db/d1d/d23/f5a 0 2024-09-17T01:52:12.824 INFO:tasks.workunit.client.0.smithi031.stdout:4/949: dwrite d8/d3a/d10a/d64/d4f/f56 [0,4194304] 0 2024-09-17T01:52:12.825 INFO:tasks.workunit.client.1.smithi092.stdout:1/711: truncate db/d1d/d23/d55/fa9 730536 0 2024-09-17T01:52:12.825 INFO:tasks.workunit.client.1.smithi092.stdout:4/740: rename d4/d13/d20/f27 to d4/d5/d1d/d30/ddd/ff2 0 2024-09-17T01:52:12.826 INFO:tasks.workunit.client.1.smithi092.stdout:1/712: fsync db/d1d/d23/d88/fc9 0 2024-09-17T01:52:12.826 INFO:tasks.workunit.client.1.smithi092.stdout:8/484: symlink d15/d25/d27/d6e/l94 0 2024-09-17T01:52:12.827 INFO:tasks.workunit.client.1.smithi092.stdout:4/741: write d4/d13/d3b/f78 [3423929,75264] 0 2024-09-17T01:52:12.828 INFO:tasks.workunit.client.0.smithi031.stdout:3/724: mkdir db/df/d50/de2 0 2024-09-17T01:52:12.828 INFO:tasks.workunit.client.1.smithi092.stdout:4/742: chown d4 24152038 1 2024-09-17T01:52:12.831 INFO:tasks.workunit.client.1.smithi092.stdout:4/743: write d4/d13/f8f [9417334,130252] 0 2024-09-17T01:52:12.831 INFO:tasks.workunit.client.0.smithi031.stdout:5/672: rmdir da/d14/dac 39 2024-09-17T01:52:12.834 INFO:tasks.workunit.client.0.smithi031.stdout:4/950: rename d8/d3a/d10a/d64/d4d/d5a/c6b to d8/d3a/d10a/d64/d92/c133 0 2024-09-17T01:52:12.835 INFO:tasks.workunit.client.0.smithi031.stdout:2/777: dwrite d1/d3/d45/d4a/fc0 [0,4194304] 0 2024-09-17T01:52:12.835 INFO:tasks.workunit.client.1.smithi092.stdout:1/713: symlink db/d1d/d23/da1/le0 0 2024-09-17T01:52:12.836 INFO:tasks.workunit.client.0.smithi031.stdout:3/725: mkdir db/df/d1d/d37/d77/de3 0 2024-09-17T01:52:12.837 INFO:tasks.workunit.client.1.smithi092.stdout:8/485: dwrite d15/d32/f50 [0,4194304] 0 2024-09-17T01:52:12.838 INFO:tasks.workunit.client.1.smithi092.stdout:8/486: read d15/f21 [791548,24840] 0 2024-09-17T01:52:12.840 INFO:tasks.workunit.client.0.smithi031.stdout:5/673: read da/dc/f16 [376303,24915] 0 2024-09-17T01:52:12.841 INFO:tasks.workunit.client.1.smithi092.stdout:6/507: link d3/fa d3/f9e 0 2024-09-17T01:52:12.842 INFO:tasks.workunit.client.0.smithi031.stdout:3/726: mkdir db/df/dc8/d6a/d83/de4 0 2024-09-17T01:52:12.843 INFO:tasks.workunit.client.1.smithi092.stdout:6/508: readlink d3/d10/l96 0 2024-09-17T01:52:12.845 INFO:tasks.workunit.client.0.smithi031.stdout:6/951: dwrite d23/db4/d6a/d70/db0/fc0 [0,4194304] 0 2024-09-17T01:52:12.845 INFO:tasks.workunit.client.0.smithi031.stdout:2/778: symlink d1/d3/df/d18/d40/dc1/l109 0 2024-09-17T01:52:12.846 INFO:tasks.workunit.client.1.smithi092.stdout:1/714: dwrite db/d1d/d2e/d62/fc0 [0,4194304] 0 2024-09-17T01:52:12.849 INFO:tasks.workunit.client.1.smithi092.stdout:6/509: fdatasync d3/f3a 0 2024-09-17T01:52:12.849 INFO:tasks.workunit.client.1.smithi092.stdout:1/715: chown db/f83 5161 1 2024-09-17T01:52:12.851 INFO:tasks.workunit.client.0.smithi031.stdout:5/674: chown da/d14/dac/l9b 48 1 2024-09-17T01:52:12.852 INFO:tasks.workunit.client.1.smithi092.stdout:8/487: dwrite d15/d32/d3b/f7e [0,4194304] 0 2024-09-17T01:52:12.855 INFO:tasks.workunit.client.1.smithi092.stdout:6/510: chown d3/d10/d1f/d21/d28/f54 48417000 1 2024-09-17T01:52:12.856 INFO:tasks.workunit.client.1.smithi092.stdout:8/488: mkdir d15/d25/d27/d6e/d95 0 2024-09-17T01:52:12.856 INFO:tasks.workunit.client.1.smithi092.stdout:1/716: read db/d3b/f54 [4190263,123952] 0 2024-09-17T01:52:12.858 INFO:tasks.workunit.client.1.smithi092.stdout:6/511: creat d3/f9f x:0 0 0 2024-09-17T01:52:12.858 INFO:tasks.workunit.client.0.smithi031.stdout:8/653: dread d0/d5/d54/d60/f80 [0,4194304] 0 2024-09-17T01:52:12.861 INFO:tasks.workunit.client.0.smithi031.stdout:5/675: rename da/d42/d12/d4a/dbf to da/d4b/d6c/df2 0 2024-09-17T01:52:12.861 INFO:tasks.workunit.client.1.smithi092.stdout:1/717: unlink db/d1d/d23/c31 0 2024-09-17T01:52:12.861 INFO:tasks.workunit.client.1.smithi092.stdout:1/718: stat db/d6c/d7a 0 2024-09-17T01:52:12.864 INFO:tasks.workunit.client.1.smithi092.stdout:1/719: creat db/d1d/db5/fe1 x:0 0 0 2024-09-17T01:52:12.867 INFO:tasks.workunit.client.1.smithi092.stdout:8/489: link d15/d32/d3b/f79 d15/d32/d40/f96 0 2024-09-17T01:52:12.870 INFO:tasks.workunit.client.0.smithi031.stdout:8/654: dwrite d0/df/d19/fba [0,4194304] 0 2024-09-17T01:52:12.872 INFO:tasks.workunit.client.0.smithi031.stdout:8/655: dread - d0/d5/fab zero size 2024-09-17T01:52:12.873 INFO:tasks.workunit.client.0.smithi031.stdout:5/676: dwrite da/d42/d12/f23 [0,4194304] 0 2024-09-17T01:52:12.873 INFO:tasks.workunit.client.1.smithi092.stdout:8/490: creat d15/d32/d40/d42/d93/f97 x:0 0 0 2024-09-17T01:52:12.876 INFO:tasks.workunit.client.1.smithi092.stdout:8/491: write d15/d32/d40/f96 [108010,111668] 0 2024-09-17T01:52:12.877 INFO:tasks.workunit.client.1.smithi092.stdout:8/492: dread - d15/d32/f91 zero size 2024-09-17T01:52:12.877 INFO:tasks.workunit.client.0.smithi031.stdout:8/656: truncate d0/d5/d54/d60/f57 1443385 0 2024-09-17T01:52:12.878 INFO:tasks.workunit.client.0.smithi031.stdout:5/677: write da/fa9 [833235,92389] 0 2024-09-17T01:52:12.883 INFO:tasks.workunit.client.0.smithi031.stdout:5/678: rename da/d4b/cd3 to da/d14/dac/d82/ddd/cf3 0 2024-09-17T01:52:12.884 INFO:tasks.workunit.client.1.smithi092.stdout:8/493: dwrite d15/d32/f50 [0,4194304] 0 2024-09-17T01:52:12.886 INFO:tasks.workunit.client.0.smithi031.stdout:5/679: creat da/d14/dac/d62/ff4 x:0 0 0 2024-09-17T01:52:12.888 INFO:tasks.workunit.client.1.smithi092.stdout:8/494: unlink d15/d32/d3b/c69 0 2024-09-17T01:52:12.892 INFO:tasks.workunit.client.1.smithi092.stdout:8/495: mkdir d15/d25/d27/d6e/d76/d83/d98 0 2024-09-17T01:52:12.893 INFO:tasks.workunit.client.1.smithi092.stdout:8/496: chown d15/d32/d3b/d78/f82 6 1 2024-09-17T01:52:12.895 INFO:tasks.workunit.client.0.smithi031.stdout:4/951: dread d8/fc [0,4194304] 0 2024-09-17T01:52:12.895 INFO:tasks.workunit.client.1.smithi092.stdout:8/497: rename d15/f6a to d15/d6f/d8b/f99 0 2024-09-17T01:52:12.896 INFO:tasks.workunit.client.0.smithi031.stdout:5/680: dread da/d42/d26/f75 [0,4194304] 0 2024-09-17T01:52:12.897 INFO:tasks.workunit.client.0.smithi031.stdout:4/952: stat d8/d3a/d10a/d64/d4d/d75/d11a/c5e 0 2024-09-17T01:52:12.898 INFO:tasks.workunit.client.1.smithi092.stdout:8/498: mkdir d15/d32/d3b/d78/d7c/d9a 0 2024-09-17T01:52:12.898 INFO:tasks.workunit.client.0.smithi031.stdout:5/681: chown da/d14/dac/d62/f78 80348992 1 2024-09-17T01:52:12.899 INFO:tasks.workunit.client.0.smithi031.stdout:5/682: truncate da/f6f 425033 0 2024-09-17T01:52:12.899 INFO:tasks.workunit.client.1.smithi092.stdout:8/499: mkdir d15/d32/d3b/d78/d9b 0 2024-09-17T01:52:12.901 INFO:tasks.workunit.client.1.smithi092.stdout:8/500: truncate d15/d32/d3b/d78/f82 1044398 0 2024-09-17T01:52:12.903 INFO:tasks.workunit.client.1.smithi092.stdout:8/501: creat d15/d25/d27/d49/f9c x:0 0 0 2024-09-17T01:52:12.904 INFO:tasks.workunit.client.0.smithi031.stdout:4/953: rename d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/f121 to d8/d3a/d10a/d64/d4d/d5a/d79/f134 0 2024-09-17T01:52:12.905 INFO:tasks.workunit.client.0.smithi031.stdout:4/954: readlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/l57 0 2024-09-17T01:52:12.908 INFO:tasks.workunit.client.0.smithi031.stdout:4/955: fdatasync d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/f8e 0 2024-09-17T01:52:12.909 INFO:tasks.workunit.client.1.smithi092.stdout:8/502: dwrite d15/d32/d40/d42/d93/f97 [0,4194304] 0 2024-09-17T01:52:12.912 INFO:tasks.workunit.client.1.smithi092.stdout:8/503: read d15/f1f [197636,126404] 0 2024-09-17T01:52:12.913 INFO:tasks.workunit.client.0.smithi031.stdout:4/956: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/f135 x:0 0 0 2024-09-17T01:52:12.917 INFO:tasks.workunit.client.0.smithi031.stdout:4/957: unlink d8/l59 0 2024-09-17T01:52:12.918 INFO:tasks.workunit.client.0.smithi031.stdout:2/779: write d1/d3/d2d/db2/d1e/d4f/d92/fef [650002,74780] 0 2024-09-17T01:52:12.920 INFO:tasks.workunit.client.1.smithi092.stdout:8/504: dwrite d15/f74 [0,4194304] 0 2024-09-17T01:52:12.920 INFO:tasks.workunit.client.0.smithi031.stdout:3/727: dwrite db/f19 [0,4194304] 0 2024-09-17T01:52:12.927 INFO:tasks.workunit.client.0.smithi031.stdout:5/683: fsync da/d42/d26/f39 0 2024-09-17T01:52:12.929 INFO:tasks.workunit.client.0.smithi031.stdout:4/958: mknod d8/d3a/d10a/d64/d4d/c136 0 2024-09-17T01:52:12.932 INFO:tasks.workunit.client.0.smithi031.stdout:5/684: write f5 [590246,55504] 0 2024-09-17T01:52:12.932 INFO:tasks.workunit.client.0.smithi031.stdout:5/685: chown da/d42 5 1 2024-09-17T01:52:12.932 INFO:tasks.workunit.client.0.smithi031.stdout:2/780: mknod d1/d3/df/d11/d30/da1/c10a 0 2024-09-17T01:52:12.933 INFO:tasks.workunit.client.0.smithi031.stdout:5/686: chown da/dc/fc9 203 1 2024-09-17T01:52:12.934 INFO:tasks.workunit.client.0.smithi031.stdout:4/959: symlink d8/d3a/d10a/d64/d4d/d5a/l137 0 2024-09-17T01:52:12.936 INFO:tasks.workunit.client.0.smithi031.stdout:5/687: symlink da/d42/d12/d72/lf5 0 2024-09-17T01:52:12.938 INFO:tasks.workunit.client.0.smithi031.stdout:3/728: dread db/d29/f2e [0,4194304] 0 2024-09-17T01:52:12.939 INFO:tasks.workunit.client.0.smithi031.stdout:4/960: creat d8/d3a/d10a/d64/d4d/dae/f138 x:0 0 0 2024-09-17T01:52:12.940 INFO:tasks.workunit.client.0.smithi031.stdout:5/688: chown da/l1e 34579 1 2024-09-17T01:52:12.941 INFO:tasks.workunit.client.0.smithi031.stdout:3/729: write db/da3/fbb [847332,55047] 0 2024-09-17T01:52:12.942 INFO:tasks.workunit.client.0.smithi031.stdout:2/781: dwrite d1/d3/d2d/db2/d1e/d21/f84 [0,4194304] 0 2024-09-17T01:52:12.942 INFO:tasks.workunit.client.0.smithi031.stdout:5/689: readlink da/d14/l33 0 2024-09-17T01:52:12.948 INFO:tasks.workunit.client.0.smithi031.stdout:5/690: dread - da/d42/d12/d72/fc8 zero size 2024-09-17T01:52:12.948 INFO:tasks.workunit.client.0.smithi031.stdout:2/782: mknod d1/c10b 0 2024-09-17T01:52:12.948 INFO:tasks.workunit.client.0.smithi031.stdout:3/730: creat db/df/dc8/d6a/dc3/ddb/fe5 x:0 0 0 2024-09-17T01:52:12.949 INFO:tasks.workunit.client.0.smithi031.stdout:5/691: dread - da/d14/dac/d82/dc3/ddb/fe4 zero size 2024-09-17T01:52:12.950 INFO:tasks.workunit.client.0.smithi031.stdout:4/961: mknod d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/d106/d123/c139 0 2024-09-17T01:52:12.955 INFO:tasks.workunit.client.0.smithi031.stdout:4/962: mkdir d8/d3a/d13a 0 2024-09-17T01:52:12.956 INFO:tasks.workunit.client.0.smithi031.stdout:5/692: dwrite da/d42/d12/d4a/fe2 [0,4194304] 0 2024-09-17T01:52:12.958 INFO:tasks.workunit.client.0.smithi031.stdout:5/693: stat da/d42/d12/c48 0 2024-09-17T01:52:12.962 INFO:tasks.workunit.client.0.smithi031.stdout:4/963: fdatasync d8/d3a/d10a/d64/f39 0 2024-09-17T01:52:12.968 INFO:tasks.workunit.client.0.smithi031.stdout:5/694: symlink da/d14/dac/d82/lf6 0 2024-09-17T01:52:12.968 INFO:tasks.workunit.client.0.smithi031.stdout:4/964: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/f13b x:0 0 0 2024-09-17T01:52:12.971 INFO:tasks.workunit.client.0.smithi031.stdout:2/783: chown d1/d3/d45/dfb 1 1 2024-09-17T01:52:12.971 INFO:tasks.workunit.client.0.smithi031.stdout:2/784: readlink d1/d3/d2d/db2/d1e/d4f/l64 0 2024-09-17T01:52:12.972 INFO:tasks.workunit.client.0.smithi031.stdout:3/731: write db/df/d1d/d37/d77/dc2/fb7 [157046,29560] 0 2024-09-17T01:52:12.975 INFO:tasks.workunit.client.0.smithi031.stdout:2/785: unlink d1/f5 0 2024-09-17T01:52:12.976 INFO:tasks.workunit.client.0.smithi031.stdout:7/775: sync 2024-09-17T01:52:12.978 INFO:tasks.workunit.client.0.smithi031.stdout:2/786: fdatasync d1/d3/d45/d4a/f57 0 2024-09-17T01:52:12.980 INFO:tasks.workunit.client.0.smithi031.stdout:5/695: truncate da/dc/f16 707250 0 2024-09-17T01:52:12.984 INFO:tasks.workunit.client.0.smithi031.stdout:3/732: rmdir db/df/d50/de2 0 2024-09-17T01:52:12.988 INFO:tasks.workunit.client.0.smithi031.stdout:2/787: rename d1/d3/d2d/db2/d1e/d4f/f9a to d1/d3/df/d18/d40/db5/f10c 0 2024-09-17T01:52:12.990 INFO:tasks.workunit.client.0.smithi031.stdout:3/733: creat db/df/d1d/d37/d4a/d97/dba/fe6 x:0 0 0 2024-09-17T01:52:12.995 INFO:tasks.workunit.client.1.smithi092.stdout:1/720: getdents db/d1d/db5 0 2024-09-17T01:52:12.995 INFO:tasks.workunit.client.0.smithi031.stdout:3/734: unlink db/d82/fd0 0 2024-09-17T01:52:12.997 INFO:tasks.workunit.client.1.smithi092.stdout:8/505: write d15/d25/d27/d49/f4a [1422072,17743] 0 2024-09-17T01:52:12.998 INFO:tasks.workunit.client.0.smithi031.stdout:7/776: dwrite db/d1c/f1d [4194304,4194304] 0 2024-09-17T01:52:13.001 INFO:tasks.workunit.client.1.smithi092.stdout:8/506: creat d15/d32/d3b/f9d x:0 0 0 2024-09-17T01:52:13.001 INFO:tasks.workunit.client.1.smithi092.stdout:6/512: dwrite d3/d25/f60 [0,4194304] 0 2024-09-17T01:52:13.003 INFO:tasks.workunit.client.1.smithi092.stdout:8/507: truncate d15/d32/d3b/f8a 564099 0 2024-09-17T01:52:13.003 INFO:tasks.workunit.client.0.smithi031.stdout:3/735: creat db/df/d1d/d37/d4a/fe7 x:0 0 0 2024-09-17T01:52:13.003 INFO:tasks.workunit.client.1.smithi092.stdout:6/513: chown d3/d10/d8c/d43/d6a/c1d 3 1 2024-09-17T01:52:13.004 INFO:tasks.workunit.client.0.smithi031.stdout:5/696: dread f4 [0,4194304] 0 2024-09-17T01:52:13.005 INFO:tasks.workunit.client.0.smithi031.stdout:7/777: mknod db/d1c/de2/cf4 0 2024-09-17T01:52:13.006 INFO:tasks.workunit.client.1.smithi092.stdout:1/721: chown db/d6c 592181549 1 2024-09-17T01:52:13.008 INFO:tasks.workunit.client.1.smithi092.stdout:8/508: mkdir d15/d32/d3b/d78/d9e 0 2024-09-17T01:52:13.008 INFO:tasks.workunit.client.0.smithi031.stdout:2/788: dread d1/d3/d2d/db2/d1e/d21/f90 [0,4194304] 0 2024-09-17T01:52:13.009 INFO:tasks.workunit.client.0.smithi031.stdout:5/697: creat da/d4b/d6c/df2/ff7 x:0 0 0 2024-09-17T01:52:13.010 INFO:tasks.workunit.client.1.smithi092.stdout:1/722: chown db/d6c/db3/fde 216 1 2024-09-17T01:52:13.011 INFO:tasks.workunit.client.0.smithi031.stdout:7/778: creat db/d29/ff5 x:0 0 0 2024-09-17T01:52:13.012 INFO:tasks.workunit.client.1.smithi092.stdout:6/514: readlink d3/d10/d8c/d43/d6a/d3d/d72/l83 0 2024-09-17T01:52:13.014 INFO:tasks.workunit.client.1.smithi092.stdout:6/515: truncate d3/d10/d1f/d21/d1e/d55/f93 794534 0 2024-09-17T01:52:13.015 INFO:tasks.workunit.client.1.smithi092.stdout:8/509: rename d15/d32/d40/d4c to d15/d25/d2b/d3d/d9f 0 2024-09-17T01:52:13.015 INFO:tasks.workunit.client.0.smithi031.stdout:3/736: rename db/df/dc8/c24 to db/df/dc8/ce8 0 2024-09-17T01:52:13.017 INFO:tasks.workunit.client.1.smithi092.stdout:1/723: creat db/d1d/d23/da1/dc3/fe2 x:0 0 0 2024-09-17T01:52:13.019 INFO:tasks.workunit.client.0.smithi031.stdout:2/789: dread d1/d3/d2d/d91/f108 [0,4194304] 0 2024-09-17T01:52:13.020 INFO:tasks.workunit.client.0.smithi031.stdout:3/737: symlink db/df/dc8/d6a/dc3/ddb/le9 0 2024-09-17T01:52:13.025 INFO:tasks.workunit.client.1.smithi092.stdout:8/510: write d15/d32/d40/d42/f4b [69409,113511] 0 2024-09-17T01:52:13.028 INFO:tasks.workunit.client.0.smithi031.stdout:2/790: readlink d1/d3/d2d/da6/de9/lf2 0 2024-09-17T01:52:13.028 INFO:tasks.workunit.client.1.smithi092.stdout:8/511: mkdir d15/d32/d3b/d78/d9e/da0 0 2024-09-17T01:52:13.028 INFO:tasks.workunit.client.0.smithi031.stdout:3/738: symlink db/df/dc8/d6a/dc3/ddb/ddc/lea 0 2024-09-17T01:52:13.029 INFO:tasks.workunit.client.1.smithi092.stdout:8/512: readlink d15/d25/d2b/d3d/l6c 0 2024-09-17T01:52:13.031 INFO:tasks.workunit.client.0.smithi031.stdout:2/791: creat d1/d3/d45/d4a/f10d x:0 0 0 2024-09-17T01:52:13.035 INFO:tasks.workunit.client.0.smithi031.stdout:5/698: dread da/d14/dac/d82/f8b [0,4194304] 0 2024-09-17T01:52:13.035 INFO:tasks.workunit.client.0.smithi031.stdout:5/699: stat da/d14 0 2024-09-17T01:52:13.035 INFO:tasks.workunit.client.0.smithi031.stdout:3/739: fsync db/df/f39 0 2024-09-17T01:52:13.037 INFO:tasks.workunit.client.1.smithi092.stdout:6/516: dread d3/d25/f9c [0,4194304] 0 2024-09-17T01:52:13.037 INFO:tasks.workunit.client.0.smithi031.stdout:3/740: write db/df/d50/fa0 [41596,26241] 0 2024-09-17T01:52:13.038 INFO:tasks.workunit.client.1.smithi092.stdout:6/517: chown d3/d10/d1f/d21/d1e 0 1 2024-09-17T01:52:13.038 INFO:tasks.workunit.client.1.smithi092.stdout:8/513: dwrite d15/d32/d40/d42/f45 [0,4194304] 0 2024-09-17T01:52:13.042 INFO:tasks.workunit.client.1.smithi092.stdout:6/518: mkdir d3/d10/d8c/d43/d5e/da0 0 2024-09-17T01:52:13.042 INFO:tasks.workunit.client.0.smithi031.stdout:3/741: unlink db/df/d1d/d37/d77/lbd 0 2024-09-17T01:52:13.043 INFO:tasks.workunit.client.1.smithi092.stdout:6/519: write d3/f8 [256183,88189] 0 2024-09-17T01:52:13.044 INFO:tasks.workunit.client.0.smithi031.stdout:7/779: truncate db/d18/fa4 1908364 0 2024-09-17T01:52:13.045 INFO:tasks.workunit.client.1.smithi092.stdout:8/514: getdents d15/d25/d27/d6e 0 2024-09-17T01:52:13.045 INFO:tasks.workunit.client.0.smithi031.stdout:5/700: dread da/d42/f5c [0,4194304] 0 2024-09-17T01:52:13.046 INFO:tasks.workunit.client.0.smithi031.stdout:5/701: dread - da/d42/fe9 zero size 2024-09-17T01:52:13.047 INFO:tasks.workunit.client.0.smithi031.stdout:5/702: write da/d42/fd8 [792872,27691] 0 2024-09-17T01:52:13.047 INFO:tasks.workunit.client.0.smithi031.stdout:2/792: rename d1/d3/d2d/db2/d1e/d21/d34/d8a/cd6 to d1/d3/d2d/d42/c10e 0 2024-09-17T01:52:13.049 INFO:tasks.workunit.client.0.smithi031.stdout:5/703: chown da/d4b/dce/ld5 1 1 2024-09-17T01:52:13.049 INFO:tasks.workunit.client.0.smithi031.stdout:2/793: chown d1/d3/df/d18/d9f/fc2 3536135 1 2024-09-17T01:52:13.050 INFO:tasks.workunit.client.0.smithi031.stdout:3/742: mkdir db/df/dc8/deb 0 2024-09-17T01:52:13.050 INFO:tasks.workunit.client.0.smithi031.stdout:5/704: chown da/dc/d98 141175 1 2024-09-17T01:52:13.050 INFO:tasks.workunit.client.0.smithi031.stdout:7/780: symlink db/d1c/de2/lf6 0 2024-09-17T01:52:13.050 INFO:tasks.workunit.client.1.smithi092.stdout:8/515: rename d15/d32/d3b/d78/d7c to d15/d32/d3b/d78/d9b/da1 0 2024-09-17T01:52:13.051 INFO:tasks.workunit.client.1.smithi092.stdout:6/520: dwrite d3/d10/d1f/d21/d28/d2b/d48/d18/f6b [0,4194304] 0 2024-09-17T01:52:13.051 INFO:tasks.workunit.client.1.smithi092.stdout:8/516: chown d15/d32/d40/d42/f45 57494372 1 2024-09-17T01:52:13.053 INFO:tasks.workunit.client.1.smithi092.stdout:6/521: truncate d3/d10/d1f/f59 1483511 0 2024-09-17T01:52:13.053 INFO:tasks.workunit.client.0.smithi031.stdout:5/705: mkdir da/dc/df8 0 2024-09-17T01:52:13.054 INFO:tasks.workunit.client.0.smithi031.stdout:3/743: truncate db/df/d1d/d37/fdf 534266 0 2024-09-17T01:52:13.054 INFO:tasks.workunit.client.1.smithi092.stdout:8/517: creat d15/d32/d40/d42/d6b/fa2 x:0 0 0 2024-09-17T01:52:13.055 INFO:tasks.workunit.client.0.smithi031.stdout:2/794: creat d1/d3/f10f x:0 0 0 2024-09-17T01:52:13.058 INFO:tasks.workunit.client.1.smithi092.stdout:8/518: symlink d15/d25/d2b/d3d/d9f/d8e/la3 0 2024-09-17T01:52:13.060 INFO:tasks.workunit.client.1.smithi092.stdout:8/519: fsync f7 0 2024-09-17T01:52:13.061 INFO:tasks.workunit.client.0.smithi031.stdout:3/744: write db/df/d1d/d37/d77/dc2/fa2 [1651093,40873] 0 2024-09-17T01:52:13.064 INFO:tasks.workunit.client.0.smithi031.stdout:7/781: dwrite db/d18/d67/dac/ddd/dc1/fcb [0,4194304] 0 2024-09-17T01:52:13.077 INFO:tasks.workunit.client.0.smithi031.stdout:5/706: dwrite da/d42/f9d [0,4194304] 0 2024-09-17T01:52:13.081 INFO:tasks.workunit.client.0.smithi031.stdout:2/795: dwrite d1/d3/d2d/db2/d1e/d21/f90 [0,4194304] 0 2024-09-17T01:52:13.099 INFO:tasks.workunit.client.0.smithi031.stdout:5/707: dread da/d14/dac/d82/dc3/fc6 [0,4194304] 0 2024-09-17T01:52:13.100 INFO:tasks.workunit.client.0.smithi031.stdout:5/708: chown da/dc/la3 311068 1 2024-09-17T01:52:13.104 INFO:tasks.workunit.client.0.smithi031.stdout:3/745: dread db/df/d1d/d37/d6c/f71 [0,4194304] 0 2024-09-17T01:52:13.107 INFO:tasks.workunit.client.0.smithi031.stdout:7/782: dread db/d1c/d41/f4b [0,4194304] 0 2024-09-17T01:52:13.107 INFO:tasks.workunit.client.0.smithi031.stdout:2/796: readlink d1/d3/d2d/l51 0 2024-09-17T01:52:13.109 INFO:tasks.workunit.client.0.smithi031.stdout:5/709: dread da/d42/d12/f41 [0,4194304] 0 2024-09-17T01:52:13.111 INFO:tasks.workunit.client.0.smithi031.stdout:5/710: write da/f49 [1510723,26132] 0 2024-09-17T01:52:13.112 INFO:tasks.workunit.client.0.smithi031.stdout:7/783: creat db/d1c/d41/d6c/da0/dd4/ff7 x:0 0 0 2024-09-17T01:52:13.118 INFO:tasks.workunit.client.0.smithi031.stdout:5/711: truncate da/d14/dac/d82/fd2 926762 0 2024-09-17T01:52:13.120 INFO:tasks.workunit.client.0.smithi031.stdout:1/763: sync 2024-09-17T01:52:13.120 INFO:tasks.workunit.client.0.smithi031.stdout:0/781: sync 2024-09-17T01:52:13.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/797: rename d1/d3/d2d/db2/d1e/d4f/d92/l9e to d1/d3/d45/d4a/d96/l110 0 2024-09-17T01:52:13.122 INFO:tasks.workunit.client.0.smithi031.stdout:5/712: truncate da/d42/d12/d64/f70 609057 0 2024-09-17T01:52:13.123 INFO:tasks.workunit.client.0.smithi031.stdout:7/784: dwrite db/d1c/f63 [0,4194304] 0 2024-09-17T01:52:13.124 INFO:tasks.workunit.client.0.smithi031.stdout:5/713: chown da/d14/dac/cd6 88318 1 2024-09-17T01:52:13.125 INFO:tasks.workunit.client.0.smithi031.stdout:2/798: unlink d1/d3/f7 0 2024-09-17T01:52:13.129 INFO:tasks.workunit.client.0.smithi031.stdout:1/764: mkdir d4/d1e/d40/daa/dce/dfe 0 2024-09-17T01:52:13.131 INFO:tasks.workunit.client.0.smithi031.stdout:1/765: chown d4/d1a/d43/cd5 1342010967 1 2024-09-17T01:52:13.135 INFO:tasks.workunit.client.0.smithi031.stdout:2/799: dwrite d1/d3/d2d/d91/f105 [0,4194304] 0 2024-09-17T01:52:13.135 INFO:tasks.workunit.client.0.smithi031.stdout:5/714: write da/d42/d12/d72/f97 [940296,3238] 0 2024-09-17T01:52:13.138 INFO:tasks.workunit.client.0.smithi031.stdout:5/715: write da/d42/d12/d72/fc8 [564811,93182] 0 2024-09-17T01:52:13.145 INFO:tasks.workunit.client.0.smithi031.stdout:2/800: dread d1/d3/df/f8d [0,4194304] 0 2024-09-17T01:52:13.145 INFO:tasks.workunit.client.0.smithi031.stdout:1/766: rmdir d4/d1e/d3f/d4d 39 2024-09-17T01:52:13.148 INFO:tasks.workunit.client.0.smithi031.stdout:7/785: truncate db/d18/f2f 3903556 0 2024-09-17T01:52:13.151 INFO:tasks.workunit.client.0.smithi031.stdout:5/716: creat da/ded/ff9 x:0 0 0 2024-09-17T01:52:13.153 INFO:tasks.workunit.client.0.smithi031.stdout:5/717: chown da/d4b/f65 52 1 2024-09-17T01:52:13.153 INFO:tasks.workunit.client.0.smithi031.stdout:2/801: dwrite d1/d3/d2d/db2/f63 [0,4194304] 0 2024-09-17T01:52:13.155 INFO:tasks.workunit.client.0.smithi031.stdout:7/786: dread db/d29/f58 [0,4194304] 0 2024-09-17T01:52:13.156 INFO:tasks.workunit.client.0.smithi031.stdout:5/718: write da/d14/dac/d82/fd2 [714152,13091] 0 2024-09-17T01:52:13.160 INFO:tasks.workunit.client.0.smithi031.stdout:5/719: readlink da/dc/lb6 0 2024-09-17T01:52:13.163 INFO:tasks.workunit.client.0.smithi031.stdout:2/802: dwrite d1/d3/df/d18/f3b [0,4194304] 0 2024-09-17T01:52:13.165 INFO:tasks.workunit.client.0.smithi031.stdout:7/787: dread db/d1c/d46/f4f [0,4194304] 0 2024-09-17T01:52:13.167 INFO:tasks.workunit.client.0.smithi031.stdout:5/720: rename da/d14/dac/d62/cb5 to da/d42/d26/cfa 0 2024-09-17T01:52:13.172 INFO:tasks.workunit.client.0.smithi031.stdout:7/788: write db/d1c/d46/d95/fc5 [89312,29995] 0 2024-09-17T01:52:13.173 INFO:tasks.workunit.client.0.smithi031.stdout:5/721: mknod da/dc/d25/cfb 0 2024-09-17T01:52:13.175 INFO:tasks.workunit.client.0.smithi031.stdout:3/746: dwrite db/df/d1d/d37/d77/dc2/fb7 [0,4194304] 0 2024-09-17T01:52:13.175 INFO:tasks.workunit.client.0.smithi031.stdout:2/803: rename d1/d3/d2d/d91/feb to d1/d3/d2d/d91/dad/f111 0 2024-09-17T01:52:13.176 INFO:tasks.workunit.client.0.smithi031.stdout:8/657: sync 2024-09-17T01:52:13.176 INFO:tasks.workunit.client.0.smithi031.stdout:4/965: sync 2024-09-17T01:52:13.176 INFO:tasks.workunit.client.0.smithi031.stdout:9/693: sync 2024-09-17T01:52:13.177 INFO:tasks.workunit.client.0.smithi031.stdout:6/952: sync 2024-09-17T01:52:13.177 INFO:tasks.workunit.client.0.smithi031.stdout:0/782: write d0/f99 [1136630,56591] 0 2024-09-17T01:52:13.180 INFO:tasks.workunit.client.0.smithi031.stdout:7/789: creat db/ff8 x:0 0 0 2024-09-17T01:52:13.184 INFO:tasks.workunit.client.0.smithi031.stdout:5/722: creat da/d42/d12/d64/ffc x:0 0 0 2024-09-17T01:52:13.188 INFO:tasks.workunit.client.0.smithi031.stdout:5/723: truncate da/d42/d26/f9f 5103455 0 2024-09-17T01:52:13.188 INFO:tasks.workunit.client.0.smithi031.stdout:1/767: truncate d4/d3d/d65/f75 1023859 0 2024-09-17T01:52:13.192 INFO:tasks.workunit.client.0.smithi031.stdout:2/804: dwrite d1/d3/d2d/db2/f28 [0,4194304] 0 2024-09-17T01:52:13.193 INFO:tasks.workunit.client.0.smithi031.stdout:8/658: chown d0/d5/f87 27 1 2024-09-17T01:52:13.198 INFO:tasks.workunit.client.0.smithi031.stdout:7/790: chown db/d1c/d8e/da7/f8d 416066 1 2024-09-17T01:52:13.204 INFO:tasks.workunit.client.0.smithi031.stdout:6/953: truncate d23/db4/d6a/f114 80978 0 2024-09-17T01:52:13.204 INFO:tasks.workunit.client.0.smithi031.stdout:4/966: dread d8/fd [0,4194304] 0 2024-09-17T01:52:13.205 INFO:tasks.workunit.client.0.smithi031.stdout:3/747: write db/df/f1b [1936631,81190] 0 2024-09-17T01:52:13.207 INFO:tasks.workunit.client.0.smithi031.stdout:9/694: mkdir d3/de1 0 2024-09-17T01:52:13.209 INFO:tasks.workunit.client.0.smithi031.stdout:9/695: truncate d3/d19/f22 13387596 0 2024-09-17T01:52:13.209 INFO:tasks.workunit.client.0.smithi031.stdout:4/967: chown d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/c87 980007 1 2024-09-17T01:52:13.210 INFO:tasks.workunit.client.0.smithi031.stdout:3/748: truncate db/df/d1d/d37/d4a/fe7 1021197 0 2024-09-17T01:52:13.211 INFO:tasks.workunit.client.0.smithi031.stdout:1/768: symlink d4/d1a/d43/d53/dd3/dee/lff 0 2024-09-17T01:52:13.214 INFO:tasks.workunit.client.0.smithi031.stdout:4/968: fdatasync d8/d3a/d10a/d64/d4d/d5a/d8c/fd9 0 2024-09-17T01:52:13.219 INFO:tasks.workunit.client.0.smithi031.stdout:7/791: mkdir db/d1c/d41/d9a/df9 0 2024-09-17T01:52:13.219 INFO:tasks.workunit.client.0.smithi031.stdout:3/749: dread db/f19 [0,4194304] 0 2024-09-17T01:52:13.219 INFO:tasks.workunit.client.0.smithi031.stdout:8/659: write d0/d5/f40 [1472863,79752] 0 2024-09-17T01:52:13.221 INFO:tasks.workunit.client.0.smithi031.stdout:0/783: fsync d0/d29/d33/d2a/dde/d9b/f10d 0 2024-09-17T01:52:13.223 INFO:tasks.workunit.client.0.smithi031.stdout:5/724: dread da/d14/dac/fe8 [0,4194304] 0 2024-09-17T01:52:13.224 INFO:tasks.workunit.client.0.smithi031.stdout:0/784: chown d0/d29/d33/d2a/d25/d38/ce8 7604592 1 2024-09-17T01:52:13.224 INFO:tasks.workunit.client.0.smithi031.stdout:5/725: readlink da/d14/dac/d62/lda 0 2024-09-17T01:52:13.231 INFO:tasks.workunit.client.0.smithi031.stdout:1/769: read - d4/d1e/d3f/d72/d7e/da2/fb3 zero size 2024-09-17T01:52:13.234 INFO:tasks.workunit.client.0.smithi031.stdout:7/792: mknod db/d1c/d46/d95/da6/cfa 0 2024-09-17T01:52:13.235 INFO:tasks.workunit.client.0.smithi031.stdout:8/660: rmdir d0/d5/d9b 39 2024-09-17T01:52:13.237 INFO:tasks.workunit.client.0.smithi031.stdout:9/696: dwrite d3/d4/d29/fa8 [0,4194304] 0 2024-09-17T01:52:13.245 INFO:tasks.workunit.client.0.smithi031.stdout:8/661: dwrite d0/df/d19/f27 [0,4194304] 0 2024-09-17T01:52:13.246 INFO:tasks.workunit.client.0.smithi031.stdout:2/805: creat d1/d3/df/d18/f112 x:0 0 0 2024-09-17T01:52:13.249 INFO:tasks.workunit.client.0.smithi031.stdout:7/793: mknod db/d1c/d41/d69/de7/cfb 0 2024-09-17T01:52:13.251 INFO:tasks.workunit.client.0.smithi031.stdout:6/954: mkdir d23/db4/d6a/d70/d74/d10f/d142 0 2024-09-17T01:52:13.256 INFO:tasks.workunit.client.0.smithi031.stdout:8/662: rmdir d0/d5/d54 39 2024-09-17T01:52:13.257 INFO:tasks.workunit.client.0.smithi031.stdout:7/794: symlink db/d29/lfc 0 2024-09-17T01:52:13.258 INFO:tasks.workunit.client.0.smithi031.stdout:4/969: dwrite d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fb7 [0,4194304] 0 2024-09-17T01:52:13.259 INFO:tasks.workunit.client.0.smithi031.stdout:6/955: readlink d23/db4/d6a/d70/lfc 0 2024-09-17T01:52:13.260 INFO:tasks.workunit.client.0.smithi031.stdout:2/806: stat d1/d3/d2d/db2/d1e/f29 0 2024-09-17T01:52:13.261 INFO:tasks.workunit.client.0.smithi031.stdout:7/795: write db/d18/f7f [277801,109569] 0 2024-09-17T01:52:13.263 INFO:tasks.workunit.client.0.smithi031.stdout:9/697: getdents d3/d4/da0/d36 0 2024-09-17T01:52:13.264 INFO:tasks.workunit.client.0.smithi031.stdout:0/785: dread d0/d29/d33/d5/d48/f5a [0,4194304] 0 2024-09-17T01:52:13.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/807: fdatasync d1/d3/d45/f8c 0 2024-09-17T01:52:13.275 INFO:tasks.workunit.client.0.smithi031.stdout:8/663: truncate d0/df/dd/f51 4342311 0 2024-09-17T01:52:13.277 INFO:tasks.workunit.client.0.smithi031.stdout:2/808: fsync d1/d3/d2d/db2/d1e/d21/f90 0 2024-09-17T01:52:13.277 INFO:tasks.workunit.client.0.smithi031.stdout:6/956: dwrite d23/db4/d64/f78 [0,4194304] 0 2024-09-17T01:52:13.277 INFO:tasks.workunit.client.0.smithi031.stdout:9/698: rename d3/d4/da0/f14 to d3/d19/d1f/d44/d64/fe2 0 2024-09-17T01:52:13.279 INFO:tasks.workunit.client.0.smithi031.stdout:5/726: truncate da/d42/d26/f9f 435756 0 2024-09-17T01:52:13.280 INFO:tasks.workunit.client.0.smithi031.stdout:7/796: dwrite db/d18/f93 [0,4194304] 0 2024-09-17T01:52:13.282 INFO:tasks.workunit.client.0.smithi031.stdout:6/957: write d23/db4/d6a/d91/fa7 [4021505,100639] 0 2024-09-17T01:52:13.283 INFO:tasks.workunit.client.0.smithi031.stdout:5/727: stat da/d42 0 2024-09-17T01:52:13.284 INFO:tasks.workunit.client.0.smithi031.stdout:0/786: creat d0/d29/da7/db3/d4a/f110 x:0 0 0 2024-09-17T01:52:13.292 INFO:tasks.workunit.client.0.smithi031.stdout:4/970: rename d8/l72 to d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/l13c 0 2024-09-17T01:52:13.299 INFO:tasks.workunit.client.0.smithi031.stdout:5/728: mkdir da/dc/d98/dfd 0 2024-09-17T01:52:13.301 INFO:tasks.workunit.client.0.smithi031.stdout:0/787: mknod d0/d37/db9/dcf/c111 0 2024-09-17T01:52:13.303 INFO:tasks.workunit.client.0.smithi031.stdout:4/971: mkdir d8/d3a/d10a/d64/d4d/d75/d13d 0 2024-09-17T01:52:13.304 INFO:tasks.workunit.client.0.smithi031.stdout:7/797: mknod db/d18/d67/dee/cfd 0 2024-09-17T01:52:13.306 INFO:tasks.workunit.client.0.smithi031.stdout:6/958: mkdir d23/db4/d6a/d70/d74/d10f/d142/d143 0 2024-09-17T01:52:13.306 INFO:tasks.workunit.client.0.smithi031.stdout:7/798: write db/d1c/d41/d9a/fea [154834,41953] 0 2024-09-17T01:52:13.307 INFO:tasks.workunit.client.0.smithi031.stdout:5/729: mkdir da/d42/d12/d72/dfe 0 2024-09-17T01:52:13.308 INFO:tasks.workunit.client.1.smithi092.stdout:9/588: sync 2024-09-17T01:52:13.308 INFO:tasks.workunit.client.0.smithi031.stdout:7/799: write db/d1c/d46/d95/fc5 [188546,7031] 0 2024-09-17T01:52:13.309 INFO:tasks.workunit.client.0.smithi031.stdout:8/664: mknod d0/d5/d54/d60/dbb/dc0/cc2 0 2024-09-17T01:52:13.310 INFO:tasks.workunit.client.0.smithi031.stdout:8/665: chown d0/f99 467 1 2024-09-17T01:52:13.312 INFO:tasks.workunit.client.0.smithi031.stdout:9/699: creat d3/d4/d41/d70/fe3 x:0 0 0 2024-09-17T01:52:13.312 INFO:tasks.workunit.client.0.smithi031.stdout:9/700: read - d3/d19/d80/fdd zero size 2024-09-17T01:52:13.314 INFO:tasks.workunit.client.1.smithi092.stdout:9/589: dwrite d0/d7/d12/d34/d26/d54/f87 [0,4194304] 0 2024-09-17T01:52:13.319 INFO:tasks.workunit.client.1.smithi092.stdout:9/590: rename d0/df/f84 to d0/d7/d12/fae 0 2024-09-17T01:52:13.321 INFO:tasks.workunit.client.0.smithi031.stdout:7/800: mkdir db/d18/d67/dac/ddd/dc1/dfe 0 2024-09-17T01:52:13.323 INFO:tasks.workunit.client.0.smithi031.stdout:6/959: dread d23/db4/d6a/d70/db0/d138/f13b [0,4194304] 0 2024-09-17T01:52:13.323 INFO:tasks.workunit.client.1.smithi092.stdout:9/591: dread d0/df/d17/f2f [0,4194304] 0 2024-09-17T01:52:13.324 INFO:tasks.workunit.client.0.smithi031.stdout:9/701: creat d3/d4/da0/d71/fe4 x:0 0 0 2024-09-17T01:52:13.324 INFO:tasks.workunit.client.1.smithi092.stdout:9/592: chown d0/d5/c3b 368 1 2024-09-17T01:52:13.325 INFO:tasks.workunit.client.0.smithi031.stdout:9/702: stat d3/d4/da0/d71/f9e 0 2024-09-17T01:52:13.325 INFO:tasks.workunit.client.1.smithi092.stdout:9/593: fdatasync d0/d7/d12/d34/fad 0 2024-09-17T01:52:13.327 INFO:tasks.workunit.client.0.smithi031.stdout:4/972: rename d8/d3a/d10a/d64/d92/c133 to d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/c13e 0 2024-09-17T01:52:13.328 INFO:tasks.workunit.client.0.smithi031.stdout:9/703: fdatasync d3/d4/da0/d36/d62/db2/dd4/fdf 0 2024-09-17T01:52:13.329 INFO:tasks.workunit.client.0.smithi031.stdout:7/801: rmdir db/d1c/d46/d95 39 2024-09-17T01:52:13.330 INFO:tasks.workunit.client.1.smithi092.stdout:9/594: link d0/d7/d12/d34/d26/d54/f9c d0/d7/d12/d86/d93/faf 0 2024-09-17T01:52:13.330 INFO:tasks.workunit.client.1.smithi092.stdout:9/595: chown d0/df/d5d/f76 27923 1 2024-09-17T01:52:13.331 INFO:tasks.workunit.client.0.smithi031.stdout:8/666: dwrite d0/df/dd/f96 [0,4194304] 0 2024-09-17T01:52:13.332 INFO:tasks.workunit.client.0.smithi031.stdout:8/667: dread - d0/df/dd/d77/d78/fb4 zero size 2024-09-17T01:52:13.342 INFO:tasks.workunit.client.1.smithi092.stdout:9/596: fdatasync d0/d7/d12/d34/d26/d54/f87 0 2024-09-17T01:52:13.343 INFO:tasks.workunit.client.1.smithi092.stdout:9/597: read d0/df/d17/f2f [643149,77646] 0 2024-09-17T01:52:13.346 INFO:tasks.workunit.client.0.smithi031.stdout:9/704: mkdir d3/d4/da0/d36/d99/de5 0 2024-09-17T01:52:13.346 INFO:tasks.workunit.client.1.smithi092.stdout:9/598: symlink d0/d7/d12/d86/lb0 0 2024-09-17T01:52:13.347 INFO:tasks.workunit.client.0.smithi031.stdout:2/809: truncate d1/d3/f4 1800130 0 2024-09-17T01:52:13.347 INFO:tasks.workunit.client.0.smithi031.stdout:4/973: mknod d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/c13f 0 2024-09-17T01:52:13.348 INFO:tasks.workunit.client.1.smithi092.stdout:9/599: creat d0/df/d17/d9d/fb1 x:0 0 0 2024-09-17T01:52:13.349 INFO:tasks.workunit.client.1.smithi092.stdout:9/600: readlink d0/d7/d12/d34/d26/d54/l8a 0 2024-09-17T01:52:13.350 INFO:tasks.workunit.client.1.smithi092.stdout:9/601: readlink d0/df/l53 0 2024-09-17T01:52:13.351 INFO:tasks.workunit.client.1.smithi092.stdout:9/602: write d0/d7/d12/d34/d26/d54/fa7 [807444,117539] 0 2024-09-17T01:52:13.352 INFO:tasks.workunit.client.1.smithi092.stdout:9/603: mknod d0/df/d17/d9d/cb2 0 2024-09-17T01:52:13.354 INFO:tasks.workunit.client.0.smithi031.stdout:0/788: dwrite d0/d29/d33/d84/f97 [0,4194304] 0 2024-09-17T01:52:13.359 INFO:tasks.workunit.client.0.smithi031.stdout:9/705: dread - d3/d47/d96/fad zero size 2024-09-17T01:52:13.360 INFO:tasks.workunit.client.1.smithi092.stdout:9/604: dwrite d0/d7/d12/f8f [0,4194304] 0 2024-09-17T01:52:13.361 INFO:tasks.workunit.client.0.smithi031.stdout:6/960: rename d23/l3a to d23/db4/d64/l144 0 2024-09-17T01:52:13.362 INFO:tasks.workunit.client.0.smithi031.stdout:2/810: write d1/d3/df/d11/d30/da1/dca/f101 [563522,75146] 0 2024-09-17T01:52:13.362 INFO:tasks.workunit.client.0.smithi031.stdout:0/789: mknod d0/d37/c112 0 2024-09-17T01:52:13.363 INFO:tasks.workunit.client.0.smithi031.stdout:6/961: write d23/db4/d6a/d70/d74/fb1 [1558973,25319] 0 2024-09-17T01:52:13.366 INFO:tasks.workunit.client.0.smithi031.stdout:4/974: unlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/l12e 0 2024-09-17T01:52:13.376 INFO:tasks.workunit.client.0.smithi031.stdout:8/668: getdents d0/d5/d54 0 2024-09-17T01:52:13.379 INFO:tasks.workunit.client.0.smithi031.stdout:7/802: dread db/d1c/d46/d95/da6/fcc [0,4194304] 0 2024-09-17T01:52:13.380 INFO:tasks.workunit.client.0.smithi031.stdout:2/811: mknod d1/d3/df/d11/d30/c113 0 2024-09-17T01:52:13.384 INFO:tasks.workunit.client.0.smithi031.stdout:0/790: creat d0/d29/d33/d2a/d25/f113 x:0 0 0 2024-09-17T01:52:13.390 INFO:tasks.workunit.client.0.smithi031.stdout:9/706: getdents d3/d19/d80 0 2024-09-17T01:52:13.392 INFO:tasks.workunit.client.0.smithi031.stdout:0/791: stat d0/d29/d33/d2a/lf9 0 2024-09-17T01:52:13.393 INFO:tasks.workunit.client.0.smithi031.stdout:7/803: mknod db/d1c/cff 0 2024-09-17T01:52:13.394 INFO:tasks.workunit.client.0.smithi031.stdout:9/707: dread - d3/d4/d41/d70/fe3 zero size 2024-09-17T01:52:13.394 INFO:tasks.workunit.client.0.smithi031.stdout:4/975: dread d8/d3a/d10a/d64/f24 [0,4194304] 0 2024-09-17T01:52:13.399 INFO:tasks.workunit.client.0.smithi031.stdout:6/962: dwrite d23/db4/d64/d67/fd9 [0,4194304] 0 2024-09-17T01:52:13.399 INFO:tasks.workunit.client.0.smithi031.stdout:2/812: creat d1/d3/d2d/db2/d1e/f114 x:0 0 0 2024-09-17T01:52:13.406 INFO:tasks.workunit.client.0.smithi031.stdout:0/792: dread d0/d29/d33/f103 [0,4194304] 0 2024-09-17T01:52:13.409 INFO:tasks.workunit.client.0.smithi031.stdout:2/813: creat d1/d3/d2d/db2/d1e/f115 x:0 0 0 2024-09-17T01:52:13.414 INFO:tasks.workunit.client.0.smithi031.stdout:8/669: dwrite d0/d5/f11 [0,4194304] 0 2024-09-17T01:52:13.416 INFO:tasks.workunit.client.0.smithi031.stdout:9/708: dread d3/d4/f2f [0,4194304] 0 2024-09-17T01:52:13.417 INFO:tasks.workunit.client.0.smithi031.stdout:2/814: creat d1/d3/d45/dfb/f116 x:0 0 0 2024-09-17T01:52:13.417 INFO:tasks.workunit.client.0.smithi031.stdout:6/963: link d23/d63/d47/df0/cf5 d23/d63/d47/df0/c145 0 2024-09-17T01:52:13.421 INFO:tasks.workunit.client.0.smithi031.stdout:6/964: stat d23/d63/l6d 0 2024-09-17T01:52:13.424 INFO:tasks.workunit.client.0.smithi031.stdout:0/793: link d0/d29/d33/d5/d48/d56/f108 d0/d29/f114 0 2024-09-17T01:52:13.424 INFO:tasks.workunit.client.0.smithi031.stdout:4/976: dread d8/d3a/f40 [0,4194304] 0 2024-09-17T01:52:13.425 INFO:tasks.workunit.client.0.smithi031.stdout:9/709: dread d3/d4/d29/fa8 [0,4194304] 0 2024-09-17T01:52:13.429 INFO:tasks.workunit.client.0.smithi031.stdout:9/710: chown d3/fa3 127696 1 2024-09-17T01:52:13.429 INFO:tasks.workunit.client.0.smithi031.stdout:7/804: dread db/f1a [0,4194304] 0 2024-09-17T01:52:13.429 INFO:tasks.workunit.client.0.smithi031.stdout:2/815: dread d1/d3/df/d18/fe2 [0,4194304] 0 2024-09-17T01:52:13.429 INFO:tasks.workunit.client.0.smithi031.stdout:6/965: mknod d23/db4/d64/c146 0 2024-09-17T01:52:13.429 INFO:tasks.workunit.client.0.smithi031.stdout:9/711: rmdir d3/d4/d41 39 2024-09-17T01:52:13.431 INFO:tasks.workunit.client.0.smithi031.stdout:0/794: rename d0/l42 to d0/d29/d33/d5/dec/l115 0 2024-09-17T01:52:13.433 INFO:tasks.workunit.client.0.smithi031.stdout:4/977: mknod d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/c140 0 2024-09-17T01:52:13.436 INFO:tasks.workunit.client.0.smithi031.stdout:6/966: creat d23/db4/d6a/d72/f147 x:0 0 0 2024-09-17T01:52:13.437 INFO:tasks.workunit.client.0.smithi031.stdout:6/967: fdatasync d23/d63/f104 0 2024-09-17T01:52:13.438 INFO:tasks.workunit.client.0.smithi031.stdout:6/968: chown d23/db4/d8a/ldb 0 1 2024-09-17T01:52:13.442 INFO:tasks.workunit.client.0.smithi031.stdout:8/670: truncate d0/d5/d6c/db0/fb3 1567521 0 2024-09-17T01:52:13.443 INFO:tasks.workunit.client.0.smithi031.stdout:8/671: stat d0/d5/d54/fbf 0 2024-09-17T01:52:13.444 INFO:tasks.workunit.client.0.smithi031.stdout:7/805: write db/d1c/d46/f4f [741538,8774] 0 2024-09-17T01:52:13.446 INFO:tasks.workunit.client.0.smithi031.stdout:9/712: dread d3/d4/da0/f48 [0,4194304] 0 2024-09-17T01:52:13.446 INFO:tasks.workunit.client.0.smithi031.stdout:4/978: dread d8/d3a/d10a/d64/d4d/d8f/fc1 [0,4194304] 0 2024-09-17T01:52:13.449 INFO:tasks.workunit.client.0.smithi031.stdout:6/969: rename d23/d63/d47/l124 to d23/dd1/l148 0 2024-09-17T01:52:13.449 INFO:tasks.workunit.client.0.smithi031.stdout:9/713: chown d3/d4/da0/d36/l37 818533586 1 2024-09-17T01:52:13.450 INFO:tasks.workunit.client.0.smithi031.stdout:6/970: chown d23/fdf 13679939 1 2024-09-17T01:52:13.450 INFO:tasks.workunit.client.0.smithi031.stdout:0/795: truncate d0/d29/d33/d2a/f23 1093095 0 2024-09-17T01:52:13.455 INFO:tasks.workunit.client.0.smithi031.stdout:4/979: chown d8/d3a/d10a/d64/d4d/dae/lbf 123884217 1 2024-09-17T01:52:13.457 INFO:tasks.workunit.client.0.smithi031.stdout:8/672: mkdir d0/df/dd/d77/dc3 0 2024-09-17T01:52:13.458 INFO:tasks.workunit.client.0.smithi031.stdout:6/971: mknod d23/db4/d6a/d72/c149 0 2024-09-17T01:52:13.460 INFO:tasks.workunit.client.0.smithi031.stdout:0/796: dwrite d0/d29/d33/d5/d48/df1/f10a [0,4194304] 0 2024-09-17T01:52:13.465 INFO:tasks.workunit.client.0.smithi031.stdout:6/972: mkdir d23/db4/d64/d67/de9/d14a 0 2024-09-17T01:52:13.466 INFO:tasks.workunit.client.0.smithi031.stdout:9/714: getdents d3/d4/da0/d36/d99 0 2024-09-17T01:52:13.467 INFO:tasks.workunit.client.0.smithi031.stdout:8/673: creat d0/d5/d9b/fc4 x:0 0 0 2024-09-17T01:52:13.472 INFO:tasks.workunit.client.0.smithi031.stdout:4/980: dwrite d8/d3a/d10a/d64/d4d/d5a/d79/f132 [0,4194304] 0 2024-09-17T01:52:13.478 INFO:tasks.workunit.client.0.smithi031.stdout:7/806: dwrite db/d1c/f1d [0,4194304] 0 2024-09-17T01:52:13.485 INFO:tasks.workunit.client.1.smithi092.stdout:5/490: sync 2024-09-17T01:52:13.485 INFO:tasks.workunit.client.1.smithi092.stdout:2/561: sync 2024-09-17T01:52:13.485 INFO:tasks.workunit.client.0.smithi031.stdout:0/797: rename d0/d29/d33/d2a/dde/d9b/lab to d0/d29/d33/d2a/d25/l116 0 2024-09-17T01:52:13.488 INFO:tasks.workunit.client.1.smithi092.stdout:5/491: rmdir d0/de/d19 39 2024-09-17T01:52:13.491 INFO:tasks.workunit.client.0.smithi031.stdout:7/807: mkdir db/d1c/d41/d6c/d100 0 2024-09-17T01:52:13.492 INFO:tasks.workunit.client.0.smithi031.stdout:6/973: dwrite d23/db4/d6a/dac/f95 [4194304,4194304] 0 2024-09-17T01:52:13.492 INFO:tasks.workunit.client.1.smithi092.stdout:5/492: write d0/de/d19/d1a/d24/f4b [5572878,109106] 0 2024-09-17T01:52:13.494 INFO:tasks.workunit.client.0.smithi031.stdout:9/715: rename d3/d4/da0/d71/la1 to d3/d4/da0/d36/d8f/le6 0 2024-09-17T01:52:13.494 INFO:tasks.workunit.client.1.smithi092.stdout:2/562: dread d10/d4c/d80/d95/fa0 [0,4194304] 0 2024-09-17T01:52:13.495 INFO:tasks.workunit.client.1.smithi092.stdout:5/493: mkdir d0/de/d19/d3c/d9e 0 2024-09-17T01:52:13.498 INFO:tasks.workunit.client.1.smithi092.stdout:5/494: mkdir d0/de/d19/d1a/d1e/d29/d9f 0 2024-09-17T01:52:13.499 INFO:tasks.workunit.client.1.smithi092.stdout:5/495: chown d0/de/d19/d1a/d1e/f12 119460 1 2024-09-17T01:52:13.500 INFO:tasks.workunit.client.1.smithi092.stdout:2/563: dwrite d10/d1d/f26 [0,4194304] 0 2024-09-17T01:52:13.501 INFO:tasks.workunit.client.0.smithi031.stdout:6/974: write d23/d63/fc7 [3376199,58912] 0 2024-09-17T01:52:13.502 INFO:tasks.workunit.client.1.smithi092.stdout:2/564: chown d10/d1d/d2c/f39 2 1 2024-09-17T01:52:13.503 INFO:tasks.workunit.client.0.smithi031.stdout:8/674: truncate d0/d5/d54/d60/f62 60188 0 2024-09-17T01:52:13.504 INFO:tasks.workunit.client.0.smithi031.stdout:6/975: rmdir d23/db4/d6a/d70/db0/d138 39 2024-09-17T01:52:13.505 INFO:tasks.workunit.client.1.smithi092.stdout:5/496: creat d0/de/d19/d3c/fa0 x:0 0 0 2024-09-17T01:52:13.506 INFO:tasks.workunit.client.1.smithi092.stdout:2/565: creat d10/d55/d84/fbb x:0 0 0 2024-09-17T01:52:13.506 INFO:tasks.workunit.client.0.smithi031.stdout:9/716: rename d3/d19/d1f/f6d to d3/d4/da0/d36/d62/fe7 0 2024-09-17T01:52:13.507 INFO:tasks.workunit.client.1.smithi092.stdout:5/497: write d0/de/d19/d1a/d1e/d29/f66 [984429,92731] 0 2024-09-17T01:52:13.508 INFO:tasks.workunit.client.1.smithi092.stdout:2/566: unlink d10/d1d/d24/c27 0 2024-09-17T01:52:13.510 INFO:tasks.workunit.client.1.smithi092.stdout:2/567: creat d10/db9/fbc x:0 0 0 2024-09-17T01:52:13.512 INFO:tasks.workunit.client.0.smithi031.stdout:6/976: mkdir d23/db4/d6a/deb/d14b 0 2024-09-17T01:52:13.512 INFO:tasks.workunit.client.0.smithi031.stdout:9/717: rmdir d3 39 2024-09-17T01:52:13.513 INFO:tasks.workunit.client.0.smithi031.stdout:6/977: write d23/db4/d64/dc1/f123 [664668,30043] 0 2024-09-17T01:52:13.514 INFO:tasks.workunit.client.1.smithi092.stdout:5/498: dwrite d0/de/d19/f89 [0,4194304] 0 2024-09-17T01:52:13.514 INFO:tasks.workunit.client.1.smithi092.stdout:2/568: mkdir d10/d8d/d63/da3/dbd 0 2024-09-17T01:52:13.516 INFO:tasks.workunit.client.0.smithi031.stdout:8/675: symlink d0/df/dd/d59/db1/lc5 0 2024-09-17T01:52:13.516 INFO:tasks.workunit.client.1.smithi092.stdout:5/499: chown d0/d7e/d90/l99 2 1 2024-09-17T01:52:13.517 INFO:tasks.workunit.client.1.smithi092.stdout:2/569: creat d10/d3a/fbe x:0 0 0 2024-09-17T01:52:13.518 INFO:tasks.workunit.client.1.smithi092.stdout:1/724: sync 2024-09-17T01:52:13.518 INFO:tasks.workunit.client.1.smithi092.stdout:3/583: sync 2024-09-17T01:52:13.518 INFO:tasks.workunit.client.1.smithi092.stdout:4/744: sync 2024-09-17T01:52:13.519 INFO:tasks.workunit.client.1.smithi092.stdout:8/520: sync 2024-09-17T01:52:13.519 INFO:tasks.workunit.client.1.smithi092.stdout:7/581: sync 2024-09-17T01:52:13.519 INFO:tasks.workunit.client.1.smithi092.stdout:6/522: sync 2024-09-17T01:52:13.519 INFO:tasks.workunit.client.1.smithi092.stdout:0/629: sync 2024-09-17T01:52:13.519 INFO:tasks.workunit.client.1.smithi092.stdout:9/605: sync 2024-09-17T01:52:13.519 INFO:tasks.workunit.client.0.smithi031.stdout:4/981: truncate d8/d3a/d10a/d64/d4d/d5a/d79/f132 922598 0 2024-09-17T01:52:13.520 INFO:tasks.workunit.client.1.smithi092.stdout:5/500: symlink d0/de/d19/d1a/d24/d9b/la1 0 2024-09-17T01:52:13.521 INFO:tasks.workunit.client.0.smithi031.stdout:9/718: write d3/d4/da0/d36/d79/fab [1860182,63075] 0 2024-09-17T01:52:13.521 INFO:tasks.workunit.client.1.smithi092.stdout:2/570: write d10/d1d/d2c/f3d [4293946,126253] 0 2024-09-17T01:52:13.523 INFO:tasks.workunit.client.0.smithi031.stdout:0/798: write d0/d29/d33/d2a/d25/f3f [3023198,41732] 0 2024-09-17T01:52:13.524 INFO:tasks.workunit.client.1.smithi092.stdout:9/606: readlink d0/d5/d29/l95 0 2024-09-17T01:52:13.524 INFO:tasks.workunit.client.1.smithi092.stdout:1/725: write db/d1d/d23/d85/f9b [521031,120462] 0 2024-09-17T01:52:13.525 INFO:tasks.workunit.client.1.smithi092.stdout:2/571: stat d10/d1d/d2c/d56/f60 0 2024-09-17T01:52:13.525 INFO:tasks.workunit.client.1.smithi092.stdout:8/521: truncate d15/d32/f7a 689268 0 2024-09-17T01:52:13.526 INFO:tasks.workunit.client.1.smithi092.stdout:0/630: readlink d3/d2e/d3b/d40/d7d/lc2 0 2024-09-17T01:52:13.526 INFO:tasks.workunit.client.1.smithi092.stdout:6/523: mkdir d3/d10/d8c/d43/d5e/da1 0 2024-09-17T01:52:13.527 INFO:tasks.workunit.client.1.smithi092.stdout:8/522: dread - d15/d32/d40/d42/d43/f88 zero size 2024-09-17T01:52:13.527 INFO:tasks.workunit.client.1.smithi092.stdout:4/745: rmdir d4/d13/d3b/d42/d76/d41/dc6 39 2024-09-17T01:52:13.528 INFO:tasks.workunit.client.0.smithi031.stdout:7/808: truncate db/d29/f75 846181 0 2024-09-17T01:52:13.528 INFO:tasks.workunit.client.1.smithi092.stdout:1/726: write db/d6c/db3/fc1 [385855,129800] 0 2024-09-17T01:52:13.529 INFO:tasks.workunit.client.0.smithi031.stdout:6/978: link d23/db4/d6a/d70/ce4 d23/db4/d6a/d70/db0/d138/c14c 0 2024-09-17T01:52:13.529 INFO:tasks.workunit.client.0.smithi031.stdout:6/979: fsync f1d 0 2024-09-17T01:52:13.530 INFO:tasks.workunit.client.0.smithi031.stdout:0/799: stat d0/d29/da7/db3/d4a/f54 0 2024-09-17T01:52:13.531 INFO:tasks.workunit.client.0.smithi031.stdout:4/982: dwrite d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fb7 [0,4194304] 0 2024-09-17T01:52:13.532 INFO:tasks.workunit.client.1.smithi092.stdout:8/523: read f7 [1749338,47696] 0 2024-09-17T01:52:13.532 INFO:tasks.workunit.client.0.smithi031.stdout:6/980: readlink d23/db4/d64/lfd 0 2024-09-17T01:52:13.533 INFO:tasks.workunit.client.1.smithi092.stdout:3/584: symlink d4/d13/d2e/d74/lc3 0 2024-09-17T01:52:13.534 INFO:tasks.workunit.client.0.smithi031.stdout:6/981: write f1e [1622678,130863] 0 2024-09-17T01:52:13.536 INFO:tasks.workunit.client.1.smithi092.stdout:6/524: dwrite d3/d10/f57 [0,4194304] 0 2024-09-17T01:52:13.539 INFO:tasks.workunit.client.0.smithi031.stdout:9/719: dread d3/d19/d1f/d44/f57 [0,4194304] 0 2024-09-17T01:52:13.540 INFO:tasks.workunit.client.0.smithi031.stdout:0/800: read d0/d29/f70 [47227,27044] 0 2024-09-17T01:52:13.543 INFO:tasks.workunit.client.1.smithi092.stdout:9/607: dwrite d0/d7/d12/d34/d26/f90 [0,4194304] 0 2024-09-17T01:52:13.546 INFO:tasks.workunit.client.1.smithi092.stdout:2/572: mknod d10/d4c/cbf 0 2024-09-17T01:52:13.546 INFO:tasks.workunit.client.1.smithi092.stdout:3/585: rmdir d4/d13/d2e/d5f 39 2024-09-17T01:52:13.546 INFO:tasks.workunit.client.1.smithi092.stdout:2/573: readlink d10/d8d/l91 0 2024-09-17T01:52:13.547 INFO:tasks.workunit.client.0.smithi031.stdout:4/983: dwrite d8/d3a/d10a/d64/d4d/d5a/d79/f80 [0,4194304] 0 2024-09-17T01:52:13.548 INFO:tasks.workunit.client.1.smithi092.stdout:6/525: rmdir d3/d10/d1f/d21 39 2024-09-17T01:52:13.549 INFO:tasks.workunit.client.0.smithi031.stdout:7/809: rename db/d1c/d8e/lca to db/d1c/d41/d9a/df9/l101 0 2024-09-17T01:52:13.552 INFO:tasks.workunit.client.0.smithi031.stdout:7/810: read db/d1c/d41/d9a/f9c [3114733,19575] 0 2024-09-17T01:52:13.553 INFO:tasks.workunit.client.0.smithi031.stdout:7/811: fsync db/d29/f3c 0 2024-09-17T01:52:13.554 INFO:tasks.workunit.client.0.smithi031.stdout:9/720: truncate d3/d19/d1f/d44/f57 594920 0 2024-09-17T01:52:13.555 INFO:tasks.workunit.client.1.smithi092.stdout:1/727: symlink db/d1d/le3 0 2024-09-17T01:52:13.558 INFO:tasks.workunit.client.0.smithi031.stdout:4/984: dread d8/d3a/d10a/d64/f7d [0,4194304] 0 2024-09-17T01:52:13.558 INFO:tasks.workunit.client.1.smithi092.stdout:7/582: getdents d3/d2b/d84 0 2024-09-17T01:52:13.558 INFO:tasks.workunit.client.1.smithi092.stdout:5/501: write d0/fc [6503832,63074] 0 2024-09-17T01:52:13.560 INFO:tasks.workunit.client.1.smithi092.stdout:8/524: mkdir d15/d25/d2b/d63/da4 0 2024-09-17T01:52:13.560 INFO:tasks.workunit.client.1.smithi092.stdout:7/583: chown d3/db/d26/f72 187648 1 2024-09-17T01:52:13.560 INFO:tasks.workunit.client.1.smithi092.stdout:8/525: stat d15/d6f 0 2024-09-17T01:52:13.562 INFO:tasks.workunit.client.0.smithi031.stdout:4/985: dread - d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d61/d91/f135 zero size 2024-09-17T01:52:13.562 INFO:tasks.workunit.client.0.smithi031.stdout:6/982: rename d23/db4/d6a/d70/d74/f99 to d23/db4/d6a/d70/d74/d10f/d142/f14d 0 2024-09-17T01:52:13.562 INFO:tasks.workunit.client.1.smithi092.stdout:9/608: dread - d0/d7/d12/d34/d26/d54/f9f zero size 2024-09-17T01:52:13.562 INFO:tasks.workunit.client.1.smithi092.stdout:3/586: chown d4/d2f/d44/d54/cb8 8 1 2024-09-17T01:52:13.563 INFO:tasks.workunit.client.1.smithi092.stdout:2/574: creat d10/d8d/d63/fc0 x:0 0 0 2024-09-17T01:52:13.564 INFO:tasks.workunit.client.1.smithi092.stdout:9/609: chown d0/d7/d12/d34/d26/d54/f9f 49617959 1 2024-09-17T01:52:13.564 INFO:tasks.workunit.client.0.smithi031.stdout:4/986: dread - d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/f10c zero size 2024-09-17T01:52:13.565 INFO:tasks.workunit.client.1.smithi092.stdout:2/575: write d10/d1d/d24/d6e/faf [24502,104414] 0 2024-09-17T01:52:13.565 INFO:tasks.workunit.client.1.smithi092.stdout:4/746: link d4/d5/d1d/d30/d3f/d4b/c74 d4/d5/d46/cf3 0 2024-09-17T01:52:13.566 INFO:tasks.workunit.client.0.smithi031.stdout:9/721: creat d3/d19/d1f/d44/fe8 x:0 0 0 2024-09-17T01:52:13.567 INFO:tasks.workunit.client.0.smithi031.stdout:4/987: readlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d65/lce 0 2024-09-17T01:52:13.567 INFO:tasks.workunit.client.1.smithi092.stdout:4/747: chown d4/d13/d3b/d42/d76 233031 1 2024-09-17T01:52:13.568 INFO:tasks.workunit.client.0.smithi031.stdout:6/983: symlink d23/d63/d47/d81/l14e 0 2024-09-17T01:52:13.569 INFO:tasks.workunit.client.0.smithi031.stdout:9/722: readlink d3/d4/da0/d36/d79/l95 0 2024-09-17T01:52:13.571 INFO:tasks.workunit.client.0.smithi031.stdout:7/812: link db/d1c/c57 db/d1c/d41/d6c/c102 0 2024-09-17T01:52:13.572 INFO:tasks.workunit.client.1.smithi092.stdout:2/576: mkdir d10/d8d/d8f/dc1 0 2024-09-17T01:52:13.573 INFO:tasks.workunit.client.0.smithi031.stdout:4/988: fsync d8/d3a/d10a/d64/f21 0 2024-09-17T01:52:13.573 INFO:tasks.workunit.client.1.smithi092.stdout:7/584: creat d3/db/d26/d65/d9a/fc9 x:0 0 0 2024-09-17T01:52:13.576 INFO:tasks.workunit.client.1.smithi092.stdout:0/631: dwrite d3/da/d15/f4e [0,4194304] 0 2024-09-17T01:52:13.578 INFO:tasks.workunit.client.0.smithi031.stdout:9/723: dwrite d3/d4/da0/d36/fa2 [0,4194304] 0 2024-09-17T01:52:13.580 INFO:tasks.workunit.client.0.smithi031.stdout:7/813: fdatasync db/d1c/fbc 0 2024-09-17T01:52:13.580 INFO:tasks.workunit.client.1.smithi092.stdout:3/587: write d4/d20/f32 [7491691,130556] 0 2024-09-17T01:52:13.582 INFO:tasks.workunit.client.1.smithi092.stdout:6/526: mknod d3/d10/d8c/d49/d7e/ca2 0 2024-09-17T01:52:13.583 INFO:tasks.workunit.client.1.smithi092.stdout:9/610: dwrite d0/d5/f8 [4194304,4194304] 0 2024-09-17T01:52:13.583 INFO:tasks.workunit.client.1.smithi092.stdout:8/526: link d15/l20 d15/d32/d3b/d78/d9e/la5 0 2024-09-17T01:52:13.588 INFO:tasks.workunit.client.1.smithi092.stdout:7/585: creat d3/d2b/d84/fca x:0 0 0 2024-09-17T01:52:13.589 INFO:tasks.workunit.client.1.smithi092.stdout:0/632: symlink d3/d2e/d3b/d48/d76/lc7 0 2024-09-17T01:52:13.591 INFO:tasks.workunit.client.0.smithi031.stdout:0/801: dwrite d0/d29/d33/d84/f10b [0,4194304] 0 2024-09-17T01:52:13.591 INFO:tasks.workunit.client.0.smithi031.stdout:7/814: mknod db/d18/c103 0 2024-09-17T01:52:13.591 INFO:tasks.workunit.client.1.smithi092.stdout:4/748: creat d4/d13/ff4 x:0 0 0 2024-09-17T01:52:13.591 INFO:tasks.workunit.client.1.smithi092.stdout:6/527: symlink d3/d10/d8c/d43/la3 0 2024-09-17T01:52:13.593 INFO:tasks.workunit.client.1.smithi092.stdout:1/728: link l9 db/d6c/d7e/le4 0 2024-09-17T01:52:13.595 INFO:tasks.workunit.client.1.smithi092.stdout:7/586: rmdir d3/d6/d13/d40/d61 39 2024-09-17T01:52:13.595 INFO:tasks.workunit.client.0.smithi031.stdout:4/989: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/f141 x:0 0 0 2024-09-17T01:52:13.596 INFO:tasks.workunit.client.1.smithi092.stdout:4/749: chown d4/d5/f40 25 1 2024-09-17T01:52:13.597 INFO:tasks.workunit.client.1.smithi092.stdout:5/502: dread d0/de/d19/d1a/f22 [0,4194304] 0 2024-09-17T01:52:13.598 INFO:tasks.workunit.client.0.smithi031.stdout:0/802: dwrite d0/d29/d33/d2a/d25/f27 [0,4194304] 0 2024-09-17T01:52:13.600 INFO:tasks.workunit.client.0.smithi031.stdout:0/803: fdatasync d0/d29/d33/d2a/d25/d38/fbf 0 2024-09-17T01:52:13.601 INFO:tasks.workunit.client.1.smithi092.stdout:9/611: dwrite d0/d7c/f8e [0,4194304] 0 2024-09-17T01:52:13.601 INFO:tasks.workunit.client.0.smithi031.stdout:7/815: symlink db/d18/d67/l104 0 2024-09-17T01:52:13.603 INFO:tasks.workunit.client.1.smithi092.stdout:3/588: rename d4/d2f/d44/l40 to d4/d2f/lc4 0 2024-09-17T01:52:13.609 INFO:tasks.workunit.client.1.smithi092.stdout:5/503: unlink d0/de/d19/d1a/d24/l62 0 2024-09-17T01:52:13.611 INFO:tasks.workunit.client.1.smithi092.stdout:2/577: dread d10/d8d/f34 [0,4194304] 0 2024-09-17T01:52:13.611 INFO:tasks.workunit.client.1.smithi092.stdout:9/612: fsync d0/d7/d12/d34/fad 0 2024-09-17T01:52:13.612 INFO:tasks.workunit.client.0.smithi031.stdout:6/984: dwrite d23/d63/f4a [4194304,4194304] 0 2024-09-17T01:52:13.613 INFO:tasks.workunit.client.1.smithi092.stdout:9/613: write d0/df/f67 [142072,62762] 0 2024-09-17T01:52:13.613 INFO:tasks.workunit.client.1.smithi092.stdout:7/587: truncate d3/d6/d13/d21/d2e/d6e/f71 925252 0 2024-09-17T01:52:13.614 INFO:tasks.workunit.client.1.smithi092.stdout:3/589: write d4/f30 [5035750,92735] 0 2024-09-17T01:52:13.615 INFO:tasks.workunit.client.1.smithi092.stdout:2/578: write d10/d3a/fbe [808012,75845] 0 2024-09-17T01:52:13.616 INFO:tasks.workunit.client.0.smithi031.stdout:7/816: symlink db/d1c/d99/de5/l105 0 2024-09-17T01:52:13.617 INFO:tasks.workunit.client.0.smithi031.stdout:0/804: dread d0/f99 [0,4194304] 0 2024-09-17T01:52:13.618 INFO:tasks.workunit.client.0.smithi031.stdout:6/985: truncate d23/d63/d47/f83 845025 0 2024-09-17T01:52:13.619 INFO:tasks.workunit.client.1.smithi092.stdout:4/750: getdents d4/d5/d1d 0 2024-09-17T01:52:13.619 INFO:tasks.workunit.client.0.smithi031.stdout:7/817: readlink db/d1c/d99/de5/l105 0 2024-09-17T01:52:13.619 INFO:tasks.workunit.client.0.smithi031.stdout:6/986: stat d23/d63/d11b 0 2024-09-17T01:52:13.622 INFO:tasks.workunit.client.0.smithi031.stdout:0/805: mkdir d0/d29/d44/d117 0 2024-09-17T01:52:13.623 INFO:tasks.workunit.client.0.smithi031.stdout:6/987: chown d23/db4/d6a/deb/fad 6 1 2024-09-17T01:52:13.623 INFO:tasks.workunit.client.1.smithi092.stdout:5/504: creat d0/de/d19/d1a/d1e/fa2 x:0 0 0 2024-09-17T01:52:13.624 INFO:tasks.workunit.client.0.smithi031.stdout:7/818: dread - db/d1c/de2/ff3 zero size 2024-09-17T01:52:13.625 INFO:tasks.workunit.client.0.smithi031.stdout:0/806: chown d0/d29/d33/d2a/d25/d38/ce8 46 1 2024-09-17T01:52:13.627 INFO:tasks.workunit.client.1.smithi092.stdout:2/579: read d10/d1d/d96/d77/f47 [14987,63302] 0 2024-09-17T01:52:13.627 INFO:tasks.workunit.client.0.smithi031.stdout:6/988: fdatasync d23/db4/f5a 0 2024-09-17T01:52:13.628 INFO:tasks.workunit.client.1.smithi092.stdout:0/633: rename d3/da/d1c/d4a to d3/dc8 0 2024-09-17T01:52:13.629 INFO:tasks.workunit.client.1.smithi092.stdout:0/634: chown d3/d2e/d3b/d72/f89 20968 1 2024-09-17T01:52:13.630 INFO:tasks.workunit.client.0.smithi031.stdout:0/807: unlink d0/d29/da7/dbb/lae 0 2024-09-17T01:52:13.630 INFO:tasks.workunit.client.1.smithi092.stdout:4/751: creat d4/d7b/ff5 x:0 0 0 2024-09-17T01:52:13.632 INFO:tasks.workunit.client.1.smithi092.stdout:8/527: dread d15/f1f [4194304,4194304] 0 2024-09-17T01:52:13.634 INFO:tasks.workunit.client.1.smithi092.stdout:9/614: unlink d0/d7/d12/d34/d26/d54/f4f 0 2024-09-17T01:52:13.635 INFO:tasks.workunit.client.1.smithi092.stdout:2/580: stat d10/l2f 0 2024-09-17T01:52:13.636 INFO:tasks.workunit.client.0.smithi031.stdout:6/989: mkdir d23/db4/d6a/deb/d14b/d14f 0 2024-09-17T01:52:13.637 INFO:tasks.workunit.client.1.smithi092.stdout:9/615: dread d0/df/d17/d9d/fa4 [0,4194304] 0 2024-09-17T01:52:13.637 INFO:tasks.workunit.client.0.smithi031.stdout:4/990: dwrite d8/d3a/d10a/fa2 [0,4194304] 0 2024-09-17T01:52:13.639 INFO:tasks.workunit.client.1.smithi092.stdout:1/729: rename db/d6c/d7e/d96 to db/d1d/d23/d55/de5 0 2024-09-17T01:52:13.639 INFO:tasks.workunit.client.0.smithi031.stdout:6/990: chown d23/db4/d8a/dd5/ddd 919719447 1 2024-09-17T01:52:13.642 INFO:tasks.workunit.client.0.smithi031.stdout:0/808: dread d0/d29/d33/d2a/dde/d9b/f10d [0,4194304] 0 2024-09-17T01:52:13.645 INFO:tasks.workunit.client.0.smithi031.stdout:4/991: fdatasync d8/d3a/d10a/d64/d4d/dae/fcb 0 2024-09-17T01:52:13.647 INFO:tasks.workunit.client.1.smithi092.stdout:6/528: dread d3/d10/d1f/d21/d28/d2b/d48/d18/f27 [4194304,4194304] 0 2024-09-17T01:52:13.648 INFO:tasks.workunit.client.0.smithi031.stdout:0/809: mkdir d0/d29/da7/dbb/d118 0 2024-09-17T01:52:13.648 INFO:tasks.workunit.client.1.smithi092.stdout:4/752: creat d4/d13/d3b/d42/ff6 x:0 0 0 2024-09-17T01:52:13.649 INFO:tasks.workunit.client.1.smithi092.stdout:6/529: chown d3/l22 0 1 2024-09-17T01:52:13.649 INFO:tasks.workunit.client.0.smithi031.stdout:4/992: write d8/d3a/d10a/d64/d4d/d5a/d79/f80 [2572921,99019] 0 2024-09-17T01:52:13.649 INFO:tasks.workunit.client.0.smithi031.stdout:6/991: dwrite d23/db4/ff2 [0,4194304] 0 2024-09-17T01:52:13.650 INFO:tasks.workunit.client.0.smithi031.stdout:7/819: truncate db/d1c/d46/d95/da6/fcc 8346897 0 2024-09-17T01:52:13.650 INFO:tasks.workunit.client.1.smithi092.stdout:7/588: dread d3/d6/d13/d40/f4f [0,4194304] 0 2024-09-17T01:52:13.652 INFO:tasks.workunit.client.1.smithi092.stdout:7/589: fsync d3/d6/d13/d40/f4f 0 2024-09-17T01:52:13.655 INFO:tasks.workunit.client.1.smithi092.stdout:7/590: write d3/db/f4a [1631079,89755] 0 2024-09-17T01:52:13.656 INFO:tasks.workunit.client.1.smithi092.stdout:3/590: link d4/d73/la7 d4/d20/d3f/lc5 0 2024-09-17T01:52:13.658 INFO:tasks.workunit.client.1.smithi092.stdout:4/753: dwrite d4/d13/d20/f29 [0,4194304] 0 2024-09-17T01:52:13.659 INFO:tasks.workunit.client.0.smithi031.stdout:6/992: symlink d23/db4/d8a/l150 0 2024-09-17T01:52:13.659 INFO:tasks.workunit.client.1.smithi092.stdout:0/635: mknod d3/d2e/d3b/da7/cc9 0 2024-09-17T01:52:13.660 INFO:tasks.workunit.client.1.smithi092.stdout:0/636: chown d3/l9 1268 1 2024-09-17T01:52:13.660 INFO:tasks.workunit.client.0.smithi031.stdout:4/993: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/ddb/f142 x:0 0 0 2024-09-17T01:52:13.660 INFO:tasks.workunit.client.1.smithi092.stdout:5/505: creat d0/de/d19/d1a/d1e/fa3 x:0 0 0 2024-09-17T01:52:13.664 INFO:tasks.workunit.client.1.smithi092.stdout:8/528: symlink d15/d32/d3b/d78/d9b/da1/d9a/la6 0 2024-09-17T01:52:13.664 INFO:tasks.workunit.client.1.smithi092.stdout:5/506: write d0/de/f6f [839749,24808] 0 2024-09-17T01:52:13.664 INFO:tasks.workunit.client.1.smithi092.stdout:4/754: readlink d4/d13/d3b/d42/d76/d35/lb7 0 2024-09-17T01:52:13.665 INFO:tasks.workunit.client.0.smithi031.stdout:4/994: dread - d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/dcf/f13b zero size 2024-09-17T01:52:13.665 INFO:tasks.workunit.client.1.smithi092.stdout:8/529: readlink d15/d25/d2b/d3d/d9f/l72 0 2024-09-17T01:52:13.666 INFO:tasks.workunit.client.1.smithi092.stdout:6/530: unlink d3/d10/d1f/d21/d28/d2b/d48/c51 0 2024-09-17T01:52:13.669 INFO:tasks.workunit.client.0.smithi031.stdout:6/993: truncate d23/db4/d6a/d70/f88 1737039 0 2024-09-17T01:52:13.671 INFO:tasks.workunit.client.0.smithi031.stdout:4/995: write d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/fb7 [3274289,59197] 0 2024-09-17T01:52:13.671 INFO:tasks.workunit.client.0.smithi031.stdout:7/820: dread db/d1c/d41/f7e [0,4194304] 0 2024-09-17T01:52:13.671 INFO:tasks.workunit.client.0.smithi031.stdout:0/810: dread d0/d29/d33/d2a/f1e [0,4194304] 0 2024-09-17T01:52:13.673 INFO:tasks.workunit.client.1.smithi092.stdout:1/730: rename db/d1d/d4b/c9e to db/d1d/db5/ce6 0 2024-09-17T01:52:13.674 INFO:tasks.workunit.client.0.smithi031.stdout:7/821: chown db/d18/d67/fa1 27 1 2024-09-17T01:52:13.674 INFO:tasks.workunit.client.1.smithi092.stdout:7/591: fdatasync d3/d6/d13/d21/f36 0 2024-09-17T01:52:13.675 INFO:tasks.workunit.client.0.smithi031.stdout:6/994: read d23/db4/d6a/f114 [36894,55996] 0 2024-09-17T01:52:13.675 INFO:tasks.workunit.client.1.smithi092.stdout:2/581: write d10/d3a/f3f [4592220,30058] 0 2024-09-17T01:52:13.676 INFO:tasks.workunit.client.1.smithi092.stdout:3/591: symlink d4/d13/d2e/d6f/lc6 0 2024-09-17T01:52:13.677 INFO:tasks.workunit.client.0.smithi031.stdout:4/996: symlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/l143 0 2024-09-17T01:52:13.677 INFO:tasks.workunit.client.0.smithi031.stdout:3/750: sync 2024-09-17T01:52:13.679 INFO:tasks.workunit.client.0.smithi031.stdout:0/811: truncate d0/d29/da7/dbb/fca 958551 0 2024-09-17T01:52:13.680 INFO:tasks.workunit.client.0.smithi031.stdout:6/995: mkdir d23/db4/d64/d67/d129/d151 0 2024-09-17T01:52:13.681 INFO:tasks.workunit.client.1.smithi092.stdout:6/531: rename d3/d10/d8c/d53 to d3/d10/d8c/d43/d5e/d73/d8f/da4 0 2024-09-17T01:52:13.682 INFO:tasks.workunit.client.0.smithi031.stdout:4/997: symlink d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/db0/l144 0 2024-09-17T01:52:13.683 INFO:tasks.workunit.client.1.smithi092.stdout:1/731: creat db/d1d/d4b/d9a/fe7 x:0 0 0 2024-09-17T01:52:13.686 INFO:tasks.workunit.client.0.smithi031.stdout:0/812: getdents d0/d37/db9 0 2024-09-17T01:52:13.687 INFO:tasks.workunit.client.1.smithi092.stdout:9/616: truncate d0/f4c 5590092 0 2024-09-17T01:52:13.688 INFO:tasks.workunit.client.1.smithi092.stdout:0/637: mkdir d3/d2e/d3b/d8f/dca 0 2024-09-17T01:52:13.689 INFO:tasks.workunit.client.1.smithi092.stdout:6/532: dwrite d3/d10/d8c/d43/d5e/d73/f7a [0,4194304] 0 2024-09-17T01:52:13.690 INFO:tasks.workunit.client.0.smithi031.stdout:4/998: creat d8/d3a/d10a/d64/d4d/d5a/d8c/d25/d36/d4c/d52/f145 x:0 0 0 2024-09-17T01:52:13.691 INFO:tasks.workunit.client.1.smithi092.stdout:2/582: symlink d10/d8d/d8f/lc2 0 2024-09-17T01:52:13.692 INFO:tasks.workunit.client.0.smithi031.stdout:6/996: rename d23/dd1 to d23/db4/d8a/dd5/ddd/d152 0 2024-09-17T01:52:13.693 INFO:tasks.workunit.client.1.smithi092.stdout:3/592: write d4/d20/d39/f7d [3491499,24091] 0 2024-09-17T01:52:13.693 INFO:tasks.workunit.client.0.smithi031.stdout:3/751: dwrite db/df/d1d/d37/d77/dc2/fe1 [0,4194304] 0 2024-09-17T01:52:13.696 INFO:tasks.workunit.client.1.smithi092.stdout:4/755: creat d4/d5/d8/d99/dcf/ff7 x:0 0 0 2024-09-17T01:52:13.696 INFO:tasks.workunit.client.1.smithi092.stdout:8/530: mknod d15/d25/d27/d6e/d76/d83/d98/ca7 0 2024-09-17T01:52:13.697 INFO:tasks.workunit.client.0.smithi031.stdout:0/813: rename d0/d37/db9/dcf/ldf to d0/d29/d33/d5/dec/l119 0 2024-09-17T01:52:13.698 INFO:tasks.workunit.client.1.smithi092.stdout:9/617: dwrite d0/d7/d12/d34/d26/d54/f87 [0,4194304] 0 2024-09-17T01:52:13.699 INFO:tasks.workunit.client.0.smithi031.stdout:4/999: chown d8/d3a/d10a/d64/l4b 2030454 1 2024-09-17T01:52:13.701 INFO:tasks.workunit.client.1.smithi092.stdout:7/592: write d3/db/d26/d65/f9d [3345497,65762] 0 2024-09-17T01:52:13.703 INFO:tasks.workunit.client.0.smithi031.stdout:0/814: write d0/d29/d33/d5/d48/d56/dc8/f10e [4860787,107447] 0 2024-09-17T01:52:13.703 INFO:tasks.workunit.client.1.smithi092.stdout:6/533: rename d3/d10/d1f/d21/d28/d2b/d48 to d3/d10/d1f/d21/da5 0 2024-09-17T01:52:13.706 INFO:tasks.workunit.client.0.smithi031.stdout:7/822: dread db/d18/f2f [0,4194304] 0 2024-09-17T01:52:13.710 INFO:tasks.workunit.client.1.smithi092.stdout:2/583: truncate d10/d4c/f72 2840392 0 2024-09-17T01:52:13.711 INFO:tasks.workunit.client.0.smithi031.stdout:7/823: read db/d1c/d46/d95/da6/fcc [8273897,58293] 0 2024-09-17T01:52:13.712 INFO:tasks.workunit.client.1.smithi092.stdout:3/593: unlink d4/d13/d2e/d43/f9b 0 2024-09-17T01:52:13.713 INFO:tasks.workunit.client.1.smithi092.stdout:4/756: creat d4/d5/d8/d92/ff8 x:0 0 0 2024-09-17T01:52:13.715 INFO:tasks.workunit.client.1.smithi092.stdout:8/531: mknod d15/d25/d27/d87/ca8 0 2024-09-17T01:52:13.715 INFO:tasks.workunit.client.1.smithi092.stdout:9/618: dwrite d0/d7/d21/f50 [0,4194304] 0 2024-09-17T01:52:13.722 INFO:tasks.workunit.client.0.smithi031.stdout:7/824: rename db/l12 to db/d18/d67/dac/ddd/dc1/l106 0 2024-09-17T01:52:13.723 INFO:tasks.workunit.client.0.smithi031.stdout:7/825: fdatasync db/d1c/d41/d6c/fc4 0 2024-09-17T01:52:13.724 INFO:tasks.workunit.client.0.smithi031.stdout:7/826: read db/d29/f4a [133273,44188] 0 2024-09-17T01:52:13.725 INFO:tasks.workunit.client.0.smithi031.stdout:3/752: dread db/d9b/fa9 [0,4194304] 0 2024-09-17T01:52:13.725 INFO:tasks.workunit.client.1.smithi092.stdout:4/757: rmdir d4/d5/d1d/dae 39 2024-09-17T01:52:13.727 INFO:tasks.workunit.client.1.smithi092.stdout:9/619: dread - d0/d7/d12/fae zero size 2024-09-17T01:52:13.727 INFO:tasks.workunit.client.1.smithi092.stdout:6/534: dwrite d3/d70/f8a [0,4194304] 0 2024-09-17T01:52:13.727 INFO:tasks.workunit.client.1.smithi092.stdout:8/532: creat d15/d25/d27/d6e/fa9 x:0 0 0 2024-09-17T01:52:13.729 INFO:tasks.workunit.client.1.smithi092.stdout:9/620: write d0/f7d [3952171,121502] 0 2024-09-17T01:52:13.730 INFO:tasks.workunit.client.1.smithi092.stdout:0/638: creat d3/d1d/fcb x:0 0 0 2024-09-17T01:52:13.731 INFO:tasks.workunit.client.1.smithi092.stdout:1/732: getdents db/d1d/d23/d88 0 2024-09-17T01:52:13.733 INFO:tasks.workunit.client.1.smithi092.stdout:9/621: chown d0/df/c80 4038 1 2024-09-17T01:52:13.733 INFO:tasks.workunit.client.1.smithi092.stdout:4/758: creat d4/d5/d1d/d30/d3f/d4b/ff9 x:0 0 0 2024-09-17T01:52:13.734 INFO:tasks.workunit.client.0.smithi031.stdout:3/753: rename db/df/d1d/d37/f4b to db/df/dc8/d6a/dc3/ddb/fec 0 2024-09-17T01:52:13.734 INFO:tasks.workunit.client.0.smithi031.stdout:7/827: truncate db/d1c/d41/f7e 1023074 0 2024-09-17T01:52:13.735 INFO:tasks.workunit.client.1.smithi092.stdout:8/533: creat d15/d25/d2b/d63/faa x:0 0 0 2024-09-17T01:52:13.737 INFO:tasks.workunit.client.0.smithi031.stdout:7/828: write db/d18/d67/dac/fe6 [955169,49516] 0 2024-09-17T01:52:13.737 INFO:tasks.workunit.client.1.smithi092.stdout:7/593: creat d3/d6/d13/d40/fcb x:0 0 0 2024-09-17T01:52:13.738 INFO:tasks.workunit.client.1.smithi092.stdout:1/733: fdatasync db/f5f 0 2024-09-17T01:52:13.739 INFO:tasks.workunit.client.0.smithi031.stdout:3/754: symlink db/df/dc8/led 0 2024-09-17T01:52:13.741 INFO:tasks.workunit.client.0.smithi031.stdout:6/997: dread d23/db4/d6a/d91/fb6 [0,4194304] 0 2024-09-17T01:52:13.742 INFO:tasks.workunit.client.1.smithi092.stdout:9/622: creat d0/d7/d12/d86/d93/d96/fb3 x:0 0 0 2024-09-17T01:52:13.742 INFO:tasks.workunit.client.0.smithi031.stdout:7/829: unlink db/d1c/d99/fa3 0 2024-09-17T01:52:13.744 INFO:tasks.workunit.client.1.smithi092.stdout:3/594: truncate d4/d13/d2e/d5f/f5c 700729 0 2024-09-17T01:52:13.745 INFO:tasks.workunit.client.0.smithi031.stdout:3/755: write db/df/dc8/d6a/f76 [2218767,117622] 0 2024-09-17T01:52:13.745 INFO:tasks.workunit.client.1.smithi092.stdout:3/595: fsync d4/d73/f7e 0 2024-09-17T01:52:13.749 INFO:tasks.workunit.client.1.smithi092.stdout:0/639: rename d3/d1d/c4d to d3/da/d1c/d3a/ccc 0 2024-09-17T01:52:13.749 INFO:tasks.workunit.client.0.smithi031.stdout:0/815: dwrite d0/d29/d33/d5/d48/d56/dc8/f79 [0,4194304] 0 2024-09-17T01:52:13.751 INFO:tasks.workunit.client.1.smithi092.stdout:6/535: creat d3/d10/d1f/d21/da5/fa6 x:0 0 0 2024-09-17T01:52:13.752 INFO:tasks.workunit.client.0.smithi031.stdout:3/756: mknod db/df/d1d/d37/d4a/d97/cee 0 2024-09-17T01:52:13.752 INFO:tasks.workunit.client.1.smithi092.stdout:9/623: mknod d0/df/d5d/cb4 0 2024-09-17T01:52:13.753 INFO:tasks.workunit.client.1.smithi092.stdout:8/534: mknod d15/d32/d40/d42/d43/d8d/cab 0 2024-09-17T01:52:13.756 INFO:tasks.workunit.client.0.smithi031.stdout:0/816: creat d0/d29/d33/d5b/f11a x:0 0 0 2024-09-17T01:52:13.758 INFO:tasks.workunit.client.1.smithi092.stdout:1/734: rename db/d1d/d23/d85 to db/d6c/d7e/d82/de8 0 2024-09-17T01:52:13.759 INFO:tasks.workunit.client.0.smithi031.stdout:0/817: dread - d0/d29/da7/db3/d4a/d86/dd7/dac/fd8 zero size 2024-09-17T01:52:13.760 INFO:tasks.workunit.client.0.smithi031.stdout:3/757: truncate db/df/d1d/d37/d4a/f94 3032311 0 2024-09-17T01:52:13.760 INFO:tasks.workunit.client.1.smithi092.stdout:4/759: creat d4/d13/ffa x:0 0 0 2024-09-17T01:52:13.762 INFO:tasks.workunit.client.1.smithi092.stdout:8/535: dwrite d15/d32/d40/d42/d93/f97 [4194304,4194304] 0 2024-09-17T01:52:13.763 INFO:tasks.workunit.client.1.smithi092.stdout:6/536: readlink d3/d10/d1f/d21/d28/l37 0 2024-09-17T01:52:13.763 INFO:tasks.workunit.client.1.smithi092.stdout:0/640: write d3/da/d1c/f91 [531623,114419] 0 2024-09-17T01:52:13.764 INFO:tasks.workunit.client.1.smithi092.stdout:2/584: dread d10/d1d/d24/f4f [0,4194304] 0 2024-09-17T01:52:13.766 INFO:tasks.workunit.client.1.smithi092.stdout:2/585: chown d10/f1a 12582326 1 2024-09-17T01:52:13.769 INFO:tasks.workunit.client.0.smithi031.stdout:7/830: dwrite db/d1c/d46/f52 [0,4194304] 0 2024-09-17T01:52:13.769 INFO:tasks.workunit.client.1.smithi092.stdout:7/594: rename d3/d6/d13/d40/d60/lb3 to d3/d6/d13/d40/d61/lcc 0 2024-09-17T01:52:13.770 INFO:tasks.workunit.client.0.smithi031.stdout:6/998: dwrite d23/d63/f4f [0,4194304] 0 2024-09-17T01:52:13.771 INFO:tasks.workunit.client.1.smithi092.stdout:1/735: mknod db/d1d/d23/da1/dc3/ce9 0 2024-09-17T01:52:13.778 INFO:tasks.workunit.client.1.smithi092.stdout:9/624: creat d0/d7/d12/d98/fb5 x:0 0 0 2024-09-17T01:52:13.786 INFO:tasks.workunit.client.1.smithi092.stdout:9/625: write d0/d7c/f8e [3799846,106516] 0 2024-09-17T01:52:13.786 INFO:tasks.workunit.client.1.smithi092.stdout:8/536: creat d15/d25/d27/d6e/fac x:0 0 0 2024-09-17T01:52:13.786 INFO:tasks.workunit.client.1.smithi092.stdout:0/641: creat d3/da/d15/d30/fcd x:0 0 0 2024-09-17T01:52:13.786 INFO:tasks.workunit.client.1.smithi092.stdout:3/596: link d4/d16/d1b/l82 d4/d73/d8f/d9e/lc7 0 2024-09-17T01:52:13.787 INFO:tasks.workunit.client.1.smithi092.stdout:3/597: chown d4/d16/d1b/f55 2792097 1 2024-09-17T01:52:13.791 INFO:tasks.workunit.client.1.smithi092.stdout:1/736: mkdir db/d6c/db3/dea 0 2024-09-17T01:52:13.792 INFO:tasks.workunit.client.0.smithi031.stdout:7/831: dwrite db/d1c/d41/d9a/f9c [0,4194304] 0 2024-09-17T01:52:13.793 INFO:tasks.workunit.client.1.smithi092.stdout:1/737: dread db/d1d/d23/f4c [0,4194304] 0 2024-09-17T01:52:13.793 INFO:tasks.workunit.client.1.smithi092.stdout:2/586: dread d10/d1d/d2c/f7d [0,4194304] 0 2024-09-17T01:52:13.794 INFO:tasks.workunit.client.0.smithi031.stdout:7/832: write db/d1c/d8e/fb2 [579115,84652] 0 2024-09-17T01:52:13.795 INFO:tasks.workunit.client.0.smithi031.stdout:7/833: dread - db/d1c/d41/d69/de7/fe8 zero size 2024-09-17T01:52:13.796 INFO:tasks.workunit.client.1.smithi092.stdout:8/537: creat d15/d25/d27/d49/fad x:0 0 0 2024-09-17T01:52:13.798 INFO:tasks.workunit.client.1.smithi092.stdout:0/642: rmdir d3/d2e/d55/d63/d81/d9c 39 2024-09-17T01:52:13.799 INFO:tasks.workunit.client.1.smithi092.stdout:1/738: fdatasync db/d1d/d2e/f32 0 2024-09-17T01:52:13.799 INFO:tasks.workunit.client.0.smithi031.stdout:6/999: truncate f1c 1219988 0 2024-09-17T01:52:13.799 INFO:tasks.workunit.client.0.smithi031.stdout:0/818: dread d0/d29/d33/d2a/d25/d38/fbf [0,4194304] 0 2024-09-17T01:52:13.802 INFO:tasks.workunit.client.1.smithi092.stdout:2/587: rmdir d10/d3a/d97/da8 39 2024-09-17T01:52:13.803 INFO:tasks.workunit.client.1.smithi092.stdout:4/760: dread d4/d13/d3b/d42/d76/d35/d3e/f43 [4194304,4194304] 0 2024-09-17T01:52:13.804 INFO:tasks.workunit.client.1.smithi092.stdout:0/643: symlink d3/d2e/d55/d63/lce 0 2024-09-17T01:52:13.805 INFO:tasks.workunit.client.1.smithi092.stdout:0/644: readlink d3/dc8/l64 0 2024-09-17T01:52:13.806 INFO:tasks.workunit.client.1.smithi092.stdout:2/588: write d10/d8d/d63/fc0 [541806,94600] 0 2024-09-17T01:52:13.806 INFO:tasks.workunit.client.1.smithi092.stdout:0/645: chown d3 28649114 1 2024-09-17T01:52:13.808 INFO:tasks.workunit.client.1.smithi092.stdout:8/538: mkdir d15/d25/d27/dae 0 2024-09-17T01:52:13.809 INFO:tasks.workunit.client.0.smithi031.stdout:3/758: dread db/df/dc8/d6a/f92 [0,4194304] 0 2024-09-17T01:52:13.810 INFO:tasks.workunit.client.0.smithi031.stdout:7/834: rename db/d1c/de2/feb to db/d1c/d46/f107 0 2024-09-17T01:52:13.811 INFO:tasks.workunit.client.1.smithi092.stdout:4/761: unlink d4/d5/d8/ca 0 2024-09-17T01:52:13.813 INFO:tasks.workunit.client.1.smithi092.stdout:1/739: unlink db/d1d/d2e/d62/f86 0 2024-09-17T01:52:13.816 INFO:tasks.workunit.client.1.smithi092.stdout:0/646: mkdir d3/d2e/d55/dcf 0 2024-09-17T01:52:13.817 INFO:tasks.workunit.client.1.smithi092.stdout:3/598: dread d4/d16/d1b/f47 [0,4194304] 0 2024-09-17T01:52:13.822 INFO:tasks.workunit.client.1.smithi092.stdout:7/595: write d3/db/d26/d6f/f79 [4554120,81454] 0 2024-09-17T01:52:13.822 INFO:tasks.workunit.client.1.smithi092.stdout:1/740: unlink db/d1d/d23/d55/f61 0 2024-09-17T01:52:13.823 INFO:tasks.workunit.client.1.smithi092.stdout:4/762: dwrite d4/d5/d8/d92/ff8 [0,4194304] 0 2024-09-17T01:52:13.826 INFO:tasks.workunit.client.1.smithi092.stdout:1/741: dread - db/d1d/d23/d88/fd9 zero size 2024-09-17T01:52:13.831 INFO:tasks.workunit.client.1.smithi092.stdout:4/763: truncate d4/d13/d20/fcc 373841 0 2024-09-17T01:52:13.832 INFO:tasks.workunit.client.1.smithi092.stdout:0/647: fdatasync d3/d73/fbb 0 2024-09-17T01:52:13.833 INFO:tasks.workunit.client.1.smithi092.stdout:1/742: read db/d6c/db3/fc1 [410465,67960] 0 2024-09-17T01:52:13.836 INFO:tasks.workunit.client.1.smithi092.stdout:7/596: rename d3/d6/d13/d21/d2e/f85 to d3/db/d26/d65/fcd 0 2024-09-17T01:52:13.839 INFO:tasks.workunit.client.1.smithi092.stdout:8/539: dwrite d15/f1f [8388608,4194304] 0 2024-09-17T01:52:13.842 INFO:tasks.workunit.client.0.smithi031.stdout:1/770: sync 2024-09-17T01:52:13.844 INFO:tasks.workunit.client.1.smithi092.stdout:7/597: write d3/d6/f9c [314891,26804] 0 2024-09-17T01:52:13.845 INFO:tasks.workunit.client.1.smithi092.stdout:9/626: dwrite d0/d7/d12/d34/d26/d54/f9c [0,4194304] 0 2024-09-17T01:52:13.846 INFO:tasks.workunit.client.1.smithi092.stdout:0/648: symlink d3/d2e/d3b/d72/d7a/ld0 0 2024-09-17T01:52:13.849 INFO:tasks.workunit.client.1.smithi092.stdout:6/537: dwrite d3/f9e [0,4194304] 0 2024-09-17T01:52:13.850 INFO:tasks.workunit.client.1.smithi092.stdout:4/764: mknod d4/d5/d1d/d30/d3f/d4b/cfb 0 2024-09-17T01:52:13.853 INFO:tasks.workunit.client.1.smithi092.stdout:8/540: fdatasync d15/d32/f59 0 2024-09-17T01:52:13.858 INFO:tasks.workunit.client.1.smithi092.stdout:3/599: truncate d4/d13/f63 3213833 0 2024-09-17T01:52:13.858 INFO:tasks.workunit.client.1.smithi092.stdout:2/589: dwrite d10/d55/f5b [0,4194304] 0 2024-09-17T01:52:13.859 INFO:tasks.workunit.client.1.smithi092.stdout:9/627: chown d0/d7/d12/d34/d26/l46 2012068 1 2024-09-17T01:52:13.859 INFO:tasks.workunit.client.1.smithi092.stdout:1/743: mkdir db/d6c/db3/dea/deb 0 2024-09-17T01:52:13.859 INFO:tasks.workunit.client.1.smithi092.stdout:6/538: write d3/d10/d1f/d21/d28/f2c [208113,77590] 0 2024-09-17T01:52:13.861 INFO:tasks.workunit.client.1.smithi092.stdout:4/765: rmdir d4/d5/d8 39 2024-09-17T01:52:13.863 INFO:tasks.workunit.client.1.smithi092.stdout:9/628: readlink d0/d7/l62 0 2024-09-17T01:52:13.868 INFO:tasks.workunit.client.1.smithi092.stdout:0/649: dwrite d3/d2e/d3b/faa [0,4194304] 0 2024-09-17T01:52:13.870 INFO:tasks.workunit.client.1.smithi092.stdout:6/539: unlink d3/d25/f60 0 2024-09-17T01:52:13.872 INFO:tasks.workunit.client.1.smithi092.stdout:1/744: fsync db/d1d/d4b/d9a/fb1 0 2024-09-17T01:52:13.873 INFO:tasks.workunit.client.1.smithi092.stdout:8/541: link d15/d32/d3b/f79 d15/d25/d2b/d63/da4/faf 0 2024-09-17T01:52:13.873 INFO:tasks.workunit.client.0.smithi031.stdout:7/835: mknod db/d18/d67/dee/c108 0 2024-09-17T01:52:13.875 INFO:tasks.workunit.client.1.smithi092.stdout:7/598: dwrite d3/d2b/d84/fab [0,4194304] 0 2024-09-17T01:52:13.875 INFO:tasks.workunit.client.1.smithi092.stdout:8/542: chown d15/f21 2537 1 2024-09-17T01:52:13.878 INFO:tasks.workunit.client.1.smithi092.stdout:7/599: dread - d3/d6/d13/d40/d61/fc3 zero size 2024-09-17T01:52:13.880 INFO:tasks.workunit.client.0.smithi031.stdout:3/759: creat db/df/dc8/d6a/dc3/ddb/ddc/fef x:0 0 0 2024-09-17T01:52:13.880 INFO:tasks.workunit.client.1.smithi092.stdout:6/540: read d3/d10/d1f/d21/da5/f3e [171306,83037] 0 2024-09-17T01:52:13.883 INFO:tasks.workunit.client.1.smithi092.stdout:1/745: mknod db/d1d/db5/cec 0 2024-09-17T01:52:13.885 INFO:tasks.workunit.client.0.smithi031.stdout:8/676: sync 2024-09-17T01:52:13.885 INFO:tasks.workunit.client.0.smithi031.stdout:2/816: sync 2024-09-17T01:52:13.885 INFO:tasks.workunit.client.0.smithi031.stdout:9/724: sync 2024-09-17T01:52:13.885 INFO:tasks.workunit.client.0.smithi031.stdout:5/730: sync 2024-09-17T01:52:13.885 INFO:tasks.workunit.client.1.smithi092.stdout:0/650: mknod d3/d2e/d3b/d8f/cd1 0 2024-09-17T01:52:13.886 INFO:tasks.workunit.client.0.smithi031.stdout:8/677: chown d0/d5/f5e 85 1 2024-09-17T01:52:13.887 INFO:tasks.workunit.client.1.smithi092.stdout:7/600: unlink d3/f4b 0 2024-09-17T01:52:13.887 INFO:tasks.workunit.client.1.smithi092.stdout:9/629: link d0/d7/d12/d34/d26/c73 d0/d5/d29/cb6 0 2024-09-17T01:52:13.889 INFO:tasks.workunit.client.1.smithi092.stdout:6/541: dwrite d3/f9f [0,4194304] 0 2024-09-17T01:52:13.892 INFO:tasks.workunit.client.1.smithi092.stdout:0/651: mkdir d3/dc8/dd2 0 2024-09-17T01:52:13.892 INFO:tasks.workunit.client.1.smithi092.stdout:6/542: write d3/f9f [2845118,90795] 0 2024-09-17T01:52:13.893 INFO:tasks.workunit.client.1.smithi092.stdout:0/652: write d3/d2e/d3b/d8f/fb6 [890009,120949] 0 2024-09-17T01:52:13.894 INFO:tasks.workunit.client.0.smithi031.stdout:7/836: mkdir db/d1c/d41/d6c/da0/dd4/d109 0 2024-09-17T01:52:13.894 INFO:tasks.workunit.client.0.smithi031.stdout:7/837: chown db/l13 915675 1 2024-09-17T01:52:13.897 INFO:tasks.workunit.client.1.smithi092.stdout:1/746: read db/d1d/d4b/f56 [3862629,118158] 0 2024-09-17T01:52:13.897 INFO:tasks.workunit.client.0.smithi031.stdout:5/731: rmdir da/dc/d98 39 2024-09-17T01:52:13.900 INFO:tasks.workunit.client.0.smithi031.stdout:2/817: creat d1/d3/d2d/db2/d1e/d2a/f117 x:0 0 0 2024-09-17T01:52:13.902 INFO:tasks.workunit.client.0.smithi031.stdout:1/771: symlink d4/d1a/d2d/l100 0 2024-09-17T01:52:13.902 INFO:tasks.workunit.client.0.smithi031.stdout:2/818: write d1/d3/d2d/db2/d1e/d21/d34/f93 [183226,56108] 0 2024-09-17T01:52:13.902 INFO:tasks.workunit.client.1.smithi092.stdout:1/747: write db/d1d/d4b/f56 [4814904,44523] 0 2024-09-17T01:52:13.902 INFO:tasks.workunit.client.1.smithi092.stdout:8/543: dread f7 [0,4194304] 0 2024-09-17T01:52:13.903 INFO:tasks.workunit.client.1.smithi092.stdout:7/601: getdents d3/d6/d13 0 2024-09-17T01:52:13.903 INFO:tasks.workunit.client.1.smithi092.stdout:1/748: chown db/d1d/d23/da1/dc3 12 1 2024-09-17T01:52:13.904 INFO:tasks.workunit.client.0.smithi031.stdout:3/760: creat db/df/dc8/d6a/ddd/ff0 x:0 0 0 2024-09-17T01:52:13.904 INFO:tasks.workunit.client.1.smithi092.stdout:8/544: chown fa 353975274 1 2024-09-17T01:52:13.905 INFO:tasks.workunit.client.1.smithi092.stdout:0/653: getdents d3/d2e/d3b/d8f/d5f 0 2024-09-17T01:52:13.905 INFO:tasks.workunit.client.0.smithi031.stdout:7/838: fsync db/d29/f4a 0 2024-09-17T01:52:13.907 INFO:tasks.workunit.client.1.smithi092.stdout:8/545: creat d15/d32/d3b/d78/fb0 x:0 0 0 2024-09-17T01:52:13.909 INFO:tasks.workunit.client.1.smithi092.stdout:0/654: readlink d3/da/d1c/d3a/lb2 0 2024-09-17T01:52:13.910 INFO:tasks.workunit.client.1.smithi092.stdout:7/602: rename d3/d6/d13/d40 to d3/db/d98/dce 0 2024-09-17T01:52:13.910 INFO:tasks.workunit.client.0.smithi031.stdout:1/772: read d4/d3d/f57 [2011195,66462] 0 2024-09-17T01:52:13.914 INFO:tasks.workunit.client.1.smithi092.stdout:1/749: dwrite db/d1d/db5/fe1 [0,4194304] 0 2024-09-17T01:52:13.914 INFO:tasks.workunit.client.1.smithi092.stdout:4/766: truncate d4/d13/d3b/d42/fc7 1231941 0 2024-09-17T01:52:13.917 INFO:tasks.workunit.client.0.smithi031.stdout:7/839: mkdir db/d29/d10a 0 2024-09-17T01:52:13.917 INFO:tasks.workunit.client.1.smithi092.stdout:7/603: creat d3/db/d26/d65/fcf x:0 0 0 2024-09-17T01:52:13.920 INFO:tasks.workunit.client.1.smithi092.stdout:8/546: dwrite d15/d25/f30 [0,4194304] 0 2024-09-17T01:52:13.924 INFO:tasks.workunit.client.0.smithi031.stdout:9/725: creat d3/fe9 x:0 0 0 2024-09-17T01:52:13.925 INFO:tasks.workunit.client.1.smithi092.stdout:4/767: getdents d4/d5/d1d/d30/d3f 0 2024-09-17T01:52:13.925 INFO:tasks.workunit.client.0.smithi031.stdout:5/732: dwrite da/d42/d12/f86 [0,4194304] 0 2024-09-17T01:52:13.927 INFO:tasks.workunit.client.0.smithi031.stdout:8/678: rename d0/l2e to d0/df/dd/lc6 0 2024-09-17T01:52:13.928 INFO:tasks.workunit.client.1.smithi092.stdout:1/750: dwrite db/d1d/d2e/fcd [0,4194304] 0 2024-09-17T01:52:13.929 INFO:tasks.workunit.client.0.smithi031.stdout:9/726: chown d3/f42 61 1 2024-09-17T01:52:13.931 INFO:tasks.workunit.client.0.smithi031.stdout:8/679: write d0/d5/d6c/db0/db7/fac [330902,73589] 0 2024-09-17T01:52:13.934 INFO:tasks.workunit.client.1.smithi092.stdout:4/768: chown d4/d13/d3b/d42/d76/d35/lb7 26 1 2024-09-17T01:52:13.935 INFO:tasks.workunit.client.1.smithi092.stdout:1/751: dread db/d1d/d23/f4c [0,4194304] 0 2024-09-17T01:52:13.935 INFO:tasks.workunit.client.1.smithi092.stdout:8/547: dwrite d15/d25/d27/d49/f9c [0,4194304] 0 2024-09-17T01:52:13.937 INFO:tasks.workunit.client.1.smithi092.stdout:4/769: dread - d4/d5/fd3 zero size 2024-09-17T01:52:13.938 INFO:tasks.workunit.client.0.smithi031.stdout:5/733: dwrite da/f74 [0,4194304] 0 2024-09-17T01:52:13.940 INFO:tasks.workunit.client.0.smithi031.stdout:5/734: write da/d42/d12/d4a/f60 [5215277,129210] 0 2024-09-17T01:52:13.942 INFO:tasks.workunit.client.1.smithi092.stdout:0/655: write d3/d73/fbb [780917,109744] 0 2024-09-17T01:52:13.942 INFO:tasks.workunit.client.1.smithi092.stdout:8/548: write d15/d32/f50 [705577,97286] 0 2024-09-17T01:52:13.945 INFO:tasks.workunit.client.0.smithi031.stdout:5/735: creat da/dc/d98/fff x:0 0 0 2024-09-17T01:52:13.947 INFO:tasks.workunit.client.1.smithi092.stdout:4/770: readlink d4/d5/d1d/d30/d3f/d4b/la5 0 2024-09-17T01:52:13.950 INFO:tasks.workunit.client.1.smithi092.stdout:8/549: read d15/d6f/d8b/f99 [782388,96241] 0 2024-09-17T01:52:13.953 INFO:tasks.workunit.client.1.smithi092.stdout:6/543: dwrite d3/f4b [0,4194304] 0 2024-09-17T01:52:13.954 INFO:tasks.workunit.client.1.smithi092.stdout:0/656: readlink d3/d1d/l88 0 2024-09-17T01:52:13.956 INFO:tasks.workunit.client.0.smithi031.stdout:5/736: link da/d14/dac/d82/d92/f94 da/d4b/dce/f100 0 2024-09-17T01:52:13.956 INFO:tasks.workunit.client.0.smithi031.stdout:5/737: chown da/d42/fd8 282117035 1 2024-09-17T01:52:13.960 INFO:tasks.workunit.client.0.smithi031.stdout:5/738: creat da/d14/dac/d62/f101 x:0 0 0 2024-09-17T01:52:13.961 INFO:tasks.workunit.client.1.smithi092.stdout:7/604: dwrite d3/db/d98/dce/d6a/fa3 [0,4194304] 0 2024-09-17T01:52:13.962 INFO:tasks.workunit.client.1.smithi092.stdout:8/550: symlink d15/d25/d2b/d3d/d9f/d8e/lb1 0 2024-09-17T01:52:13.963 INFO:tasks.workunit.client.1.smithi092.stdout:6/544: mknod d3/d10/d8c/d43/d6a/d3d/ca7 0 2024-09-17T01:52:13.963 INFO:tasks.workunit.client.1.smithi092.stdout:4/771: dwrite d4/d7b/d7d/f93 [0,4194304] 0 2024-09-17T01:52:13.964 INFO:tasks.workunit.client.0.smithi031.stdout:3/761: unlink db/df/d1d/d37/d4a/f33 0 2024-09-17T01:52:13.965 INFO:tasks.workunit.client.1.smithi092.stdout:7/605: mknod d3/d6/da1/cd0 0 2024-09-17T01:52:13.965 INFO:tasks.workunit.client.1.smithi092.stdout:8/551: write f1 [2124837,68190] 0 2024-09-17T01:52:13.965 INFO:tasks.workunit.client.0.smithi031.stdout:7/840: dread db/f89 [0,4194304] 0 2024-09-17T01:52:13.967 INFO:tasks.workunit.client.1.smithi092.stdout:0/657: creat d3/da/fd3 x:0 0 0 2024-09-17T01:52:13.967 INFO:tasks.workunit.client.0.smithi031.stdout:5/739: mkdir da/d42/d12/d102 0 2024-09-17T01:52:13.969 INFO:tasks.workunit.client.1.smithi092.stdout:4/772: truncate d4/d5/fd3 735379 0 2024-09-17T01:52:13.969 INFO:tasks.workunit.client.1.smithi092.stdout:6/545: write d3/d10/d1f/d21/da5/d18/f6b [4617127,12483] 0 2024-09-17T01:52:13.973 INFO:tasks.workunit.client.0.smithi031.stdout:0/819: dwrite d0/d29/fa2 [0,4194304] 0 2024-09-17T01:52:13.973 INFO:tasks.workunit.client.0.smithi031.stdout:5/740: chown da/d14/f3b 35312271 1 2024-09-17T01:52:13.975 INFO:tasks.workunit.client.1.smithi092.stdout:7/606: getdents d3/d2b/d84/da7 0 2024-09-17T01:52:13.975 INFO:tasks.workunit.client.0.smithi031.stdout:9/727: dread d3/d4/da0/d36/d62/fe7 [0,4194304] 0 2024-09-17T01:52:13.975 INFO:tasks.workunit.client.1.smithi092.stdout:6/546: mkdir d3/d25/da8 0 2024-09-17T01:52:13.976 INFO:tasks.workunit.client.0.smithi031.stdout:5/741: chown da/dc/d25/l61 62703 1 2024-09-17T01:52:13.979 INFO:tasks.workunit.client.1.smithi092.stdout:8/552: dwrite d15/d25/d27/d49/f4a [0,4194304] 0 2024-09-17T01:52:13.980 INFO:tasks.workunit.client.0.smithi031.stdout:9/728: read d3/d19/fa4 [2373423,46525] 0 2024-09-17T01:52:13.981 INFO:tasks.workunit.client.0.smithi031.stdout:3/762: dread db/df/dc8/d6a/d83/dcb/f8f [0,4194304] 0 2024-09-17T01:52:13.982 INFO:tasks.workunit.client.1.smithi092.stdout:7/607: symlink d3/d2b/d37/ld1 0 2024-09-17T01:52:13.982 INFO:tasks.workunit.client.0.smithi031.stdout:1/773: rename d4/d1e/f47 to d4/d1e/d40/daa/dce/dfe/f101 0 2024-09-17T01:52:13.983 INFO:tasks.workunit.client.0.smithi031.stdout:7/841: truncate db/d29/f75 1065808 0 2024-09-17T01:52:13.984 INFO:tasks.workunit.client.1.smithi092.stdout:0/658: dwrite d3/da/d1c/f91 [0,4194304] 0 2024-09-17T01:52:13.988 INFO:tasks.workunit.client.1.smithi092.stdout:0/659: write d3/d1d/d6b/f6c [2236582,57868] 0 2024-09-17T01:52:13.989 INFO:tasks.workunit.client.0.smithi031.stdout:8/680: rename d0/df/dd/d59/c67 to d0/d5/d54/cc7 0 2024-09-17T01:52:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:13 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:13 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:13 smithi092 ceph-mon[33552]: pgmap v17: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 99 MiB/s rd, 290 MiB/s wr, 544 op/s 2024-09-17T01:52:13.992 INFO:tasks.workunit.client.0.smithi031.stdout:7/842: unlink db/d1c/d41/c53 0 2024-09-17T01:52:13.992 INFO:tasks.workunit.client.1.smithi092.stdout:7/608: symlink d3/db/d98/dce/d6a/ld2 0 2024-09-17T01:52:13.993 INFO:tasks.workunit.client.1.smithi092.stdout:8/553: symlink d15/d32/lb2 0 2024-09-17T01:52:13.994 INFO:tasks.workunit.client.1.smithi092.stdout:1/752: dread db/d6c/d7e/fa7 [0,4194304] 0 2024-09-17T01:52:13.994 INFO:tasks.workunit.client.1.smithi092.stdout:0/660: mknod d3/d2e/d3b/d40/d7d/cd4 0 2024-09-17T01:52:13.995 INFO:tasks.workunit.client.1.smithi092.stdout:0/661: readlink d3/d1d/l24 0 2024-09-17T01:52:13.997 INFO:tasks.workunit.client.0.smithi031.stdout:7/843: creat db/d29/d10a/f10b x:0 0 0 2024-09-17T01:52:13.999 INFO:tasks.workunit.client.1.smithi092.stdout:8/554: creat d15/d25/d27/d6e/d76/d83/d98/fb3 x:0 0 0 2024-09-17T01:52:14.000 INFO:tasks.workunit.client.0.smithi031.stdout:2/819: rmdir d1/d3/d2d/db2/d1e/d4f 39 2024-09-17T01:52:14.003 INFO:tasks.workunit.client.0.smithi031.stdout:7/844: creat db/d18/d67/dac/ddd/f10c x:0 0 0 2024-09-17T01:52:14.003 INFO:tasks.workunit.client.1.smithi092.stdout:1/753: dwrite db/f5f [0,4194304] 0 2024-09-17T01:52:14.004 INFO:tasks.workunit.client.0.smithi031.stdout:2/820: symlink d1/d3/d2d/d71/l118 0 2024-09-17T01:52:14.005 INFO:tasks.workunit.client.1.smithi092.stdout:7/609: creat d3/d6/d13/db7/fd3 x:0 0 0 2024-09-17T01:52:14.008 INFO:tasks.workunit.client.1.smithi092.stdout:7/610: readlink d3/d6/d13/d21/d2e/l2f 0 2024-09-17T01:52:14.009 INFO:tasks.workunit.client.0.smithi031.stdout:7/845: rename db/d1c/d46/l68 to db/d1c/d41/d6c/l10d 0 2024-09-17T01:52:14.010 INFO:tasks.workunit.client.1.smithi092.stdout:1/754: getdents db/d1d/d4b/d9a 0 2024-09-17T01:52:14.011 INFO:tasks.workunit.client.0.smithi031.stdout:3/763: unlink db/c20 0 2024-09-17T01:52:14.012 INFO:tasks.workunit.client.1.smithi092.stdout:7/611: dread d3/db/d98/dce/d6a/fa3 [0,4194304] 0 2024-09-17T01:52:14.013 INFO:tasks.workunit.client.0.smithi031.stdout:7/846: rmdir db/d18/d67/dac/ddd/dbf 39 2024-09-17T01:52:14.013 INFO:tasks.workunit.client.0.smithi031.stdout:5/742: dread da/f49 [0,4194304] 0 2024-09-17T01:52:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:13 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:13 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:13 smithi031 ceph-mon[27673]: pgmap v17: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 99 MiB/s rd, 290 MiB/s wr, 544 op/s 2024-09-17T01:52:14.015 INFO:tasks.workunit.client.0.smithi031.stdout:2/821: mknod d1/d3/d2d/db2/d1e/d21/c119 0 2024-09-17T01:52:14.016 INFO:tasks.workunit.client.0.smithi031.stdout:9/729: dread d3/f42 [0,4194304] 0 2024-09-17T01:52:14.016 INFO:tasks.workunit.client.0.smithi031.stdout:3/764: mknod db/df/d1d/d37/d6c/d6e/cf1 0 2024-09-17T01:52:14.018 INFO:tasks.workunit.client.0.smithi031.stdout:9/730: write d3/d4/da0/d36/d62/db2/fd9 [714505,35572] 0 2024-09-17T01:52:14.018 INFO:tasks.workunit.client.0.smithi031.stdout:7/847: mkdir db/d18/d67/d10e 0 2024-09-17T01:52:14.019 INFO:tasks.workunit.client.0.smithi031.stdout:5/743: symlink da/d14/dac/d82/ddd/l103 0 2024-09-17T01:52:14.020 INFO:tasks.workunit.client.0.smithi031.stdout:7/848: chown db/c7c 44053 1 2024-09-17T01:52:14.023 INFO:tasks.workunit.client.0.smithi031.stdout:7/849: dread - db/d1c/ff1 zero size 2024-09-17T01:52:14.025 INFO:tasks.workunit.client.0.smithi031.stdout:9/731: mkdir d3/d4/da0/d36/d62/dd8/dea 0 2024-09-17T01:52:14.026 INFO:tasks.workunit.client.0.smithi031.stdout:3/765: dwrite db/df/dc8/d6a/fcd [0,4194304] 0 2024-09-17T01:52:14.030 INFO:tasks.workunit.client.0.smithi031.stdout:7/850: rename db/l13 to db/d1c/d41/d6c/d100/l10f 0 2024-09-17T01:52:14.032 INFO:tasks.workunit.client.0.smithi031.stdout:9/732: dread d3/d19/d1f/f6b [0,4194304] 0 2024-09-17T01:52:14.032 INFO:tasks.workunit.client.0.smithi031.stdout:3/766: chown db/c28 516831420 1 2024-09-17T01:52:14.033 INFO:tasks.workunit.client.0.smithi031.stdout:5/744: dread f8 [0,4194304] 0 2024-09-17T01:52:14.033 INFO:tasks.workunit.client.0.smithi031.stdout:7/851: write db/d1c/d46/d95/fc5 [1101475,63661] 0 2024-09-17T01:52:14.034 INFO:tasks.workunit.client.0.smithi031.stdout:3/767: fdatasync db/da3/fbb 0 2024-09-17T01:52:14.035 INFO:tasks.workunit.client.0.smithi031.stdout:9/733: mknod d3/d19/d80/db9/ceb 0 2024-09-17T01:52:14.039 INFO:tasks.workunit.client.0.smithi031.stdout:7/852: creat db/d18/d67/d10e/f110 x:0 0 0 2024-09-17T01:52:14.039 INFO:tasks.workunit.client.0.smithi031.stdout:3/768: mkdir db/df/d1d/df2 0 2024-09-17T01:52:14.045 INFO:tasks.workunit.client.0.smithi031.stdout:9/734: dwrite d3/f2a [4194304,4194304] 0 2024-09-17T01:52:14.046 INFO:tasks.workunit.client.0.smithi031.stdout:3/769: creat db/df/dc8/d6a/d83/de4/ff3 x:0 0 0 2024-09-17T01:52:14.047 INFO:tasks.workunit.client.0.smithi031.stdout:9/735: creat d3/d19/d1f/fec x:0 0 0 2024-09-17T01:52:14.048 INFO:tasks.workunit.client.0.smithi031.stdout:3/770: chown db/df/d1d/d37/d77/fcf 127802 1 2024-09-17T01:52:14.048 INFO:tasks.workunit.client.0.smithi031.stdout:3/771: readlink db/df/l5e 0 2024-09-17T01:52:14.048 INFO:tasks.workunit.client.0.smithi031.stdout:3/772: chown db/d29 101598 1 2024-09-17T01:52:14.049 INFO:tasks.workunit.client.0.smithi031.stdout:9/736: write d3/fb [1380119,86756] 0 2024-09-17T01:52:14.051 INFO:tasks.workunit.client.0.smithi031.stdout:3/773: mkdir db/d82/df4 0 2024-09-17T01:52:14.052 INFO:tasks.workunit.client.0.smithi031.stdout:9/737: symlink d3/d19/d1f/d44/led 0 2024-09-17T01:52:14.053 INFO:tasks.workunit.client.0.smithi031.stdout:3/774: symlink db/df/d1d/d37/d77/lf5 0 2024-09-17T01:52:14.055 INFO:tasks.workunit.client.0.smithi031.stdout:9/738: unlink d3/d4/da0/d36/d99/cce 0 2024-09-17T01:52:14.057 INFO:tasks.workunit.client.0.smithi031.stdout:3/775: link db/df/dc8/d6a/fcd db/df/d1d/d37/d6c/d6e/dd4/ff6 0 2024-09-17T01:52:14.067 INFO:tasks.workunit.client.0.smithi031.stdout:9/739: dread d3/d4/d41/f7a [0,4194304] 0 2024-09-17T01:52:14.073 INFO:tasks.workunit.client.1.smithi092.stdout:5/507: sync 2024-09-17T01:52:14.090 INFO:tasks.workunit.client.1.smithi092.stdout:5/508: fdatasync d0/d7e/f85 0 2024-09-17T01:52:14.090 INFO:tasks.workunit.client.1.smithi092.stdout:6/547: truncate d3/d10/d1f/d21/d28/f2f 279675 0 2024-09-17T01:52:14.090 INFO:tasks.workunit.client.1.smithi092.stdout:0/662: truncate d3/d2e/d3b/f94 3683395 0 2024-09-17T01:52:14.091 INFO:tasks.workunit.client.1.smithi092.stdout:7/612: dread - d3/db/d98/dce/d6a/f9b zero size 2024-09-17T01:52:14.094 INFO:tasks.workunit.client.1.smithi092.stdout:0/663: readlink d3/d2e/d3b/d8f/lb5 0 2024-09-17T01:52:14.106 INFO:tasks.workunit.client.0.smithi031.stdout:8/681: symlink d0/d5/d54/lc8 0 2024-09-17T01:52:14.107 INFO:tasks.workunit.client.1.smithi092.stdout:7/613: dread - d3/d6/d13/d21/d2e/d6e/f99 zero size 2024-09-17T01:52:14.108 INFO:tasks.workunit.client.1.smithi092.stdout:6/548: write d3/d10/d1f/d21/d28/f56 [1732274,98124] 0 2024-09-17T01:52:14.108 INFO:tasks.workunit.client.1.smithi092.stdout:0/664: write d3/d2e/d55/d63/f6d [133475,77869] 0 2024-09-17T01:52:14.109 INFO:tasks.workunit.client.1.smithi092.stdout:5/509: creat d0/d50/d70/d78/d8f/fa4 x:0 0 0 2024-09-17T01:52:14.109 INFO:tasks.workunit.client.1.smithi092.stdout:0/665: chown d3/f28 180 1 2024-09-17T01:52:14.109 INFO:tasks.workunit.client.1.smithi092.stdout:6/549: chown d3/d10/d8c/d43/d6a/d3d 72624 1 2024-09-17T01:52:14.109 INFO:tasks.workunit.client.1.smithi092.stdout:7/614: mknod d3/d2b/d84/cd4 0 2024-09-17T01:52:14.111 INFO:tasks.workunit.client.1.smithi092.stdout:6/550: write d3/d10/d1f/d21/d28/f99 [3964042,76098] 0 2024-09-17T01:52:14.113 INFO:tasks.workunit.client.1.smithi092.stdout:6/551: read - d3/d10/d1f/d21/f65 zero size 2024-09-17T01:52:14.115 INFO:tasks.workunit.client.1.smithi092.stdout:1/755: dread db/d1d/d23/f3c [0,4194304] 0 2024-09-17T01:52:14.116 INFO:tasks.workunit.client.1.smithi092.stdout:1/756: chown db/d1d/d23/d34/c3e 27 1 2024-09-17T01:52:14.117 INFO:tasks.workunit.client.0.smithi031.stdout:8/682: dread d0/d5/d6c/db0/fb3 [0,4194304] 0 2024-09-17T01:52:14.120 INFO:tasks.workunit.client.0.smithi031.stdout:2/822: dwrite d1/d3/d2d/d91/f108 [0,4194304] 0 2024-09-17T01:52:14.121 INFO:tasks.workunit.client.0.smithi031.stdout:8/683: write d0/d5/f40 [401092,114725] 0 2024-09-17T01:52:14.122 INFO:tasks.workunit.client.0.smithi031.stdout:7/853: truncate db/d18/f9e 3247415 0 2024-09-17T01:52:14.123 INFO:tasks.workunit.client.0.smithi031.stdout:3/776: dread db/f12 [0,4194304] 0 2024-09-17T01:52:14.128 INFO:tasks.workunit.client.0.smithi031.stdout:3/777: mkdir db/df/dc8/d6a/dc3/ddb/df7 0 2024-09-17T01:52:14.129 INFO:tasks.workunit.client.0.smithi031.stdout:2/823: dwrite d1/d3/d2d/db2/d1e/d21/ddf/f73 [0,4194304] 0 2024-09-17T01:52:14.135 INFO:tasks.workunit.client.0.smithi031.stdout:8/684: link d0/df/la8 d0/df/dd/da9/lc9 0 2024-09-17T01:52:14.142 INFO:tasks.workunit.client.0.smithi031.stdout:3/778: dwrite db/df/dc8/d6a/f92 [4194304,4194304] 0 2024-09-17T01:52:14.143 INFO:tasks.workunit.client.0.smithi031.stdout:2/824: dwrite d1/d3/d2d/db2/d1e/d2a/f95 [0,4194304] 0 2024-09-17T01:52:14.144 INFO:tasks.workunit.client.0.smithi031.stdout:9/740: dwrite d3/d19/d1f/d44/d64/fde [0,4194304] 0 2024-09-17T01:52:14.152 INFO:tasks.workunit.client.0.smithi031.stdout:2/825: dread d1/d3/d2d/d91/f108 [0,4194304] 0 2024-09-17T01:52:14.160 INFO:tasks.workunit.client.0.smithi031.stdout:8/685: mkdir d0/df/d19/d86/dca 0 2024-09-17T01:52:14.161 INFO:tasks.workunit.client.0.smithi031.stdout:9/741: readlink d3/d4/da0/l26 0 2024-09-17T01:52:14.165 INFO:tasks.workunit.client.0.smithi031.stdout:3/779: rename db/df/d50/f51 to db/df/dc8/d6a/d83/de4/ff8 0 2024-09-17T01:52:14.170 INFO:tasks.workunit.client.0.smithi031.stdout:8/686: dwrite d0/d5/fab [0,4194304] 0 2024-09-17T01:52:14.173 INFO:tasks.workunit.client.0.smithi031.stdout:3/780: read db/df/d50/f75 [283964,91735] 0 2024-09-17T01:52:14.175 INFO:tasks.workunit.client.0.smithi031.stdout:9/742: dwrite d3/d4/da0/d36/d79/fab [0,4194304] 0 2024-09-17T01:52:14.179 INFO:tasks.workunit.client.0.smithi031.stdout:2/826: dwrite d1/f103 [0,4194304] 0 2024-09-17T01:52:14.181 INFO:tasks.workunit.client.0.smithi031.stdout:2/827: readlink d1/d3/d2d/db2/d1e/l5c 0 2024-09-17T01:52:14.183 INFO:tasks.workunit.client.0.smithi031.stdout:8/687: creat d0/d5/fcb x:0 0 0 2024-09-17T01:52:14.187 INFO:tasks.workunit.client.0.smithi031.stdout:9/743: mkdir d3/d4/da0/d36/d8f/dee 0 2024-09-17T01:52:14.192 INFO:tasks.workunit.client.0.smithi031.stdout:8/688: write d0/d5/d54/d60/f66 [1520674,106012] 0 2024-09-17T01:52:14.194 INFO:tasks.workunit.client.0.smithi031.stdout:8/689: mkdir d0/dcc 0 2024-09-17T01:52:14.195 INFO:tasks.workunit.client.0.smithi031.stdout:2/828: dwrite d1/d3/df/d11/f2f [4194304,4194304] 0 2024-09-17T01:52:14.197 INFO:tasks.workunit.client.0.smithi031.stdout:2/829: rmdir d1/d3/d2d/d91/dad 39 2024-09-17T01:52:14.199 INFO:tasks.workunit.client.0.smithi031.stdout:8/690: fsync d0/d5/d54/f8c 0 2024-09-17T01:52:14.201 INFO:tasks.workunit.client.1.smithi092.stdout:1/757: mknod db/d1d/d23/d34/ced 0 2024-09-17T01:52:14.203 INFO:tasks.workunit.client.0.smithi031.stdout:8/691: dread d0/d5/f11 [0,4194304] 0 2024-09-17T01:52:14.204 INFO:tasks.workunit.client.1.smithi092.stdout:7/615: write d3/db/d98/dce/f6c [1189166,68898] 0 2024-09-17T01:52:14.204 INFO:tasks.workunit.client.0.smithi031.stdout:2/830: rename d1/d3/df/d11/c31 to d1/d3/df/d11/d30/ddd/c11a 0 2024-09-17T01:52:14.206 INFO:tasks.workunit.client.0.smithi031.stdout:8/692: write d0/d5/f5e [5012243,108809] 0 2024-09-17T01:52:14.206 INFO:tasks.workunit.client.1.smithi092.stdout:0/666: rmdir d3/d2e/d3b/d8f/dca 0 2024-09-17T01:52:14.207 INFO:tasks.workunit.client.1.smithi092.stdout:5/510: truncate d0/de/d19/d1a/d1e/f1d 814106 0 2024-09-17T01:52:14.208 INFO:tasks.workunit.client.0.smithi031.stdout:3/781: write db/df/d1d/d37/d6c/d6e/f9f [807319,16787] 0 2024-09-17T01:52:14.209 INFO:tasks.workunit.client.1.smithi092.stdout:0/667: dread - d3/da/fd3 zero size 2024-09-17T01:52:14.210 INFO:tasks.workunit.client.1.smithi092.stdout:7/616: creat d3/db/d26/d83/fd5 x:0 0 0 2024-09-17T01:52:14.210 INFO:tasks.workunit.client.1.smithi092.stdout:1/758: dwrite db/d1d/d2e/d62/fc0 [0,4194304] 0 2024-09-17T01:52:14.211 INFO:tasks.workunit.client.0.smithi031.stdout:8/693: dread d0/df/dd/d59/f6f [0,4194304] 0 2024-09-17T01:52:14.212 INFO:tasks.workunit.client.1.smithi092.stdout:5/511: mkdir d0/d50/da5 0 2024-09-17T01:52:14.215 INFO:tasks.workunit.client.1.smithi092.stdout:7/617: rename d3/d2b/l69 to d3/db/d26/d83/da6/ld6 0 2024-09-17T01:52:14.216 INFO:tasks.workunit.client.1.smithi092.stdout:5/512: stat d0/de/d19/d1a/d1e/d3e/d4c/c80 0 2024-09-17T01:52:14.217 INFO:tasks.workunit.client.0.smithi031.stdout:9/744: dwrite d3/d19/d1f/d44/f57 [0,4194304] 0 2024-09-17T01:52:14.218 INFO:tasks.workunit.client.0.smithi031.stdout:9/745: stat d3/d19/d1f/l8d 0 2024-09-17T01:52:14.219 INFO:tasks.workunit.client.1.smithi092.stdout:7/618: fdatasync d3/db/d7b/fbc 0 2024-09-17T01:52:14.221 INFO:tasks.workunit.client.1.smithi092.stdout:1/759: dwrite db/d1d/d2e/d62/fbe [0,4194304] 0 2024-09-17T01:52:14.224 INFO:tasks.workunit.client.1.smithi092.stdout:5/513: symlink d0/de/d19/d3c/d41/d8d/la6 0 2024-09-17T01:52:14.226 INFO:tasks.workunit.client.0.smithi031.stdout:8/694: link d0/d5/d6c/db0/db7/c95 d0/df/d19/d86/dca/ccd 0 2024-09-17T01:52:14.227 INFO:tasks.workunit.client.0.smithi031.stdout:2/831: truncate d1/d3/d2d/d42/f83 1135699 0 2024-09-17T01:52:14.227 INFO:tasks.workunit.client.1.smithi092.stdout:7/619: symlink d3/db/d98/dce/daf/ld7 0 2024-09-17T01:52:14.228 INFO:tasks.workunit.client.1.smithi092.stdout:5/514: dread - d0/de/d19/d3c/d41/f73 zero size 2024-09-17T01:52:14.229 INFO:tasks.workunit.client.0.smithi031.stdout:3/782: truncate db/df/dc8/d6a/f92 7088278 0 2024-09-17T01:52:14.229 INFO:tasks.workunit.client.1.smithi092.stdout:1/760: creat db/d6c/db3/dea/deb/fee x:0 0 0 2024-09-17T01:52:14.230 INFO:tasks.workunit.client.1.smithi092.stdout:7/620: fsync d3/d2b/d37/f8b 0 2024-09-17T01:52:14.231 INFO:tasks.workunit.client.0.smithi031.stdout:3/783: dread - db/df/d1d/fce zero size 2024-09-17T01:52:14.232 INFO:tasks.workunit.client.0.smithi031.stdout:2/832: fsync d1/d3/d2d/d91/ff4 0 2024-09-17T01:52:14.234 INFO:tasks.workunit.client.1.smithi092.stdout:1/761: mkdir db/d6c/d7e/d82/def 0 2024-09-17T01:52:14.234 INFO:tasks.workunit.client.0.smithi031.stdout:9/746: dwrite d3/d19/fa4 [0,4194304] 0 2024-09-17T01:52:14.235 INFO:tasks.workunit.client.1.smithi092.stdout:6/552: dread d3/d10/d1f/d21/f3b [0,4194304] 0 2024-09-17T01:52:14.237 INFO:tasks.workunit.client.1.smithi092.stdout:7/621: read d3/db/d26/f6d [638218,4144] 0 2024-09-17T01:52:14.237 INFO:tasks.workunit.client.0.smithi031.stdout:2/833: symlink d1/d7c/l11b 0 2024-09-17T01:52:14.240 INFO:tasks.workunit.client.1.smithi092.stdout:1/762: creat db/d1d/ff0 x:0 0 0 2024-09-17T01:52:14.242 INFO:tasks.workunit.client.0.smithi031.stdout:3/784: dwrite db/f12 [0,4194304] 0 2024-09-17T01:52:14.243 INFO:tasks.workunit.client.0.smithi031.stdout:2/834: write d1/d3/d2d/d91/dad/fe1 [287168,20945] 0 2024-09-17T01:52:14.244 INFO:tasks.workunit.client.0.smithi031.stdout:9/747: dwrite d3/d19/d1f/f21 [0,4194304] 0 2024-09-17T01:52:14.247 INFO:tasks.workunit.client.1.smithi092.stdout:6/553: link d3/d10/d8c/d43/d5e/d73/d8f/c9b d3/d10/d1f/d21/da5/d18/ca9 0 2024-09-17T01:52:14.248 INFO:tasks.workunit.client.0.smithi031.stdout:9/748: stat d3/d4/da0/d36/d62/c6a 0 2024-09-17T01:52:14.248 INFO:tasks.workunit.client.1.smithi092.stdout:6/554: fsync d3/d10/d8c/d43/d6a/d3d/f95 0 2024-09-17T01:52:14.249 INFO:tasks.workunit.client.0.smithi031.stdout:3/785: write db/df/d1d/d37/d6c/d6e/f85 [1028156,19979] 0 2024-09-17T01:52:14.251 INFO:tasks.workunit.client.0.smithi031.stdout:3/786: chown db/df/dc8/d6a/d83/dcb/l40 1098 1 2024-09-17T01:52:14.252 INFO:tasks.workunit.client.0.smithi031.stdout:2/835: mkdir d1/d3/d2d/d11c 0 2024-09-17T01:52:14.253 INFO:tasks.workunit.client.1.smithi092.stdout:6/555: creat d3/d10/d8c/d43/d5e/d73/d8f/da4/faa x:0 0 0 2024-09-17T01:52:14.254 INFO:tasks.workunit.client.1.smithi092.stdout:6/556: readlink d3/d10/d8c/d43/l5a 0 2024-09-17T01:52:14.255 INFO:tasks.workunit.client.1.smithi092.stdout:6/557: stat d3/d10/d8c/c4d 0 2024-09-17T01:52:14.255 INFO:tasks.workunit.client.0.smithi031.stdout:2/836: creat d1/d3/df/d18/d40/d43/f11d x:0 0 0 2024-09-17T01:52:14.256 INFO:tasks.workunit.client.1.smithi092.stdout:6/558: chown d3/d10/d1f/d21/l58 219 1 2024-09-17T01:52:14.258 INFO:tasks.workunit.client.0.smithi031.stdout:2/837: stat d1/d3/df/d11/d30/ddd/ce7 0 2024-09-17T01:52:14.259 INFO:tasks.workunit.client.0.smithi031.stdout:2/838: write d1/d3/d2d/f38 [5998421,108689] 0 2024-09-17T01:52:14.261 INFO:tasks.workunit.client.0.smithi031.stdout:2/839: write d1/d3/d2d/db2/d1e/f97 [56801,62500] 0 2024-09-17T01:52:14.262 INFO:tasks.workunit.client.0.smithi031.stdout:2/840: chown d1/d3/d2d/db2/d1e/d21/d34 6 1 2024-09-17T01:52:14.265 INFO:tasks.workunit.client.0.smithi031.stdout:2/841: mknod d1/d3/d2d/d71/c11e 0 2024-09-17T01:52:14.266 INFO:tasks.workunit.client.0.smithi031.stdout:2/842: dread - d1/d3/d45/d4a/f10d zero size 2024-09-17T01:52:14.266 INFO:tasks.workunit.client.1.smithi092.stdout:5/515: truncate d0/de/d19/d1a/d1e/d29/f7c 1168849 0 2024-09-17T01:52:14.269 INFO:tasks.workunit.client.0.smithi031.stdout:2/843: write d1/d3/df/d11/d30/da1/dca/f101 [811540,130546] 0 2024-09-17T01:52:14.270 INFO:tasks.workunit.client.1.smithi092.stdout:5/516: unlink d0/de/d19/d1a/d1e/d52/l6a 0 2024-09-17T01:52:14.270 INFO:tasks.workunit.client.0.smithi031.stdout:2/844: dread - d1/d3/d2d/db2/f5e zero size 2024-09-17T01:52:14.273 INFO:tasks.workunit.client.0.smithi031.stdout:8/695: dwrite d0/df/d19/f90 [0,4194304] 0 2024-09-17T01:52:14.274 INFO:tasks.workunit.client.1.smithi092.stdout:5/517: chown d0/de/d19/d3c/d41/d8d 2926 1 2024-09-17T01:52:14.274 INFO:tasks.workunit.client.1.smithi092.stdout:7/622: dwrite d3/d6/d13/d21/d2e/d6e/f86 [0,4194304] 0 2024-09-17T01:52:14.276 INFO:tasks.workunit.client.0.smithi031.stdout:2/845: unlink d1/d3/d2d/db2/d1e/d4f/fc6 0 2024-09-17T01:52:14.278 INFO:tasks.workunit.client.0.smithi031.stdout:8/696: readlink d0/df/la8 0 2024-09-17T01:52:14.278 INFO:tasks.workunit.client.0.smithi031.stdout:2/846: chown d1/d7c/fd9 25424063 1 2024-09-17T01:52:14.280 INFO:tasks.workunit.client.1.smithi092.stdout:1/763: dwrite db/d1d/d23/f4c [0,4194304] 0 2024-09-17T01:52:14.281 INFO:tasks.workunit.client.0.smithi031.stdout:9/749: dread d3/d4c/f4f [0,4194304] 0 2024-09-17T01:52:14.283 INFO:tasks.workunit.client.1.smithi092.stdout:7/623: symlink d3/db/d98/dce/d60/d93/ld8 0 2024-09-17T01:52:14.293 INFO:tasks.workunit.client.0.smithi031.stdout:2/847: dwrite d1/d3/d2d/f8b [0,4194304] 0 2024-09-17T01:52:14.294 INFO:tasks.workunit.client.0.smithi031.stdout:3/787: dwrite db/df/d50/f8d [0,4194304] 0 2024-09-17T01:52:14.296 INFO:tasks.workunit.client.1.smithi092.stdout:7/624: symlink d3/d6/ld9 0 2024-09-17T01:52:14.299 INFO:tasks.workunit.client.0.smithi031.stdout:9/750: dwrite d3/d4/da0/d36/d62/fe7 [0,4194304] 0 2024-09-17T01:52:14.300 INFO:tasks.workunit.client.0.smithi031.stdout:3/788: rmdir db/d29 39 2024-09-17T01:52:14.301 INFO:tasks.workunit.client.0.smithi031.stdout:3/789: stat db/df/d1d/d37/fdf 0 2024-09-17T01:52:14.302 INFO:tasks.workunit.client.0.smithi031.stdout:0/820: sync 2024-09-17T01:52:14.304 INFO:tasks.workunit.client.1.smithi092.stdout:7/625: read d3/db/d26/f66 [5092182,70208] 0 2024-09-17T01:52:14.304 INFO:tasks.workunit.client.0.smithi031.stdout:9/751: stat d3/d4/da0/d36/d62/db2/dd4 0 2024-09-17T01:52:14.305 INFO:tasks.workunit.client.1.smithi092.stdout:7/626: fsync d3/fc 0 2024-09-17T01:52:14.306 INFO:tasks.workunit.client.1.smithi092.stdout:7/627: chown c1 126051761 1 2024-09-17T01:52:14.306 INFO:tasks.workunit.client.0.smithi031.stdout:0/821: symlink d0/d29/d44/l11b 0 2024-09-17T01:52:14.307 INFO:tasks.workunit.client.1.smithi092.stdout:7/628: fdatasync d3/db/f4a 0 2024-09-17T01:52:14.307 INFO:tasks.workunit.client.1.smithi092.stdout:1/764: dread db/d1d/d4b/f56 [0,4194304] 0 2024-09-17T01:52:14.308 INFO:tasks.workunit.client.0.smithi031.stdout:9/752: mknod d3/d4c/cef 0 2024-09-17T01:52:14.308 INFO:tasks.workunit.client.0.smithi031.stdout:3/790: symlink db/df/d1d/d37/d77/de3/lf9 0 2024-09-17T01:52:14.311 INFO:tasks.workunit.client.1.smithi092.stdout:1/765: creat db/d6c/db3/dea/deb/ff1 x:0 0 0 2024-09-17T01:52:14.313 INFO:tasks.workunit.client.0.smithi031.stdout:9/753: link d3/d19/f34 d3/d4/da0/d36/ff0 0 2024-09-17T01:52:14.315 INFO:tasks.workunit.client.0.smithi031.stdout:0/822: dwrite d0/d29/d33/d2a/d25/d38/fef [0,4194304] 0 2024-09-17T01:52:14.315 INFO:tasks.workunit.client.0.smithi031.stdout:9/754: write d3/d19/d1f/f21 [3304230,27749] 0 2024-09-17T01:52:14.320 INFO:tasks.workunit.client.0.smithi031.stdout:9/755: creat d3/d19/d1f/d44/ff1 x:0 0 0 2024-09-17T01:52:14.321 INFO:tasks.workunit.client.0.smithi031.stdout:0/823: read d0/d29/d33/fdc [48116,84763] 0 2024-09-17T01:52:14.326 INFO:tasks.workunit.client.0.smithi031.stdout:0/824: creat d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/d104/f11c x:0 0 0 2024-09-17T01:52:14.328 INFO:tasks.workunit.client.0.smithi031.stdout:0/825: creat d0/f11d x:0 0 0 2024-09-17T01:52:14.329 INFO:tasks.workunit.client.1.smithi092.stdout:5/518: truncate d0/de/d19/d1a/d1e/f36 8254291 0 2024-09-17T01:52:14.330 INFO:tasks.workunit.client.0.smithi031.stdout:0/826: creat d0/d29/d33/d5/dad/f11e x:0 0 0 2024-09-17T01:52:14.333 INFO:tasks.workunit.client.1.smithi092.stdout:5/519: readlink d0/de/d19/l91 0 2024-09-17T01:52:14.335 INFO:tasks.workunit.client.1.smithi092.stdout:7/629: write d3/db/d26/f6d [1682545,120134] 0 2024-09-17T01:52:14.335 INFO:tasks.workunit.client.0.smithi031.stdout:8/697: truncate d0/df/dd/f45 967051 0 2024-09-17T01:52:14.335 INFO:tasks.workunit.client.0.smithi031.stdout:0/827: link d0/f7d d0/d29/da7/f11f 0 2024-09-17T01:52:14.336 INFO:tasks.workunit.client.1.smithi092.stdout:1/766: write db/f87 [3099544,69783] 0 2024-09-17T01:52:14.337 INFO:tasks.workunit.client.1.smithi092.stdout:7/630: readlink d3/d2b/d84/da7/l75 0 2024-09-17T01:52:14.337 INFO:tasks.workunit.client.1.smithi092.stdout:5/520: symlink d0/de/d19/d1a/d1e/d3e/la7 0 2024-09-17T01:52:14.339 INFO:tasks.workunit.client.0.smithi031.stdout:2/848: write d1/d3/d2d/db2/d1e/f3e [18240,27253] 0 2024-09-17T01:52:14.342 INFO:tasks.workunit.client.1.smithi092.stdout:5/521: fdatasync d0/de/d19/d1a/d1e/d3e/f59 0 2024-09-17T01:52:14.343 INFO:tasks.workunit.client.0.smithi031.stdout:2/849: chown d1/d3/df/d11/d30/ddd/de3/fea 147930 1 2024-09-17T01:52:14.343 INFO:tasks.workunit.client.0.smithi031.stdout:0/828: dwrite d0/d29/da7/db3/d4a/d86/fd9 [0,4194304] 0 2024-09-17T01:52:14.343 INFO:tasks.workunit.client.0.smithi031.stdout:2/850: chown d1/d3/d45 4938671 1 2024-09-17T01:52:14.344 INFO:tasks.workunit.client.1.smithi092.stdout:1/767: dread db/d1d/d23/f3c [0,4194304] 0 2024-09-17T01:52:14.344 INFO:tasks.workunit.client.0.smithi031.stdout:9/756: write d3/f1d [768676,6975] 0 2024-09-17T01:52:14.345 INFO:tasks.workunit.client.0.smithi031.stdout:9/757: fdatasync d3/d19/d80/f8a 0 2024-09-17T01:52:14.346 INFO:tasks.workunit.client.0.smithi031.stdout:2/851: write d1/d3/d2d/d91/dad/fe4 [448669,29152] 0 2024-09-17T01:52:14.346 INFO:tasks.workunit.client.1.smithi092.stdout:7/631: dwrite d3/db/d26/d83/fd5 [0,4194304] 0 2024-09-17T01:52:14.346 INFO:tasks.workunit.client.1.smithi092.stdout:1/768: read - db/d1d/d23/d88/f99 zero size 2024-09-17T01:52:14.347 INFO:tasks.workunit.client.0.smithi031.stdout:1/774: sync 2024-09-17T01:52:14.347 INFO:tasks.workunit.client.0.smithi031.stdout:7/854: sync 2024-09-17T01:52:14.347 INFO:tasks.workunit.client.0.smithi031.stdout:5/745: sync 2024-09-17T01:52:14.347 INFO:tasks.workunit.client.1.smithi092.stdout:5/522: creat d0/de/d19/d1a/d1e/d29/fa8 x:0 0 0 2024-09-17T01:52:14.349 INFO:tasks.workunit.client.1.smithi092.stdout:5/523: chown d0/de/d19/d1a/d1e/f5c 43638304 1 2024-09-17T01:52:14.353 INFO:tasks.workunit.client.0.smithi031.stdout:9/758: creat d3/d19/d80/db9/ff2 x:0 0 0 2024-09-17T01:52:14.354 INFO:tasks.workunit.client.1.smithi092.stdout:7/632: creat d3/db/d98/dce/fda x:0 0 0 2024-09-17T01:52:14.355 INFO:tasks.workunit.client.0.smithi031.stdout:5/746: truncate da/d42/d12/d72/f97 1945289 0 2024-09-17T01:52:14.355 INFO:tasks.workunit.client.0.smithi031.stdout:8/698: truncate d0/d5/fa 331717 0 2024-09-17T01:52:14.356 INFO:tasks.workunit.client.1.smithi092.stdout:5/524: link d0/de/d19/d1a/d1e/d3e/f59 d0/fa9 0 2024-09-17T01:52:14.356 INFO:tasks.workunit.client.0.smithi031.stdout:0/829: dwrite d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:52:14.358 INFO:tasks.workunit.client.0.smithi031.stdout:7/855: mknod db/d1c/d41/d69/c111 0 2024-09-17T01:52:14.359 INFO:tasks.workunit.client.1.smithi092.stdout:5/525: creat d0/de/d19/d1a/d1e/d3e/d4c/faa x:0 0 0 2024-09-17T01:52:14.360 INFO:tasks.workunit.client.0.smithi031.stdout:9/759: unlink d3/d4/da0/f60 0 2024-09-17T01:52:14.362 INFO:tasks.workunit.client.1.smithi092.stdout:5/526: truncate d0/de/d19/d1a/d1e/f75 94952 0 2024-09-17T01:52:14.362 INFO:tasks.workunit.client.1.smithi092.stdout:5/527: chown d0/de/l32 3 1 2024-09-17T01:52:14.363 INFO:tasks.workunit.client.0.smithi031.stdout:5/747: mkdir da/d4b/d6c/df2/d104 0 2024-09-17T01:52:14.364 INFO:tasks.workunit.client.0.smithi031.stdout:5/748: readlink da/d42/d12/lcb 0 2024-09-17T01:52:14.364 INFO:tasks.workunit.client.1.smithi092.stdout:5/528: mknod d0/de/d19/d1a/d1e/cab 0 2024-09-17T01:52:14.366 INFO:tasks.workunit.client.0.smithi031.stdout:0/830: symlink d0/d37/l120 0 2024-09-17T01:52:14.368 INFO:tasks.workunit.client.0.smithi031.stdout:0/831: chown d0/d29/d33/d2a/d25/d38/f41 358 1 2024-09-17T01:52:14.368 INFO:tasks.workunit.client.1.smithi092.stdout:5/529: creat d0/d50/d70/d78/d8f/fac x:0 0 0 2024-09-17T01:52:14.371 INFO:tasks.workunit.client.1.smithi092.stdout:5/530: symlink d0/de/d19/d3c/lad 0 2024-09-17T01:52:14.373 INFO:tasks.workunit.client.0.smithi031.stdout:7/856: dwrite db/d1c/f5c [0,4194304] 0 2024-09-17T01:52:14.374 INFO:tasks.workunit.client.1.smithi092.stdout:1/769: dwrite db/d1d/d23/d88/fc8 [0,4194304] 0 2024-09-17T01:52:14.375 INFO:tasks.workunit.client.1.smithi092.stdout:1/770: readlink db/d1d/d23/d55/de5/l97 0 2024-09-17T01:52:14.375 INFO:tasks.workunit.client.0.smithi031.stdout:8/699: creat d0/df/dd/d77/fce x:0 0 0 2024-09-17T01:52:14.376 INFO:tasks.workunit.client.1.smithi092.stdout:1/771: write db/f87 [4357401,8081] 0 2024-09-17T01:52:14.376 INFO:tasks.workunit.client.0.smithi031.stdout:0/832: unlink d0/d29/d33/d5/d48/d56/dc8/f10e 0 2024-09-17T01:52:14.377 INFO:tasks.workunit.client.0.smithi031.stdout:9/760: link d3/d4/da0/d36/f6e d3/d19/d80/ff3 0 2024-09-17T01:52:14.378 INFO:tasks.workunit.client.1.smithi092.stdout:1/772: chown db/fd 7 1 2024-09-17T01:52:14.378 INFO:tasks.workunit.client.1.smithi092.stdout:1/773: chown db/d6c/d8b 9362171 1 2024-09-17T01:52:14.379 INFO:tasks.workunit.client.0.smithi031.stdout:0/833: stat d0/d29/da7/db3/d4a/d86/dd7/c61 0 2024-09-17T01:52:14.380 INFO:tasks.workunit.client.1.smithi092.stdout:3/600: sync 2024-09-17T01:52:14.386 INFO:tasks.workunit.client.0.smithi031.stdout:2/852: dwrite d1/d3/d2d/db2/f33 [4194304,4194304] 0 2024-09-17T01:52:14.388 INFO:tasks.workunit.client.1.smithi092.stdout:3/601: read d4/d2f/d44/fae [736669,24230] 0 2024-09-17T01:52:14.389 INFO:tasks.workunit.client.0.smithi031.stdout:9/761: rmdir d3/d47 39 2024-09-17T01:52:14.389 INFO:tasks.workunit.client.1.smithi092.stdout:3/602: truncate d4/d13/d2e/d43/fa2 926297 0 2024-09-17T01:52:14.390 INFO:tasks.workunit.client.0.smithi031.stdout:9/762: chown d3/d19/d1f/d44/d64/fbf 8174899 1 2024-09-17T01:52:14.391 INFO:tasks.workunit.client.0.smithi031.stdout:9/763: dread - d3/d4/fc6 zero size 2024-09-17T01:52:14.397 INFO:tasks.workunit.client.0.smithi031.stdout:8/700: mkdir d0/d5/d9b/dcf 0 2024-09-17T01:52:14.397 INFO:tasks.workunit.client.0.smithi031.stdout:8/701: write d0/d5/d9b/f49 [2897000,37069] 0 2024-09-17T01:52:14.397 INFO:tasks.workunit.client.0.smithi031.stdout:1/775: truncate d4/d1a/d2d/fa 4708517 0 2024-09-17T01:52:14.403 INFO:tasks.workunit.client.0.smithi031.stdout:7/857: rmdir db/d18/d67/dac/ddd/dc1/dfe 0 2024-09-17T01:52:14.404 INFO:tasks.workunit.client.1.smithi092.stdout:1/774: mkdir db/d6c/d7e/df2 0 2024-09-17T01:52:14.404 INFO:tasks.workunit.client.0.smithi031.stdout:8/702: symlink d0/d5/d6c/db0/db7/ld0 0 2024-09-17T01:52:14.405 INFO:tasks.workunit.client.0.smithi031.stdout:5/749: link da/dc/l1f da/d14/l105 0 2024-09-17T01:52:14.405 INFO:tasks.workunit.client.0.smithi031.stdout:1/776: dread d4/d1a/d2d/d18/f1c [0,4194304] 0 2024-09-17T01:52:14.408 INFO:tasks.workunit.client.1.smithi092.stdout:1/775: write db/d3b/fb7 [4523431,126095] 0 2024-09-17T01:52:14.409 INFO:tasks.workunit.client.1.smithi092.stdout:3/603: dread d4/d13/d2e/d5f/f5c [0,4194304] 0 2024-09-17T01:52:14.411 INFO:tasks.workunit.client.0.smithi031.stdout:9/764: link d3/d19/d80/ff3 d3/d4/da0/d36/d99/de5/ff4 0 2024-09-17T01:52:14.411 INFO:tasks.workunit.client.0.smithi031.stdout:0/834: getdents d0/d29/d33/d5/d48 0 2024-09-17T01:52:14.413 INFO:tasks.workunit.client.0.smithi031.stdout:8/703: mkdir d0/d5/d9b/dcf/dd1 0 2024-09-17T01:52:14.414 INFO:tasks.workunit.client.0.smithi031.stdout:5/750: mkdir da/d14/dac/d82/d106 0 2024-09-17T01:52:14.415 INFO:tasks.workunit.client.1.smithi092.stdout:3/604: getdents d4/d16/d1b 0 2024-09-17T01:52:14.417 INFO:tasks.workunit.client.1.smithi092.stdout:1/776: dwrite db/d6c/db3/dea/deb/ff1 [0,4194304] 0 2024-09-17T01:52:14.417 INFO:tasks.workunit.client.1.smithi092.stdout:5/531: dread d0/de/d19/f89 [0,4194304] 0 2024-09-17T01:52:14.422 INFO:tasks.workunit.client.0.smithi031.stdout:0/835: dwrite d0/d37/f81 [0,4194304] 0 2024-09-17T01:52:14.422 INFO:tasks.workunit.client.1.smithi092.stdout:5/532: write d0/d7e/f85 [1059693,103159] 0 2024-09-17T01:52:14.423 INFO:tasks.workunit.client.0.smithi031.stdout:0/836: chown d0/d37/db9/l105 14916792 1 2024-09-17T01:52:14.425 INFO:tasks.workunit.client.0.smithi031.stdout:0/837: write d0/d29/d33/d5/fa [1965551,110341] 0 2024-09-17T01:52:14.425 INFO:tasks.workunit.client.1.smithi092.stdout:5/533: fdatasync d0/de/d19/d1a/d1e/d29/f60 0 2024-09-17T01:52:14.426 INFO:tasks.workunit.client.1.smithi092.stdout:1/777: dwrite db/d6c/d7e/d82/fbd [4194304,4194304] 0 2024-09-17T01:52:14.428 INFO:tasks.workunit.client.1.smithi092.stdout:1/778: chown db/d1d/db5/lc4 216 1 2024-09-17T01:52:14.434 INFO:tasks.workunit.client.0.smithi031.stdout:2/853: truncate d1/d3/d2d/db2/f33 305969 0 2024-09-17T01:52:14.435 INFO:tasks.workunit.client.1.smithi092.stdout:1/779: dwrite db/d1d/d23/d34/fb0 [0,4194304] 0 2024-09-17T01:52:14.436 INFO:tasks.workunit.client.0.smithi031.stdout:8/704: dread d0/d5/d9b/f41 [0,4194304] 0 2024-09-17T01:52:14.438 INFO:tasks.workunit.client.1.smithi092.stdout:5/534: link d0/de/d19/d1a/d1e/fa2 d0/d50/da5/fae 0 2024-09-17T01:52:14.438 INFO:tasks.workunit.client.0.smithi031.stdout:5/751: truncate da/dc/fc9 854511 0 2024-09-17T01:52:14.443 INFO:tasks.workunit.client.0.smithi031.stdout:2/854: getdents d1/d3/d45 0 2024-09-17T01:52:14.443 INFO:tasks.workunit.client.1.smithi092.stdout:5/535: mknod d0/d50/caf 0 2024-09-17T01:52:14.444 INFO:tasks.workunit.client.1.smithi092.stdout:1/780: dwrite db/f87 [4194304,4194304] 0 2024-09-17T01:52:14.444 INFO:tasks.workunit.client.0.smithi031.stdout:2/855: stat d1/d3/d45/d4a/f10d 0 2024-09-17T01:52:14.447 INFO:tasks.workunit.client.0.smithi031.stdout:5/752: getdents da/d42/d12 0 2024-09-17T01:52:14.448 INFO:tasks.workunit.client.1.smithi092.stdout:1/781: unlink db/d1d/d23/d55/f7b 0 2024-09-17T01:52:14.449 INFO:tasks.workunit.client.1.smithi092.stdout:1/782: chown db/d1d/d23/l35 851576 1 2024-09-17T01:52:14.450 INFO:tasks.workunit.client.1.smithi092.stdout:1/783: chown db/d1d/db5/c53 0 1 2024-09-17T01:52:14.452 INFO:tasks.workunit.client.1.smithi092.stdout:3/605: truncate d4/d2f/d44/d3c/f3e 3564239 0 2024-09-17T01:52:14.454 INFO:tasks.workunit.client.0.smithi031.stdout:0/838: truncate d0/d29/da7/db3/f77 4180598 0 2024-09-17T01:52:14.455 INFO:tasks.workunit.client.1.smithi092.stdout:1/784: getdents db/d6c/d7e/d82 0 2024-09-17T01:52:14.456 INFO:tasks.workunit.client.1.smithi092.stdout:1/785: write db/d1d/d23/d55/fa9 [550556,109615] 0 2024-09-17T01:52:14.457 INFO:tasks.workunit.client.0.smithi031.stdout:5/753: dwrite da/d14/f3b [0,4194304] 0 2024-09-17T01:52:14.458 INFO:tasks.workunit.client.0.smithi031.stdout:0/839: write d0/d29/da7/db3/d4a/d86/fe5 [1038253,128806] 0 2024-09-17T01:52:14.458 INFO:tasks.workunit.client.1.smithi092.stdout:1/786: write db/d1d/d23/d88/fd9 [877458,24822] 0 2024-09-17T01:52:14.459 INFO:tasks.workunit.client.0.smithi031.stdout:2/856: fsync d1/d3/d2d/db2/d1e/d2a/fbe 0 2024-09-17T01:52:14.460 INFO:tasks.workunit.client.1.smithi092.stdout:1/787: chown db/d1d/d23/da1/dc3 28228 1 2024-09-17T01:52:14.463 INFO:tasks.workunit.client.1.smithi092.stdout:1/788: dread db/d1d/d2e/fcd [0,4194304] 0 2024-09-17T01:52:14.465 INFO:tasks.workunit.client.0.smithi031.stdout:5/754: stat da/d42/d26/c83 0 2024-09-17T01:52:14.465 INFO:tasks.workunit.client.1.smithi092.stdout:3/606: read d4/f2d [4015862,98819] 0 2024-09-17T01:52:14.467 INFO:tasks.workunit.client.0.smithi031.stdout:0/840: write d0/d29/d33/fdc [594174,67482] 0 2024-09-17T01:52:14.470 INFO:tasks.workunit.client.1.smithi092.stdout:1/789: read db/d1d/f2a [464355,2579] 0 2024-09-17T01:52:14.470 INFO:tasks.workunit.client.1.smithi092.stdout:3/607: link d4/d20/f84 d4/d13/d2e/d43/fc8 0 2024-09-17T01:52:14.471 INFO:tasks.workunit.client.0.smithi031.stdout:2/857: symlink d1/d3/d2d/db2/d1e/l11f 0 2024-09-17T01:52:14.471 INFO:tasks.workunit.client.0.smithi031.stdout:0/841: read - d0/d29/d33/d2a/d25/f113 zero size 2024-09-17T01:52:14.471 INFO:tasks.workunit.client.0.smithi031.stdout:8/705: dwrite d0/df/dd/d77/d78/f7f [0,4194304] 0 2024-09-17T01:52:14.476 INFO:tasks.workunit.client.0.smithi031.stdout:0/842: chown d0/d29/da7/dbb/fca 103248548 1 2024-09-17T01:52:14.477 INFO:tasks.workunit.client.0.smithi031.stdout:8/706: symlink d0/df/dd/d9c/ld2 0 2024-09-17T01:52:14.478 INFO:tasks.workunit.client.0.smithi031.stdout:8/707: readlink d0/df/d19/l4a 0 2024-09-17T01:52:14.480 INFO:tasks.workunit.client.0.smithi031.stdout:8/708: stat d0/d5/f40 0 2024-09-17T01:52:14.480 INFO:tasks.workunit.client.1.smithi092.stdout:3/608: creat d4/d20/d3f/fc9 x:0 0 0 2024-09-17T01:52:14.481 INFO:tasks.workunit.client.1.smithi092.stdout:3/609: fsync d4/f30 0 2024-09-17T01:52:14.481 INFO:tasks.workunit.client.1.smithi092.stdout:1/790: dwrite db/d6c/d8b/fba [0,4194304] 0 2024-09-17T01:52:14.483 INFO:tasks.workunit.client.1.smithi092.stdout:3/610: chown d4/d16/d1b/f47 192 1 2024-09-17T01:52:14.484 INFO:tasks.workunit.client.0.smithi031.stdout:2/858: link d1/d3/d2d/db2/d1e/d4f/d92/fef d1/d3/d2d/d91/f120 0 2024-09-17T01:52:14.485 INFO:tasks.workunit.client.1.smithi092.stdout:1/791: mkdir db/d1d/d4b/df3 0 2024-09-17T01:52:14.488 INFO:tasks.workunit.client.1.smithi092.stdout:1/792: creat db/d1d/d4b/ff4 x:0 0 0 2024-09-17T01:52:14.492 INFO:tasks.workunit.client.1.smithi092.stdout:1/793: rename db/d1d/d23/c4f to db/d1d/d2e/d62/cf5 0 2024-09-17T01:52:14.495 INFO:tasks.workunit.client.0.smithi031.stdout:2/859: dread d1/d3/df/ffc [0,4194304] 0 2024-09-17T01:52:14.496 INFO:tasks.workunit.client.0.smithi031.stdout:5/755: dwrite da/d42/d12/f41 [0,4194304] 0 2024-09-17T01:52:14.499 INFO:tasks.workunit.client.0.smithi031.stdout:0/843: dwrite d0/d29/d33/f75 [0,4194304] 0 2024-09-17T01:52:14.500 INFO:tasks.workunit.client.0.smithi031.stdout:5/756: mkdir da/dc/da2/d107 0 2024-09-17T01:52:14.508 INFO:tasks.workunit.client.0.smithi031.stdout:8/709: dread d0/df/dd/d77/f92 [0,4194304] 0 2024-09-17T01:52:14.509 INFO:tasks.workunit.client.0.smithi031.stdout:8/710: dread - d0/d5/fcb zero size 2024-09-17T01:52:14.512 INFO:tasks.workunit.client.1.smithi092.stdout:1/794: dwrite db/d1d/d4b/d9a/fb1 [0,4194304] 0 2024-09-17T01:52:14.513 INFO:tasks.workunit.client.0.smithi031.stdout:0/844: write d0/d29/d33/d2a/d25/f7a [784293,59955] 0 2024-09-17T01:52:14.513 INFO:tasks.workunit.client.1.smithi092.stdout:3/611: dread d4/d20/d39/fac [0,4194304] 0 2024-09-17T01:52:14.514 INFO:tasks.workunit.client.1.smithi092.stdout:3/612: stat d4/d16/f8c 0 2024-09-17T01:52:14.514 INFO:tasks.workunit.client.1.smithi092.stdout:3/613: chown d4/d13/l3d 10 1 2024-09-17T01:52:14.517 INFO:tasks.workunit.client.0.smithi031.stdout:8/711: creat d0/d5/d54/fd3 x:0 0 0 2024-09-17T01:52:14.518 INFO:tasks.workunit.client.0.smithi031.stdout:2/860: dwrite d1/d3/df/f8d [0,4194304] 0 2024-09-17T01:52:14.518 INFO:tasks.workunit.client.1.smithi092.stdout:3/614: fdatasync d4/d13/d2e/f75 0 2024-09-17T01:52:14.520 INFO:tasks.workunit.client.1.smithi092.stdout:3/615: creat d4/d20/d39/d70/fca x:0 0 0 2024-09-17T01:52:14.520 INFO:tasks.workunit.client.1.smithi092.stdout:3/616: chown d4/d20/f86 413291 1 2024-09-17T01:52:14.522 INFO:tasks.workunit.client.0.smithi031.stdout:3/791: sync 2024-09-17T01:52:14.526 INFO:tasks.workunit.client.0.smithi031.stdout:0/845: rename d0/d29/da7/db3/d4a/d86/da1/fc4 to d0/d29/da7/dbb/d118/f121 0 2024-09-17T01:52:14.531 INFO:tasks.workunit.client.0.smithi031.stdout:2/861: dwrite d1/d3/d45/d4a/d96/ffe [0,4194304] 0 2024-09-17T01:52:14.533 INFO:tasks.workunit.client.0.smithi031.stdout:8/712: mknod d0/df/d19/d86/dca/cd4 0 2024-09-17T01:52:14.534 INFO:tasks.workunit.client.0.smithi031.stdout:0/846: mknod d0/d37/db9/c122 0 2024-09-17T01:52:14.535 INFO:tasks.workunit.client.0.smithi031.stdout:2/862: dread - d1/d3/f10f zero size 2024-09-17T01:52:14.539 INFO:tasks.workunit.client.0.smithi031.stdout:5/757: dread da/d14/f89 [0,4194304] 0 2024-09-17T01:52:14.540 INFO:tasks.workunit.client.0.smithi031.stdout:8/713: rmdir d0/d5/d9b/dcf/dd1 0 2024-09-17T01:52:14.542 INFO:tasks.workunit.client.0.smithi031.stdout:2/863: creat d1/db6/f121 x:0 0 0 2024-09-17T01:52:14.544 INFO:tasks.workunit.client.0.smithi031.stdout:5/758: mknod da/d14/dac/d82/ddd/c108 0 2024-09-17T01:52:14.544 INFO:tasks.workunit.client.0.smithi031.stdout:5/759: dread - da/d14/dac/fec zero size 2024-09-17T01:52:14.546 INFO:tasks.workunit.client.0.smithi031.stdout:0/847: link d0/d29/d33/d5/fa d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/f123 0 2024-09-17T01:52:14.547 INFO:tasks.workunit.client.0.smithi031.stdout:8/714: mknod d0/df/dd/d77/dc3/cd5 0 2024-09-17T01:52:14.548 INFO:tasks.workunit.client.0.smithi031.stdout:8/715: write d0/d5/fcb [702811,31688] 0 2024-09-17T01:52:14.549 INFO:tasks.workunit.client.0.smithi031.stdout:2/864: rename d1/d3/d2d/c81 to d1/d7c/c122 0 2024-09-17T01:52:14.550 INFO:tasks.workunit.client.0.smithi031.stdout:5/760: creat da/d42/d12/d72/dfe/f109 x:0 0 0 2024-09-17T01:52:14.552 INFO:tasks.workunit.client.0.smithi031.stdout:8/716: unlink d0/d5/d54/d60/f57 0 2024-09-17T01:52:14.554 INFO:tasks.workunit.client.0.smithi031.stdout:2/865: creat d1/d3/df/d11/d30/ddd/f123 x:0 0 0 2024-09-17T01:52:14.556 INFO:tasks.workunit.client.0.smithi031.stdout:0/848: link d0/d29/da7/db3/d4a/f6c d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/f124 0 2024-09-17T01:52:14.558 INFO:tasks.workunit.client.0.smithi031.stdout:0/849: write d0/d29/d33/d2a/d25/f113 [939706,77065] 0 2024-09-17T01:52:14.558 INFO:tasks.workunit.client.1.smithi092.stdout:3/617: dread d4/d20/f26 [0,4194304] 0 2024-09-17T01:52:14.559 INFO:tasks.workunit.client.0.smithi031.stdout:5/761: symlink da/dc/l10a 0 2024-09-17T01:52:14.560 INFO:tasks.workunit.client.0.smithi031.stdout:2/866: read - d1/d3/df/f5a zero size 2024-09-17T01:52:14.562 INFO:tasks.workunit.client.0.smithi031.stdout:8/717: unlink d0/d5/d6c/db0/db7/c95 0 2024-09-17T01:52:14.563 INFO:tasks.workunit.client.1.smithi092.stdout:3/618: dwrite d4/d20/f26 [0,4194304] 0 2024-09-17T01:52:14.565 INFO:tasks.workunit.client.0.smithi031.stdout:0/850: rmdir d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/d104 39 2024-09-17T01:52:14.565 INFO:tasks.workunit.client.0.smithi031.stdout:3/792: dwrite db/f19 [0,4194304] 0 2024-09-17T01:52:14.566 INFO:tasks.workunit.client.1.smithi092.stdout:3/619: creat d4/d13/d2e/d43/fcb x:0 0 0 2024-09-17T01:52:14.567 INFO:tasks.workunit.client.0.smithi031.stdout:3/793: chown db/df/f15 1971790 1 2024-09-17T01:52:14.567 INFO:tasks.workunit.client.0.smithi031.stdout:5/762: dread da/f74 [0,4194304] 0 2024-09-17T01:52:14.568 INFO:tasks.workunit.client.1.smithi092.stdout:3/620: rmdir d4/d20/d3f 39 2024-09-17T01:52:14.568 INFO:tasks.workunit.client.0.smithi031.stdout:2/867: rmdir d1/d3/d2d/db2/d1e 39 2024-09-17T01:52:14.570 INFO:tasks.workunit.client.1.smithi092.stdout:3/621: mknod d4/d20/d39/d70/d95/da3/ccc 0 2024-09-17T01:52:14.570 INFO:tasks.workunit.client.0.smithi031.stdout:8/718: truncate d0/d5/d54/d60/f6b 190835 0 2024-09-17T01:52:14.570 INFO:tasks.workunit.client.0.smithi031.stdout:2/868: fdatasync d1/d3/df/d18/d40/d43/f11d 0 2024-09-17T01:52:14.570 INFO:tasks.workunit.client.0.smithi031.stdout:8/719: chown d0/df/d19/f27 988593 1 2024-09-17T01:52:14.571 INFO:tasks.workunit.client.1.smithi092.stdout:3/622: creat d4/d13/d2e/d43/fcd x:0 0 0 2024-09-17T01:52:14.572 INFO:tasks.workunit.client.1.smithi092.stdout:3/623: read - d4/d20/d39/f93 zero size 2024-09-17T01:52:14.574 INFO:tasks.workunit.client.1.smithi092.stdout:3/624: mknod d4/d2f/cce 0 2024-09-17T01:52:14.575 INFO:tasks.workunit.client.1.smithi092.stdout:3/625: dread - d4/d20/d3f/fc9 zero size 2024-09-17T01:52:14.577 INFO:tasks.workunit.client.1.smithi092.stdout:3/626: symlink d4/d73/d7b/lcf 0 2024-09-17T01:52:14.579 INFO:tasks.workunit.client.1.smithi092.stdout:3/627: truncate d4/d20/f81 185546 0 2024-09-17T01:52:14.579 INFO:tasks.workunit.client.0.smithi031.stdout:2/869: dwrite d1/d3/df/d18/f3b [0,4194304] 0 2024-09-17T01:52:14.580 INFO:tasks.workunit.client.1.smithi092.stdout:3/628: readlink d4/d20/d39/l97 0 2024-09-17T01:52:14.580 INFO:tasks.workunit.client.0.smithi031.stdout:8/720: mknod d0/df/d19/d86/cd6 0 2024-09-17T01:52:14.581 INFO:tasks.workunit.client.0.smithi031.stdout:2/870: read - d1/d3/d2d/db2/fe0 zero size 2024-09-17T01:52:14.581 INFO:tasks.workunit.client.0.smithi031.stdout:0/851: symlink d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/d104/l125 0 2024-09-17T01:52:14.581 INFO:tasks.workunit.client.1.smithi092.stdout:3/629: mkdir d4/d2f/d44/d3c/dd0 0 2024-09-17T01:52:14.582 INFO:tasks.workunit.client.1.smithi092.stdout:3/630: readlink d4/d20/lb1 0 2024-09-17T01:52:14.585 INFO:tasks.workunit.client.0.smithi031.stdout:5/763: creat da/dc/da2/d107/f10b x:0 0 0 2024-09-17T01:52:14.586 INFO:tasks.workunit.client.1.smithi092.stdout:3/631: link d4/d13/f8b d4/d20/d3f/dc0/fd1 0 2024-09-17T01:52:14.587 INFO:tasks.workunit.client.1.smithi092.stdout:3/632: write d4/d2f/f9a [4550217,115997] 0 2024-09-17T01:52:14.588 INFO:tasks.workunit.client.1.smithi092.stdout:3/633: write d4/d16/f80 [207398,116036] 0 2024-09-17T01:52:14.590 INFO:tasks.workunit.client.0.smithi031.stdout:0/852: creat d0/d29/d33/d5/d48/df1/f126 x:0 0 0 2024-09-17T01:52:14.591 INFO:tasks.workunit.client.1.smithi092.stdout:3/634: truncate d4/d73/d8f/d92/fa0 101477 0 2024-09-17T01:52:14.593 INFO:tasks.workunit.client.0.smithi031.stdout:0/853: creat d0/d29/d33/d5/dec/f127 x:0 0 0 2024-09-17T01:52:14.598 INFO:tasks.workunit.client.0.smithi031.stdout:0/854: mknod d0/d37/db9/dcf/c128 0 2024-09-17T01:52:14.601 INFO:tasks.workunit.client.0.smithi031.stdout:3/794: truncate db/f11 603282 0 2024-09-17T01:52:14.604 INFO:tasks.workunit.client.0.smithi031.stdout:3/795: stat db/df/d1d/d37/d77/de3 0 2024-09-17T01:52:14.604 INFO:tasks.workunit.client.0.smithi031.stdout:2/871: write d1/d3/df/f5b [4355004,96872] 0 2024-09-17T01:52:14.609 INFO:tasks.workunit.client.0.smithi031.stdout:3/796: unlink db/df/d1d/d37/d6c/d6e/fbe 0 2024-09-17T01:52:14.609 INFO:tasks.workunit.client.1.smithi092.stdout:3/635: dread d4/d13/d2e/f75 [0,4194304] 0 2024-09-17T01:52:14.612 INFO:tasks.workunit.client.0.smithi031.stdout:5/764: dwrite da/d4b/dce/f100 [0,4194304] 0 2024-09-17T01:52:14.612 INFO:tasks.workunit.client.0.smithi031.stdout:8/721: dwrite d0/d5/f7d [0,4194304] 0 2024-09-17T01:52:14.612 INFO:tasks.workunit.client.1.smithi092.stdout:3/636: mkdir d4/d13/d2e/d6f/dd2 0 2024-09-17T01:52:14.613 INFO:tasks.workunit.client.1.smithi092.stdout:9/630: sync 2024-09-17T01:52:14.613 INFO:tasks.workunit.client.1.smithi092.stdout:4/773: sync 2024-09-17T01:52:14.613 INFO:tasks.workunit.client.1.smithi092.stdout:2/590: sync 2024-09-17T01:52:14.616 INFO:tasks.workunit.client.0.smithi031.stdout:5/765: dread - da/d14/dac/d62/fcf zero size 2024-09-17T01:52:14.616 INFO:tasks.workunit.client.1.smithi092.stdout:3/637: creat d4/d20/d3f/dc0/fd3 x:0 0 0 2024-09-17T01:52:14.617 INFO:tasks.workunit.client.0.smithi031.stdout:7/858: sync 2024-09-17T01:52:14.618 INFO:tasks.workunit.client.1.smithi092.stdout:4/774: chown d4/d13/d3b/d42/d76/d35/f39 17047800 1 2024-09-17T01:52:14.618 INFO:tasks.workunit.client.1.smithi092.stdout:4/775: stat d4/d13/d3b/d42 0 2024-09-17T01:52:14.619 INFO:tasks.workunit.client.1.smithi092.stdout:2/591: mknod d10/d4c/cc3 0 2024-09-17T01:52:14.619 INFO:tasks.workunit.client.0.smithi031.stdout:2/872: creat d1/d3/f124 x:0 0 0 2024-09-17T01:52:14.620 INFO:tasks.workunit.client.0.smithi031.stdout:7/859: read - db/d1c/d99/fc3 zero size 2024-09-17T01:52:14.621 INFO:tasks.workunit.client.0.smithi031.stdout:0/855: dwrite d0/d37/f8f [0,4194304] 0 2024-09-17T01:52:14.626 INFO:tasks.workunit.client.0.smithi031.stdout:8/722: truncate d0/df/d19/f29 3279995 0 2024-09-17T01:52:14.627 INFO:tasks.workunit.client.1.smithi092.stdout:4/776: rename d4/d5/d1d/d30/d3f/d4b/ff1 to d4/d13/d20/de0/ffc 0 2024-09-17T01:52:14.627 INFO:tasks.workunit.client.0.smithi031.stdout:3/797: creat db/df/dc8/deb/ffa x:0 0 0 2024-09-17T01:52:14.629 INFO:tasks.workunit.client.1.smithi092.stdout:2/592: dwrite d10/db9/fbc [0,4194304] 0 2024-09-17T01:52:14.630 INFO:tasks.workunit.client.0.smithi031.stdout:5/766: unlink da/d4b/db4/cd4 0 2024-09-17T01:52:14.631 INFO:tasks.workunit.client.0.smithi031.stdout:8/723: creat d0/df/dd/d77/dc3/fd7 x:0 0 0 2024-09-17T01:52:14.632 INFO:tasks.workunit.client.0.smithi031.stdout:3/798: mknod db/df/d1d/d37/d4a/cfb 0 2024-09-17T01:52:14.633 INFO:tasks.workunit.client.0.smithi031.stdout:5/767: symlink da/dc/da2/d107/l10c 0 2024-09-17T01:52:14.633 INFO:tasks.workunit.client.0.smithi031.stdout:8/724: truncate d0/f52 3319788 0 2024-09-17T01:52:14.634 INFO:tasks.workunit.client.0.smithi031.stdout:5/768: dread - da/d42/d12/d4a/faa zero size 2024-09-17T01:52:14.635 INFO:tasks.workunit.client.1.smithi092.stdout:3/638: link d4/d2f/d44/fae d4/d16/d1b/daf/fd4 0 2024-09-17T01:52:14.637 INFO:tasks.workunit.client.0.smithi031.stdout:3/799: creat db/df/d1d/d37/d6c/ffc x:0 0 0 2024-09-17T01:52:14.638 INFO:tasks.workunit.client.0.smithi031.stdout:5/769: write da/d42/d26/f75 [1829823,9224] 0 2024-09-17T01:52:14.639 INFO:tasks.workunit.client.0.smithi031.stdout:8/725: mkdir d0/dd8 0 2024-09-17T01:52:14.640 INFO:tasks.workunit.client.1.smithi092.stdout:3/639: truncate d4/d16/d1b/f21 815262 0 2024-09-17T01:52:14.641 INFO:tasks.workunit.client.0.smithi031.stdout:3/800: mknod db/df/d1d/df2/cfd 0 2024-09-17T01:52:14.642 INFO:tasks.workunit.client.1.smithi092.stdout:3/640: mkdir d4/d20/d9f/dd5 0 2024-09-17T01:52:14.643 INFO:tasks.workunit.client.0.smithi031.stdout:5/770: mkdir da/d14/dac/d62/d10d 0 2024-09-17T01:52:14.643 INFO:tasks.workunit.client.0.smithi031.stdout:8/726: mknod d0/d5/d54/d60/dbb/dc0/cd9 0 2024-09-17T01:52:14.644 INFO:tasks.workunit.client.0.smithi031.stdout:5/771: dread - da/d14/dac/d62/fcf zero size 2024-09-17T01:52:14.645 INFO:tasks.workunit.client.1.smithi092.stdout:9/631: dwrite d0/d7/d12/d86/d93/d96/f8d [0,4194304] 0 2024-09-17T01:52:14.647 INFO:tasks.workunit.client.0.smithi031.stdout:8/727: creat d0/fda x:0 0 0 2024-09-17T01:52:14.649 INFO:tasks.workunit.client.1.smithi092.stdout:9/632: mkdir d0/d7/db7 0 2024-09-17T01:52:14.651 INFO:tasks.workunit.client.0.smithi031.stdout:3/801: dwrite db/df/dc8/d6a/ddd/ff0 [0,4194304] 0 2024-09-17T01:52:14.651 INFO:tasks.workunit.client.0.smithi031.stdout:8/728: fdatasync d0/d5/f87 0 2024-09-17T01:52:14.652 INFO:tasks.workunit.client.1.smithi092.stdout:9/633: truncate d0/d7/d12/f88 1169886 0 2024-09-17T01:52:14.653 INFO:tasks.workunit.client.1.smithi092.stdout:9/634: truncate d0/d7/d12/d34/d26/d54/fa0 819329 0 2024-09-17T01:52:14.654 INFO:tasks.workunit.client.0.smithi031.stdout:5/772: link c6 da/d14/dac/dc2/c10e 0 2024-09-17T01:52:14.656 INFO:tasks.workunit.client.1.smithi092.stdout:9/635: symlink d0/d7/d12/d34/d26/lb8 0 2024-09-17T01:52:14.658 INFO:tasks.workunit.client.0.smithi031.stdout:8/729: dread d0/d5/f11 [0,4194304] 0 2024-09-17T01:52:14.660 INFO:tasks.workunit.client.0.smithi031.stdout:8/730: truncate d0/d5/d6c/db0/fb9 711421 0 2024-09-17T01:52:14.666 INFO:tasks.workunit.client.0.smithi031.stdout:0/856: write d0/d29/d33/dff/fa0 [1238347,26621] 0 2024-09-17T01:52:14.667 INFO:tasks.workunit.client.1.smithi092.stdout:2/593: truncate d10/d3a/f3f 4504567 0 2024-09-17T01:52:14.669 INFO:tasks.workunit.client.1.smithi092.stdout:2/594: fsync d10/d5c/d81/f87 0 2024-09-17T01:52:14.669 INFO:tasks.workunit.client.0.smithi031.stdout:8/731: dwrite d0/df/d19/d86/fa3 [0,4194304] 0 2024-09-17T01:52:14.670 INFO:tasks.workunit.client.1.smithi092.stdout:4/777: dwrite d4/d5/fd2 [0,4194304] 0 2024-09-17T01:52:14.673 INFO:tasks.workunit.client.1.smithi092.stdout:4/778: write d4/d7b/ff0 [691160,99319] 0 2024-09-17T01:52:14.675 INFO:tasks.workunit.client.1.smithi092.stdout:2/595: creat d10/d4c/d80/d95/daa/fc4 x:0 0 0 2024-09-17T01:52:14.676 INFO:tasks.workunit.client.0.smithi031.stdout:7/860: dread db/d18/f9e [0,4194304] 0 2024-09-17T01:52:14.677 INFO:tasks.workunit.client.0.smithi031.stdout:0/857: rename d0/d29/da7/l91 to d0/d29/da7/db3/d4a/d86/dd7/l129 0 2024-09-17T01:52:14.678 INFO:tasks.workunit.client.1.smithi092.stdout:3/641: dwrite d4/d16/f48 [0,4194304] 0 2024-09-17T01:52:14.679 INFO:tasks.workunit.client.1.smithi092.stdout:4/779: read d4/d13/d3b/d42/d76/fd1 [2092191,646] 0 2024-09-17T01:52:14.679 INFO:tasks.workunit.client.1.smithi092.stdout:9/636: dwrite d0/f4c [0,4194304] 0 2024-09-17T01:52:14.680 INFO:tasks.workunit.client.0.smithi031.stdout:8/732: creat d0/d5/d6c/db0/fdb x:0 0 0 2024-09-17T01:52:14.682 INFO:tasks.workunit.client.1.smithi092.stdout:4/780: write d4/d13/d3b/d42/d76/f48 [4180575,7568] 0 2024-09-17T01:52:14.683 INFO:tasks.workunit.client.0.smithi031.stdout:8/733: chown d0/df/f8a 33 1 2024-09-17T01:52:14.684 INFO:tasks.workunit.client.1.smithi092.stdout:2/596: rename d10/d4c/f94 to d10/d1d/d96/d77/d9c/dae/fc5 0 2024-09-17T01:52:14.686 INFO:tasks.workunit.client.1.smithi092.stdout:2/597: fdatasync d10/d55/d84/fbb 0 2024-09-17T01:52:14.686 INFO:tasks.workunit.client.1.smithi092.stdout:3/642: mknod d4/d2f/d44/d3c/cd6 0 2024-09-17T01:52:14.687 INFO:tasks.workunit.client.0.smithi031.stdout:0/858: dwrite d0/d29/da7/db3/d4a/f6e [0,4194304] 0 2024-09-17T01:52:14.689 INFO:tasks.workunit.client.1.smithi092.stdout:4/781: mknod d4/d13/d3b/d42/cfd 0 2024-09-17T01:52:14.690 INFO:tasks.workunit.client.1.smithi092.stdout:2/598: mkdir d10/d4c/d80/d95/dc6 0 2024-09-17T01:52:14.691 INFO:tasks.workunit.client.0.smithi031.stdout:3/802: write db/df/d1d/f7c [800402,16567] 0 2024-09-17T01:52:14.691 INFO:tasks.workunit.client.0.smithi031.stdout:5/773: truncate da/d14/dac/d82/fd2 249213 0 2024-09-17T01:52:14.694 INFO:tasks.workunit.client.1.smithi092.stdout:9/637: link d0/d7/c57 d0/cb9 0 2024-09-17T01:52:14.696 INFO:tasks.workunit.client.0.smithi031.stdout:0/859: mkdir d0/d29/d33/d5/d48/d56/dc8/dcc/d12a 0 2024-09-17T01:52:14.696 INFO:tasks.workunit.client.1.smithi092.stdout:3/643: dwrite d4/d20/d39/d70/fca [0,4194304] 0 2024-09-17T01:52:14.700 INFO:tasks.workunit.client.0.smithi031.stdout:5/774: mknod da/d4b/dce/c10f 0 2024-09-17T01:52:14.701 INFO:tasks.workunit.client.0.smithi031.stdout:0/860: dread d0/d29/d33/f75 [0,4194304] 0 2024-09-17T01:52:14.702 INFO:tasks.workunit.client.1.smithi092.stdout:4/782: dwrite d4/d13/f8f [0,4194304] 0 2024-09-17T01:52:14.703 INFO:tasks.workunit.client.0.smithi031.stdout:5/775: read da/d42/d12/d72/fc8 [30592,117840] 0 2024-09-17T01:52:14.704 INFO:tasks.workunit.client.0.smithi031.stdout:3/803: fsync db/df/dc8/d6a/dc3/ddb/fec 0 2024-09-17T01:52:14.706 INFO:tasks.workunit.client.0.smithi031.stdout:3/804: write db/df/d1d/d37/d6c/d6e/f9f [463561,478] 0 2024-09-17T01:52:14.707 INFO:tasks.workunit.client.1.smithi092.stdout:3/644: unlink d4/c36 0 2024-09-17T01:52:14.708 INFO:tasks.workunit.client.1.smithi092.stdout:2/599: dwrite d10/d1d/d24/f62 [0,4194304] 0 2024-09-17T01:52:14.709 INFO:tasks.workunit.client.0.smithi031.stdout:5/776: write da/d42/fb0 [697888,80890] 0 2024-09-17T01:52:14.710 INFO:tasks.workunit.client.1.smithi092.stdout:9/638: rename d0/df/c80 to d0/d7/d12/d34/d26/d54/d6b/cba 0 2024-09-17T01:52:14.710 INFO:tasks.workunit.client.0.smithi031.stdout:5/777: dread - da/d42/d12/d64/ffc zero size 2024-09-17T01:52:14.711 INFO:tasks.workunit.client.0.smithi031.stdout:5/778: stat da/d42/d12/d72/f97 0 2024-09-17T01:52:14.712 INFO:tasks.workunit.client.0.smithi031.stdout:0/861: mknod d0/d29/d33/c12b 0 2024-09-17T01:52:14.713 INFO:tasks.workunit.client.0.smithi031.stdout:3/805: mknod db/df/d1d/d37/d65/cfe 0 2024-09-17T01:52:14.713 INFO:tasks.workunit.client.1.smithi092.stdout:3/645: truncate d4/d13/d2e/f75 3327021 0 2024-09-17T01:52:14.714 INFO:tasks.workunit.client.1.smithi092.stdout:4/783: rmdir d4/d5/d1d/dae 39 2024-09-17T01:52:14.715 INFO:tasks.workunit.client.0.smithi031.stdout:0/862: write d0/d29/d33/d5/d48/d56/fb6 [1279678,112549] 0 2024-09-17T01:52:14.716 INFO:tasks.workunit.client.0.smithi031.stdout:5/779: creat da/d4b/d6c/df2/de7/f110 x:0 0 0 2024-09-17T01:52:14.717 INFO:tasks.workunit.client.1.smithi092.stdout:3/646: dread d4/d20/f86 [0,4194304] 0 2024-09-17T01:52:14.719 INFO:tasks.workunit.client.0.smithi031.stdout:0/863: chown d0/d29/da7/db3/c71 12 1 2024-09-17T01:52:14.720 INFO:tasks.workunit.client.1.smithi092.stdout:2/600: unlink d10/d1d/d2c/d56/d66/cab 0 2024-09-17T01:52:14.721 INFO:tasks.workunit.client.0.smithi031.stdout:0/864: chown d0/d29/da7/db3/d4a/f6c 430388 1 2024-09-17T01:52:14.721 INFO:tasks.workunit.client.0.smithi031.stdout:5/780: unlink da/fb8 0 2024-09-17T01:52:14.722 INFO:tasks.workunit.client.0.smithi031.stdout:3/806: symlink db/df/d1d/d37/d6c/lff 0 2024-09-17T01:52:14.724 INFO:tasks.workunit.client.1.smithi092.stdout:9/639: dread d0/d7/d12/d34/f3a [0,4194304] 0 2024-09-17T01:52:14.725 INFO:tasks.workunit.client.0.smithi031.stdout:7/861: dread db/f51 [0,4194304] 0 2024-09-17T01:52:14.725 INFO:tasks.workunit.client.1.smithi092.stdout:3/647: dwrite d4/d20/d3f/f9c [0,4194304] 0 2024-09-17T01:52:14.726 INFO:tasks.workunit.client.0.smithi031.stdout:5/781: creat da/d42/d12/d102/f111 x:0 0 0 2024-09-17T01:52:14.726 INFO:tasks.workunit.client.1.smithi092.stdout:3/648: write d4/d13/d2e/d5f/f62 [1586260,85011] 0 2024-09-17T01:52:14.727 INFO:tasks.workunit.client.1.smithi092.stdout:3/649: chown d4/d73 633 1 2024-09-17T01:52:14.727 INFO:tasks.workunit.client.0.smithi031.stdout:3/807: truncate db/df/d1d/d37/d65/fca 981700 0 2024-09-17T01:52:14.728 INFO:tasks.workunit.client.1.smithi092.stdout:4/784: rename d4/d5/d8/f34 to d4/d5/d8/d92/ffe 0 2024-09-17T01:52:14.730 INFO:tasks.workunit.client.1.smithi092.stdout:2/601: symlink d10/d1d/d2c/d5a/lc7 0 2024-09-17T01:52:14.731 INFO:tasks.workunit.client.0.smithi031.stdout:0/865: fdatasync d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/f123 0 2024-09-17T01:52:14.734 INFO:tasks.workunit.client.1.smithi092.stdout:4/785: fdatasync d4/d5/d1d/f9c 0 2024-09-17T01:52:14.735 INFO:tasks.workunit.client.0.smithi031.stdout:5/782: mkdir da/d14/dac/d62/d112 0 2024-09-17T01:52:14.735 INFO:tasks.workunit.client.0.smithi031.stdout:0/866: dread - d0/d29/d33/d2a/dde/d9b/fe0 zero size 2024-09-17T01:52:14.735 INFO:tasks.workunit.client.0.smithi031.stdout:7/862: dwrite db/d29/f58 [0,4194304] 0 2024-09-17T01:52:14.737 INFO:tasks.workunit.client.1.smithi092.stdout:3/650: rename d4/d73/d7b/c8d to d4/d2f/d44/d3c/cd7 0 2024-09-17T01:52:14.738 INFO:tasks.workunit.client.1.smithi092.stdout:2/602: fdatasync d10/d8d/f34 0 2024-09-17T01:52:14.738 INFO:tasks.workunit.client.1.smithi092.stdout:9/640: getdents d0/d7c/da9 0 2024-09-17T01:52:14.739 INFO:tasks.workunit.client.1.smithi092.stdout:2/603: chown d10/d4c/d80/d95/ca4 0 1 2024-09-17T01:52:14.740 INFO:tasks.workunit.client.1.smithi092.stdout:4/786: mkdir d4/d5/d1d/d30/d3f/d4b/dff 0 2024-09-17T01:52:14.741 INFO:tasks.workunit.client.0.smithi031.stdout:0/867: rename d0/d29/da7/dbb to d0/d29/d33/d5/d48/d12c 0 2024-09-17T01:52:14.745 INFO:tasks.workunit.client.1.smithi092.stdout:3/651: link d4/d73/d8f/d9e/fbb d4/d20/d3f/fd8 0 2024-09-17T01:52:14.745 INFO:tasks.workunit.client.0.smithi031.stdout:7/863: link db/d1c/d46/d95/c97 db/d1c/d99/de4/c112 0 2024-09-17T01:52:14.746 INFO:tasks.workunit.client.0.smithi031.stdout:1/777: sync 2024-09-17T01:52:14.746 INFO:tasks.workunit.client.0.smithi031.stdout:9/765: sync 2024-09-17T01:52:14.747 INFO:tasks.workunit.client.1.smithi092.stdout:9/641: creat d0/d7/d12/d86/fbb x:0 0 0 2024-09-17T01:52:14.747 INFO:tasks.workunit.client.0.smithi031.stdout:0/868: mkdir d0/d29/da7/d10f/d12d 0 2024-09-17T01:52:14.747 INFO:tasks.workunit.client.0.smithi031.stdout:1/778: readlink d4/d3d/d65/lc5 0 2024-09-17T01:52:14.748 INFO:tasks.workunit.client.0.smithi031.stdout:7/864: symlink db/d29/d10a/l113 0 2024-09-17T01:52:14.749 INFO:tasks.workunit.client.0.smithi031.stdout:5/783: getdents da/d14/dac/d82 0 2024-09-17T01:52:14.750 INFO:tasks.workunit.client.1.smithi092.stdout:2/604: getdents d10/d1d/d96 0 2024-09-17T01:52:14.750 INFO:tasks.workunit.client.0.smithi031.stdout:0/869: stat d0/d29/da7/db3/d4a/d86/dd7/dac/fd8 0 2024-09-17T01:52:14.750 INFO:tasks.workunit.client.0.smithi031.stdout:9/766: mknod d3/d19/d1f/cf5 0 2024-09-17T01:52:14.751 INFO:tasks.workunit.client.0.smithi031.stdout:0/870: symlink d0/l12e 0 2024-09-17T01:52:14.753 INFO:tasks.workunit.client.1.smithi092.stdout:4/787: dread d4/d5/d1d/dae/fd5 [0,4194304] 0 2024-09-17T01:52:14.755 INFO:tasks.workunit.client.1.smithi092.stdout:2/605: creat d10/d3a/d97/fc8 x:0 0 0 2024-09-17T01:52:14.755 INFO:tasks.workunit.client.0.smithi031.stdout:5/784: rename da/d14/dac/d82/dc3/ddb to da/dc/df8/d113 0 2024-09-17T01:52:14.756 INFO:tasks.workunit.client.1.smithi092.stdout:3/652: dwrite d4/d2f/f9a [0,4194304] 0 2024-09-17T01:52:14.758 INFO:tasks.workunit.client.1.smithi092.stdout:8/555: sync 2024-09-17T01:52:14.758 INFO:tasks.workunit.client.1.smithi092.stdout:9/642: dwrite d0/d5/f8 [8388608,4194304] 0 2024-09-17T01:52:14.759 INFO:tasks.workunit.client.1.smithi092.stdout:2/606: write d10/d1d/d2c/f39 [2199258,47539] 0 2024-09-17T01:52:14.759 INFO:tasks.workunit.client.0.smithi031.stdout:3/808: dread db/f3e [0,4194304] 0 2024-09-17T01:52:14.761 INFO:tasks.workunit.client.1.smithi092.stdout:9/643: read - d0/d7/d12/fae zero size 2024-09-17T01:52:14.762 INFO:tasks.workunit.client.0.smithi031.stdout:0/871: rename d0/d29/d33/d5/d48/d12c/d118 to d0/d29/d33/d5/d48/d56/dc8/d12f 0 2024-09-17T01:52:14.763 INFO:tasks.workunit.client.0.smithi031.stdout:1/779: link d4/d3d/d65/d78/f90 d4/d1e/d3f/d72/d7e/f102 0 2024-09-17T01:52:14.765 INFO:tasks.workunit.client.1.smithi092.stdout:3/653: symlink d4/d2f/d44/d3c/ld9 0 2024-09-17T01:52:14.766 INFO:tasks.workunit.client.1.smithi092.stdout:4/788: creat d4/d5/d8/d99/dcf/f100 x:0 0 0 2024-09-17T01:52:14.767 INFO:tasks.workunit.client.1.smithi092.stdout:8/556: creat d15/d32/d40/d42/d6b/fb4 x:0 0 0 2024-09-17T01:52:14.768 INFO:tasks.workunit.client.1.smithi092.stdout:4/789: write d4/d5/d8/d92/fa3 [1808345,55648] 0 2024-09-17T01:52:14.768 INFO:tasks.workunit.client.0.smithi031.stdout:8/734: truncate d0/df/d19/fba 3217407 0 2024-09-17T01:52:14.770 INFO:tasks.workunit.client.0.smithi031.stdout:5/785: link da/ded/ff9 da/ded/f114 0 2024-09-17T01:52:14.770 INFO:tasks.workunit.client.1.smithi092.stdout:9/644: creat d0/d7/d12/d34/d26/d54/d6b/fbc x:0 0 0 2024-09-17T01:52:14.772 INFO:tasks.workunit.client.0.smithi031.stdout:0/872: dwrite d0/d29/d33/d2a/d25/d38/fbf [0,4194304] 0 2024-09-17T01:52:14.773 INFO:tasks.workunit.client.1.smithi092.stdout:3/654: mkdir d4/d2f/d44/d54/dda 0 2024-09-17T01:52:14.774 INFO:tasks.workunit.client.1.smithi092.stdout:3/655: dread - d4/d20/d39/f93 zero size 2024-09-17T01:52:14.774 INFO:tasks.workunit.client.0.smithi031.stdout:0/873: chown d0/cbd 715771 1 2024-09-17T01:52:14.775 INFO:tasks.workunit.client.1.smithi092.stdout:2/607: mkdir d10/d4c/d80/d95/dc6/dc9 0 2024-09-17T01:52:14.776 INFO:tasks.workunit.client.0.smithi031.stdout:0/874: fdatasync d0/d29/da7/db3/d4a/d86/fd9 0 2024-09-17T01:52:14.778 INFO:tasks.workunit.client.0.smithi031.stdout:0/875: write d0/d29/d33/d5/dec/f127 [529126,1364] 0 2024-09-17T01:52:14.778 INFO:tasks.workunit.client.0.smithi031.stdout:8/735: fdatasync d0/d5/d54/fbf 0 2024-09-17T01:52:14.778 INFO:tasks.workunit.client.1.smithi092.stdout:9/645: mkdir d0/d7c/dbd 0 2024-09-17T01:52:14.779 INFO:tasks.workunit.client.1.smithi092.stdout:4/790: mkdir d4/d13/d3b/d42/d76/d35/d3e/d101 0 2024-09-17T01:52:14.780 INFO:tasks.workunit.client.0.smithi031.stdout:8/736: readlink d0/df/dd/l30 0 2024-09-17T01:52:14.782 INFO:tasks.workunit.client.0.smithi031.stdout:3/809: rename db/d29/fab to db/df/d1d/d37/d6c/d96/f100 0 2024-09-17T01:52:14.783 INFO:tasks.workunit.client.1.smithi092.stdout:2/608: rename d10/d1d/d96/d77/f2b to d10/d4c/d80/d95/dc6/fca 0 2024-09-17T01:52:14.784 INFO:tasks.workunit.client.1.smithi092.stdout:9/646: creat d0/fbe x:0 0 0 2024-09-17T01:52:14.785 INFO:tasks.workunit.client.1.smithi092.stdout:2/609: mkdir d10/d5c/d81/dcb 0 2024-09-17T01:52:14.786 INFO:tasks.workunit.client.1.smithi092.stdout:4/791: mkdir d4/d5/d1d/d102 0 2024-09-17T01:52:14.788 INFO:tasks.workunit.client.0.smithi031.stdout:8/737: dwrite d0/df/d19/f33 [0,4194304] 0 2024-09-17T01:52:14.791 INFO:tasks.workunit.client.1.smithi092.stdout:9/647: rename d0/d7/d12/d34/d26/d54/d6b/c81 to d0/d7/d21/cbf 0 2024-09-17T01:52:14.791 INFO:tasks.workunit.client.0.smithi031.stdout:0/876: creat d0/d29/d44/d117/f130 x:0 0 0 2024-09-17T01:52:14.792 INFO:tasks.workunit.client.0.smithi031.stdout:3/810: dwrite db/df/d1d/d37/d77/f8b [0,4194304] 0 2024-09-17T01:52:14.794 INFO:tasks.workunit.client.0.smithi031.stdout:3/811: fdatasync db/df/dc8/d6a/f8c 0 2024-09-17T01:52:14.795 INFO:tasks.workunit.client.1.smithi092.stdout:9/648: truncate d0/d7/d12/d34/f3a 293557 0 2024-09-17T01:52:14.795 INFO:tasks.workunit.client.1.smithi092.stdout:2/610: dread d10/d1d/d96/d77/f9f [0,4194304] 0 2024-09-17T01:52:14.797 INFO:tasks.workunit.client.0.smithi031.stdout:0/877: creat d0/d29/d33/d5/d48/d12c/f131 x:0 0 0 2024-09-17T01:52:14.800 INFO:tasks.workunit.client.0.smithi031.stdout:0/878: truncate d0/d29/d33/d5/d48/d56/fea 4994529 0 2024-09-17T01:52:14.804 INFO:tasks.workunit.client.1.smithi092.stdout:9/649: link d0/df/d5d/la6 d0/d7c/dbd/lc0 0 2024-09-17T01:52:14.805 INFO:tasks.workunit.client.0.smithi031.stdout:0/879: mkdir d0/d29/d33/d5/d48/d56/dc8/d12f/d132 0 2024-09-17T01:52:14.806 INFO:tasks.workunit.client.1.smithi092.stdout:2/611: dwrite d10/d1d/d24/f62 [0,4194304] 0 2024-09-17T01:52:14.806 INFO:tasks.workunit.client.1.smithi092.stdout:2/612: fdatasync d10/d8d/f34 0 2024-09-17T01:52:14.806 INFO:tasks.workunit.client.1.smithi092.stdout:2/613: read - d10/d3a/d97/fc8 zero size 2024-09-17T01:52:14.810 INFO:tasks.workunit.client.1.smithi092.stdout:9/650: creat d0/d5/fc1 x:0 0 0 2024-09-17T01:52:14.810 INFO:tasks.workunit.client.0.smithi031.stdout:5/786: dread da/dc/f3a [0,4194304] 0 2024-09-17T01:52:14.813 INFO:tasks.workunit.client.1.smithi092.stdout:2/614: creat d10/fcc x:0 0 0 2024-09-17T01:52:14.813 INFO:tasks.workunit.client.1.smithi092.stdout:9/651: creat d0/d7c/da9/fc2 x:0 0 0 2024-09-17T01:52:14.814 INFO:tasks.workunit.client.0.smithi031.stdout:9/767: write d3/f15 [465679,105531] 0 2024-09-17T01:52:14.816 INFO:tasks.workunit.client.1.smithi092.stdout:2/615: unlink d10/f5d 0 2024-09-17T01:52:14.816 INFO:tasks.workunit.client.0.smithi031.stdout:0/880: dwrite d0/d29/d33/d5/dec/f127 [0,4194304] 0 2024-09-17T01:52:14.821 INFO:tasks.workunit.client.0.smithi031.stdout:5/787: rename da/d14/dac/l52 to da/d4b/d6c/df2/de7/l115 0 2024-09-17T01:52:14.823 INFO:tasks.workunit.client.1.smithi092.stdout:9/652: creat d0/d7/d12/d34/d26/d54/fc3 x:0 0 0 2024-09-17T01:52:14.825 INFO:tasks.workunit.client.0.smithi031.stdout:8/738: dread d0/f74 [0,4194304] 0 2024-09-17T01:52:14.825 INFO:tasks.workunit.client.0.smithi031.stdout:0/881: truncate d0/d29/d33/f35 5416694 0 2024-09-17T01:52:14.827 INFO:tasks.workunit.client.0.smithi031.stdout:1/780: write d4/d3d/d65/f75 [1787743,7239] 0 2024-09-17T01:52:14.827 INFO:tasks.workunit.client.1.smithi092.stdout:9/653: read d0/df/d17/f1c [819963,27563] 0 2024-09-17T01:52:14.828 INFO:tasks.workunit.client.0.smithi031.stdout:9/768: write d3/d4/d29/f78 [352001,18304] 0 2024-09-17T01:52:14.828 INFO:tasks.workunit.client.1.smithi092.stdout:8/557: truncate d15/f1f 267734 0 2024-09-17T01:52:14.828 INFO:tasks.workunit.client.1.smithi092.stdout:2/616: dwrite d10/d4c/d80/d95/fa0 [0,4194304] 0 2024-09-17T01:52:14.831 INFO:tasks.workunit.client.1.smithi092.stdout:8/558: readlink d15/d32/l7f 0 2024-09-17T01:52:14.832 INFO:tasks.workunit.client.0.smithi031.stdout:3/812: dread db/df/d1d/d37/d6c/d6e/fbc [0,4194304] 0 2024-09-17T01:52:14.833 INFO:tasks.workunit.client.1.smithi092.stdout:2/617: dread d10/f14 [0,4194304] 0 2024-09-17T01:52:14.833 INFO:tasks.workunit.client.0.smithi031.stdout:0/882: unlink d0/d29/da7/db3/d4a/d86/dd7/dac/lcb 0 2024-09-17T01:52:14.833 INFO:tasks.workunit.client.0.smithi031.stdout:3/813: chown db/df/dc8/l91 133 1 2024-09-17T01:52:14.834 INFO:tasks.workunit.client.1.smithi092.stdout:9/654: mkdir d0/d7/d12/d34/d26/d54/d6b/dc4 0 2024-09-17T01:52:14.835 INFO:tasks.workunit.client.1.smithi092.stdout:2/618: fsync d10/d55/f5b 0 2024-09-17T01:52:14.838 INFO:tasks.workunit.client.0.smithi031.stdout:1/781: mknod d4/d1a/d43/d53/dd3/dd8/c103 0 2024-09-17T01:52:14.838 INFO:tasks.workunit.client.0.smithi031.stdout:2/873: sync 2024-09-17T01:52:14.839 INFO:tasks.workunit.client.1.smithi092.stdout:8/559: link d15/d25/d2b/d3d/l8c d15/d32/d40/d42/d93/lb5 0 2024-09-17T01:52:14.839 INFO:tasks.workunit.client.1.smithi092.stdout:9/655: write d0/d7/d12/d34/d26/d54/f9c [4708740,26907] 0 2024-09-17T01:52:14.839 INFO:tasks.workunit.client.0.smithi031.stdout:3/814: symlink db/df/d1d/df2/l101 0 2024-09-17T01:52:14.839 INFO:tasks.workunit.client.1.smithi092.stdout:2/619: fdatasync d10/d1d/d24/f29 0 2024-09-17T01:52:14.841 INFO:tasks.workunit.client.1.smithi092.stdout:4/792: dwrite d4/d13/d3b/d42/fc7 [0,4194304] 0 2024-09-17T01:52:14.842 INFO:tasks.workunit.client.1.smithi092.stdout:8/560: write d15/d25/f68 [2949720,26002] 0 2024-09-17T01:52:14.843 INFO:tasks.workunit.client.0.smithi031.stdout:0/883: rename d0/d29/d33/d5/d48/d56/dc8/dcc to d0/d29/da7/db3/d4a/d86/d133 0 2024-09-17T01:52:14.844 INFO:tasks.workunit.client.1.smithi092.stdout:9/656: fsync d0/d5/d29/f6a 0 2024-09-17T01:52:14.844 INFO:tasks.workunit.client.1.smithi092.stdout:2/620: creat d10/d55/d84/fcd x:0 0 0 2024-09-17T01:52:14.845 INFO:tasks.workunit.client.0.smithi031.stdout:2/874: creat d1/d3/df/d11/d30/da1/f125 x:0 0 0 2024-09-17T01:52:14.846 INFO:tasks.workunit.client.1.smithi092.stdout:4/793: symlink d4/dbd/l103 0 2024-09-17T01:52:14.847 INFO:tasks.workunit.client.0.smithi031.stdout:3/815: dwrite db/da3/fbb [0,4194304] 0 2024-09-17T01:52:14.847 INFO:tasks.workunit.client.1.smithi092.stdout:4/794: fdatasync d4/d5/d1d/d30/f5b 0 2024-09-17T01:52:14.848 INFO:tasks.workunit.client.0.smithi031.stdout:1/782: creat d4/d1a/d2d/f104 x:0 0 0 2024-09-17T01:52:14.850 INFO:tasks.workunit.client.1.smithi092.stdout:4/795: write d4/d7b/ff5 [968051,23761] 0 2024-09-17T01:52:14.850 INFO:tasks.workunit.client.1.smithi092.stdout:8/561: symlink d15/d25/d2b/d63/lb6 0 2024-09-17T01:52:14.854 INFO:tasks.workunit.client.1.smithi092.stdout:9/657: creat d0/d7/d12/d34/fc5 x:0 0 0 2024-09-17T01:52:14.855 INFO:tasks.workunit.client.0.smithi031.stdout:2/875: creat d1/f126 x:0 0 0 2024-09-17T01:52:14.856 INFO:tasks.workunit.client.0.smithi031.stdout:8/739: dread d0/d5/d9b/f5c [0,4194304] 0 2024-09-17T01:52:14.857 INFO:tasks.workunit.client.0.smithi031.stdout:3/816: unlink db/df/d1d/d37/c3c 0 2024-09-17T01:52:14.857 INFO:tasks.workunit.client.0.smithi031.stdout:8/740: fsync d0/df/d19/f27 0 2024-09-17T01:52:14.858 INFO:tasks.workunit.client.0.smithi031.stdout:8/741: dread - d0/d5/d9b/fc4 zero size 2024-09-17T01:52:14.859 INFO:tasks.workunit.client.1.smithi092.stdout:4/796: rename d4/d5/fd3 to d4/d13/d20/de0/f104 0 2024-09-17T01:52:14.859 INFO:tasks.workunit.client.0.smithi031.stdout:1/783: rename d4/d3d/d65/lbe to d4/d1e/d3f/d72/d7e/d92/l105 0 2024-09-17T01:52:14.859 INFO:tasks.workunit.client.0.smithi031.stdout:8/742: readlink d0/l2 0 2024-09-17T01:52:14.860 INFO:tasks.workunit.client.1.smithi092.stdout:4/797: fsync d4/d13/d3b/d42/f86 0 2024-09-17T01:52:14.861 INFO:tasks.workunit.client.1.smithi092.stdout:2/621: mkdir d10/d1d/d96/d77/dce 0 2024-09-17T01:52:14.862 INFO:tasks.workunit.client.1.smithi092.stdout:9/658: mkdir d0/d7/d12/d98/dc6 0 2024-09-17T01:52:14.866 INFO:tasks.workunit.client.0.smithi031.stdout:2/876: rename d1/db6/fbd to d1/d7c/f127 0 2024-09-17T01:52:14.866 INFO:tasks.workunit.client.1.smithi092.stdout:8/562: creat d15/d25/d27/dae/fb7 x:0 0 0 2024-09-17T01:52:14.867 INFO:tasks.workunit.client.1.smithi092.stdout:4/798: write d4/f1e [4339631,81497] 0 2024-09-17T01:52:14.868 INFO:tasks.workunit.client.1.smithi092.stdout:4/799: chown d4/d7b/d7d/f93 89667 1 2024-09-17T01:52:14.869 INFO:tasks.workunit.client.1.smithi092.stdout:2/622: creat d10/d1d/d2c/fcf x:0 0 0 2024-09-17T01:52:14.870 INFO:tasks.workunit.client.0.smithi031.stdout:5/788: truncate da/d14/dac/d82/d92/f94 3523940 0 2024-09-17T01:52:14.871 INFO:tasks.workunit.client.1.smithi092.stdout:9/659: unlink d0/df/d17/f1c 0 2024-09-17T01:52:14.872 INFO:tasks.workunit.client.1.smithi092.stdout:9/660: write d0/d7/d12/d34/fc5 [209963,38587] 0 2024-09-17T01:52:14.873 INFO:tasks.workunit.client.1.smithi092.stdout:8/563: creat d15/d25/d2b/d63/fb8 x:0 0 0 2024-09-17T01:52:14.873 INFO:tasks.workunit.client.0.smithi031.stdout:3/817: rename db/df/d1d/d37/d77/dc2/fa2 to db/df/dc8/f102 0 2024-09-17T01:52:14.874 INFO:tasks.workunit.client.1.smithi092.stdout:2/623: unlink d10/d1d/f26 0 2024-09-17T01:52:14.876 INFO:tasks.workunit.client.1.smithi092.stdout:4/800: write d4/d13/d3b/d42/d76/d35/d3e/d7c/f8a [1830635,108923] 0 2024-09-17T01:52:14.878 INFO:tasks.workunit.client.0.smithi031.stdout:2/877: truncate d1/d3/df/d11/d30/ddd/de3/fea 47177 0 2024-09-17T01:52:14.879 INFO:tasks.workunit.client.1.smithi092.stdout:8/564: rmdir d15/d25/d2b 39 2024-09-17T01:52:14.879 INFO:tasks.workunit.client.0.smithi031.stdout:3/818: dread db/f12 [0,4194304] 0 2024-09-17T01:52:14.881 INFO:tasks.workunit.client.0.smithi031.stdout:1/784: rename d4/d1a/d43/d53/f73 to d4/d1a/d43/f106 0 2024-09-17T01:52:14.883 INFO:tasks.workunit.client.1.smithi092.stdout:2/624: creat d10/fd0 x:0 0 0 2024-09-17T01:52:14.884 INFO:tasks.workunit.client.0.smithi031.stdout:3/819: truncate db/df/d1d/f59 819788 0 2024-09-17T01:52:14.887 INFO:tasks.workunit.client.1.smithi092.stdout:2/625: getdents d10/d3a/d97 0 2024-09-17T01:52:14.892 INFO:tasks.workunit.client.0.smithi031.stdout:1/785: mkdir d4/d1a/d43/d53/dd3/dee/d107 0 2024-09-17T01:52:14.893 INFO:tasks.workunit.client.1.smithi092.stdout:4/801: truncate d4/d5/fd2 3810555 0 2024-09-17T01:52:14.893 INFO:tasks.workunit.client.0.smithi031.stdout:3/820: dwrite db/df/d1d/d37/d77/dc2/fbf [0,4194304] 0 2024-09-17T01:52:14.894 INFO:tasks.workunit.client.1.smithi092.stdout:4/802: dread - d4/d13/d3b/fca zero size 2024-09-17T01:52:14.896 INFO:tasks.workunit.client.0.smithi031.stdout:2/878: creat d1/d3/df/d11/d30/ddd/de3/f128 x:0 0 0 2024-09-17T01:52:14.897 INFO:tasks.workunit.client.0.smithi031.stdout:5/789: dread da/d42/f9d [0,4194304] 0 2024-09-17T01:52:14.898 INFO:tasks.workunit.client.1.smithi092.stdout:2/626: dwrite d10/d1d/d96/d77/d9c/dae/fc5 [0,4194304] 0 2024-09-17T01:52:14.900 INFO:tasks.workunit.client.0.smithi031.stdout:3/821: truncate db/df/d1d/d37/d6c/ffc 229066 0 2024-09-17T01:52:14.911 INFO:tasks.workunit.client.0.smithi031.stdout:2/879: mknod d1/d3/df/d18/c129 0 2024-09-17T01:52:14.912 INFO:tasks.workunit.client.0.smithi031.stdout:5/790: rmdir da/d14/dac/d82 39 2024-09-17T01:52:14.916 INFO:tasks.workunit.client.0.smithi031.stdout:5/791: creat da/ded/f116 x:0 0 0 2024-09-17T01:52:14.921 INFO:tasks.workunit.client.0.smithi031.stdout:3/822: creat db/f103 x:0 0 0 2024-09-17T01:52:14.922 INFO:tasks.workunit.client.0.smithi031.stdout:1/786: getdents d4/d1e/d5d/dae 0 2024-09-17T01:52:14.925 INFO:tasks.workunit.client.0.smithi031.stdout:3/823: mkdir db/df/dc8/d6a/d83/d104 0 2024-09-17T01:52:14.926 INFO:tasks.workunit.client.0.smithi031.stdout:1/787: symlink d4/d1e/d40/daa/l108 0 2024-09-17T01:52:14.933 INFO:tasks.workunit.client.0.smithi031.stdout:3/824: write db/d9b/fe0 [162025,51866] 0 2024-09-17T01:52:14.933 INFO:tasks.workunit.client.0.smithi031.stdout:5/792: dread da/d14/dac/d62/f78 [0,4194304] 0 2024-09-17T01:52:14.934 INFO:tasks.workunit.client.0.smithi031.stdout:3/825: fdatasync db/df/d50/f62 0 2024-09-17T01:52:14.936 INFO:tasks.workunit.client.0.smithi031.stdout:5/793: mknod da/dc/d98/c117 0 2024-09-17T01:52:14.937 INFO:tasks.workunit.client.0.smithi031.stdout:3/826: symlink db/df/d1d/d37/d6c/d6e/dd4/l105 0 2024-09-17T01:52:14.938 INFO:tasks.workunit.client.0.smithi031.stdout:5/794: mkdir da/dc/d98/d118 0 2024-09-17T01:52:14.938 INFO:tasks.workunit.client.0.smithi031.stdout:3/827: chown db/df/dc8/d6a/d83/dcb/l69 24021028 1 2024-09-17T01:52:14.939 INFO:tasks.workunit.client.0.smithi031.stdout:3/828: read - db/df/dc8/d6a/d83/de4/ff3 zero size 2024-09-17T01:52:14.939 INFO:tasks.workunit.client.0.smithi031.stdout:5/795: rmdir da/d4b/d6c/df2/de7 39 2024-09-17T01:52:14.940 INFO:tasks.workunit.client.0.smithi031.stdout:3/829: fdatasync db/df/dc8/deb/ffa 0 2024-09-17T01:52:14.941 INFO:tasks.workunit.client.0.smithi031.stdout:5/796: write da/d42/fe9 [40276,10180] 0 2024-09-17T01:52:14.946 INFO:tasks.workunit.client.0.smithi031.stdout:5/797: rename da/d42/d12/f23 to da/d14/dac/d62/d112/f119 0 2024-09-17T01:52:14.953 INFO:tasks.workunit.client.0.smithi031.stdout:3/830: dread db/fe [0,4194304] 0 2024-09-17T01:52:14.964 INFO:tasks.workunit.client.0.smithi031.stdout:3/831: rmdir db 39 2024-09-17T01:52:14.974 INFO:tasks.workunit.client.1.smithi092.stdout:0/668: sync 2024-09-17T01:52:14.976 INFO:tasks.workunit.client.0.smithi031.stdout:3/832: dread db/f3e [8388608,4194304] 0 2024-09-17T01:52:14.977 INFO:tasks.workunit.client.0.smithi031.stdout:3/833: chown db/df/d1d/d37/d6c/d6e/cb6 63 1 2024-09-17T01:52:14.977 INFO:tasks.workunit.client.0.smithi031.stdout:3/834: chown db/d9b/c9d 756309856 1 2024-09-17T01:52:14.978 INFO:tasks.workunit.client.1.smithi092.stdout:4/803: link d4/d5/d8/d99/dcf/f100 d4/d5/f105 0 2024-09-17T01:52:14.980 INFO:tasks.workunit.client.1.smithi092.stdout:9/661: dread d0/d7/d21/fa5 [0,4194304] 0 2024-09-17T01:52:14.980 INFO:tasks.workunit.client.1.smithi092.stdout:4/804: write d4/d13/d3b/f47 [9112042,111142] 0 2024-09-17T01:52:14.982 INFO:tasks.workunit.client.1.smithi092.stdout:4/805: write d4/d5/d8/d92/ff8 [475676,36143] 0 2024-09-17T01:52:14.984 INFO:tasks.workunit.client.0.smithi031.stdout:3/835: truncate db/df/dc8/d6a/d83/de4/ff8 740560 0 2024-09-17T01:52:14.985 INFO:tasks.workunit.client.0.smithi031.stdout:3/836: chown db/df/d1d/fce 0 1 2024-09-17T01:52:14.988 INFO:tasks.workunit.client.0.smithi031.stdout:3/837: mknod db/df/dc8/d6a/c106 0 2024-09-17T01:52:14.990 INFO:tasks.workunit.client.0.smithi031.stdout:5/798: dread da/dc/f3e [0,4194304] 0 2024-09-17T01:52:14.992 INFO:tasks.workunit.client.0.smithi031.stdout:3/838: link db/df/dc8/f102 db/da3/f107 0 2024-09-17T01:52:14.994 INFO:tasks.workunit.client.0.smithi031.stdout:5/799: creat da/d14/f11a x:0 0 0 2024-09-17T01:52:14.996 INFO:tasks.workunit.client.1.smithi092.stdout:2/627: dread d10/d55/f5b [0,4194304] 0 2024-09-17T01:52:14.996 INFO:tasks.workunit.client.1.smithi092.stdout:0/669: rename d3/l95 to d3/ld5 0 2024-09-17T01:52:14.997 INFO:tasks.workunit.client.0.smithi031.stdout:5/800: symlink da/dc/l11b 0 2024-09-17T01:52:14.997 INFO:tasks.workunit.client.0.smithi031.stdout:3/839: dwrite db/f34 [0,4194304] 0 2024-09-17T01:52:14.998 INFO:tasks.workunit.client.1.smithi092.stdout:9/662: rename d0/df/d5d/l5f to d0/df/d17/d9d/lc7 0 2024-09-17T01:52:14.998 INFO:tasks.workunit.client.0.smithi031.stdout:5/801: write da/ded/f116 [637682,59436] 0 2024-09-17T01:52:15.000 INFO:tasks.workunit.client.0.smithi031.stdout:3/840: rmdir db/df/dc8/d6a/ddd 39 2024-09-17T01:52:15.000 INFO:tasks.workunit.client.1.smithi092.stdout:2/628: symlink d10/d1d/d96/d77/d9c/dae/ld1 0 2024-09-17T01:52:15.001 INFO:tasks.workunit.client.0.smithi031.stdout:5/802: creat da/d4b/f11c x:0 0 0 2024-09-17T01:52:15.002 INFO:tasks.workunit.client.1.smithi092.stdout:9/663: read d0/d7/f36 [4159551,39002] 0 2024-09-17T01:52:15.002 INFO:tasks.workunit.client.0.smithi031.stdout:3/841: write db/d9b/fa9 [1325273,37965] 0 2024-09-17T01:52:15.003 INFO:tasks.workunit.client.0.smithi031.stdout:5/803: unlink da/d14/lae 0 2024-09-17T01:52:15.005 INFO:tasks.workunit.client.0.smithi031.stdout:3/842: read db/df/d1d/d37/f4d [776993,129282] 0 2024-09-17T01:52:15.006 INFO:tasks.workunit.client.0.smithi031.stdout:5/804: readlink da/d42/d12/d4a/l7d 0 2024-09-17T01:52:15.007 INFO:tasks.workunit.client.1.smithi092.stdout:9/664: dread - d0/d5/fc1 zero size 2024-09-17T01:52:15.012 INFO:tasks.workunit.client.1.smithi092.stdout:2/629: dwrite d10/d8d/f31 [0,4194304] 0 2024-09-17T01:52:15.013 INFO:tasks.workunit.client.0.smithi031.stdout:5/805: truncate da/dc/fc9 1335782 0 2024-09-17T01:52:15.013 INFO:tasks.workunit.client.0.smithi031.stdout:5/806: creat da/d4b/d6c/f11d x:0 0 0 2024-09-17T01:52:15.014 INFO:tasks.workunit.client.1.smithi092.stdout:0/670: dwrite d3/da/d1c/d3a/f57 [0,4194304] 0 2024-09-17T01:52:15.016 INFO:tasks.workunit.client.1.smithi092.stdout:0/671: write d3/dc8/f6e [772142,80191] 0 2024-09-17T01:52:15.019 INFO:tasks.workunit.client.0.smithi031.stdout:5/807: symlink da/d14/dac/d82/d92/l11e 0 2024-09-17T01:52:15.021 INFO:tasks.workunit.client.0.smithi031.stdout:7/865: sync 2024-09-17T01:52:15.022 INFO:tasks.workunit.client.1.smithi092.stdout:9/665: write d0/d5/d29/f6a [1041106,36075] 0 2024-09-17T01:52:15.023 INFO:tasks.workunit.client.0.smithi031.stdout:7/866: write db/d1c/d41/d6c/f9d [227842,63941] 0 2024-09-17T01:52:15.025 INFO:tasks.workunit.client.1.smithi092.stdout:0/672: dwrite d3/d2e/d3b/f82 [0,4194304] 0 2024-09-17T01:52:15.028 INFO:tasks.workunit.client.0.smithi031.stdout:7/867: creat db/d1c/d41/d69/de7/f114 x:0 0 0 2024-09-17T01:52:15.029 INFO:tasks.workunit.client.1.smithi092.stdout:2/630: write d10/d1d/d96/d77/f9f [236554,116213] 0 2024-09-17T01:52:15.031 INFO:tasks.workunit.client.1.smithi092.stdout:9/666: creat d0/d7/d12/d86/fc8 x:0 0 0 2024-09-17T01:52:15.032 INFO:tasks.workunit.client.1.smithi092.stdout:0/673: creat d3/d2e/d55/d63/dc1/fd6 x:0 0 0 2024-09-17T01:52:15.033 INFO:tasks.workunit.client.0.smithi031.stdout:7/868: creat db/d1c/d46/d95/f115 x:0 0 0 2024-09-17T01:52:15.034 INFO:tasks.workunit.client.1.smithi092.stdout:0/674: mknod d3/d2e/d3b/da7/cd7 0 2024-09-17T01:52:15.036 INFO:tasks.workunit.client.1.smithi092.stdout:0/675: write d3/d2e/d55/d63/fc0 [646901,20173] 0 2024-09-17T01:52:15.037 INFO:tasks.workunit.client.0.smithi031.stdout:3/843: dwrite db/df/f39 [0,4194304] 0 2024-09-17T01:52:15.038 INFO:tasks.workunit.client.0.smithi031.stdout:5/808: dwrite da/d42/d12/d64/ffc [0,4194304] 0 2024-09-17T01:52:15.039 INFO:tasks.workunit.client.0.smithi031.stdout:7/869: mknod db/d1c/d46/c116 0 2024-09-17T01:52:15.040 INFO:tasks.workunit.client.1.smithi092.stdout:2/631: dread d10/d1d/d96/d77/f3e [0,4194304] 0 2024-09-17T01:52:15.041 INFO:tasks.workunit.client.1.smithi092.stdout:2/632: chown d10/d8d/f76 778957017 1 2024-09-17T01:52:15.043 INFO:tasks.workunit.client.1.smithi092.stdout:2/633: creat d10/d1d/fd2 x:0 0 0 2024-09-17T01:52:15.044 INFO:tasks.workunit.client.0.smithi031.stdout:5/809: symlink da/d42/d26/l11f 0 2024-09-17T01:52:15.048 INFO:tasks.workunit.client.0.smithi031.stdout:5/810: mknod da/d14/dac/d82/dc3/c120 0 2024-09-17T01:52:15.049 INFO:tasks.workunit.client.0.smithi031.stdout:3/844: link db/c13 db/df/d1d/d37/d6c/d6e/dd4/c108 0 2024-09-17T01:52:15.049 INFO:tasks.workunit.client.1.smithi092.stdout:2/634: dwrite d10/d55/d84/fbb [0,4194304] 0 2024-09-17T01:52:15.055 INFO:tasks.workunit.client.0.smithi031.stdout:3/845: truncate db/df/dc8/f102 1221529 0 2024-09-17T01:52:15.057 INFO:tasks.workunit.client.0.smithi031.stdout:3/846: write db/df/d1d/d37/d77/f8b [1656985,46594] 0 2024-09-17T01:52:15.059 INFO:tasks.workunit.client.0.smithi031.stdout:5/811: truncate da/d14/dac/fe8 509605 0 2024-09-17T01:52:15.061 INFO:tasks.workunit.client.0.smithi031.stdout:3/847: creat db/df/d1d/d37/d6c/d6e/f109 x:0 0 0 2024-09-17T01:52:15.062 INFO:tasks.workunit.client.0.smithi031.stdout:7/870: dread db/f89 [0,4194304] 0 2024-09-17T01:52:15.063 INFO:tasks.workunit.client.0.smithi031.stdout:5/812: mkdir da/d42/d12/d64/d121 0 2024-09-17T01:52:15.064 INFO:tasks.workunit.client.0.smithi031.stdout:7/871: write db/f3a [572587,40423] 0 2024-09-17T01:52:15.065 INFO:tasks.workunit.client.0.smithi031.stdout:5/813: truncate da/d14/dac/d62/ff4 297632 0 2024-09-17T01:52:15.067 INFO:tasks.workunit.client.0.smithi031.stdout:5/814: write da/d14/dac/dc2/fc5 [126574,88444] 0 2024-09-17T01:52:15.072 INFO:tasks.workunit.client.0.smithi031.stdout:3/848: link db/df/dc8/ce8 db/df/d1d/d37/d4a/c10a 0 2024-09-17T01:52:15.074 INFO:tasks.workunit.client.1.smithi092.stdout:0/676: truncate d3/d2e/d55/d63/d81/fac 3137973 0 2024-09-17T01:52:15.075 INFO:tasks.workunit.client.0.smithi031.stdout:5/815: dwrite da/d42/d12/f86 [0,4194304] 0 2024-09-17T01:52:15.076 INFO:tasks.workunit.client.1.smithi092.stdout:0/677: rmdir d3/d2e/d3b/d48 39 2024-09-17T01:52:15.077 INFO:tasks.workunit.client.0.smithi031.stdout:5/816: dread - da/d14/dac/d62/f101 zero size 2024-09-17T01:52:15.080 INFO:tasks.workunit.client.0.smithi031.stdout:3/849: dwrite db/df/dc8/d6a/d83/de4/ff3 [0,4194304] 0 2024-09-17T01:52:15.091 INFO:tasks.workunit.client.0.smithi031.stdout:3/850: creat db/df/dc8/d6a/d83/de4/f10b x:0 0 0 2024-09-17T01:52:15.092 INFO:tasks.workunit.client.0.smithi031.stdout:7/872: write db/d1c/d41/d69/f70 [1704076,106562] 0 2024-09-17T01:52:15.105 INFO:tasks.workunit.client.1.smithi092.stdout:0/678: dread d3/d2e/d3b/d48/f5b [0,4194304] 0 2024-09-17T01:52:15.109 INFO:tasks.workunit.client.1.smithi092.stdout:0/679: write d3/da/fa2 [137435,112690] 0 2024-09-17T01:52:15.112 INFO:tasks.workunit.client.1.smithi092.stdout:0/680: rename d3/d1d to d3/d2e/d3b/d8f/d5f/db1/dd8 0 2024-09-17T01:52:15.112 INFO:tasks.workunit.client.1.smithi092.stdout:0/681: readlink d3/d2e/d3b/d8f/lb5 0 2024-09-17T01:52:15.114 INFO:tasks.workunit.client.1.smithi092.stdout:0/682: unlink d3/d2e/d3b/d8f/d5f/db1/dd8/fcb 0 2024-09-17T01:52:15.122 INFO:tasks.workunit.client.0.smithi031.stdout:3/851: unlink db/d82/cad 0 2024-09-17T01:52:15.122 INFO:tasks.workunit.client.0.smithi031.stdout:7/873: creat db/d18/d67/dac/ddd/dc1/f117 x:0 0 0 2024-09-17T01:52:15.123 INFO:tasks.workunit.client.0.smithi031.stdout:5/817: getdents da/d14/dac/d82/dc3 0 2024-09-17T01:52:15.124 INFO:tasks.workunit.client.0.smithi031.stdout:7/874: symlink db/d1c/d46/d95/l118 0 2024-09-17T01:52:15.126 INFO:tasks.workunit.client.0.smithi031.stdout:5/818: creat da/d14/dac/d82/ddd/f122 x:0 0 0 2024-09-17T01:52:15.128 INFO:tasks.workunit.client.0.smithi031.stdout:7/875: rename db/d1c/d99/fc3 to db/d18/d67/dac/f119 0 2024-09-17T01:52:15.143 INFO:tasks.workunit.client.0.smithi031.stdout:3/852: truncate db/fa7 1721589 0 2024-09-17T01:52:15.144 INFO:tasks.workunit.client.0.smithi031.stdout:3/853: readlink db/df/d1d/d37/d6c/d6e/dd4/lae 0 2024-09-17T01:52:15.145 INFO:tasks.workunit.client.0.smithi031.stdout:7/876: write db/d1c/d46/d95/da6/fcc [7701765,42529] 0 2024-09-17T01:52:15.147 INFO:tasks.workunit.client.0.smithi031.stdout:3/854: creat db/da3/f10c x:0 0 0 2024-09-17T01:52:15.147 INFO:tasks.workunit.client.0.smithi031.stdout:7/877: fdatasync db/d1c/d46/f52 0 2024-09-17T01:52:15.150 INFO:tasks.workunit.client.0.smithi031.stdout:3/855: write db/df/f1b [1705686,95844] 0 2024-09-17T01:52:15.151 INFO:tasks.workunit.client.0.smithi031.stdout:5/819: dwrite da/ded/f114 [0,4194304] 0 2024-09-17T01:52:15.155 INFO:tasks.workunit.client.0.smithi031.stdout:3/856: mknod db/df/d1d/d37/d77/dc2/c10d 0 2024-09-17T01:52:15.158 INFO:tasks.workunit.client.0.smithi031.stdout:7/878: dwrite db/d1c/d41/d9a/fab [0,4194304] 0 2024-09-17T01:52:15.158 INFO:tasks.workunit.client.0.smithi031.stdout:3/857: read db/df/d1d/d37/d77/dc2/fbf [3295490,24948] 0 2024-09-17T01:52:15.159 INFO:tasks.workunit.client.0.smithi031.stdout:7/879: fsync db/d29/f58 0 2024-09-17T01:52:15.159 INFO:tasks.workunit.client.0.smithi031.stdout:5/820: creat da/d14/dac/f123 x:0 0 0 2024-09-17T01:52:15.165 INFO:tasks.workunit.client.0.smithi031.stdout:5/821: unlink da/d42/d12/d4a/fe2 0 2024-09-17T01:52:15.166 INFO:tasks.workunit.client.0.smithi031.stdout:5/822: chown da/d4b/d6c/df2/d104 39764 1 2024-09-17T01:52:15.168 INFO:tasks.workunit.client.0.smithi031.stdout:7/880: creat db/d1c/d46/f11a x:0 0 0 2024-09-17T01:52:15.170 INFO:tasks.workunit.client.0.smithi031.stdout:5/823: mknod da/dc/da2/c124 0 2024-09-17T01:52:15.170 INFO:tasks.workunit.client.1.smithi092.stdout:0/683: dwrite d3/da/d1c/f45 [4194304,4194304] 0 2024-09-17T01:52:15.171 INFO:tasks.workunit.client.0.smithi031.stdout:7/881: truncate db/d1c/d8e/da7/f90 1017670 0 2024-09-17T01:52:15.172 INFO:tasks.workunit.client.1.smithi092.stdout:0/684: write d3/d2e/d3b/fb9 [403987,99592] 0 2024-09-17T01:52:15.175 INFO:tasks.workunit.client.0.smithi031.stdout:7/882: mkdir db/d1c/d41/d69/dd6/d11b 0 2024-09-17T01:52:15.177 INFO:tasks.workunit.client.0.smithi031.stdout:5/824: dwrite da/d4b/f4d [0,4194304] 0 2024-09-17T01:52:15.177 INFO:tasks.workunit.client.1.smithi092.stdout:0/685: dwrite d3/d2e/d55/d63/fc0 [0,4194304] 0 2024-09-17T01:52:15.178 INFO:tasks.workunit.client.1.smithi092.stdout:0/686: chown d3/d2e/d3b/d8f/d5f/db1/dd8/l5e 2 1 2024-09-17T01:52:15.180 INFO:tasks.workunit.client.1.smithi092.stdout:0/687: chown d3/cf 448233089 1 2024-09-17T01:52:15.182 INFO:tasks.workunit.client.1.smithi092.stdout:6/559: sync 2024-09-17T01:52:15.182 INFO:tasks.workunit.client.1.smithi092.stdout:7/633: sync 2024-09-17T01:52:15.183 INFO:tasks.workunit.client.0.smithi031.stdout:7/883: rename db/d1c/d46/c7a to db/d1c/d41/d69/c11c 0 2024-09-17T01:52:15.186 INFO:tasks.workunit.client.1.smithi092.stdout:0/688: unlink d3/d2e/d3b/d8f/d5f/db1/dd8/l24 0 2024-09-17T01:52:15.186 INFO:tasks.workunit.client.0.smithi031.stdout:7/884: creat db/d1c/d46/d95/da6/f11d x:0 0 0 2024-09-17T01:52:15.187 INFO:tasks.workunit.client.0.smithi031.stdout:7/885: fsync db/d1c/d41/d6c/da0/dd4/ff7 0 2024-09-17T01:52:15.189 INFO:tasks.workunit.client.0.smithi031.stdout:7/886: truncate db/d1c/d46/f107 313143 0 2024-09-17T01:52:15.189 INFO:tasks.workunit.client.1.smithi092.stdout:6/560: creat d3/d10/d8c/d43/d6a/fab x:0 0 0 2024-09-17T01:52:15.190 INFO:tasks.workunit.client.0.smithi031.stdout:7/887: truncate db/d1c/d41/d69/fc0 776386 0 2024-09-17T01:52:15.191 INFO:tasks.workunit.client.1.smithi092.stdout:6/561: rmdir d3/d10/d8c/d49 39 2024-09-17T01:52:15.192 INFO:tasks.workunit.client.0.smithi031.stdout:7/888: creat db/d1c/d46/d95/da6/f11e x:0 0 0 2024-09-17T01:52:15.194 INFO:tasks.workunit.client.0.smithi031.stdout:7/889: mknod db/d1c/d41/d9a/df9/c11f 0 2024-09-17T01:52:15.194 INFO:tasks.workunit.client.1.smithi092.stdout:6/562: mknod d3/d10/cac 0 2024-09-17T01:52:15.195 INFO:tasks.workunit.client.1.smithi092.stdout:6/563: mkdir d3/d25/da8/dad 0 2024-09-17T01:52:15.203 INFO:tasks.workunit.client.0.smithi031.stdout:5/825: truncate da/d4b/f4d 812194 0 2024-09-17T01:52:15.207 INFO:tasks.workunit.client.0.smithi031.stdout:5/826: mknod da/d42/d12/d72/dfe/c125 0 2024-09-17T01:52:15.208 INFO:tasks.workunit.client.0.smithi031.stdout:5/827: fdatasync da/d14/f3b 0 2024-09-17T01:52:15.210 INFO:tasks.workunit.client.0.smithi031.stdout:5/828: write da/d42/d12/d64/ffc [3881088,35386] 0 2024-09-17T01:52:15.210 INFO:tasks.workunit.client.1.smithi092.stdout:7/634: dread d3/d6/d13/d21/d2e/d6e/f20 [0,4194304] 0 2024-09-17T01:52:15.211 INFO:tasks.workunit.client.0.smithi031.stdout:5/829: fdatasync da/d14/f3b 0 2024-09-17T01:52:15.212 INFO:tasks.workunit.client.1.smithi092.stdout:7/635: stat d3/db/d98/dce/d60/d93/ld8 0 2024-09-17T01:52:15.213 INFO:tasks.workunit.client.0.smithi031.stdout:7/890: dwrite db/d18/fa4 [0,4194304] 0 2024-09-17T01:52:15.215 INFO:tasks.workunit.client.0.smithi031.stdout:5/830: write da/d14/dac/f77 [3652587,57292] 0 2024-09-17T01:52:15.217 INFO:tasks.workunit.client.0.smithi031.stdout:7/891: mkdir db/d18/d67/dac/d120 0 2024-09-17T01:52:15.218 INFO:tasks.workunit.client.0.smithi031.stdout:7/892: chown db/d18/f9e 4038206 1 2024-09-17T01:52:15.220 INFO:tasks.workunit.client.0.smithi031.stdout:5/831: mkdir da/d4b/d126 0 2024-09-17T01:52:15.221 INFO:tasks.workunit.client.0.smithi031.stdout:7/893: stat db/d18/d67 0 2024-09-17T01:52:15.222 INFO:tasks.workunit.client.0.smithi031.stdout:5/832: mkdir da/d14/dac/d62/d10d/d127 0 2024-09-17T01:52:15.224 INFO:tasks.workunit.client.0.smithi031.stdout:7/894: rename db/d1c/d41/d6c/fb0 to db/d18/d67/d10e/f121 0 2024-09-17T01:52:15.225 INFO:tasks.workunit.client.0.smithi031.stdout:5/833: mkdir da/d42/d12/d128 0 2024-09-17T01:52:15.226 INFO:tasks.workunit.client.0.smithi031.stdout:7/895: mkdir db/d18/d67/dac/d122 0 2024-09-17T01:52:15.227 INFO:tasks.workunit.client.0.smithi031.stdout:7/896: chown db/d18/l22 37986 1 2024-09-17T01:52:15.232 INFO:tasks.workunit.client.0.smithi031.stdout:7/897: dread db/d1c/d46/f4f [0,4194304] 0 2024-09-17T01:52:15.236 INFO:tasks.workunit.client.0.smithi031.stdout:7/898: unlink l7 0 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi031 to 1217M 2024-09-17T01:52:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:14 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:15.240 INFO:tasks.workunit.client.0.smithi031.stdout:7/899: creat db/d18/d67/d10e/f123 x:0 0 0 2024-09-17T01:52:15.241 INFO:tasks.workunit.client.0.smithi031.stdout:7/900: write db/d18/d67/d10e/f121 [1856489,26462] 0 2024-09-17T01:52:15.252 INFO:tasks.workunit.client.0.smithi031.stdout:7/901: dwrite db/d1c/f71 [0,4194304] 0 2024-09-17T01:52:15.257 INFO:tasks.workunit.client.0.smithi031.stdout:5/834: dread da/d4b/dce/fd9 [0,4194304] 0 2024-09-17T01:52:15.258 INFO:tasks.workunit.client.0.smithi031.stdout:5/835: truncate da/d42/fd8 1405293 0 2024-09-17T01:52:15.258 INFO:tasks.workunit.client.0.smithi031.stdout:5/836: read da/ded/ff9 [3621420,15816] 0 2024-09-17T01:52:15.261 INFO:tasks.workunit.client.0.smithi031.stdout:5/837: creat da/d14/dac/d62/d10d/f129 x:0 0 0 2024-09-17T01:52:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:15.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi031 to 1217M 2024-09-17T01:52:15.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:14 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:15.267 INFO:tasks.workunit.client.0.smithi031.stdout:5/838: dwrite da/d14/dac/d82/f8b [4194304,4194304] 0 2024-09-17T01:52:15.268 INFO:tasks.workunit.client.0.smithi031.stdout:5/839: dread - da/dc/da2/feb zero size 2024-09-17T01:52:15.272 INFO:tasks.workunit.client.0.smithi031.stdout:5/840: unlink da/d42/d26/l11f 0 2024-09-17T01:52:15.272 INFO:tasks.workunit.client.0.smithi031.stdout:5/841: chown da/d42/d12/d4a/l56 51 1 2024-09-17T01:52:15.273 INFO:tasks.workunit.client.1.smithi092.stdout:6/564: dread d3/d25/f9c [0,4194304] 0 2024-09-17T01:52:15.274 INFO:tasks.workunit.client.1.smithi092.stdout:7/636: fsync d3/d6/d13/d21/d2e/f97 0 2024-09-17T01:52:15.276 INFO:tasks.workunit.client.1.smithi092.stdout:6/565: truncate d3/d10/d1f/d21/da5/d18/f6b 4970453 0 2024-09-17T01:52:15.276 INFO:tasks.workunit.client.1.smithi092.stdout:7/637: chown d3/d6/d13/d21/d2e/d6e/f86 1704 1 2024-09-17T01:52:15.277 INFO:tasks.workunit.client.1.smithi092.stdout:7/638: chown d3/db/db2 7152885 1 2024-09-17T01:52:15.279 INFO:tasks.workunit.client.0.smithi031.stdout:5/842: dwrite da/f74 [0,4194304] 0 2024-09-17T01:52:15.280 INFO:tasks.workunit.client.1.smithi092.stdout:7/639: creat d3/db/d98/dce/d6a/fdb x:0 0 0 2024-09-17T01:52:15.282 INFO:tasks.workunit.client.0.smithi031.stdout:5/843: symlink da/d14/dac/d82/ddd/l12a 0 2024-09-17T01:52:15.284 INFO:tasks.workunit.client.0.smithi031.stdout:7/902: dread db/d1c/fa2 [0,4194304] 0 2024-09-17T01:52:15.284 INFO:tasks.workunit.client.1.smithi092.stdout:6/566: dwrite d3/d10/d8c/d49/f75 [0,4194304] 0 2024-09-17T01:52:15.285 INFO:tasks.workunit.client.0.smithi031.stdout:7/903: creat db/d1c/d41/d6c/f124 x:0 0 0 2024-09-17T01:52:15.289 INFO:tasks.workunit.client.0.smithi031.stdout:7/904: creat db/d18/f125 x:0 0 0 2024-09-17T01:52:15.290 INFO:tasks.workunit.client.1.smithi092.stdout:6/567: mkdir d3/d25/da8/dad/dae 0 2024-09-17T01:52:15.293 INFO:tasks.workunit.client.1.smithi092.stdout:6/568: creat d3/d10/d8c/d43/faf x:0 0 0 2024-09-17T01:52:15.293 INFO:tasks.workunit.client.0.smithi031.stdout:7/905: rmdir db/d1c/d8e/ded 0 2024-09-17T01:52:15.294 INFO:tasks.workunit.client.1.smithi092.stdout:6/569: truncate d3/d10/d1f/f59 1536715 0 2024-09-17T01:52:15.296 INFO:tasks.workunit.client.1.smithi092.stdout:7/640: write d3/db/d26/f66 [3153623,21841] 0 2024-09-17T01:52:15.298 INFO:tasks.workunit.client.1.smithi092.stdout:6/570: unlink d3/d10/d1f/d21/d28/d2b/f8b 0 2024-09-17T01:52:15.303 INFO:tasks.workunit.client.1.smithi092.stdout:7/641: dwrite d3/db/d98/dce/f6c [0,4194304] 0 2024-09-17T01:52:15.309 INFO:tasks.workunit.client.1.smithi092.stdout:7/642: dwrite d3/db/d98/dce/f6c [0,4194304] 0 2024-09-17T01:52:15.310 INFO:tasks.workunit.client.1.smithi092.stdout:7/643: chown d3/db/d26/d83/da6 135749 1 2024-09-17T01:52:15.312 INFO:tasks.workunit.client.1.smithi092.stdout:7/644: read - d3/d2b/d84/fca zero size 2024-09-17T01:52:15.313 INFO:tasks.workunit.client.1.smithi092.stdout:6/571: write d3/d10/d1f/d21/da5/f3e [1420214,30701] 0 2024-09-17T01:52:15.314 INFO:tasks.workunit.client.1.smithi092.stdout:7/645: write d3/d6/da1/fc6 [219979,72040] 0 2024-09-17T01:52:15.316 INFO:tasks.workunit.client.1.smithi092.stdout:7/646: rmdir d3/d2b/d84 39 2024-09-17T01:52:15.318 INFO:tasks.workunit.client.1.smithi092.stdout:6/572: getdents d3/d25/da8/dad/dae 0 2024-09-17T01:52:15.319 INFO:tasks.workunit.client.0.smithi031.stdout:7/906: dread db/fe [0,4194304] 0 2024-09-17T01:52:15.320 INFO:tasks.workunit.client.1.smithi092.stdout:6/573: mknod d3/d10/d8c/d49/d7e/cb0 0 2024-09-17T01:52:15.321 INFO:tasks.workunit.client.1.smithi092.stdout:6/574: chown d3/d10/d1f/d21/da5/l76 83 1 2024-09-17T01:52:15.322 INFO:tasks.workunit.client.1.smithi092.stdout:6/575: write d3/d10/d8c/d43/d5e/d73/f7a [1361897,110401] 0 2024-09-17T01:52:15.324 INFO:tasks.workunit.client.1.smithi092.stdout:6/576: creat d3/d25/da8/fb1 x:0 0 0 2024-09-17T01:52:15.325 INFO:tasks.workunit.client.1.smithi092.stdout:6/577: readlink d3/d10/d1f/d21/l58 0 2024-09-17T01:52:15.334 INFO:tasks.workunit.client.1.smithi092.stdout:6/578: dwrite d3/d25/f9c [4194304,4194304] 0 2024-09-17T01:52:15.336 INFO:tasks.workunit.client.1.smithi092.stdout:6/579: rmdir d3/d10/d8c/d49 39 2024-09-17T01:52:15.337 INFO:tasks.workunit.client.0.smithi031.stdout:7/907: dread db/f15 [0,4194304] 0 2024-09-17T01:52:15.338 INFO:tasks.workunit.client.1.smithi092.stdout:5/536: sync 2024-09-17T01:52:15.341 INFO:tasks.workunit.client.1.smithi092.stdout:7/647: dread d3/db/f4a [0,4194304] 0 2024-09-17T01:52:15.342 INFO:tasks.workunit.client.1.smithi092.stdout:6/580: dread d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:15.343 INFO:tasks.workunit.client.0.smithi031.stdout:7/908: dwrite db/d1c/f5c [0,4194304] 0 2024-09-17T01:52:15.343 INFO:tasks.workunit.client.1.smithi092.stdout:5/537: rename d0/de/d19/d1a/d1e/d29/d9f to d0/de/d19/d1a/d1e/d52/d9a/db0 0 2024-09-17T01:52:15.344 INFO:tasks.workunit.client.1.smithi092.stdout:6/581: chown d3/d10/d1f/d21/da5/d18/l71 1290623651 1 2024-09-17T01:52:15.344 INFO:tasks.workunit.client.1.smithi092.stdout:6/582: fdatasync d3/f9f 0 2024-09-17T01:52:15.344 INFO:tasks.workunit.client.0.smithi031.stdout:7/909: truncate db/d29/fe9 368882 0 2024-09-17T01:52:15.345 INFO:tasks.workunit.client.1.smithi092.stdout:5/538: write d0/de/d19/d1a/d1e/d74/f83 [4497613,89206] 0 2024-09-17T01:52:15.345 INFO:tasks.workunit.client.1.smithi092.stdout:7/648: mkdir d3/d6/dc2/ddc 0 2024-09-17T01:52:15.346 INFO:tasks.workunit.client.1.smithi092.stdout:7/649: fsync d3/db/d7b/f81 0 2024-09-17T01:52:15.352 INFO:tasks.workunit.client.1.smithi092.stdout:6/583: creat d3/d8e/fb2 x:0 0 0 2024-09-17T01:52:15.353 INFO:tasks.workunit.client.1.smithi092.stdout:6/584: chown d3/d10/d1f/d21/f81 306938 1 2024-09-17T01:52:15.358 INFO:tasks.workunit.client.1.smithi092.stdout:6/585: dwrite d3/f9f [0,4194304] 0 2024-09-17T01:52:15.358 INFO:tasks.workunit.client.1.smithi092.stdout:6/586: chown d3/d10/d8c/d43 2491301 1 2024-09-17T01:52:15.360 INFO:tasks.workunit.client.1.smithi092.stdout:5/539: write d0/de/d19/d1a/f22 [3879553,122442] 0 2024-09-17T01:52:15.361 INFO:tasks.workunit.client.1.smithi092.stdout:6/587: rmdir d3/d10/d1f/d21/d28 39 2024-09-17T01:52:15.362 INFO:tasks.workunit.client.1.smithi092.stdout:5/540: creat d0/d7e/d90/fb1 x:0 0 0 2024-09-17T01:52:15.364 INFO:tasks.workunit.client.1.smithi092.stdout:6/588: unlink d3/d10/d8c/d43/d6a/d3d/f4f 0 2024-09-17T01:52:15.365 INFO:tasks.workunit.client.1.smithi092.stdout:6/589: write d3/d10/d1f/f32 [2147915,63029] 0 2024-09-17T01:52:15.366 INFO:tasks.workunit.client.0.smithi031.stdout:7/910: dwrite db/d1c/d41/d9a/fb3 [0,4194304] 0 2024-09-17T01:52:15.369 INFO:tasks.workunit.client.0.smithi031.stdout:7/911: symlink db/d1c/d41/d6c/da0/dd4/l126 0 2024-09-17T01:52:15.369 INFO:tasks.workunit.client.1.smithi092.stdout:7/650: dread d3/db/d26/f6d [0,4194304] 0 2024-09-17T01:52:15.373 INFO:tasks.workunit.client.0.smithi031.stdout:7/912: mknod db/d1c/d41/d69/dd6/c127 0 2024-09-17T01:52:15.373 INFO:tasks.workunit.client.1.smithi092.stdout:5/541: dwrite d0/de/d19/d1a/d1e/d3e/d4c/f5d [0,4194304] 0 2024-09-17T01:52:15.373 INFO:tasks.workunit.client.1.smithi092.stdout:6/590: creat d3/d10/d8c/d49/fb3 x:0 0 0 2024-09-17T01:52:15.375 INFO:tasks.workunit.client.1.smithi092.stdout:6/591: creat d3/d8e/fb4 x:0 0 0 2024-09-17T01:52:15.377 INFO:tasks.workunit.client.1.smithi092.stdout:6/592: write d3/f6 [3620772,72087] 0 2024-09-17T01:52:15.377 INFO:tasks.workunit.client.1.smithi092.stdout:7/651: dwrite d3/fc [0,4194304] 0 2024-09-17T01:52:15.378 INFO:tasks.workunit.client.1.smithi092.stdout:5/542: creat d0/de/d19/d3c/d41/d8d/fb2 x:0 0 0 2024-09-17T01:52:15.383 INFO:tasks.workunit.client.1.smithi092.stdout:5/543: chown d0/l16 225291 1 2024-09-17T01:52:15.384 INFO:tasks.workunit.client.1.smithi092.stdout:7/652: mknod d3/d6/dc2/cdd 0 2024-09-17T01:52:15.403 INFO:tasks.workunit.client.1.smithi092.stdout:5/544: rename d0/de/d19/d1a/d1e/d29/f66 to d0/d50/fb3 0 2024-09-17T01:52:15.405 INFO:tasks.workunit.client.1.smithi092.stdout:7/653: symlink d3/db/d26/d65/lde 0 2024-09-17T01:52:15.406 INFO:tasks.workunit.client.0.smithi031.stdout:7/913: dread db/d1c/d41/d9a/f9c [0,4194304] 0 2024-09-17T01:52:15.408 INFO:tasks.workunit.client.1.smithi092.stdout:7/654: mkdir d3/d2b/d84/ddf 0 2024-09-17T01:52:15.409 INFO:tasks.workunit.client.1.smithi092.stdout:5/545: getdents d0/d50/d70 0 2024-09-17T01:52:15.409 INFO:tasks.workunit.client.1.smithi092.stdout:7/655: chown d3/db/d26/d65/f9d 3689866 1 2024-09-17T01:52:15.411 INFO:tasks.workunit.client.1.smithi092.stdout:7/656: rmdir d3/db/d98/dce/d61 39 2024-09-17T01:52:15.412 INFO:tasks.workunit.client.1.smithi092.stdout:5/546: symlink d0/de/d19/d1a/d1e/d52/d9a/db0/lb4 0 2024-09-17T01:52:15.412 INFO:tasks.workunit.client.1.smithi092.stdout:7/657: write d3/db/d98/fa9 [274713,115865] 0 2024-09-17T01:52:15.412 INFO:tasks.workunit.client.0.smithi031.stdout:0/884: sync 2024-09-17T01:52:15.413 INFO:tasks.workunit.client.0.smithi031.stdout:9/769: sync 2024-09-17T01:52:15.413 INFO:tasks.workunit.client.0.smithi031.stdout:0/885: chown d0/d29/da7/db3/l83 89 1 2024-09-17T01:52:15.415 INFO:tasks.workunit.client.0.smithi031.stdout:9/770: mkdir d3/d19/d80/db9/df6 0 2024-09-17T01:52:15.416 INFO:tasks.workunit.client.1.smithi092.stdout:5/547: getdents d0/de/d19/d3c/d41 0 2024-09-17T01:52:15.419 INFO:tasks.workunit.client.1.smithi092.stdout:7/658: dwrite d3/db/d26/f72 [0,4194304] 0 2024-09-17T01:52:15.419 INFO:tasks.workunit.client.0.smithi031.stdout:9/771: truncate d3/d19/d80/ff3 1344528 0 2024-09-17T01:52:15.420 INFO:tasks.workunit.client.0.smithi031.stdout:0/886: dwrite d0/d29/d33/d5/f3b [4194304,4194304] 0 2024-09-17T01:52:15.420 INFO:tasks.workunit.client.1.smithi092.stdout:5/548: mknod d0/d77/cb5 0 2024-09-17T01:52:15.420 INFO:tasks.workunit.client.1.smithi092.stdout:7/659: read - d3/d6/d13/d21/d2e/d6e/f99 zero size 2024-09-17T01:52:15.423 INFO:tasks.workunit.client.1.smithi092.stdout:5/549: creat d0/d7e/fb6 x:0 0 0 2024-09-17T01:52:15.423 INFO:tasks.workunit.client.0.smithi031.stdout:0/887: mknod d0/d37/db9/dcf/c134 0 2024-09-17T01:52:15.424 INFO:tasks.workunit.client.1.smithi092.stdout:7/660: rename d3/db/d98/dce/d6a/dc8 to d3/db/d98/dce/d6a/dc8/de0 22 2024-09-17T01:52:15.428 INFO:tasks.workunit.client.1.smithi092.stdout:5/550: fsync d0/de/d19/d3c/d41/f6e 0 2024-09-17T01:52:15.431 INFO:tasks.workunit.client.1.smithi092.stdout:7/661: symlink d3/d6/d13/d21/le1 0 2024-09-17T01:52:15.434 INFO:tasks.workunit.client.1.smithi092.stdout:5/551: dread d0/de/d19/d1a/f7b [0,4194304] 0 2024-09-17T01:52:15.438 INFO:tasks.workunit.client.1.smithi092.stdout:7/662: dwrite d3/fc [0,4194304] 0 2024-09-17T01:52:15.440 INFO:tasks.workunit.client.1.smithi092.stdout:5/552: dread d0/de/d19/d1a/d1e/f75 [0,4194304] 0 2024-09-17T01:52:15.443 INFO:tasks.workunit.client.1.smithi092.stdout:7/663: rename d3/db/f54 to d3/db/d98/dce/fe2 0 2024-09-17T01:52:15.450 INFO:tasks.workunit.client.1.smithi092.stdout:7/664: dwrite d3/d6/d13/d21/d2e/f59 [0,4194304] 0 2024-09-17T01:52:15.455 INFO:tasks.workunit.client.0.smithi031.stdout:0/888: write d0/d29/da7/f11f [1225228,3211] 0 2024-09-17T01:52:15.458 INFO:tasks.workunit.client.1.smithi092.stdout:7/665: dwrite d3/d6/d13/d21/d2e/f59 [0,4194304] 0 2024-09-17T01:52:15.459 INFO:tasks.workunit.client.0.smithi031.stdout:9/772: write d3/d19/d1f/d44/d64/f97 [927965,9101] 0 2024-09-17T01:52:15.463 INFO:tasks.workunit.client.0.smithi031.stdout:0/889: link d0/d29/d33/d5/d48/d56/f108 d0/d29/d33/d5/d48/d56/f135 0 2024-09-17T01:52:15.466 INFO:tasks.workunit.client.0.smithi031.stdout:9/773: dread d3/d19/d1f/f6b [0,4194304] 0 2024-09-17T01:52:15.466 INFO:tasks.workunit.client.0.smithi031.stdout:0/890: read d0/d37/f87 [34479,18591] 0 2024-09-17T01:52:15.467 INFO:tasks.workunit.client.0.smithi031.stdout:0/891: stat d0/d29/da7/db3/f8e 0 2024-09-17T01:52:15.468 INFO:tasks.workunit.client.0.smithi031.stdout:0/892: chown d0/d29/d33/d2a/dde/lda 182 1 2024-09-17T01:52:15.470 INFO:tasks.workunit.client.0.smithi031.stdout:8/743: sync 2024-09-17T01:52:15.470 INFO:tasks.workunit.client.0.smithi031.stdout:2/880: sync 2024-09-17T01:52:15.470 INFO:tasks.workunit.client.0.smithi031.stdout:1/788: sync 2024-09-17T01:52:15.472 INFO:tasks.workunit.client.0.smithi031.stdout:0/893: symlink d0/d29/d33/d2a/d25/d38/l136 0 2024-09-17T01:52:15.472 INFO:tasks.workunit.client.0.smithi031.stdout:8/744: stat d0/df/dd/d77/dc3/fd7 0 2024-09-17T01:52:15.473 INFO:tasks.workunit.client.0.smithi031.stdout:1/789: readlink d4/d1e/d3f/d72/d7e/da2/la3 0 2024-09-17T01:52:15.474 INFO:tasks.workunit.client.0.smithi031.stdout:2/881: creat d1/d7c/f12a x:0 0 0 2024-09-17T01:52:15.474 INFO:tasks.workunit.client.1.smithi092.stdout:7/666: write d3/d6/d13/d21/d2e/d6e/f53 [653468,67918] 0 2024-09-17T01:52:15.475 INFO:tasks.workunit.client.0.smithi031.stdout:8/745: symlink d0/d5/d6c/d6d/ldc 0 2024-09-17T01:52:15.475 INFO:tasks.workunit.client.1.smithi092.stdout:7/667: chown d3/db/db2 77009526 1 2024-09-17T01:52:15.477 INFO:tasks.workunit.client.0.smithi031.stdout:8/746: read d0/d5/d6c/d6d/f8f [73719,37303] 0 2024-09-17T01:52:15.478 INFO:tasks.workunit.client.1.smithi092.stdout:5/553: dwrite d0/de/d19/d3c/d41/f43 [0,4194304] 0 2024-09-17T01:52:15.479 INFO:tasks.workunit.client.0.smithi031.stdout:1/790: unlink d4/d1e/d3f/d4d/dcd/l87 0 2024-09-17T01:52:15.480 INFO:tasks.workunit.client.1.smithi092.stdout:7/668: getdents d3/d6/d13 0 2024-09-17T01:52:15.482 INFO:tasks.workunit.client.1.smithi092.stdout:7/669: dread d3/d6/d13/d21/d2e/d6e/f20 [4194304,4194304] 0 2024-09-17T01:52:15.483 INFO:tasks.workunit.client.0.smithi031.stdout:2/882: dwrite d1/d3/df/d11/d30/ddd/de3/f128 [0,4194304] 0 2024-09-17T01:52:15.483 INFO:tasks.workunit.client.1.smithi092.stdout:5/554: creat d0/fb7 x:0 0 0 2024-09-17T01:52:15.483 INFO:tasks.workunit.client.0.smithi031.stdout:1/791: chown d4/l5 5 1 2024-09-17T01:52:15.484 INFO:tasks.workunit.client.0.smithi031.stdout:2/883: chown d1/d3/d2d/d91 1725270 1 2024-09-17T01:52:15.484 INFO:tasks.workunit.client.1.smithi092.stdout:7/670: rmdir d3/db/d98/dce/d61 39 2024-09-17T01:52:15.485 INFO:tasks.workunit.client.0.smithi031.stdout:8/747: creat d0/d5/fdd x:0 0 0 2024-09-17T01:52:15.485 INFO:tasks.workunit.client.1.smithi092.stdout:5/555: truncate d0/de/d19/d1a/d1e/d3e/f59 278795 0 2024-09-17T01:52:15.486 INFO:tasks.workunit.client.0.smithi031.stdout:1/792: creat d4/d1a/d43/f109 x:0 0 0 2024-09-17T01:52:15.489 INFO:tasks.workunit.client.0.smithi031.stdout:2/884: chown d1/d3/d2d/db2/d1e/d2a/d7f 2 1 2024-09-17T01:52:15.490 INFO:tasks.workunit.client.0.smithi031.stdout:1/793: creat d4/d3d/de4/f10a x:0 0 0 2024-09-17T01:52:15.491 INFO:tasks.workunit.client.0.smithi031.stdout:1/794: dread - d4/d1a/d2d/f104 zero size 2024-09-17T01:52:15.497 INFO:tasks.workunit.client.0.smithi031.stdout:8/748: getdents d0 0 2024-09-17T01:52:15.498 INFO:tasks.workunit.client.0.smithi031.stdout:9/774: dread d3/f2a [0,4194304] 0 2024-09-17T01:52:15.498 INFO:tasks.workunit.client.0.smithi031.stdout:8/749: chown d0/d5/fdd 1 1 2024-09-17T01:52:15.499 INFO:tasks.workunit.client.0.smithi031.stdout:1/795: creat d4/d1a/d43/d53/dd3/dee/d107/f10b x:0 0 0 2024-09-17T01:52:15.501 INFO:tasks.workunit.client.0.smithi031.stdout:8/750: symlink d0/df/dd/d9c/lde 0 2024-09-17T01:52:15.501 INFO:tasks.workunit.client.0.smithi031.stdout:9/775: mkdir d3/df7 0 2024-09-17T01:52:15.502 INFO:tasks.workunit.client.0.smithi031.stdout:9/776: stat d3/d4/d29/fa8 0 2024-09-17T01:52:15.503 INFO:tasks.workunit.client.0.smithi031.stdout:9/777: dread - d3/fe9 zero size 2024-09-17T01:52:15.505 INFO:tasks.workunit.client.0.smithi031.stdout:9/778: creat d3/d4/ff8 x:0 0 0 2024-09-17T01:52:15.506 INFO:tasks.workunit.client.0.smithi031.stdout:9/779: fsync d3/d4/da0/d36/d62/db2/fd9 0 2024-09-17T01:52:15.508 INFO:tasks.workunit.client.0.smithi031.stdout:9/780: mkdir d3/d4/da0/d36/d62/db2/df9 0 2024-09-17T01:52:15.511 INFO:tasks.workunit.client.1.smithi092.stdout:5/556: dread d0/de/f8e [0,4194304] 0 2024-09-17T01:52:15.512 INFO:tasks.workunit.client.0.smithi031.stdout:8/751: read d0/df/dd/d59/fb8 [5652064,33189] 0 2024-09-17T01:52:15.513 INFO:tasks.workunit.client.1.smithi092.stdout:5/557: rmdir d0/d50/d70/d78/d8f 39 2024-09-17T01:52:15.513 INFO:tasks.workunit.client.0.smithi031.stdout:2/885: write d1/d3/d2d/db2/d1e/f39 [4238079,51578] 0 2024-09-17T01:52:15.514 INFO:tasks.workunit.client.1.smithi092.stdout:7/671: dread d3/d6/f1c [0,4194304] 0 2024-09-17T01:52:15.515 INFO:tasks.workunit.client.0.smithi031.stdout:8/752: chown d0/d5/d9b/l69 5 1 2024-09-17T01:52:15.515 INFO:tasks.workunit.client.1.smithi092.stdout:7/672: stat d3/d6/f9c 0 2024-09-17T01:52:15.516 INFO:tasks.workunit.client.0.smithi031.stdout:2/886: read - d1/d3/df/f5a zero size 2024-09-17T01:52:15.517 INFO:tasks.workunit.client.1.smithi092.stdout:5/558: rename d0/de/d19/d1a/d1e/f12 to d0/de/d19/d1a/d1e/d52/d9a/db0/fb8 0 2024-09-17T01:52:15.518 INFO:tasks.workunit.client.1.smithi092.stdout:7/673: chown d3/db/d98/dce/f55 0 1 2024-09-17T01:52:15.518 INFO:tasks.workunit.client.0.smithi031.stdout:9/781: dwrite d3/d19/d1f/d44/d64/fe2 [0,4194304] 0 2024-09-17T01:52:15.519 INFO:tasks.workunit.client.1.smithi092.stdout:7/674: chown d3/db/d98/dce/daf/lc0 69899938 1 2024-09-17T01:52:15.519 INFO:tasks.workunit.client.1.smithi092.stdout:7/675: dread - d3/fbe zero size 2024-09-17T01:52:15.520 INFO:tasks.workunit.client.0.smithi031.stdout:9/782: dread - d3/d19/db5/fd6 zero size 2024-09-17T01:52:15.521 INFO:tasks.workunit.client.1.smithi092.stdout:5/559: rename d0/de/d19/d1a/d1e/d29/fa8 to d0/d50/da5/fb9 0 2024-09-17T01:52:15.523 INFO:tasks.workunit.client.1.smithi092.stdout:5/560: mknod d0/de/d19/d1a/d24/cba 0 2024-09-17T01:52:15.523 INFO:tasks.workunit.client.1.smithi092.stdout:5/561: fsync d0/de/d19/d1a/d1e/f71 0 2024-09-17T01:52:15.524 INFO:tasks.workunit.client.0.smithi031.stdout:1/796: dwrite d4/d1e/d40/d84/fdc [0,4194304] 0 2024-09-17T01:52:15.526 INFO:tasks.workunit.client.0.smithi031.stdout:8/753: dwrite d0/df/dd/d59/fb8 [0,4194304] 0 2024-09-17T01:52:15.527 INFO:tasks.workunit.client.1.smithi092.stdout:5/562: symlink d0/de/d19/d1a/d1e/d52/d9a/db0/lbb 0 2024-09-17T01:52:15.528 INFO:tasks.workunit.client.0.smithi031.stdout:8/754: fdatasync d0/d5/d6c/d6d/f72 0 2024-09-17T01:52:15.529 INFO:tasks.workunit.client.1.smithi092.stdout:5/563: creat d0/fbc x:0 0 0 2024-09-17T01:52:15.529 INFO:tasks.workunit.client.0.smithi031.stdout:1/797: mkdir d4/d1a/d43/d10c 0 2024-09-17T01:52:15.531 INFO:tasks.workunit.client.1.smithi092.stdout:5/564: write d0/de/d19/d1a/d1e/d3e/f63 [750025,102075] 0 2024-09-17T01:52:15.532 INFO:tasks.workunit.client.0.smithi031.stdout:8/755: read d0/df/dd/d77/f92 [1508567,7084] 0 2024-09-17T01:52:15.533 INFO:tasks.workunit.client.1.smithi092.stdout:5/565: truncate d0/de/d19/f8c 368707 0 2024-09-17T01:52:15.533 INFO:tasks.workunit.client.0.smithi031.stdout:9/783: link d3/d19/d1f/f23 d3/d47/ffa 0 2024-09-17T01:52:15.535 INFO:tasks.workunit.client.0.smithi031.stdout:9/784: write d3/d4/da0/d71/f9e [2424658,55266] 0 2024-09-17T01:52:15.537 INFO:tasks.workunit.client.0.smithi031.stdout:9/785: fdatasync d3/d19/d1f/fec 0 2024-09-17T01:52:15.540 INFO:tasks.workunit.client.0.smithi031.stdout:8/756: dwrite d0/d5/fab [0,4194304] 0 2024-09-17T01:52:15.541 INFO:tasks.workunit.client.1.smithi092.stdout:7/676: dread d3/d6/d13/d21/d2e/d6e/fc4 [0,4194304] 0 2024-09-17T01:52:15.542 INFO:tasks.workunit.client.1.smithi092.stdout:1/795: sync 2024-09-17T01:52:15.542 INFO:tasks.workunit.client.1.smithi092.stdout:5/566: dwrite d0/d50/d70/f81 [0,4194304] 0 2024-09-17T01:52:15.543 INFO:tasks.workunit.client.1.smithi092.stdout:3/656: sync 2024-09-17T01:52:15.544 INFO:tasks.workunit.client.1.smithi092.stdout:7/677: write d3/db/db2/fbf [630692,912] 0 2024-09-17T01:52:15.544 INFO:tasks.workunit.client.1.smithi092.stdout:1/796: dread - db/d1d/d4b/d9a/fe7 zero size 2024-09-17T01:52:15.545 INFO:tasks.workunit.client.0.smithi031.stdout:9/786: dwrite d3/d19/d80/ff3 [0,4194304] 0 2024-09-17T01:52:15.546 INFO:tasks.workunit.client.1.smithi092.stdout:1/797: stat db/d6c/d7e/d82/fae 0 2024-09-17T01:52:15.546 INFO:tasks.workunit.client.1.smithi092.stdout:3/657: symlink d4/d13/d2e/d6f/ldb 0 2024-09-17T01:52:15.550 INFO:tasks.workunit.client.0.smithi031.stdout:9/787: read d3/d19/d1f/f58 [1569314,103684] 0 2024-09-17T01:52:15.554 INFO:tasks.workunit.client.1.smithi092.stdout:5/567: truncate d0/de/d19/d1a/d1e/f1d 505552 0 2024-09-17T01:52:15.556 INFO:tasks.workunit.client.1.smithi092.stdout:7/678: dwrite d3/db/d98/fa9 [0,4194304] 0 2024-09-17T01:52:15.558 INFO:tasks.workunit.client.1.smithi092.stdout:7/679: write d3/fc [2750611,37104] 0 2024-09-17T01:52:15.558 INFO:tasks.workunit.client.1.smithi092.stdout:3/658: link d4/d20/f7c d4/d20/d9f/dd5/fdc 0 2024-09-17T01:52:15.558 INFO:tasks.workunit.client.1.smithi092.stdout:1/798: creat db/d1d/ff6 x:0 0 0 2024-09-17T01:52:15.560 INFO:tasks.workunit.client.1.smithi092.stdout:5/568: mkdir d0/de/d19/d1a/d1e/d52/dbd 0 2024-09-17T01:52:15.561 INFO:tasks.workunit.client.1.smithi092.stdout:7/680: chown d3/db/f5e 4966556 1 2024-09-17T01:52:15.561 INFO:tasks.workunit.client.0.smithi031.stdout:2/887: dread d1/f8f [0,4194304] 0 2024-09-17T01:52:15.563 INFO:tasks.workunit.client.1.smithi092.stdout:5/569: readlink d0/de/d19/d1a/d1e/d3e/d4c/l54 0 2024-09-17T01:52:15.563 INFO:tasks.workunit.client.1.smithi092.stdout:7/681: truncate d3/db/d26/f72 5019740 0 2024-09-17T01:52:15.564 INFO:tasks.workunit.client.1.smithi092.stdout:1/799: rename db/d6c/d7e/d82/cdb to db/d6c/db3/dea/deb/cf7 0 2024-09-17T01:52:15.564 INFO:tasks.workunit.client.0.smithi031.stdout:2/888: creat d1/d3/d2d/db2/d1e/d21/d34/f12b x:0 0 0 2024-09-17T01:52:15.565 INFO:tasks.workunit.client.1.smithi092.stdout:3/659: mknod d4/d2f/d44/d54/dda/cdd 0 2024-09-17T01:52:15.565 INFO:tasks.workunit.client.1.smithi092.stdout:3/660: dread - d4/d73/d8f/d9e/fbb zero size 2024-09-17T01:52:15.566 INFO:tasks.workunit.client.1.smithi092.stdout:3/661: chown d4/d13/d2e/d6f 0 1 2024-09-17T01:52:15.567 INFO:tasks.workunit.client.1.smithi092.stdout:3/662: chown d4/d73/d8f/d9e/fbb 62982931 1 2024-09-17T01:52:15.568 INFO:tasks.workunit.client.1.smithi092.stdout:3/663: chown d4/d20/d39/f7d 4623 1 2024-09-17T01:52:15.569 INFO:tasks.workunit.client.0.smithi031.stdout:2/889: rename d1/d3/df/d18/d40/d43 to d1/d3/d2d/db2/d1e/d21/d34/d8a/d12c 0 2024-09-17T01:52:15.569 INFO:tasks.workunit.client.1.smithi092.stdout:3/664: write d4/d13/d2e/fc1 [1013192,110223] 0 2024-09-17T01:52:15.570 INFO:tasks.workunit.client.0.smithi031.stdout:2/890: write d1/d3/d45/d4a/fc0 [1152270,30395] 0 2024-09-17T01:52:15.571 INFO:tasks.workunit.client.1.smithi092.stdout:7/682: fsync d3/d2b/d37/f8b 0 2024-09-17T01:52:15.572 INFO:tasks.workunit.client.1.smithi092.stdout:1/800: mknod db/d1d/d2e/d62/cf8 0 2024-09-17T01:52:15.572 INFO:tasks.workunit.client.0.smithi031.stdout:7/914: sync 2024-09-17T01:52:15.572 INFO:tasks.workunit.client.0.smithi031.stdout:3/858: sync 2024-09-17T01:52:15.572 INFO:tasks.workunit.client.0.smithi031.stdout:5/844: sync 2024-09-17T01:52:15.573 INFO:tasks.workunit.client.0.smithi031.stdout:2/891: readlink d1/d3/df/d11/lc9 0 2024-09-17T01:52:15.575 INFO:tasks.workunit.client.1.smithi092.stdout:3/665: truncate d4/d16/f24 4341318 0 2024-09-17T01:52:15.575 INFO:tasks.workunit.client.0.smithi031.stdout:5/845: write da/d14/dac/d82/f8b [2115475,79009] 0 2024-09-17T01:52:15.575 INFO:tasks.workunit.client.0.smithi031.stdout:7/915: chown db/d1c/c3e 57 1 2024-09-17T01:52:15.576 INFO:tasks.workunit.client.0.smithi031.stdout:3/859: mknod db/df/d50/c10e 0 2024-09-17T01:52:15.577 INFO:tasks.workunit.client.1.smithi092.stdout:1/801: link db/d1d/f72 db/d6c/d7e/d82/de8/ff9 0 2024-09-17T01:52:15.578 INFO:tasks.workunit.client.0.smithi031.stdout:2/892: rename d1/d3/df/c52 to d1/d3/df/d18/c12d 0 2024-09-17T01:52:15.579 INFO:tasks.workunit.client.1.smithi092.stdout:7/683: dwrite d3/db/d7b/fbc [0,4194304] 0 2024-09-17T01:52:15.579 INFO:tasks.workunit.client.1.smithi092.stdout:7/684: write d3/d6/d13/f7d [1451864,73449] 0 2024-09-17T01:52:15.581 INFO:tasks.workunit.client.0.smithi031.stdout:3/860: mkdir db/df/dc8/d6a/d83/d10f 0 2024-09-17T01:52:15.581 INFO:tasks.workunit.client.0.smithi031.stdout:5/846: dread f8 [0,4194304] 0 2024-09-17T01:52:15.582 INFO:tasks.workunit.client.1.smithi092.stdout:1/802: mknod db/d1d/d4b/df3/cfa 0 2024-09-17T01:52:15.583 INFO:tasks.workunit.client.0.smithi031.stdout:2/893: fsync d1/d3/df/d18/f61 0 2024-09-17T01:52:15.583 INFO:tasks.workunit.client.1.smithi092.stdout:1/803: read - db/d1d/ff0 zero size 2024-09-17T01:52:15.583 INFO:tasks.workunit.client.1.smithi092.stdout:7/685: creat d3/db/d98/fe3 x:0 0 0 2024-09-17T01:52:15.587 INFO:tasks.workunit.client.0.smithi031.stdout:7/916: dwrite db/d1c/d8e/fb2 [0,4194304] 0 2024-09-17T01:52:15.589 INFO:tasks.workunit.client.0.smithi031.stdout:5/847: creat da/d4b/d6c/df2/f12b x:0 0 0 2024-09-17T01:52:15.590 INFO:tasks.workunit.client.0.smithi031.stdout:2/894: fdatasync d1/d3/df/d11/d30/ddd/ff1 0 2024-09-17T01:52:15.591 INFO:tasks.workunit.client.0.smithi031.stdout:7/917: chown db/d1c/d41/d6c/da0/dd4/d109 17 1 2024-09-17T01:52:15.592 INFO:tasks.workunit.client.0.smithi031.stdout:3/861: truncate db/df/dc8/f102 2209063 0 2024-09-17T01:52:15.593 INFO:tasks.workunit.client.0.smithi031.stdout:1/798: dwrite d4/d1e/d3f/d72/d7e/da2/fb3 [0,4194304] 0 2024-09-17T01:52:15.596 INFO:tasks.workunit.client.0.smithi031.stdout:3/862: mkdir db/d82/d110 0 2024-09-17T01:52:15.596 INFO:tasks.workunit.client.0.smithi031.stdout:7/918: truncate db/d29/f5d 5106932 0 2024-09-17T01:52:15.644 INFO:tasks.workunit.client.1.smithi092.stdout:7/686: write d3/db/d26/f72 [1026948,51915] 0 2024-09-17T01:52:15.644 INFO:tasks.workunit.client.1.smithi092.stdout:5/570: rmdir d0 39 2024-09-17T01:52:15.645 INFO:tasks.workunit.client.0.smithi031.stdout:3/863: write db/df/dc8/d6a/f76 [4123666,32934] 0 2024-09-17T01:52:15.648 INFO:tasks.workunit.client.1.smithi092.stdout:5/571: fsync d0/de/d19/f1f 0 2024-09-17T01:52:15.651 INFO:tasks.workunit.client.1.smithi092.stdout:1/804: dwrite db/d6c/db3/dea/deb/fee [0,4194304] 0 2024-09-17T01:52:15.651 INFO:tasks.workunit.client.1.smithi092.stdout:5/572: chown d0/de/d19/d1a/d1e/d74/f83 66 1 2024-09-17T01:52:15.652 INFO:tasks.workunit.client.0.smithi031.stdout:7/919: write db/d1c/d46/f60 [4480259,46465] 0 2024-09-17T01:52:15.654 INFO:tasks.workunit.client.1.smithi092.stdout:1/805: write db/d1d/d4b/f56 [4399651,99179] 0 2024-09-17T01:52:15.655 INFO:tasks.workunit.client.0.smithi031.stdout:8/757: dwrite d0/d5/d6c/f8b [0,4194304] 0 2024-09-17T01:52:15.656 INFO:tasks.workunit.client.0.smithi031.stdout:7/920: readlink db/d18/l22 0 2024-09-17T01:52:15.657 INFO:tasks.workunit.client.1.smithi092.stdout:7/687: dwrite d3/db/f15 [0,4194304] 0 2024-09-17T01:52:15.659 INFO:tasks.workunit.client.1.smithi092.stdout:5/573: rename d0/d50/d70/d78/d8f/fac to d0/de/d19/d3c/d41/d8d/fbe 0 2024-09-17T01:52:15.659 INFO:tasks.workunit.client.0.smithi031.stdout:8/758: read d0/f42 [8195,129478] 0 2024-09-17T01:52:15.661 INFO:tasks.workunit.client.0.smithi031.stdout:1/799: dwrite d4/d1e/f4b [0,4194304] 0 2024-09-17T01:52:15.661 INFO:tasks.workunit.client.1.smithi092.stdout:7/688: unlink d3/d2b/d3a/c7e 0 2024-09-17T01:52:15.662 INFO:tasks.workunit.client.1.smithi092.stdout:5/574: write d0/de/d19/d3c/d41/d8d/fbe [190849,124773] 0 2024-09-17T01:52:15.663 INFO:tasks.workunit.client.1.smithi092.stdout:7/689: creat d3/db/d7b/fe4 x:0 0 0 2024-09-17T01:52:15.665 INFO:tasks.workunit.client.1.smithi092.stdout:7/690: mknod d3/d6/d13/ce5 0 2024-09-17T01:52:15.666 INFO:tasks.workunit.client.0.smithi031.stdout:3/864: rename db/df/d1d/d37/d4a/f43 to db/df/d1d/d37/d6c/d6e/dd4/dd7/f111 0 2024-09-17T01:52:15.666 INFO:tasks.workunit.client.0.smithi031.stdout:2/895: dread d1/d3/df/d18/f3b [0,4194304] 0 2024-09-17T01:52:15.666 INFO:tasks.workunit.client.0.smithi031.stdout:7/921: symlink db/d1c/d41/d6c/da0/l128 0 2024-09-17T01:52:15.667 INFO:tasks.workunit.client.1.smithi092.stdout:5/575: getdents d0 0 2024-09-17T01:52:15.668 INFO:tasks.workunit.client.1.smithi092.stdout:7/691: mknod d3/d2b/ce6 0 2024-09-17T01:52:15.673 INFO:tasks.workunit.client.1.smithi092.stdout:5/576: read d0/de/d19/d1a/d24/f4b [2954567,97497] 0 2024-09-17T01:52:15.674 INFO:tasks.workunit.client.0.smithi031.stdout:7/922: rename db/d18/f2f to db/d1c/d41/d9a/f129 0 2024-09-17T01:52:15.675 INFO:tasks.workunit.client.0.smithi031.stdout:8/759: symlink d0/d5/d6c/db0/ldf 0 2024-09-17T01:52:15.676 INFO:tasks.workunit.client.0.smithi031.stdout:2/896: write d1/d3/df/d18/f3b [749966,128747] 0 2024-09-17T01:52:15.677 INFO:tasks.workunit.client.0.smithi031.stdout:8/760: chown d0/df/dd/da9/lbc 58 1 2024-09-17T01:52:15.678 INFO:tasks.workunit.client.1.smithi092.stdout:5/577: dwrite d0/de/f8e [0,4194304] 0 2024-09-17T01:52:15.678 INFO:tasks.workunit.client.0.smithi031.stdout:3/865: unlink db/df/d1d/d37/cda 0 2024-09-17T01:52:15.679 INFO:tasks.workunit.client.0.smithi031.stdout:2/897: dread d1/f8f [4194304,4194304] 0 2024-09-17T01:52:15.681 INFO:tasks.workunit.client.0.smithi031.stdout:7/923: write db/d1c/f63 [1625723,129543] 0 2024-09-17T01:52:15.682 INFO:tasks.workunit.client.1.smithi092.stdout:5/578: mknod d0/de/d19/d3c/d41/cbf 0 2024-09-17T01:52:15.682 INFO:tasks.workunit.client.0.smithi031.stdout:3/866: read db/d9b/fe0 [79911,56532] 0 2024-09-17T01:52:15.682 INFO:tasks.workunit.client.0.smithi031.stdout:7/924: fdatasync db/d18/fa4 0 2024-09-17T01:52:15.682 INFO:tasks.workunit.client.1.smithi092.stdout:5/579: fdatasync d0/d23/f4d 0 2024-09-17T01:52:15.683 INFO:tasks.workunit.client.1.smithi092.stdout:5/580: readlink d0/de/d19/d3c/d41/d8d/la6 0 2024-09-17T01:52:15.684 INFO:tasks.workunit.client.0.smithi031.stdout:8/761: rename d0/d5/fa to d0/d5/d54/d60/dbb/dc0/fe0 0 2024-09-17T01:52:15.684 INFO:tasks.workunit.client.1.smithi092.stdout:5/581: rmdir d0/de/d19/d1a 39 2024-09-17T01:52:15.686 INFO:tasks.workunit.client.1.smithi092.stdout:5/582: write d0/d7e/d90/fb1 [905546,48955] 0 2024-09-17T01:52:15.687 INFO:tasks.workunit.client.0.smithi031.stdout:2/898: mkdir d1/d12e 0 2024-09-17T01:52:15.688 INFO:tasks.workunit.client.1.smithi092.stdout:5/583: creat d0/de/d19/d3c/d41/fc0 x:0 0 0 2024-09-17T01:52:15.688 INFO:tasks.workunit.client.1.smithi092.stdout:5/584: stat d0/d77 0 2024-09-17T01:52:15.689 INFO:tasks.workunit.client.0.smithi031.stdout:2/899: write d1/d3/df/d11/f2f [3693996,8553] 0 2024-09-17T01:52:15.689 INFO:tasks.workunit.client.0.smithi031.stdout:7/925: mknod db/d1c/d8e/da7/c12a 0 2024-09-17T01:52:15.690 INFO:tasks.workunit.client.0.smithi031.stdout:2/900: readlink d1/d3/d2d/db2/d1e/d21/l35 0 2024-09-17T01:52:15.691 INFO:tasks.workunit.client.1.smithi092.stdout:5/585: mkdir d0/de/d19/d1a/d1e/d52/d9a/db0/dc1 0 2024-09-17T01:52:15.692 INFO:tasks.workunit.client.0.smithi031.stdout:3/867: creat db/df/dc8/d6a/ddd/f112 x:0 0 0 2024-09-17T01:52:15.693 INFO:tasks.workunit.client.1.smithi092.stdout:1/806: dread db/d1d/d23/f45 [0,4194304] 0 2024-09-17T01:52:15.693 INFO:tasks.workunit.client.1.smithi092.stdout:5/586: fsync d0/d50/f5b 0 2024-09-17T01:52:15.694 INFO:tasks.workunit.client.0.smithi031.stdout:8/762: link d0/d5/fcb d0/d5/d6c/fe1 0 2024-09-17T01:52:15.698 INFO:tasks.workunit.client.0.smithi031.stdout:8/763: unlink d0/f42 0 2024-09-17T01:52:15.699 INFO:tasks.workunit.client.0.smithi031.stdout:2/901: symlink d1/d3/d2d/db2/d1e/d4f/l12f 0 2024-09-17T01:52:15.699 INFO:tasks.workunit.client.1.smithi092.stdout:5/587: dwrite d0/d7e/fb6 [0,4194304] 0 2024-09-17T01:52:15.700 INFO:tasks.workunit.client.0.smithi031.stdout:3/868: mkdir db/d82/df4/d113 0 2024-09-17T01:52:15.701 INFO:tasks.workunit.client.0.smithi031.stdout:2/902: dread - d1/d3/d2d/db2/d1e/d21/d34/d8a/d12c/f11d zero size 2024-09-17T01:52:15.703 INFO:tasks.workunit.client.0.smithi031.stdout:3/869: creat db/df/dc8/d6a/d83/d10f/f114 x:0 0 0 2024-09-17T01:52:15.706 INFO:tasks.workunit.client.0.smithi031.stdout:3/870: write db/df/d1d/d37/d6c/d96/f100 [273598,127377] 0 2024-09-17T01:52:15.708 INFO:tasks.workunit.client.0.smithi031.stdout:2/903: link d1/d3/d2d/db2/d1e/d2a/fbe d1/d3/f130 0 2024-09-17T01:52:15.712 INFO:tasks.workunit.client.0.smithi031.stdout:2/904: read d1/d3/df/d11/d30/f7a [19877,88788] 0 2024-09-17T01:52:15.714 INFO:tasks.workunit.client.0.smithi031.stdout:3/871: dwrite db/f103 [0,4194304] 0 2024-09-17T01:52:15.714 INFO:tasks.workunit.client.0.smithi031.stdout:0/894: sync 2024-09-17T01:52:15.716 INFO:tasks.workunit.client.0.smithi031.stdout:1/800: write d4/d1a/d43/fe3 [683256,4203] 0 2024-09-17T01:52:15.716 INFO:tasks.workunit.client.0.smithi031.stdout:0/895: fsync d0/d29/d33/d2a/f7f 0 2024-09-17T01:52:15.717 INFO:tasks.workunit.client.0.smithi031.stdout:3/872: creat db/df/dc8/d6a/ddd/f115 x:0 0 0 2024-09-17T01:52:15.717 INFO:tasks.workunit.client.1.smithi092.stdout:7/692: mkdir d3/d6/d13/de7 0 2024-09-17T01:52:15.721 INFO:tasks.workunit.client.0.smithi031.stdout:3/873: mkdir db/df/d50/d116 0 2024-09-17T01:52:15.723 INFO:tasks.workunit.client.0.smithi031.stdout:0/896: unlink d0/d29/d33/fdc 0 2024-09-17T01:52:15.723 INFO:tasks.workunit.client.1.smithi092.stdout:8/565: sync 2024-09-17T01:52:15.723 INFO:tasks.workunit.client.1.smithi092.stdout:4/806: sync 2024-09-17T01:52:15.723 INFO:tasks.workunit.client.1.smithi092.stdout:0/689: sync 2024-09-17T01:52:15.723 INFO:tasks.workunit.client.1.smithi092.stdout:9/667: sync 2024-09-17T01:52:15.723 INFO:tasks.workunit.client.1.smithi092.stdout:2/635: sync 2024-09-17T01:52:15.724 INFO:tasks.workunit.client.0.smithi031.stdout:0/897: dread - d0/d29/da7/db3/d4a/f110 zero size 2024-09-17T01:52:15.725 INFO:tasks.workunit.client.0.smithi031.stdout:0/898: readlink d0/d29/l36 0 2024-09-17T01:52:15.727 INFO:tasks.workunit.client.0.smithi031.stdout:0/899: write d0/d29/d33/d5b/f11a [1009657,30559] 0 2024-09-17T01:52:15.727 INFO:tasks.workunit.client.0.smithi031.stdout:3/874: read db/da3/f107 [1036650,65105] 0 2024-09-17T01:52:15.730 INFO:tasks.workunit.client.1.smithi092.stdout:0/690: creat d3/d2e/d3b/d40/d7d/fd9 x:0 0 0 2024-09-17T01:52:15.731 INFO:tasks.workunit.client.1.smithi092.stdout:1/807: write db/d6c/d7e/d82/de8/ff9 [649154,41735] 0 2024-09-17T01:52:15.731 INFO:tasks.workunit.client.0.smithi031.stdout:3/875: creat db/df/d1d/df2/f117 x:0 0 0 2024-09-17T01:52:15.733 INFO:tasks.workunit.client.1.smithi092.stdout:9/668: rename d0/d7/l62 to d0/d7/d12/lc9 0 2024-09-17T01:52:15.733 INFO:tasks.workunit.client.0.smithi031.stdout:2/905: dread d1/d3/df/d18/d40/dc1/ffd [0,4194304] 0 2024-09-17T01:52:15.735 INFO:tasks.workunit.client.1.smithi092.stdout:4/807: creat d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/f106 x:0 0 0 2024-09-17T01:52:15.736 INFO:tasks.workunit.client.1.smithi092.stdout:7/693: dwrite d3/d6/f64 [0,4194304] 0 2024-09-17T01:52:15.736 INFO:tasks.workunit.client.0.smithi031.stdout:3/876: dread db/df/f39 [0,4194304] 0 2024-09-17T01:52:15.737 INFO:tasks.workunit.client.1.smithi092.stdout:8/566: symlink d15/d32/d40/lb9 0 2024-09-17T01:52:15.738 INFO:tasks.workunit.client.1.smithi092.stdout:0/691: creat d3/d2e/d3b/d40/d7d/fda x:0 0 0 2024-09-17T01:52:15.738 INFO:tasks.workunit.client.0.smithi031.stdout:0/900: link d0/d37/db9/dcf/cc6 d0/d29/d33/d5/d48/d56/c137 0 2024-09-17T01:52:15.739 INFO:tasks.workunit.client.1.smithi092.stdout:8/567: readlink d15/d32/d40/d42/l53 0 2024-09-17T01:52:15.740 INFO:tasks.workunit.client.0.smithi031.stdout:2/906: truncate d1/d3/d2d/db2/d1e/d2a/f67 129761 0 2024-09-17T01:52:15.742 INFO:tasks.workunit.client.1.smithi092.stdout:9/669: stat d0/d5/d29/cb6 0 2024-09-17T01:52:15.743 INFO:tasks.workunit.client.0.smithi031.stdout:0/901: mknod d0/d29/d33/d5b/c138 0 2024-09-17T01:52:15.744 INFO:tasks.workunit.client.1.smithi092.stdout:5/588: dwrite d0/de/d19/f69 [0,4194304] 0 2024-09-17T01:52:15.745 INFO:tasks.workunit.client.0.smithi031.stdout:0/902: chown d0/d29/d33/dff/fa0 85815 1 2024-09-17T01:52:15.748 INFO:tasks.workunit.client.1.smithi092.stdout:2/636: getdents d10/d55 0 2024-09-17T01:52:15.748 INFO:tasks.workunit.client.1.smithi092.stdout:9/670: readlink d0/d7/d12/lc9 0 2024-09-17T01:52:15.752 INFO:tasks.workunit.client.1.smithi092.stdout:7/694: creat d3/d6/d13/d21/d2e/fe8 x:0 0 0 2024-09-17T01:52:15.754 INFO:tasks.workunit.client.1.smithi092.stdout:5/589: creat d0/de/d19/d1a/d1e/d52/d9a/fc2 x:0 0 0 2024-09-17T01:52:15.755 INFO:tasks.workunit.client.1.smithi092.stdout:0/692: mkdir d3/dc8/dd2/ddb 0 2024-09-17T01:52:15.757 INFO:tasks.workunit.client.1.smithi092.stdout:9/671: symlink d0/d7/d12/d86/d93/lca 0 2024-09-17T01:52:15.759 INFO:tasks.workunit.client.1.smithi092.stdout:2/637: dwrite d10/d5c/d81/f99 [0,4194304] 0 2024-09-17T01:52:15.761 INFO:tasks.workunit.client.1.smithi092.stdout:1/808: dread db/d6c/d8b/fba [0,4194304] 0 2024-09-17T01:52:15.761 INFO:tasks.workunit.client.1.smithi092.stdout:5/590: symlink d0/de/d19/d1a/d1e/d3e/d4c/lc3 0 2024-09-17T01:52:15.763 INFO:tasks.workunit.client.1.smithi092.stdout:8/568: getdents d15 0 2024-09-17T01:52:15.766 INFO:tasks.workunit.client.1.smithi092.stdout:0/693: dread d3/d2e/d3b/f82 [0,4194304] 0 2024-09-17T01:52:15.766 INFO:tasks.workunit.client.1.smithi092.stdout:9/672: link d0/f59 d0/d7c/dbd/fcb 0 2024-09-17T01:52:15.773 INFO:tasks.workunit.client.1.smithi092.stdout:1/809: rename db/d1d/d23/l37 to db/d6c/db3/lfb 0 2024-09-17T01:52:15.774 INFO:tasks.workunit.client.1.smithi092.stdout:5/591: dwrite d0/d7e/d90/fb1 [0,4194304] 0 2024-09-17T01:52:15.777 INFO:tasks.workunit.client.1.smithi092.stdout:9/673: mkdir d0/d7/dcc 0 2024-09-17T01:52:15.780 INFO:tasks.workunit.client.1.smithi092.stdout:0/694: dread d3/dc8/f6e [0,4194304] 0 2024-09-17T01:52:15.781 INFO:tasks.workunit.client.1.smithi092.stdout:8/569: dwrite d15/d32/d40/d42/d6b/fb4 [0,4194304] 0 2024-09-17T01:52:15.783 INFO:tasks.workunit.client.1.smithi092.stdout:2/638: dwrite d10/d1d/d2c/d5a/d7a/f7b [4194304,4194304] 0 2024-09-17T01:52:15.784 INFO:tasks.workunit.client.1.smithi092.stdout:1/810: read db/d1d/d2e/f32 [823904,90484] 0 2024-09-17T01:52:15.787 INFO:tasks.workunit.client.1.smithi092.stdout:9/674: mknod d0/d7/d12/d86/d93/ccd 0 2024-09-17T01:52:15.789 INFO:tasks.workunit.client.1.smithi092.stdout:2/639: creat d10/d1d/d96/d77/d9c/dae/fd3 x:0 0 0 2024-09-17T01:52:15.795 INFO:tasks.workunit.client.1.smithi092.stdout:1/811: dwrite db/d3b/f48 [0,4194304] 0 2024-09-17T01:52:15.798 INFO:tasks.workunit.client.1.smithi092.stdout:2/640: dwrite d10/d8d/d63/fc0 [0,4194304] 0 2024-09-17T01:52:15.801 INFO:tasks.workunit.client.1.smithi092.stdout:1/812: rename db/d1d/d23/d88/fb2 to db/d1d/d4b/ffc 0 2024-09-17T01:52:15.804 INFO:tasks.workunit.client.1.smithi092.stdout:2/641: write d10/d1d/d96/d77/f9b [3386845,24732] 0 2024-09-17T01:52:15.806 INFO:tasks.workunit.client.1.smithi092.stdout:1/813: truncate db/d1d/f22 3038662 0 2024-09-17T01:52:15.808 INFO:tasks.workunit.client.1.smithi092.stdout:2/642: creat d10/d8d/d8f/fd4 x:0 0 0 2024-09-17T01:52:15.809 INFO:tasks.workunit.client.0.smithi031.stdout:7/926: dwrite db/d18/f27 [0,4194304] 0 2024-09-17T01:52:15.809 INFO:tasks.workunit.client.0.smithi031.stdout:2/907: truncate d1/d3/d45/d4a/f57 937771 0 2024-09-17T01:52:15.810 INFO:tasks.workunit.client.1.smithi092.stdout:1/814: creat db/d1d/d23/da1/dc3/ffd x:0 0 0 2024-09-17T01:52:15.812 INFO:tasks.workunit.client.1.smithi092.stdout:1/815: creat db/d6c/d7e/df2/ffe x:0 0 0 2024-09-17T01:52:15.814 INFO:tasks.workunit.client.0.smithi031.stdout:0/903: unlink d0/d29/d44/l7b 0 2024-09-17T01:52:15.815 INFO:tasks.workunit.client.0.smithi031.stdout:8/764: symlink d0/df/d19/le2 0 2024-09-17T01:52:15.816 INFO:tasks.workunit.client.1.smithi092.stdout:1/816: creat db/d1d/d23/d88/fff x:0 0 0 2024-09-17T01:52:15.817 INFO:tasks.workunit.client.0.smithi031.stdout:1/801: dwrite d4/d1a/d2d/fd1 [0,4194304] 0 2024-09-17T01:52:15.818 INFO:tasks.workunit.client.1.smithi092.stdout:1/817: mkdir db/d6c/db3/d100 0 2024-09-17T01:52:15.818 INFO:tasks.workunit.client.0.smithi031.stdout:2/908: unlink d1/d3/d2d/d91/dad/fe1 0 2024-09-17T01:52:15.822 INFO:tasks.workunit.client.1.smithi092.stdout:1/818: rename db/d1d/d23/c90 to db/d1d/d23/da1/c101 0 2024-09-17T01:52:15.822 INFO:tasks.workunit.client.0.smithi031.stdout:2/909: write d1/d3/df/d11/d30/f82 [1599628,92526] 0 2024-09-17T01:52:15.824 INFO:tasks.workunit.client.1.smithi092.stdout:1/819: chown db/d6c/db3/dea/deb/cf7 1185022 1 2024-09-17T01:52:15.824 INFO:tasks.workunit.client.0.smithi031.stdout:8/765: stat d0/d5/d6c/db0/db7/fac 0 2024-09-17T01:52:15.825 INFO:tasks.workunit.client.0.smithi031.stdout:2/910: write d1/f103 [4810953,85730] 0 2024-09-17T01:52:15.826 INFO:tasks.workunit.client.0.smithi031.stdout:1/802: creat d4/d1e/d3f/d4d/dcd/f10d x:0 0 0 2024-09-17T01:52:15.827 INFO:tasks.workunit.client.1.smithi092.stdout:1/820: creat db/d6c/d7e/d82/f102 x:0 0 0 2024-09-17T01:52:15.828 INFO:tasks.workunit.client.0.smithi031.stdout:0/904: dwrite d0/d29/d33/d2a/d25/f113 [0,4194304] 0 2024-09-17T01:52:15.828 INFO:tasks.workunit.client.1.smithi092.stdout:9/675: write d0/d5/d29/f91 [873462,77973] 0 2024-09-17T01:52:15.828 INFO:tasks.workunit.client.0.smithi031.stdout:8/766: write d0/df/dd/f96 [2973454,88032] 0 2024-09-17T01:52:15.828 INFO:tasks.workunit.client.1.smithi092.stdout:8/570: dread f7 [0,4194304] 0 2024-09-17T01:52:15.830 INFO:tasks.workunit.client.0.smithi031.stdout:8/767: fsync d0/d5/d6c/d6d/f72 0 2024-09-17T01:52:15.830 INFO:tasks.workunit.client.0.smithi031.stdout:1/803: creat d4/d1a/d2d/d18/f10e x:0 0 0 2024-09-17T01:52:15.831 INFO:tasks.workunit.client.1.smithi092.stdout:1/821: chown db/d1d/d23/da1 69626 1 2024-09-17T01:52:15.831 INFO:tasks.workunit.client.0.smithi031.stdout:2/911: mknod d1/d3/df/d11/d30/db1/c131 0 2024-09-17T01:52:15.833 INFO:tasks.workunit.client.1.smithi092.stdout:1/822: stat db/d1d/d23/d55/de5/dd3 0 2024-09-17T01:52:15.833 INFO:tasks.workunit.client.0.smithi031.stdout:0/905: rmdir d0/d29/d33/d5/d48/d56 39 2024-09-17T01:52:15.836 INFO:tasks.workunit.client.0.smithi031.stdout:8/768: creat d0/fe3 x:0 0 0 2024-09-17T01:52:15.836 INFO:tasks.workunit.client.1.smithi092.stdout:9/676: creat d0/d7/d12/d34/d26/fce x:0 0 0 2024-09-17T01:52:15.836 INFO:tasks.workunit.client.1.smithi092.stdout:8/571: getdents d15/d25 0 2024-09-17T01:52:15.842 INFO:tasks.workunit.client.1.smithi092.stdout:8/572: creat d15/d32/d3b/d78/d9b/fba x:0 0 0 2024-09-17T01:52:15.843 INFO:tasks.workunit.client.1.smithi092.stdout:9/677: dwrite d0/d7/d12/d34/f7e [0,4194304] 0 2024-09-17T01:52:15.843 INFO:tasks.workunit.client.0.smithi031.stdout:1/804: link d4/d3d/d65/db7/fc2 d4/d1e/d40/ddb/f10f 0 2024-09-17T01:52:15.844 INFO:tasks.workunit.client.0.smithi031.stdout:2/912: dwrite d1/d3/df/d11/d30/ddd/ff3 [0,4194304] 0 2024-09-17T01:52:15.845 INFO:tasks.workunit.client.1.smithi092.stdout:2/643: dread d10/d1d/d24/fba [0,4194304] 0 2024-09-17T01:52:15.848 INFO:tasks.workunit.client.0.smithi031.stdout:7/927: dwrite db/fe [0,4194304] 0 2024-09-17T01:52:15.850 INFO:tasks.workunit.client.0.smithi031.stdout:7/928: chown db/d1c/d46/l8b 10 1 2024-09-17T01:52:15.850 INFO:tasks.workunit.client.0.smithi031.stdout:7/929: stat db/d1c/cff 0 2024-09-17T01:52:15.854 INFO:tasks.workunit.client.0.smithi031.stdout:1/805: creat d4/d1e/d3f/d4d/da5/f110 x:0 0 0 2024-09-17T01:52:15.854 INFO:tasks.workunit.client.0.smithi031.stdout:2/913: mknod d1/d12e/c132 0 2024-09-17T01:52:15.855 INFO:tasks.workunit.client.1.smithi092.stdout:1/823: write db/d1d/db5/f93 [321343,74711] 0 2024-09-17T01:52:15.855 INFO:tasks.workunit.client.0.smithi031.stdout:2/914: stat d1/d12e/c132 0 2024-09-17T01:52:15.857 INFO:tasks.workunit.client.1.smithi092.stdout:8/573: link d15/l20 d15/d25/d2b/d3d/d9f/lbb 0 2024-09-17T01:52:15.857 INFO:tasks.workunit.client.1.smithi092.stdout:2/644: getdents d10/d54 0 2024-09-17T01:52:15.858 INFO:tasks.workunit.client.1.smithi092.stdout:2/645: dread - d10/d3a/d97/fc8 zero size 2024-09-17T01:52:15.859 INFO:tasks.workunit.client.0.smithi031.stdout:1/806: write d4/d1e/d40/d84/fdc [4493934,26716] 0 2024-09-17T01:52:15.859 INFO:tasks.workunit.client.0.smithi031.stdout:8/769: symlink d0/d5/d54/le4 0 2024-09-17T01:52:15.859 INFO:tasks.workunit.client.1.smithi092.stdout:8/574: symlink d15/d32/d3b/d78/d9e/lbc 0 2024-09-17T01:52:15.862 INFO:tasks.workunit.client.1.smithi092.stdout:1/824: creat db/d6c/d7e/dd1/f103 x:0 0 0 2024-09-17T01:52:15.862 INFO:tasks.workunit.client.0.smithi031.stdout:2/915: rename d1/d3/d45/d4a/d96/fd4 to d1/d12e/f133 0 2024-09-17T01:52:15.862 INFO:tasks.workunit.client.0.smithi031.stdout:7/930: creat db/d1c/d41/d6c/f12b x:0 0 0 2024-09-17T01:52:15.863 INFO:tasks.workunit.client.1.smithi092.stdout:2/646: symlink d10/d8d/d8f/ld5 0 2024-09-17T01:52:15.864 INFO:tasks.workunit.client.0.smithi031.stdout:1/807: mknod d4/d1e/d3f/d4d/da5/c111 0 2024-09-17T01:52:15.864 INFO:tasks.workunit.client.0.smithi031.stdout:0/906: write d0/d29/da7/db3/f8e [13459,110505] 0 2024-09-17T01:52:15.864 INFO:tasks.workunit.client.1.smithi092.stdout:2/647: chown d10/d1d/d96/d77/d9c/dae/cb7 11 1 2024-09-17T01:52:15.865 INFO:tasks.workunit.client.1.smithi092.stdout:1/825: unlink db/d1d/ff0 0 2024-09-17T01:52:15.867 INFO:tasks.workunit.client.1.smithi092.stdout:8/575: link d15/d32/f59 d15/d6f/d8b/fbd 0 2024-09-17T01:52:15.868 INFO:tasks.workunit.client.1.smithi092.stdout:8/576: chown d15/d32/d40/lb9 1 1 2024-09-17T01:52:15.868 INFO:tasks.workunit.client.0.smithi031.stdout:1/808: mknod d4/d1e/d3f/d72/c112 0 2024-09-17T01:52:15.868 INFO:tasks.workunit.client.1.smithi092.stdout:8/577: stat d15/d32/d3b/f79 0 2024-09-17T01:52:15.869 INFO:tasks.workunit.client.1.smithi092.stdout:1/826: rmdir db 39 2024-09-17T01:52:15.869 INFO:tasks.workunit.client.0.smithi031.stdout:1/809: chown d4/d3d/d65/db7 125 1 2024-09-17T01:52:15.869 INFO:tasks.workunit.client.0.smithi031.stdout:0/907: read d0/d29/d33/d2a/d25/f26 [219864,88687] 0 2024-09-17T01:52:15.869 INFO:tasks.workunit.client.1.smithi092.stdout:2/648: symlink d10/d1d/d96/d77/ld6 0 2024-09-17T01:52:15.870 INFO:tasks.workunit.client.0.smithi031.stdout:7/931: dwrite db/d18/d67/d10e/f121 [0,4194304] 0 2024-09-17T01:52:15.870 INFO:tasks.workunit.client.1.smithi092.stdout:6/593: sync 2024-09-17T01:52:15.871 INFO:tasks.workunit.client.0.smithi031.stdout:8/770: rename d0/f99 to d0/df/dd/d9c/fe5 0 2024-09-17T01:52:15.871 INFO:tasks.workunit.client.1.smithi092.stdout:6/594: fsync f1 0 2024-09-17T01:52:15.871 INFO:tasks.workunit.client.0.smithi031.stdout:7/932: dread - db/d1c/d41/d9a/fcd zero size 2024-09-17T01:52:15.873 INFO:tasks.workunit.client.0.smithi031.stdout:0/908: write d0/d29/d33/d5/f62 [3772050,5826] 0 2024-09-17T01:52:15.873 INFO:tasks.workunit.client.1.smithi092.stdout:6/595: symlink d3/d8e/lb5 0 2024-09-17T01:52:15.874 INFO:tasks.workunit.client.0.smithi031.stdout:9/788: sync 2024-09-17T01:52:15.874 INFO:tasks.workunit.client.1.smithi092.stdout:9/678: dread d0/d7/d21/f50 [0,4194304] 0 2024-09-17T01:52:15.875 INFO:tasks.workunit.client.0.smithi031.stdout:7/933: mknod db/d18/d67/dee/c12c 0 2024-09-17T01:52:15.876 INFO:tasks.workunit.client.1.smithi092.stdout:1/827: mknod db/d6c/d7a/c104 0 2024-09-17T01:52:15.876 INFO:tasks.workunit.client.1.smithi092.stdout:9/679: fdatasync d0/f32 0 2024-09-17T01:52:15.877 INFO:tasks.workunit.client.1.smithi092.stdout:6/596: dread d3/d10/d1f/d21/d1e/d55/f93 [0,4194304] 0 2024-09-17T01:52:15.878 INFO:tasks.workunit.client.1.smithi092.stdout:6/597: readlink d3/d10/d1f/l74 0 2024-09-17T01:52:15.878 INFO:tasks.workunit.client.1.smithi092.stdout:1/828: chown l9 7 1 2024-09-17T01:52:15.879 INFO:tasks.workunit.client.0.smithi031.stdout:0/909: readlink d0/d29/d33/d5/dec/l119 0 2024-09-17T01:52:15.880 INFO:tasks.workunit.client.0.smithi031.stdout:2/916: dread d1/d3/df/d11/f26 [0,4194304] 0 2024-09-17T01:52:15.880 INFO:tasks.workunit.client.1.smithi092.stdout:9/680: creat d0/d7/d12/d34/d26/d54/d6b/fcf x:0 0 0 2024-09-17T01:52:15.881 INFO:tasks.workunit.client.0.smithi031.stdout:2/917: fsync d1/f126 0 2024-09-17T01:52:15.882 INFO:tasks.workunit.client.0.smithi031.stdout:8/771: dread d0/d5/fab [0,4194304] 0 2024-09-17T01:52:15.882 INFO:tasks.workunit.client.1.smithi092.stdout:6/598: symlink d3/d10/d8c/d43/d5e/da1/lb6 0 2024-09-17T01:52:15.882 INFO:tasks.workunit.client.0.smithi031.stdout:2/918: fsync d1/d3/d2d/db2/fe0 0 2024-09-17T01:52:15.883 INFO:tasks.workunit.client.0.smithi031.stdout:7/934: unlink db/d1c/d46/d95/da6/fcc 0 2024-09-17T01:52:15.885 INFO:tasks.workunit.client.1.smithi092.stdout:9/681: rmdir d0/d7c 39 2024-09-17T01:52:15.887 INFO:tasks.workunit.client.1.smithi092.stdout:6/599: rmdir d3/d25/da8 39 2024-09-17T01:52:15.890 INFO:tasks.workunit.client.1.smithi092.stdout:1/829: link db/d1d/d2e/d62/cf8 db/d1d/d4b/c105 0 2024-09-17T01:52:15.891 INFO:tasks.workunit.client.0.smithi031.stdout:2/919: unlink d1/d3/d2d/f8b 0 2024-09-17T01:52:15.892 INFO:tasks.workunit.client.1.smithi092.stdout:6/600: rename d3/f3a to d3/d10/d8c/d43/fb7 0 2024-09-17T01:52:15.893 INFO:tasks.workunit.client.0.smithi031.stdout:0/910: creat d0/d29/d33/d5/d48/d56/dc8/d12f/f139 x:0 0 0 2024-09-17T01:52:15.895 INFO:tasks.workunit.client.0.smithi031.stdout:7/935: mkdir db/d18/d67/dac/d120/d12d 0 2024-09-17T01:52:15.895 INFO:tasks.workunit.client.1.smithi092.stdout:6/601: symlink d3/d10/d8c/d43/d6a/d3d/lb8 0 2024-09-17T01:52:15.896 INFO:tasks.workunit.client.0.smithi031.stdout:9/789: getdents d3/d4/da0/d36/d79/dd0 0 2024-09-17T01:52:15.896 INFO:tasks.workunit.client.1.smithi092.stdout:1/830: symlink db/l106 0 2024-09-17T01:52:15.897 INFO:tasks.workunit.client.1.smithi092.stdout:1/831: readlink db/d1d/d23/da1/le0 0 2024-09-17T01:52:15.897 INFO:tasks.workunit.client.0.smithi031.stdout:8/772: creat d0/d5/fe6 x:0 0 0 2024-09-17T01:52:15.897 INFO:tasks.workunit.client.1.smithi092.stdout:1/832: stat db/d1d/d23/d34/fb0 0 2024-09-17T01:52:15.898 INFO:tasks.workunit.client.0.smithi031.stdout:2/920: dread d1/d3/df/d18/d40/dc1/ffd [0,4194304] 0 2024-09-17T01:52:15.898 INFO:tasks.workunit.client.1.smithi092.stdout:6/602: mkdir d3/d10/d8c/d49/db9 0 2024-09-17T01:52:15.898 INFO:tasks.workunit.client.0.smithi031.stdout:0/911: mknod d0/d29/da7/db3/d4a/d86/dd7/dac/c13a 0 2024-09-17T01:52:15.900 INFO:tasks.workunit.client.1.smithi092.stdout:8/578: write f7 [2478326,89440] 0 2024-09-17T01:52:15.900 INFO:tasks.workunit.client.1.smithi092.stdout:2/649: truncate d10/d55/d84/fbb 3684666 0 2024-09-17T01:52:15.901 INFO:tasks.workunit.client.1.smithi092.stdout:6/603: write d3/f6 [3286639,100145] 0 2024-09-17T01:52:15.902 INFO:tasks.workunit.client.0.smithi031.stdout:0/912: fdatasync d0/d29/d33/d5/f98 0 2024-09-17T01:52:15.902 INFO:tasks.workunit.client.0.smithi031.stdout:8/773: chown d0/d5/d54/d60/dbb/dc0/fe0 434609929 1 2024-09-17T01:52:15.902 INFO:tasks.workunit.client.0.smithi031.stdout:2/921: chown d1/d3/df/d11/d30/db1/fb7 30 1 2024-09-17T01:52:15.902 INFO:tasks.workunit.client.0.smithi031.stdout:7/936: dread db/fe [0,4194304] 0 2024-09-17T01:52:15.903 INFO:tasks.workunit.client.1.smithi092.stdout:1/833: mknod db/d6c/c107 0 2024-09-17T01:52:15.904 INFO:tasks.workunit.client.0.smithi031.stdout:9/790: rename d3/d19/l40 to d3/d4/da0/d71/lfb 0 2024-09-17T01:52:15.904 INFO:tasks.workunit.client.0.smithi031.stdout:8/774: fsync d0/d5/d9b/f4b 0 2024-09-17T01:52:15.904 INFO:tasks.workunit.client.0.smithi031.stdout:7/937: fdatasync db/d1c/fbc 0 2024-09-17T01:52:15.905 INFO:tasks.workunit.client.0.smithi031.stdout:1/810: dread d4/d1e/d5d/dae/f9c [0,4194304] 0 2024-09-17T01:52:15.905 INFO:tasks.workunit.client.1.smithi092.stdout:8/579: unlink d15/d32/d40/d42/l53 0 2024-09-17T01:52:15.906 INFO:tasks.workunit.client.0.smithi031.stdout:2/922: chown d1/d3/df/d11/d30/da1/dca 5 1 2024-09-17T01:52:15.906 INFO:tasks.workunit.client.0.smithi031.stdout:7/938: readlink db/d18/l22 0 2024-09-17T01:52:15.908 INFO:tasks.workunit.client.0.smithi031.stdout:9/791: write d3/d4/d29/fa8 [3780170,93414] 0 2024-09-17T01:52:15.908 INFO:tasks.workunit.client.1.smithi092.stdout:6/604: write d3/d10/d1f/d21/d28/f2c [8906583,77428] 0 2024-09-17T01:52:15.909 INFO:tasks.workunit.client.0.smithi031.stdout:2/923: fsync d1/d3/d2d/db2/d1e/f29 0 2024-09-17T01:52:15.909 INFO:tasks.workunit.client.1.smithi092.stdout:2/650: rename fe to d10/d1d/d96/d77/d9c/fd7 0 2024-09-17T01:52:15.910 INFO:tasks.workunit.client.0.smithi031.stdout:1/811: fsync d4/d1e/d3f/d72/d7e/d92/f99 0 2024-09-17T01:52:15.911 INFO:tasks.workunit.client.0.smithi031.stdout:9/792: chown d3/d4/da0/d36/d99/de5 460 1 2024-09-17T01:52:15.911 INFO:tasks.workunit.client.0.smithi031.stdout:8/775: dread d0/d5/d9b/f5f [0,4194304] 0 2024-09-17T01:52:15.913 INFO:tasks.workunit.client.0.smithi031.stdout:8/776: write d0/d5/d54/fd3 [190228,398] 0 2024-09-17T01:52:15.914 INFO:tasks.workunit.client.1.smithi092.stdout:2/651: mkdir d10/d4c/d80/dd8 0 2024-09-17T01:52:15.914 INFO:tasks.workunit.client.1.smithi092.stdout:9/682: dwrite d0/d7/d12/f99 [0,4194304] 0 2024-09-17T01:52:15.916 INFO:tasks.workunit.client.0.smithi031.stdout:5/848: sync 2024-09-17T01:52:15.916 INFO:tasks.workunit.client.0.smithi031.stdout:3/877: sync 2024-09-17T01:52:15.918 INFO:tasks.workunit.client.0.smithi031.stdout:5/849: fdatasync da/d42/fe9 0 2024-09-17T01:52:15.919 INFO:tasks.workunit.client.1.smithi092.stdout:2/652: symlink d10/d54/ld9 0 2024-09-17T01:52:15.919 INFO:tasks.workunit.client.0.smithi031.stdout:7/939: dwrite db/fe [0,4194304] 0 2024-09-17T01:52:15.920 INFO:tasks.workunit.client.0.smithi031.stdout:3/878: fsync db/df/d1d/d37/fdf 0 2024-09-17T01:52:15.921 INFO:tasks.workunit.client.0.smithi031.stdout:2/924: creat d1/d3/d2d/d11c/f134 x:0 0 0 2024-09-17T01:52:15.923 INFO:tasks.workunit.client.0.smithi031.stdout:8/777: mknod d0/d5/d54/d60/ce7 0 2024-09-17T01:52:15.924 INFO:tasks.workunit.client.1.smithi092.stdout:6/605: dwrite d3/d10/d8c/d43/d5e/d73/f90 [0,4194304] 0 2024-09-17T01:52:15.925 INFO:tasks.workunit.client.1.smithi092.stdout:1/834: dread db/fd [0,4194304] 0 2024-09-17T01:52:15.926 INFO:tasks.workunit.client.1.smithi092.stdout:2/653: rename d10/d8d/d63 to d10/d55/dda 0 2024-09-17T01:52:15.927 INFO:tasks.workunit.client.0.smithi031.stdout:3/879: write db/f7d [5086003,123802] 0 2024-09-17T01:52:15.929 INFO:tasks.workunit.client.0.smithi031.stdout:1/812: dwrite d4/d3d/d65/fea [0,4194304] 0 2024-09-17T01:52:15.929 INFO:tasks.workunit.client.0.smithi031.stdout:9/793: mknod d3/d19/cfc 0 2024-09-17T01:52:15.932 INFO:tasks.workunit.client.1.smithi092.stdout:8/580: dread d15/d32/d3b/f7e [0,4194304] 0 2024-09-17T01:52:15.933 INFO:tasks.workunit.client.0.smithi031.stdout:2/925: read d1/d3/df/d18/f61 [130487,8167] 0 2024-09-17T01:52:15.934 INFO:tasks.workunit.client.1.smithi092.stdout:8/581: fdatasync d15/d25/d27/f3e 0 2024-09-17T01:52:15.935 INFO:tasks.workunit.client.1.smithi092.stdout:8/582: dread - d15/f89 zero size 2024-09-17T01:52:15.935 INFO:tasks.workunit.client.1.smithi092.stdout:6/606: rmdir d3/d10 39 2024-09-17T01:52:15.938 INFO:tasks.workunit.client.1.smithi092.stdout:2/654: rename l7 to d10/d1d/d2c/d5a/ldb 0 2024-09-17T01:52:15.944 INFO:tasks.workunit.client.1.smithi092.stdout:2/655: mknod d10/d1d/d2c/d56/d66/cdc 0 2024-09-17T01:52:15.945 INFO:tasks.workunit.client.0.smithi031.stdout:1/813: symlink d4/d1e/d3f/d72/l113 0 2024-09-17T01:52:15.946 INFO:tasks.workunit.client.1.smithi092.stdout:6/607: rename d3/d10/d1f/d21/d28/f56 to d3/d25/da8/fba 0 2024-09-17T01:52:15.947 INFO:tasks.workunit.client.1.smithi092.stdout:1/835: getdents db/d1d/d23/da1 0 2024-09-17T01:52:15.948 INFO:tasks.workunit.client.0.smithi031.stdout:3/880: creat db/df/dc8/d6a/dc3/ddb/f118 x:0 0 0 2024-09-17T01:52:15.950 INFO:tasks.workunit.client.1.smithi092.stdout:6/608: creat d3/d10/d8c/d43/d6a/d3d/d72/fbb x:0 0 0 2024-09-17T01:52:15.951 INFO:tasks.workunit.client.1.smithi092.stdout:1/836: symlink db/d1d/d23/da1/dbf/l108 0 2024-09-17T01:52:15.951 INFO:tasks.workunit.client.1.smithi092.stdout:2/656: dread d10/d1d/f8b [0,4194304] 0 2024-09-17T01:52:15.952 INFO:tasks.workunit.client.0.smithi031.stdout:3/881: readlink db/df/d1d/d37/d6c/d6e/dd4/l105 0 2024-09-17T01:52:15.952 INFO:tasks.workunit.client.1.smithi092.stdout:1/837: write db/d6c/d7e/d82/fae [4912168,127957] 0 2024-09-17T01:52:15.953 INFO:tasks.workunit.client.0.smithi031.stdout:2/926: rename d1/d3/d2d/db2/d1e to d1/d3/d2d/da6/d107/d135 0 2024-09-17T01:52:15.953 INFO:tasks.workunit.client.0.smithi031.stdout:8/778: dread d0/d5/d9b/f5c [0,4194304] 0 2024-09-17T01:52:15.954 INFO:tasks.workunit.client.0.smithi031.stdout:0/913: dwrite d0/d29/d33/d5/fa [0,4194304] 0 2024-09-17T01:52:15.954 INFO:tasks.workunit.client.1.smithi092.stdout:2/657: fdatasync d10/d1d/d2c/d56/f60 0 2024-09-17T01:52:15.955 INFO:tasks.workunit.client.0.smithi031.stdout:5/850: creat da/d42/d12/d128/f12c x:0 0 0 2024-09-17T01:52:15.956 INFO:tasks.workunit.client.1.smithi092.stdout:6/609: truncate d3/d10/d1f/d21/da5/d18/f27 3484623 0 2024-09-17T01:52:15.958 INFO:tasks.workunit.client.1.smithi092.stdout:6/610: mknod d3/d25/da8/cbc 0 2024-09-17T01:52:15.959 INFO:tasks.workunit.client.0.smithi031.stdout:9/794: truncate d3/d19/f34 1320354 0 2024-09-17T01:52:15.959 INFO:tasks.workunit.client.1.smithi092.stdout:9/683: write d0/d7/d12/fae [912474,77630] 0 2024-09-17T01:52:15.961 INFO:tasks.workunit.client.0.smithi031.stdout:1/814: dread d4/d1a/d2d/fd1 [0,4194304] 0 2024-09-17T01:52:15.963 INFO:tasks.workunit.client.1.smithi092.stdout:2/658: dwrite d10/d4c/d80/d95/daa/fc4 [0,4194304] 0 2024-09-17T01:52:15.964 INFO:tasks.workunit.client.1.smithi092.stdout:8/583: write d15/d32/d3b/f79 [384924,23034] 0 2024-09-17T01:52:15.965 INFO:tasks.workunit.client.0.smithi031.stdout:0/914: symlink d0/d29/d33/d2a/l13b 0 2024-09-17T01:52:15.965 INFO:tasks.workunit.client.1.smithi092.stdout:2/659: write d10/d1d/d2c/f39 [1596234,10026] 0 2024-09-17T01:52:15.967 INFO:tasks.workunit.client.1.smithi092.stdout:8/584: write d15/d32/f38 [4414272,118285] 0 2024-09-17T01:52:15.969 INFO:tasks.workunit.client.1.smithi092.stdout:1/838: dread db/d1d/d4b/fd2 [0,4194304] 0 2024-09-17T01:52:15.969 INFO:tasks.workunit.client.0.smithi031.stdout:8/779: dwrite d0/d5/fe6 [0,4194304] 0 2024-09-17T01:52:15.976 INFO:tasks.workunit.client.0.smithi031.stdout:7/940: dread db/d1c/d46/f60 [0,4194304] 0 2024-09-17T01:52:15.976 INFO:tasks.workunit.client.1.smithi092.stdout:1/839: chown db/l59 34 1 2024-09-17T01:52:15.977 INFO:tasks.workunit.client.1.smithi092.stdout:1/840: stat db/d6c/d7e/df2 0 2024-09-17T01:52:15.977 INFO:tasks.workunit.client.1.smithi092.stdout:9/684: link d0/d7/d12/d34/d26/d54/f4e d0/d7/d12/fd0 0 2024-09-17T01:52:15.978 INFO:tasks.workunit.client.0.smithi031.stdout:3/882: link db/df/d1d/f7c db/da3/f119 0 2024-09-17T01:52:15.980 INFO:tasks.workunit.client.0.smithi031.stdout:1/815: fsync d4/d1e/d40/d84/f97 0 2024-09-17T01:52:15.981 INFO:tasks.workunit.client.1.smithi092.stdout:8/585: dwrite d15/d32/d3b/f7e [0,4194304] 0 2024-09-17T01:52:15.981 INFO:tasks.workunit.client.0.smithi031.stdout:1/816: stat d4/d1e/d8d/df9 0 2024-09-17T01:52:15.982 INFO:tasks.workunit.client.1.smithi092.stdout:1/841: write db/d1d/d2e/d62/fbe [2391324,73157] 0 2024-09-17T01:52:15.987 INFO:tasks.workunit.client.1.smithi092.stdout:1/842: mkdir db/d6c/d8b/d109 0 2024-09-17T01:52:15.987 INFO:tasks.workunit.client.0.smithi031.stdout:0/915: rename d0/d29/da7/db3/d4a/d86/da1/le7 to d0/d29/d33/d5/d48/d56/dc8/l13c 0 2024-09-17T01:52:15.989 INFO:tasks.workunit.client.1.smithi092.stdout:1/843: unlink db/d6c/c9c 0 2024-09-17T01:52:15.990 INFO:tasks.workunit.client.0.smithi031.stdout:2/927: creat d1/d3/df/d11/f136 x:0 0 0 2024-09-17T01:52:15.990 INFO:tasks.workunit.client.1.smithi092.stdout:1/844: write db/d1d/d23/d88/fd9 [1797251,129718] 0 2024-09-17T01:52:15.992 INFO:tasks.workunit.client.0.smithi031.stdout:1/817: mkdir d4/d1e/d40/daa/dce/d114 0 2024-09-17T01:52:15.994 INFO:tasks.workunit.client.0.smithi031.stdout:1/818: readlink d4/d1a/d43/lf1 0 2024-09-17T01:52:15.996 INFO:tasks.workunit.client.1.smithi092.stdout:1/845: rename db/d6c/d8b/la0 to db/d1d/d23/da1/dc3/l10a 0 2024-09-17T01:52:15.997 INFO:tasks.workunit.client.0.smithi031.stdout:8/780: creat d0/df/db6/fe8 x:0 0 0 2024-09-17T01:52:15.997 INFO:tasks.workunit.client.1.smithi092.stdout:1/846: write db/d1d/d23/d88/fd9 [362215,100964] 0 2024-09-17T01:52:16.001 INFO:tasks.workunit.client.0.smithi031.stdout:0/916: creat d0/d29/d33/d5/d48/d56/dc8/d12f/d132/f13d x:0 0 0 2024-09-17T01:52:16.002 INFO:tasks.workunit.client.0.smithi031.stdout:3/883: creat db/f11a x:0 0 0 2024-09-17T01:52:16.002 INFO:tasks.workunit.client.0.smithi031.stdout:9/795: dread d3/f8 [0,4194304] 0 2024-09-17T01:52:16.006 INFO:tasks.workunit.client.1.smithi092.stdout:2/660: dwrite d10/d1d/d96/d77/d9c/fd7 [0,4194304] 0 2024-09-17T01:52:16.006 INFO:tasks.workunit.client.0.smithi031.stdout:0/917: mkdir d0/d13e 0 2024-09-17T01:52:16.007 INFO:tasks.workunit.client.0.smithi031.stdout:1/819: dwrite d4/d3d/d65/d78/f80 [0,4194304] 0 2024-09-17T01:52:16.008 INFO:tasks.workunit.client.0.smithi031.stdout:5/851: dread da/d42/d12/d4a/f60 [0,4194304] 0 2024-09-17T01:52:16.008 INFO:tasks.workunit.client.1.smithi092.stdout:1/847: dwrite db/d1d/f2a [0,4194304] 0 2024-09-17T01:52:16.009 INFO:tasks.workunit.client.1.smithi092.stdout:8/586: dread d15/d25/d27/f3e [0,4194304] 0 2024-09-17T01:52:16.010 INFO:tasks.workunit.client.1.smithi092.stdout:9/685: dwrite d0/d5/d29/f55 [0,4194304] 0 2024-09-17T01:52:16.010 INFO:tasks.workunit.client.1.smithi092.stdout:2/661: symlink d10/d3a/d97/ldd 0 2024-09-17T01:52:16.012 INFO:tasks.workunit.client.0.smithi031.stdout:3/884: write db/df/f39 [3752777,106739] 0 2024-09-17T01:52:16.013 INFO:tasks.workunit.client.1.smithi092.stdout:8/587: creat d15/d25/d27/d6e/d76/fbe x:0 0 0 2024-09-17T01:52:16.014 INFO:tasks.workunit.client.1.smithi092.stdout:8/588: dread - d15/d25/d27/d49/fad zero size 2024-09-17T01:52:16.015 INFO:tasks.workunit.client.0.smithi031.stdout:8/781: dwrite d0/d5/d54/fbf [8388608,4194304] 0 2024-09-17T01:52:16.015 INFO:tasks.workunit.client.1.smithi092.stdout:8/589: fsync d15/d25/d27/d6e/fac 0 2024-09-17T01:52:16.018 INFO:tasks.workunit.client.0.smithi031.stdout:9/796: mknod d3/d4/da0/d36/d79/dd0/cfd 0 2024-09-17T01:52:16.019 INFO:tasks.workunit.client.1.smithi092.stdout:2/662: truncate d10/d4c/f72 1188502 0 2024-09-17T01:52:16.021 INFO:tasks.workunit.client.1.smithi092.stdout:8/590: dread d15/d32/d40/d42/d6b/fb4 [0,4194304] 0 2024-09-17T01:52:16.023 INFO:tasks.workunit.client.1.smithi092.stdout:2/663: symlink d10/db9/lde 0 2024-09-17T01:52:16.025 INFO:tasks.workunit.client.1.smithi092.stdout:8/591: fsync d15/d25/f5a 0 2024-09-17T01:52:16.026 INFO:tasks.workunit.client.1.smithi092.stdout:9/686: getdents d0/d7 0 2024-09-17T01:52:16.027 INFO:tasks.workunit.client.1.smithi092.stdout:2/664: mknod d10/db9/cdf 0 2024-09-17T01:52:16.028 INFO:tasks.workunit.client.1.smithi092.stdout:9/687: write d0/d7/d12/d34/d26/d54/d6b/f92 [493626,20144] 0 2024-09-17T01:52:16.029 INFO:tasks.workunit.client.0.smithi031.stdout:5/852: dwrite da/d4b/d6c/df2/ff7 [0,4194304] 0 2024-09-17T01:52:16.031 INFO:tasks.workunit.client.1.smithi092.stdout:8/592: link d15/f1d d15/d25/d2b/d63/fbf 0 2024-09-17T01:52:16.032 INFO:tasks.workunit.client.0.smithi031.stdout:8/782: mknod d0/df/dd/ce9 0 2024-09-17T01:52:16.034 INFO:tasks.workunit.client.1.smithi092.stdout:8/593: creat d15/d25/d27/d6e/fc0 x:0 0 0 2024-09-17T01:52:16.034 INFO:tasks.workunit.client.0.smithi031.stdout:9/797: creat d3/d4/da0/d36/d8f/ffe x:0 0 0 2024-09-17T01:52:16.036 INFO:tasks.workunit.client.0.smithi031.stdout:8/783: write d0/d5/d9b/f5c [121054,103657] 0 2024-09-17T01:52:16.039 INFO:tasks.workunit.client.0.smithi031.stdout:3/885: rename db/df/dc8/d6a/dc3/ddb/ddc/fef to db/df/dc8/f11b 0 2024-09-17T01:52:16.039 INFO:tasks.workunit.client.0.smithi031.stdout:5/853: dwrite da/d14/dac/f68 [4194304,4194304] 0 2024-09-17T01:52:16.040 INFO:tasks.workunit.client.0.smithi031.stdout:8/784: rmdir d0/df/dd/d9c 39 2024-09-17T01:52:16.044 INFO:tasks.workunit.client.0.smithi031.stdout:8/785: symlink d0/d5/d54/d60/dbb/dc0/lea 0 2024-09-17T01:52:16.046 INFO:tasks.workunit.client.0.smithi031.stdout:3/886: unlink db/df/d1d/d37/d4a/d97/cc4 0 2024-09-17T01:52:16.049 INFO:tasks.workunit.client.0.smithi031.stdout:5/854: getdents da/d4b/dce 0 2024-09-17T01:52:16.051 INFO:tasks.workunit.client.1.smithi092.stdout:8/594: dwrite d15/d32/d3b/d78/d9b/fba [0,4194304] 0 2024-09-17T01:52:16.052 INFO:tasks.workunit.client.1.smithi092.stdout:3/666: sync 2024-09-17T01:52:16.052 INFO:tasks.workunit.client.1.smithi092.stdout:4/808: sync 2024-09-17T01:52:16.052 INFO:tasks.workunit.client.0.smithi031.stdout:5/855: mknod da/d14/dac/d62/d10d/d127/c12d 0 2024-09-17T01:52:16.053 INFO:tasks.workunit.client.0.smithi031.stdout:3/887: dwrite db/f7d [0,4194304] 0 2024-09-17T01:52:16.053 INFO:tasks.workunit.client.0.smithi031.stdout:5/856: chown da/dc/l10a 372170 1 2024-09-17T01:52:16.054 INFO:tasks.workunit.client.1.smithi092.stdout:8/595: dread - d15/d32/d40/d42/d6b/fa2 zero size 2024-09-17T01:52:16.065 INFO:tasks.workunit.client.0.smithi031.stdout:3/888: link db/df/d1d/d37/d6c/c9a db/df/dc8/d6a/d83/dcb/c11c 0 2024-09-17T01:52:16.065 INFO:tasks.workunit.client.0.smithi031.stdout:5/857: link da/d14/c8a da/d42/c12e 0 2024-09-17T01:52:16.068 INFO:tasks.workunit.client.0.smithi031.stdout:3/889: mknod db/df/dc8/d6a/dc3/ddb/df7/c11d 0 2024-09-17T01:52:16.071 INFO:tasks.workunit.client.0.smithi031.stdout:3/890: creat db/df/d1d/d37/d77/f11e x:0 0 0 2024-09-17T01:52:16.072 INFO:tasks.workunit.client.0.smithi031.stdout:9/798: dread d3/fb [0,4194304] 0 2024-09-17T01:52:16.073 INFO:tasks.workunit.client.0.smithi031.stdout:3/891: stat db/df/d1d/d37/d77/dc2/fb7 0 2024-09-17T01:52:16.075 INFO:tasks.workunit.client.0.smithi031.stdout:9/799: mknod d3/d4c/cff 0 2024-09-17T01:52:16.076 INFO:tasks.workunit.client.0.smithi031.stdout:9/800: fsync d3/d19/d1f/d44/d64/fde 0 2024-09-17T01:52:16.077 INFO:tasks.workunit.client.0.smithi031.stdout:3/892: write db/df/d1d/f7c [4348492,28559] 0 2024-09-17T01:52:16.079 INFO:tasks.workunit.client.0.smithi031.stdout:9/801: write d3/d4/da0/d36/d62/fcf [791183,126313] 0 2024-09-17T01:52:16.080 INFO:tasks.workunit.client.0.smithi031.stdout:3/893: symlink db/d9b/l11f 0 2024-09-17T01:52:16.089 INFO:tasks.workunit.client.1.smithi092.stdout:3/667: fdatasync d4/d13/d2e/d5f/f5c 0 2024-09-17T01:52:16.113 INFO:tasks.workunit.client.1.smithi092.stdout:1/848: truncate db/d6c/db3/dea/deb/fee 3962093 0 2024-09-17T01:52:16.115 INFO:tasks.workunit.client.1.smithi092.stdout:4/809: dwrite d4/d13/d20/de0/ffc [0,4194304] 0 2024-09-17T01:52:16.119 INFO:tasks.workunit.client.1.smithi092.stdout:3/668: mknod d4/d13/d2e/d6f/cde 0 2024-09-17T01:52:16.123 INFO:tasks.workunit.client.1.smithi092.stdout:8/596: dread d15/d25/f30 [0,4194304] 0 2024-09-17T01:52:16.124 INFO:tasks.workunit.client.1.smithi092.stdout:1/849: creat db/d6c/db3/dea/deb/f10b x:0 0 0 2024-09-17T01:52:16.127 INFO:tasks.workunit.client.1.smithi092.stdout:2/665: write d10/f1a [1442677,111329] 0 2024-09-17T01:52:16.129 INFO:tasks.workunit.client.1.smithi092.stdout:3/669: mknod d4/d13/d2e/d5f/d89/cdf 0 2024-09-17T01:52:16.130 INFO:tasks.workunit.client.1.smithi092.stdout:3/670: chown d4/d13/f14 257 1 2024-09-17T01:52:16.131 INFO:tasks.workunit.client.1.smithi092.stdout:3/671: fsync d4/d20/d3f/fc9 0 2024-09-17T01:52:16.132 INFO:tasks.workunit.client.1.smithi092.stdout:1/850: stat db/d1d/d23/da1/dbf/ld8 0 2024-09-17T01:52:16.133 INFO:tasks.workunit.client.0.smithi031.stdout:7/941: write db/d1c/d41/d9a/f129 [3151456,105095] 0 2024-09-17T01:52:16.136 INFO:tasks.workunit.client.1.smithi092.stdout:4/810: mkdir d4/d5/d1d/d107 0 2024-09-17T01:52:16.136 INFO:tasks.workunit.client.0.smithi031.stdout:7/942: creat db/d1c/d41/d69/de7/f12e x:0 0 0 2024-09-17T01:52:16.139 INFO:tasks.workunit.client.0.smithi031.stdout:0/918: write d0/d29/d33/d5/f85 [41423,127806] 0 2024-09-17T01:52:16.140 INFO:tasks.workunit.client.0.smithi031.stdout:1/820: truncate d4/d1a/d2d/f38 4127772 0 2024-09-17T01:52:16.142 INFO:tasks.workunit.client.1.smithi092.stdout:8/597: rename d15/d25/d27/d6e/l94 to d15/d25/d2b/lc1 0 2024-09-17T01:52:16.143 INFO:tasks.workunit.client.1.smithi092.stdout:9/688: dwrite d0/df/f66 [0,4194304] 0 2024-09-17T01:52:16.143 INFO:tasks.workunit.client.0.smithi031.stdout:2/928: dwrite d1/d3/df/d11/d30/f6e [0,4194304] 0 2024-09-17T01:52:16.143 INFO:tasks.workunit.client.0.smithi031.stdout:0/919: symlink d0/l13f 0 2024-09-17T01:52:16.145 INFO:tasks.workunit.client.1.smithi092.stdout:3/672: fdatasync d4/d2f/d44/d3c/f3e 0 2024-09-17T01:52:16.146 INFO:tasks.workunit.client.0.smithi031.stdout:3/894: dread db/d29/f4e [0,4194304] 0 2024-09-17T01:52:16.146 INFO:tasks.workunit.client.0.smithi031.stdout:9/802: fsync d3/d4/da0/d36/d8f/ffe 0 2024-09-17T01:52:16.148 INFO:tasks.workunit.client.1.smithi092.stdout:8/598: mknod d15/d25/d27/d49/cc2 0 2024-09-17T01:52:16.149 INFO:tasks.workunit.client.1.smithi092.stdout:8/599: chown d15/d25/d2b/c65 252324518 1 2024-09-17T01:52:16.149 INFO:tasks.workunit.client.0.smithi031.stdout:1/821: unlink d4/d1e/d8d/f9a 0 2024-09-17T01:52:16.152 INFO:tasks.workunit.client.0.smithi031.stdout:2/929: creat d1/d3/df/d11/d30/db1/f137 x:0 0 0 2024-09-17T01:52:16.152 INFO:tasks.workunit.client.0.smithi031.stdout:3/895: chown db/df/dc8/l4f 2 1 2024-09-17T01:52:16.156 INFO:tasks.workunit.client.1.smithi092.stdout:4/811: dread d4/d13/d3b/d42/d76/d35/d3e/f43 [4194304,4194304] 0 2024-09-17T01:52:16.157 INFO:tasks.workunit.client.0.smithi031.stdout:0/920: dwrite d0/d29/d33/d5/d48/d56/dc8/d12f/f139 [0,4194304] 0 2024-09-17T01:52:16.159 INFO:tasks.workunit.client.1.smithi092.stdout:9/689: creat d0/d7/d12/d34/d26/d54/d6b/dc4/fd1 x:0 0 0 2024-09-17T01:52:16.166 INFO:tasks.workunit.client.1.smithi092.stdout:9/690: dread d0/d7/fab [4194304,4194304] 0 2024-09-17T01:52:16.173 INFO:tasks.workunit.client.1.smithi092.stdout:9/691: link d0/d5/c8c d0/d5/d3e/cd2 0 2024-09-17T01:52:16.177 INFO:tasks.workunit.client.1.smithi092.stdout:1/851: creat db/d1d/d23/da1/f10c x:0 0 0 2024-09-17T01:52:16.184 INFO:tasks.workunit.client.1.smithi092.stdout:1/852: dwrite db/d1d/d4b/d9a/fb1 [0,4194304] 0 2024-09-17T01:52:16.188 INFO:tasks.workunit.client.1.smithi092.stdout:1/853: unlink db/d1d/d2e/d62/lac 0 2024-09-17T01:52:16.190 INFO:tasks.workunit.client.1.smithi092.stdout:1/854: mknod db/d6c/db3/dea/c10d 0 2024-09-17T01:52:16.193 INFO:tasks.workunit.client.1.smithi092.stdout:1/855: rename db/d1d/db5/fcf to db/d6c/d7e/d82/de8/f10e 0 2024-09-17T01:52:16.196 INFO:tasks.workunit.client.1.smithi092.stdout:1/856: symlink db/d6c/db3/l10f 0 2024-09-17T01:52:16.198 INFO:tasks.workunit.client.1.smithi092.stdout:1/857: dread db/d1d/db5/f93 [0,4194304] 0 2024-09-17T01:52:16.203 INFO:tasks.workunit.client.1.smithi092.stdout:1/858: dread db/d1d/d23/d88/fc8 [4194304,4194304] 0 2024-09-17T01:52:16.212 INFO:tasks.workunit.client.1.smithi092.stdout:8/600: write f1 [1246908,8636] 0 2024-09-17T01:52:16.215 INFO:tasks.workunit.client.1.smithi092.stdout:3/673: write d4/d13/d2e/d43/fc8 [451218,84114] 0 2024-09-17T01:52:16.218 INFO:tasks.workunit.client.1.smithi092.stdout:3/674: mknod d4/d16/d1b/ce0 0 2024-09-17T01:52:16.221 INFO:tasks.workunit.client.1.smithi092.stdout:3/675: symlink d4/d2f/d44/d3c/le1 0 2024-09-17T01:52:16.221 INFO:tasks.workunit.client.1.smithi092.stdout:3/676: dread - d4/d20/fb0 zero size 2024-09-17T01:52:16.223 INFO:tasks.workunit.client.0.smithi031.stdout:9/803: creat d3/d4/da0/d36/d79/f100 x:0 0 0 2024-09-17T01:52:16.224 INFO:tasks.workunit.client.1.smithi092.stdout:3/677: mknod d4/d20/d9f/ce2 0 2024-09-17T01:52:16.224 INFO:tasks.workunit.client.0.smithi031.stdout:0/921: symlink d0/d29/da7/db3/d4a/d86/dd7/l140 0 2024-09-17T01:52:16.224 INFO:tasks.workunit.client.0.smithi031.stdout:1/822: dwrite d4/d1e/d3f/d72/d7e/da2/fa4 [0,4194304] 0 2024-09-17T01:52:16.225 INFO:tasks.workunit.client.0.smithi031.stdout:8/786: dwrite d0/df/d19/f29 [0,4194304] 0 2024-09-17T01:52:16.227 INFO:tasks.workunit.client.1.smithi092.stdout:1/859: rename db/d1d/ff6 to db/d1d/f110 0 2024-09-17T01:52:16.229 INFO:tasks.workunit.client.0.smithi031.stdout:0/922: chown d0/d29/da7/db3/d4a/d86/da1/ce3 0 1 2024-09-17T01:52:16.230 INFO:tasks.workunit.client.1.smithi092.stdout:3/678: dwrite d4/d16/f80 [0,4194304] 0 2024-09-17T01:52:16.232 INFO:tasks.workunit.client.0.smithi031.stdout:1/823: creat d4/d3d/d65/db7/f115 x:0 0 0 2024-09-17T01:52:16.233 INFO:tasks.workunit.client.0.smithi031.stdout:9/804: rename d3/d4/da0/d36/d8f/cbe to d3/d4/da0/d36/d8f/dee/c101 0 2024-09-17T01:52:16.234 INFO:tasks.workunit.client.1.smithi092.stdout:1/860: rename db/d1d/d23/d55/l67 to db/d1d/d4b/d9a/l111 0 2024-09-17T01:52:16.235 INFO:tasks.workunit.client.0.smithi031.stdout:3/896: getdents db/df 0 2024-09-17T01:52:16.238 INFO:tasks.workunit.client.0.smithi031.stdout:9/805: mkdir d3/d4c/d102 0 2024-09-17T01:52:16.238 INFO:tasks.workunit.client.0.smithi031.stdout:7/943: dwrite db/d1c/fbe [0,4194304] 0 2024-09-17T01:52:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:15 smithi092 ceph-mon[33552]: pgmap v18: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 95 MiB/s rd, 271 MiB/s wr, 514 op/s 2024-09-17T01:52:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:15 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:16.240 INFO:tasks.workunit.client.0.smithi031.stdout:8/787: creat d0/feb x:0 0 0 2024-09-17T01:52:16.241 INFO:tasks.workunit.client.1.smithi092.stdout:3/679: dwrite d4/d16/d1b/fbd [0,4194304] 0 2024-09-17T01:52:16.242 INFO:tasks.workunit.client.0.smithi031.stdout:0/923: getdents d0/d37/db9/dcf/d106 0 2024-09-17T01:52:16.243 INFO:tasks.workunit.client.1.smithi092.stdout:1/861: rename db/d1d/d4b/d9a/fb1 to db/d1d/d23/d55/de5/f112 0 2024-09-17T01:52:16.248 INFO:tasks.workunit.client.0.smithi031.stdout:3/897: rename db/df/d1d/df2 to db/df/d1d/d37/d77/dc2/d120 0 2024-09-17T01:52:16.249 INFO:tasks.workunit.client.1.smithi092.stdout:9/692: rmdir d0/d7/db7 0 2024-09-17T01:52:16.250 INFO:tasks.workunit.client.0.smithi031.stdout:9/806: symlink d3/df7/l103 0 2024-09-17T01:52:16.250 INFO:tasks.workunit.client.0.smithi031.stdout:7/944: dwrite db/d18/f27 [0,4194304] 0 2024-09-17T01:52:16.251 INFO:tasks.workunit.client.1.smithi092.stdout:3/680: creat d4/d2f/fe3 x:0 0 0 2024-09-17T01:52:16.252 INFO:tasks.workunit.client.0.smithi031.stdout:0/924: dread - d0/d29/d33/d5/d48/d56/f108 zero size 2024-09-17T01:52:16.253 INFO:tasks.workunit.client.0.smithi031.stdout:3/898: creat db/d82/f121 x:0 0 0 2024-09-17T01:52:16.253 INFO:tasks.workunit.client.1.smithi092.stdout:8/601: dwrite d15/d32/d40/f7b [0,4194304] 0 2024-09-17T01:52:16.253 INFO:tasks.workunit.client.1.smithi092.stdout:8/602: chown f1 52073 1 2024-09-17T01:52:16.255 INFO:tasks.workunit.client.0.smithi031.stdout:7/945: symlink db/d1c/d41/d9a/l12f 0 2024-09-17T01:52:16.256 INFO:tasks.workunit.client.1.smithi092.stdout:3/681: write d4/d2f/f53 [2438648,104847] 0 2024-09-17T01:52:16.257 INFO:tasks.workunit.client.1.smithi092.stdout:3/682: chown d4/d20/d39/fac 1967227 1 2024-09-17T01:52:16.258 INFO:tasks.workunit.client.0.smithi031.stdout:0/925: creat d0/d29/d33/d5/d48/d56/f141 x:0 0 0 2024-09-17T01:52:16.260 INFO:tasks.workunit.client.1.smithi092.stdout:8/603: rename d15/d32/c64 to d15/d32/d40/cc3 0 2024-09-17T01:52:16.261 INFO:tasks.workunit.client.0.smithi031.stdout:9/807: dwrite d3/d4/da0/d36/d62/db2/dd4/fdf [0,4194304] 0 2024-09-17T01:52:16.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:15 smithi031 ceph-mon[27673]: pgmap v18: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 95 MiB/s rd, 271 MiB/s wr, 514 op/s 2024-09-17T01:52:16.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:15 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:16.265 INFO:tasks.workunit.client.0.smithi031.stdout:7/946: mkdir db/d18/d67/dac/ddd/dc1/d130 0 2024-09-17T01:52:16.265 INFO:tasks.workunit.client.1.smithi092.stdout:3/683: rename d4/d16/f8c to d4/d73/dba/dbe/fe4 0 2024-09-17T01:52:16.266 INFO:tasks.workunit.client.0.smithi031.stdout:3/899: symlink db/df/d1d/d37/d6c/d96/l122 0 2024-09-17T01:52:16.266 INFO:tasks.workunit.client.0.smithi031.stdout:8/788: link d0/d5/d6c/d6d/ldc d0/df/d19/d86/dca/lec 0 2024-09-17T01:52:16.269 INFO:tasks.workunit.client.0.smithi031.stdout:0/926: fdatasync d0/d29/da7/db3/d4a/d86/fc2 0 2024-09-17T01:52:16.269 INFO:tasks.workunit.client.1.smithi092.stdout:3/684: creat d4/d2f/d44/d54/dda/fe5 x:0 0 0 2024-09-17T01:52:16.270 INFO:tasks.workunit.client.1.smithi092.stdout:3/685: write d4/d16/d1b/f87 [636453,40416] 0 2024-09-17T01:52:16.271 INFO:tasks.workunit.client.1.smithi092.stdout:3/686: write d4/d20/d3f/f9c [1663212,129684] 0 2024-09-17T01:52:16.271 INFO:tasks.workunit.client.0.smithi031.stdout:8/789: mknod d0/d5/d9b/ced 0 2024-09-17T01:52:16.272 INFO:tasks.workunit.client.1.smithi092.stdout:7/695: sync 2024-09-17T01:52:16.274 INFO:tasks.workunit.client.0.smithi031.stdout:9/808: creat d3/d4/da0/d36/d62/dd8/f104 x:0 0 0 2024-09-17T01:52:16.274 INFO:tasks.workunit.client.1.smithi092.stdout:7/696: mknod d3/d2b/d84/da7/ce9 0 2024-09-17T01:52:16.275 INFO:tasks.workunit.client.0.smithi031.stdout:0/927: creat d0/d29/da7/db3/d4a/f142 x:0 0 0 2024-09-17T01:52:16.276 INFO:tasks.workunit.client.0.smithi031.stdout:3/900: mknod db/df/dc8/deb/c123 0 2024-09-17T01:52:16.279 INFO:tasks.workunit.client.0.smithi031.stdout:0/928: creat d0/d29/d33/d84/f143 x:0 0 0 2024-09-17T01:52:16.280 INFO:tasks.workunit.client.1.smithi092.stdout:7/697: dwrite d3/d2b/d84/fab [0,4194304] 0 2024-09-17T01:52:16.282 INFO:tasks.workunit.client.0.smithi031.stdout:3/901: rename db/df/d50 to db/df/dc8/d6a/d83/de4/d124 0 2024-09-17T01:52:16.282 INFO:tasks.workunit.client.0.smithi031.stdout:8/790: link d0/d5/d54/d60/dbb/dc0/cd9 d0/d5/d6c/db0/cee 0 2024-09-17T01:52:16.283 INFO:tasks.workunit.client.0.smithi031.stdout:9/809: dwrite d3/d4/da0/d36/d99/de5/ff4 [0,4194304] 0 2024-09-17T01:52:16.284 INFO:tasks.workunit.client.1.smithi092.stdout:7/698: rename d3/db/d98/dce/daf/ld7 to d3/d6/d13/d21/lea 0 2024-09-17T01:52:16.284 INFO:tasks.workunit.client.1.smithi092.stdout:7/699: fdatasync d3/db/f5e 0 2024-09-17T01:52:16.285 INFO:tasks.workunit.client.0.smithi031.stdout:0/929: fdatasync d0/d37/ff0 0 2024-09-17T01:52:16.287 INFO:tasks.workunit.client.0.smithi031.stdout:0/930: read d0/f7d [168042,38317] 0 2024-09-17T01:52:16.293 INFO:tasks.workunit.client.0.smithi031.stdout:0/931: mkdir d0/d29/d33/d2a/d25/d102/d144 0 2024-09-17T01:52:16.294 INFO:tasks.workunit.client.0.smithi031.stdout:0/932: write d0/d29/d33/d5/f62 [1623162,48829] 0 2024-09-17T01:52:16.295 INFO:tasks.workunit.client.0.smithi031.stdout:9/810: mknod d3/d4/da0/d36/d62/c105 0 2024-09-17T01:52:16.296 INFO:tasks.workunit.client.0.smithi031.stdout:9/811: fsync d3/d19/d80/db9/ff2 0 2024-09-17T01:52:16.298 INFO:tasks.workunit.client.0.smithi031.stdout:0/933: mkdir d0/d29/da7/db3/d4a/d86/dd7/dac/d145 0 2024-09-17T01:52:16.299 INFO:tasks.workunit.client.0.smithi031.stdout:9/812: symlink d3/d4c/d102/l106 0 2024-09-17T01:52:16.302 INFO:tasks.workunit.client.0.smithi031.stdout:9/813: unlink d3/d19/f65 0 2024-09-17T01:52:16.304 INFO:tasks.workunit.client.0.smithi031.stdout:0/934: dwrite d0/d29/fa2 [0,4194304] 0 2024-09-17T01:52:16.308 INFO:tasks.workunit.client.0.smithi031.stdout:9/814: rename d3/d4c/d102/l106 to d3/d4/da0/l107 0 2024-09-17T01:52:16.310 INFO:tasks.workunit.client.0.smithi031.stdout:0/935: rename d0/d29/d33/d2a/d25/d38/f65 to d0/d29/da7/db3/f146 0 2024-09-17T01:52:16.315 INFO:tasks.workunit.client.0.smithi031.stdout:9/815: creat d3/d4/da0/f108 x:0 0 0 2024-09-17T01:52:16.316 INFO:tasks.workunit.client.0.smithi031.stdout:9/816: mknod d3/c109 0 2024-09-17T01:52:16.322 INFO:tasks.workunit.client.0.smithi031.stdout:9/817: dwrite d3/d4/da0/d36/d62/fe7 [0,4194304] 0 2024-09-17T01:52:16.333 INFO:tasks.workunit.client.0.smithi031.stdout:7/947: dread db/d1c/d41/d6c/fc4 [0,4194304] 0 2024-09-17T01:52:16.337 INFO:tasks.workunit.client.0.smithi031.stdout:2/930: sync 2024-09-17T01:52:16.337 INFO:tasks.workunit.client.0.smithi031.stdout:5/858: sync 2024-09-17T01:52:16.340 INFO:tasks.workunit.client.0.smithi031.stdout:7/948: dwrite db/d1c/d46/d95/da6/fd3 [0,4194304] 0 2024-09-17T01:52:16.340 INFO:tasks.workunit.client.1.smithi092.stdout:1/862: rmdir db/d1d/d23/d55 39 2024-09-17T01:52:16.345 INFO:tasks.workunit.client.0.smithi031.stdout:1/824: write d4/d1e/d3f/d72/d7e/f102 [693409,44978] 0 2024-09-17T01:52:16.346 INFO:tasks.workunit.client.1.smithi092.stdout:1/863: creat db/d6c/d8b/d109/f113 x:0 0 0 2024-09-17T01:52:16.348 INFO:tasks.workunit.client.0.smithi031.stdout:5/859: dwrite da/d42/d26/f34 [4194304,4194304] 0 2024-09-17T01:52:16.348 INFO:tasks.workunit.client.1.smithi092.stdout:9/693: rmdir d0/d7/d12/d34/d26/d54/d6b/dc4 39 2024-09-17T01:52:16.351 INFO:tasks.workunit.client.1.smithi092.stdout:1/864: write db/d1d/d2e/fcd [2110889,81470] 0 2024-09-17T01:52:16.351 INFO:tasks.workunit.client.1.smithi092.stdout:8/604: truncate d15/f34 4156286 0 2024-09-17T01:52:16.352 INFO:tasks.workunit.client.1.smithi092.stdout:1/865: chown db/d1d/d23/f4c 20924 1 2024-09-17T01:52:16.353 INFO:tasks.workunit.client.1.smithi092.stdout:9/694: symlink d0/ld3 0 2024-09-17T01:52:16.354 INFO:tasks.workunit.client.1.smithi092.stdout:9/695: chown d0/df/d17/f51 2735849 1 2024-09-17T01:52:16.355 INFO:tasks.workunit.client.0.smithi031.stdout:9/818: dread d3/d19/d1f/f23 [0,4194304] 0 2024-09-17T01:52:16.358 INFO:tasks.workunit.client.0.smithi031.stdout:1/825: fsync d4/d1a/d2d/fa 0 2024-09-17T01:52:16.359 INFO:tasks.workunit.client.0.smithi031.stdout:5/860: dread da/d14/dac/f68 [4194304,4194304] 0 2024-09-17T01:52:16.361 INFO:tasks.workunit.client.1.smithi092.stdout:1/866: dread db/d6c/db3/dea/deb/fee [0,4194304] 0 2024-09-17T01:52:16.362 INFO:tasks.workunit.client.1.smithi092.stdout:3/687: dwrite d4/d13/f63 [0,4194304] 0 2024-09-17T01:52:16.365 INFO:tasks.workunit.client.0.smithi031.stdout:5/861: creat da/dc/d25/f12f x:0 0 0 2024-09-17T01:52:16.365 INFO:tasks.workunit.client.1.smithi092.stdout:9/696: link d0/d7/d12/d34/d26/d54/f24 d0/d7/d12/fd4 0 2024-09-17T01:52:16.366 INFO:tasks.workunit.client.0.smithi031.stdout:8/791: mknod d0/df/d19/d86/dca/cef 0 2024-09-17T01:52:16.367 INFO:tasks.workunit.client.1.smithi092.stdout:3/688: dread d4/d13/d2e/d43/fc8 [0,4194304] 0 2024-09-17T01:52:16.371 INFO:tasks.workunit.client.0.smithi031.stdout:8/792: dread d0/d5/fe6 [0,4194304] 0 2024-09-17T01:52:16.371 INFO:tasks.workunit.client.1.smithi092.stdout:9/697: creat d0/d7/d12/fd5 x:0 0 0 2024-09-17T01:52:16.372 INFO:tasks.workunit.client.1.smithi092.stdout:1/867: dwrite db/d1d/d4b/ff4 [0,4194304] 0 2024-09-17T01:52:16.373 INFO:tasks.workunit.client.1.smithi092.stdout:8/605: dread d15/d25/f5a [0,4194304] 0 2024-09-17T01:52:16.377 INFO:tasks.workunit.client.0.smithi031.stdout:9/819: link d3/d19/d1f/d44/d64/fe0 d3/d4/f10a 0 2024-09-17T01:52:16.377 INFO:tasks.workunit.client.1.smithi092.stdout:9/698: stat d0/d7/d12/d98/dc6 0 2024-09-17T01:52:16.378 INFO:tasks.workunit.client.0.smithi031.stdout:9/820: chown d3/d19/db5 3096 1 2024-09-17T01:52:16.378 INFO:tasks.workunit.client.0.smithi031.stdout:9/821: write d3/fe9 [787207,18024] 0 2024-09-17T01:52:16.379 INFO:tasks.workunit.client.0.smithi031.stdout:5/862: link da/d14/dac/f68 da/d14/dac/d82/dc3/f130 0 2024-09-17T01:52:16.381 INFO:tasks.workunit.client.1.smithi092.stdout:3/689: dwrite d4/d16/d1b/f87 [0,4194304] 0 2024-09-17T01:52:16.382 INFO:tasks.workunit.client.1.smithi092.stdout:9/699: write d0/d5/d29/f55 [3320821,5361] 0 2024-09-17T01:52:16.384 INFO:tasks.workunit.client.0.smithi031.stdout:9/822: creat d3/d4/da0/d36/f10b x:0 0 0 2024-09-17T01:52:16.385 INFO:tasks.workunit.client.0.smithi031.stdout:9/823: write d3/d4/da0/d71/f9e [2039151,123215] 0 2024-09-17T01:52:16.385 INFO:tasks.workunit.client.1.smithi092.stdout:9/700: fdatasync d0/d7/d12/d34/fc5 0 2024-09-17T01:52:16.387 INFO:tasks.workunit.client.0.smithi031.stdout:5/863: rename da/d42/d12/d72/lf5 to da/d42/d12/d4a/l131 0 2024-09-17T01:52:16.388 INFO:tasks.workunit.client.1.smithi092.stdout:3/690: mknod d4/d20/d31/ce6 0 2024-09-17T01:52:16.389 INFO:tasks.workunit.client.1.smithi092.stdout:8/606: dwrite d15/d25/f68 [0,4194304] 0 2024-09-17T01:52:16.389 INFO:tasks.workunit.client.1.smithi092.stdout:1/868: dwrite db/fd [8388608,4194304] 0 2024-09-17T01:52:16.389 INFO:tasks.workunit.client.0.smithi031.stdout:8/793: mkdir d0/df/dd/d77/df0 0 2024-09-17T01:52:16.390 INFO:tasks.workunit.client.1.smithi092.stdout:9/701: chown d0/d7/d12/d34/fc5 3962 1 2024-09-17T01:52:16.397 INFO:tasks.workunit.client.1.smithi092.stdout:1/869: read - db/d1d/f110 zero size 2024-09-17T01:52:16.398 INFO:tasks.workunit.client.0.smithi031.stdout:0/936: write d0/f68 [1584881,68598] 0 2024-09-17T01:52:16.402 INFO:tasks.workunit.client.0.smithi031.stdout:5/864: creat da/d42/d12/d64/d121/f132 x:0 0 0 2024-09-17T01:52:16.403 INFO:tasks.workunit.client.1.smithi092.stdout:8/607: dwrite d15/d32/d40/d42/f45 [0,4194304] 0 2024-09-17T01:52:16.404 INFO:tasks.workunit.client.0.smithi031.stdout:2/931: dread d1/d3/df/f5b [0,4194304] 0 2024-09-17T01:52:16.406 INFO:tasks.workunit.client.0.smithi031.stdout:3/902: link db/df/dc8/l52 db/d82/d110/l125 0 2024-09-17T01:52:16.406 INFO:tasks.workunit.client.0.smithi031.stdout:8/794: dwrite d0/df/f2b [4194304,4194304] 0 2024-09-17T01:52:16.413 INFO:tasks.workunit.client.0.smithi031.stdout:9/824: rename d3/d4/d41/f7a to d3/f10c 0 2024-09-17T01:52:16.415 INFO:tasks.workunit.client.0.smithi031.stdout:8/795: symlink d0/d5/d9b/dcf/lf1 0 2024-09-17T01:52:16.418 INFO:tasks.workunit.client.0.smithi031.stdout:7/949: truncate db/d1c/d41/d9a/fb3 3741762 0 2024-09-17T01:52:16.421 INFO:tasks.workunit.client.0.smithi031.stdout:0/937: rename d0/d29/da7/db3/f8e to d0/d29/d33/d2a/f147 0 2024-09-17T01:52:16.424 INFO:tasks.workunit.client.0.smithi031.stdout:9/825: mknod d3/d19/d80/db9/c10d 0 2024-09-17T01:52:16.425 INFO:tasks.workunit.client.0.smithi031.stdout:7/950: chown db/d1c/d41/d6c/fc4 974850 1 2024-09-17T01:52:16.425 INFO:tasks.workunit.client.0.smithi031.stdout:2/932: mknod d1/d3/d2d/da6/c138 0 2024-09-17T01:52:16.425 INFO:tasks.workunit.client.0.smithi031.stdout:1/826: dread d4/d1e/d3f/d4d/f6f [0,4194304] 0 2024-09-17T01:52:16.427 INFO:tasks.workunit.client.1.smithi092.stdout:3/691: truncate d4/d20/f81 115998 0 2024-09-17T01:52:16.427 INFO:tasks.workunit.client.0.smithi031.stdout:3/903: truncate db/df/dc8/d6a/f92 251578 0 2024-09-17T01:52:16.428 INFO:tasks.workunit.client.0.smithi031.stdout:8/796: dwrite d0/d5/d6c/db0/db7/fac [0,4194304] 0 2024-09-17T01:52:16.429 INFO:tasks.workunit.client.1.smithi092.stdout:1/870: truncate db/d1d/db5/f5e 196494 0 2024-09-17T01:52:16.429 INFO:tasks.workunit.client.1.smithi092.stdout:8/608: creat d15/d32/d3b/d78/d9e/fc4 x:0 0 0 2024-09-17T01:52:16.434 INFO:tasks.workunit.client.1.smithi092.stdout:9/702: rename d0/d7/d12/d34/d26/d54/f9c to d0/d7c/dbd/fd6 0 2024-09-17T01:52:16.435 INFO:tasks.workunit.client.1.smithi092.stdout:1/871: readlink db/d1d/d23/d55/de5/l97 0 2024-09-17T01:52:16.437 INFO:tasks.workunit.client.1.smithi092.stdout:8/609: truncate d15/f1e 4903455 0 2024-09-17T01:52:16.438 INFO:tasks.workunit.client.0.smithi031.stdout:7/951: creat db/d18/f131 x:0 0 0 2024-09-17T01:52:16.439 INFO:tasks.workunit.client.1.smithi092.stdout:9/703: creat d0/d7/d12/d98/dc6/fd7 x:0 0 0 2024-09-17T01:52:16.439 INFO:tasks.workunit.client.0.smithi031.stdout:8/797: truncate d0/d5/d6c/db0/fb3 1612980 0 2024-09-17T01:52:16.439 INFO:tasks.workunit.client.0.smithi031.stdout:9/826: rename d3/d4/d29 to d3/d19/d10e 0 2024-09-17T01:52:16.440 INFO:tasks.workunit.client.1.smithi092.stdout:8/610: mkdir d15/d25/dc5 0 2024-09-17T01:52:16.440 INFO:tasks.workunit.client.0.smithi031.stdout:2/933: dwrite d1/d7c/f12a [0,4194304] 0 2024-09-17T01:52:16.441 INFO:tasks.workunit.client.1.smithi092.stdout:1/872: creat db/d6c/d7e/d82/def/f114 x:0 0 0 2024-09-17T01:52:16.441 INFO:tasks.workunit.client.1.smithi092.stdout:5/592: sync 2024-09-17T01:52:16.442 INFO:tasks.workunit.client.1.smithi092.stdout:0/695: sync 2024-09-17T01:52:16.443 INFO:tasks.workunit.client.0.smithi031.stdout:9/827: write d3/d19/db5/fd6 [217134,1823] 0 2024-09-17T01:52:16.443 INFO:tasks.workunit.client.1.smithi092.stdout:5/593: chown d0/de/d19/f6b 3595 1 2024-09-17T01:52:16.448 INFO:tasks.workunit.client.1.smithi092.stdout:5/594: write d0/de/d19/d3c/d41/d8d/fb2 [140754,98810] 0 2024-09-17T01:52:16.449 INFO:tasks.workunit.client.0.smithi031.stdout:3/904: rename db/df/dc8/d6a/dc3/ddb/df7 to db/da3/d126 0 2024-09-17T01:52:16.449 INFO:tasks.workunit.client.0.smithi031.stdout:5/865: dread da/d42/d26/fa6 [0,4194304] 0 2024-09-17T01:52:16.449 INFO:tasks.workunit.client.1.smithi092.stdout:1/873: dwrite db/d1d/d23/d55/de5/fc2 [0,4194304] 0 2024-09-17T01:52:16.449 INFO:tasks.workunit.client.0.smithi031.stdout:8/798: mkdir d0/d5/d6c/db0/df2 0 2024-09-17T01:52:16.450 INFO:tasks.workunit.client.1.smithi092.stdout:9/704: read d0/d7/d12/d34/fc5 [205994,114335] 0 2024-09-17T01:52:16.452 INFO:tasks.workunit.client.1.smithi092.stdout:5/595: mknod d0/cc4 0 2024-09-17T01:52:16.452 INFO:tasks.workunit.client.0.smithi031.stdout:7/952: mknod db/d18/d67/dac/ddd/c132 0 2024-09-17T01:52:16.452 INFO:tasks.workunit.client.0.smithi031.stdout:9/828: symlink d3/de1/l10f 0 2024-09-17T01:52:16.453 INFO:tasks.workunit.client.0.smithi031.stdout:2/934: dread d1/d3/d2d/da6/d107/d135/d2a/f67 [0,4194304] 0 2024-09-17T01:52:16.457 INFO:tasks.workunit.client.1.smithi092.stdout:9/705: link d0/df/d5d/f76 d0/d7/d12/d86/d93/fd8 0 2024-09-17T01:52:16.459 INFO:tasks.workunit.client.0.smithi031.stdout:7/953: creat db/d18/d67/dac/ddd/dbf/f133 x:0 0 0 2024-09-17T01:52:16.460 INFO:tasks.workunit.client.0.smithi031.stdout:9/829: mknod d3/d19/d80/db9/df6/c110 0 2024-09-17T01:52:16.462 INFO:tasks.workunit.client.0.smithi031.stdout:8/799: rename d0/d5/d54/l56 to d0/df/dd/lf3 0 2024-09-17T01:52:16.463 INFO:tasks.workunit.client.0.smithi031.stdout:7/954: symlink db/d1c/de2/l134 0 2024-09-17T01:52:16.466 INFO:tasks.workunit.client.0.smithi031.stdout:9/830: mknod d3/d4/c111 0 2024-09-17T01:52:16.468 INFO:tasks.workunit.client.0.smithi031.stdout:7/955: getdents db/d1c/d41/d9a/df9 0 2024-09-17T01:52:16.469 INFO:tasks.workunit.client.0.smithi031.stdout:7/956: dread - db/d18/d67/dac/ddd/f10c zero size 2024-09-17T01:52:16.471 INFO:tasks.workunit.client.0.smithi031.stdout:7/957: truncate db/f15 357812 0 2024-09-17T01:52:16.474 INFO:tasks.workunit.client.0.smithi031.stdout:7/958: mknod db/d1c/d46/c135 0 2024-09-17T01:52:16.475 INFO:tasks.workunit.client.1.smithi092.stdout:8/611: dread f1 [0,4194304] 0 2024-09-17T01:52:16.475 INFO:tasks.workunit.client.0.smithi031.stdout:7/959: dread - db/fcf zero size 2024-09-17T01:52:16.477 INFO:tasks.workunit.client.0.smithi031.stdout:2/935: dread d1/f103 [0,4194304] 0 2024-09-17T01:52:16.478 INFO:tasks.workunit.client.0.smithi031.stdout:2/936: dread - d1/d3/d2d/da6/d107/d135/d2a/f117 zero size 2024-09-17T01:52:16.479 INFO:tasks.workunit.client.0.smithi031.stdout:7/960: unlink db/d18/f9e 0 2024-09-17T01:52:16.481 INFO:tasks.workunit.client.0.smithi031.stdout:7/961: chown db/f89 1913 1 2024-09-17T01:52:16.482 INFO:tasks.workunit.client.0.smithi031.stdout:7/962: truncate db/d1c/de2/ff3 91753 0 2024-09-17T01:52:16.483 INFO:tasks.workunit.client.0.smithi031.stdout:7/963: chown db/d18/d67 12274318 1 2024-09-17T01:52:16.484 INFO:tasks.workunit.client.0.smithi031.stdout:2/937: rename d1/d3/d2d/da6/d107/d135/d21/d34/d8a to d1/d3/d139 0 2024-09-17T01:52:16.485 INFO:tasks.workunit.client.0.smithi031.stdout:7/964: symlink db/d1c/d8e/l136 0 2024-09-17T01:52:16.486 INFO:tasks.workunit.client.0.smithi031.stdout:2/938: symlink d1/d3/df/d66/l13a 0 2024-09-17T01:52:16.488 INFO:tasks.workunit.client.0.smithi031.stdout:2/939: dread - d1/d3/d2d/d11c/f134 zero size 2024-09-17T01:52:16.491 INFO:tasks.workunit.client.0.smithi031.stdout:7/965: dwrite db/d1c/de2/ff3 [0,4194304] 0 2024-09-17T01:52:16.494 INFO:tasks.workunit.client.1.smithi092.stdout:7/700: sync 2024-09-17T01:52:16.494 INFO:tasks.workunit.client.1.smithi092.stdout:2/666: sync 2024-09-17T01:52:16.494 INFO:tasks.workunit.client.1.smithi092.stdout:4/812: sync 2024-09-17T01:52:16.494 INFO:tasks.workunit.client.1.smithi092.stdout:6/611: sync 2024-09-17T01:52:16.496 INFO:tasks.workunit.client.0.smithi031.stdout:7/966: dread db/f89 [0,4194304] 0 2024-09-17T01:52:16.497 INFO:tasks.workunit.client.1.smithi092.stdout:6/612: chown d3/d10/f6f 17 1 2024-09-17T01:52:16.498 INFO:tasks.workunit.client.1.smithi092.stdout:4/813: stat d4/d5/d1d/d30/d3f/d4b/f81 0 2024-09-17T01:52:16.498 INFO:tasks.workunit.client.1.smithi092.stdout:2/667: chown d10/d4c/cbf 0 1 2024-09-17T01:52:16.500 INFO:tasks.workunit.client.1.smithi092.stdout:7/701: rename d3/d6/d13/d21/d2e/d6e/f20 to d3/db/d26/d6f/feb 0 2024-09-17T01:52:16.502 INFO:tasks.workunit.client.1.smithi092.stdout:4/814: readlink d4/d5/d1d/d30/l5d 0 2024-09-17T01:52:16.504 INFO:tasks.workunit.client.1.smithi092.stdout:7/702: mkdir d3/db/d26/d83/dec 0 2024-09-17T01:52:16.505 INFO:tasks.workunit.client.1.smithi092.stdout:6/613: fdatasync d3/d10/d8c/d43/fb7 0 2024-09-17T01:52:16.507 INFO:tasks.workunit.client.0.smithi031.stdout:7/967: mknod db/d1c/d41/c137 0 2024-09-17T01:52:16.510 INFO:tasks.workunit.client.1.smithi092.stdout:2/668: link d10/d1d/d96/d77/d9c/dae/cb7 d10/d4c/d80/ce0 0 2024-09-17T01:52:16.510 INFO:tasks.workunit.client.0.smithi031.stdout:7/968: mkdir db/d1c/d8e/da7/d138 0 2024-09-17T01:52:16.512 INFO:tasks.workunit.client.1.smithi092.stdout:4/815: symlink d4/d13/d3b/d42/d76/d35/de8/l108 0 2024-09-17T01:52:16.514 INFO:tasks.workunit.client.1.smithi092.stdout:7/703: getdents d3/d2b/d84/ddf 0 2024-09-17T01:52:16.515 INFO:tasks.workunit.client.0.smithi031.stdout:7/969: mknod db/d18/d67/dac/d122/c139 0 2024-09-17T01:52:16.517 INFO:tasks.workunit.client.1.smithi092.stdout:7/704: readlink d3/d6/d13/l11 0 2024-09-17T01:52:16.519 INFO:tasks.workunit.client.0.smithi031.stdout:0/938: dwrite d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/f124 [0,4194304] 0 2024-09-17T01:52:16.519 INFO:tasks.workunit.client.1.smithi092.stdout:7/705: write d3/d6/f9c [4074534,22998] 0 2024-09-17T01:52:16.519 INFO:tasks.workunit.client.1.smithi092.stdout:2/669: truncate d10/d4c/f72 547676 0 2024-09-17T01:52:16.520 INFO:tasks.workunit.client.0.smithi031.stdout:0/939: readlink d0/d29/d33/d5/lf4 0 2024-09-17T01:52:16.520 INFO:tasks.workunit.client.0.smithi031.stdout:1/827: truncate d4/d1a/d2d/fd1 2698969 0 2024-09-17T01:52:16.523 INFO:tasks.workunit.client.1.smithi092.stdout:2/670: mknod d10/d8d/d8f/ce1 0 2024-09-17T01:52:16.523 INFO:tasks.workunit.client.0.smithi031.stdout:3/905: write db/df/f23 [127875,98635] 0 2024-09-17T01:52:16.526 INFO:tasks.workunit.client.0.smithi031.stdout:9/831: dread d3/d19/d1f/d44/d64/fbf [0,4194304] 0 2024-09-17T01:52:16.526 INFO:tasks.workunit.client.1.smithi092.stdout:2/671: dread - d10/d1d/d2c/d56/f78 zero size 2024-09-17T01:52:16.528 INFO:tasks.workunit.client.1.smithi092.stdout:7/706: link d3/db/d98/dce/c50 d3/db/d26/d65/ced 0 2024-09-17T01:52:16.528 INFO:tasks.workunit.client.1.smithi092.stdout:2/672: dread - d10/d1d/d96/d77/d9c/dae/fd3 zero size 2024-09-17T01:52:16.528 INFO:tasks.workunit.client.0.smithi031.stdout:0/940: creat d0/d29/da7/d10f/f148 x:0 0 0 2024-09-17T01:52:16.529 INFO:tasks.workunit.client.0.smithi031.stdout:7/970: dwrite db/f89 [0,4194304] 0 2024-09-17T01:52:16.529 INFO:tasks.workunit.client.1.smithi092.stdout:7/707: chown d3/db/db2 54 1 2024-09-17T01:52:16.531 INFO:tasks.workunit.client.1.smithi092.stdout:7/708: fsync d3/db/d26/d6f/f79 0 2024-09-17T01:52:16.531 INFO:tasks.workunit.client.0.smithi031.stdout:0/941: truncate d0/f11d 424961 0 2024-09-17T01:52:16.532 INFO:tasks.workunit.client.0.smithi031.stdout:1/828: symlink d4/d3d/d65/d78/l116 0 2024-09-17T01:52:16.533 INFO:tasks.workunit.client.0.smithi031.stdout:8/800: write d0/d5/d9b/f9e [820029,124959] 0 2024-09-17T01:52:16.534 INFO:tasks.workunit.client.1.smithi092.stdout:2/673: truncate d10/d55/dda/fa1 1073445 0 2024-09-17T01:52:16.534 INFO:tasks.workunit.client.0.smithi031.stdout:3/906: write db/df/dc8/f11b [840545,125190] 0 2024-09-17T01:52:16.535 INFO:tasks.workunit.client.1.smithi092.stdout:6/614: dread d3/d10/d1f/d21/d28/d2b/f2e [4194304,4194304] 0 2024-09-17T01:52:16.537 INFO:tasks.workunit.client.0.smithi031.stdout:1/829: chown d4/d1e/d40/d84/fdc 271 1 2024-09-17T01:52:16.539 INFO:tasks.workunit.client.0.smithi031.stdout:7/971: rename db/d1c/de2/cf4 to db/d1c/d99/de5/c13a 0 2024-09-17T01:52:16.543 INFO:tasks.workunit.client.1.smithi092.stdout:7/709: creat d3/d6/dc2/ddc/fee x:0 0 0 2024-09-17T01:52:16.543 INFO:tasks.workunit.client.0.smithi031.stdout:8/801: readlink d0/d5/d54/lb5 0 2024-09-17T01:52:16.543 INFO:tasks.workunit.client.1.smithi092.stdout:2/674: dwrite d10/d1d/d24/f62 [0,4194304] 0 2024-09-17T01:52:16.544 INFO:tasks.workunit.client.0.smithi031.stdout:3/907: chown db/da3/la8 6047491 1 2024-09-17T01:52:16.546 INFO:tasks.workunit.client.0.smithi031.stdout:1/830: rmdir d4/d1e 39 2024-09-17T01:52:16.551 INFO:tasks.workunit.client.0.smithi031.stdout:8/802: unlink d0/df/dd/d59/l7c 0 2024-09-17T01:52:16.552 INFO:tasks.workunit.client.1.smithi092.stdout:2/675: creat d10/d1d/d2c/fe2 x:0 0 0 2024-09-17T01:52:16.552 INFO:tasks.workunit.client.1.smithi092.stdout:6/615: creat d3/d10/d1f/d21/d28/fbd x:0 0 0 2024-09-17T01:52:16.554 INFO:tasks.workunit.client.0.smithi031.stdout:3/908: unlink db/df/dc8/d6a/d83/de4/d124/fc7 0 2024-09-17T01:52:16.557 INFO:tasks.workunit.client.1.smithi092.stdout:8/612: chown d15/d25/d27 22417 1 2024-09-17T01:52:16.559 INFO:tasks.workunit.client.1.smithi092.stdout:3/692: dwrite d4/d73/d8f/d9e/fbb [0,4194304] 0 2024-09-17T01:52:16.561 INFO:tasks.workunit.client.0.smithi031.stdout:8/803: creat d0/d5/d54/d60/dbb/ff4 x:0 0 0 2024-09-17T01:52:16.561 INFO:tasks.workunit.client.1.smithi092.stdout:4/816: dread d4/d13/d3b/d42/d76/d35/f39 [0,4194304] 0 2024-09-17T01:52:16.563 INFO:tasks.workunit.client.0.smithi031.stdout:1/831: unlink d4/d1e/d40/daa/dce/dfe/f101 0 2024-09-17T01:52:16.563 INFO:tasks.workunit.client.0.smithi031.stdout:3/909: dwrite db/df/dc8/d6a/d83/de4/f10b [0,4194304] 0 2024-09-17T01:52:16.569 INFO:tasks.workunit.client.0.smithi031.stdout:7/972: rmdir db/d18/d67/dac/ddd/dc1/d130 0 2024-09-17T01:52:16.570 INFO:tasks.workunit.client.0.smithi031.stdout:0/942: link d0/d29/da7/db3/f77 d0/d37/db9/dcf/d106/f149 0 2024-09-17T01:52:16.570 INFO:tasks.workunit.client.1.smithi092.stdout:1/874: truncate db/d3b/fad 2419122 0 2024-09-17T01:52:16.570 INFO:tasks.workunit.client.0.smithi031.stdout:7/973: write db/d29/f2e [4534871,17239] 0 2024-09-17T01:52:16.571 INFO:tasks.workunit.client.1.smithi092.stdout:7/710: dwrite d3/d6/dc2/ddc/fee [0,4194304] 0 2024-09-17T01:52:16.572 INFO:tasks.workunit.client.1.smithi092.stdout:9/706: write d0/d7/d12/f88 [2095572,2816] 0 2024-09-17T01:52:16.575 INFO:tasks.workunit.client.0.smithi031.stdout:8/804: creat d0/d5/d6c/d6d/ff5 x:0 0 0 2024-09-17T01:52:16.578 INFO:tasks.workunit.client.1.smithi092.stdout:0/696: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:52:16.580 INFO:tasks.workunit.client.0.smithi031.stdout:0/943: rmdir d0/d29/d44/d117 39 2024-09-17T01:52:16.581 INFO:tasks.workunit.client.1.smithi092.stdout:3/693: mknod d4/d20/d3f/dc0/ce7 0 2024-09-17T01:52:16.582 INFO:tasks.workunit.client.0.smithi031.stdout:7/974: symlink db/d1c/d41/d69/dd6/l13b 0 2024-09-17T01:52:16.582 INFO:tasks.workunit.client.0.smithi031.stdout:3/910: read db/df/d1d/d37/d77/dc2/fb7 [1534149,101238] 0 2024-09-17T01:52:16.583 INFO:tasks.workunit.client.1.smithi092.stdout:2/676: dwrite d10/d1d/d96/d77/f9b [0,4194304] 0 2024-09-17T01:52:16.584 INFO:tasks.workunit.client.1.smithi092.stdout:8/613: dwrite d15/d25/d27/d49/f4a [0,4194304] 0 2024-09-17T01:52:16.585 INFO:tasks.workunit.client.1.smithi092.stdout:0/697: write d3/da/d1c/f91 [3682053,1581] 0 2024-09-17T01:52:16.585 INFO:tasks.workunit.client.0.smithi031.stdout:9/832: dwrite d3/d4/d41/d70/f84 [0,4194304] 0 2024-09-17T01:52:16.588 INFO:tasks.workunit.client.0.smithi031.stdout:8/805: mknod d0/df/dd/d77/df0/cf6 0 2024-09-17T01:52:16.588 INFO:tasks.workunit.client.1.smithi092.stdout:2/677: read - d10/fd0 zero size 2024-09-17T01:52:16.590 INFO:tasks.workunit.client.1.smithi092.stdout:7/711: rename d3/d6/f64 to d3/d2b/d84/fef 0 2024-09-17T01:52:16.592 INFO:tasks.workunit.client.1.smithi092.stdout:4/817: link d4/f1e d4/d5/d8/d99/dcf/f109 0 2024-09-17T01:52:16.594 INFO:tasks.workunit.client.1.smithi092.stdout:5/596: mknod d0/de/d19/d1a/d1e/d52/d9a/db0/cc5 0 2024-09-17T01:52:16.595 INFO:tasks.workunit.client.0.smithi031.stdout:3/911: unlink db/df/d1d/d37/d77/f11e 0 2024-09-17T01:52:16.595 INFO:tasks.workunit.client.1.smithi092.stdout:4/818: write d4/f8b [555550,88016] 0 2024-09-17T01:52:16.596 INFO:tasks.workunit.client.0.smithi031.stdout:9/833: chown d3/d19/d1f/d44/d64/f97 1 1 2024-09-17T01:52:16.598 INFO:tasks.workunit.client.0.smithi031.stdout:3/912: write db/df/dc8/d6a/f76 [1766713,99866] 0 2024-09-17T01:52:16.598 INFO:tasks.workunit.client.1.smithi092.stdout:5/597: write d0/de/d19/d1a/d1e/d3e/d4c/faa [757372,40349] 0 2024-09-17T01:52:16.602 INFO:tasks.workunit.client.1.smithi092.stdout:9/707: rmdir d0/d7/d21 39 2024-09-17T01:52:16.606 INFO:tasks.workunit.client.0.smithi031.stdout:3/913: write db/df/d1d/d37/d65/f9c [4920274,51085] 0 2024-09-17T01:52:16.607 INFO:tasks.workunit.client.1.smithi092.stdout:6/616: getdents d3/d10/d8c/d43/d6a/d3d/d72 0 2024-09-17T01:52:16.608 INFO:tasks.workunit.client.0.smithi031.stdout:7/975: getdents db/d1c/d41/d9a 0 2024-09-17T01:52:16.609 INFO:tasks.workunit.client.1.smithi092.stdout:8/614: unlink d15/d32/d40/d42/d43/f71 0 2024-09-17T01:52:16.609 INFO:tasks.workunit.client.0.smithi031.stdout:9/834: creat d3/d19/d1f/f112 x:0 0 0 2024-09-17T01:52:16.610 INFO:tasks.workunit.client.1.smithi092.stdout:5/598: read - d0/fb7 zero size 2024-09-17T01:52:16.610 INFO:tasks.workunit.client.1.smithi092.stdout:2/678: mknod d10/d1d/d96/d77/dce/ce3 0 2024-09-17T01:52:16.611 INFO:tasks.workunit.client.0.smithi031.stdout:3/914: unlink db/df/dc8/d6a/d83/de4/d124/l70 0 2024-09-17T01:52:16.611 INFO:tasks.workunit.client.1.smithi092.stdout:5/599: write d0/de/d19/d1a/d1e/f1d [1278052,88368] 0 2024-09-17T01:52:16.611 INFO:tasks.workunit.client.1.smithi092.stdout:9/708: truncate d0/df/d17/f7b 253816 0 2024-09-17T01:52:16.613 INFO:tasks.workunit.client.0.smithi031.stdout:3/915: fsync db/df/dc8/f11b 0 2024-09-17T01:52:16.614 INFO:tasks.workunit.client.1.smithi092.stdout:4/819: symlink d4/d5/d8/de2/l10a 0 2024-09-17T01:52:16.615 INFO:tasks.workunit.client.1.smithi092.stdout:4/820: read - d4/d5/f105 zero size 2024-09-17T01:52:16.616 INFO:tasks.workunit.client.1.smithi092.stdout:4/821: fsync d4/d7b/d7d/f93 0 2024-09-17T01:52:16.616 INFO:tasks.workunit.client.1.smithi092.stdout:6/617: read d3/f6 [3166581,119403] 0 2024-09-17T01:52:16.617 INFO:tasks.workunit.client.0.smithi031.stdout:9/835: dread d3/d4/da0/d36/f6e [0,4194304] 0 2024-09-17T01:52:16.618 INFO:tasks.workunit.client.0.smithi031.stdout:7/976: dwrite db/d18/d67/dac/ddd/dbf/fce [0,4194304] 0 2024-09-17T01:52:16.618 INFO:tasks.workunit.client.1.smithi092.stdout:5/600: mknod d0/de/d19/d1a/d24/d9b/cc6 0 2024-09-17T01:52:16.620 INFO:tasks.workunit.client.0.smithi031.stdout:7/977: dread - db/ff8 zero size 2024-09-17T01:52:16.621 INFO:tasks.workunit.client.1.smithi092.stdout:8/615: mkdir d15/d25/d2b/d3d/dc6 0 2024-09-17T01:52:16.624 INFO:tasks.workunit.client.0.smithi031.stdout:7/978: fsync db/ff2 0 2024-09-17T01:52:16.625 INFO:tasks.workunit.client.1.smithi092.stdout:4/822: dwrite d4/f8b [0,4194304] 0 2024-09-17T01:52:16.626 INFO:tasks.workunit.client.0.smithi031.stdout:7/979: creat db/d18/d67/dac/f13c x:0 0 0 2024-09-17T01:52:16.628 INFO:tasks.workunit.client.1.smithi092.stdout:5/601: mknod d0/de/d19/d1a/d1e/d74/cc7 0 2024-09-17T01:52:16.630 INFO:tasks.workunit.client.0.smithi031.stdout:7/980: symlink db/d18/l13d 0 2024-09-17T01:52:16.631 INFO:tasks.workunit.client.0.smithi031.stdout:1/832: dwrite d4/d1a/d2d/fb4 [0,4194304] 0 2024-09-17T01:52:16.632 INFO:tasks.workunit.client.1.smithi092.stdout:8/616: creat d15/d32/d3b/d78/fc7 x:0 0 0 2024-09-17T01:52:16.633 INFO:tasks.workunit.client.1.smithi092.stdout:7/712: getdents d3/db/d98/dce/d61 0 2024-09-17T01:52:16.634 INFO:tasks.workunit.client.1.smithi092.stdout:8/617: dread - d15/f89 zero size 2024-09-17T01:52:16.635 INFO:tasks.workunit.client.0.smithi031.stdout:1/833: mkdir d4/d1e/d40/daa/dce/d117 0 2024-09-17T01:52:16.635 INFO:tasks.workunit.client.1.smithi092.stdout:2/679: getdents d10/d55/d84 0 2024-09-17T01:52:16.635 INFO:tasks.workunit.client.1.smithi092.stdout:4/823: write d4/d5/d1d/d30/ddd/ff2 [4214605,43589] 0 2024-09-17T01:52:16.637 INFO:tasks.workunit.client.1.smithi092.stdout:9/709: dwrite d0/d7/d12/d34/d26/d54/fc3 [0,4194304] 0 2024-09-17T01:52:16.639 INFO:tasks.workunit.client.1.smithi092.stdout:7/713: mknod d3/d2b/d84/cf0 0 2024-09-17T01:52:16.640 INFO:tasks.workunit.client.0.smithi031.stdout:1/834: getdents d4/d3d/d65/db7 0 2024-09-17T01:52:16.640 INFO:tasks.workunit.client.1.smithi092.stdout:9/710: fsync d0/d7/d12/fd5 0 2024-09-17T01:52:16.640 INFO:tasks.workunit.client.1.smithi092.stdout:8/618: dread - d15/d25/d2b/d3d/d9f/f5c zero size 2024-09-17T01:52:16.641 INFO:tasks.workunit.client.0.smithi031.stdout:1/835: stat d4/d1e/d3f/d72/d7e 0 2024-09-17T01:52:16.642 INFO:tasks.workunit.client.1.smithi092.stdout:4/824: mknod d4/d5/d1d/d107/c10b 0 2024-09-17T01:52:16.642 INFO:tasks.workunit.client.1.smithi092.stdout:7/714: dread - d3/db/d98/dce/fcb zero size 2024-09-17T01:52:16.643 INFO:tasks.workunit.client.1.smithi092.stdout:7/715: fdatasync d3/db/d26/d65/fcf 0 2024-09-17T01:52:16.644 INFO:tasks.workunit.client.0.smithi031.stdout:1/836: unlink d4/d1a/d2d/d18/ff0 0 2024-09-17T01:52:16.645 INFO:tasks.workunit.client.1.smithi092.stdout:4/825: mknod d4/d13/d3b/d42/d76/d35/c10c 0 2024-09-17T01:52:16.646 INFO:tasks.workunit.client.1.smithi092.stdout:7/716: write d3/db/d26/d6f/feb [5290177,74811] 0 2024-09-17T01:52:16.648 INFO:tasks.workunit.client.0.smithi031.stdout:1/837: rename d4/dac to d4/d1e/d5d/d118 0 2024-09-17T01:52:16.649 INFO:tasks.workunit.client.1.smithi092.stdout:7/717: fsync d3/db/f4a 0 2024-09-17T01:52:16.649 INFO:tasks.workunit.client.1.smithi092.stdout:8/619: link d15/d32/d40/c5e d15/d32/d3b/d78/cc8 0 2024-09-17T01:52:16.649 INFO:tasks.workunit.client.1.smithi092.stdout:0/698: dread d3/d2e/d55/d63/d81/fac [0,4194304] 0 2024-09-17T01:52:16.650 INFO:tasks.workunit.client.1.smithi092.stdout:4/826: symlink d4/d5/d1d/d30/d3f/d4b/dff/l10d 0 2024-09-17T01:52:16.651 INFO:tasks.workunit.client.1.smithi092.stdout:0/699: fsync d3/da/f22 0 2024-09-17T01:52:16.652 INFO:tasks.workunit.client.1.smithi092.stdout:4/827: chown d4/d5/d8/d99/dcf 1916629 1 2024-09-17T01:52:16.652 INFO:tasks.workunit.client.1.smithi092.stdout:8/620: dread - d15/d32/d40/d42/d43/f90 zero size 2024-09-17T01:52:16.653 INFO:tasks.workunit.client.1.smithi092.stdout:7/718: creat d3/db/d26/d65/ff1 x:0 0 0 2024-09-17T01:52:16.656 INFO:tasks.workunit.client.1.smithi092.stdout:8/621: readlink d15/d32/d40/d42/d6b/l7d 0 2024-09-17T01:52:16.656 INFO:tasks.workunit.client.1.smithi092.stdout:7/719: creat d3/d2b/d37/ff2 x:0 0 0 2024-09-17T01:52:16.657 INFO:tasks.workunit.client.1.smithi092.stdout:7/720: fdatasync d3/d2b/d84/fab 0 2024-09-17T01:52:16.658 INFO:tasks.workunit.client.1.smithi092.stdout:4/828: truncate d4/d7b/d7d/f95 364745 0 2024-09-17T01:52:16.663 INFO:tasks.workunit.client.1.smithi092.stdout:2/680: dread f5 [0,4194304] 0 2024-09-17T01:52:16.663 INFO:tasks.workunit.client.1.smithi092.stdout:7/721: dwrite d3/db/d7b/fbc [0,4194304] 0 2024-09-17T01:52:16.665 INFO:tasks.workunit.client.1.smithi092.stdout:8/622: truncate d15/f1e 172610 0 2024-09-17T01:52:16.667 INFO:tasks.workunit.client.1.smithi092.stdout:1/875: truncate db/d1d/d2e/d62/fc0 1459123 0 2024-09-17T01:52:16.670 INFO:tasks.workunit.client.1.smithi092.stdout:4/829: rmdir d4/d13/d3b/d42/d76/d35/d3e/d101 0 2024-09-17T01:52:16.673 INFO:tasks.workunit.client.1.smithi092.stdout:1/876: mknod db/d6c/d7e/dd1/c115 0 2024-09-17T01:52:16.673 INFO:tasks.workunit.client.1.smithi092.stdout:4/830: read d4/d5/d8/d92/ffe [370061,113209] 0 2024-09-17T01:52:16.673 INFO:tasks.workunit.client.1.smithi092.stdout:2/681: getdents d10/d1d/d96 0 2024-09-17T01:52:16.677 INFO:tasks.workunit.client.1.smithi092.stdout:1/877: chown db/d6c/d7e/d82/def/f114 905738166 1 2024-09-17T01:52:16.677 INFO:tasks.workunit.client.1.smithi092.stdout:2/682: read d10/d1d/d96/d77/d9c/fd7 [1324967,121336] 0 2024-09-17T01:52:16.677 INFO:tasks.workunit.client.1.smithi092.stdout:3/694: dwrite d4/d20/d3f/dc0/fd1 [0,4194304] 0 2024-09-17T01:52:16.678 INFO:tasks.workunit.client.1.smithi092.stdout:4/831: creat d4/d7b/dc8/f10e x:0 0 0 2024-09-17T01:52:16.679 INFO:tasks.workunit.client.1.smithi092.stdout:4/832: chown d4/d5/c7 119261875 1 2024-09-17T01:52:16.681 INFO:tasks.workunit.client.1.smithi092.stdout:2/683: write d10/d8d/f52 [3180455,23948] 0 2024-09-17T01:52:16.683 INFO:tasks.workunit.client.1.smithi092.stdout:2/684: readlink d10/d1d/d96/l9a 0 2024-09-17T01:52:16.684 INFO:tasks.workunit.client.1.smithi092.stdout:4/833: symlink d4/d5/d8/l10f 0 2024-09-17T01:52:16.686 INFO:tasks.workunit.client.1.smithi092.stdout:2/685: unlink d10/d1d/d24/f62 0 2024-09-17T01:52:16.687 INFO:tasks.workunit.client.0.smithi031.stdout:1/838: dread d4/d1a/d2d/fa [0,4194304] 0 2024-09-17T01:52:16.687 INFO:tasks.workunit.client.1.smithi092.stdout:3/695: dread d4/d13/d2e/fc1 [0,4194304] 0 2024-09-17T01:52:16.688 INFO:tasks.workunit.client.1.smithi092.stdout:4/834: creat d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3/f110 x:0 0 0 2024-09-17T01:52:16.690 INFO:tasks.workunit.client.1.smithi092.stdout:2/686: creat d10/d1d/d24/fe4 x:0 0 0 2024-09-17T01:52:16.692 INFO:tasks.workunit.client.1.smithi092.stdout:4/835: symlink d4/d13/d3b/l111 0 2024-09-17T01:52:16.698 INFO:tasks.workunit.client.1.smithi092.stdout:5/602: rename d0/de/d19/d1a/d24/d9b to d0/de/d19/d1a/d1e/d74/dc8 0 2024-09-17T01:52:16.699 INFO:tasks.workunit.client.0.smithi031.stdout:0/944: dwrite d0/d29/f70 [0,4194304] 0 2024-09-17T01:52:16.700 INFO:tasks.workunit.client.1.smithi092.stdout:5/603: read - d0/fbc zero size 2024-09-17T01:52:16.702 INFO:tasks.workunit.client.0.smithi031.stdout:9/836: write d3/d4/da0/d36/ff0 [243543,67493] 0 2024-09-17T01:52:16.702 INFO:tasks.workunit.client.1.smithi092.stdout:2/687: rename d10/d1d/d96/d77/f3e to d10/d4c/d80/d95/fe5 0 2024-09-17T01:52:16.703 INFO:tasks.workunit.client.1.smithi092.stdout:5/604: write d0/de/d19/f92 [2679612,127636] 0 2024-09-17T01:52:16.704 INFO:tasks.workunit.client.0.smithi031.stdout:0/945: creat d0/d29/d33/d5/d48/d56/dc8/d12f/d132/f14a x:0 0 0 2024-09-17T01:52:16.705 INFO:tasks.workunit.client.1.smithi092.stdout:2/688: mknod d10/d4c/ce6 0 2024-09-17T01:52:16.706 INFO:tasks.workunit.client.1.smithi092.stdout:6/618: truncate d3/f4b 1990344 0 2024-09-17T01:52:16.708 INFO:tasks.workunit.client.1.smithi092.stdout:6/619: dread - d3/d10/d8c/d43/d5e/d73/d8f/da4/faa zero size 2024-09-17T01:52:16.708 INFO:tasks.workunit.client.0.smithi031.stdout:0/946: mkdir d0/d29/d33/d5/d48/df1/d14b 0 2024-09-17T01:52:16.709 INFO:tasks.workunit.client.1.smithi092.stdout:2/689: rmdir d10/db9 39 2024-09-17T01:52:16.709 INFO:tasks.workunit.client.0.smithi031.stdout:3/916: dwrite db/f42 [0,4194304] 0 2024-09-17T01:52:16.710 INFO:tasks.workunit.client.0.smithi031.stdout:0/947: write d0/f11d [398809,120360] 0 2024-09-17T01:52:16.711 INFO:tasks.workunit.client.0.smithi031.stdout:3/917: stat db/df/d1d/fce 0 2024-09-17T01:52:16.712 INFO:tasks.workunit.client.1.smithi092.stdout:5/605: link d0/de/d19/f6b d0/de/d19/d3c/d41/d8d/fc9 0 2024-09-17T01:52:16.713 INFO:tasks.workunit.client.0.smithi031.stdout:9/837: dwrite d3/d4/da0/d36/fa2 [0,4194304] 0 2024-09-17T01:52:16.714 INFO:tasks.workunit.client.1.smithi092.stdout:6/620: mknod d3/d10/d8c/d43/d5e/cbe 0 2024-09-17T01:52:16.714 INFO:tasks.workunit.client.1.smithi092.stdout:9/711: write d0/df/f3c [1152451,93562] 0 2024-09-17T01:52:16.715 INFO:tasks.workunit.client.0.smithi031.stdout:3/918: truncate db/df/dc8/d6a/dc3/ddb/fec 596541 0 2024-09-17T01:52:16.716 INFO:tasks.workunit.client.1.smithi092.stdout:2/690: fdatasync d10/d1d/d24/f43 0 2024-09-17T01:52:16.717 INFO:tasks.workunit.client.1.smithi092.stdout:2/691: chown d10/d55 7141774 1 2024-09-17T01:52:16.717 INFO:tasks.workunit.client.1.smithi092.stdout:6/621: write d3/d10/d8c/d43/d5e/d73/f94 [1137057,104821] 0 2024-09-17T01:52:16.718 INFO:tasks.workunit.client.0.smithi031.stdout:5/866: sync 2024-09-17T01:52:16.719 INFO:tasks.workunit.client.1.smithi092.stdout:2/692: chown d10/d55/f64 220160449 1 2024-09-17T01:52:16.720 INFO:tasks.workunit.client.1.smithi092.stdout:5/606: chown d0/d50/da5 1265464707 1 2024-09-17T01:52:16.723 INFO:tasks.workunit.client.1.smithi092.stdout:5/607: write d0/de/d19/d1a/d1e/d3e/f63 [2627596,106917] 0 2024-09-17T01:52:16.724 INFO:tasks.workunit.client.0.smithi031.stdout:5/867: truncate da/d4b/d6c/fc0 158090 0 2024-09-17T01:52:16.726 INFO:tasks.workunit.client.1.smithi092.stdout:2/693: mkdir d10/d1d/d96/de7 0 2024-09-17T01:52:16.727 INFO:tasks.workunit.client.0.smithi031.stdout:3/919: creat db/df/d1d/d37/f127 x:0 0 0 2024-09-17T01:52:16.728 INFO:tasks.workunit.client.1.smithi092.stdout:9/712: mkdir d0/d7/d21/dd9 0 2024-09-17T01:52:16.729 INFO:tasks.workunit.client.0.smithi031.stdout:5/868: unlink da/d14/dac/dc2/fc5 0 2024-09-17T01:52:16.731 INFO:tasks.workunit.client.1.smithi092.stdout:5/608: creat d0/de/d19/d1a/d24/fca x:0 0 0 2024-09-17T01:52:16.732 INFO:tasks.workunit.client.0.smithi031.stdout:0/948: dread d0/d29/d33/d5/d48/d12c/fca [0,4194304] 0 2024-09-17T01:52:16.734 INFO:tasks.workunit.client.0.smithi031.stdout:3/920: read db/df/d1d/d37/d6c/d6e/dd4/ff6 [1019722,34384] 0 2024-09-17T01:52:16.734 INFO:tasks.workunit.client.0.smithi031.stdout:1/839: dwrite d4/d1e/d3f/d72/d7e/fa9 [0,4194304] 0 2024-09-17T01:52:16.737 INFO:tasks.workunit.client.1.smithi092.stdout:2/694: mknod d10/d4c/d80/dd8/ce8 0 2024-09-17T01:52:16.740 INFO:tasks.workunit.client.1.smithi092.stdout:8/623: write d15/d32/d3b/d78/d9b/da1/f84 [1747269,25641] 0 2024-09-17T01:52:16.741 INFO:tasks.workunit.client.1.smithi092.stdout:7/722: dwrite d3/d6/d13/d21/d2e/f97 [0,4194304] 0 2024-09-17T01:52:16.741 INFO:tasks.workunit.client.0.smithi031.stdout:9/838: dread d3/d4/da0/d71/f9e [0,4194304] 0 2024-09-17T01:52:16.741 INFO:tasks.workunit.client.1.smithi092.stdout:2/695: creat d10/d4c/d80/fe9 x:0 0 0 2024-09-17T01:52:16.742 INFO:tasks.workunit.client.0.smithi031.stdout:5/869: rename da/d14/dac/d82/d92/l11e to da/d42/l133 0 2024-09-17T01:52:16.744 INFO:tasks.workunit.client.0.smithi031.stdout:1/840: creat d4/d1e/d3f/d4d/da5/f119 x:0 0 0 2024-09-17T01:52:16.744 INFO:tasks.workunit.client.0.smithi031.stdout:3/921: truncate db/df/dc8/d6a/d83/de4/d124/f63 561632 0 2024-09-17T01:52:16.745 INFO:tasks.workunit.client.1.smithi092.stdout:1/878: write db/d1d/db5/f6b [77113,109750] 0 2024-09-17T01:52:16.746 INFO:tasks.workunit.client.0.smithi031.stdout:5/870: mknod da/d42/d12/d72/dfe/c134 0 2024-09-17T01:52:16.747 INFO:tasks.workunit.client.1.smithi092.stdout:8/624: chown d15/d25/f30 542 1 2024-09-17T01:52:16.747 INFO:tasks.workunit.client.0.smithi031.stdout:5/871: readlink da/dc/d25/l5e 0 2024-09-17T01:52:16.748 INFO:tasks.workunit.client.1.smithi092.stdout:7/723: mkdir d3/d2b/d84/df3 0 2024-09-17T01:52:16.748 INFO:tasks.workunit.client.1.smithi092.stdout:2/696: mkdir d10/d8d/d8f/dea 0 2024-09-17T01:52:16.749 INFO:tasks.workunit.client.1.smithi092.stdout:7/724: read - d3/db/d98/dce/fda zero size 2024-09-17T01:52:16.750 INFO:tasks.workunit.client.0.smithi031.stdout:1/841: mkdir d4/d1a/d43/d11a 0 2024-09-17T01:52:16.750 INFO:tasks.workunit.client.1.smithi092.stdout:1/879: write db/d1d/d23/f3c [2303576,67821] 0 2024-09-17T01:52:16.752 INFO:tasks.workunit.client.1.smithi092.stdout:7/725: write d3/db/d26/d65/fcd [6163196,39214] 0 2024-09-17T01:52:16.754 INFO:tasks.workunit.client.1.smithi092.stdout:3/696: write d4/d16/d1b/f55 [3548654,35833] 0 2024-09-17T01:52:16.755 INFO:tasks.workunit.client.1.smithi092.stdout:1/880: creat db/d1d/d23/d55/de5/dd3/f116 x:0 0 0 2024-09-17T01:52:16.756 INFO:tasks.workunit.client.0.smithi031.stdout:9/839: link d3/d19/d10e/f78 d3/d4/da0/d36/d99/db3/f113 0 2024-09-17T01:52:16.757 INFO:tasks.workunit.client.1.smithi092.stdout:7/726: creat d3/d2b/d84/da7/ff4 x:0 0 0 2024-09-17T01:52:16.758 INFO:tasks.workunit.client.0.smithi031.stdout:5/872: creat da/d14/dac/dc2/f135 x:0 0 0 2024-09-17T01:52:16.759 INFO:tasks.workunit.client.1.smithi092.stdout:4/836: write d4/d5/d1d/d30/f64 [112471,79554] 0 2024-09-17T01:52:16.759 INFO:tasks.workunit.client.0.smithi031.stdout:1/842: fsync d4/d3d/f5a 0 2024-09-17T01:52:16.760 INFO:tasks.workunit.client.1.smithi092.stdout:1/881: unlink db/d1d/d23/da1/dbf/lca 0 2024-09-17T01:52:16.763 INFO:tasks.workunit.client.1.smithi092.stdout:7/727: write d3/d6/d13/f7d [1979674,38855] 0 2024-09-17T01:52:16.765 INFO:tasks.workunit.client.1.smithi092.stdout:7/728: write d3/d6/fc7 [789791,71684] 0 2024-09-17T01:52:16.766 INFO:tasks.workunit.client.0.smithi031.stdout:9/840: rename d3/d19/d1f/d44 to d3/d4c/d102/d114 0 2024-09-17T01:52:16.767 INFO:tasks.workunit.client.1.smithi092.stdout:1/882: creat db/d1d/d23/da1/dbf/f117 x:0 0 0 2024-09-17T01:52:16.767 INFO:tasks.workunit.client.0.smithi031.stdout:1/843: fdatasync d4/d1e/f42 0 2024-09-17T01:52:16.773 INFO:tasks.workunit.client.1.smithi092.stdout:5/609: dread d0/de/d19/d1a/d24/f4b [4194304,4194304] 0 2024-09-17T01:52:16.774 INFO:tasks.workunit.client.1.smithi092.stdout:3/697: link d4/d13/d2e/c50 d4/d2f/d44/d83/ce8 0 2024-09-17T01:52:16.775 INFO:tasks.workunit.client.0.smithi031.stdout:1/844: creat d4/d1a/d43/d53/dd3/dee/f11b x:0 0 0 2024-09-17T01:52:16.775 INFO:tasks.workunit.client.0.smithi031.stdout:5/873: link da/d14/dac/d82/d92/f94 da/dc/f136 0 2024-09-17T01:52:16.776 INFO:tasks.workunit.client.0.smithi031.stdout:9/841: dwrite d3/d4/da0/d36/d8f/ffe [0,4194304] 0 2024-09-17T01:52:16.777 INFO:tasks.workunit.client.0.smithi031.stdout:5/874: stat da 0 2024-09-17T01:52:16.777 INFO:tasks.workunit.client.0.smithi031.stdout:3/922: dread db/df/dc8/d6a/f76 [0,4194304] 0 2024-09-17T01:52:16.778 INFO:tasks.workunit.client.1.smithi092.stdout:1/883: symlink db/d1d/d4b/df3/l118 0 2024-09-17T01:52:16.778 INFO:tasks.workunit.client.1.smithi092.stdout:3/698: stat d4/d73/d8f/d92/fa0 0 2024-09-17T01:52:16.779 INFO:tasks.workunit.client.0.smithi031.stdout:3/923: chown db/df/dc8/d6a/d83/dcb/f8f 2031213 1 2024-09-17T01:52:16.780 INFO:tasks.workunit.client.1.smithi092.stdout:5/610: mkdir d0/de/d19/d3c/d41/d8d/dcb 0 2024-09-17T01:52:16.781 INFO:tasks.workunit.client.0.smithi031.stdout:3/924: chown db/df/dc8/d6a/d83/de4/d124/f75 27215084 1 2024-09-17T01:52:16.782 INFO:tasks.workunit.client.1.smithi092.stdout:3/699: read d4/d73/d8f/d9e/fbb [4061563,65063] 0 2024-09-17T01:52:16.783 INFO:tasks.workunit.client.0.smithi031.stdout:1/845: dread d4/d1e/d40/d84/fb8 [0,4194304] 0 2024-09-17T01:52:16.783 INFO:tasks.workunit.client.0.smithi031.stdout:5/875: mkdir da/d14/dac/d62/d10d/d127/d137 0 2024-09-17T01:52:16.783 INFO:tasks.workunit.client.0.smithi031.stdout:0/949: dread d0/d29/d33/d2a/d25/f27 [0,4194304] 0 2024-09-17T01:52:16.784 INFO:tasks.workunit.client.0.smithi031.stdout:0/950: fdatasync d0/d29/d33/d5/f98 0 2024-09-17T01:52:16.787 INFO:tasks.workunit.client.1.smithi092.stdout:6/622: dwrite d3/d10/d1f/d21/d1e/d55/f93 [0,4194304] 0 2024-09-17T01:52:16.788 INFO:tasks.workunit.client.0.smithi031.stdout:9/842: symlink d3/d4/da0/d36/d62/dd8/dea/l115 0 2024-09-17T01:52:16.790 INFO:tasks.workunit.client.0.smithi031.stdout:3/925: mkdir db/df/d1d/d128 0 2024-09-17T01:52:16.790 INFO:tasks.workunit.client.1.smithi092.stdout:3/700: chown d4/d13/f63 606684 1 2024-09-17T01:52:16.790 INFO:tasks.workunit.client.1.smithi092.stdout:7/729: dwrite d3/d6/d13/d21/d2e/d6e/fc4 [4194304,4194304] 0 2024-09-17T01:52:16.791 INFO:tasks.workunit.client.1.smithi092.stdout:6/623: chown d3/d10/d1f/l74 2 1 2024-09-17T01:52:16.792 INFO:tasks.workunit.client.0.smithi031.stdout:3/926: truncate db/df/dc8/d6a/d83/de4/d124/f62 4470914 0 2024-09-17T01:52:16.792 INFO:tasks.workunit.client.0.smithi031.stdout:1/846: rename d4/d1a/d2d/f68 to d4/d1e/d3f/d4d/dcd/f11c 0 2024-09-17T01:52:16.795 INFO:tasks.workunit.client.1.smithi092.stdout:2/697: write fd [2169535,89988] 0 2024-09-17T01:52:16.795 INFO:tasks.workunit.client.0.smithi031.stdout:0/951: dread - d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/fe9 zero size 2024-09-17T01:52:16.796 INFO:tasks.workunit.client.1.smithi092.stdout:7/730: write d3/db/d98/dce/fcb [966149,107266] 0 2024-09-17T01:52:16.797 INFO:tasks.workunit.client.0.smithi031.stdout:0/952: dread - d0/d29/da7/d10f/f148 zero size 2024-09-17T01:52:16.797 INFO:tasks.workunit.client.1.smithi092.stdout:9/713: dwrite d0/d7/d12/fd0 [0,4194304] 0 2024-09-17T01:52:16.798 INFO:tasks.workunit.client.1.smithi092.stdout:3/701: chown d4/d20/f26 46029 1 2024-09-17T01:52:16.799 INFO:tasks.workunit.client.0.smithi031.stdout:1/847: chown d4/c6 17813 1 2024-09-17T01:52:16.799 INFO:tasks.workunit.client.1.smithi092.stdout:1/884: rename db/d1d/d23/d55/c7d to db/d6c/db3/c119 0 2024-09-17T01:52:16.803 INFO:tasks.workunit.client.1.smithi092.stdout:6/624: symlink d3/d10/d1f/d21/d1e/lbf 0 2024-09-17T01:52:16.806 INFO:tasks.workunit.client.1.smithi092.stdout:7/731: mknod d3/db/d98/cf5 0 2024-09-17T01:52:16.806 INFO:tasks.workunit.client.1.smithi092.stdout:6/625: read d3/d10/d8c/d43/d5e/f5f [851806,116293] 0 2024-09-17T01:52:16.807 INFO:tasks.workunit.client.0.smithi031.stdout:1/848: dwrite d4/d3d/d65/d78/f7d [0,4194304] 0 2024-09-17T01:52:16.808 INFO:tasks.workunit.client.1.smithi092.stdout:4/837: dwrite d4/d13/d3b/d42/d76/d35/f84 [0,4194304] 0 2024-09-17T01:52:16.808 INFO:tasks.workunit.client.0.smithi031.stdout:2/940: sync 2024-09-17T01:52:16.808 INFO:tasks.workunit.client.0.smithi031.stdout:8/806: sync 2024-09-17T01:52:16.810 INFO:tasks.workunit.client.1.smithi092.stdout:4/838: write d4/d7b/d7d/fbf [73125,33660] 0 2024-09-17T01:52:16.811 INFO:tasks.workunit.client.0.smithi031.stdout:0/953: fdatasync d0/d29/d33/d2a/fcd 0 2024-09-17T01:52:16.811 INFO:tasks.workunit.client.1.smithi092.stdout:1/885: creat db/d6c/db3/dea/f11a x:0 0 0 2024-09-17T01:52:16.812 INFO:tasks.workunit.client.0.smithi031.stdout:8/807: write d0/d5/fab [2897639,125609] 0 2024-09-17T01:52:16.812 INFO:tasks.workunit.client.0.smithi031.stdout:3/927: link db/f88 db/df/d1d/d37/d6c/d96/f129 0 2024-09-17T01:52:16.813 INFO:tasks.workunit.client.0.smithi031.stdout:1/849: read d4/d1e/d5d/dae/ff5 [702478,112999] 0 2024-09-17T01:52:16.813 INFO:tasks.workunit.client.0.smithi031.stdout:9/843: getdents d3/d4/da0/d36/d62 0 2024-09-17T01:52:16.814 INFO:tasks.workunit.client.0.smithi031.stdout:2/941: mkdir d1/d3/df/d11/d30/ddd/d13b 0 2024-09-17T01:52:16.814 INFO:tasks.workunit.client.1.smithi092.stdout:9/714: rename d0/df/d5d/f76 to d0/d7/d12/fda 0 2024-09-17T01:52:16.815 INFO:tasks.workunit.client.0.smithi031.stdout:3/928: chown db/df/d1d/l5b 15 1 2024-09-17T01:52:16.816 INFO:tasks.workunit.client.1.smithi092.stdout:3/702: symlink d4/d13/d2e/d6f/dd2/le9 0 2024-09-17T01:52:16.819 INFO:tasks.workunit.client.1.smithi092.stdout:9/715: readlink d0/df/l53 0 2024-09-17T01:52:16.819 INFO:tasks.workunit.client.0.smithi031.stdout:8/808: truncate d0/d5/da2/faa 75362 0 2024-09-17T01:52:16.821 INFO:tasks.workunit.client.0.smithi031.stdout:1/850: mkdir d4/d1e/d3f/d4d/d11d 0 2024-09-17T01:52:16.822 INFO:tasks.workunit.client.1.smithi092.stdout:9/716: chown d0/d7/d21/f75 1 1 2024-09-17T01:52:16.823 INFO:tasks.workunit.client.1.smithi092.stdout:3/703: write d4/d16/d1b/f47 [14920,55451] 0 2024-09-17T01:52:16.823 INFO:tasks.workunit.client.0.smithi031.stdout:9/844: creat d3/f116 x:0 0 0 2024-09-17T01:52:16.824 INFO:tasks.workunit.client.0.smithi031.stdout:3/929: symlink db/df/d1d/d128/l12a 0 2024-09-17T01:52:16.825 INFO:tasks.workunit.client.1.smithi092.stdout:1/886: dwrite db/d6c/d8b/d109/f113 [0,4194304] 0 2024-09-17T01:52:16.825 INFO:tasks.workunit.client.0.smithi031.stdout:1/851: write d4/d1e/d3f/d72/d7e/da2/fbb [2980706,71359] 0 2024-09-17T01:52:16.826 INFO:tasks.workunit.client.1.smithi092.stdout:9/717: mknod d0/d7/d21/cdb 0 2024-09-17T01:52:16.826 INFO:tasks.workunit.client.1.smithi092.stdout:1/887: write db/d1d/d23/da1/dc3/fe2 [751021,118484] 0 2024-09-17T01:52:16.828 INFO:tasks.workunit.client.0.smithi031.stdout:8/809: mkdir d0/df/dd/d59/df7 0 2024-09-17T01:52:16.829 INFO:tasks.workunit.client.1.smithi092.stdout:3/704: symlink d4/d13/d2e/lea 0 2024-09-17T01:52:16.829 INFO:tasks.workunit.client.1.smithi092.stdout:3/705: stat d4/d20/lb1 0 2024-09-17T01:52:16.830 INFO:tasks.workunit.client.1.smithi092.stdout:9/718: write d0/d7/d12/d86/d93/d96/f41 [4389009,82283] 0 2024-09-17T01:52:16.834 INFO:tasks.workunit.client.0.smithi031.stdout:2/942: link d1/d3/d2d/da6/d107/d135/d21/d98/lf8 d1/d3/df/d18/l13c 0 2024-09-17T01:52:16.835 INFO:tasks.workunit.client.1.smithi092.stdout:3/706: rename d4/d2f/d44/d54/ca5 to d4/d20/d3f/dc0/ceb 0 2024-09-17T01:52:16.836 INFO:tasks.workunit.client.0.smithi031.stdout:8/810: creat d0/df/dd/d77/d78/ff8 x:0 0 0 2024-09-17T01:52:16.836 INFO:tasks.workunit.client.0.smithi031.stdout:3/930: read db/df/dc8/d6a/d83/de4/ff8 [655849,16412] 0 2024-09-17T01:52:16.837 INFO:tasks.workunit.client.1.smithi092.stdout:1/888: getdents db/d6c/d7e/d82/def 0 2024-09-17T01:52:16.837 INFO:tasks.workunit.client.0.smithi031.stdout:8/811: fsync d0/df/dd/d77/d78/f7f 0 2024-09-17T01:52:16.838 INFO:tasks.workunit.client.1.smithi092.stdout:1/889: read db/d6c/d7e/d82/fae [2839093,24828] 0 2024-09-17T01:52:16.839 INFO:tasks.workunit.client.0.smithi031.stdout:3/931: mknod db/d29/c12b 0 2024-09-17T01:52:16.841 INFO:tasks.workunit.client.0.smithi031.stdout:8/812: write d0/fda [61652,38390] 0 2024-09-17T01:52:16.841 INFO:tasks.workunit.client.1.smithi092.stdout:1/890: symlink db/d6c/d7e/l11b 0 2024-09-17T01:52:16.843 INFO:tasks.workunit.client.0.smithi031.stdout:2/943: getdents d1/d3/d2d/da6/d107/d135/d21/d98 0 2024-09-17T01:52:16.844 INFO:tasks.workunit.client.0.smithi031.stdout:7/981: sync 2024-09-17T01:52:16.845 INFO:tasks.workunit.client.0.smithi031.stdout:2/944: write d1/d3/d2d/da6/d107/d135/f39 [394884,84814] 0 2024-09-17T01:52:16.847 INFO:tasks.workunit.client.1.smithi092.stdout:7/732: dread d3/db/d26/d65/fcd [0,4194304] 0 2024-09-17T01:52:16.847 INFO:tasks.workunit.client.1.smithi092.stdout:1/891: dwrite db/d6c/d7e/dd1/f103 [0,4194304] 0 2024-09-17T01:52:16.848 INFO:tasks.workunit.client.1.smithi092.stdout:7/733: fdatasync d3/db/d7b/f81 0 2024-09-17T01:52:16.848 INFO:tasks.workunit.client.0.smithi031.stdout:2/945: mknod d1/d3/d2d/d91/dad/c13d 0 2024-09-17T01:52:16.849 INFO:tasks.workunit.client.1.smithi092.stdout:1/892: chown db/d1d/d23/da1/dbf/l108 8546 1 2024-09-17T01:52:16.850 INFO:tasks.workunit.client.0.smithi031.stdout:7/982: truncate db/d1c/fda 715361 0 2024-09-17T01:52:16.850 INFO:tasks.workunit.client.0.smithi031.stdout:8/813: dread d0/d5/fe6 [0,4194304] 0 2024-09-17T01:52:16.850 INFO:tasks.workunit.client.0.smithi031.stdout:8/814: chown d0/d5/d54/d60/dbb 943214 1 2024-09-17T01:52:16.852 INFO:tasks.workunit.client.1.smithi092.stdout:7/734: creat d3/db/d26/d83/ff6 x:0 0 0 2024-09-17T01:52:16.855 INFO:tasks.workunit.client.1.smithi092.stdout:2/698: write d10/d4c/f8e [4379116,83537] 0 2024-09-17T01:52:16.857 INFO:tasks.workunit.client.1.smithi092.stdout:1/893: dwrite db/d1d/d2e/fcd [4194304,4194304] 0 2024-09-17T01:52:16.858 INFO:tasks.workunit.client.0.smithi031.stdout:8/815: symlink d0/d5/d6c/db0/df2/lf9 0 2024-09-17T01:52:16.859 INFO:tasks.workunit.client.0.smithi031.stdout:2/946: link d1/d3/d2d/db2/f5e d1/d3/d2d/d11c/f13e 0 2024-09-17T01:52:16.859 INFO:tasks.workunit.client.0.smithi031.stdout:7/983: dwrite db/d1c/d41/d69/f70 [0,4194304] 0 2024-09-17T01:52:16.861 INFO:tasks.workunit.client.0.smithi031.stdout:5/876: truncate da/d14/dac/d62/d112/f119 337393 0 2024-09-17T01:52:16.862 INFO:tasks.workunit.client.0.smithi031.stdout:1/852: dread d4/d1a/f25 [0,4194304] 0 2024-09-17T01:52:16.863 INFO:tasks.workunit.client.0.smithi031.stdout:5/877: chown da/dc/lb6 0 1 2024-09-17T01:52:16.866 INFO:tasks.workunit.client.0.smithi031.stdout:5/878: write da/d42/d12/d4a/f71 [579248,63241] 0 2024-09-17T01:52:16.866 INFO:tasks.workunit.client.0.smithi031.stdout:7/984: creat db/d1c/d41/d69/dd6/f13e x:0 0 0 2024-09-17T01:52:16.868 INFO:tasks.workunit.client.0.smithi031.stdout:5/879: readlink da/d4b/d6c/df2/lde 0 2024-09-17T01:52:16.869 INFO:tasks.workunit.client.0.smithi031.stdout:1/853: dread - d4/d1e/d40/daa/fc8 zero size 2024-09-17T01:52:16.870 INFO:tasks.workunit.client.1.smithi092.stdout:6/626: write d3/f44 [4180384,84855] 0 2024-09-17T01:52:16.870 INFO:tasks.workunit.client.0.smithi031.stdout:0/954: write d0/f21 [1866726,10374] 0 2024-09-17T01:52:16.872 INFO:tasks.workunit.client.1.smithi092.stdout:4/839: write d4/d5/d8/d92/ffe [1561962,124723] 0 2024-09-17T01:52:16.872 INFO:tasks.workunit.client.0.smithi031.stdout:0/955: chown d0/d29/d33/d2a/dde/d9b/cb5 38 1 2024-09-17T01:52:16.872 INFO:tasks.workunit.client.1.smithi092.stdout:6/627: stat d3/d10/d8c/d43/d6a/d3d/d72/fbb 0 2024-09-17T01:52:16.873 INFO:tasks.workunit.client.0.smithi031.stdout:0/956: stat d0/d29/d33/d5/dad/f11e 0 2024-09-17T01:52:16.874 INFO:tasks.workunit.client.1.smithi092.stdout:6/628: chown d3/d25/da8/fb1 37 1 2024-09-17T01:52:16.876 INFO:tasks.workunit.client.0.smithi031.stdout:1/854: readlink d4/d1a/d43/d53/la7 0 2024-09-17T01:52:16.876 INFO:tasks.workunit.client.0.smithi031.stdout:2/947: getdents d1 0 2024-09-17T01:52:16.876 INFO:tasks.workunit.client.0.smithi031.stdout:1/855: chown d4/d1e/d5d 1272 1 2024-09-17T01:52:16.877 INFO:tasks.workunit.client.0.smithi031.stdout:7/985: write db/d1c/fec [1910880,96283] 0 2024-09-17T01:52:16.878 INFO:tasks.workunit.client.1.smithi092.stdout:4/840: rename d4/d13/d3b/f6d to d4/d13/d3b/d42/d76/d35/d3e/f112 0 2024-09-17T01:52:16.878 INFO:tasks.workunit.client.0.smithi031.stdout:7/986: fdatasync db/d18/fb7 0 2024-09-17T01:52:16.880 INFO:tasks.workunit.client.0.smithi031.stdout:9/845: write d3/d4/f10a [660132,77552] 0 2024-09-17T01:52:16.882 INFO:tasks.workunit.client.0.smithi031.stdout:9/846: write d3/d19/fa4 [1559983,116113] 0 2024-09-17T01:52:16.882 INFO:tasks.workunit.client.0.smithi031.stdout:2/948: creat d1/d3/d2d/d11c/f13f x:0 0 0 2024-09-17T01:52:16.883 INFO:tasks.workunit.client.1.smithi092.stdout:4/841: creat d4/d13/f113 x:0 0 0 2024-09-17T01:52:16.884 INFO:tasks.workunit.client.1.smithi092.stdout:3/707: dwrite d4/d2f/fa8 [0,4194304] 0 2024-09-17T01:52:16.886 INFO:tasks.workunit.client.0.smithi031.stdout:5/880: creat da/f138 x:0 0 0 2024-09-17T01:52:16.888 INFO:tasks.workunit.client.0.smithi031.stdout:5/881: truncate da/f49 3306188 0 2024-09-17T01:52:16.890 INFO:tasks.workunit.client.0.smithi031.stdout:0/957: getdents d0/d29/d33/d2a/d25/d102/d144 0 2024-09-17T01:52:16.891 INFO:tasks.workunit.client.0.smithi031.stdout:9/847: creat d3/d47/f117 x:0 0 0 2024-09-17T01:52:16.891 INFO:tasks.workunit.client.0.smithi031.stdout:1/856: mknod d4/d1e/d3f/d4d/d11d/c11e 0 2024-09-17T01:52:16.891 INFO:tasks.workunit.client.1.smithi092.stdout:3/708: creat d4/d13/d2e/d5f/fec x:0 0 0 2024-09-17T01:52:16.892 INFO:tasks.workunit.client.0.smithi031.stdout:0/958: stat d0/d29/d33/d5/d48/d12c 0 2024-09-17T01:52:16.892 INFO:tasks.workunit.client.0.smithi031.stdout:5/882: creat da/d4b/f139 x:0 0 0 2024-09-17T01:52:16.893 INFO:tasks.workunit.client.1.smithi092.stdout:7/735: dread d3/db/f5e [0,4194304] 0 2024-09-17T01:52:16.893 INFO:tasks.workunit.client.1.smithi092.stdout:3/709: rmdir d4 39 2024-09-17T01:52:16.893 INFO:tasks.workunit.client.0.smithi031.stdout:2/949: dwrite d1/d3/d45/d4a/fc0 [4194304,4194304] 0 2024-09-17T01:52:16.896 INFO:tasks.workunit.client.1.smithi092.stdout:3/710: write d4/d13/d2e/d43/fcb [918209,83207] 0 2024-09-17T01:52:16.896 INFO:tasks.workunit.client.0.smithi031.stdout:1/857: creat d4/d3d/f11f x:0 0 0 2024-09-17T01:52:16.899 INFO:tasks.workunit.client.0.smithi031.stdout:2/950: mknod d1/d3/d45/d4a/c140 0 2024-09-17T01:52:16.899 INFO:tasks.workunit.client.1.smithi092.stdout:3/711: mknod d4/d20/d9f/dd5/ced 0 2024-09-17T01:52:16.900 INFO:tasks.workunit.client.1.smithi092.stdout:3/712: chown d4/d20/d9f/dd5/ced 128957 1 2024-09-17T01:52:16.902 INFO:tasks.workunit.client.0.smithi031.stdout:1/858: unlink d4/d1e/d3f/d72/d7e/f82 0 2024-09-17T01:52:16.903 INFO:tasks.workunit.client.1.smithi092.stdout:3/713: unlink d4/d16/d1b/c71 0 2024-09-17T01:52:16.903 INFO:tasks.workunit.client.0.smithi031.stdout:9/848: mknod d3/d19/d1f/c118 0 2024-09-17T01:52:16.905 INFO:tasks.workunit.client.1.smithi092.stdout:3/714: truncate d4/d13/d2e/d5f/f62 1827886 0 2024-09-17T01:52:16.906 INFO:tasks.workunit.client.0.smithi031.stdout:1/859: unlink d4/d1e/d5d/dae/f9c 0 2024-09-17T01:52:16.906 INFO:tasks.workunit.client.1.smithi092.stdout:2/699: truncate d10/d1d/d2c/f42 825016 0 2024-09-17T01:52:16.906 INFO:tasks.workunit.client.0.smithi031.stdout:3/932: write db/d29/f4e [1533224,15812] 0 2024-09-17T01:52:16.907 INFO:tasks.workunit.client.0.smithi031.stdout:9/849: readlink d3/d4/da0/d36/d79/l83 0 2024-09-17T01:52:16.909 INFO:tasks.workunit.client.0.smithi031.stdout:2/951: rename d1/d3/d2d/da6/d107/d135/d21/d34/c72 to d1/d3/df/d11/d30/ddd/de3/c141 0 2024-09-17T01:52:16.909 INFO:tasks.workunit.client.1.smithi092.stdout:3/715: creat d4/d73/fee x:0 0 0 2024-09-17T01:52:16.909 INFO:tasks.workunit.client.1.smithi092.stdout:6/629: dread d3/d10/d8c/d43/d6a/f50 [0,4194304] 0 2024-09-17T01:52:16.911 INFO:tasks.workunit.client.1.smithi092.stdout:4/842: getdents d4/d13/d3b 0 2024-09-17T01:52:16.913 INFO:tasks.workunit.client.1.smithi092.stdout:7/736: truncate d3/db/d26/f66 382267 0 2024-09-17T01:52:16.913 INFO:tasks.workunit.client.0.smithi031.stdout:3/933: rename db/df/d1d/d37/f3f to db/df/d1d/d37/d77/de3/f12c 0 2024-09-17T01:52:16.914 INFO:tasks.workunit.client.1.smithi092.stdout:9/719: dwrite d0/d7/d12/fda [0,4194304] 0 2024-09-17T01:52:16.915 INFO:tasks.workunit.client.0.smithi031.stdout:2/952: unlink d1/d3/d2d/da6/d107/d135/d2a/l2e 0 2024-09-17T01:52:16.918 INFO:tasks.workunit.client.1.smithi092.stdout:7/737: creat d3/db/d98/dce/d6a/ff7 x:0 0 0 2024-09-17T01:52:16.919 INFO:tasks.workunit.client.1.smithi092.stdout:6/630: mknod d3/d10/d1f/d21/d28/d2b/cc0 0 2024-09-17T01:52:16.920 INFO:tasks.workunit.client.0.smithi031.stdout:3/934: creat db/df/d1d/d37/d77/de3/f12d x:0 0 0 2024-09-17T01:52:16.922 INFO:tasks.workunit.client.0.smithi031.stdout:2/953: fdatasync d1/d3/d2d/da6/d107/d135/d21/fd5 0 2024-09-17T01:52:16.923 INFO:tasks.workunit.client.0.smithi031.stdout:1/860: creat d4/d3d/d65/f120 x:0 0 0 2024-09-17T01:52:16.924 INFO:tasks.workunit.client.0.smithi031.stdout:8/816: dwrite d0/d5/d6c/d6d/f8f [0,4194304] 0 2024-09-17T01:52:16.926 INFO:tasks.workunit.client.1.smithi092.stdout:4/843: link d4/laa d4/d13/d3b/d42/d76/d35/l114 0 2024-09-17T01:52:16.927 INFO:tasks.workunit.client.0.smithi031.stdout:8/817: fsync d0/d5/d9b/f5c 0 2024-09-17T01:52:16.929 INFO:tasks.workunit.client.1.smithi092.stdout:6/631: symlink d3/d10/d1f/d21/lc1 0 2024-09-17T01:52:16.932 INFO:tasks.workunit.client.0.smithi031.stdout:7/987: dwrite db/d18/d67/fa1 [0,4194304] 0 2024-09-17T01:52:16.933 INFO:tasks.workunit.client.1.smithi092.stdout:7/738: link d3/d6/da1/fc6 d3/db/d26/d65/ff8 0 2024-09-17T01:52:16.933 INFO:tasks.workunit.client.0.smithi031.stdout:2/954: creat d1/d3/d2d/da6/d107/d135/d21/d98/f142 x:0 0 0 2024-09-17T01:52:16.934 INFO:tasks.workunit.client.1.smithi092.stdout:4/844: read d4/d5/d1d/d30/f64 [403700,23662] 0 2024-09-17T01:52:16.935 INFO:tasks.workunit.client.0.smithi031.stdout:0/959: write d0/d29/da7/db3/d4a/d86/dd7/dac/dd0/fe9 [842326,52410] 0 2024-09-17T01:52:16.936 INFO:tasks.workunit.client.1.smithi092.stdout:6/632: read d3/d10/d1f/d21/d28/d2b/f2e [598433,98373] 0 2024-09-17T01:52:16.937 INFO:tasks.workunit.client.1.smithi092.stdout:6/633: fsync d3/d70/f8a 0 2024-09-17T01:52:16.938 INFO:tasks.workunit.client.1.smithi092.stdout:3/716: dwrite d4/d20/d9f/dd5/fdc [0,4194304] 0 2024-09-17T01:52:16.939 INFO:tasks.workunit.client.0.smithi031.stdout:5/883: dwrite da/ded/ff9 [0,4194304] 0 2024-09-17T01:52:16.942 INFO:tasks.workunit.client.1.smithi092.stdout:7/739: rmdir d3/db/d26/d83 39 2024-09-17T01:52:16.943 INFO:tasks.workunit.client.0.smithi031.stdout:0/960: dread - d0/d29/d33/d5/d48/d12c/f131 zero size 2024-09-17T01:52:16.944 INFO:tasks.workunit.client.0.smithi031.stdout:7/988: readlink db/d18/d67/dac/ddd/dc1/l106 0 2024-09-17T01:52:16.945 INFO:tasks.workunit.client.0.smithi031.stdout:2/955: fsync d1/d3/d45/f6b 0 2024-09-17T01:52:16.946 INFO:tasks.workunit.client.0.smithi031.stdout:9/850: write d3/d19/d10e/f78 [5056250,106286] 0 2024-09-17T01:52:16.948 INFO:tasks.workunit.client.0.smithi031.stdout:8/818: mknod d0/d5/cfa 0 2024-09-17T01:52:16.948 INFO:tasks.workunit.client.1.smithi092.stdout:7/740: dread - d3/d6/d13/d21/d2e/faa zero size 2024-09-17T01:52:16.948 INFO:tasks.workunit.client.0.smithi031.stdout:2/956: readlink d1/d3/d2d/da6/d107/d135/d21/d34/lc7 0 2024-09-17T01:52:16.951 INFO:tasks.workunit.client.0.smithi031.stdout:2/957: fdatasync d1/d3/d2d/da6/d107/d135/f114 0 2024-09-17T01:52:16.951 INFO:tasks.workunit.client.0.smithi031.stdout:1/861: getdents d4/d3d/d65/d78 0 2024-09-17T01:52:16.952 INFO:tasks.workunit.client.1.smithi092.stdout:6/634: creat d3/d10/d1f/d21/d28/d2b/fc2 x:0 0 0 2024-09-17T01:52:16.952 INFO:tasks.workunit.client.1.smithi092.stdout:4/845: link d4/d5/l2a d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3/l115 0 2024-09-17T01:52:16.954 INFO:tasks.workunit.client.1.smithi092.stdout:9/720: dread d0/d7/f77 [0,4194304] 0 2024-09-17T01:52:16.955 INFO:tasks.workunit.client.1.smithi092.stdout:7/741: mkdir d3/d6/dc2/ddc/df9 0 2024-09-17T01:52:16.956 INFO:tasks.workunit.client.1.smithi092.stdout:6/635: dread - d3/d10/d8c/d43/d5e/d73/d8f/da4/faa zero size 2024-09-17T01:52:16.956 INFO:tasks.workunit.client.0.smithi031.stdout:0/961: creat d0/d37/db9/f14c x:0 0 0 2024-09-17T01:52:16.957 INFO:tasks.workunit.client.1.smithi092.stdout:9/721: chown d0/d7c/dbd/fd6 59056927 1 2024-09-17T01:52:16.958 INFO:tasks.workunit.client.0.smithi031.stdout:7/989: chown db/l17 1 1 2024-09-17T01:52:16.959 INFO:tasks.workunit.client.1.smithi092.stdout:4/846: rename d4/d13/fde to d4/d13/d3b/d42/d76/d35/d3e/d7c/f116 0 2024-09-17T01:52:16.960 INFO:tasks.workunit.client.0.smithi031.stdout:9/851: mkdir d3/d4/d41/d119 0 2024-09-17T01:52:16.960 INFO:tasks.workunit.client.0.smithi031.stdout:8/819: dwrite d0/d5/d6c/d6d/f72 [0,4194304] 0 2024-09-17T01:52:16.961 INFO:tasks.workunit.client.1.smithi092.stdout:7/742: rmdir d3/d6/d13/d21/d2e/d6e 39 2024-09-17T01:52:16.965 INFO:tasks.workunit.client.0.smithi031.stdout:2/958: creat d1/d3/d45/f143 x:0 0 0 2024-09-17T01:52:16.966 INFO:tasks.workunit.client.0.smithi031.stdout:1/862: chown d4/d1e/d3f/cb0 11136053 1 2024-09-17T01:52:16.968 INFO:tasks.workunit.client.0.smithi031.stdout:7/990: write db/d1c/d46/f60 [44836,72276] 0 2024-09-17T01:52:16.969 INFO:tasks.workunit.client.1.smithi092.stdout:6/636: rename d3/d70/f77 to d3/d10/d8c/d43/d5e/d73/d8f/da4/fc3 0 2024-09-17T01:52:16.969 INFO:tasks.workunit.client.1.smithi092.stdout:4/847: read - d4/f94 zero size 2024-09-17T01:52:16.970 INFO:tasks.workunit.client.1.smithi092.stdout:6/637: dread - d3/d10/d1f/d21/d28/fbd zero size 2024-09-17T01:52:16.971 INFO:tasks.workunit.client.1.smithi092.stdout:4/848: write d4/d5/fa2 [1996900,68058] 0 2024-09-17T01:52:16.973 INFO:tasks.workunit.client.0.smithi031.stdout:2/959: creat d1/d3/df/d11/d30/da1/f144 x:0 0 0 2024-09-17T01:52:16.973 INFO:tasks.workunit.client.1.smithi092.stdout:7/743: unlink d3/d2b/d84/da7/ff4 0 2024-09-17T01:52:16.973 INFO:tasks.workunit.client.0.smithi031.stdout:1/863: mkdir d4/d1e/d3f/d72/d7e/da2/d121 0 2024-09-17T01:52:16.974 INFO:tasks.workunit.client.0.smithi031.stdout:7/991: symlink db/d1c/d8e/l13f 0 2024-09-17T01:52:16.975 INFO:tasks.workunit.client.1.smithi092.stdout:7/744: write d3/fc [9366255,14484] 0 2024-09-17T01:52:16.975 INFO:tasks.workunit.client.0.smithi031.stdout:9/852: symlink d3/d4/da0/l11a 0 2024-09-17T01:52:16.976 INFO:tasks.workunit.client.0.smithi031.stdout:8/820: creat d0/d5/d54/ffb x:0 0 0 2024-09-17T01:52:16.977 INFO:tasks.workunit.client.0.smithi031.stdout:5/884: dwrite da/dc/f73 [0,4194304] 0 2024-09-17T01:52:16.977 INFO:tasks.workunit.client.0.smithi031.stdout:1/864: write d4/d3d/d65/f75 [1476713,114450] 0 2024-09-17T01:52:16.978 INFO:tasks.workunit.client.1.smithi092.stdout:6/638: dwrite d3/d10/f57 [0,4194304] 0 2024-09-17T01:52:16.980 INFO:tasks.workunit.client.1.smithi092.stdout:4/849: symlink d4/d5/d1d/d30/d3f/l117 0 2024-09-17T01:52:16.983 INFO:tasks.workunit.client.1.smithi092.stdout:3/717: mknod d4/d13/d2e/d43/cef 0 2024-09-17T01:52:16.985 INFO:tasks.workunit.client.0.smithi031.stdout:1/865: creat d4/d1a/d43/d53/f122 x:0 0 0 2024-09-17T01:52:16.985 INFO:tasks.workunit.client.1.smithi092.stdout:6/639: rmdir d3/d10/d1f/d21/da5 39 2024-09-17T01:52:16.988 INFO:tasks.workunit.client.0.smithi031.stdout:7/992: rename db/d1c/d46/d95/da6/f11e to db/d1c/d8e/f140 0 2024-09-17T01:52:16.989 INFO:tasks.workunit.client.1.smithi092.stdout:3/718: rmdir d4/d73/dba 39 2024-09-17T01:52:16.993 INFO:tasks.workunit.client.1.smithi092.stdout:6/640: truncate d3/d10/f6f 1095274 0 2024-09-17T01:52:16.993 INFO:tasks.workunit.client.1.smithi092.stdout:9/722: write d0/d7/f77 [1160221,107454] 0 2024-09-17T01:52:16.994 INFO:tasks.workunit.client.0.smithi031.stdout:5/885: symlink da/d42/l13a 0 2024-09-17T01:52:16.994 INFO:tasks.workunit.client.1.smithi092.stdout:6/641: fsync d3/d8e/fb2 0 2024-09-17T01:52:16.994 INFO:tasks.workunit.client.0.smithi031.stdout:1/866: dwrite d4/d1e/d3f/d4d/da5/ffa [0,4194304] 0 2024-09-17T01:52:16.996 INFO:tasks.workunit.client.1.smithi092.stdout:3/719: write d4/d73/dba/fb6 [521253,46677] 0 2024-09-17T01:52:16.997 INFO:tasks.workunit.client.1.smithi092.stdout:4/850: creat d4/d5/f118 x:0 0 0 2024-09-17T01:52:16.997 INFO:tasks.workunit.client.1.smithi092.stdout:6/642: symlink d3/d70/lc4 0 2024-09-17T01:52:16.998 INFO:tasks.workunit.client.0.smithi031.stdout:2/960: write d1/d3/df/d11/f26 [671353,52545] 0 2024-09-17T01:52:17.001 INFO:tasks.workunit.client.0.smithi031.stdout:9/853: write d3/d4c/f4f [3491037,124837] 0 2024-09-17T01:52:17.001 INFO:tasks.workunit.client.0.smithi031.stdout:0/962: dwrite d0/d29/d33/d5b/f9e [0,4194304] 0 2024-09-17T01:52:17.003 INFO:tasks.workunit.client.0.smithi031.stdout:5/886: rename da/d14/dac/d82/ddd/c108 to da/d14/dac/d62/d112/c13b 0 2024-09-17T01:52:17.003 INFO:tasks.workunit.client.1.smithi092.stdout:9/723: link d0/d7/d12/d34/l2b d0/d5/d3e/daa/ldc 0 2024-09-17T01:52:17.004 INFO:tasks.workunit.client.0.smithi031.stdout:5/887: readlink da/d42/d12/d4a/l7e 0 2024-09-17T01:52:17.006 INFO:tasks.workunit.client.0.smithi031.stdout:5/888: readlink da/d4b/d6c/df2/lde 0 2024-09-17T01:52:17.008 INFO:tasks.workunit.client.0.smithi031.stdout:9/854: mknod d3/d4/da0/d36/c11b 0 2024-09-17T01:52:17.009 INFO:tasks.workunit.client.1.smithi092.stdout:3/720: rename d4/d2f/d44/d3c/dd0 to d4/d16/df0 0 2024-09-17T01:52:17.009 INFO:tasks.workunit.client.0.smithi031.stdout:9/855: read d3/d19/f22 [8805351,99015] 0 2024-09-17T01:52:17.010 INFO:tasks.workunit.client.1.smithi092.stdout:6/643: getdents d3/d10/d8c/d49 0 2024-09-17T01:52:17.011 INFO:tasks.workunit.client.1.smithi092.stdout:3/721: write d4/d16/f48 [3498916,103002] 0 2024-09-17T01:52:17.012 INFO:tasks.workunit.client.0.smithi031.stdout:7/993: getdents db/d1c/d41/d6c/da0/dd4 0 2024-09-17T01:52:17.012 INFO:tasks.workunit.client.1.smithi092.stdout:6/644: truncate d3/d10/d8c/d49/fb3 689057 0 2024-09-17T01:52:17.013 INFO:tasks.workunit.client.0.smithi031.stdout:7/994: chown db/d1c/de2 995 1 2024-09-17T01:52:17.015 INFO:tasks.workunit.client.1.smithi092.stdout:3/722: unlink d4/d2f/d44/d54/cb8 0 2024-09-17T01:52:17.016 INFO:tasks.workunit.client.0.smithi031.stdout:8/821: dwrite d0/f74 [0,4194304] 0 2024-09-17T01:52:17.018 INFO:tasks.workunit.client.0.smithi031.stdout:8/822: write d0/fe3 [843456,51956] 0 2024-09-17T01:52:17.019 INFO:tasks.workunit.client.0.smithi031.stdout:1/867: link d4/d1e/d40/d84/fc1 d4/d1e/d40/daa/dce/d114/f123 0 2024-09-17T01:52:17.019 INFO:tasks.workunit.client.1.smithi092.stdout:7/745: dread d3/db/d26/d83/fd5 [0,4194304] 0 2024-09-17T01:52:17.020 INFO:tasks.workunit.client.1.smithi092.stdout:3/723: symlink d4/d20/d39/d70/d95/da3/lf1 0 2024-09-17T01:52:17.020 INFO:tasks.workunit.client.0.smithi031.stdout:1/868: readlink d4/d1e/d3f/d72/d7e/da2/la3 0 2024-09-17T01:52:17.021 INFO:tasks.workunit.client.0.smithi031.stdout:9/856: mknod d3/d4/d41/d70/c11c 0 2024-09-17T01:52:17.023 INFO:tasks.workunit.client.1.smithi092.stdout:3/724: creat d4/d2f/d44/d54/ff2 x:0 0 0 2024-09-17T01:52:17.024 INFO:tasks.workunit.client.0.smithi031.stdout:8/823: unlink d0/df/db6/fe8 0 2024-09-17T01:52:17.025 INFO:tasks.workunit.client.1.smithi092.stdout:3/725: chown d4/d13/f1d 1591617125 1 2024-09-17T01:52:17.026 INFO:tasks.workunit.client.0.smithi031.stdout:7/995: rename db/f51 to db/d18/d67/dac/ddd/dc1/f141 0 2024-09-17T01:52:17.028 INFO:tasks.workunit.client.1.smithi092.stdout:3/726: dread d4/d73/d8f/d92/fa0 [0,4194304] 0 2024-09-17T01:52:17.029 INFO:tasks.workunit.client.1.smithi092.stdout:3/727: chown d4/d73/d8f 1730 1 2024-09-17T01:52:17.029 INFO:tasks.workunit.client.0.smithi031.stdout:0/963: write d0/d37/fb7 [200519,17373] 0 2024-09-17T01:52:17.030 INFO:tasks.workunit.client.1.smithi092.stdout:7/746: link d3/d2b/d84/fab d3/db/d26/d83/ffa 0 2024-09-17T01:52:17.031 INFO:tasks.workunit.client.0.smithi031.stdout:9/857: symlink d3/de1/l11d 0 2024-09-17T01:52:17.032 INFO:tasks.workunit.client.1.smithi092.stdout:3/728: dread d4/d13/f8b [0,4194304] 0 2024-09-17T01:52:17.034 INFO:tasks.workunit.client.0.smithi031.stdout:2/961: write d1/d3/f4 [703545,26804] 0 2024-09-17T01:52:17.036 INFO:tasks.workunit.client.0.smithi031.stdout:1/869: dread d4/d1e/f42 [0,4194304] 0 2024-09-17T01:52:17.036 INFO:tasks.workunit.client.1.smithi092.stdout:7/747: rmdir d3/db/d26/d83/da6 39 2024-09-17T01:52:17.038 INFO:tasks.workunit.client.0.smithi031.stdout:7/996: symlink db/d1c/d41/d6c/da0/dd4/d109/l142 0 2024-09-17T01:52:17.038 INFO:tasks.workunit.client.0.smithi031.stdout:1/870: stat d4/c93 0 2024-09-17T01:52:17.039 INFO:tasks.workunit.client.1.smithi092.stdout:4/851: unlink d4/d5/d1d/d30/d3f/d4b/c74 0 2024-09-17T01:52:17.041 INFO:tasks.workunit.client.0.smithi031.stdout:2/962: creat d1/d3/df/d18/d40/dc1/f145 x:0 0 0 2024-09-17T01:52:17.042 INFO:tasks.workunit.client.1.smithi092.stdout:9/724: dwrite d0/df/d17/f51 [0,4194304] 0 2024-09-17T01:52:17.043 INFO:tasks.workunit.client.1.smithi092.stdout:3/729: write d4/d13/d2e/d43/fcd [299318,31308] 0 2024-09-17T01:52:17.044 INFO:tasks.workunit.client.1.smithi092.stdout:6/645: write d3/d10/d8c/d43/d6a/d3d/f88 [2631654,74433] 0 2024-09-17T01:52:17.044 INFO:tasks.workunit.client.1.smithi092.stdout:3/730: fdatasync d4/d20/d3f/fc9 0 2024-09-17T01:52:17.045 INFO:tasks.workunit.client.0.smithi031.stdout:9/858: dwrite d3/d4/da0/d36/d79/f100 [0,4194304] 0 2024-09-17T01:52:17.045 INFO:tasks.workunit.client.0.smithi031.stdout:7/997: rmdir db/d1c/d41/d6c/da0/dd4/d109 39 2024-09-17T01:52:17.045 INFO:tasks.workunit.client.1.smithi092.stdout:4/852: truncate d4/d13/d3b/d42/d76/fd1 3108408 0 2024-09-17T01:52:17.046 INFO:tasks.workunit.client.1.smithi092.stdout:6/646: fsync d3/d10/d8c/d49/f75 0 2024-09-17T01:52:17.046 INFO:tasks.workunit.client.1.smithi092.stdout:3/731: write d4/f30 [6082199,124967] 0 2024-09-17T01:52:17.047 INFO:tasks.workunit.client.1.smithi092.stdout:9/725: write d0/d7/d12/d34/d26/d54/d6b/f92 [181587,110699] 0 2024-09-17T01:52:17.049 INFO:tasks.workunit.client.1.smithi092.stdout:3/732: write d4/d16/d1b/fbd [395617,83506] 0 2024-09-17T01:52:17.051 INFO:tasks.workunit.client.1.smithi092.stdout:3/733: write d4/d13/d2e/d43/fcd [845387,804] 0 2024-09-17T01:52:17.055 INFO:tasks.workunit.client.0.smithi031.stdout:9/859: mknod d3/d47/c11e 0 2024-09-17T01:52:17.056 INFO:tasks.workunit.client.1.smithi092.stdout:4/853: rmdir d4/d13/d3b/d42/d76/d35/d3e/d7c 39 2024-09-17T01:52:17.057 INFO:tasks.workunit.client.1.smithi092.stdout:9/726: mkdir d0/d7c/dbd/ddd 0 2024-09-17T01:52:17.059 INFO:tasks.workunit.client.1.smithi092.stdout:7/748: getdents d3/db/d26/d83 0 2024-09-17T01:52:17.059 INFO:tasks.workunit.client.0.smithi031.stdout:9/860: write d3/d19/db5/fd6 [296420,65456] 0 2024-09-17T01:52:17.060 INFO:tasks.workunit.client.0.smithi031.stdout:7/998: dwrite db/d29/d10a/f10b [0,4194304] 0 2024-09-17T01:52:17.064 INFO:tasks.workunit.client.1.smithi092.stdout:9/727: creat d0/d7/d12/fde x:0 0 0 2024-09-17T01:52:17.064 INFO:tasks.workunit.client.1.smithi092.stdout:6/647: dwrite d3/d10/d1f/d21/da5/d18/f6b [0,4194304] 0 2024-09-17T01:52:17.064 INFO:tasks.workunit.client.0.smithi031.stdout:0/964: write d0/d29/d33/d2a/d25/fe6 [48951,74739] 0 2024-09-17T01:52:17.065 INFO:tasks.workunit.client.0.smithi031.stdout:7/999: fsync db/d1c/fa2 0 2024-09-17T01:52:17.066 INFO:tasks.workunit.client.1.smithi092.stdout:6/648: write d3/d10/d1f/f32 [4480181,118367] 0 2024-09-17T01:52:17.067 INFO:tasks.workunit.client.1.smithi092.stdout:7/749: dread d3/d6/dc2/ddc/fee [0,4194304] 0 2024-09-17T01:52:17.068 INFO:tasks.workunit.client.1.smithi092.stdout:9/728: unlink d0/d5/d29/l39 0 2024-09-17T01:52:17.071 INFO:tasks.workunit.client.0.smithi031.stdout:8/824: dwrite d0/df/d19/fba [0,4194304] 0 2024-09-17T01:52:17.072 INFO:tasks.workunit.client.1.smithi092.stdout:6/649: symlink d3/d10/d8c/d43/d6a/lc5 0 2024-09-17T01:52:17.073 INFO:tasks.workunit.client.0.smithi031.stdout:9/861: symlink d3/d4/da0/d36/d99/db3/l11f 0 2024-09-17T01:52:17.074 INFO:tasks.workunit.client.0.smithi031.stdout:0/965: truncate d0/d29/d33/d2a/f1e 183719 0 2024-09-17T01:52:17.075 INFO:tasks.workunit.client.1.smithi092.stdout:6/650: creat d3/d10/d8c/d49/d7e/fc6 x:0 0 0 2024-09-17T01:52:17.077 INFO:tasks.workunit.client.0.smithi031.stdout:2/963: write d1/d3/d2d/db2/f5e [69553,60724] 0 2024-09-17T01:52:17.079 INFO:tasks.workunit.client.0.smithi031.stdout:9/862: read d3/d4/da0/d36/d79/f100 [2496661,79742] 0 2024-09-17T01:52:17.080 INFO:tasks.workunit.client.1.smithi092.stdout:9/729: link d0/d7/d12/d34/f72 d0/df/d17/fdf 0 2024-09-17T01:52:17.081 INFO:tasks.workunit.client.1.smithi092.stdout:9/730: dread - d0/d7c/da9/fc2 zero size 2024-09-17T01:52:17.081 INFO:tasks.workunit.client.0.smithi031.stdout:0/966: mknod d0/d29/d33/d5/d48/d56/c14d 0 2024-09-17T01:52:17.082 INFO:tasks.workunit.client.1.smithi092.stdout:9/731: truncate d0/f32 4652637 0 2024-09-17T01:52:17.085 INFO:tasks.workunit.client.1.smithi092.stdout:3/734: write d4/d20/f42 [563683,63695] 0 2024-09-17T01:52:17.086 INFO:tasks.workunit.client.0.smithi031.stdout:2/964: truncate d1/d3/d2d/d91/ff4 893695 0 2024-09-17T01:52:17.086 INFO:tasks.workunit.client.1.smithi092.stdout:4/854: write d4/f94 [747917,7170] 0 2024-09-17T01:52:17.090 INFO:tasks.workunit.client.1.smithi092.stdout:4/855: mkdir d4/d5/d1d/d30/d3f/d4b/dff/d119 0 2024-09-17T01:52:17.092 INFO:tasks.workunit.client.0.smithi031.stdout:1/871: dread d4/f4a [0,4194304] 0 2024-09-17T01:52:17.092 INFO:tasks.workunit.client.1.smithi092.stdout:7/750: write d3/db/d26/d83/f96 [972904,118638] 0 2024-09-17T01:52:17.093 INFO:tasks.workunit.client.0.smithi031.stdout:9/863: dwrite d3/d47/d96/fcc [0,4194304] 0 2024-09-17T01:52:17.094 INFO:tasks.workunit.client.0.smithi031.stdout:2/965: fsync d1/d3/df/d11/d30/ddd/de3/f128 0 2024-09-17T01:52:17.094 INFO:tasks.workunit.client.1.smithi092.stdout:4/856: mknod d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3/c11a 0 2024-09-17T01:52:17.095 INFO:tasks.workunit.client.0.smithi031.stdout:0/967: getdents d0/d29/d33/d84 0 2024-09-17T01:52:17.096 INFO:tasks.workunit.client.0.smithi031.stdout:9/864: dread - d3/f116 zero size 2024-09-17T01:52:17.096 INFO:tasks.workunit.client.0.smithi031.stdout:2/966: chown d1/d3/d2d/d71/c11e 9319184 1 2024-09-17T01:52:17.097 INFO:tasks.workunit.client.0.smithi031.stdout:9/865: read d3/d47/ffa [5519255,106215] 0 2024-09-17T01:52:17.097 INFO:tasks.workunit.client.1.smithi092.stdout:7/751: mkdir d3/db/d98/dce/d60/d93/dfb 0 2024-09-17T01:52:17.097 INFO:tasks.workunit.client.0.smithi031.stdout:1/872: stat d4/d1a/c56 0 2024-09-17T01:52:17.098 INFO:tasks.workunit.client.0.smithi031.stdout:0/968: chown d0/d29/d33/d2a/f39 7 1 2024-09-17T01:52:17.098 INFO:tasks.workunit.client.1.smithi092.stdout:7/752: chown d3/db/d26/d83/f96 0 1 2024-09-17T01:52:17.100 INFO:tasks.workunit.client.1.smithi092.stdout:6/651: dread f2 [0,4194304] 0 2024-09-17T01:52:17.102 INFO:tasks.workunit.client.1.smithi092.stdout:7/753: fdatasync d3/db/d26/d83/ffa 0 2024-09-17T01:52:17.104 INFO:tasks.workunit.client.1.smithi092.stdout:6/652: dread d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:17.106 INFO:tasks.workunit.client.0.smithi031.stdout:2/967: mkdir d1/d12e/d146 0 2024-09-17T01:52:17.107 INFO:tasks.workunit.client.1.smithi092.stdout:6/653: creat d3/d10/d1f/d21/d28/fc7 x:0 0 0 2024-09-17T01:52:17.107 INFO:tasks.workunit.client.0.smithi031.stdout:2/968: stat d1/d3/d2d/da6/de9 0 2024-09-17T01:52:17.110 INFO:tasks.workunit.client.1.smithi092.stdout:6/654: read d3/d25/f9c [4821129,8745] 0 2024-09-17T01:52:17.111 INFO:tasks.workunit.client.1.smithi092.stdout:6/655: symlink d3/d70/lc8 0 2024-09-17T01:52:17.114 INFO:tasks.workunit.client.1.smithi092.stdout:6/656: truncate d3/d10/d1f/f30 45739 0 2024-09-17T01:52:17.115 INFO:tasks.workunit.client.0.smithi031.stdout:8/825: write d0/d5/d54/f8c [1039303,13733] 0 2024-09-17T01:52:17.115 INFO:tasks.workunit.client.1.smithi092.stdout:6/657: chown d3/d25/f9c 7938 1 2024-09-17T01:52:17.121 INFO:tasks.workunit.client.1.smithi092.stdout:6/658: dwrite d3/d10/d8c/d43/faf [0,4194304] 0 2024-09-17T01:52:17.122 INFO:tasks.workunit.client.1.smithi092.stdout:6/659: dread - d3/d10/d8c/d49/d7e/fc6 zero size 2024-09-17T01:52:17.124 INFO:tasks.workunit.client.1.smithi092.stdout:3/735: write d4/d2f/d44/fae [667291,53116] 0 2024-09-17T01:52:17.125 INFO:tasks.workunit.client.1.smithi092.stdout:6/660: chown d3/d10/d8c/d43/fb7 10283706 1 2024-09-17T01:52:17.128 INFO:tasks.workunit.client.1.smithi092.stdout:6/661: creat d3/d10/d1f/d21/da5/d18/fc9 x:0 0 0 2024-09-17T01:52:17.134 INFO:tasks.workunit.client.1.smithi092.stdout:4/857: dwrite d4/d13/d3b/d42/d76/d35/f39 [0,4194304] 0 2024-09-17T01:52:17.135 INFO:tasks.workunit.client.1.smithi092.stdout:7/754: dread d3/db/d98/dce/f55 [0,4194304] 0 2024-09-17T01:52:17.135 INFO:tasks.workunit.client.1.smithi092.stdout:3/736: read d4/d20/d39/d70/fca [4123286,109000] 0 2024-09-17T01:52:17.136 INFO:tasks.workunit.client.1.smithi092.stdout:4/858: stat d4/d7b/dc8/f10e 0 2024-09-17T01:52:17.142 INFO:tasks.workunit.client.1.smithi092.stdout:3/737: fdatasync d4/d16/d1b/fbd 0 2024-09-17T01:52:17.146 INFO:tasks.workunit.client.1.smithi092.stdout:6/662: dwrite d3/f44 [0,4194304] 0 2024-09-17T01:52:17.147 INFO:tasks.workunit.client.1.smithi092.stdout:3/738: write d4/f28 [3398928,117405] 0 2024-09-17T01:52:17.147 INFO:tasks.workunit.client.1.smithi092.stdout:7/755: dwrite d3/db/db2/fbf [0,4194304] 0 2024-09-17T01:52:17.155 INFO:tasks.workunit.client.1.smithi092.stdout:3/739: unlink d4/d20/d3f/dc0/ceb 0 2024-09-17T01:52:17.157 INFO:tasks.workunit.client.1.smithi092.stdout:6/663: dwrite d3/d10/d1f/f32 [0,4194304] 0 2024-09-17T01:52:17.158 INFO:tasks.workunit.client.0.smithi031.stdout:1/873: creat d4/d1e/d3f/d72/d7e/da2/f124 x:0 0 0 2024-09-17T01:52:17.160 INFO:tasks.workunit.client.0.smithi031.stdout:9/866: mkdir d3/d19/d10e/d120 0 2024-09-17T01:52:17.160 INFO:tasks.workunit.client.1.smithi092.stdout:6/664: write d3/fa [1349206,107658] 0 2024-09-17T01:52:17.162 INFO:tasks.workunit.client.1.smithi092.stdout:3/740: getdents d4/d73/dba/dbe 0 2024-09-17T01:52:17.165 INFO:tasks.workunit.client.1.smithi092.stdout:4/859: dwrite d4/d5/fd2 [0,4194304] 0 2024-09-17T01:52:17.169 INFO:tasks.workunit.client.0.smithi031.stdout:0/969: dwrite d0/d29/d33/d2a/d25/d102/f107 [0,4194304] 0 2024-09-17T01:52:17.170 INFO:tasks.workunit.client.1.smithi092.stdout:6/665: creat d3/d10/d8c/d43/d6a/fca x:0 0 0 2024-09-17T01:52:17.172 INFO:tasks.workunit.client.1.smithi092.stdout:4/860: dwrite d4/d5/d1d/d30/d7a/fab [0,4194304] 0 2024-09-17T01:52:17.176 INFO:tasks.workunit.client.1.smithi092.stdout:6/666: rename d3/d10/d1f/d21/f81 to d3/d10/d1f/d21/da5/d18/fcb 0 2024-09-17T01:52:17.181 INFO:tasks.workunit.client.1.smithi092.stdout:7/756: dread d3/d6/d13/d21/f5c [0,4194304] 0 2024-09-17T01:52:17.182 INFO:tasks.workunit.client.1.smithi092.stdout:4/861: symlink d4/d5/d46/l11b 0 2024-09-17T01:52:17.185 INFO:tasks.workunit.client.1.smithi092.stdout:7/757: creat d3/db/d98/dce/d60/ffc x:0 0 0 2024-09-17T01:52:17.186 INFO:tasks.workunit.client.1.smithi092.stdout:7/758: dread - d3/d6/d13/d21/d2e/fe8 zero size 2024-09-17T01:52:17.187 INFO:tasks.workunit.client.1.smithi092.stdout:4/862: getdents d4/d5/d1d/d30/d3f/d4b/dff 0 2024-09-17T01:52:17.189 INFO:tasks.workunit.client.1.smithi092.stdout:7/759: dread - d3/d6/d13/d21/d2e/d6e/f99 zero size 2024-09-17T01:52:17.190 INFO:tasks.workunit.client.1.smithi092.stdout:4/863: creat d4/d13/d20/de0/f11c x:0 0 0 2024-09-17T01:52:17.194 INFO:tasks.workunit.client.1.smithi092.stdout:4/864: link d4/d5/c2f d4/d13/d3b/d42/d76/d35/de8/c11d 0 2024-09-17T01:52:17.196 INFO:tasks.workunit.client.1.smithi092.stdout:4/865: rmdir d4/d13/d3b/d42/d76/d35/d3e/d7c 39 2024-09-17T01:52:17.196 INFO:tasks.workunit.client.1.smithi092.stdout:4/866: dread - d4/d13/ff4 zero size 2024-09-17T01:52:17.198 INFO:tasks.workunit.client.1.smithi092.stdout:4/867: mknod d4/d5/d1d/d30/d3f/d4b/dff/c11e 0 2024-09-17T01:52:17.200 INFO:tasks.workunit.client.1.smithi092.stdout:4/868: creat d4/d13/d20/de0/f11f x:0 0 0 2024-09-17T01:52:17.203 INFO:tasks.workunit.client.1.smithi092.stdout:4/869: rename d4/d5/d1d/d30/d3f/la9 to d4/d7b/l120 0 2024-09-17T01:52:17.204 INFO:tasks.workunit.client.1.smithi092.stdout:4/870: write d4/d5/f118 [438590,40571] 0 2024-09-17T01:52:17.204 INFO:tasks.workunit.client.1.smithi092.stdout:4/871: dread - d4/d13/d3b/d42/f86 zero size 2024-09-17T01:52:17.207 INFO:tasks.workunit.client.1.smithi092.stdout:4/872: rename d4/d13/d20/de0/f11c to d4/d13/d20/f121 0 2024-09-17T01:52:17.209 INFO:tasks.workunit.client.1.smithi092.stdout:4/873: fsync d4/d5/d1d/d30/d7a/fab 0 2024-09-17T01:52:17.210 INFO:tasks.workunit.client.1.smithi092.stdout:6/667: dread d3/d10/d1f/d21/d28/f54 [0,4194304] 0 2024-09-17T01:52:17.210 INFO:tasks.workunit.client.1.smithi092.stdout:4/874: chown d4/d5/d1d/d30/d7a/dda 11 1 2024-09-17T01:52:17.211 INFO:tasks.workunit.client.1.smithi092.stdout:6/668: write d3/d8e/fb2 [737101,77941] 0 2024-09-17T01:52:17.212 INFO:tasks.workunit.client.1.smithi092.stdout:3/741: write d4/d73/d8f/d92/fa0 [502720,119046] 0 2024-09-17T01:52:17.214 INFO:tasks.workunit.client.1.smithi092.stdout:6/669: mknod d3/d8e/ccc 0 2024-09-17T01:52:17.216 INFO:tasks.workunit.client.1.smithi092.stdout:6/670: read - d3/d10/d1f/d21/d28/f82 zero size 2024-09-17T01:52:17.218 INFO:tasks.workunit.client.1.smithi092.stdout:6/671: chown d3/d10/d1f/d21/da5/d18 495556 1 2024-09-17T01:52:17.218 INFO:tasks.workunit.client.1.smithi092.stdout:4/875: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/f9e [0,4194304] 0 2024-09-17T01:52:17.220 INFO:tasks.workunit.client.1.smithi092.stdout:6/672: write d3/d10/d8c/d43/faf [2280240,69515] 0 2024-09-17T01:52:17.222 INFO:tasks.workunit.client.0.smithi031.stdout:8/826: write d0/df/dd/f45 [708526,114441] 0 2024-09-17T01:52:17.223 INFO:tasks.workunit.client.0.smithi031.stdout:9/867: truncate d3/d4c/d102/d114/d64/f97 3431056 0 2024-09-17T01:52:17.223 INFO:tasks.workunit.client.1.smithi092.stdout:4/876: creat d4/d5/d1d/d107/f122 x:0 0 0 2024-09-17T01:52:17.224 INFO:tasks.workunit.client.0.smithi031.stdout:0/970: write d0/d29/d33/d2a/f39 [2296397,66675] 0 2024-09-17T01:52:17.225 INFO:tasks.workunit.client.1.smithi092.stdout:7/760: dwrite d3/db/d98/dce/d60/f88 [0,4194304] 0 2024-09-17T01:52:17.228 INFO:tasks.workunit.client.1.smithi092.stdout:4/877: write d4/d13/f113 [479181,37185] 0 2024-09-17T01:52:17.229 INFO:tasks.workunit.client.0.smithi031.stdout:2/969: dwrite d1/d3/d45/f78 [0,4194304] 0 2024-09-17T01:52:17.234 INFO:tasks.workunit.client.0.smithi031.stdout:9/868: link d3/d4/d41/l94 d3/df7/l121 0 2024-09-17T01:52:17.235 INFO:tasks.workunit.client.0.smithi031.stdout:2/970: read d1/d3/df/d11/d30/f37 [2936057,57109] 0 2024-09-17T01:52:17.237 INFO:tasks.workunit.client.0.smithi031.stdout:8/827: rename d0/dd8 to d0/d5/d54/d60/dbb/dc0/dfc 0 2024-09-17T01:52:17.238 INFO:tasks.workunit.client.1.smithi092.stdout:4/878: getdents d4/d5/d8 0 2024-09-17T01:52:17.241 INFO:tasks.workunit.client.1.smithi092.stdout:4/879: chown d4/d5/d1d/d30/d3f/l117 14080 1 2024-09-17T01:52:17.241 INFO:tasks.workunit.client.0.smithi031.stdout:2/971: symlink d1/d3/d139/d12c/l147 0 2024-09-17T01:52:17.242 INFO:tasks.workunit.client.1.smithi092.stdout:6/673: truncate d3/d10/d1f/d21/d28/f99 416262 0 2024-09-17T01:52:17.244 INFO:tasks.workunit.client.1.smithi092.stdout:4/880: fsync d4/d5/fb9 0 2024-09-17T01:52:17.245 INFO:tasks.workunit.client.1.smithi092.stdout:4/881: write d4/d13/d3b/f47 [6343522,49901] 0 2024-09-17T01:52:17.246 INFO:tasks.workunit.client.0.smithi031.stdout:0/971: dwrite d0/d29/f114 [0,4194304] 0 2024-09-17T01:52:17.246 INFO:tasks.workunit.client.1.smithi092.stdout:4/882: chown d4/d5/d1d/d30/ddd/ff2 341892 1 2024-09-17T01:52:17.247 INFO:tasks.workunit.client.1.smithi092.stdout:4/883: readlink d4/d5/d8/l10f 0 2024-09-17T01:52:17.247 INFO:tasks.workunit.client.0.smithi031.stdout:2/972: rename d1/d7c/c99 to d1/c148 0 2024-09-17T01:52:17.248 INFO:tasks.workunit.client.0.smithi031.stdout:8/828: link d0/d5/c4f d0/d5/d9b/cfd 0 2024-09-17T01:52:17.249 INFO:tasks.workunit.client.0.smithi031.stdout:0/972: creat d0/d29/d33/d5/dad/f14e x:0 0 0 2024-09-17T01:52:17.250 INFO:tasks.workunit.client.0.smithi031.stdout:0/973: chown d0/f8a 62351 1 2024-09-17T01:52:17.251 INFO:tasks.workunit.client.0.smithi031.stdout:0/974: chown d0/d37/l120 11 1 2024-09-17T01:52:17.251 INFO:tasks.workunit.client.0.smithi031.stdout:8/829: mknod d0/df/db6/cfe 0 2024-09-17T01:52:17.254 INFO:tasks.workunit.client.0.smithi031.stdout:8/830: creat d0/d5/d6c/db0/db7/fff x:0 0 0 2024-09-17T01:52:17.269 INFO:tasks.workunit.client.1.smithi092.stdout:4/884: dwrite d4/d13/d3b/d42/d76/d35/d3e/d7c/f87 [0,4194304] 0 2024-09-17T01:52:17.272 INFO:tasks.workunit.client.0.smithi031.stdout:2/973: read d1/d3/df/d11/d30/fcb [17299,35885] 0 2024-09-17T01:52:17.272 INFO:tasks.workunit.client.0.smithi031.stdout:2/974: chown d1/d3/df/d18/d40/lb8 433 1 2024-09-17T01:52:17.273 INFO:tasks.workunit.client.0.smithi031.stdout:2/975: mknod d1/d3/d2d/d91/c149 0 2024-09-17T01:52:17.274 INFO:tasks.workunit.client.1.smithi092.stdout:4/885: symlink d4/d5/d46/l123 0 2024-09-17T01:52:17.281 INFO:tasks.workunit.client.1.smithi092.stdout:4/886: write d4/d7b/d7d/f95 [429288,120883] 0 2024-09-17T01:52:17.283 INFO:tasks.workunit.client.0.smithi031.stdout:0/975: dread d0/f1f [0,4194304] 0 2024-09-17T01:52:17.284 INFO:tasks.workunit.client.1.smithi092.stdout:4/887: mknod d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/c124 0 2024-09-17T01:52:17.285 INFO:tasks.workunit.client.0.smithi031.stdout:2/976: dread d1/d3/d45/d4a/f6d [0,4194304] 0 2024-09-17T01:52:17.286 INFO:tasks.workunit.client.0.smithi031.stdout:0/976: creat d0/d29/d33/d2a/d25/d102/f14f x:0 0 0 2024-09-17T01:52:17.286 INFO:tasks.workunit.client.0.smithi031.stdout:0/977: chown d0/d29/d33/d5/d48/d56/dc8/fe1 495661 1 2024-09-17T01:52:17.287 INFO:tasks.workunit.client.0.smithi031.stdout:5/889: sync 2024-09-17T01:52:17.287 INFO:tasks.workunit.client.0.smithi031.stdout:3/935: sync 2024-09-17T01:52:17.287 INFO:tasks.workunit.client.0.smithi031.stdout:2/977: creat d1/d3/d2d/da6/f14a x:0 0 0 2024-09-17T01:52:17.288 INFO:tasks.workunit.client.0.smithi031.stdout:0/978: rmdir d0/d29/da7/db3/d4a/d86 39 2024-09-17T01:52:17.291 INFO:tasks.workunit.client.0.smithi031.stdout:0/979: write d0/d29/da7/db3/d4a/f6e [5127637,58771] 0 2024-09-17T01:52:17.291 INFO:tasks.workunit.client.0.smithi031.stdout:3/936: write db/df/d1d/d37/d4a/fe7 [1223998,102573] 0 2024-09-17T01:52:17.291 INFO:tasks.workunit.client.0.smithi031.stdout:5/890: mkdir da/d14/dac/d13c 0 2024-09-17T01:52:17.294 INFO:tasks.workunit.client.0.smithi031.stdout:5/891: mkdir da/d14/dac/d62/d10d/d127/d13d 0 2024-09-17T01:52:17.295 INFO:tasks.workunit.client.0.smithi031.stdout:3/937: symlink db/df/d1d/d37/d77/de3/l12e 0 2024-09-17T01:52:17.296 INFO:tasks.workunit.client.0.smithi031.stdout:3/938: write db/d29/f4e [4858007,21172] 0 2024-09-17T01:52:17.297 INFO:tasks.workunit.client.0.smithi031.stdout:0/980: rename d0/d29/d33/d5/d48/d56/dc8/ldd to d0/d29/d33/d2a/d25/d102/l150 0 2024-09-17T01:52:17.304 INFO:tasks.workunit.client.0.smithi031.stdout:5/892: dread da/dc/f16 [0,4194304] 0 2024-09-17T01:52:17.304 INFO:tasks.workunit.client.0.smithi031.stdout:3/939: link db/df/dc8/d6a/d83/de4/d124/c5c db/df/d1d/d37/d4a/d97/dba/c12f 0 2024-09-17T01:52:17.305 INFO:tasks.workunit.client.0.smithi031.stdout:5/893: fdatasync da/d42/d12/d64/ffc 0 2024-09-17T01:52:17.307 INFO:tasks.workunit.client.1.smithi092.stdout:4/888: dread d4/d13/d3b/d42/d76/d35/d3e/f43 [0,4194304] 0 2024-09-17T01:52:17.308 INFO:tasks.workunit.client.1.smithi092.stdout:4/889: write d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/f106 [159130,4801] 0 2024-09-17T01:52:17.311 INFO:tasks.workunit.client.1.smithi092.stdout:4/890: rmdir d4/d5/d8/de2 39 2024-09-17T01:52:17.312 INFO:tasks.workunit.client.0.smithi031.stdout:5/894: creat da/dc/d98/f13e x:0 0 0 2024-09-17T01:52:17.312 INFO:tasks.workunit.client.0.smithi031.stdout:3/940: dwrite db/df/dc8/f11b [0,4194304] 0 2024-09-17T01:52:17.313 INFO:tasks.workunit.client.0.smithi031.stdout:2/978: truncate d1/f103 4336539 0 2024-09-17T01:52:17.314 INFO:tasks.workunit.client.0.smithi031.stdout:0/981: link d0/d29/d33/d5/d48/d56/dc8/l13c d0/d29/da7/db3/d4a/d86/dd7/dac/l151 0 2024-09-17T01:52:17.317 INFO:tasks.workunit.client.0.smithi031.stdout:5/895: dread da/ded/f116 [0,4194304] 0 2024-09-17T01:52:17.321 INFO:tasks.workunit.client.0.smithi031.stdout:0/982: link d0/d29/d33/dff/fa0 d0/d29/da7/db3/d4a/d86/d133/d12a/f152 0 2024-09-17T01:52:17.326 INFO:tasks.workunit.client.0.smithi031.stdout:5/896: dwrite da/d42/d12/d128/f12c [0,4194304] 0 2024-09-17T01:52:17.327 INFO:tasks.workunit.client.0.smithi031.stdout:0/983: mkdir d0/d29/d33/d5/dad/d153 0 2024-09-17T01:52:17.330 INFO:tasks.workunit.client.1.smithi092.stdout:4/891: dread d4/d13/d3b/f8d [0,4194304] 0 2024-09-17T01:52:17.330 INFO:tasks.workunit.client.1.smithi092.stdout:4/892: stat d4/d5/d1d/d30/ddd/ff2 0 2024-09-17T01:52:17.334 INFO:tasks.workunit.client.1.smithi092.stdout:4/893: getdents d4/d7b 0 2024-09-17T01:52:17.336 INFO:tasks.workunit.client.0.smithi031.stdout:0/984: mknod d0/d29/d33/d2a/d25/c154 0 2024-09-17T01:52:17.336 INFO:tasks.workunit.client.1.smithi092.stdout:4/894: chown d4/d5/d8/d92/cac 449339 1 2024-09-17T01:52:17.338 INFO:tasks.workunit.client.0.smithi031.stdout:3/941: dread db/df/d1d/f7c [0,4194304] 0 2024-09-17T01:52:17.340 INFO:tasks.workunit.client.0.smithi031.stdout:3/942: stat db/df/dc8/d6a/d83/de4/d124 0 2024-09-17T01:52:17.340 INFO:tasks.workunit.client.1.smithi092.stdout:4/895: read d4/d5/d1d/d30/f64 [3422711,30500] 0 2024-09-17T01:52:17.341 INFO:tasks.workunit.client.0.smithi031.stdout:3/943: dread - db/da3/f10c zero size 2024-09-17T01:52:17.342 INFO:tasks.workunit.client.1.smithi092.stdout:4/896: fdatasync d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3/f110 0 2024-09-17T01:52:17.342 INFO:tasks.workunit.client.0.smithi031.stdout:2/979: dwrite d1/d3/df/d18/d40/db5/fd1 [4194304,4194304] 0 2024-09-17T01:52:17.342 INFO:tasks.workunit.client.0.smithi031.stdout:0/985: rename d0/d29/d33/d5/d48/d56/l67 to d0/d29/da7/db3/d4a/d86/dd7/dac/d145/l155 0 2024-09-17T01:52:17.345 INFO:tasks.workunit.client.0.smithi031.stdout:2/980: write d1/d3/d2d/d91/ff4 [1315811,52579] 0 2024-09-17T01:52:17.347 INFO:tasks.workunit.client.0.smithi031.stdout:0/986: creat d0/d29/d33/d2a/dde/f156 x:0 0 0 2024-09-17T01:52:17.350 INFO:tasks.workunit.client.1.smithi092.stdout:4/897: write d4/d5/fc1 [684367,23271] 0 2024-09-17T01:52:17.352 INFO:tasks.workunit.client.0.smithi031.stdout:2/981: mknod d1/d3/d2d/da6/d107/d135/d2a/d7f/c14b 0 2024-09-17T01:52:17.353 INFO:tasks.workunit.client.0.smithi031.stdout:0/987: creat d0/d29/d33/d5/d48/d56/dc8/d12f/f157 x:0 0 0 2024-09-17T01:52:17.354 INFO:tasks.workunit.client.1.smithi092.stdout:4/898: symlink d4/d5/d1d/d30/d3f/d4b/dff/l125 0 2024-09-17T01:52:17.354 INFO:tasks.workunit.client.1.smithi092.stdout:4/899: write d4/d5/fc4 [502469,53719] 0 2024-09-17T01:52:17.356 INFO:tasks.workunit.client.1.smithi092.stdout:4/900: write d4/d13/d3b/d42/d76/f48 [4855034,14414] 0 2024-09-17T01:52:17.356 INFO:tasks.workunit.client.0.smithi031.stdout:2/982: fdatasync d1/d3/df/d66/fce 0 2024-09-17T01:52:17.358 INFO:tasks.workunit.client.1.smithi092.stdout:4/901: rmdir d4/d13/d3b/d42/d76/d41 39 2024-09-17T01:52:17.359 INFO:tasks.workunit.client.0.smithi031.stdout:0/988: symlink d0/d29/da7/d10f/l158 0 2024-09-17T01:52:17.360 INFO:tasks.workunit.client.0.smithi031.stdout:5/897: dwrite da/d42/d26/f39 [0,4194304] 0 2024-09-17T01:52:17.361 INFO:tasks.workunit.client.0.smithi031.stdout:2/983: truncate d1/d3/d2d/db2/f33 310847 0 2024-09-17T01:52:17.361 INFO:tasks.workunit.client.1.smithi092.stdout:4/902: creat d4/d5/d8/d99/dcf/f126 x:0 0 0 2024-09-17T01:52:17.364 INFO:tasks.workunit.client.0.smithi031.stdout:2/984: mkdir d1/d3/d2d/da6/d107/d14c 0 2024-09-17T01:52:17.366 INFO:tasks.workunit.client.0.smithi031.stdout:5/898: mkdir da/dc/da2/d107/d13f 0 2024-09-17T01:52:17.367 INFO:tasks.workunit.client.0.smithi031.stdout:0/989: truncate d0/d29/d33/d2a/f23 440498 0 2024-09-17T01:52:17.368 INFO:tasks.workunit.client.0.smithi031.stdout:2/985: fsync d1/d3/df/f5b 0 2024-09-17T01:52:17.370 INFO:tasks.workunit.client.0.smithi031.stdout:2/986: write d1/d3/df/d11/d30/da1/f144 [887428,65662] 0 2024-09-17T01:52:17.374 INFO:tasks.workunit.client.0.smithi031.stdout:3/944: dwrite db/df/d1d/d37/d6c/d6e/dd4/dd7/f111 [4194304,4194304] 0 2024-09-17T01:52:17.375 INFO:tasks.workunit.client.0.smithi031.stdout:0/990: dread d0/d29/da7/db3/d4a/d86/dd7/ffb [0,4194304] 0 2024-09-17T01:52:17.376 INFO:tasks.workunit.client.0.smithi031.stdout:2/987: link d1/d3/df/d18/d40/dc1/f145 d1/d3/d2d/d91/dad/f14d 0 2024-09-17T01:52:17.379 INFO:tasks.workunit.client.0.smithi031.stdout:2/988: write d1/d3/d2d/d91/dad/f111 [213167,11999] 0 2024-09-17T01:52:17.379 INFO:tasks.workunit.client.0.smithi031.stdout:0/991: readlink d0/d29/d33/d5/dec/l115 0 2024-09-17T01:52:17.384 INFO:tasks.workunit.client.0.smithi031.stdout:2/989: mkdir d1/d3/d2d/da6/d107/d135/d2a/d7f/d14e 0 2024-09-17T01:52:17.389 INFO:tasks.workunit.client.0.smithi031.stdout:1/874: sync 2024-09-17T01:52:17.390 INFO:tasks.workunit.client.0.smithi031.stdout:3/945: write db/df/f22 [353470,74314] 0 2024-09-17T01:52:17.392 INFO:tasks.workunit.client.0.smithi031.stdout:5/899: dwrite da/d14/dac/f68 [0,4194304] 0 2024-09-17T01:52:17.394 INFO:tasks.workunit.client.0.smithi031.stdout:1/875: symlink d4/d1a/d43/d53/dd3/dee/d107/l125 0 2024-09-17T01:52:17.396 INFO:tasks.workunit.client.0.smithi031.stdout:3/946: mknod db/df/d1d/d37/d65/c130 0 2024-09-17T01:52:17.397 INFO:tasks.workunit.client.0.smithi031.stdout:5/900: mkdir da/dc/df8/d113/d140 0 2024-09-17T01:52:17.398 INFO:tasks.workunit.client.0.smithi031.stdout:1/876: creat d4/d1e/d8d/df9/f126 x:0 0 0 2024-09-17T01:52:17.400 INFO:tasks.workunit.client.0.smithi031.stdout:3/947: symlink db/df/dc8/d6a/d83/dcb/l131 0 2024-09-17T01:52:17.401 INFO:tasks.workunit.client.0.smithi031.stdout:2/990: truncate d1/d3/df/f2b 2619543 0 2024-09-17T01:52:17.402 INFO:tasks.workunit.client.0.smithi031.stdout:3/948: write db/df/f22 [594595,76584] 0 2024-09-17T01:52:17.404 INFO:tasks.workunit.client.0.smithi031.stdout:1/877: creat d4/d1e/d3f/d72/d7e/d92/f127 x:0 0 0 2024-09-17T01:52:17.404 INFO:tasks.workunit.client.0.smithi031.stdout:0/992: dread d0/d29/d33/d2a/d25/d38/fbf [0,4194304] 0 2024-09-17T01:52:17.405 INFO:tasks.workunit.client.0.smithi031.stdout:1/878: dread - d4/d3d/d65/f120 zero size 2024-09-17T01:52:17.407 INFO:tasks.workunit.client.0.smithi031.stdout:3/949: write db/df/d1d/d37/d6c/d6e/dd4/ff6 [1414282,68184] 0 2024-09-17T01:52:17.407 INFO:tasks.workunit.client.0.smithi031.stdout:1/879: chown d4/d1a/d2d/fe 625 1 2024-09-17T01:52:17.408 INFO:tasks.workunit.client.0.smithi031.stdout:5/901: creat da/dc/f141 x:0 0 0 2024-09-17T01:52:17.411 INFO:tasks.workunit.client.0.smithi031.stdout:1/880: symlink d4/d1e/d40/l128 0 2024-09-17T01:52:17.416 INFO:tasks.workunit.client.0.smithi031.stdout:0/993: dwrite d0/d29/d33/d84/f97 [0,4194304] 0 2024-09-17T01:52:17.417 INFO:tasks.workunit.client.0.smithi031.stdout:9/869: sync 2024-09-17T01:52:17.417 INFO:tasks.workunit.client.0.smithi031.stdout:8/831: sync 2024-09-17T01:52:17.417 INFO:tasks.workunit.client.0.smithi031.stdout:2/991: fsync d1/d3/df/d18/d40/dc1/ffd 0 2024-09-17T01:52:17.418 INFO:tasks.workunit.client.0.smithi031.stdout:0/994: dread - d0/d29/d33/d5/d48/d56/dc8/d12f/f157 zero size 2024-09-17T01:52:17.419 INFO:tasks.workunit.client.0.smithi031.stdout:8/832: fsync d0/d5/d6c/db0/fb9 0 2024-09-17T01:52:17.422 INFO:tasks.workunit.client.0.smithi031.stdout:3/950: rename db/df/d1d/d37/d77/dc2/fb7 to db/df/d1d/d37/d6c/d6e/dd4/f132 0 2024-09-17T01:52:17.427 INFO:tasks.workunit.client.0.smithi031.stdout:0/995: readlink d0/d29/d33/d5/d48/d56/dc8/l13c 0 2024-09-17T01:52:17.429 INFO:tasks.workunit.client.0.smithi031.stdout:1/881: write d4/d1e/d40/d84/fa6 [2040780,1573] 0 2024-09-17T01:52:17.430 INFO:tasks.workunit.client.0.smithi031.stdout:1/882: readlink d4/l7f 0 2024-09-17T01:52:17.430 INFO:tasks.workunit.client.0.smithi031.stdout:9/870: readlink d3/d19/d1f/l75 0 2024-09-17T01:52:17.431 INFO:tasks.workunit.client.0.smithi031.stdout:0/996: rmdir d0/d29/d44 39 2024-09-17T01:52:17.434 INFO:tasks.workunit.client.0.smithi031.stdout:5/902: rename da/d4b/d6c/df2/de7/l115 to da/dc/da2/d107/l142 0 2024-09-17T01:52:17.439 INFO:tasks.workunit.client.0.smithi031.stdout:2/992: rename d1/d3/d2d/da6/d107/d135/f115 to d1/d3/df/d11/d30/ddd/d13b/f14f 0 2024-09-17T01:52:17.441 INFO:tasks.workunit.client.0.smithi031.stdout:0/997: dwrite d0/d29/d33/d5/d48/d56/f141 [0,4194304] 0 2024-09-17T01:52:17.443 INFO:tasks.workunit.client.0.smithi031.stdout:5/903: mkdir da/d42/d12/d128/d143 0 2024-09-17T01:52:17.448 INFO:tasks.workunit.client.0.smithi031.stdout:3/951: getdents db/df/d1d/d37/d6c/d96 0 2024-09-17T01:52:17.449 INFO:tasks.workunit.client.0.smithi031.stdout:9/871: dread d3/d4c/d102/d114/d64/fe2 [4194304,4194304] 0 2024-09-17T01:52:17.451 INFO:tasks.workunit.client.0.smithi031.stdout:8/833: rename d0/df/d19/d86/cad to d0/d5/d9b/dcf/c100 0 2024-09-17T01:52:17.452 INFO:tasks.workunit.client.0.smithi031.stdout:3/952: chown db/df/d1d/d37/d6c/d6e/f7e 120 1 2024-09-17T01:52:17.453 INFO:tasks.workunit.client.0.smithi031.stdout:2/993: dwrite d1/d3/d2d/da6/d107/d135/f97 [0,4194304] 0 2024-09-17T01:52:17.458 INFO:tasks.workunit.client.0.smithi031.stdout:0/998: rename d0/d29/c2f to d0/d29/d33/d5/dad/d153/c159 0 2024-09-17T01:52:17.461 INFO:tasks.workunit.client.0.smithi031.stdout:9/872: unlink d3/d4/da0/d36/d79/l86 0 2024-09-17T01:52:17.462 INFO:tasks.workunit.client.0.smithi031.stdout:9/873: stat d3/d4/da0/d36/c11b 0 2024-09-17T01:52:17.464 INFO:tasks.workunit.client.0.smithi031.stdout:0/999: unlink d0/d29/d33/d5/d48/d8c/lb2 0 2024-09-17T01:52:17.466 INFO:tasks.workunit.client.0.smithi031.stdout:3/953: creat db/f133 x:0 0 0 2024-09-17T01:52:17.467 INFO:tasks.workunit.client.0.smithi031.stdout:3/954: stat db/d82/d110 0 2024-09-17T01:52:17.467 INFO:tasks.workunit.client.0.smithi031.stdout:9/874: mkdir d3/d4/da0/d36/d79/dd0/d122 0 2024-09-17T01:52:17.469 INFO:tasks.workunit.client.0.smithi031.stdout:2/994: rename d1/d3/d2d/da6/d107/d135/d21/ddf/l60 to d1/d3/d2d/da6/d107/d135/d21/l150 0 2024-09-17T01:52:17.470 INFO:tasks.workunit.client.1.smithi092.stdout:0/700: sync 2024-09-17T01:52:17.470 INFO:tasks.workunit.client.0.smithi031.stdout:8/834: getdents d0/d5/d54/d60 0 2024-09-17T01:52:17.473 INFO:tasks.workunit.client.0.smithi031.stdout:9/875: creat d3/d4/da0/d36/d62/dd8/f123 x:0 0 0 2024-09-17T01:52:17.475 INFO:tasks.workunit.client.0.smithi031.stdout:2/995: stat d1/d3/d2d/da6/d107/d135/d21/d98/lf8 0 2024-09-17T01:52:17.477 INFO:tasks.workunit.client.0.smithi031.stdout:2/996: truncate d1/f126 759897 0 2024-09-17T01:52:17.480 INFO:tasks.workunit.client.0.smithi031.stdout:2/997: readlink d1/d3/d45/dfb/l9d 0 2024-09-17T01:52:17.480 INFO:tasks.workunit.client.0.smithi031.stdout:8/835: symlink d0/df/d19/d86/dca/l101 0 2024-09-17T01:52:17.480 INFO:tasks.workunit.client.0.smithi031.stdout:8/836: write d0/f74 [3302131,20212] 0 2024-09-17T01:52:17.481 INFO:tasks.workunit.client.0.smithi031.stdout:9/876: mknod d3/d19/c124 0 2024-09-17T01:52:17.481 INFO:tasks.workunit.client.0.smithi031.stdout:8/837: dread - d0/df/dd/d77/fce zero size 2024-09-17T01:52:17.481 INFO:tasks.workunit.client.0.smithi031.stdout:1/883: dread d4/d1a/d2d/f8b [0,4194304] 0 2024-09-17T01:52:17.482 INFO:tasks.workunit.client.0.smithi031.stdout:9/877: mkdir d3/d4/da0/d36/d62/dd8/d125 0 2024-09-17T01:52:17.486 INFO:tasks.workunit.client.0.smithi031.stdout:8/838: creat d0/df/d19/d86/dca/f102 x:0 0 0 2024-09-17T01:52:17.489 INFO:tasks.workunit.client.0.smithi031.stdout:9/878: creat d3/d4c/d102/d114/f126 x:0 0 0 2024-09-17T01:52:17.490 INFO:tasks.workunit.client.0.smithi031.stdout:1/884: dread d4/d3d/d65/f75 [0,4194304] 0 2024-09-17T01:52:17.492 INFO:tasks.workunit.client.0.smithi031.stdout:1/885: read d4/d1e/f70 [5355164,102073] 0 2024-09-17T01:52:17.493 INFO:tasks.workunit.client.0.smithi031.stdout:8/839: unlink d0/d5/d6c/db0/cee 0 2024-09-17T01:52:17.496 INFO:tasks.workunit.client.0.smithi031.stdout:3/955: truncate db/d9b/fa9 1104677 0 2024-09-17T01:52:17.498 INFO:tasks.workunit.client.0.smithi031.stdout:2/998: write d1/d3/d45/dfb/ff5 [783751,38657] 0 2024-09-17T01:52:17.499 INFO:tasks.workunit.client.0.smithi031.stdout:3/956: symlink db/df/d1d/l134 0 2024-09-17T01:52:17.501 INFO:tasks.workunit.client.0.smithi031.stdout:2/999: mkdir d1/d3/d2d/d91/dad/d151 0 2024-09-17T01:52:17.503 INFO:tasks.workunit.client.1.smithi092.stdout:0/701: rename d3/da/c20 to d3/d2e/d55/dcf/cdc 0 2024-09-17T01:52:17.505 INFO:tasks.workunit.client.1.smithi092.stdout:0/702: mknod d3/da/d15/cdd 0 2024-09-17T01:52:17.505 INFO:tasks.workunit.client.0.smithi031.stdout:3/957: dwrite db/d29/f2e [0,4194304] 0 2024-09-17T01:52:17.511 INFO:tasks.workunit.client.0.smithi031.stdout:3/958: unlink db/df/f39 0 2024-09-17T01:52:17.511 INFO:tasks.workunit.client.1.smithi092.stdout:0/703: symlink d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/lde 0 2024-09-17T01:52:17.515 INFO:tasks.workunit.client.0.smithi031.stdout:9/879: dread d3/d19/d1f/f21 [0,4194304] 0 2024-09-17T01:52:17.516 INFO:tasks.workunit.client.0.smithi031.stdout:9/880: chown d3/d4/da0/d36/d79/fab 29 1 2024-09-17T01:52:17.518 INFO:tasks.workunit.client.1.smithi092.stdout:0/704: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:52:17.519 INFO:tasks.workunit.client.0.smithi031.stdout:9/881: mkdir d3/d47/d96/d127 0 2024-09-17T01:52:17.520 INFO:tasks.workunit.client.0.smithi031.stdout:9/882: write d3/d4/da0/f108 [571999,52922] 0 2024-09-17T01:52:17.520 INFO:tasks.workunit.client.0.smithi031.stdout:3/959: symlink db/df/d1d/d37/d4a/l135 0 2024-09-17T01:52:17.522 INFO:tasks.workunit.client.0.smithi031.stdout:9/883: truncate d3/d4/da0/f108 1471971 0 2024-09-17T01:52:17.523 INFO:tasks.workunit.client.0.smithi031.stdout:3/960: creat db/df/d1d/d37/d77/de3/f136 x:0 0 0 2024-09-17T01:52:17.530 INFO:tasks.workunit.client.0.smithi031.stdout:9/884: dwrite d3/d4c/d102/d114/d64/fe2 [0,4194304] 0 2024-09-17T01:52:17.532 INFO:tasks.workunit.client.0.smithi031.stdout:9/885: symlink d3/d4/d41/d119/l128 0 2024-09-17T01:52:17.536 INFO:tasks.workunit.client.0.smithi031.stdout:9/886: link d3/d19/d80/f8a d3/d4/d41/d119/f129 0 2024-09-17T01:52:17.537 INFO:tasks.workunit.client.0.smithi031.stdout:9/887: stat d3/d4/da0/l4e 0 2024-09-17T01:52:17.539 INFO:tasks.workunit.client.1.smithi092.stdout:0/705: dwrite d3/d2e/d3b/f94 [0,4194304] 0 2024-09-17T01:52:17.544 INFO:tasks.workunit.client.1.smithi092.stdout:0/706: getdents d3/d2e/d3b/d48/d76 0 2024-09-17T01:52:17.545 INFO:tasks.workunit.client.0.smithi031.stdout:3/961: dwrite db/df/d1d/d37/d77/de3/f12c [0,4194304] 0 2024-09-17T01:52:17.547 INFO:tasks.workunit.client.1.smithi092.stdout:0/707: unlink d3/d2e/d3b/d8f/f9b 0 2024-09-17T01:52:17.549 INFO:tasks.workunit.client.1.smithi092.stdout:0/708: rmdir d3/d2e/d3b/d48/d76 39 2024-09-17T01:52:17.549 INFO:tasks.workunit.client.0.smithi031.stdout:3/962: creat db/df/dc8/d6a/ddd/f137 x:0 0 0 2024-09-17T01:52:17.550 INFO:tasks.workunit.client.1.smithi092.stdout:0/709: chown d3/d2e/d3b/d8f/d5f/db1/dd8/f80 87184 1 2024-09-17T01:52:17.551 INFO:tasks.workunit.client.0.smithi031.stdout:3/963: mknod db/df/d1d/d37/d6c/d6e/c138 0 2024-09-17T01:52:17.552 INFO:tasks.workunit.client.0.smithi031.stdout:3/964: symlink db/d82/df4/l139 0 2024-09-17T01:52:17.553 INFO:tasks.workunit.client.0.smithi031.stdout:9/888: dread d3/d4c/d102/d114/d64/f90 [0,4194304] 0 2024-09-17T01:52:17.553 INFO:tasks.workunit.client.1.smithi092.stdout:0/710: dread - d3/d2e/d55/d63/d81/d9c/fbd zero size 2024-09-17T01:52:17.557 INFO:tasks.workunit.client.0.smithi031.stdout:9/889: getdents d3/d4/da0/d71 0 2024-09-17T01:52:17.558 INFO:tasks.workunit.client.1.smithi092.stdout:0/711: dwrite d3/da/d1c/d3a/f57 [0,4194304] 0 2024-09-17T01:52:17.559 INFO:tasks.workunit.client.0.smithi031.stdout:9/890: symlink d3/df7/l12a 0 2024-09-17T01:52:17.559 INFO:tasks.workunit.client.1.smithi092.stdout:0/712: chown d3/d2e/d3b/d8f/d5f/db1 1 1 2024-09-17T01:52:17.561 INFO:tasks.workunit.client.1.smithi092.stdout:0/713: mknod d3/d2e/d55/d63/cdf 0 2024-09-17T01:52:17.562 INFO:tasks.workunit.client.1.smithi092.stdout:0/714: chown d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad 2571626 1 2024-09-17T01:52:17.563 INFO:tasks.workunit.client.1.smithi092.stdout:0/715: stat d3/da/fd3 0 2024-09-17T01:52:17.564 INFO:tasks.workunit.client.1.smithi092.stdout:0/716: symlink d3/d2e/d3b/d72/le0 0 2024-09-17T01:52:17.565 INFO:tasks.workunit.client.0.smithi031.stdout:9/891: dwrite d3/d19/f34 [0,4194304] 0 2024-09-17T01:52:17.566 INFO:tasks.workunit.client.1.smithi092.stdout:0/717: dread - d3/d2e/d3b/d40/d7d/f8b zero size 2024-09-17T01:52:17.569 INFO:tasks.workunit.client.0.smithi031.stdout:9/892: mkdir d3/d4/da0/d36/d79/dd0/d122/d12b 0 2024-09-17T01:52:17.576 INFO:tasks.workunit.client.0.smithi031.stdout:9/893: rmdir d3/d4/da0/d36/d79/dd0/d122/d12b 0 2024-09-17T01:52:17.578 INFO:tasks.workunit.client.1.smithi092.stdout:0/718: dread d3/d2e/d55/d63/f6d [0,4194304] 0 2024-09-17T01:52:17.580 INFO:tasks.workunit.client.0.smithi031.stdout:9/894: creat d3/d4/da0/d36/d62/f12c x:0 0 0 2024-09-17T01:52:17.580 INFO:tasks.workunit.client.1.smithi092.stdout:0/719: fsync d3/d2e/d3b/d72/fbe 0 2024-09-17T01:52:17.581 INFO:tasks.workunit.client.0.smithi031.stdout:9/895: chown d3/d4/da0/l11a 5 1 2024-09-17T01:52:17.581 INFO:tasks.workunit.client.0.smithi031.stdout:3/965: dwrite db/df/d1d/f59 [0,4194304] 0 2024-09-17T01:52:17.586 INFO:tasks.workunit.client.0.smithi031.stdout:3/966: readlink db/df/dc8/l52 0 2024-09-17T01:52:17.589 INFO:tasks.workunit.client.0.smithi031.stdout:3/967: link db/df/d1d/d37/d6c/d6e/f9f db/da3/d126/f13a 0 2024-09-17T01:52:17.591 INFO:tasks.workunit.client.0.smithi031.stdout:3/968: mkdir db/df/dc8/d13b 0 2024-09-17T01:52:17.595 INFO:tasks.workunit.client.0.smithi031.stdout:9/896: write d3/d4/f27 [2079254,11104] 0 2024-09-17T01:52:17.599 INFO:tasks.workunit.client.0.smithi031.stdout:3/969: dwrite db/df/d1d/d37/d4a/d97/dba/fe6 [0,4194304] 0 2024-09-17T01:52:17.599 INFO:tasks.workunit.client.1.smithi092.stdout:0/720: dwrite d3/d2e/d55/f67 [0,4194304] 0 2024-09-17T01:52:17.600 INFO:tasks.workunit.client.0.smithi031.stdout:3/970: readlink db/df/d1d/d128/l12a 0 2024-09-17T01:52:17.600 INFO:tasks.workunit.client.0.smithi031.stdout:9/897: fdatasync d3/d4/da0/d36/d62/db2/dd4/fdf 0 2024-09-17T01:52:17.601 INFO:tasks.workunit.client.1.smithi092.stdout:0/721: symlink d3/da/d15/dba/le1 0 2024-09-17T01:52:17.602 INFO:tasks.workunit.client.1.smithi092.stdout:0/722: chown d3/da/d15/d30/fcd 234551 1 2024-09-17T01:52:17.605 INFO:tasks.workunit.client.1.smithi092.stdout:0/723: mknod d3/d2e/d55/d63/d81/d9c/ce2 0 2024-09-17T01:52:17.607 INFO:tasks.workunit.client.0.smithi031.stdout:9/898: dread d3/d4/da0/d36/d8f/ffe [0,4194304] 0 2024-09-17T01:52:17.608 INFO:tasks.workunit.client.1.smithi092.stdout:0/724: mkdir d3/d2e/d55/d63/d81/de3 0 2024-09-17T01:52:17.614 INFO:tasks.workunit.client.0.smithi031.stdout:9/899: read d3/d19/fa4 [87367,29640] 0 2024-09-17T01:52:17.616 INFO:tasks.workunit.client.0.smithi031.stdout:3/971: dwrite db/df/f54 [0,4194304] 0 2024-09-17T01:52:17.618 INFO:tasks.workunit.client.1.smithi092.stdout:8/625: sync 2024-09-17T01:52:17.622 INFO:tasks.workunit.client.0.smithi031.stdout:3/972: rename db/df/dc8/d6a/d83/d10f to db/d13c 0 2024-09-17T01:52:17.623 INFO:tasks.workunit.client.1.smithi092.stdout:8/626: rename c11 to d15/d32/d40/d42/d6b/cc9 0 2024-09-17T01:52:17.625 INFO:tasks.workunit.client.0.smithi031.stdout:5/904: sync 2024-09-17T01:52:17.626 INFO:tasks.workunit.client.1.smithi092.stdout:8/627: mknod d15/d32/d3b/d78/d9e/cca 0 2024-09-17T01:52:17.627 INFO:tasks.workunit.client.0.smithi031.stdout:9/900: write d3/d4/fb8 [3962751,116687] 0 2024-09-17T01:52:17.631 INFO:tasks.workunit.client.0.smithi031.stdout:5/905: getdents da/d42/d12/d72/dfe 0 2024-09-17T01:52:17.631 INFO:tasks.workunit.client.0.smithi031.stdout:3/973: write db/df/f15 [1307067,9757] 0 2024-09-17T01:52:17.632 INFO:tasks.workunit.client.1.smithi092.stdout:8/628: link d15/d25/d27/d6e/fa9 d15/d32/d3b/d78/d9b/da1/d9a/fcb 0 2024-09-17T01:52:17.632 INFO:tasks.workunit.client.1.smithi092.stdout:0/725: dwrite d3/d2e/f84 [0,4194304] 0 2024-09-17T01:52:17.633 INFO:tasks.workunit.client.0.smithi031.stdout:3/974: read db/f46 [1878046,39414] 0 2024-09-17T01:52:17.635 INFO:tasks.workunit.client.1.smithi092.stdout:0/726: truncate d3/da/d1c/fc5 252871 0 2024-09-17T01:52:17.635 INFO:tasks.workunit.client.1.smithi092.stdout:8/629: mkdir d15/d25/d27/d49/dcc 0 2024-09-17T01:52:17.637 INFO:tasks.workunit.client.1.smithi092.stdout:0/727: read - d3/d2e/d3b/d8f/f7c zero size 2024-09-17T01:52:17.639 INFO:tasks.workunit.client.1.smithi092.stdout:8/630: rename d15/d25/d2b/d63/da4 to d15/d6f/dcd 0 2024-09-17T01:52:17.640 INFO:tasks.workunit.client.0.smithi031.stdout:3/975: unlink db/df/dc8/cd1 0 2024-09-17T01:52:17.642 INFO:tasks.workunit.client.1.smithi092.stdout:0/728: unlink d3/d2e/d3b/d48/c97 0 2024-09-17T01:52:17.643 INFO:tasks.workunit.client.0.smithi031.stdout:9/901: dread d3/d4/da0/d71/f9e [0,4194304] 0 2024-09-17T01:52:17.644 INFO:tasks.workunit.client.1.smithi092.stdout:0/729: truncate d3/d2e/d3b/d8f/f7c 607598 0 2024-09-17T01:52:17.644 INFO:tasks.workunit.client.1.smithi092.stdout:0/730: chown d3/d2e/d3b/d8f/d5f/db1 1651 1 2024-09-17T01:52:17.645 INFO:tasks.workunit.client.1.smithi092.stdout:8/631: read d15/d32/d40/d42/f5f [2001919,126638] 0 2024-09-17T01:52:17.646 INFO:tasks.workunit.client.1.smithi092.stdout:8/632: chown d15/d25/d2b/l37 1005 1 2024-09-17T01:52:17.648 INFO:tasks.workunit.client.0.smithi031.stdout:3/976: dwrite db/df/d1d/fce [0,4194304] 0 2024-09-17T01:52:17.649 INFO:tasks.workunit.client.0.smithi031.stdout:9/902: unlink d3/d4c/l5e 0 2024-09-17T01:52:17.650 INFO:tasks.workunit.client.1.smithi092.stdout:0/731: dwrite d3/da/fb [0,4194304] 0 2024-09-17T01:52:17.651 INFO:tasks.workunit.client.0.smithi031.stdout:8/840: sync 2024-09-17T01:52:17.651 INFO:tasks.workunit.client.0.smithi031.stdout:1/886: sync 2024-09-17T01:52:17.651 INFO:tasks.workunit.client.0.smithi031.stdout:9/903: fsync d3/d4c/d102/d114/f8b 0 2024-09-17T01:52:17.652 INFO:tasks.workunit.client.0.smithi031.stdout:5/906: dwrite da/d14/dac/d82/d92/f94 [0,4194304] 0 2024-09-17T01:52:17.652 INFO:tasks.workunit.client.0.smithi031.stdout:3/977: unlink db/f1f 0 2024-09-17T01:52:17.653 INFO:tasks.workunit.client.0.smithi031.stdout:8/841: chown d0/feb 48779 1 2024-09-17T01:52:17.653 INFO:tasks.workunit.client.0.smithi031.stdout:1/887: readlink d4/d1e/d3f/d72/l113 0 2024-09-17T01:52:17.655 INFO:tasks.workunit.client.1.smithi092.stdout:8/633: dwrite d15/d25/d27/dae/fb7 [0,4194304] 0 2024-09-17T01:52:17.655 INFO:tasks.workunit.client.1.smithi092.stdout:0/732: truncate d3/d2e/d3b/d8f/fb6 1833579 0 2024-09-17T01:52:17.656 INFO:tasks.workunit.client.0.smithi031.stdout:9/904: creat d3/d19/d80/f12d x:0 0 0 2024-09-17T01:52:17.657 INFO:tasks.workunit.client.0.smithi031.stdout:3/978: mkdir db/df/dc8/d6a/d83/d13d 0 2024-09-17T01:52:17.658 INFO:tasks.workunit.client.0.smithi031.stdout:8/842: creat d0/d5/d54/d60/dbb/f103 x:0 0 0 2024-09-17T01:52:17.662 INFO:tasks.workunit.client.0.smithi031.stdout:1/888: symlink d4/d1e/d5d/d118/l129 0 2024-09-17T01:52:17.662 INFO:tasks.workunit.client.1.smithi092.stdout:0/733: write d3/d2e/d55/d63/f6d [305957,76529] 0 2024-09-17T01:52:17.664 INFO:tasks.workunit.client.0.smithi031.stdout:9/905: mkdir d3/d4/da0/d36/d99/de5/d12e 0 2024-09-17T01:52:17.665 INFO:tasks.workunit.client.1.smithi092.stdout:8/634: truncate d15/f1d 213553 0 2024-09-17T01:52:17.665 INFO:tasks.workunit.client.0.smithi031.stdout:3/979: getdents db/df/dc8/d6a/d83/d13d 0 2024-09-17T01:52:17.666 INFO:tasks.workunit.client.1.smithi092.stdout:8/635: mknod d15/d25/d27/d6e/d76/cce 0 2024-09-17T01:52:17.667 INFO:tasks.workunit.client.1.smithi092.stdout:0/734: getdents d3/d2e/d3b/d40 0 2024-09-17T01:52:17.669 INFO:tasks.workunit.client.1.smithi092.stdout:0/735: truncate d3/d2e/d55/d63/dc1/fd6 438853 0 2024-09-17T01:52:17.669 INFO:tasks.workunit.client.1.smithi092.stdout:8/636: mkdir d15/d25/d27/d6e/d95/dcf 0 2024-09-17T01:52:17.674 INFO:tasks.workunit.client.0.smithi031.stdout:5/907: dread da/d14/dac/d82/f8b [0,4194304] 0 2024-09-17T01:52:17.674 INFO:tasks.workunit.client.0.smithi031.stdout:3/980: unlink db/df/dc8/d6a/dc3/ddb/fec 0 2024-09-17T01:52:17.674 INFO:tasks.workunit.client.1.smithi092.stdout:8/637: unlink d15/d25/d2b/d3d/l67 0 2024-09-17T01:52:17.675 INFO:tasks.workunit.client.0.smithi031.stdout:8/843: dwrite d0/d5/d6c/d6d/f72 [0,4194304] 0 2024-09-17T01:52:17.677 INFO:tasks.workunit.client.0.smithi031.stdout:8/844: readlink d0/l76 0 2024-09-17T01:52:17.677 INFO:tasks.workunit.client.0.smithi031.stdout:9/906: dread d3/d19/d1f/f6b [0,4194304] 0 2024-09-17T01:52:17.678 INFO:tasks.workunit.client.0.smithi031.stdout:5/908: symlink da/d14/dac/d82/ddd/l144 0 2024-09-17T01:52:17.679 INFO:tasks.workunit.client.0.smithi031.stdout:8/845: write d0/df/d19/f29 [1598465,50842] 0 2024-09-17T01:52:17.679 INFO:tasks.workunit.client.0.smithi031.stdout:3/981: mkdir db/df/dc8/d6a/d83/de4/d124/d13e 0 2024-09-17T01:52:17.684 INFO:tasks.workunit.client.0.smithi031.stdout:5/909: truncate da/d14/f3b 4205450 0 2024-09-17T01:52:17.690 INFO:tasks.workunit.client.0.smithi031.stdout:9/907: dwrite d3/d4c/d102/d114/fe8 [0,4194304] 0 2024-09-17T01:52:17.694 INFO:tasks.workunit.client.0.smithi031.stdout:9/908: creat d3/d4c/f12f x:0 0 0 2024-09-17T01:52:17.694 INFO:tasks.workunit.client.0.smithi031.stdout:5/910: dwrite da/dc/f73 [0,4194304] 0 2024-09-17T01:52:17.694 INFO:tasks.workunit.client.0.smithi031.stdout:3/982: link db/df/l32 db/df/d1d/d37/d4a/d97/dba/l13f 0 2024-09-17T01:52:17.703 INFO:tasks.workunit.client.0.smithi031.stdout:5/911: dread da/ded/f114 [0,4194304] 0 2024-09-17T01:52:17.703 INFO:tasks.workunit.client.0.smithi031.stdout:5/912: chown da/d4b/l84 398 1 2024-09-17T01:52:17.705 INFO:tasks.workunit.client.0.smithi031.stdout:3/983: link db/df/d1d/d37/d4a/ca4 db/df/d1d/d37/d65/c140 0 2024-09-17T01:52:17.706 INFO:tasks.workunit.client.0.smithi031.stdout:3/984: stat db/da3/d126/f13a 0 2024-09-17T01:52:17.711 INFO:tasks.workunit.client.0.smithi031.stdout:5/913: dwrite da/d42/d12/d4a/f71 [0,4194304] 0 2024-09-17T01:52:17.715 INFO:tasks.workunit.client.0.smithi031.stdout:8/846: dread d0/df/d19/f90 [0,4194304] 0 2024-09-17T01:52:17.715 INFO:tasks.workunit.client.0.smithi031.stdout:5/914: dread da/d14/dac/f59 [0,4194304] 0 2024-09-17T01:52:17.717 INFO:tasks.workunit.client.0.smithi031.stdout:5/915: dread - da/d14/dac/d82/dc3/fe3 zero size 2024-09-17T01:52:17.731 INFO:tasks.workunit.client.0.smithi031.stdout:9/909: dread d3/d19/d10e/f78 [0,4194304] 0 2024-09-17T01:52:17.734 INFO:tasks.workunit.client.1.smithi092.stdout:5/611: sync 2024-09-17T01:52:17.734 INFO:tasks.workunit.client.1.smithi092.stdout:1/894: sync 2024-09-17T01:52:17.734 INFO:tasks.workunit.client.0.smithi031.stdout:9/910: rename d3/d4c/cff to d3/d4/da0/d36/d79/c130 0 2024-09-17T01:52:17.736 INFO:tasks.workunit.client.1.smithi092.stdout:1/895: mknod db/d3b/c11c 0 2024-09-17T01:52:17.736 INFO:tasks.workunit.client.0.smithi031.stdout:9/911: mkdir d3/d4c/d102/d114/d131 0 2024-09-17T01:52:17.737 INFO:tasks.workunit.client.1.smithi092.stdout:5/612: fsync d0/de/d19/d3c/d41/d8d/fc9 0 2024-09-17T01:52:17.740 INFO:tasks.workunit.client.1.smithi092.stdout:1/896: rename db/l16 to db/d6c/d7e/d82/l11d 0 2024-09-17T01:52:17.742 INFO:tasks.workunit.client.1.smithi092.stdout:5/613: creat d0/de/d19/d3c/fcc x:0 0 0 2024-09-17T01:52:17.743 INFO:tasks.workunit.client.1.smithi092.stdout:1/897: creat db/d6c/d7e/f11e x:0 0 0 2024-09-17T01:52:17.745 INFO:tasks.workunit.client.1.smithi092.stdout:1/898: symlink db/d1d/d23/d34/l11f 0 2024-09-17T01:52:17.745 INFO:tasks.workunit.client.1.smithi092.stdout:1/899: readlink l9 0 2024-09-17T01:52:17.747 INFO:tasks.workunit.client.0.smithi031.stdout:1/889: dwrite d4/d1e/d40/daa/dce/d114/f123 [0,4194304] 0 2024-09-17T01:52:17.748 INFO:tasks.workunit.client.1.smithi092.stdout:1/900: link db/d1d/d4b/d9a/lb8 db/d1d/d23/d88/l120 0 2024-09-17T01:52:17.749 INFO:tasks.workunit.client.0.smithi031.stdout:1/890: truncate d4/d1e/d8d/df9/f126 17907 0 2024-09-17T01:52:17.749 INFO:tasks.workunit.client.1.smithi092.stdout:1/901: mkdir db/d3b/d121 0 2024-09-17T01:52:17.751 INFO:tasks.workunit.client.1.smithi092.stdout:1/902: mknod db/d1d/d4b/df3/c122 0 2024-09-17T01:52:17.753 INFO:tasks.workunit.client.0.smithi031.stdout:1/891: creat d4/d1e/d3f/d4d/f12a x:0 0 0 2024-09-17T01:52:17.756 INFO:tasks.workunit.client.0.smithi031.stdout:1/892: read d4/d1e/f3b [2292846,63486] 0 2024-09-17T01:52:17.758 INFO:tasks.workunit.client.1.smithi092.stdout:0/736: write d3/da/d1c/d3a/f66 [1186122,62484] 0 2024-09-17T01:52:17.759 INFO:tasks.workunit.client.1.smithi092.stdout:1/903: dread db/d1d/d23/f5b [0,4194304] 0 2024-09-17T01:52:17.759 INFO:tasks.workunit.client.1.smithi092.stdout:0/737: stat d3/d2e/d3b/d40/d7d/cd4 0 2024-09-17T01:52:17.760 INFO:tasks.workunit.client.1.smithi092.stdout:1/904: chown db/d1d/d23/f3c 193 1 2024-09-17T01:52:17.760 INFO:tasks.workunit.client.1.smithi092.stdout:1/905: chown db/d1d/d23/f45 57872800 1 2024-09-17T01:52:17.761 INFO:tasks.workunit.client.0.smithi031.stdout:3/985: write db/df/d1d/d37/f72 [385796,119407] 0 2024-09-17T01:52:17.762 INFO:tasks.workunit.client.0.smithi031.stdout:8/847: write d0/d5/f5d [1228592,77786] 0 2024-09-17T01:52:17.762 INFO:tasks.workunit.client.1.smithi092.stdout:0/738: creat d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/fe4 x:0 0 0 2024-09-17T01:52:17.763 INFO:tasks.workunit.client.1.smithi092.stdout:1/906: creat db/d6c/d7e/df2/f123 x:0 0 0 2024-09-17T01:52:17.764 INFO:tasks.workunit.client.0.smithi031.stdout:3/986: mkdir db/df/d141 0 2024-09-17T01:52:17.764 INFO:tasks.workunit.client.1.smithi092.stdout:1/907: mknod db/d1d/d23/d34/c124 0 2024-09-17T01:52:17.765 INFO:tasks.workunit.client.1.smithi092.stdout:1/908: truncate db/d3b/fb7 5005422 0 2024-09-17T01:52:17.766 INFO:tasks.workunit.client.0.smithi031.stdout:3/987: fdatasync db/df/f31 0 2024-09-17T01:52:17.766 INFO:tasks.workunit.client.1.smithi092.stdout:1/909: mknod db/d6c/d8b/c125 0 2024-09-17T01:52:17.769 INFO:tasks.workunit.client.0.smithi031.stdout:8/848: dwrite d0/df/dd/d77/dc3/fd7 [0,4194304] 0 2024-09-17T01:52:17.769 INFO:tasks.workunit.client.0.smithi031.stdout:3/988: symlink db/df/d1d/d128/l142 0 2024-09-17T01:52:17.769 INFO:tasks.workunit.client.1.smithi092.stdout:1/910: getdents db/d1d/d23/d55/de5 0 2024-09-17T01:52:17.771 INFO:tasks.workunit.client.1.smithi092.stdout:1/911: symlink db/d1d/d23/d55/l126 0 2024-09-17T01:52:17.771 INFO:tasks.workunit.client.1.smithi092.stdout:1/912: write db/d6c/d7e/d82/de8/f9b [30989,21311] 0 2024-09-17T01:52:17.772 INFO:tasks.workunit.client.1.smithi092.stdout:1/913: chown db/d6c/d7e/d82/de8 1966 1 2024-09-17T01:52:17.773 INFO:tasks.workunit.client.0.smithi031.stdout:8/849: mkdir d0/dcc/d104 0 2024-09-17T01:52:17.774 INFO:tasks.workunit.client.1.smithi092.stdout:1/914: creat db/d3b/f127 x:0 0 0 2024-09-17T01:52:17.776 INFO:tasks.workunit.client.1.smithi092.stdout:1/915: creat db/d1d/d23/d55/de5/f128 x:0 0 0 2024-09-17T01:52:17.777 INFO:tasks.workunit.client.1.smithi092.stdout:1/916: truncate db/d1d/d2e/fcd 9175849 0 2024-09-17T01:52:17.778 INFO:tasks.workunit.client.1.smithi092.stdout:1/917: chown db/d1d/d2e/d62/fbe 16978485 1 2024-09-17T01:52:17.778 INFO:tasks.workunit.client.1.smithi092.stdout:1/918: readlink db/d1d/l76 0 2024-09-17T01:52:17.779 INFO:tasks.workunit.client.1.smithi092.stdout:1/919: dread - db/d1d/d23/da1/f10c zero size 2024-09-17T01:52:17.780 INFO:tasks.workunit.client.0.smithi031.stdout:3/989: dwrite db/df/dc8/d6a/d83/de4/d124/fa0 [0,4194304] 0 2024-09-17T01:52:17.781 INFO:tasks.workunit.client.0.smithi031.stdout:8/850: rename d0/df/f46 to d0/d5/d54/d60/dbb/f105 0 2024-09-17T01:52:17.781 INFO:tasks.workunit.client.1.smithi092.stdout:1/920: write db/d6c/d7e/d82/de8/ff9 [1582800,34793] 0 2024-09-17T01:52:17.782 INFO:tasks.workunit.client.1.smithi092.stdout:1/921: readlink db/d1d/d23/d34/l8f 0 2024-09-17T01:52:17.785 INFO:tasks.workunit.client.1.smithi092.stdout:1/922: creat db/d1d/d23/d55/de5/dd3/f129 x:0 0 0 2024-09-17T01:52:17.785 INFO:tasks.workunit.client.1.smithi092.stdout:5/614: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:17.787 INFO:tasks.workunit.client.0.smithi031.stdout:1/893: write d4/d1a/fed [6202,58771] 0 2024-09-17T01:52:17.787 INFO:tasks.workunit.client.0.smithi031.stdout:5/916: dwrite da/d14/dac/f59 [0,4194304] 0 2024-09-17T01:52:17.788 INFO:tasks.workunit.client.1.smithi092.stdout:1/923: mkdir db/d3b/d12a 0 2024-09-17T01:52:17.789 INFO:tasks.workunit.client.1.smithi092.stdout:1/924: write db/d6c/d7e/df2/ffe [888555,54103] 0 2024-09-17T01:52:17.791 INFO:tasks.workunit.client.0.smithi031.stdout:3/990: fdatasync db/df/d1d/d37/d4a/f94 0 2024-09-17T01:52:17.793 INFO:tasks.workunit.client.0.smithi031.stdout:5/917: readlink da/dc/l21 0 2024-09-17T01:52:17.793 INFO:tasks.workunit.client.1.smithi092.stdout:5/615: link d0/de/d19/f6b d0/d50/d70/fcd 0 2024-09-17T01:52:17.798 INFO:tasks.workunit.client.1.smithi092.stdout:5/616: creat d0/de/d19/d3c/d9e/fce x:0 0 0 2024-09-17T01:52:17.798 INFO:tasks.workunit.client.0.smithi031.stdout:3/991: read db/df/f15 [3150339,63596] 0 2024-09-17T01:52:17.798 INFO:tasks.workunit.client.1.smithi092.stdout:1/925: dwrite db/d1d/d23/d55/de5/dd3/f129 [0,4194304] 0 2024-09-17T01:52:17.799 INFO:tasks.workunit.client.0.smithi031.stdout:3/992: fsync db/da3/fbb 0 2024-09-17T01:52:17.799 INFO:tasks.workunit.client.0.smithi031.stdout:1/894: dread d4/d1e/d40/d84/f8c [0,4194304] 0 2024-09-17T01:52:17.800 INFO:tasks.workunit.client.1.smithi092.stdout:1/926: chown db/d6c 762 1 2024-09-17T01:52:17.801 INFO:tasks.workunit.client.1.smithi092.stdout:1/927: dread - db/d1d/d23/d55/de5/f128 zero size 2024-09-17T01:52:17.801 INFO:tasks.workunit.client.0.smithi031.stdout:3/993: mkdir db/df/d1d/d37/d4a/d97/dba/d143 0 2024-09-17T01:52:17.802 INFO:tasks.workunit.client.1.smithi092.stdout:5/617: symlink d0/de/d19/d1a/d1e/d29/lcf 0 2024-09-17T01:52:17.802 INFO:tasks.workunit.client.0.smithi031.stdout:8/851: dread d0/d5/d9b/f5f [0,4194304] 0 2024-09-17T01:52:17.802 INFO:tasks.workunit.client.1.smithi092.stdout:1/928: fdatasync db/d1d/d23/da1/f10c 0 2024-09-17T01:52:17.803 INFO:tasks.workunit.client.0.smithi031.stdout:1/895: fdatasync d4/d3d/d65/db7/fc2 0 2024-09-17T01:52:17.803 INFO:tasks.workunit.client.1.smithi092.stdout:5/618: write d0/de/d19/d1a/d1e/d3e/f63 [1242465,2388] 0 2024-09-17T01:52:17.804 INFO:tasks.workunit.client.0.smithi031.stdout:3/994: rmdir db/df/d1d 39 2024-09-17T01:52:17.804 INFO:tasks.workunit.client.0.smithi031.stdout:8/852: stat d0/df/d19/d86/cd6 0 2024-09-17T01:52:17.806 INFO:tasks.workunit.client.0.smithi031.stdout:8/853: dread - d0/df/dd/d77/d78/ff8 zero size 2024-09-17T01:52:17.809 INFO:tasks.workunit.client.1.smithi092.stdout:1/929: read db/d1d/d2e/d62/fc0 [266101,106701] 0 2024-09-17T01:52:17.810 INFO:tasks.workunit.client.0.smithi031.stdout:3/995: mknod db/df/d1d/d37/d77/de3/c144 0 2024-09-17T01:52:17.810 INFO:tasks.workunit.client.1.smithi092.stdout:8/638: write d15/d25/d2b/d63/fbf [1118157,102424] 0 2024-09-17T01:52:17.811 INFO:tasks.workunit.client.1.smithi092.stdout:8/639: stat d15/d25/d2b/d63/faa 0 2024-09-17T01:52:17.814 INFO:tasks.workunit.client.0.smithi031.stdout:8/854: dwrite d0/fe3 [0,4194304] 0 2024-09-17T01:52:17.814 INFO:tasks.workunit.client.1.smithi092.stdout:8/640: mkdir d15/d32/d40/d42/d43/d8d/dd0 0 2024-09-17T01:52:17.818 INFO:tasks.workunit.client.1.smithi092.stdout:8/641: mknod d15/d32/d3b/d78/cd1 0 2024-09-17T01:52:17.818 INFO:tasks.workunit.client.1.smithi092.stdout:1/930: dwrite db/d6c/d7e/d82/de8/f10e [0,4194304] 0 2024-09-17T01:52:17.819 INFO:tasks.workunit.client.1.smithi092.stdout:1/931: readlink la 0 2024-09-17T01:52:17.820 INFO:tasks.workunit.client.1.smithi092.stdout:8/642: chown d15/d32/d40/d42/d6b/fb4 1 1 2024-09-17T01:52:17.824 INFO:tasks.workunit.client.1.smithi092.stdout:8/643: mknod d15/d25/d27/d6e/d95/cd2 0 2024-09-17T01:52:17.844 INFO:tasks.workunit.client.0.smithi031.stdout:5/918: dwrite da/d4b/fba [0,4194304] 0 2024-09-17T01:52:17.847 INFO:tasks.workunit.client.0.smithi031.stdout:1/896: dread d4/d1e/d3f/d72/d7e/da2/fb3 [0,4194304] 0 2024-09-17T01:52:17.847 INFO:tasks.workunit.client.0.smithi031.stdout:8/855: dread d0/df/f65 [0,4194304] 0 2024-09-17T01:52:17.851 INFO:tasks.workunit.client.1.smithi092.stdout:8/644: getdents d15/d25/d27/d6e/d95 0 2024-09-17T01:52:17.853 INFO:tasks.workunit.client.0.smithi031.stdout:5/919: link da/d42/l133 da/dc/d98/dfd/l145 0 2024-09-17T01:52:17.853 INFO:tasks.workunit.client.1.smithi092.stdout:8/645: creat d15/d32/d3b/d78/fd3 x:0 0 0 2024-09-17T01:52:17.855 INFO:tasks.workunit.client.1.smithi092.stdout:8/646: symlink d15/d25/d27/d6e/ld4 0 2024-09-17T01:52:17.856 INFO:tasks.workunit.client.1.smithi092.stdout:8/647: fdatasync d15/d32/d3b/d78/d9b/fba 0 2024-09-17T01:52:17.858 INFO:tasks.workunit.client.0.smithi031.stdout:8/856: dwrite d0/d5/d9b/f4b [0,4194304] 0 2024-09-17T01:52:17.859 INFO:tasks.workunit.client.0.smithi031.stdout:3/996: dwrite db/df/dc8/d6a/f92 [0,4194304] 0 2024-09-17T01:52:17.861 INFO:tasks.workunit.client.0.smithi031.stdout:9/912: sync 2024-09-17T01:52:17.864 INFO:tasks.workunit.client.0.smithi031.stdout:3/997: creat db/df/d1d/d37/d77/f145 x:0 0 0 2024-09-17T01:52:17.864 INFO:tasks.workunit.client.0.smithi031.stdout:8/857: symlink d0/l106 0 2024-09-17T01:52:17.867 INFO:tasks.workunit.client.0.smithi031.stdout:8/858: fsync d0/d5/d54/d60/f66 0 2024-09-17T01:52:17.867 INFO:tasks.workunit.client.0.smithi031.stdout:8/859: truncate d0/feb 27721 0 2024-09-17T01:52:17.869 INFO:tasks.workunit.client.0.smithi031.stdout:9/913: getdents d3/d4/da0/d36/d99/db3 0 2024-09-17T01:52:17.871 INFO:tasks.workunit.client.0.smithi031.stdout:9/914: chown d3/d4/d41/d70/f84 3 1 2024-09-17T01:52:17.874 INFO:tasks.workunit.client.0.smithi031.stdout:9/915: symlink d3/d4/da0/d71/l132 0 2024-09-17T01:52:17.876 INFO:tasks.workunit.client.1.smithi092.stdout:8/648: dread d15/d32/f50 [0,4194304] 0 2024-09-17T01:52:17.877 INFO:tasks.workunit.client.0.smithi031.stdout:1/897: dread d4/d1a/d2d/fe [0,4194304] 0 2024-09-17T01:52:17.877 INFO:tasks.workunit.client.0.smithi031.stdout:9/916: symlink d3/d19/d80/l133 0 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:8/649: fdatasync d15/d25/f68 0 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:6/674: sync 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:4/903: sync 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:2/700: sync 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:7/761: sync 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:3/742: sync 2024-09-17T01:52:17.878 INFO:tasks.workunit.client.1.smithi092.stdout:9/732: sync 2024-09-17T01:52:17.881 INFO:tasks.workunit.client.1.smithi092.stdout:3/743: chown d4/d20/d3f/dc0/fd3 10790259 1 2024-09-17T01:52:17.881 INFO:tasks.workunit.client.0.smithi031.stdout:9/917: creat d3/d4/da0/d36/d62/dd8/d125/f134 x:0 0 0 2024-09-17T01:52:17.882 INFO:tasks.workunit.client.1.smithi092.stdout:2/701: mknod d10/d1d/d2c/d5a/ceb 0 2024-09-17T01:52:17.883 INFO:tasks.workunit.client.0.smithi031.stdout:3/998: truncate db/df/f54 3625677 0 2024-09-17T01:52:17.884 INFO:tasks.workunit.client.0.smithi031.stdout:9/918: readlink d3/d4/da0/d36/d99/db3/ld2 0 2024-09-17T01:52:17.884 INFO:tasks.workunit.client.1.smithi092.stdout:8/650: fsync d15/d32/d40/d42/f55 0 2024-09-17T01:52:17.884 INFO:tasks.workunit.client.1.smithi092.stdout:2/702: stat d10/d8d/d8f/dc1 0 2024-09-17T01:52:17.884 INFO:tasks.workunit.client.1.smithi092.stdout:7/762: fdatasync d3/db/d98/dce/fe2 0 2024-09-17T01:52:17.884 INFO:tasks.workunit.client.1.smithi092.stdout:3/744: write d4/d20/f42 [308737,28516] 0 2024-09-17T01:52:17.885 INFO:tasks.workunit.client.0.smithi031.stdout:9/919: chown d3/d19/d80/faf 447 1 2024-09-17T01:52:17.885 INFO:tasks.workunit.client.1.smithi092.stdout:9/733: write d0/df/d17/d9d/fa4 [99010,51066] 0 2024-09-17T01:52:17.887 INFO:tasks.workunit.client.0.smithi031.stdout:3/999: write db/df/dc8/d6a/dc3/ddb/fe5 [750449,14866] 0 2024-09-17T01:52:17.888 INFO:tasks.workunit.client.1.smithi092.stdout:3/745: chown d4/d20/f86 0 1 2024-09-17T01:52:17.888 INFO:tasks.workunit.client.0.smithi031.stdout:8/860: dwrite d0/d5/f87 [0,4194304] 0 2024-09-17T01:52:17.889 INFO:tasks.workunit.client.1.smithi092.stdout:8/651: write d15/d32/d40/d42/f45 [4358447,51059] 0 2024-09-17T01:52:17.889 INFO:tasks.workunit.client.1.smithi092.stdout:4/904: dwrite d4/d7b/ff5 [0,4194304] 0 2024-09-17T01:52:17.889 INFO:tasks.workunit.client.0.smithi031.stdout:9/920: mkdir d3/d47/d96/d127/d135 0 2024-09-17T01:52:17.893 INFO:tasks.workunit.client.1.smithi092.stdout:7/763: write d3/db/d98/dce/fcb [667375,99786] 0 2024-09-17T01:52:17.893 INFO:tasks.workunit.client.1.smithi092.stdout:9/734: truncate d0/df/d17/d9d/fb1 809578 0 2024-09-17T01:52:17.895 INFO:tasks.workunit.client.0.smithi031.stdout:8/861: rename d0/d5/d54/d60/dbb/f103 to d0/d5/d54/d60/f107 0 2024-09-17T01:52:17.896 INFO:tasks.workunit.client.0.smithi031.stdout:5/920: dread da/d42/d12/f86 [0,4194304] 0 2024-09-17T01:52:17.897 INFO:tasks.workunit.client.1.smithi092.stdout:8/652: creat d15/d25/d27/d6e/fd5 x:0 0 0 2024-09-17T01:52:17.898 INFO:tasks.workunit.client.0.smithi031.stdout:5/921: write da/d14/dac/fec [559794,85081] 0 2024-09-17T01:52:17.899 INFO:tasks.workunit.client.0.smithi031.stdout:5/922: stat da/d14/dac/f123 0 2024-09-17T01:52:17.904 INFO:tasks.workunit.client.1.smithi092.stdout:8/653: mknod d15/d25/d27/d6e/cd6 0 2024-09-17T01:52:17.905 INFO:tasks.workunit.client.0.smithi031.stdout:5/923: rename da/d4b/d6c/df2/de7 to da/d14/dac/d82/d146 0 2024-09-17T01:52:17.905 INFO:tasks.workunit.client.0.smithi031.stdout:5/924: stat da/d42/d12/d64 0 2024-09-17T01:52:17.905 INFO:tasks.workunit.client.1.smithi092.stdout:6/675: truncate d3/fa 1149242 0 2024-09-17T01:52:17.906 INFO:tasks.workunit.client.0.smithi031.stdout:5/925: chown da/dc/f27 1674889476 1 2024-09-17T01:52:17.907 INFO:tasks.workunit.client.1.smithi092.stdout:2/703: write d10/d1d/d2c/fb5 [605254,103555] 0 2024-09-17T01:52:17.907 INFO:tasks.workunit.client.0.smithi031.stdout:5/926: write da/d14/dac/d62/f78 [1882724,42490] 0 2024-09-17T01:52:17.909 INFO:tasks.workunit.client.1.smithi092.stdout:4/905: creat d4/d13/d3b/d42/d76/d35/f127 x:0 0 0 2024-09-17T01:52:17.910 INFO:tasks.workunit.client.0.smithi031.stdout:5/927: mknod da/dc/df8/c147 0 2024-09-17T01:52:17.910 INFO:tasks.workunit.client.0.smithi031.stdout:5/928: fdatasync da/d14/dac/d62/f101 0 2024-09-17T01:52:17.912 INFO:tasks.workunit.client.1.smithi092.stdout:4/906: symlink d4/d5/d1d/d107/l128 0 2024-09-17T01:52:17.912 INFO:tasks.workunit.client.0.smithi031.stdout:5/929: creat da/dc/df8/d113/d140/f148 x:0 0 0 2024-09-17T01:52:17.912 INFO:tasks.workunit.client.1.smithi092.stdout:9/735: link d0/ld3 d0/df/le0 0 2024-09-17T01:52:17.913 INFO:tasks.workunit.client.1.smithi092.stdout:9/736: stat d0/d7/d12/d98 0 2024-09-17T01:52:17.913 INFO:tasks.workunit.client.1.smithi092.stdout:6/676: symlink d3/d10/d1f/d21/lcd 0 2024-09-17T01:52:17.914 INFO:tasks.workunit.client.1.smithi092.stdout:6/677: fsync d3/d10/d8c/d49/f75 0 2024-09-17T01:52:17.914 INFO:tasks.workunit.client.1.smithi092.stdout:8/654: getdents d15/d32/d40/d42/d43 0 2024-09-17T01:52:17.915 INFO:tasks.workunit.client.0.smithi031.stdout:5/930: link da/d14/dac/cd6 da/d4b/d126/c149 0 2024-09-17T01:52:17.916 INFO:tasks.workunit.client.1.smithi092.stdout:6/678: read - d3/d25/da8/fb1 zero size 2024-09-17T01:52:17.916 INFO:tasks.workunit.client.1.smithi092.stdout:9/737: rmdir d0/d5 39 2024-09-17T01:52:17.917 INFO:tasks.workunit.client.1.smithi092.stdout:6/679: stat d3/d10/d8c/c4d 0 2024-09-17T01:52:17.918 INFO:tasks.workunit.client.1.smithi092.stdout:8/655: write d15/d25/d2b/d63/fbf [582171,68998] 0 2024-09-17T01:52:17.918 INFO:tasks.workunit.client.0.smithi031.stdout:5/931: mkdir da/d14/d14a 0 2024-09-17T01:52:17.921 INFO:tasks.workunit.client.0.smithi031.stdout:5/932: creat da/dc/df8/d113/f14b x:0 0 0 2024-09-17T01:52:17.922 INFO:tasks.workunit.client.0.smithi031.stdout:9/921: truncate d3/d19/db5/fd6 142593 0 2024-09-17T01:52:17.922 INFO:tasks.workunit.client.0.smithi031.stdout:8/862: write d0/d5/d6c/db0/db7/faf [141109,20747] 0 2024-09-17T01:52:17.923 INFO:tasks.workunit.client.1.smithi092.stdout:7/764: write d3/d6/d13/d21/f38 [2287263,105103] 0 2024-09-17T01:52:17.924 INFO:tasks.workunit.client.0.smithi031.stdout:9/922: fdatasync d3/d4c/d102/d114/fe8 0 2024-09-17T01:52:17.924 INFO:tasks.workunit.client.0.smithi031.stdout:8/863: readlink d0/l4c 0 2024-09-17T01:52:17.926 INFO:tasks.workunit.client.0.smithi031.stdout:9/923: chown d3/d4/da0/d71/dda 1062348455 1 2024-09-17T01:52:17.928 INFO:tasks.workunit.client.0.smithi031.stdout:5/933: dread da/d14/dac/d82/dc3/f130 [0,4194304] 0 2024-09-17T01:52:17.929 INFO:tasks.workunit.client.1.smithi092.stdout:3/746: dwrite d4/d2f/f4f [0,4194304] 0 2024-09-17T01:52:17.931 INFO:tasks.workunit.client.1.smithi092.stdout:4/907: link d4/d13/d3b/d42/d76/d35/d3e/d7c/f116 d4/d13/d3b/d42/d76/d35/f129 0 2024-09-17T01:52:17.932 INFO:tasks.workunit.client.1.smithi092.stdout:6/680: dwrite f2 [0,4194304] 0 2024-09-17T01:52:17.932 INFO:tasks.workunit.client.0.smithi031.stdout:9/924: creat d3/d4/da0/d36/d62/f136 x:0 0 0 2024-09-17T01:52:17.932 INFO:tasks.workunit.client.0.smithi031.stdout:8/864: dread d0/d5/fcb [0,4194304] 0 2024-09-17T01:52:17.933 INFO:tasks.workunit.client.0.smithi031.stdout:8/865: fdatasync d0/d5/d54/d60/f66 0 2024-09-17T01:52:17.933 INFO:tasks.workunit.client.1.smithi092.stdout:6/681: fdatasync d3/d10/d1f/d21/f65 0 2024-09-17T01:52:17.936 INFO:tasks.workunit.client.1.smithi092.stdout:8/656: rmdir d15/d25/dc5 0 2024-09-17T01:52:17.939 INFO:tasks.workunit.client.1.smithi092.stdout:3/747: symlink d4/d16/df0/lf3 0 2024-09-17T01:52:17.940 INFO:tasks.workunit.client.0.smithi031.stdout:5/934: creat da/d14/dac/d62/d10d/d127/d13d/f14c x:0 0 0 2024-09-17T01:52:17.941 INFO:tasks.workunit.client.1.smithi092.stdout:4/908: creat d4/d7b/dc8/f12a x:0 0 0 2024-09-17T01:52:17.942 INFO:tasks.workunit.client.0.smithi031.stdout:8/866: chown d0/d5/d54/lbd 2328 1 2024-09-17T01:52:17.943 INFO:tasks.workunit.client.1.smithi092.stdout:6/682: mknod d3/d10/d1f/d21/d1e/d55/cce 0 2024-09-17T01:52:17.943 INFO:tasks.workunit.client.0.smithi031.stdout:8/867: dread - d0/d5/d6c/db0/fdb zero size 2024-09-17T01:52:17.943 INFO:tasks.workunit.client.1.smithi092.stdout:9/738: truncate d0/d7/d12/d34/f56 486944 0 2024-09-17T01:52:17.944 INFO:tasks.workunit.client.0.smithi031.stdout:8/868: readlink d0/df/d19/l20 0 2024-09-17T01:52:17.945 INFO:tasks.workunit.client.1.smithi092.stdout:8/657: fsync d15/d25/d2b/d63/faa 0 2024-09-17T01:52:17.945 INFO:tasks.workunit.client.0.smithi031.stdout:8/869: truncate d0/d5/d9b/fc4 795485 0 2024-09-17T01:52:17.945 INFO:tasks.workunit.client.1.smithi092.stdout:2/704: dread d10/d5c/d81/f90 [0,4194304] 0 2024-09-17T01:52:17.946 INFO:tasks.workunit.client.0.smithi031.stdout:5/935: creat da/d4b/d6c/df2/d104/f14d x:0 0 0 2024-09-17T01:52:17.947 INFO:tasks.workunit.client.1.smithi092.stdout:4/909: chown d4/d5/c1f 503 1 2024-09-17T01:52:17.948 INFO:tasks.workunit.client.1.smithi092.stdout:6/683: stat d3/d10/d1f/d21/d28/f2f 0 2024-09-17T01:52:17.950 INFO:tasks.workunit.client.1.smithi092.stdout:8/658: rmdir d15/d6f/dcd 39 2024-09-17T01:52:17.950 INFO:tasks.workunit.client.1.smithi092.stdout:4/910: read - d4/d13/d20/de0/f11f zero size 2024-09-17T01:52:17.952 INFO:tasks.workunit.client.0.smithi031.stdout:5/936: rename da/dc/da2/cb1 to da/ded/c14e 0 2024-09-17T01:52:17.952 INFO:tasks.workunit.client.1.smithi092.stdout:8/659: fdatasync d15/d32/f38 0 2024-09-17T01:52:17.952 INFO:tasks.workunit.client.0.smithi031.stdout:9/925: link d3/d4/cac d3/d4c/d102/d114/c137 0 2024-09-17T01:52:17.953 INFO:tasks.workunit.client.1.smithi092.stdout:9/739: fdatasync d0/d5/d29/f52 0 2024-09-17T01:52:17.953 INFO:tasks.workunit.client.0.smithi031.stdout:9/926: dread - d3/d19/d80/fdd zero size 2024-09-17T01:52:17.954 INFO:tasks.workunit.client.0.smithi031.stdout:8/870: symlink d0/d5/l108 0 2024-09-17T01:52:17.955 INFO:tasks.workunit.client.1.smithi092.stdout:7/765: dwrite d3/db/d26/d83/da6/fb1 [0,4194304] 0 2024-09-17T01:52:17.956 INFO:tasks.workunit.client.0.smithi031.stdout:8/871: truncate d0/feb 323154 0 2024-09-17T01:52:17.956 INFO:tasks.workunit.client.0.smithi031.stdout:9/927: getdents d3/d19/d10e/d120 0 2024-09-17T01:52:17.957 INFO:tasks.workunit.client.0.smithi031.stdout:5/937: dread da/d4b/d6c/fc0 [0,4194304] 0 2024-09-17T01:52:17.957 INFO:tasks.workunit.client.1.smithi092.stdout:4/911: fdatasync d4/d5/fd6 0 2024-09-17T01:52:17.958 INFO:tasks.workunit.client.1.smithi092.stdout:3/748: getdents d4/d2f/d44/d54 0 2024-09-17T01:52:17.961 INFO:tasks.workunit.client.0.smithi031.stdout:5/938: truncate da/dc/f27 2864605 0 2024-09-17T01:52:17.961 INFO:tasks.workunit.client.1.smithi092.stdout:4/912: chown d4/dbd/l103 792680 1 2024-09-17T01:52:17.963 INFO:tasks.workunit.client.1.smithi092.stdout:9/740: symlink d0/d7c/da9/le1 0 2024-09-17T01:52:17.963 INFO:tasks.workunit.client.1.smithi092.stdout:4/913: read - d4/d13/d20/de0/f11f zero size 2024-09-17T01:52:17.964 INFO:tasks.workunit.client.0.smithi031.stdout:9/928: dwrite d3/d4c/d102/d114/ff1 [0,4194304] 0 2024-09-17T01:52:17.964 INFO:tasks.workunit.client.1.smithi092.stdout:8/660: dwrite f7 [0,4194304] 0 2024-09-17T01:52:17.965 INFO:tasks.workunit.client.1.smithi092.stdout:4/914: stat d4/d7b 0 2024-09-17T01:52:17.966 INFO:tasks.workunit.client.1.smithi092.stdout:3/749: unlink d4/d16/l19 0 2024-09-17T01:52:17.966 INFO:tasks.workunit.client.0.smithi031.stdout:9/929: mkdir d3/d4/da0/d71/d138 0 2024-09-17T01:52:17.971 INFO:tasks.workunit.client.1.smithi092.stdout:9/741: mknod d0/d5/d3e/ce2 0 2024-09-17T01:52:17.972 INFO:tasks.workunit.client.1.smithi092.stdout:7/766: creat d3/d2b/ffd x:0 0 0 2024-09-17T01:52:17.977 INFO:tasks.workunit.client.1.smithi092.stdout:6/684: write d3/d10/d1f/f30 [155847,40790] 0 2024-09-17T01:52:17.977 INFO:tasks.workunit.client.1.smithi092.stdout:8/661: rmdir d15/d6f 39 2024-09-17T01:52:17.981 INFO:tasks.workunit.client.1.smithi092.stdout:3/750: rename d4/d2f/d44/d3c/cb5 to d4/d2f/d44/d54/dda/cf4 0 2024-09-17T01:52:17.981 INFO:tasks.workunit.client.0.smithi031.stdout:5/939: write da/d14/f53 [16016,71791] 0 2024-09-17T01:52:17.982 INFO:tasks.workunit.client.1.smithi092.stdout:6/685: fdatasync d3/d10/d1f/d21/d28/f54 0 2024-09-17T01:52:17.982 INFO:tasks.workunit.client.1.smithi092.stdout:4/915: dwrite d4/d5/d1d/d30/d3f/d4b/ff9 [0,4194304] 0 2024-09-17T01:52:17.983 INFO:tasks.workunit.client.1.smithi092.stdout:7/767: mkdir d3/db/d98/dce/d60/d93/dfb/dfe 0 2024-09-17T01:52:17.984 INFO:tasks.workunit.client.0.smithi031.stdout:5/940: unlink da/d4b/l84 0 2024-09-17T01:52:17.986 INFO:tasks.workunit.client.1.smithi092.stdout:8/662: write d15/d32/d40/d42/d93/f97 [1409903,11140] 0 2024-09-17T01:52:17.987 INFO:tasks.workunit.client.1.smithi092.stdout:3/751: write d4/d2f/f9a [5499512,128409] 0 2024-09-17T01:52:17.989 INFO:tasks.workunit.client.0.smithi031.stdout:5/941: dwrite da/d42/d26/f34 [4194304,4194304] 0 2024-09-17T01:52:17.990 INFO:tasks.workunit.client.1.smithi092.stdout:2/705: dread d10/d55/f5b [0,4194304] 0 2024-09-17T01:52:17.991 INFO:tasks.workunit.client.1.smithi092.stdout:9/742: dwrite d0/df/d17/d9d/fb1 [0,4194304] 0 2024-09-17T01:52:17.992 INFO:tasks.workunit.client.1.smithi092.stdout:8/663: write d15/d32/f7a [1088542,16594] 0 2024-09-17T01:52:17.994 INFO:tasks.workunit.client.1.smithi092.stdout:2/706: readlink d10/db9/lde 0 2024-09-17T01:52:17.995 INFO:tasks.workunit.client.0.smithi031.stdout:5/942: rename da/dc/df8/c147 to da/dc/da2/c14f 0 2024-09-17T01:52:17.995 INFO:tasks.workunit.client.1.smithi092.stdout:4/916: dread - d4/d13/d3b/d42/d76/d35/fa0 zero size 2024-09-17T01:52:17.998 INFO:tasks.workunit.client.1.smithi092.stdout:9/743: rmdir d0/d7 39 2024-09-17T01:52:17.998 INFO:tasks.workunit.client.1.smithi092.stdout:3/752: chown d4/d13/d2e/d5f/c9d 946302 1 2024-09-17T01:52:17.998 INFO:tasks.workunit.client.1.smithi092.stdout:6/686: symlink d3/d10/d1f/d21/d28/lcf 0 2024-09-17T01:52:18.000 INFO:tasks.workunit.client.0.smithi031.stdout:5/943: link da/d14/dac/d82/dc3/f130 da/d42/d12/d64/d121/f150 0 2024-09-17T01:52:18.002 INFO:tasks.workunit.client.0.smithi031.stdout:5/944: creat da/d14/dac/d62/d10d/f151 x:0 0 0 2024-09-17T01:52:18.003 INFO:tasks.workunit.client.1.smithi092.stdout:0/739: sync 2024-09-17T01:52:18.006 INFO:tasks.workunit.client.1.smithi092.stdout:2/707: unlink d10/d4c/d80/d95/daa/fc4 0 2024-09-17T01:52:18.007 INFO:tasks.workunit.client.0.smithi031.stdout:5/945: link da/d4b/ce0 da/d4b/d6c/df2/d104/c152 0 2024-09-17T01:52:18.007 INFO:tasks.workunit.client.1.smithi092.stdout:3/753: dread d4/d13/f8b [0,4194304] 0 2024-09-17T01:52:18.008 INFO:tasks.workunit.client.1.smithi092.stdout:2/708: stat d10/d1d/d24/d6e/faf 0 2024-09-17T01:52:18.008 INFO:tasks.workunit.client.0.smithi031.stdout:5/946: dread - da/d4b/db4/fd7 zero size 2024-09-17T01:52:18.009 INFO:tasks.workunit.client.1.smithi092.stdout:4/917: creat d4/d5/d8/d99/f12b x:0 0 0 2024-09-17T01:52:18.009 INFO:tasks.workunit.client.0.smithi031.stdout:5/947: dread - da/d42/d12/d4a/faa zero size 2024-09-17T01:52:18.009 INFO:tasks.workunit.client.1.smithi092.stdout:2/709: stat d10/d3a 0 2024-09-17T01:52:18.010 INFO:tasks.workunit.client.1.smithi092.stdout:9/744: stat d0/d7/d12/d86 0 2024-09-17T01:52:18.010 INFO:tasks.workunit.client.0.smithi031.stdout:5/948: rmdir da/d42/d12/d72 39 2024-09-17T01:52:18.011 INFO:tasks.workunit.client.0.smithi031.stdout:5/949: fsync da/d4b/dce/f100 0 2024-09-17T01:52:18.011 INFO:tasks.workunit.client.1.smithi092.stdout:4/918: read - d4/d5/d1d/f9c zero size 2024-09-17T01:52:18.013 INFO:tasks.workunit.client.1.smithi092.stdout:0/740: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:52:18.013 INFO:tasks.workunit.client.1.smithi092.stdout:3/754: creat d4/d20/d9f/dd5/ff5 x:0 0 0 2024-09-17T01:52:18.016 INFO:tasks.workunit.client.1.smithi092.stdout:6/687: link d3/d10/d1f/d21/d1e/d55/f93 d3/d10/d1f/d21/d1e/d55/fd0 0 2024-09-17T01:52:18.018 INFO:tasks.workunit.client.1.smithi092.stdout:2/710: rmdir d10/d4c/d80/d95 39 2024-09-17T01:52:18.018 INFO:tasks.workunit.client.1.smithi092.stdout:4/919: rmdir d4/d5/d8/d99/dd4 39 2024-09-17T01:52:18.021 INFO:tasks.workunit.client.1.smithi092.stdout:9/745: mkdir d0/df/d17/de3 0 2024-09-17T01:52:18.024 INFO:tasks.workunit.client.1.smithi092.stdout:9/746: truncate d0/d7/d12/d34/d26/d54/d6b/fcf 723506 0 2024-09-17T01:52:18.026 INFO:tasks.workunit.client.1.smithi092.stdout:2/711: rename d10/d8d/l3b to d10/d8d/d8f/dc1/lec 0 2024-09-17T01:52:18.030 INFO:tasks.workunit.client.1.smithi092.stdout:4/920: fsync d4/d13/d3b/d42/d76/d35/f129 0 2024-09-17T01:52:18.031 INFO:tasks.workunit.client.1.smithi092.stdout:4/921: chown d4/d5/d8/d99/daf/fce 59859628 1 2024-09-17T01:52:18.032 INFO:tasks.workunit.client.1.smithi092.stdout:9/747: rmdir d0/d7/d12/d86/d93 39 2024-09-17T01:52:18.033 INFO:tasks.workunit.client.0.smithi031.stdout:5/950: rmdir da/dc 39 2024-09-17T01:52:18.033 INFO:tasks.workunit.client.0.smithi031.stdout:5/951: write da/f138 [253125,97362] 0 2024-09-17T01:52:18.035 INFO:tasks.workunit.client.1.smithi092.stdout:4/922: dread d4/d13/d3b/f78 [4194304,4194304] 0 2024-09-17T01:52:18.036 INFO:tasks.workunit.client.0.smithi031.stdout:5/952: mknod da/c153 0 2024-09-17T01:52:18.037 INFO:tasks.workunit.client.0.smithi031.stdout:1/898: sync 2024-09-17T01:52:18.038 INFO:tasks.workunit.client.0.smithi031.stdout:5/953: truncate da/d14/dac/d62/fcf 19085 0 2024-09-17T01:52:18.041 INFO:tasks.workunit.client.1.smithi092.stdout:7/768: dwrite d3/d2b/d84/fab [0,4194304] 0 2024-09-17T01:52:18.043 INFO:tasks.workunit.client.0.smithi031.stdout:5/954: rename da/d42/d26 to da/dc/da2/d107/d13f/d154 0 2024-09-17T01:52:18.043 INFO:tasks.workunit.client.1.smithi092.stdout:4/923: mkdir d4/d13/d3b/d42/d76/d12c 0 2024-09-17T01:52:18.044 INFO:tasks.workunit.client.0.smithi031.stdout:1/899: write d4/d3d/d65/db7/fc2 [575993,29527] 0 2024-09-17T01:52:18.045 INFO:tasks.workunit.client.1.smithi092.stdout:7/769: rename d3/db/d98/dce/d61/fc3 to d3/db/d26/d83/dec/fff 0 2024-09-17T01:52:18.047 INFO:tasks.workunit.client.1.smithi092.stdout:9/748: creat d0/d7/d12/d34/d26/fe4 x:0 0 0 2024-09-17T01:52:18.051 INFO:tasks.workunit.client.1.smithi092.stdout:9/749: dread - d0/d7/d12/d34/d26/d54/d6b/fbc zero size 2024-09-17T01:52:18.052 INFO:tasks.workunit.client.0.smithi031.stdout:1/900: write d4/d1e/d3f/d72/f7a [2570794,36153] 0 2024-09-17T01:52:18.053 INFO:tasks.workunit.client.0.smithi031.stdout:1/901: chown f3 104884 1 2024-09-17T01:52:18.053 INFO:tasks.workunit.client.1.smithi092.stdout:4/924: dwrite d4/d13/d3b/d42/f86 [0,4194304] 0 2024-09-17T01:52:18.056 INFO:tasks.workunit.client.1.smithi092.stdout:7/770: creat d3/d6/d13/f100 x:0 0 0 2024-09-17T01:52:18.061 INFO:tasks.workunit.client.1.smithi092.stdout:9/750: chown d0/d7/fab 459236 1 2024-09-17T01:52:18.062 INFO:tasks.workunit.client.1.smithi092.stdout:6/688: dwrite d3/d10/d1f/d21/d28/f2f [0,4194304] 0 2024-09-17T01:52:18.069 INFO:tasks.workunit.client.1.smithi092.stdout:3/755: dwrite d4/d16/f24 [0,4194304] 0 2024-09-17T01:52:18.070 INFO:tasks.workunit.client.1.smithi092.stdout:7/771: fdatasync d3/d6/d13/d21/d2e/d6e/f2c 0 2024-09-17T01:52:18.072 INFO:tasks.workunit.client.1.smithi092.stdout:2/712: dwrite d10/d55/dda/fa1 [0,4194304] 0 2024-09-17T01:52:18.072 INFO:tasks.workunit.client.1.smithi092.stdout:6/689: truncate d3/d10/d1f/d21/da5/d18/fc9 675237 0 2024-09-17T01:52:18.073 INFO:tasks.workunit.client.1.smithi092.stdout:9/751: mkdir d0/d7/de5 0 2024-09-17T01:52:18.074 INFO:tasks.workunit.client.1.smithi092.stdout:3/756: readlink d4/d2f/d44/d3c/ld9 0 2024-09-17T01:52:18.074 INFO:tasks.workunit.client.1.smithi092.stdout:7/772: fdatasync d3/db/d26/d65/f9d 0 2024-09-17T01:52:18.078 INFO:tasks.workunit.client.1.smithi092.stdout:9/752: symlink d0/d7c/dbd/le6 0 2024-09-17T01:52:18.081 INFO:tasks.workunit.client.1.smithi092.stdout:9/753: fsync d0/d7c/f8e 0 2024-09-17T01:52:18.083 INFO:tasks.workunit.client.1.smithi092.stdout:9/754: write d0/f4c [4094115,95491] 0 2024-09-17T01:52:18.084 INFO:tasks.workunit.client.1.smithi092.stdout:2/713: rename d10/d4c/f8e to d10/d1d/d2c/d5a/d7a/fed 0 2024-09-17T01:52:18.086 INFO:tasks.workunit.client.1.smithi092.stdout:7/773: mknod d3/d2b/d84/da7/c101 0 2024-09-17T01:52:18.086 INFO:tasks.workunit.client.1.smithi092.stdout:4/925: dwrite d4/d5/d46/f50 [4194304,4194304] 0 2024-09-17T01:52:18.087 INFO:tasks.workunit.client.1.smithi092.stdout:9/755: chown d0/d7/d12/d34/d26/fce 2216040 1 2024-09-17T01:52:18.088 INFO:tasks.workunit.client.1.smithi092.stdout:4/926: readlink d4/d13/d20/l71 0 2024-09-17T01:52:18.089 INFO:tasks.workunit.client.1.smithi092.stdout:9/756: dread - d0/d7/d12/d86/fc8 zero size 2024-09-17T01:52:18.089 INFO:tasks.workunit.client.1.smithi092.stdout:6/690: mknod d3/d10/d1f/d21/cd1 0 2024-09-17T01:52:18.091 INFO:tasks.workunit.client.0.smithi031.stdout:1/902: dread d4/d1e/d3f/d72/d7e/da2/fa4 [0,4194304] 0 2024-09-17T01:52:18.092 INFO:tasks.workunit.client.1.smithi092.stdout:9/757: chown d0/d7/d12/d98 7040744 1 2024-09-17T01:52:18.092 INFO:tasks.workunit.client.0.smithi031.stdout:1/903: dread - d4/d3d/de4/fef zero size 2024-09-17T01:52:18.093 INFO:tasks.workunit.client.1.smithi092.stdout:2/714: rename d10/d1d/d24/fba to d10/d3a/fee 0 2024-09-17T01:52:18.094 INFO:tasks.workunit.client.0.smithi031.stdout:1/904: mknod d4/d1e/d3f/d72/d7e/d92/c12b 0 2024-09-17T01:52:18.095 INFO:tasks.workunit.client.1.smithi092.stdout:6/691: symlink d3/d8e/ld2 0 2024-09-17T01:52:18.095 INFO:tasks.workunit.client.1.smithi092.stdout:6/692: chown d3/f33 493 1 2024-09-17T01:52:18.096 INFO:tasks.workunit.client.1.smithi092.stdout:7/774: mknod d3/d6/d13/c102 0 2024-09-17T01:52:18.097 INFO:tasks.workunit.client.1.smithi092.stdout:6/693: chown d3/d10/d1f/d21/d28/c87 0 1 2024-09-17T01:52:18.097 INFO:tasks.workunit.client.0.smithi031.stdout:1/905: symlink d4/d3d/d65/l12c 0 2024-09-17T01:52:18.100 INFO:tasks.workunit.client.0.smithi031.stdout:1/906: fdatasync d4/d1e/d3f/d4d/dcd/fec 0 2024-09-17T01:52:18.100 INFO:tasks.workunit.client.1.smithi092.stdout:6/694: chown d3/d10/d1f/d21/d1e/lbf 230156 1 2024-09-17T01:52:18.101 INFO:tasks.workunit.client.1.smithi092.stdout:7/775: creat d3/db/d98/dce/daf/f103 x:0 0 0 2024-09-17T01:52:18.101 INFO:tasks.workunit.client.1.smithi092.stdout:9/758: read d0/d7/d12/d34/f56 [174806,108824] 0 2024-09-17T01:52:18.102 INFO:tasks.workunit.client.0.smithi031.stdout:1/907: read d4/d1e/f42 [436557,105207] 0 2024-09-17T01:52:18.102 INFO:tasks.workunit.client.1.smithi092.stdout:6/695: stat d3/d10/d1f/d21/da5/d18/fcb 0 2024-09-17T01:52:18.105 INFO:tasks.workunit.client.1.smithi092.stdout:6/696: write d3/d70/f8a [3154824,114089] 0 2024-09-17T01:52:18.105 INFO:tasks.workunit.client.1.smithi092.stdout:7/776: chown d3/db/d26/d83/da6/ld6 2 1 2024-09-17T01:52:18.108 INFO:tasks.workunit.client.1.smithi092.stdout:7/777: chown d3/db/d98/dce/d6a/fdb 210 1 2024-09-17T01:52:18.108 INFO:tasks.workunit.client.1.smithi092.stdout:9/759: mknod d0/d7/d12/d86/d93/d96/ce7 0 2024-09-17T01:52:18.109 INFO:tasks.workunit.client.1.smithi092.stdout:6/697: mknod d3/d10/d1f/d21/da5/d18/cd3 0 2024-09-17T01:52:18.110 INFO:tasks.workunit.client.1.smithi092.stdout:3/757: dread d4/d16/d1b/fbd [0,4194304] 0 2024-09-17T01:52:18.110 INFO:tasks.workunit.client.1.smithi092.stdout:9/760: chown d0/d7/d12/d86/fbb 340038640 1 2024-09-17T01:52:18.111 INFO:tasks.workunit.client.1.smithi092.stdout:6/698: chown d3/d10/d8c/d49/f75 2 1 2024-09-17T01:52:18.112 INFO:tasks.workunit.client.1.smithi092.stdout:7/778: creat d3/db/d98/dce/d6a/dad/f104 x:0 0 0 2024-09-17T01:52:18.113 INFO:tasks.workunit.client.0.smithi031.stdout:1/908: getdents d4/d1e/d40/d84 0 2024-09-17T01:52:18.114 INFO:tasks.workunit.client.1.smithi092.stdout:3/758: creat d4/d16/d1b/ff6 x:0 0 0 2024-09-17T01:52:18.116 INFO:tasks.workunit.client.1.smithi092.stdout:3/759: fdatasync d4/d20/f32 0 2024-09-17T01:52:18.118 INFO:tasks.workunit.client.1.smithi092.stdout:9/761: link d0/d5/fc1 d0/d7c/da9/fe8 0 2024-09-17T01:52:18.119 INFO:tasks.workunit.client.1.smithi092.stdout:9/762: readlink d0/df/l53 0 2024-09-17T01:52:18.121 INFO:tasks.workunit.client.1.smithi092.stdout:2/715: dread d10/d1d/d24/f4f [0,4194304] 0 2024-09-17T01:52:18.122 INFO:tasks.workunit.client.1.smithi092.stdout:7/779: dwrite d3/db/d26/d65/f9d [0,4194304] 0 2024-09-17T01:52:18.122 INFO:tasks.workunit.client.1.smithi092.stdout:6/699: dread d3/d10/d1f/d21/da5/f3e [0,4194304] 0 2024-09-17T01:52:18.122 INFO:tasks.workunit.client.1.smithi092.stdout:9/763: chown d0/d7/d21/f50 312804821 1 2024-09-17T01:52:18.123 INFO:tasks.workunit.client.1.smithi092.stdout:4/927: truncate d4/f8b 481606 0 2024-09-17T01:52:18.127 INFO:tasks.workunit.client.1.smithi092.stdout:9/764: dread - d0/d7/d12/d86/d93/d96/fb3 zero size 2024-09-17T01:52:18.128 INFO:tasks.workunit.client.1.smithi092.stdout:2/716: mknod d10/cef 0 2024-09-17T01:52:18.129 INFO:tasks.workunit.client.1.smithi092.stdout:6/700: dread d3/d10/d8c/d49/fb3 [0,4194304] 0 2024-09-17T01:52:18.129 INFO:tasks.workunit.client.1.smithi092.stdout:4/928: fdatasync d4/d13/d20/de0/f104 0 2024-09-17T01:52:18.130 INFO:tasks.workunit.client.1.smithi092.stdout:2/717: chown d10/d55/dda/fc0 221 1 2024-09-17T01:52:18.131 INFO:tasks.workunit.client.1.smithi092.stdout:7/780: dread d3/db/d26/d83/ffa [0,4194304] 0 2024-09-17T01:52:18.132 INFO:tasks.workunit.client.1.smithi092.stdout:3/760: creat d4/d13/d2e/d6f/dd2/ff7 x:0 0 0 2024-09-17T01:52:18.132 INFO:tasks.workunit.client.1.smithi092.stdout:6/701: chown d3/d10/d8c/d43/d5e 576817 1 2024-09-17T01:52:18.132 INFO:tasks.workunit.client.1.smithi092.stdout:7/781: stat d3/d6/d13/d21/d2e/d6e/f2c 0 2024-09-17T01:52:18.133 INFO:tasks.workunit.client.1.smithi092.stdout:4/929: mkdir d4/d7b/d12d 0 2024-09-17T01:52:18.134 INFO:tasks.workunit.client.1.smithi092.stdout:2/718: dread d10/d1d/d24/f43 [0,4194304] 0 2024-09-17T01:52:18.135 INFO:tasks.workunit.client.1.smithi092.stdout:3/761: truncate d4/d2f/d44/d54/dda/fe5 118900 0 2024-09-17T01:52:18.135 INFO:tasks.workunit.client.1.smithi092.stdout:6/702: creat d3/d10/d1f/d21/d1e/fd4 x:0 0 0 2024-09-17T01:52:18.136 INFO:tasks.workunit.client.1.smithi092.stdout:3/762: chown d4/ld 5049 1 2024-09-17T01:52:18.136 INFO:tasks.workunit.client.1.smithi092.stdout:4/930: chown d4/d5/d8/de2 1159 1 2024-09-17T01:52:18.137 INFO:tasks.workunit.client.1.smithi092.stdout:3/763: fsync d4/d20/d39/f93 0 2024-09-17T01:52:18.140 INFO:tasks.workunit.client.1.smithi092.stdout:6/703: mknod d3/d25/da8/dad/dae/cd5 0 2024-09-17T01:52:18.140 INFO:tasks.workunit.client.0.smithi031.stdout:1/909: mkdir d4/d1e/d5d/d118/d12d 0 2024-09-17T01:52:18.141 INFO:tasks.workunit.client.1.smithi092.stdout:3/764: mknod d4/d2f/d44/d83/cf8 0 2024-09-17T01:52:18.141 INFO:tasks.workunit.client.1.smithi092.stdout:6/704: stat d3/d10/d8c/d43/d6a/d3d/f88 0 2024-09-17T01:52:18.142 INFO:tasks.workunit.client.1.smithi092.stdout:4/931: dwrite d4/f94 [0,4194304] 0 2024-09-17T01:52:18.142 INFO:tasks.workunit.client.0.smithi031.stdout:1/910: rmdir d4/d1e/d3f/d4d/da5 39 2024-09-17T01:52:18.145 INFO:tasks.workunit.client.1.smithi092.stdout:6/705: dread - d3/d10/d1f/d21/d1e/d55/f5b zero size 2024-09-17T01:52:18.146 INFO:tasks.workunit.client.1.smithi092.stdout:4/932: write d4/d13/d3b/d42/d76/d35/f127 [393441,6651] 0 2024-09-17T01:52:18.146 INFO:tasks.workunit.client.1.smithi092.stdout:4/933: read d4/f94 [750183,112026] 0 2024-09-17T01:52:18.148 INFO:tasks.workunit.client.0.smithi031.stdout:1/911: getdents d4/d1e/d3f/d72/d7e/d92 0 2024-09-17T01:52:18.149 INFO:tasks.workunit.client.1.smithi092.stdout:6/706: truncate d3/f4b 1912142 0 2024-09-17T01:52:18.153 INFO:tasks.workunit.client.1.smithi092.stdout:6/707: rename d3/d10/cac to d3/d10/d1f/d21/d1e/cd6 0 2024-09-17T01:52:18.154 INFO:tasks.workunit.client.0.smithi031.stdout:1/912: dread d4/d1e/d40/d84/fc1 [0,4194304] 0 2024-09-17T01:52:18.154 INFO:tasks.workunit.client.1.smithi092.stdout:9/765: dread d0/d7/d12/d86/d93/fd8 [0,4194304] 0 2024-09-17T01:52:18.161 INFO:tasks.workunit.client.1.smithi092.stdout:6/708: dwrite d3/d10/d8c/d43/d5e/d73/f90 [0,4194304] 0 2024-09-17T01:52:18.161 INFO:tasks.workunit.client.0.smithi031.stdout:1/913: dread d4/d3d/d65/fa1 [0,4194304] 0 2024-09-17T01:52:18.163 INFO:tasks.workunit.client.0.smithi031.stdout:1/914: mkdir d4/d1a/d43/d11a/d12e 0 2024-09-17T01:52:18.165 INFO:tasks.workunit.client.1.smithi092.stdout:6/709: unlink d3/d10/d8c/d43/d6a/d3d/d72/l83 0 2024-09-17T01:52:18.169 INFO:tasks.workunit.client.1.smithi092.stdout:6/710: mkdir d3/d10/d8c/d43/d5e/dd7 0 2024-09-17T01:52:18.172 INFO:tasks.workunit.client.0.smithi031.stdout:1/915: dwrite d4/d1a/d43/d53/dd3/dee/d107/f10b [0,4194304] 0 2024-09-17T01:52:18.174 INFO:tasks.workunit.client.1.smithi092.stdout:4/934: write d4/d13/d3b/d42/d76/d35/fa0 [99512,46625] 0 2024-09-17T01:52:18.177 INFO:tasks.workunit.client.0.smithi031.stdout:1/916: creat d4/d1e/d40/daa/f12f x:0 0 0 2024-09-17T01:52:18.177 INFO:tasks.workunit.client.1.smithi092.stdout:6/711: dwrite d3/d10/d1f/f32 [4194304,4194304] 0 2024-09-17T01:52:18.180 INFO:tasks.workunit.client.1.smithi092.stdout:6/712: fsync d3/d10/f57 0 2024-09-17T01:52:18.182 INFO:tasks.workunit.client.1.smithi092.stdout:3/765: dread d4/d20/d9f/dd5/fdc [0,4194304] 0 2024-09-17T01:52:18.182 INFO:tasks.workunit.client.0.smithi031.stdout:1/917: dwrite d4/d1e/d8d/df9/f126 [0,4194304] 0 2024-09-17T01:52:18.182 INFO:tasks.workunit.client.1.smithi092.stdout:4/935: creat d4/d13/d3b/d42/d76/d35/d3e/d7c/f12e x:0 0 0 2024-09-17T01:52:18.188 INFO:tasks.workunit.client.1.smithi092.stdout:9/766: dread d0/d7/d12/d34/d26/f6f [0,4194304] 0 2024-09-17T01:52:18.188 INFO:tasks.workunit.client.0.smithi031.stdout:8/872: sync 2024-09-17T01:52:18.188 INFO:tasks.workunit.client.0.smithi031.stdout:1/918: rename d4/d3d/d65/d78/l89 to d4/d1e/d8d/df9/l130 0 2024-09-17T01:52:18.189 INFO:tasks.workunit.client.0.smithi031.stdout:8/873: read - d0/df/dd/d77/fce zero size 2024-09-17T01:52:18.193 INFO:tasks.workunit.client.0.smithi031.stdout:1/919: creat d4/d1e/f131 x:0 0 0 2024-09-17T01:52:18.195 INFO:tasks.workunit.client.0.smithi031.stdout:1/920: creat d4/d1e/d40/f132 x:0 0 0 2024-09-17T01:52:18.196 INFO:tasks.workunit.client.1.smithi092.stdout:9/767: dwrite d0/d7/d12/d34/f7e [0,4194304] 0 2024-09-17T01:52:18.198 INFO:tasks.workunit.client.1.smithi092.stdout:4/936: truncate d4/d5/fd2 2856648 0 2024-09-17T01:52:18.198 INFO:tasks.workunit.client.0.smithi031.stdout:1/921: creat d4/d1e/f133 x:0 0 0 2024-09-17T01:52:18.198 INFO:tasks.workunit.client.1.smithi092.stdout:9/768: write d0/d7/d12/d34/d26/d54/d6b/fcf [454348,112643] 0 2024-09-17T01:52:18.199 INFO:tasks.workunit.client.1.smithi092.stdout:9/769: readlink d0/ld3 0 2024-09-17T01:52:18.200 INFO:tasks.workunit.client.0.smithi031.stdout:1/922: truncate d4/d3d/de4/fe7 747478 0 2024-09-17T01:52:18.201 INFO:tasks.workunit.client.1.smithi092.stdout:9/770: rmdir d0/d5/d3e/daa 39 2024-09-17T01:52:18.202 INFO:tasks.workunit.client.1.smithi092.stdout:9/771: read - d0/d7/d12/d34/d26/fce zero size 2024-09-17T01:52:18.203 INFO:tasks.workunit.client.0.smithi031.stdout:9/930: sync 2024-09-17T01:52:18.203 INFO:tasks.workunit.client.0.smithi031.stdout:5/955: sync 2024-09-17T01:52:18.205 INFO:tasks.workunit.client.1.smithi092.stdout:9/772: creat d0/d7c/dbd/ddd/fe9 x:0 0 0 2024-09-17T01:52:18.206 INFO:tasks.workunit.client.0.smithi031.stdout:5/956: symlink da/d14/dac/d82/l155 0 2024-09-17T01:52:18.207 INFO:tasks.workunit.client.0.smithi031.stdout:1/923: getdents d4/d1a/d43/d11a 0 2024-09-17T01:52:18.207 INFO:tasks.workunit.client.1.smithi092.stdout:6/713: truncate d3/d10/f57 3207087 0 2024-09-17T01:52:18.208 INFO:tasks.workunit.client.0.smithi031.stdout:8/874: write d0/d5/d9b/f41 [2424680,44371] 0 2024-09-17T01:52:18.209 INFO:tasks.workunit.client.0.smithi031.stdout:8/875: read d0/d5/d9b/f5f [88617,59352] 0 2024-09-17T01:52:18.212 INFO:tasks.workunit.client.0.smithi031.stdout:8/876: mknod d0/df/dd/c109 0 2024-09-17T01:52:18.214 INFO:tasks.workunit.client.1.smithi092.stdout:3/766: dread d4/d2f/fa8 [0,4194304] 0 2024-09-17T01:52:18.214 INFO:tasks.workunit.client.0.smithi031.stdout:8/877: mknod d0/df/c10a 0 2024-09-17T01:52:18.215 INFO:tasks.workunit.client.1.smithi092.stdout:6/714: creat d3/d10/d1f/d21/d28/fd8 x:0 0 0 2024-09-17T01:52:18.215 INFO:tasks.workunit.client.1.smithi092.stdout:9/773: dwrite d0/d7/d12/d34/d26/fce [0,4194304] 0 2024-09-17T01:52:18.218 INFO:tasks.workunit.client.0.smithi031.stdout:8/878: creat d0/f10b x:0 0 0 2024-09-17T01:52:18.219 INFO:tasks.workunit.client.0.smithi031.stdout:5/957: dread f8 [0,4194304] 0 2024-09-17T01:52:18.220 INFO:tasks.workunit.client.0.smithi031.stdout:1/924: write d4/d1e/d5d/dae/f9f [3699503,129976] 0 2024-09-17T01:52:18.221 INFO:tasks.workunit.client.1.smithi092.stdout:9/774: creat d0/d5/d29/fea x:0 0 0 2024-09-17T01:52:18.222 INFO:tasks.workunit.client.1.smithi092.stdout:6/715: fdatasync d3/f4b 0 2024-09-17T01:52:18.223 INFO:tasks.workunit.client.0.smithi031.stdout:8/879: truncate d0/d5/d54/d60/f62 628964 0 2024-09-17T01:52:18.224 INFO:tasks.workunit.client.0.smithi031.stdout:1/925: mknod d4/d1e/d40/daa/dce/dfe/c134 0 2024-09-17T01:52:18.226 INFO:tasks.workunit.client.0.smithi031.stdout:8/880: mknod d0/df/dd/d77/df0/c10c 0 2024-09-17T01:52:18.227 INFO:tasks.workunit.client.1.smithi092.stdout:3/767: creat d4/d20/d3f/ff9 x:0 0 0 2024-09-17T01:52:18.229 INFO:tasks.workunit.client.0.smithi031.stdout:1/926: unlink d4/d3d/c74 0 2024-09-17T01:52:18.230 INFO:tasks.workunit.client.0.smithi031.stdout:5/958: link da/d14/l105 da/d4b/d126/l156 0 2024-09-17T01:52:18.232 INFO:tasks.workunit.client.0.smithi031.stdout:1/927: creat d4/d1a/d2d/d18/f135 x:0 0 0 2024-09-17T01:52:18.232 INFO:tasks.workunit.client.0.smithi031.stdout:8/881: creat d0/f10d x:0 0 0 2024-09-17T01:52:18.234 INFO:tasks.workunit.client.0.smithi031.stdout:1/928: write d4/d1a/d43/d53/dd3/dee/f11b [333258,19139] 0 2024-09-17T01:52:18.234 INFO:tasks.workunit.client.0.smithi031.stdout:5/959: read da/d14/dac/f4c [471506,82855] 0 2024-09-17T01:52:18.236 INFO:tasks.workunit.client.1.smithi092.stdout:9/775: dwrite d0/d5/d29/f52 [0,4194304] 0 2024-09-17T01:52:18.236 INFO:tasks.workunit.client.1.smithi092.stdout:6/716: truncate d3/d25/da8/fba 320716 0 2024-09-17T01:52:18.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:17 smithi092 ceph-mon[33552]: pgmap v19: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 145 MiB/s rd, 392 MiB/s wr, 769 op/s 2024-09-17T01:52:18.239 INFO:tasks.workunit.client.1.smithi092.stdout:6/717: chown d3/d10/d8c/d43/d6a/d3d/f88 482900593 1 2024-09-17T01:52:18.242 INFO:tasks.workunit.client.1.smithi092.stdout:6/718: write d3/d10/d1f/d21/f65 [135827,38556] 0 2024-09-17T01:52:18.244 INFO:tasks.workunit.client.1.smithi092.stdout:5/619: sync 2024-09-17T01:52:18.244 INFO:tasks.workunit.client.1.smithi092.stdout:1/932: sync 2024-09-17T01:52:18.245 INFO:tasks.workunit.client.0.smithi031.stdout:1/929: dwrite d4/d1a/d2d/d18/f10e [0,4194304] 0 2024-09-17T01:52:18.245 INFO:tasks.workunit.client.1.smithi092.stdout:3/768: dwrite d4/d73/d7b/f94 [0,4194304] 0 2024-09-17T01:52:18.248 INFO:tasks.workunit.client.0.smithi031.stdout:1/930: symlink d4/d3d/d65/db7/l136 0 2024-09-17T01:52:18.248 INFO:tasks.workunit.client.1.smithi092.stdout:1/933: dread - db/d6c/d7e/df2/f123 zero size 2024-09-17T01:52:18.248 INFO:tasks.workunit.client.1.smithi092.stdout:5/620: chown d0/de/d19/f1f 170594741 1 2024-09-17T01:52:18.249 INFO:tasks.workunit.client.1.smithi092.stdout:3/769: chown d4/d2f/d44/d54/ff2 1301 1 2024-09-17T01:52:18.249 INFO:tasks.workunit.client.1.smithi092.stdout:9/776: dwrite d0/d7/fab [4194304,4194304] 0 2024-09-17T01:52:18.252 INFO:tasks.workunit.client.1.smithi092.stdout:5/621: chown d0/de/d19/f1f 296324 1 2024-09-17T01:52:18.253 INFO:tasks.workunit.client.1.smithi092.stdout:1/934: creat db/d1d/d4b/d9a/f12b x:0 0 0 2024-09-17T01:52:18.255 INFO:tasks.workunit.client.1.smithi092.stdout:1/935: read - db/d6c/db3/dea/deb/f10b zero size 2024-09-17T01:52:18.255 INFO:tasks.workunit.client.0.smithi031.stdout:1/931: mknod d4/d1e/d3f/d4d/c137 0 2024-09-17T01:52:18.257 INFO:tasks.workunit.client.1.smithi092.stdout:1/936: dread - db/d1d/d23/da1/dbf/f117 zero size 2024-09-17T01:52:18.257 INFO:tasks.workunit.client.1.smithi092.stdout:6/719: truncate d3/d10/d1f/d21/d28/f99 1034260 0 2024-09-17T01:52:18.260 INFO:tasks.workunit.client.1.smithi092.stdout:5/622: mknod d0/de/d19/d3c/cd0 0 2024-09-17T01:52:18.261 INFO:tasks.workunit.client.0.smithi031.stdout:5/960: dwrite da/f6f [0,4194304] 0 2024-09-17T01:52:18.262 INFO:tasks.workunit.client.1.smithi092.stdout:3/770: rename d4/d16/df0 to d4/d16/dfa 0 2024-09-17T01:52:18.263 INFO:tasks.workunit.client.0.smithi031.stdout:5/961: stat da/d4b/f65 0 2024-09-17T01:52:18.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:17 smithi031 ceph-mon[27673]: pgmap v19: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 145 MiB/s rd, 392 MiB/s wr, 769 op/s 2024-09-17T01:52:18.266 INFO:tasks.workunit.client.1.smithi092.stdout:1/937: stat db/d1d/d4b/c105 0 2024-09-17T01:52:18.269 INFO:tasks.workunit.client.0.smithi031.stdout:8/882: dread d0/d5/f40 [0,4194304] 0 2024-09-17T01:52:18.269 INFO:tasks.workunit.client.0.smithi031.stdout:5/962: symlink da/dc/d98/l157 0 2024-09-17T01:52:18.269 INFO:tasks.workunit.client.0.smithi031.stdout:1/932: dwrite d4/d1e/f131 [0,4194304] 0 2024-09-17T01:52:18.270 INFO:tasks.workunit.client.1.smithi092.stdout:5/623: creat d0/de/d19/d1a/d1e/d74/dc8/fd1 x:0 0 0 2024-09-17T01:52:18.271 INFO:tasks.workunit.client.0.smithi031.stdout:8/883: write d0/d5/f40 [464332,25159] 0 2024-09-17T01:52:18.271 INFO:tasks.workunit.client.1.smithi092.stdout:1/938: stat db/d3b/fad 0 2024-09-17T01:52:18.273 INFO:tasks.workunit.client.0.smithi031.stdout:1/933: mkdir d4/d3d/de4/d138 0 2024-09-17T01:52:18.273 INFO:tasks.workunit.client.0.smithi031.stdout:8/884: chown d0/df/dd/d77/l88 21 1 2024-09-17T01:52:18.273 INFO:tasks.workunit.client.1.smithi092.stdout:1/939: chown db/d1d/d23/d34/l8f 31375 1 2024-09-17T01:52:18.274 INFO:tasks.workunit.client.0.smithi031.stdout:1/934: chown d4/d1e/d40/daa 27943 1 2024-09-17T01:52:18.274 INFO:tasks.workunit.client.1.smithi092.stdout:3/771: read d4/d20/d39/f5e [399402,92571] 0 2024-09-17T01:52:18.274 INFO:tasks.workunit.client.0.smithi031.stdout:5/963: creat da/d14/dac/d62/d112/f158 x:0 0 0 2024-09-17T01:52:18.275 INFO:tasks.workunit.client.1.smithi092.stdout:1/940: write db/d1d/d23/f3c [5813546,63391] 0 2024-09-17T01:52:18.276 INFO:tasks.workunit.client.0.smithi031.stdout:8/885: mkdir d0/d5/d6c/d6d/d10e 0 2024-09-17T01:52:18.276 INFO:tasks.workunit.client.1.smithi092.stdout:6/720: link d3/d10/d1f/d21/d1e/fd4 d3/d10/d8c/d43/d6a/d3d/fd9 0 2024-09-17T01:52:18.277 INFO:tasks.workunit.client.0.smithi031.stdout:1/935: fsync d4/d1e/d5d/d118/fbf 0 2024-09-17T01:52:18.277 INFO:tasks.workunit.client.0.smithi031.stdout:8/886: readlink d0/df/dd/d77/l81 0 2024-09-17T01:52:18.279 INFO:tasks.workunit.client.0.smithi031.stdout:1/936: chown d4/d1a/d43/d53/d9e 138802 1 2024-09-17T01:52:18.280 INFO:tasks.workunit.client.0.smithi031.stdout:1/937: read - d4/d3d/de4/f10a zero size 2024-09-17T01:52:18.283 INFO:tasks.workunit.client.1.smithi092.stdout:6/721: dread d3/d10/d1f/f52 [0,4194304] 0 2024-09-17T01:52:18.286 INFO:tasks.workunit.client.1.smithi092.stdout:6/722: write f2 [896749,111253] 0 2024-09-17T01:52:18.288 INFO:tasks.workunit.client.1.smithi092.stdout:3/772: dread d4/d20/f81 [0,4194304] 0 2024-09-17T01:52:18.289 INFO:tasks.workunit.client.1.smithi092.stdout:1/941: dwrite db/d3b/f127 [0,4194304] 0 2024-09-17T01:52:18.290 INFO:tasks.workunit.client.1.smithi092.stdout:6/723: chown d3/d10/d1f/d21/d1e/l5c 1 1 2024-09-17T01:52:18.292 INFO:tasks.workunit.client.1.smithi092.stdout:9/777: dwrite d0/d7c/da9/fe8 [0,4194304] 0 2024-09-17T01:52:18.296 INFO:tasks.workunit.client.1.smithi092.stdout:1/942: creat db/d1d/db5/f12c x:0 0 0 2024-09-17T01:52:18.298 INFO:tasks.workunit.client.1.smithi092.stdout:6/724: creat d3/d10/d1f/d21/fda x:0 0 0 2024-09-17T01:52:18.300 INFO:tasks.workunit.client.1.smithi092.stdout:3/773: dwrite d4/d20/d39/d70/fca [0,4194304] 0 2024-09-17T01:52:18.301 INFO:tasks.workunit.client.1.smithi092.stdout:3/774: chown d4/d2f/d44/d3c/cd6 140 1 2024-09-17T01:52:18.303 INFO:tasks.workunit.client.0.smithi031.stdout:8/887: write d0/d5/d54/d60/f97 [3860381,118696] 0 2024-09-17T01:52:18.304 INFO:tasks.workunit.client.1.smithi092.stdout:9/778: creat d0/d7/d12/d34/d26/feb x:0 0 0 2024-09-17T01:52:18.305 INFO:tasks.workunit.client.1.smithi092.stdout:5/624: write d0/d50/d70/fcd [2568792,83065] 0 2024-09-17T01:52:18.306 INFO:tasks.workunit.client.1.smithi092.stdout:9/779: fdatasync d0/d7/d12/d34/f7e 0 2024-09-17T01:52:18.307 INFO:tasks.workunit.client.0.smithi031.stdout:8/888: write d0/d5/d54/d60/dbb/ff4 [660961,109868] 0 2024-09-17T01:52:18.309 INFO:tasks.workunit.client.0.smithi031.stdout:5/964: dwrite da/d14/dac/d62/f6b [0,4194304] 0 2024-09-17T01:52:18.310 INFO:tasks.workunit.client.0.smithi031.stdout:5/965: chown da/d42/d12/d64 119 1 2024-09-17T01:52:18.312 INFO:tasks.workunit.client.1.smithi092.stdout:5/625: creat d0/de/d19/d3c/d41/fd2 x:0 0 0 2024-09-17T01:52:18.313 INFO:tasks.workunit.client.1.smithi092.stdout:3/775: dread d4/d20/d3f/dc0/fd1 [0,4194304] 0 2024-09-17T01:52:18.314 INFO:tasks.workunit.client.0.smithi031.stdout:5/966: creat da/dc/d98/f159 x:0 0 0 2024-09-17T01:52:18.314 INFO:tasks.workunit.client.1.smithi092.stdout:9/780: truncate d0/d7/d12/d34/d26/d54/f24 3652852 0 2024-09-17T01:52:18.315 INFO:tasks.workunit.client.1.smithi092.stdout:3/776: symlink d4/d20/d39/lfb 0 2024-09-17T01:52:18.316 INFO:tasks.workunit.client.0.smithi031.stdout:5/967: dread - da/dc/df8/d113/fe4 zero size 2024-09-17T01:52:18.317 INFO:tasks.workunit.client.1.smithi092.stdout:5/626: truncate d0/de/d19/d1a/d1e/d74/dc8/fd1 577259 0 2024-09-17T01:52:18.318 INFO:tasks.workunit.client.1.smithi092.stdout:5/627: chown d0/de/f8e 4920 1 2024-09-17T01:52:18.319 INFO:tasks.workunit.client.1.smithi092.stdout:9/781: mknod d0/d7/d12/d34/d26/d54/d6b/cec 0 2024-09-17T01:52:18.319 INFO:tasks.workunit.client.0.smithi031.stdout:8/889: dread d0/d5/d54/d60/f80 [0,4194304] 0 2024-09-17T01:52:18.319 INFO:tasks.workunit.client.0.smithi031.stdout:5/968: rename da/d14/dac/d82/dc3/f130 to da/d4b/db4/f15a 0 2024-09-17T01:52:18.320 INFO:tasks.workunit.client.0.smithi031.stdout:5/969: fdatasync da/dc/f3e 0 2024-09-17T01:52:18.321 INFO:tasks.workunit.client.1.smithi092.stdout:9/782: chown d0/d7/d12/fd0 8142887 1 2024-09-17T01:52:18.322 INFO:tasks.workunit.client.0.smithi031.stdout:5/970: write da/dc/f136 [5168659,13623] 0 2024-09-17T01:52:18.324 INFO:tasks.workunit.client.0.smithi031.stdout:5/971: mknod da/dc/da2/d107/d13f/d154/c15b 0 2024-09-17T01:52:18.325 INFO:tasks.workunit.client.0.smithi031.stdout:5/972: truncate da/d14/f11a 254177 0 2024-09-17T01:52:18.327 INFO:tasks.workunit.client.0.smithi031.stdout:5/973: creat da/d14/dac/d62/d112/f15c x:0 0 0 2024-09-17T01:52:18.327 INFO:tasks.workunit.client.1.smithi092.stdout:6/725: dread d3/f6 [0,4194304] 0 2024-09-17T01:52:18.328 INFO:tasks.workunit.client.0.smithi031.stdout:5/974: mknod da/dc/da2/d107/d13f/c15d 0 2024-09-17T01:52:18.332 INFO:tasks.workunit.client.1.smithi092.stdout:6/726: link d3/d10/d1f/d21/d28/f2c d3/fdb 0 2024-09-17T01:52:18.332 INFO:tasks.workunit.client.1.smithi092.stdout:1/943: dwrite db/d1d/db5/f5e [0,4194304] 0 2024-09-17T01:52:18.334 INFO:tasks.workunit.client.1.smithi092.stdout:6/727: chown d3/d10/d1f/c68 3 1 2024-09-17T01:52:18.334 INFO:tasks.workunit.client.1.smithi092.stdout:6/728: chown d3/d10/d1f/f52 3 1 2024-09-17T01:52:18.335 INFO:tasks.workunit.client.0.smithi031.stdout:5/975: fsync da/d14/dac/d82/d92/f94 0 2024-09-17T01:52:18.337 INFO:tasks.workunit.client.1.smithi092.stdout:1/944: symlink db/d6c/d7e/d82/def/l12d 0 2024-09-17T01:52:18.337 INFO:tasks.workunit.client.1.smithi092.stdout:6/729: fdatasync d3/f6 0 2024-09-17T01:52:18.339 INFO:tasks.workunit.client.0.smithi031.stdout:5/976: rename da/dc/da2/d107/l142 to da/d42/d12/d4a/l15e 0 2024-09-17T01:52:18.341 INFO:tasks.workunit.client.1.smithi092.stdout:1/945: getdents db/d3b/d121 0 2024-09-17T01:52:18.342 INFO:tasks.workunit.client.1.smithi092.stdout:9/783: write d0/d5/f45 [4820510,73757] 0 2024-09-17T01:52:18.342 INFO:tasks.workunit.client.1.smithi092.stdout:5/628: dread d0/fc [4194304,4194304] 0 2024-09-17T01:52:18.344 INFO:tasks.workunit.client.1.smithi092.stdout:6/730: creat d3/d10/d1f/d21/d28/d2b/fdc x:0 0 0 2024-09-17T01:52:18.346 INFO:tasks.workunit.client.1.smithi092.stdout:9/784: getdents d0/df/d17/de3 0 2024-09-17T01:52:18.347 INFO:tasks.workunit.client.1.smithi092.stdout:5/629: getdents d0/de/d19/d3c/d41/d8d/dcb 0 2024-09-17T01:52:18.350 INFO:tasks.workunit.client.1.smithi092.stdout:9/785: mkdir d0/d5/d29/ded 0 2024-09-17T01:52:18.350 INFO:tasks.workunit.client.1.smithi092.stdout:3/777: dread d4/d20/d39/fac [0,4194304] 0 2024-09-17T01:52:18.350 INFO:tasks.workunit.client.1.smithi092.stdout:5/630: rmdir d0/d50/d70 39 2024-09-17T01:52:18.352 INFO:tasks.workunit.client.1.smithi092.stdout:6/731: rename d3/d10/d8c/d43/d5e/d73/d8f/da4/fc3 to d3/d10/d8c/d49/d7e/fdd 0 2024-09-17T01:52:18.354 INFO:tasks.workunit.client.1.smithi092.stdout:5/631: mkdir d0/de/d19/d1a/d1e/d52/d9a/db0/dd3 0 2024-09-17T01:52:18.355 INFO:tasks.workunit.client.1.smithi092.stdout:9/786: mknod d0/cee 0 2024-09-17T01:52:18.357 INFO:tasks.workunit.client.1.smithi092.stdout:3/778: dwrite d4/d2f/f53 [4194304,4194304] 0 2024-09-17T01:52:18.358 INFO:tasks.workunit.client.0.smithi031.stdout:5/977: dread da/d4b/f9c [0,4194304] 0 2024-09-17T01:52:18.358 INFO:tasks.workunit.client.0.smithi031.stdout:5/978: readlink da/d42/lab 0 2024-09-17T01:52:18.365 INFO:tasks.workunit.client.1.smithi092.stdout:5/632: dwrite d0/de/d19/d3c/d41/fd2 [0,4194304] 0 2024-09-17T01:52:18.366 INFO:tasks.workunit.client.0.smithi031.stdout:5/979: dwrite da/d4b/f4d [0,4194304] 0 2024-09-17T01:52:18.368 INFO:tasks.workunit.client.0.smithi031.stdout:5/980: chown da/d14/dac/d62/f78 60833 1 2024-09-17T01:52:18.370 INFO:tasks.workunit.client.1.smithi092.stdout:1/946: dread db/d1d/d4b/f56 [0,4194304] 0 2024-09-17T01:52:18.372 INFO:tasks.workunit.client.1.smithi092.stdout:6/732: dread d3/d10/d8c/d43/d6a/f97 [0,4194304] 0 2024-09-17T01:52:18.373 INFO:tasks.workunit.client.1.smithi092.stdout:1/947: chown db/d1d/db5/lc4 125833 1 2024-09-17T01:52:18.373 INFO:tasks.workunit.client.0.smithi031.stdout:5/981: dread da/d42/d12/d64/f70 [0,4194304] 0 2024-09-17T01:52:18.375 INFO:tasks.workunit.client.0.smithi031.stdout:5/982: creat da/d42/d12/d64/d121/f15f x:0 0 0 2024-09-17T01:52:18.377 INFO:tasks.workunit.client.1.smithi092.stdout:6/733: mknod d3/d25/da8/dad/cde 0 2024-09-17T01:52:18.379 INFO:tasks.workunit.client.1.smithi092.stdout:5/633: getdents d0/de/d19/d1a/d1e/d74/dc8 0 2024-09-17T01:52:18.379 INFO:tasks.workunit.client.1.smithi092.stdout:9/787: write d0/d7/d12/d34/d26/d54/f24 [2646986,57535] 0 2024-09-17T01:52:18.380 INFO:tasks.workunit.client.1.smithi092.stdout:3/779: write d4/d13/d2e/f75 [3341282,19999] 0 2024-09-17T01:52:18.380 INFO:tasks.workunit.client.1.smithi092.stdout:6/734: creat d3/d8e/fdf x:0 0 0 2024-09-17T01:52:18.382 INFO:tasks.workunit.client.1.smithi092.stdout:9/788: readlink d0/df/d17/d9d/lc7 0 2024-09-17T01:52:18.383 INFO:tasks.workunit.client.1.smithi092.stdout:3/780: truncate d4/d20/f81 811121 0 2024-09-17T01:52:18.386 INFO:tasks.workunit.client.1.smithi092.stdout:3/781: write d4/d20/d3f/fc9 [286359,9097] 0 2024-09-17T01:52:18.386 INFO:tasks.workunit.client.1.smithi092.stdout:3/782: readlink d4/l7 0 2024-09-17T01:52:18.387 INFO:tasks.workunit.client.1.smithi092.stdout:5/634: getdents d0/d23 0 2024-09-17T01:52:18.388 INFO:tasks.workunit.client.1.smithi092.stdout:3/783: dread - d4/d73/fee zero size 2024-09-17T01:52:18.389 INFO:tasks.workunit.client.1.smithi092.stdout:6/735: truncate d3/d10/d1f/d21/da5/d18/f27 1097613 0 2024-09-17T01:52:18.389 INFO:tasks.workunit.client.1.smithi092.stdout:9/789: getdents d0/d7/d12/d86/d93/d96 0 2024-09-17T01:52:18.390 INFO:tasks.workunit.client.1.smithi092.stdout:6/736: chown d3/d10/d1f/d21/d28/d2b/cc0 24815 1 2024-09-17T01:52:18.391 INFO:tasks.workunit.client.1.smithi092.stdout:3/784: mknod d4/d73/d8f/d9e/cfc 0 2024-09-17T01:52:18.393 INFO:tasks.workunit.client.1.smithi092.stdout:5/635: mkdir d0/de/dd4 0 2024-09-17T01:52:18.395 INFO:tasks.workunit.client.1.smithi092.stdout:6/737: symlink d3/d10/d8c/le0 0 2024-09-17T01:52:18.397 INFO:tasks.workunit.client.0.smithi031.stdout:5/983: dwrite da/d14/dac/d82/dc3/fcc [0,4194304] 0 2024-09-17T01:52:18.398 INFO:tasks.workunit.client.1.smithi092.stdout:5/636: getdents d0/d50/d70/d78/d8f 0 2024-09-17T01:52:18.399 INFO:tasks.workunit.client.1.smithi092.stdout:9/790: dwrite d0/d7/d21/f50 [0,4194304] 0 2024-09-17T01:52:18.400 INFO:tasks.workunit.client.1.smithi092.stdout:9/791: chown d0/df 13 1 2024-09-17T01:52:18.400 INFO:tasks.workunit.client.1.smithi092.stdout:5/637: readlink d0/de/d19/d1a/d1e/d3e/d4c/l51 0 2024-09-17T01:52:18.401 INFO:tasks.workunit.client.0.smithi031.stdout:5/984: mknod da/d14/dac/d62/d10d/d127/d13d/c160 0 2024-09-17T01:52:18.409 INFO:tasks.workunit.client.1.smithi092.stdout:9/792: mkdir d0/d7/def 0 2024-09-17T01:52:18.410 INFO:tasks.workunit.client.1.smithi092.stdout:5/638: rename d0/de/d19/d1a/d24 to d0/de/d19/d1a/d1e/d74/dc8/dd5 0 2024-09-17T01:52:18.410 INFO:tasks.workunit.client.1.smithi092.stdout:1/948: dread db/d1d/d2e/d62/fbe [0,4194304] 0 2024-09-17T01:52:18.419 INFO:tasks.workunit.client.0.smithi031.stdout:5/985: dwrite da/d14/fe6 [0,4194304] 0 2024-09-17T01:52:18.420 INFO:tasks.workunit.client.0.smithi031.stdout:5/986: stat da/dc/df8/d113/d140 0 2024-09-17T01:52:18.423 INFO:tasks.workunit.client.0.smithi031.stdout:5/987: getdents da/dc/d98 0 2024-09-17T01:52:18.424 INFO:tasks.workunit.client.0.smithi031.stdout:9/931: sync 2024-09-17T01:52:18.425 INFO:tasks.workunit.client.0.smithi031.stdout:5/988: mkdir da/dc/d25/d161 0 2024-09-17T01:52:18.428 INFO:tasks.workunit.client.0.smithi031.stdout:9/932: rename d3/d19/d80/db9/df6 to d3/d4/da0/d36/d79/dd0/d139 0 2024-09-17T01:52:18.428 INFO:tasks.workunit.client.0.smithi031.stdout:5/989: creat da/d42/d12/d72/f162 x:0 0 0 2024-09-17T01:52:18.429 INFO:tasks.workunit.client.1.smithi092.stdout:9/793: symlink d0/df/d17/d9d/lf0 0 2024-09-17T01:52:18.430 INFO:tasks.workunit.client.0.smithi031.stdout:9/933: symlink d3/d19/d10e/d120/l13a 0 2024-09-17T01:52:18.430 INFO:tasks.workunit.client.1.smithi092.stdout:1/949: creat db/d1d/d23/d55/f12e x:0 0 0 2024-09-17T01:52:18.431 INFO:tasks.workunit.client.0.smithi031.stdout:5/990: symlink da/d42/d12/d64/l163 0 2024-09-17T01:52:18.435 INFO:tasks.workunit.client.0.smithi031.stdout:9/934: dwrite d3/fa3 [0,4194304] 0 2024-09-17T01:52:18.442 INFO:tasks.workunit.client.0.smithi031.stdout:9/935: link d3/d4c/d102/d114/d64/lc1 d3/l13b 0 2024-09-17T01:52:18.443 INFO:tasks.workunit.client.0.smithi031.stdout:5/991: truncate da/d42/d12/d4a/f71 3353893 0 2024-09-17T01:52:18.444 INFO:tasks.workunit.client.0.smithi031.stdout:5/992: fdatasync da/dc/d98/fff 0 2024-09-17T01:52:18.445 INFO:tasks.workunit.client.0.smithi031.stdout:5/993: readlink da/dc/d25/l7f 0 2024-09-17T01:52:18.446 INFO:tasks.workunit.client.1.smithi092.stdout:5/639: dread d0/fd [0,4194304] 0 2024-09-17T01:52:18.447 INFO:tasks.workunit.client.0.smithi031.stdout:5/994: creat da/d4b/d6c/df2/f164 x:0 0 0 2024-09-17T01:52:18.449 INFO:tasks.workunit.client.0.smithi031.stdout:5/995: fdatasync da/d42/f8c 0 2024-09-17T01:52:18.450 INFO:tasks.workunit.client.0.smithi031.stdout:5/996: write da/d4b/f139 [343047,36503] 0 2024-09-17T01:52:18.450 INFO:tasks.workunit.client.0.smithi031.stdout:5/997: stat da/d14/f53 0 2024-09-17T01:52:18.451 INFO:tasks.workunit.client.0.smithi031.stdout:5/998: truncate da/f6f 5100286 0 2024-09-17T01:52:18.452 INFO:tasks.workunit.client.0.smithi031.stdout:5/999: write da/d14/dac/f59 [2165487,122753] 0 2024-09-17T01:52:18.466 INFO:tasks.workunit.client.1.smithi092.stdout:8/664: sync 2024-09-17T01:52:18.473 INFO:tasks.workunit.client.1.smithi092.stdout:9/794: rmdir d0/d7/d12/d34/d26/d54/d6b 39 2024-09-17T01:52:18.478 INFO:tasks.workunit.client.0.smithi031.stdout:1/938: sync 2024-09-17T01:52:18.480 INFO:tasks.workunit.client.0.smithi031.stdout:9/936: truncate d3/fa3 4034140 0 2024-09-17T01:52:18.482 INFO:tasks.workunit.client.0.smithi031.stdout:1/939: creat d4/d1e/d3f/d72/d7e/f139 x:0 0 0 2024-09-17T01:52:18.483 INFO:tasks.workunit.client.1.smithi092.stdout:8/665: rename d15/d25/d27/dae to d15/d25/d27/d49/dd7 0 2024-09-17T01:52:18.484 INFO:tasks.workunit.client.1.smithi092.stdout:8/666: stat d15/d32/d3b/d78/d9e/da0 0 2024-09-17T01:52:18.484 INFO:tasks.workunit.client.0.smithi031.stdout:9/937: creat d3/d19/f13c x:0 0 0 2024-09-17T01:52:18.486 INFO:tasks.workunit.client.0.smithi031.stdout:1/940: creat d4/d1a/d43/d10c/f13a x:0 0 0 2024-09-17T01:52:18.486 INFO:tasks.workunit.client.1.smithi092.stdout:8/667: creat d15/d25/d27/d6e/fd8 x:0 0 0 2024-09-17T01:52:18.488 INFO:tasks.workunit.client.1.smithi092.stdout:8/668: mkdir d15/d32/d40/d42/d6b/dd9 0 2024-09-17T01:52:18.489 INFO:tasks.workunit.client.0.smithi031.stdout:1/941: creat d4/d1e/d40/daa/dce/d114/f13b x:0 0 0 2024-09-17T01:52:18.491 INFO:tasks.workunit.client.1.smithi092.stdout:1/950: truncate db/d1d/db5/fe1 2292282 0 2024-09-17T01:52:18.491 INFO:tasks.workunit.client.1.smithi092.stdout:9/795: dread d0/d7/d12/d34/d26/f90 [0,4194304] 0 2024-09-17T01:52:18.492 INFO:tasks.workunit.client.1.smithi092.stdout:1/951: write db/d1d/d23/d34/fb0 [3926906,109164] 0 2024-09-17T01:52:18.493 INFO:tasks.workunit.client.1.smithi092.stdout:1/952: fdatasync db/d6c/d7e/df2/f123 0 2024-09-17T01:52:18.494 INFO:tasks.workunit.client.0.smithi031.stdout:9/938: truncate d3/d4c/d102/d114/d64/fe2 11462282 0 2024-09-17T01:52:18.495 INFO:tasks.workunit.client.1.smithi092.stdout:5/640: write d0/de/f11 [2014193,109452] 0 2024-09-17T01:52:18.496 INFO:tasks.workunit.client.0.smithi031.stdout:1/942: dwrite d4/d1e/d3f/d4d/f6f [0,4194304] 0 2024-09-17T01:52:18.497 INFO:tasks.workunit.client.1.smithi092.stdout:1/953: fsync db/d3b/fad 0 2024-09-17T01:52:18.498 INFO:tasks.workunit.client.1.smithi092.stdout:5/641: readlink d0/de/d19/d1a/d1e/d74/dc8/la1 0 2024-09-17T01:52:18.498 INFO:tasks.workunit.client.0.smithi031.stdout:1/943: chown d4/d1e/d40/daa/dce/d114 0 1 2024-09-17T01:52:18.498 INFO:tasks.workunit.client.0.smithi031.stdout:9/939: unlink d3/d4/da0/d36/d99/lba 0 2024-09-17T01:52:18.500 INFO:tasks.workunit.client.1.smithi092.stdout:9/796: creat d0/d7/d12/d86/ff1 x:0 0 0 2024-09-17T01:52:18.504 INFO:tasks.workunit.client.1.smithi092.stdout:9/797: write d0/d7/d12/d34/fc5 [1189570,128008] 0 2024-09-17T01:52:18.504 INFO:tasks.workunit.client.0.smithi031.stdout:1/944: truncate d4/d3d/d65/db7/fc2 1645475 0 2024-09-17T01:52:18.505 INFO:tasks.workunit.client.0.smithi031.stdout:1/945: chown d4/d1a/c71 90 1 2024-09-17T01:52:18.505 INFO:tasks.workunit.client.1.smithi092.stdout:8/669: rename d15/d32 to d15/d25/d27/d6e/d95/dda 0 2024-09-17T01:52:18.505 INFO:tasks.workunit.client.0.smithi031.stdout:9/940: dwrite d3/fb [0,4194304] 0 2024-09-17T01:52:18.511 INFO:tasks.workunit.client.1.smithi092.stdout:9/798: dwrite d0/d7c/dbd/ddd/fe9 [0,4194304] 0 2024-09-17T01:52:18.512 INFO:tasks.workunit.client.0.smithi031.stdout:9/941: creat d3/d4/da0/d36/d99/de5/d12e/f13d x:0 0 0 2024-09-17T01:52:18.512 INFO:tasks.workunit.client.1.smithi092.stdout:9/799: chown d0/d5/d29/f6a 51493 1 2024-09-17T01:52:18.513 INFO:tasks.workunit.client.1.smithi092.stdout:8/670: rename d15/d25/d27/d6e/d95/dda/d3b/f9d to d15/d25/d2b/d63/fdb 0 2024-09-17T01:52:18.513 INFO:tasks.workunit.client.0.smithi031.stdout:1/946: dread d4/d3d/de4/fe7 [0,4194304] 0 2024-09-17T01:52:18.516 INFO:tasks.workunit.client.0.smithi031.stdout:1/947: mkdir d4/d1e/d5d/d118/d13c 0 2024-09-17T01:52:18.518 INFO:tasks.workunit.client.0.smithi031.stdout:9/942: rmdir d3/d4/da0/d36/d62/db2 39 2024-09-17T01:52:18.521 INFO:tasks.workunit.client.0.smithi031.stdout:1/948: dread d4/d1e/f49 [0,4194304] 0 2024-09-17T01:52:18.523 INFO:tasks.workunit.client.0.smithi031.stdout:9/943: mknod d3/d4/da0/d36/d62/db2/dd4/c13e 0 2024-09-17T01:52:18.524 INFO:tasks.workunit.client.0.smithi031.stdout:1/949: creat d4/d1a/d43/d53/dd3/dee/d107/f13d x:0 0 0 2024-09-17T01:52:18.526 INFO:tasks.workunit.client.0.smithi031.stdout:9/944: creat d3/d4/da0/d36/d99/de5/f13f x:0 0 0 2024-09-17T01:52:18.526 INFO:tasks.workunit.client.0.smithi031.stdout:1/950: read d4/d1e/d3f/d4d/f6f [4387472,113378] 0 2024-09-17T01:52:18.529 INFO:tasks.workunit.client.0.smithi031.stdout:9/945: symlink d3/d19/d1f/l140 0 2024-09-17T01:52:18.530 INFO:tasks.workunit.client.1.smithi092.stdout:5/642: dread d0/de/d19/f6b [0,4194304] 0 2024-09-17T01:52:18.530 INFO:tasks.workunit.client.0.smithi031.stdout:9/946: write d3/d4/da0/d36/d62/fe7 [4006137,117395] 0 2024-09-17T01:52:18.531 INFO:tasks.workunit.client.0.smithi031.stdout:9/947: dread - d3/d4/da0/d36/f10b zero size 2024-09-17T01:52:18.532 INFO:tasks.workunit.client.0.smithi031.stdout:8/890: sync 2024-09-17T01:52:18.533 INFO:tasks.workunit.client.1.smithi092.stdout:5/643: getdents d0/de/d19/d1a/d1e/d74/dc8/dd5 0 2024-09-17T01:52:18.533 INFO:tasks.workunit.client.0.smithi031.stdout:9/948: fdatasync d3/d4/da0/f38 0 2024-09-17T01:52:18.535 INFO:tasks.workunit.client.0.smithi031.stdout:8/891: truncate d0/d5/d54/ffb 398772 0 2024-09-17T01:52:18.536 INFO:tasks.workunit.client.1.smithi092.stdout:5/644: unlink d0/de/d19/d1a/d1e/l2e 0 2024-09-17T01:52:18.537 INFO:tasks.workunit.client.0.smithi031.stdout:8/892: write d0/d5/d6c/d6d/f8f [3954721,44655] 0 2024-09-17T01:52:18.537 INFO:tasks.workunit.client.1.smithi092.stdout:9/800: truncate d0/d7/d12/d86/d93/d96/f41 4734333 0 2024-09-17T01:52:18.538 INFO:tasks.workunit.client.0.smithi031.stdout:9/949: truncate d3/d4/d41/fbc 1515537 0 2024-09-17T01:52:18.540 INFO:tasks.workunit.client.1.smithi092.stdout:9/801: write d0/d7/d12/d34/d26/d54/f87 [409592,24731] 0 2024-09-17T01:52:18.540 INFO:tasks.workunit.client.1.smithi092.stdout:8/671: dwrite d15/d25/d27/d6e/fa9 [0,4194304] 0 2024-09-17T01:52:18.542 INFO:tasks.workunit.client.1.smithi092.stdout:8/672: chown d15/d25/d2b/l54 14279092 1 2024-09-17T01:52:18.542 INFO:tasks.workunit.client.0.smithi031.stdout:8/893: mknod d0/c10f 0 2024-09-17T01:52:18.543 INFO:tasks.workunit.client.0.smithi031.stdout:8/894: write d0/fe3 [1305350,13381] 0 2024-09-17T01:52:18.544 INFO:tasks.workunit.client.1.smithi092.stdout:8/673: write d15/d25/d27/d6e/d95/dda/d40/d42/f45 [2856852,104807] 0 2024-09-17T01:52:18.547 INFO:tasks.workunit.client.0.smithi031.stdout:8/895: getdents d0/df/dd/d59/df7 0 2024-09-17T01:52:18.548 INFO:tasks.workunit.client.1.smithi092.stdout:8/674: symlink d15/d25/d27/d6e/d95/dcf/ldc 0 2024-09-17T01:52:18.549 INFO:tasks.workunit.client.0.smithi031.stdout:8/896: dread - d0/d5/fdd zero size 2024-09-17T01:52:18.549 INFO:tasks.workunit.client.1.smithi092.stdout:8/675: fsync fa 0 2024-09-17T01:52:18.550 INFO:tasks.workunit.client.1.smithi092.stdout:8/676: dread - d15/d25/d27/d49/fad zero size 2024-09-17T01:52:18.552 INFO:tasks.workunit.client.0.smithi031.stdout:1/951: dwrite d4/d1e/d40/f54 [4194304,4194304] 0 2024-09-17T01:52:18.553 INFO:tasks.workunit.client.0.smithi031.stdout:8/897: creat d0/df/dd/d9c/f110 x:0 0 0 2024-09-17T01:52:18.554 INFO:tasks.workunit.client.1.smithi092.stdout:9/802: dwrite d0/d7/d12/d34/d26/d54/fa7 [0,4194304] 0 2024-09-17T01:52:18.555 INFO:tasks.workunit.client.0.smithi031.stdout:1/952: truncate d4/d1e/d40/d84/f8c 1273723 0 2024-09-17T01:52:18.556 INFO:tasks.workunit.client.0.smithi031.stdout:8/898: truncate d0/d5/d54/d60/f107 970744 0 2024-09-17T01:52:18.557 INFO:tasks.workunit.client.0.smithi031.stdout:8/899: readlink d0/df/d19/l20 0 2024-09-17T01:52:18.560 INFO:tasks.workunit.client.1.smithi092.stdout:9/803: getdents d0/d5/d3e 0 2024-09-17T01:52:18.561 INFO:tasks.workunit.client.0.smithi031.stdout:1/953: truncate d4/d1a/d2d/d18/f39 984723 0 2024-09-17T01:52:18.566 INFO:tasks.workunit.client.1.smithi092.stdout:9/804: creat d0/d7/d12/d34/d26/d54/d6b/ff2 x:0 0 0 2024-09-17T01:52:18.567 INFO:tasks.workunit.client.0.smithi031.stdout:8/900: dwrite d0/d5/f7d [4194304,4194304] 0 2024-09-17T01:52:18.567 INFO:tasks.workunit.client.0.smithi031.stdout:1/954: truncate d4/d1a/d43/d53/dd3/dee/d107/f13d 965042 0 2024-09-17T01:52:18.569 INFO:tasks.workunit.client.0.smithi031.stdout:8/901: write d0/df/dd/d9c/fe5 [714292,106881] 0 2024-09-17T01:52:18.570 INFO:tasks.workunit.client.1.smithi092.stdout:8/677: dread d15/d25/f68 [0,4194304] 0 2024-09-17T01:52:18.570 INFO:tasks.workunit.client.0.smithi031.stdout:1/955: truncate d4/d1a/d2d/f38 4914336 0 2024-09-17T01:52:18.571 INFO:tasks.workunit.client.0.smithi031.stdout:8/902: rmdir d0/df/d19/d86 39 2024-09-17T01:52:18.573 INFO:tasks.workunit.client.1.smithi092.stdout:8/678: fdatasync d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/d9a/fcb 0 2024-09-17T01:52:18.573 INFO:tasks.workunit.client.0.smithi031.stdout:1/956: symlink d4/d1e/d5d/l13e 0 2024-09-17T01:52:18.575 INFO:tasks.workunit.client.0.smithi031.stdout:8/903: getdents d0/d5/da2 0 2024-09-17T01:52:18.576 INFO:tasks.workunit.client.1.smithi092.stdout:8/679: creat d15/d25/d2b/d3d/d9f/d8e/fdd x:0 0 0 2024-09-17T01:52:18.578 INFO:tasks.workunit.client.0.smithi031.stdout:8/904: mknod d0/df/dd/d59/df7/c111 0 2024-09-17T01:52:18.580 INFO:tasks.workunit.client.0.smithi031.stdout:8/905: creat d0/d5/d6c/db0/f112 x:0 0 0 2024-09-17T01:52:18.582 INFO:tasks.workunit.client.0.smithi031.stdout:8/906: fsync d0/df/d19/d86/dca/f102 0 2024-09-17T01:52:18.582 INFO:tasks.workunit.client.1.smithi092.stdout:8/680: dwrite d15/d25/d27/d6e/d95/dda/f38 [0,4194304] 0 2024-09-17T01:52:18.583 INFO:tasks.workunit.client.1.smithi092.stdout:8/681: dread - d15/d25/d27/d6e/d95/dda/d40/d42/d43/f90 zero size 2024-09-17T01:52:18.584 INFO:tasks.workunit.client.0.smithi031.stdout:8/907: mkdir d0/df/dd/d113 0 2024-09-17T01:52:18.589 INFO:tasks.workunit.client.0.smithi031.stdout:1/957: truncate d4/d1e/d40/daa/dce/d114/f123 1764457 0 2024-09-17T01:52:18.590 INFO:tasks.workunit.client.1.smithi092.stdout:8/682: read d15/d6f/d8b/f99 [573936,61770] 0 2024-09-17T01:52:18.590 INFO:tasks.workunit.client.0.smithi031.stdout:1/958: chown d4/d1e/d5d/f8f 842 1 2024-09-17T01:52:18.591 INFO:tasks.workunit.client.0.smithi031.stdout:8/908: dwrite d0/d5/d9b/f9e [0,4194304] 0 2024-09-17T01:52:18.592 INFO:tasks.workunit.client.1.smithi092.stdout:9/805: dread d0/d7/d12/d34/d26/d54/f83 [0,4194304] 0 2024-09-17T01:52:18.593 INFO:tasks.workunit.client.1.smithi092.stdout:8/683: rename d15/d25/d27/l6d to d15/d25/d27/d6e/d95/lde 0 2024-09-17T01:52:18.593 INFO:tasks.workunit.client.0.smithi031.stdout:1/959: fsync d4/d1e/d3f/d4d/f6f 0 2024-09-17T01:52:18.594 INFO:tasks.workunit.client.0.smithi031.stdout:1/960: fdatasync d4/d1a/d43/d53/f122 0 2024-09-17T01:52:18.594 INFO:tasks.workunit.client.0.smithi031.stdout:8/909: mknod d0/d5/d54/d60/c114 0 2024-09-17T01:52:18.596 INFO:tasks.workunit.client.1.smithi092.stdout:8/684: creat d15/d25/d27/d6e/d95/dda/d40/d42/d43/d8d/fdf x:0 0 0 2024-09-17T01:52:18.597 INFO:tasks.workunit.client.0.smithi031.stdout:1/961: creat d4/d1e/d5d/f13f x:0 0 0 2024-09-17T01:52:18.598 INFO:tasks.workunit.client.0.smithi031.stdout:1/962: chown d4/d3d/d65/d78/ff3 6812 1 2024-09-17T01:52:18.599 INFO:tasks.workunit.client.0.smithi031.stdout:1/963: readlink d4/d1a/d43/lf1 0 2024-09-17T01:52:18.600 INFO:tasks.workunit.client.1.smithi092.stdout:8/685: truncate d15/d25/d2b/d63/fdb 964197 0 2024-09-17T01:52:18.601 INFO:tasks.workunit.client.0.smithi031.stdout:1/964: dread d4/d3d/d65/fa1 [0,4194304] 0 2024-09-17T01:52:18.601 INFO:tasks.workunit.client.0.smithi031.stdout:8/910: link d0/df/d19/l4a d0/df/dd/d77/d78/l115 0 2024-09-17T01:52:18.602 INFO:tasks.workunit.client.0.smithi031.stdout:8/911: readlink d0/df/dd/da9/lbc 0 2024-09-17T01:52:18.603 INFO:tasks.workunit.client.1.smithi092.stdout:8/686: mkdir d15/d25/d27/d6e/de0 0 2024-09-17T01:52:18.605 INFO:tasks.workunit.client.0.smithi031.stdout:1/965: dread d4/d1a/d43/d53/dd3/dee/f11b [0,4194304] 0 2024-09-17T01:52:18.606 INFO:tasks.workunit.client.1.smithi092.stdout:9/806: dwrite d0/d7/d12/d34/d26/f6f [4194304,4194304] 0 2024-09-17T01:52:18.606 INFO:tasks.workunit.client.1.smithi092.stdout:8/687: truncate d15/d25/d27/d6e/d95/dda/f7a 2036527 0 2024-09-17T01:52:18.607 INFO:tasks.workunit.client.0.smithi031.stdout:1/966: symlink d4/d1a/d43/d11a/l140 0 2024-09-17T01:52:18.607 INFO:tasks.workunit.client.1.smithi092.stdout:8/688: fdatasync d15/d25/d2b/d63/fb8 0 2024-09-17T01:52:18.609 INFO:tasks.workunit.client.1.smithi092.stdout:9/807: creat d0/d7/def/ff3 x:0 0 0 2024-09-17T01:52:18.610 INFO:tasks.workunit.client.1.smithi092.stdout:8/689: creat d15/d25/d2b/d63/fe1 x:0 0 0 2024-09-17T01:52:18.610 INFO:tasks.workunit.client.1.smithi092.stdout:9/808: dread - d0/d7/d12/d34/d26/d54/d6b/fbc zero size 2024-09-17T01:52:18.610 INFO:tasks.workunit.client.0.smithi031.stdout:1/967: symlink d4/d1a/d2d/d18/d52/l141 0 2024-09-17T01:52:18.611 INFO:tasks.workunit.client.1.smithi092.stdout:8/690: chown d15/d6f/dcd 6831 1 2024-09-17T01:52:18.612 INFO:tasks.workunit.client.1.smithi092.stdout:9/809: fdatasync d0/d5/d29/f91 0 2024-09-17T01:52:18.613 INFO:tasks.workunit.client.0.smithi031.stdout:1/968: creat d4/d1e/d3f/d4d/d11d/f142 x:0 0 0 2024-09-17T01:52:18.616 INFO:tasks.workunit.client.1.smithi092.stdout:9/810: symlink d0/d7/d12/d34/d26/lf4 0 2024-09-17T01:52:18.616 INFO:tasks.workunit.client.0.smithi031.stdout:1/969: creat d4/d3d/f143 x:0 0 0 2024-09-17T01:52:18.618 INFO:tasks.workunit.client.0.smithi031.stdout:1/970: mknod d4/d1a/d43/d11a/c144 0 2024-09-17T01:52:18.619 INFO:tasks.workunit.client.0.smithi031.stdout:1/971: dread - d4/d1e/d3f/d72/d7e/da2/f124 zero size 2024-09-17T01:52:18.620 INFO:tasks.workunit.client.1.smithi092.stdout:8/691: dwrite d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/fc4 [0,4194304] 0 2024-09-17T01:52:18.620 INFO:tasks.workunit.client.0.smithi031.stdout:1/972: write d4/d1a/fed [50034,62578] 0 2024-09-17T01:52:18.622 INFO:tasks.workunit.client.0.smithi031.stdout:1/973: symlink d4/d1e/d8d/df9/dfc/l145 0 2024-09-17T01:52:18.624 INFO:tasks.workunit.client.0.smithi031.stdout:1/974: symlink d4/d1e/d3f/d72/l146 0 2024-09-17T01:52:18.625 INFO:tasks.workunit.client.1.smithi092.stdout:8/692: creat d15/d25/d2b/d3d/dc6/fe2 x:0 0 0 2024-09-17T01:52:18.625 INFO:tasks.workunit.client.0.smithi031.stdout:1/975: chown d4/d3d/de4/f10a 977 1 2024-09-17T01:52:18.626 INFO:tasks.workunit.client.1.smithi092.stdout:9/811: dread d0/df/d17/fdf [4194304,4194304] 0 2024-09-17T01:52:18.627 INFO:tasks.workunit.client.1.smithi092.stdout:9/812: stat d0/d7/d12/fd4 0 2024-09-17T01:52:18.627 INFO:tasks.workunit.client.0.smithi031.stdout:8/912: dread d0/d5/d6c/d6d/f8f [0,4194304] 0 2024-09-17T01:52:18.628 INFO:tasks.workunit.client.1.smithi092.stdout:8/693: rmdir d15/d25/d27/d87 39 2024-09-17T01:52:18.628 INFO:tasks.workunit.client.0.smithi031.stdout:1/976: creat d4/d1e/d3f/d72/d7e/f147 x:0 0 0 2024-09-17T01:52:18.631 INFO:tasks.workunit.client.0.smithi031.stdout:8/913: rename d0/d5/fcb to d0/d5/d6c/d6d/d10e/f116 0 2024-09-17T01:52:18.632 INFO:tasks.workunit.client.0.smithi031.stdout:1/977: dread d4/d1e/f49 [0,4194304] 0 2024-09-17T01:52:18.632 INFO:tasks.workunit.client.1.smithi092.stdout:8/694: unlink d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/la5 0 2024-09-17T01:52:18.633 INFO:tasks.workunit.client.0.smithi031.stdout:1/978: read d4/d1e/d40/f54 [8108736,43689] 0 2024-09-17T01:52:18.636 INFO:tasks.workunit.client.0.smithi031.stdout:8/914: dread d0/df/dd/d59/f6f [0,4194304] 0 2024-09-17T01:52:18.637 INFO:tasks.workunit.client.0.smithi031.stdout:1/979: rename d4/d1e/d3f/c46 to d4/d3d/d65/db7/c148 0 2024-09-17T01:52:18.637 INFO:tasks.workunit.client.1.smithi092.stdout:8/695: rename d15/d25/d27/d6e/d95/dda/d40/d42/d6b/l7d to d15/d25/d27/d6e/d95/dda/le3 0 2024-09-17T01:52:18.638 INFO:tasks.workunit.client.1.smithi092.stdout:9/813: truncate d0/d7/d12/d34/d26/d54/fa0 218798 0 2024-09-17T01:52:18.639 INFO:tasks.workunit.client.0.smithi031.stdout:1/980: creat d4/d3d/de4/d138/f149 x:0 0 0 2024-09-17T01:52:18.641 INFO:tasks.workunit.client.1.smithi092.stdout:8/696: rename d15/c28 to d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/ce4 0 2024-09-17T01:52:18.642 INFO:tasks.workunit.client.0.smithi031.stdout:1/981: creat d4/d1e/d3f/d72/d7e/d92/f14a x:0 0 0 2024-09-17T01:52:18.645 INFO:tasks.workunit.client.0.smithi031.stdout:9/950: sync 2024-09-17T01:52:18.645 INFO:tasks.workunit.client.1.smithi092.stdout:9/814: dwrite d0/d7/d12/d34/d26/d54/f24 [0,4194304] 0 2024-09-17T01:52:18.647 INFO:tasks.workunit.client.0.smithi031.stdout:1/982: link d4/d1e/d3f/cb0 d4/d3d/de4/c14b 0 2024-09-17T01:52:18.649 INFO:tasks.workunit.client.0.smithi031.stdout:9/951: mknod d3/d4/da0/d36/d62/db2/dd4/c141 0 2024-09-17T01:52:18.650 INFO:tasks.workunit.client.0.smithi031.stdout:1/983: truncate d4/d1e/d3f/d72/d7e/d92/f14a 1048474 0 2024-09-17T01:52:18.650 INFO:tasks.workunit.client.1.smithi092.stdout:8/697: dread d15/d25/d27/d6e/d95/dda/d40/f96 [0,4194304] 0 2024-09-17T01:52:18.654 INFO:tasks.workunit.client.1.smithi092.stdout:9/815: dwrite d0/f32 [4194304,4194304] 0 2024-09-17T01:52:18.655 INFO:tasks.workunit.client.0.smithi031.stdout:1/984: unlink d4/d1e/d3f/d72/d7e/da2/fbd 0 2024-09-17T01:52:18.656 INFO:tasks.workunit.client.0.smithi031.stdout:9/952: dwrite d3/d19/d1f/f112 [0,4194304] 0 2024-09-17T01:52:18.658 INFO:tasks.workunit.client.0.smithi031.stdout:1/985: chown d4/d3d/d65/db7/l136 353624320 1 2024-09-17T01:52:18.660 INFO:tasks.workunit.client.0.smithi031.stdout:1/986: chown d4/c37 7209669 1 2024-09-17T01:52:18.660 INFO:tasks.workunit.client.1.smithi092.stdout:9/816: readlink d0/d7/d12/d86/l7f 0 2024-09-17T01:52:18.661 INFO:tasks.workunit.client.1.smithi092.stdout:8/698: dwrite d15/d25/d27/d6e/fd5 [0,4194304] 0 2024-09-17T01:52:18.662 INFO:tasks.workunit.client.0.smithi031.stdout:8/915: write d0/f70 [1588379,13429] 0 2024-09-17T01:52:18.665 INFO:tasks.workunit.client.1.smithi092.stdout:8/699: mkdir d15/d6f/de5 0 2024-09-17T01:52:18.665 INFO:tasks.workunit.client.0.smithi031.stdout:9/953: dwrite d3/d4/da0/d36/d99/de5/ff4 [4194304,4194304] 0 2024-09-17T01:52:18.667 INFO:tasks.workunit.client.0.smithi031.stdout:9/954: write d3/d4/da0/d36/f6e [8151003,756] 0 2024-09-17T01:52:18.670 INFO:tasks.workunit.client.1.smithi092.stdout:9/817: rename d0/df/d17/d9d/fa4 to d0/d7/dcc/ff5 0 2024-09-17T01:52:18.672 INFO:tasks.workunit.client.1.smithi092.stdout:9/818: chown d0/d7/d12/d34/d26/lf4 984741242 1 2024-09-17T01:52:18.674 INFO:tasks.workunit.client.0.smithi031.stdout:1/987: fdatasync d4/d1e/d40/daa/dce/d114/f123 0 2024-09-17T01:52:18.675 INFO:tasks.workunit.client.0.smithi031.stdout:9/955: read d3/d19/d1f/f58 [3361668,80932] 0 2024-09-17T01:52:18.677 INFO:tasks.workunit.client.1.smithi092.stdout:8/700: link fa d15/d25/d27/d87/fe6 0 2024-09-17T01:52:18.679 INFO:tasks.workunit.client.0.smithi031.stdout:9/956: mknod d3/d19/db5/c142 0 2024-09-17T01:52:18.682 INFO:tasks.workunit.client.0.smithi031.stdout:1/988: getdents d4/d1a/d2d/d18/d52 0 2024-09-17T01:52:18.683 INFO:tasks.workunit.client.1.smithi092.stdout:7/782: sync 2024-09-17T01:52:18.683 INFO:tasks.workunit.client.1.smithi092.stdout:2/719: sync 2024-09-17T01:52:18.683 INFO:tasks.workunit.client.1.smithi092.stdout:8/701: dwrite d15/d25/d27/d6e/d95/dda/d40/f7b [0,4194304] 0 2024-09-17T01:52:18.684 INFO:tasks.workunit.client.1.smithi092.stdout:0/741: sync 2024-09-17T01:52:18.685 INFO:tasks.workunit.client.1.smithi092.stdout:8/702: write d15/d25/d27/f3e [1388645,34846] 0 2024-09-17T01:52:18.686 INFO:tasks.workunit.client.0.smithi031.stdout:9/957: dwrite d3/fe9 [0,4194304] 0 2024-09-17T01:52:18.687 INFO:tasks.workunit.client.1.smithi092.stdout:0/742: rmdir d3/da 39 2024-09-17T01:52:18.693 INFO:tasks.workunit.client.0.smithi031.stdout:9/958: rmdir d3/d4 39 2024-09-17T01:52:18.694 INFO:tasks.workunit.client.0.smithi031.stdout:9/959: write d3/d19/d80/fdd [553164,68002] 0 2024-09-17T01:52:18.696 INFO:tasks.workunit.client.0.smithi031.stdout:1/989: write d4/d1e/d40/d84/fa6 [357613,14201] 0 2024-09-17T01:52:18.698 INFO:tasks.workunit.client.1.smithi092.stdout:2/720: creat d10/d4c/d80/ff0 x:0 0 0 2024-09-17T01:52:18.698 INFO:tasks.workunit.client.0.smithi031.stdout:9/960: write d3/d19/d1f/f23 [1585901,63238] 0 2024-09-17T01:52:18.701 INFO:tasks.workunit.client.1.smithi092.stdout:0/743: truncate d3/da/f9e 680887 0 2024-09-17T01:52:18.701 INFO:tasks.workunit.client.0.smithi031.stdout:1/990: creat d4/d1a/d43/d53/dd3/dd8/f14c x:0 0 0 2024-09-17T01:52:18.703 INFO:tasks.workunit.client.1.smithi092.stdout:8/703: symlink d15/d25/d27/d6e/d95/dda/d40/d42/d6b/dd9/le7 0 2024-09-17T01:52:18.704 INFO:tasks.workunit.client.0.smithi031.stdout:9/961: unlink d3/d19/d10e/l50 0 2024-09-17T01:52:18.705 INFO:tasks.workunit.client.1.smithi092.stdout:7/783: getdents d3/d6 0 2024-09-17T01:52:18.708 INFO:tasks.workunit.client.0.smithi031.stdout:1/991: dwrite d4/f4a [0,4194304] 0 2024-09-17T01:52:18.709 INFO:tasks.workunit.client.1.smithi092.stdout:2/721: mknod d10/d8d/d8f/d93/cf1 0 2024-09-17T01:52:18.709 INFO:tasks.workunit.client.1.smithi092.stdout:0/744: creat d3/da/d15/dab/fe5 x:0 0 0 2024-09-17T01:52:18.710 INFO:tasks.workunit.client.0.smithi031.stdout:9/962: creat d3/d4/da0/d36/d62/db2/dd4/f143 x:0 0 0 2024-09-17T01:52:18.712 INFO:tasks.workunit.client.1.smithi092.stdout:9/819: dread d0/d7/d12/f99 [0,4194304] 0 2024-09-17T01:52:18.713 INFO:tasks.workunit.client.1.smithi092.stdout:0/745: write d3/d2e/d55/d63/fc0 [2655511,118340] 0 2024-09-17T01:52:18.713 INFO:tasks.workunit.client.1.smithi092.stdout:2/722: getdents d10/d5c/d81/dcb 0 2024-09-17T01:52:18.714 INFO:tasks.workunit.client.1.smithi092.stdout:7/784: dwrite d3/d6/d13/d21/d2e/f97 [0,4194304] 0 2024-09-17T01:52:18.715 INFO:tasks.workunit.client.0.smithi031.stdout:9/963: rename d3/d4/d41/d70/f84 to d3/d4c/d102/d114/d64/f144 0 2024-09-17T01:52:18.717 INFO:tasks.workunit.client.1.smithi092.stdout:9/820: read d0/d7c/da9/fe8 [3616780,75682] 0 2024-09-17T01:52:18.717 INFO:tasks.workunit.client.1.smithi092.stdout:8/704: getdents d15/d25/d27/d6e 0 2024-09-17T01:52:18.719 INFO:tasks.workunit.client.1.smithi092.stdout:2/723: write d10/d1d/d96/d77/f47 [486592,107736] 0 2024-09-17T01:52:18.720 INFO:tasks.workunit.client.1.smithi092.stdout:7/785: chown d3/db/d26/d83/dec/fff 1988229 1 2024-09-17T01:52:18.721 INFO:tasks.workunit.client.0.smithi031.stdout:9/964: dwrite d3/d19/d1f/f23 [4194304,4194304] 0 2024-09-17T01:52:18.721 INFO:tasks.workunit.client.1.smithi092.stdout:8/705: chown f1 109039162 1 2024-09-17T01:52:18.722 INFO:tasks.workunit.client.1.smithi092.stdout:0/746: truncate d3/d2e/d3b/d48/f5b 2795942 0 2024-09-17T01:52:18.725 INFO:tasks.workunit.client.1.smithi092.stdout:7/786: chown d3/db/d26/d65/lde 15017 1 2024-09-17T01:52:18.726 INFO:tasks.workunit.client.0.smithi031.stdout:9/965: rmdir d3/d4/da0/d36/d79/dd0 39 2024-09-17T01:52:18.727 INFO:tasks.workunit.client.1.smithi092.stdout:9/821: unlink d0/d7/d12/d34/d26/d54/fa7 0 2024-09-17T01:52:18.728 INFO:tasks.workunit.client.1.smithi092.stdout:8/706: mknod d15/d25/d27/d6e/ce8 0 2024-09-17T01:52:18.729 INFO:tasks.workunit.client.0.smithi031.stdout:9/966: write d3/d4/da0/d36/d62/db2/fd9 [185545,26038] 0 2024-09-17T01:52:18.729 INFO:tasks.workunit.client.1.smithi092.stdout:8/707: readlink lb 0 2024-09-17T01:52:18.730 INFO:tasks.workunit.client.1.smithi092.stdout:0/747: mknod d3/dc8/dd2/ce6 0 2024-09-17T01:52:18.730 INFO:tasks.workunit.client.0.smithi031.stdout:9/967: symlink d3/d4/l145 0 2024-09-17T01:52:18.732 INFO:tasks.workunit.client.0.smithi031.stdout:1/992: dread d4/f10 [0,4194304] 0 2024-09-17T01:52:18.732 INFO:tasks.workunit.client.0.smithi031.stdout:1/993: chown d4/d1a/d43/d10c 63461499 1 2024-09-17T01:52:18.734 INFO:tasks.workunit.client.1.smithi092.stdout:8/708: write d15/d25/d27/d6e/d95/dda/d3b/d78/fc7 [662176,14681] 0 2024-09-17T01:52:18.734 INFO:tasks.workunit.client.1.smithi092.stdout:7/787: symlink d3/d6/d13/d21/l105 0 2024-09-17T01:52:18.735 INFO:tasks.workunit.client.1.smithi092.stdout:2/724: dwrite d10/d5c/d81/f87 [0,4194304] 0 2024-09-17T01:52:18.737 INFO:tasks.workunit.client.0.smithi031.stdout:1/994: unlink d4/d1e/l2b 0 2024-09-17T01:52:18.738 INFO:tasks.workunit.client.1.smithi092.stdout:9/822: link d0/d7/d12/d86/l7f d0/d5/d29/ded/lf6 0 2024-09-17T01:52:18.740 INFO:tasks.workunit.client.1.smithi092.stdout:2/725: write d10/d1d/d96/d77/f9f [762816,15670] 0 2024-09-17T01:52:18.740 INFO:tasks.workunit.client.1.smithi092.stdout:7/788: unlink d3/db/d26/f72 0 2024-09-17T01:52:18.740 INFO:tasks.workunit.client.0.smithi031.stdout:9/968: dwrite d3/d4/da0/d36/d62/db2/dd4/fdf [4194304,4194304] 0 2024-09-17T01:52:18.740 INFO:tasks.workunit.client.1.smithi092.stdout:8/709: fsync d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/fc4 0 2024-09-17T01:52:18.742 INFO:tasks.workunit.client.1.smithi092.stdout:9/823: creat d0/df/d5d/ff7 x:0 0 0 2024-09-17T01:52:18.747 INFO:tasks.workunit.client.1.smithi092.stdout:8/710: mknod d15/d25/d27/d6e/d95/dda/d40/d42/d43/ce9 0 2024-09-17T01:52:18.749 INFO:tasks.workunit.client.0.smithi031.stdout:9/969: read d3/d4/da0/d36/d8f/ffe [1002029,76036] 0 2024-09-17T01:52:18.749 INFO:tasks.workunit.client.0.smithi031.stdout:1/995: dread d4/d1e/d3f/d72/d7e/d92/f14a [0,4194304] 0 2024-09-17T01:52:18.750 INFO:tasks.workunit.client.0.smithi031.stdout:1/996: write d4/d3d/f11f [627052,70423] 0 2024-09-17T01:52:18.755 INFO:tasks.workunit.client.1.smithi092.stdout:0/748: write d3/da/d1c/f49 [3992971,11044] 0 2024-09-17T01:52:18.758 INFO:tasks.workunit.client.1.smithi092.stdout:0/749: rmdir d3/d2e/d3b/d8f/d5f/db1 39 2024-09-17T01:52:18.759 INFO:tasks.workunit.client.1.smithi092.stdout:0/750: chown d3/d2e/d3b/d8f/fbf 9318260 1 2024-09-17T01:52:18.762 INFO:tasks.workunit.client.1.smithi092.stdout:8/711: dread d15/d25/d2b/d63/fbf [0,4194304] 0 2024-09-17T01:52:18.763 INFO:tasks.workunit.client.1.smithi092.stdout:0/751: rmdir d3/d2e/d3b/d8f/d5f/db1/dd8 39 2024-09-17T01:52:18.766 INFO:tasks.workunit.client.0.smithi031.stdout:1/997: fdatasync d4/d3d/f11f 0 2024-09-17T01:52:18.766 INFO:tasks.workunit.client.1.smithi092.stdout:2/726: dwrite d10/d1d/d2c/d5a/d7a/f7c [0,4194304] 0 2024-09-17T01:52:18.768 INFO:tasks.workunit.client.1.smithi092.stdout:8/712: creat d15/d25/d2b/d3d/dc6/fea x:0 0 0 2024-09-17T01:52:18.771 INFO:tasks.workunit.client.0.smithi031.stdout:1/998: creat d4/d3d/d65/d78/f14d x:0 0 0 2024-09-17T01:52:18.771 INFO:tasks.workunit.client.0.smithi031.stdout:9/970: dwrite d3/d19/f22 [0,4194304] 0 2024-09-17T01:52:18.771 INFO:tasks.workunit.client.0.smithi031.stdout:1/999: stat d4/d1e/d8d 0 2024-09-17T01:52:18.774 INFO:tasks.workunit.client.0.smithi031.stdout:9/971: creat d3/d4/da0/d71/d138/f146 x:0 0 0 2024-09-17T01:52:18.775 INFO:tasks.workunit.client.1.smithi092.stdout:0/752: rename d3/da/f10 to d3/da/d1c/fe7 0 2024-09-17T01:52:18.776 INFO:tasks.workunit.client.1.smithi092.stdout:7/789: dread d3/db/d26/f3b [0,4194304] 0 2024-09-17T01:52:18.777 INFO:tasks.workunit.client.0.smithi031.stdout:9/972: mknod d3/d4/da0/d71/d138/c147 0 2024-09-17T01:52:18.778 INFO:tasks.workunit.client.1.smithi092.stdout:8/713: rename d15/d25/d27/d87/fe6 to d15/d25/d27/d49/feb 0 2024-09-17T01:52:18.778 INFO:tasks.workunit.client.0.smithi031.stdout:9/973: write d3/f1d [609387,107744] 0 2024-09-17T01:52:18.780 INFO:tasks.workunit.client.1.smithi092.stdout:8/714: creat d15/d25/d2b/d3d/dc6/fec x:0 0 0 2024-09-17T01:52:18.782 INFO:tasks.workunit.client.1.smithi092.stdout:7/790: read d3/db/f4a [2308055,117994] 0 2024-09-17T01:52:18.782 INFO:tasks.workunit.client.0.smithi031.stdout:9/974: dread d3/fb [0,4194304] 0 2024-09-17T01:52:18.784 INFO:tasks.workunit.client.1.smithi092.stdout:7/791: truncate d3/d6/d13/d21/d2e/d6e/f99 844040 0 2024-09-17T01:52:18.785 INFO:tasks.workunit.client.1.smithi092.stdout:7/792: chown d3/db/d98/dce/fe2 48923 1 2024-09-17T01:52:18.789 INFO:tasks.workunit.client.1.smithi092.stdout:7/793: rename d3/d6/d13/d21/d2e/f59 to d3/d6/d13/f106 0 2024-09-17T01:52:18.792 INFO:tasks.workunit.client.1.smithi092.stdout:7/794: creat d3/d6/dc2/dc5/f107 x:0 0 0 2024-09-17T01:52:18.795 INFO:tasks.workunit.client.1.smithi092.stdout:8/715: truncate d15/d25/d27/f3e 3710659 0 2024-09-17T01:52:18.795 INFO:tasks.workunit.client.1.smithi092.stdout:7/795: write d3/d6/d13/d21/d2e/d6e/f71 [5087933,8020] 0 2024-09-17T01:52:18.797 INFO:tasks.workunit.client.0.smithi031.stdout:8/916: sync 2024-09-17T01:52:18.798 INFO:tasks.workunit.client.1.smithi092.stdout:7/796: creat d3/db/d98/dce/d6a/f108 x:0 0 0 2024-09-17T01:52:18.799 INFO:tasks.workunit.client.1.smithi092.stdout:2/727: dwrite d10/d3a/d97/f98 [0,4194304] 0 2024-09-17T01:52:18.801 INFO:tasks.workunit.client.1.smithi092.stdout:2/728: write d10/d1d/fd2 [1036418,20633] 0 2024-09-17T01:52:18.803 INFO:tasks.workunit.client.1.smithi092.stdout:8/716: mkdir d15/d25/d27/d6e/d95/dda/d40/d42/ded 0 2024-09-17T01:52:18.803 INFO:tasks.workunit.client.0.smithi031.stdout:8/917: truncate d0/df/d19/fba 4074826 0 2024-09-17T01:52:18.805 INFO:tasks.workunit.client.0.smithi031.stdout:8/918: write d0/d5/d9b/fc4 [1290220,48854] 0 2024-09-17T01:52:18.805 INFO:tasks.workunit.client.0.smithi031.stdout:9/975: dread d3/d19/f34 [0,4194304] 0 2024-09-17T01:52:18.807 INFO:tasks.workunit.client.1.smithi092.stdout:7/797: creat d3/d2b/d84/ddf/f109 x:0 0 0 2024-09-17T01:52:18.808 INFO:tasks.workunit.client.0.smithi031.stdout:9/976: mknod d3/d19/d80/db9/c148 0 2024-09-17T01:52:18.809 INFO:tasks.workunit.client.1.smithi092.stdout:2/729: creat d10/d8d/d9e/ff2 x:0 0 0 2024-09-17T01:52:18.810 INFO:tasks.workunit.client.0.smithi031.stdout:9/977: read d3/d4c/d102/d114/d64/fde [2400894,124770] 0 2024-09-17T01:52:18.814 INFO:tasks.workunit.client.1.smithi092.stdout:8/717: link d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/cca d15/d25/cee 0 2024-09-17T01:52:18.819 INFO:tasks.workunit.client.1.smithi092.stdout:8/718: chown d15/d25/d27/d6e/d95/dda/c52 66818 1 2024-09-17T01:52:18.820 INFO:tasks.workunit.client.1.smithi092.stdout:7/798: dwrite d3/db/d98/dce/d6a/fa3 [0,4194304] 0 2024-09-17T01:52:18.820 INFO:tasks.workunit.client.1.smithi092.stdout:2/730: dwrite d10/d1d/d2c/d5a/d7a/fed [0,4194304] 0 2024-09-17T01:52:18.827 INFO:tasks.workunit.client.1.smithi092.stdout:2/731: rename d10/d8d/f34 to d10/d1d/d2c/d56/d66/ff3 0 2024-09-17T01:52:18.831 INFO:tasks.workunit.client.1.smithi092.stdout:2/732: write d10/d1d/d96/d77/d9c/dae/fc5 [4634045,77335] 0 2024-09-17T01:52:18.833 INFO:tasks.workunit.client.1.smithi092.stdout:7/799: rename d3/db/d7b/f81 to d3/d6/d13/db7/f10a 0 2024-09-17T01:52:18.835 INFO:tasks.workunit.client.1.smithi092.stdout:7/800: write d3/db/d98/fa9 [3333701,8024] 0 2024-09-17T01:52:18.836 INFO:tasks.workunit.client.1.smithi092.stdout:7/801: write d3/db/f5e [2479596,11682] 0 2024-09-17T01:52:18.837 INFO:tasks.workunit.client.1.smithi092.stdout:2/733: mkdir d10/d4c/df4 0 2024-09-17T01:52:18.838 INFO:tasks.workunit.client.1.smithi092.stdout:7/802: fsync d3/db/d26/f80 0 2024-09-17T01:52:18.838 INFO:tasks.workunit.client.0.smithi031.stdout:8/919: mkdir d0/d5/d54/d60/dbb/dc0/d117 0 2024-09-17T01:52:18.839 INFO:tasks.workunit.client.1.smithi092.stdout:7/803: write d3/d2b/ffd [696138,11560] 0 2024-09-17T01:52:18.841 INFO:tasks.workunit.client.1.smithi092.stdout:2/734: mkdir d10/d1d/d2c/d5a/d7a/df5 0 2024-09-17T01:52:18.842 INFO:tasks.workunit.client.1.smithi092.stdout:7/804: symlink d3/d6/d13/d21/d2e/d6e/l10b 0 2024-09-17T01:52:18.845 INFO:tasks.workunit.client.1.smithi092.stdout:7/805: symlink d3/db/d26/l10c 0 2024-09-17T01:52:18.846 INFO:tasks.workunit.client.0.smithi031.stdout:8/920: dwrite d0/df/dd/d77/fce [0,4194304] 0 2024-09-17T01:52:18.847 INFO:tasks.workunit.client.1.smithi092.stdout:2/735: getdents d10/d1d 0 2024-09-17T01:52:18.848 INFO:tasks.workunit.client.1.smithi092.stdout:7/806: creat d3/d6/da1/f10d x:0 0 0 2024-09-17T01:52:18.849 INFO:tasks.workunit.client.1.smithi092.stdout:7/807: readlink d3/db/d26/d65/lde 0 2024-09-17T01:52:18.849 INFO:tasks.workunit.client.1.smithi092.stdout:2/736: mknod d10/d55/cf6 0 2024-09-17T01:52:18.854 INFO:tasks.workunit.client.1.smithi092.stdout:7/808: creat d3/db/d98/dce/d6a/dad/f10e x:0 0 0 2024-09-17T01:52:18.856 INFO:tasks.workunit.client.1.smithi092.stdout:7/809: dread - d3/d2b/d84/ddf/f109 zero size 2024-09-17T01:52:18.856 INFO:tasks.workunit.client.1.smithi092.stdout:7/810: chown d3/d6/dc2/dc5 14 1 2024-09-17T01:52:18.857 INFO:tasks.workunit.client.1.smithi092.stdout:7/811: chown d3/d2b/d84/cf0 708989 1 2024-09-17T01:52:18.859 INFO:tasks.workunit.client.1.smithi092.stdout:7/812: truncate d3/d6/d13/d21/d2e/fe8 743864 0 2024-09-17T01:52:18.861 INFO:tasks.workunit.client.1.smithi092.stdout:7/813: read d3/d2b/ffd [512418,111712] 0 2024-09-17T01:52:18.866 INFO:tasks.workunit.client.1.smithi092.stdout:7/814: chown d3/db/d98/dce/d6a/dad/lae 4899 1 2024-09-17T01:52:18.872 INFO:tasks.workunit.client.1.smithi092.stdout:7/815: rename d3/d6/d13/d21/l74 to d3/db/d98/dce/d6a/dc8/l10f 0 2024-09-17T01:52:18.873 INFO:tasks.workunit.client.1.smithi092.stdout:2/737: dwrite d10/d1d/d96/d77/fa9 [0,4194304] 0 2024-09-17T01:52:18.873 INFO:tasks.workunit.client.1.smithi092.stdout:2/738: fsync d10/d55/d84/fcd 0 2024-09-17T01:52:18.875 INFO:tasks.workunit.client.1.smithi092.stdout:2/739: write d10/d4c/d80/fe9 [83819,130451] 0 2024-09-17T01:52:18.883 INFO:tasks.workunit.client.1.smithi092.stdout:7/816: dwrite d3/db/d26/f6d [0,4194304] 0 2024-09-17T01:52:18.886 INFO:tasks.workunit.client.1.smithi092.stdout:2/740: rename d10/d1d/d96/d77/c22 to d10/d1d/d2c/d5a/d7a/cf7 0 2024-09-17T01:52:18.887 INFO:tasks.workunit.client.1.smithi092.stdout:2/741: chown d10/d1d/d2c/d5a/l71 456315766 1 2024-09-17T01:52:18.889 INFO:tasks.workunit.client.1.smithi092.stdout:2/742: symlink d10/db9/lf8 0 2024-09-17T01:52:18.891 INFO:tasks.workunit.client.1.smithi092.stdout:2/743: rmdir d10/d4c/d80/d95/dc6 39 2024-09-17T01:52:18.902 INFO:tasks.workunit.client.1.smithi092.stdout:7/817: dread d3/db/d26/d6f/feb [0,4194304] 0 2024-09-17T01:52:18.904 INFO:tasks.workunit.client.1.smithi092.stdout:7/818: read d3/d2b/d37/f8b [4304311,41667] 0 2024-09-17T01:52:18.904 INFO:tasks.workunit.client.0.smithi031.stdout:8/921: getdents d0/df/dd/d77/d78 0 2024-09-17T01:52:18.905 INFO:tasks.workunit.client.0.smithi031.stdout:8/922: dread - d0/f10b zero size 2024-09-17T01:52:18.906 INFO:tasks.workunit.client.1.smithi092.stdout:7/819: creat d3/d6/d13/db7/f110 x:0 0 0 2024-09-17T01:52:18.912 INFO:tasks.workunit.client.0.smithi031.stdout:8/923: creat d0/dcc/d104/f118 x:0 0 0 2024-09-17T01:52:18.915 INFO:tasks.workunit.client.1.smithi092.stdout:2/744: dwrite d10/d1d/d96/d77/f33 [0,4194304] 0 2024-09-17T01:52:18.915 INFO:tasks.workunit.client.1.smithi092.stdout:7/820: dwrite d3/db/d26/d83/da6/fb1 [4194304,4194304] 0 2024-09-17T01:52:18.919 INFO:tasks.workunit.client.1.smithi092.stdout:3/785: sync 2024-09-17T01:52:18.919 INFO:tasks.workunit.client.1.smithi092.stdout:4/937: sync 2024-09-17T01:52:18.925 INFO:tasks.workunit.client.1.smithi092.stdout:2/745: rename d10/d5c/d81 to d10/d4c/d80/df9 0 2024-09-17T01:52:18.927 INFO:tasks.workunit.client.1.smithi092.stdout:4/938: mkdir d4/d7b/d12d/d12f 0 2024-09-17T01:52:18.927 INFO:tasks.workunit.client.1.smithi092.stdout:7/821: getdents d3/d6/dc2/ddc 0 2024-09-17T01:52:18.929 INFO:tasks.workunit.client.1.smithi092.stdout:3/786: rename d4/d20/f32 to d4/d20/d39/d70/ffd 0 2024-09-17T01:52:18.929 INFO:tasks.workunit.client.1.smithi092.stdout:4/939: chown d4/d13/d20/fcc 183 1 2024-09-17T01:52:18.932 INFO:tasks.workunit.client.1.smithi092.stdout:7/822: rmdir d3/d2b 39 2024-09-17T01:52:18.934 INFO:tasks.workunit.client.1.smithi092.stdout:3/787: write d4/d20/d9f/dd5/fdc [1584974,25995] 0 2024-09-17T01:52:18.936 INFO:tasks.workunit.client.1.smithi092.stdout:3/788: chown d4/ld 254492 1 2024-09-17T01:52:18.936 INFO:tasks.workunit.client.1.smithi092.stdout:4/940: fdatasync d4/d5/d1d/d30/d3f/d4b/f81 0 2024-09-17T01:52:18.943 INFO:tasks.workunit.client.1.smithi092.stdout:7/823: link d3/db/d26/f62 d3/d6/d13/f111 0 2024-09-17T01:52:18.944 INFO:tasks.workunit.client.1.smithi092.stdout:7/824: write d3/db/f4a [1371545,1736] 0 2024-09-17T01:52:18.945 INFO:tasks.workunit.client.1.smithi092.stdout:2/746: truncate d10/db9/fbc 3340098 0 2024-09-17T01:52:18.949 INFO:tasks.workunit.client.1.smithi092.stdout:7/825: mknod d3/db/d98/dce/d60/d93/dfb/c112 0 2024-09-17T01:52:18.973 INFO:tasks.workunit.client.0.smithi031.stdout:8/924: write d0/d5/d54/d60/dbb/dc0/fe0 [1161137,30710] 0 2024-09-17T01:52:18.978 INFO:tasks.workunit.client.0.smithi031.stdout:9/978: rmdir d3/d4/da0/d36 39 2024-09-17T01:52:18.980 INFO:tasks.workunit.client.0.smithi031.stdout:9/979: mkdir d3/d4/d41/d119/d149 0 2024-09-17T01:52:18.981 INFO:tasks.workunit.client.0.smithi031.stdout:9/980: write d3/d4/ff8 [400986,130849] 0 2024-09-17T01:52:18.983 INFO:tasks.workunit.client.0.smithi031.stdout:9/981: creat d3/d19/d80/f14a x:0 0 0 2024-09-17T01:52:18.985 INFO:tasks.workunit.client.1.smithi092.stdout:2/747: rmdir d10/d1d 39 2024-09-17T01:52:18.986 INFO:tasks.workunit.client.0.smithi031.stdout:8/925: rmdir d0/dcc 39 2024-09-17T01:52:18.987 INFO:tasks.workunit.client.0.smithi031.stdout:8/926: chown d0/d5/d9b/f5c 760 1 2024-09-17T01:52:18.987 INFO:tasks.workunit.client.1.smithi092.stdout:7/826: write d3/d6/f1c [2075764,12934] 0 2024-09-17T01:52:18.987 INFO:tasks.workunit.client.0.smithi031.stdout:8/927: write d0/f70 [2268084,6919] 0 2024-09-17T01:52:18.988 INFO:tasks.workunit.client.0.smithi031.stdout:9/982: creat d3/d4/da0/d36/d62/f14b x:0 0 0 2024-09-17T01:52:18.989 INFO:tasks.workunit.client.0.smithi031.stdout:9/983: dread - d3/d19/d80/db9/ff2 zero size 2024-09-17T01:52:18.991 INFO:tasks.workunit.client.1.smithi092.stdout:4/941: dwrite d4/d5/d1d/d30/f64 [0,4194304] 0 2024-09-17T01:52:18.992 INFO:tasks.workunit.client.0.smithi031.stdout:9/984: creat d3/d4c/f14c x:0 0 0 2024-09-17T01:52:18.992 INFO:tasks.workunit.client.1.smithi092.stdout:7/827: creat d3/db/d98/dce/d6a/f113 x:0 0 0 2024-09-17T01:52:18.993 INFO:tasks.workunit.client.1.smithi092.stdout:7/828: stat d3/db/d98/cf5 0 2024-09-17T01:52:18.994 INFO:tasks.workunit.client.1.smithi092.stdout:4/942: stat d4/d13/d3b/d42/d76/d35/d3e 0 2024-09-17T01:52:18.994 INFO:tasks.workunit.client.1.smithi092.stdout:3/789: dread d4/d73/d8f/d9e/fbb [0,4194304] 0 2024-09-17T01:52:18.996 INFO:tasks.workunit.client.0.smithi031.stdout:8/928: dwrite d0/d5/f11 [0,4194304] 0 2024-09-17T01:52:18.997 INFO:tasks.workunit.client.0.smithi031.stdout:8/929: fdatasync d0/fda 0 2024-09-17T01:52:18.998 INFO:tasks.workunit.client.1.smithi092.stdout:4/943: creat d4/d7b/d12d/f130 x:0 0 0 2024-09-17T01:52:18.998 INFO:tasks.workunit.client.1.smithi092.stdout:2/748: dwrite d10/d8d/d8f/fb6 [0,4194304] 0 2024-09-17T01:52:19.004 INFO:tasks.workunit.client.1.smithi092.stdout:3/790: getdents d4/d13/d2e/d43 0 2024-09-17T01:52:19.006 INFO:tasks.workunit.client.1.smithi092.stdout:3/791: rename d4 to d4/d20/dfe 22 2024-09-17T01:52:19.007 INFO:tasks.workunit.client.0.smithi031.stdout:8/930: dwrite d0/d5/f40 [0,4194304] 0 2024-09-17T01:52:19.007 INFO:tasks.workunit.client.0.smithi031.stdout:8/931: chown d0/d5/d6c 846428 1 2024-09-17T01:52:19.008 INFO:tasks.workunit.client.0.smithi031.stdout:9/985: truncate d3/d19/d80/fdd 589327 0 2024-09-17T01:52:19.011 INFO:tasks.workunit.client.1.smithi092.stdout:3/792: truncate d4/d16/d1b/f21 263469 0 2024-09-17T01:52:19.011 INFO:tasks.workunit.client.1.smithi092.stdout:4/944: read d4/d5/f40 [2932810,78472] 0 2024-09-17T01:52:19.012 INFO:tasks.workunit.client.0.smithi031.stdout:9/986: symlink d3/d47/d96/l14d 0 2024-09-17T01:52:19.013 INFO:tasks.workunit.client.1.smithi092.stdout:2/749: write d10/db9/fbc [485687,48943] 0 2024-09-17T01:52:19.015 INFO:tasks.workunit.client.1.smithi092.stdout:4/945: mknod d4/d5/d1d/dae/c131 0 2024-09-17T01:52:19.016 INFO:tasks.workunit.client.1.smithi092.stdout:3/793: mknod d4/d13/d2e/d6f/dd2/cff 0 2024-09-17T01:52:19.017 INFO:tasks.workunit.client.0.smithi031.stdout:8/932: dwrite d0/d5/d6c/db0/db7/fff [0,4194304] 0 2024-09-17T01:52:19.017 INFO:tasks.workunit.client.1.smithi092.stdout:2/750: fdatasync d10/d1d/d2c/fe2 0 2024-09-17T01:52:19.020 INFO:tasks.workunit.client.1.smithi092.stdout:3/794: creat d4/d20/d39/d70/d95/da3/f100 x:0 0 0 2024-09-17T01:52:19.021 INFO:tasks.workunit.client.1.smithi092.stdout:4/946: symlink d4/d5/d1d/d30/d3f/d4b/dff/d119/l132 0 2024-09-17T01:52:19.023 INFO:tasks.workunit.client.0.smithi031.stdout:9/987: dwrite d3/d4/fc6 [0,4194304] 0 2024-09-17T01:52:19.024 INFO:tasks.workunit.client.1.smithi092.stdout:2/751: read d10/d1d/d96/d77/d9c/fd7 [3645403,51766] 0 2024-09-17T01:52:19.025 INFO:tasks.workunit.client.1.smithi092.stdout:2/752: write d10/d8d/d8f/fd4 [704051,81908] 0 2024-09-17T01:52:19.027 INFO:tasks.workunit.client.0.smithi031.stdout:8/933: rename d0/d5/d54 to d0/df/d119 0 2024-09-17T01:52:19.030 INFO:tasks.workunit.client.0.smithi031.stdout:8/934: creat d0/dcc/f11a x:0 0 0 2024-09-17T01:52:19.033 INFO:tasks.workunit.client.0.smithi031.stdout:9/988: dwrite d3/d4/da0/d36/d99/db3/f113 [0,4194304] 0 2024-09-17T01:52:19.034 INFO:tasks.workunit.client.0.smithi031.stdout:8/935: creat d0/df/dd/d59/db1/f11b x:0 0 0 2024-09-17T01:52:19.035 INFO:tasks.workunit.client.0.smithi031.stdout:8/936: readlink d0/l4c 0 2024-09-17T01:52:19.038 INFO:tasks.workunit.client.0.smithi031.stdout:9/989: creat d3/d4/da0/d36/d79/dd0/f14e x:0 0 0 2024-09-17T01:52:19.041 INFO:tasks.workunit.client.0.smithi031.stdout:8/937: creat d0/df/d19/f11c x:0 0 0 2024-09-17T01:52:19.043 INFO:tasks.workunit.client.0.smithi031.stdout:8/938: fsync d0/d5/d6c/db0/db7/faf 0 2024-09-17T01:52:19.044 INFO:tasks.workunit.client.0.smithi031.stdout:8/939: chown d0/d5/d9b 0 1 2024-09-17T01:52:19.045 INFO:tasks.workunit.client.0.smithi031.stdout:9/990: symlink d3/d4/da0/d36/d62/dd8/dea/l14f 0 2024-09-17T01:52:19.046 INFO:tasks.workunit.client.0.smithi031.stdout:8/940: mknod d0/df/dd/c11d 0 2024-09-17T01:52:19.049 INFO:tasks.workunit.client.0.smithi031.stdout:9/991: getdents d3/d4/da0/d36/d62 0 2024-09-17T01:52:19.050 INFO:tasks.workunit.client.0.smithi031.stdout:9/992: write d3/d4c/d102/d114/d64/f97 [3732144,97860] 0 2024-09-17T01:52:19.056 INFO:tasks.workunit.client.0.smithi031.stdout:9/993: dwrite d3/fa3 [0,4194304] 0 2024-09-17T01:52:19.058 INFO:tasks.workunit.client.0.smithi031.stdout:9/994: fsync d3/d4/da0/f38 0 2024-09-17T01:52:19.064 INFO:tasks.workunit.client.1.smithi092.stdout:2/753: dread d10/d3a/f3f [0,4194304] 0 2024-09-17T01:52:19.066 INFO:tasks.workunit.client.1.smithi092.stdout:2/754: symlink d10/d1d/d96/lfa 0 2024-09-17T01:52:19.067 INFO:tasks.workunit.client.1.smithi092.stdout:2/755: readlink d10/d1d/d2c/d5a/l71 0 2024-09-17T01:52:19.068 INFO:tasks.workunit.client.1.smithi092.stdout:3/795: write d4/d20/d3f/dc0/fd1 [3817154,82575] 0 2024-09-17T01:52:19.070 INFO:tasks.workunit.client.1.smithi092.stdout:3/796: readlink d4/d20/d39/l5d 0 2024-09-17T01:52:19.071 INFO:tasks.workunit.client.1.smithi092.stdout:2/756: rename d10/d1d/d24/f92 to d10/d55/ffb 0 2024-09-17T01:52:19.071 INFO:tasks.workunit.client.1.smithi092.stdout:3/797: fdatasync d4/d13/d2e/d43/fa2 0 2024-09-17T01:52:19.073 INFO:tasks.workunit.client.1.smithi092.stdout:3/798: fdatasync d4/d13/d2e/f75 0 2024-09-17T01:52:19.075 INFO:tasks.workunit.client.1.smithi092.stdout:4/947: dwrite d4/d5/f105 [0,4194304] 0 2024-09-17T01:52:19.075 INFO:tasks.workunit.client.1.smithi092.stdout:3/799: fdatasync d4/d16/f24 0 2024-09-17T01:52:19.076 INFO:tasks.workunit.client.1.smithi092.stdout:4/948: read - d4/d13/d3b/fca zero size 2024-09-17T01:52:19.078 INFO:tasks.workunit.client.1.smithi092.stdout:4/949: write d4/d5/fc4 [1166806,27429] 0 2024-09-17T01:52:19.078 INFO:tasks.workunit.client.1.smithi092.stdout:2/757: rename d10/d3a/c45 to d10/cfc 0 2024-09-17T01:52:19.083 INFO:tasks.workunit.client.1.smithi092.stdout:3/800: dread d4/d73/d8f/d92/fa0 [0,4194304] 0 2024-09-17T01:52:19.085 INFO:tasks.workunit.client.1.smithi092.stdout:4/950: link d4/d13/d20/f29 d4/d5/d1d/dae/f133 0 2024-09-17T01:52:19.087 INFO:tasks.workunit.client.1.smithi092.stdout:3/801: unlink d4/f61 0 2024-09-17T01:52:19.087 INFO:tasks.workunit.client.0.smithi031.stdout:9/995: getdents d3/d4/da0/d36/d62/dd8/d125 0 2024-09-17T01:52:19.089 INFO:tasks.workunit.client.0.smithi031.stdout:9/996: write d3/d4c/d102/d114/d64/f144 [1046385,39744] 0 2024-09-17T01:52:19.092 INFO:tasks.workunit.client.0.smithi031.stdout:9/997: rmdir d3/d4/da0/d36/d62/db2 39 2024-09-17T01:52:19.093 INFO:tasks.workunit.client.1.smithi092.stdout:4/951: dwrite d4/d5/d8/d99/f12b [0,4194304] 0 2024-09-17T01:52:19.094 INFO:tasks.workunit.client.0.smithi031.stdout:9/998: stat d3/d19/d1f/cc0 0 2024-09-17T01:52:19.097 INFO:tasks.workunit.client.0.smithi031.stdout:9/999: symlink d3/d4c/d102/d114/l150 0 2024-09-17T01:52:19.097 INFO:tasks.workunit.client.1.smithi092.stdout:4/952: read d4/d13/d3b/f47 [3095512,131022] 0 2024-09-17T01:52:19.102 INFO:tasks.workunit.client.1.smithi092.stdout:4/953: creat d4/d5/d1d/d30/d3f/d4b/dff/d119/f134 x:0 0 0 2024-09-17T01:52:19.102 INFO:tasks.workunit.client.1.smithi092.stdout:2/758: dread d10/d55/dda/fa1 [0,4194304] 0 2024-09-17T01:52:19.104 INFO:tasks.workunit.client.1.smithi092.stdout:2/759: stat d10/d4c/d80/df9 0 2024-09-17T01:52:19.108 INFO:tasks.workunit.client.1.smithi092.stdout:2/760: truncate d10/d55/d84/fbb 193231 0 2024-09-17T01:52:19.112 INFO:tasks.workunit.client.1.smithi092.stdout:4/954: rename d4/d13/d3b/d42/d76/d41/dc6/ce9 to d4/d13/d3b/d42/d76/d35/de8/c135 0 2024-09-17T01:52:19.114 INFO:tasks.workunit.client.1.smithi092.stdout:2/761: rmdir d10/d8d/d8f/dea 0 2024-09-17T01:52:19.114 INFO:tasks.workunit.client.1.smithi092.stdout:3/802: dread d4/d73/d7b/f94 [0,4194304] 0 2024-09-17T01:52:19.115 INFO:tasks.workunit.client.1.smithi092.stdout:2/762: write d10/d1d/d96/d77/d9c/dae/fc5 [3864264,25175] 0 2024-09-17T01:52:19.116 INFO:tasks.workunit.client.1.smithi092.stdout:2/763: stat d10/d4c/d80/d95/fe5 0 2024-09-17T01:52:19.120 INFO:tasks.workunit.client.1.smithi092.stdout:4/955: rename d4/d13/d20/f29 to d4/d5/d1d/d30/d3f/d4b/dff/f136 0 2024-09-17T01:52:19.120 INFO:tasks.workunit.client.1.smithi092.stdout:3/803: chown d4/d2f/l6c 1657 1 2024-09-17T01:52:19.121 INFO:tasks.workunit.client.1.smithi092.stdout:3/804: write d4/d20/d39/f7d [1185804,51004] 0 2024-09-17T01:52:19.122 INFO:tasks.workunit.client.1.smithi092.stdout:3/805: fsync d4/d2f/d44/d3c/f90 0 2024-09-17T01:52:19.125 INFO:tasks.workunit.client.1.smithi092.stdout:2/764: truncate d10/d55/d84/fbb 217868 0 2024-09-17T01:52:19.126 INFO:tasks.workunit.client.1.smithi092.stdout:3/806: mknod d4/d20/d9f/dd5/c101 0 2024-09-17T01:52:19.129 INFO:tasks.workunit.client.1.smithi092.stdout:2/765: mkdir d10/d8d/d9e/dfd 0 2024-09-17T01:52:19.129 INFO:tasks.workunit.client.1.smithi092.stdout:3/807: truncate d4/f18 1383521 0 2024-09-17T01:52:19.130 INFO:tasks.workunit.client.1.smithi092.stdout:2/766: truncate d10/d1d/d24/d6e/faf 252304 0 2024-09-17T01:52:19.131 INFO:tasks.workunit.client.1.smithi092.stdout:2/767: fsync d10/d8d/d8f/fb6 0 2024-09-17T01:52:19.133 INFO:tasks.workunit.client.1.smithi092.stdout:4/956: dread d4/d13/d3b/d42/f86 [0,4194304] 0 2024-09-17T01:52:19.138 INFO:tasks.workunit.client.1.smithi092.stdout:2/768: getdents d10/d1d/d2c/d5a/d7a/df5 0 2024-09-17T01:52:19.142 INFO:tasks.workunit.client.1.smithi092.stdout:2/769: creat d10/d4c/d80/d95/db3/ffe x:0 0 0 2024-09-17T01:52:19.143 INFO:tasks.workunit.client.1.smithi092.stdout:2/770: chown d10/d8d/d8f/d93 228 1 2024-09-17T01:52:19.143 INFO:tasks.workunit.client.1.smithi092.stdout:3/808: truncate d4/d20/f42 599963 0 2024-09-17T01:52:19.143 INFO:tasks.workunit.client.1.smithi092.stdout:2/771: chown d10/fd0 298812 1 2024-09-17T01:52:19.149 INFO:tasks.workunit.client.1.smithi092.stdout:4/957: dread d4/d13/d3b/d42/fc7 [0,4194304] 0 2024-09-17T01:52:19.150 INFO:tasks.workunit.client.1.smithi092.stdout:2/772: dwrite d10/d4c/d80/fe9 [0,4194304] 0 2024-09-17T01:52:19.155 INFO:tasks.workunit.client.1.smithi092.stdout:2/773: mknod d10/d1d/d24/d6e/cff 0 2024-09-17T01:52:19.155 INFO:tasks.workunit.client.1.smithi092.stdout:4/958: truncate d4/d5/d1d/dae/f133 1787273 0 2024-09-17T01:52:19.156 INFO:tasks.workunit.client.1.smithi092.stdout:4/959: write d4/d13/d3b/d42/d76/f48 [4287828,83696] 0 2024-09-17T01:52:19.156 INFO:tasks.workunit.client.1.smithi092.stdout:4/960: stat d4/d7b/ff0 0 2024-09-17T01:52:19.157 INFO:tasks.workunit.client.1.smithi092.stdout:4/961: readlink d4/d5/d1d/d30/l5d 0 2024-09-17T01:52:19.157 INFO:tasks.workunit.client.1.smithi092.stdout:4/962: chown d4/d5/d8/d99/la1 0 1 2024-09-17T01:52:19.187 INFO:tasks.workunit.client.1.smithi092.stdout:4/963: dwrite d4/d5/d8/d99/f12b [4194304,4194304] 0 2024-09-17T01:52:19.193 INFO:tasks.workunit.client.1.smithi092.stdout:3/809: dread d4/f28 [0,4194304] 0 2024-09-17T01:52:19.195 INFO:tasks.workunit.client.1.smithi092.stdout:4/964: rename d4/d5/d1d/d30/cbe to d4/d13/d3b/d42/d76/d35/d3e/d7c/dc3/c137 0 2024-09-17T01:52:19.198 INFO:tasks.workunit.client.1.smithi092.stdout:4/965: mkdir d4/d5/d1d/d138 0 2024-09-17T01:52:19.199 INFO:tasks.workunit.client.1.smithi092.stdout:4/966: write d4/d5/fa2 [5995415,44217] 0 2024-09-17T01:52:19.202 INFO:tasks.workunit.client.1.smithi092.stdout:4/967: unlink d4/d13/d3b/c59 0 2024-09-17T01:52:19.205 INFO:tasks.workunit.client.1.smithi092.stdout:4/968: truncate d4/d5/fd2 2100803 0 2024-09-17T01:52:19.207 INFO:tasks.workunit.client.1.smithi092.stdout:3/810: write d4/d2f/d44/d54/f88 [331295,99381] 0 2024-09-17T01:52:19.215 INFO:tasks.workunit.client.1.smithi092.stdout:4/969: dread d4/d13/d3b/d42/d76/fd1 [0,4194304] 0 2024-09-17T01:52:19.217 INFO:tasks.workunit.client.1.smithi092.stdout:4/970: link d4/d13/f17 d4/d5/d1d/d102/f139 0 2024-09-17T01:52:19.218 INFO:tasks.workunit.client.1.smithi092.stdout:4/971: fdatasync d4/d5/d8/d99/f12b 0 2024-09-17T01:52:19.219 INFO:tasks.workunit.client.1.smithi092.stdout:4/972: chown d4/d7b/d12d/d12f 14609 1 2024-09-17T01:52:19.220 INFO:tasks.workunit.client.1.smithi092.stdout:4/973: write d4/d5/d8/d92/ff8 [2888139,70621] 0 2024-09-17T01:52:19.256 INFO:tasks.workunit.client.0.smithi031.stdout:8/941: sync 2024-09-17T01:52:19.257 INFO:tasks.workunit.client.0.smithi031.stdout:8/942: write d0/df/dd/d77/d78/ff8 [192128,44] 0 2024-09-17T01:52:19.280 INFO:tasks.workunit.client.0.smithi031.stdout:8/943: dwrite d0/df/d119/d60/dbb/f105 [0,4194304] 0 2024-09-17T01:52:19.280 INFO:tasks.workunit.client.0.smithi031.stdout:8/944: chown d0/df/dd/d59 108 1 2024-09-17T01:52:19.282 INFO:tasks.workunit.client.0.smithi031.stdout:8/945: mknod d0/df/d119/d60/dbb/dc0/dfc/c11e 0 2024-09-17T01:52:19.286 INFO:tasks.workunit.client.0.smithi031.stdout:8/946: dread d0/d5/d6c/db0/db7/fff [0,4194304] 0 2024-09-17T01:52:19.287 INFO:tasks.workunit.client.0.smithi031.stdout:8/947: chown d0/dcc/f11a 1130 1 2024-09-17T01:52:19.394 INFO:tasks.workunit.client.1.smithi092.stdout:6/738: sync 2024-09-17T01:52:19.395 INFO:tasks.workunit.client.1.smithi092.stdout:6/739: fsync d3/d10/d8c/d43/d5e/d73/d8f/da4/faa 0 2024-09-17T01:52:19.397 INFO:tasks.workunit.client.1.smithi092.stdout:6/740: creat d3/d70/fe1 x:0 0 0 2024-09-17T01:52:19.397 INFO:tasks.workunit.client.1.smithi092.stdout:1/954: sync 2024-09-17T01:52:19.399 INFO:tasks.workunit.client.1.smithi092.stdout:6/741: dread d3/d10/d1f/d21/da5/d18/fcb [0,4194304] 0 2024-09-17T01:52:19.404 INFO:tasks.workunit.client.1.smithi092.stdout:6/742: link d3/d10/d1f/d21/da5/d18/ca9 d3/d10/d8c/d49/d7e/ce2 0 2024-09-17T01:52:19.405 INFO:tasks.workunit.client.1.smithi092.stdout:6/743: mknod d3/d10/d8c/d43/d5e/da0/ce3 0 2024-09-17T01:52:19.406 INFO:tasks.workunit.client.1.smithi092.stdout:6/744: stat d3/d10/d1f/d21/d1e/d55/f93 0 2024-09-17T01:52:19.406 INFO:tasks.workunit.client.1.smithi092.stdout:6/745: chown d3/d10/d8c/f24 6462850 1 2024-09-17T01:52:19.407 INFO:tasks.workunit.client.1.smithi092.stdout:6/746: write d3/d10/d1f/f59 [320906,46569] 0 2024-09-17T01:52:19.409 INFO:tasks.workunit.client.1.smithi092.stdout:6/747: fdatasync d3/d10/d8c/f7f 0 2024-09-17T01:52:19.410 INFO:tasks.workunit.client.0.smithi031.stdout:8/948: sync 2024-09-17T01:52:19.410 INFO:tasks.workunit.client.0.smithi031.stdout:8/949: stat d0/df/d119/d60/ce7 0 2024-09-17T01:52:19.413 INFO:tasks.workunit.client.0.smithi031.stdout:8/950: mknod d0/df/c11f 0 2024-09-17T01:52:19.415 INFO:tasks.workunit.client.1.smithi092.stdout:6/748: dread - d3/d8e/fb4 zero size 2024-09-17T01:52:19.420 INFO:tasks.workunit.client.0.smithi031.stdout:8/951: truncate d0/f9 1981171 0 2024-09-17T01:52:19.420 INFO:tasks.workunit.client.1.smithi092.stdout:6/749: dwrite d3/f44 [0,4194304] 0 2024-09-17T01:52:19.422 INFO:tasks.workunit.client.0.smithi031.stdout:8/952: creat d0/d5/da2/f120 x:0 0 0 2024-09-17T01:52:19.423 INFO:tasks.workunit.client.0.smithi031.stdout:8/953: write d0/df/dd/d77/dc3/fd7 [628440,88396] 0 2024-09-17T01:52:19.425 INFO:tasks.workunit.client.0.smithi031.stdout:8/954: dread - d0/df/dd/d77/d78/fb4 zero size 2024-09-17T01:52:19.428 INFO:tasks.workunit.client.0.smithi031.stdout:8/955: fsync d0/df/d119/d60/f97 0 2024-09-17T01:52:19.429 INFO:tasks.workunit.client.0.smithi031.stdout:8/956: readlink d0/l106 0 2024-09-17T01:52:19.431 INFO:tasks.workunit.client.0.smithi031.stdout:8/957: chown d0/df/dd/lf3 3817437 1 2024-09-17T01:52:19.441 INFO:tasks.workunit.client.1.smithi092.stdout:6/750: creat d3/d10/d1f/d21/da5/d18/fe4 x:0 0 0 2024-09-17T01:52:19.442 INFO:tasks.workunit.client.1.smithi092.stdout:6/751: stat d3/d10/d1f/d21/f3b 0 2024-09-17T01:52:19.444 INFO:tasks.workunit.client.0.smithi031.stdout:8/958: dread d0/f9 [0,4194304] 0 2024-09-17T01:52:19.445 INFO:tasks.workunit.client.1.smithi092.stdout:6/752: link d3/f9e d3/d70/fe5 0 2024-09-17T01:52:19.446 INFO:tasks.workunit.client.1.smithi092.stdout:6/753: write d3/d10/d8c/d43/d6a/d3d/d72/fbb [1020064,69935] 0 2024-09-17T01:52:19.449 INFO:tasks.workunit.client.0.smithi031.stdout:8/959: dread d0/df/d119/d60/dbb/dc0/fe0 [0,4194304] 0 2024-09-17T01:52:19.453 INFO:tasks.workunit.client.0.smithi031.stdout:8/960: rename d0/df/d119/d60/f62 to d0/d5/d6c/db0/db7/f121 0 2024-09-17T01:52:19.453 INFO:tasks.workunit.client.0.smithi031.stdout:8/961: stat d0/df/d119/d60/dbb/dc0/cc2 0 2024-09-17T01:52:19.459 INFO:tasks.workunit.client.0.smithi031.stdout:8/962: dwrite d0/df/dd/d9c/fe5 [0,4194304] 0 2024-09-17T01:52:19.460 INFO:tasks.workunit.client.1.smithi092.stdout:6/754: write d3/d10/d8c/f7f [1197163,114611] 0 2024-09-17T01:52:19.462 INFO:tasks.workunit.client.0.smithi031.stdout:8/963: creat d0/d5/d9b/f122 x:0 0 0 2024-09-17T01:52:19.462 INFO:tasks.workunit.client.1.smithi092.stdout:6/755: fsync d3/d10/d8c/d43/d5e/f5f 0 2024-09-17T01:52:19.463 INFO:tasks.workunit.client.0.smithi031.stdout:8/964: stat d0/d5/d9b/l85 0 2024-09-17T01:52:19.463 INFO:tasks.workunit.client.0.smithi031.stdout:8/965: write d0/df/d19/f11c [425453,15476] 0 2024-09-17T01:52:19.467 INFO:tasks.workunit.client.1.smithi092.stdout:6/756: mknod d3/d10/d1f/d21/d28/ce6 0 2024-09-17T01:52:19.467 INFO:tasks.workunit.client.1.smithi092.stdout:6/757: chown d3/d10/d8c/d49/d7e 28739189 1 2024-09-17T01:52:19.469 INFO:tasks.workunit.client.0.smithi031.stdout:8/966: rename d0/d5/d9b/c6a to d0/df/db6/c123 0 2024-09-17T01:52:19.470 INFO:tasks.workunit.client.0.smithi031.stdout:8/967: chown d0/df/dd/d59/df7 0 1 2024-09-17T01:52:19.531 INFO:tasks.workunit.client.0.smithi031.stdout:8/968: sync 2024-09-17T01:52:19.533 INFO:tasks.workunit.client.0.smithi031.stdout:8/969: chown d0/d5/c3c 1 1 2024-09-17T01:52:19.537 INFO:tasks.workunit.client.0.smithi031.stdout:8/970: write d0/df/f8a [1336261,43314] 0 2024-09-17T01:52:19.539 INFO:tasks.workunit.client.0.smithi031.stdout:8/971: mkdir d0/d5/d6c/d124 0 2024-09-17T01:52:19.540 INFO:tasks.workunit.client.0.smithi031.stdout:8/972: write d0/d5/f7d [2579536,36956] 0 2024-09-17T01:52:19.542 INFO:tasks.workunit.client.0.smithi031.stdout:8/973: fdatasync d0/d5/d6c/fe1 0 2024-09-17T01:52:19.545 INFO:tasks.workunit.client.0.smithi031.stdout:8/974: symlink d0/d5/l125 0 2024-09-17T01:52:19.545 INFO:tasks.workunit.client.0.smithi031.stdout:8/975: chown d0/d5/d6c/db0/db7/fac 219 1 2024-09-17T01:52:19.549 INFO:tasks.workunit.client.0.smithi031.stdout:8/976: link d0/df/d119/lb5 d0/df/d119/d60/dbb/l126 0 2024-09-17T01:52:19.557 INFO:tasks.workunit.client.0.smithi031.stdout:8/977: dwrite d0/d5/d9b/f5f [0,4194304] 0 2024-09-17T01:52:19.559 INFO:tasks.workunit.client.0.smithi031.stdout:8/978: dread d0/d5/d6c/db0/db7/faf [0,4194304] 0 2024-09-17T01:52:19.563 INFO:tasks.workunit.client.0.smithi031.stdout:8/979: link d0/df/dd/f96 d0/df/dd/d77/df0/f127 0 2024-09-17T01:52:19.565 INFO:tasks.workunit.client.0.smithi031.stdout:8/980: mkdir d0/df/d119/d128 0 2024-09-17T01:52:19.567 INFO:tasks.workunit.client.0.smithi031.stdout:8/981: creat d0/df/d119/d60/dbb/dc0/f129 x:0 0 0 2024-09-17T01:52:19.568 INFO:tasks.workunit.client.0.smithi031.stdout:8/982: chown d0/df/d119/l82 3262 1 2024-09-17T01:52:19.568 INFO:tasks.workunit.client.0.smithi031.stdout:8/983: readlink d0/l4c 0 2024-09-17T01:52:19.570 INFO:tasks.workunit.client.0.smithi031.stdout:8/984: mkdir d0/df/d119/d128/d12a 0 2024-09-17T01:52:19.571 INFO:tasks.workunit.client.0.smithi031.stdout:8/985: creat d0/d5/d9b/f12b x:0 0 0 2024-09-17T01:52:19.572 INFO:tasks.workunit.client.0.smithi031.stdout:8/986: fdatasync d0/df/dd/d59/f6f 0 2024-09-17T01:52:19.573 INFO:tasks.workunit.client.0.smithi031.stdout:8/987: write d0/d5/d6c/f8b [2429874,28727] 0 2024-09-17T01:52:19.576 INFO:tasks.workunit.client.0.smithi031.stdout:8/988: mknod d0/df/dd/d59/db1/c12c 0 2024-09-17T01:52:19.579 INFO:tasks.workunit.client.0.smithi031.stdout:8/989: rename d0/df/d19/f27 to d0/d5/da2/f12d 0 2024-09-17T01:52:19.581 INFO:tasks.workunit.client.0.smithi031.stdout:8/990: write d0/d5/d6c/db0/db7/fff [5155345,117449] 0 2024-09-17T01:52:19.582 INFO:tasks.workunit.client.0.smithi031.stdout:8/991: chown d0/df/dd/d59/l98 3857540 1 2024-09-17T01:52:19.584 INFO:tasks.workunit.client.0.smithi031.stdout:8/992: truncate d0/df/d19/f31 1576064 0 2024-09-17T01:52:19.585 INFO:tasks.workunit.client.0.smithi031.stdout:8/993: chown d0/df/dd/c64 1915446 1 2024-09-17T01:52:19.585 INFO:tasks.workunit.client.0.smithi031.stdout:8/994: stat d0/df/d19/d86/dca/f102 0 2024-09-17T01:52:19.587 INFO:tasks.workunit.client.0.smithi031.stdout:8/995: mknod d0/d5/d6c/d6d/d10e/c12e 0 2024-09-17T01:52:19.589 INFO:tasks.workunit.client.0.smithi031.stdout:8/996: creat d0/df/dd/d113/f12f x:0 0 0 2024-09-17T01:52:19.590 INFO:tasks.workunit.client.0.smithi031.stdout:8/997: mkdir d0/dcc/d130 0 2024-09-17T01:52:19.591 INFO:tasks.workunit.client.0.smithi031.stdout:8/998: truncate d0/df/dd/d113/f12f 951260 0 2024-09-17T01:52:19.592 INFO:tasks.workunit.client.0.smithi031.stdout:8/999: truncate d0/df/d119/d60/dbb/dc0/fe0 1398993 0 2024-09-17T01:52:19.596 INFO:tasks.workunit.client.0.smithi031.stderr:+ rm -rf -- ./tmp.mgE5bhRenx 2024-09-17T01:52:19.657 INFO:tasks.workunit.client.1.smithi092.stdout:5/645: sync 2024-09-17T01:52:19.658 INFO:tasks.workunit.client.1.smithi092.stdout:5/646: write d0/de/d19/d1a/d1e/d29/f60 [356064,10457] 0 2024-09-17T01:52:19.660 INFO:tasks.workunit.client.1.smithi092.stdout:5/647: mknod d0/de/d19/d3c/d9e/cd6 0 2024-09-17T01:52:19.664 INFO:tasks.workunit.client.1.smithi092.stdout:5/648: dwrite d0/de/d19/f1f [0,4194304] 0 2024-09-17T01:52:19.671 INFO:tasks.workunit.client.1.smithi092.stdout:5/649: truncate d0/d50/d70/fcd 1021243 0 2024-09-17T01:52:19.672 INFO:tasks.workunit.client.1.smithi092.stdout:5/650: fdatasync d0/d50/fb3 0 2024-09-17T01:52:19.673 INFO:tasks.workunit.client.1.smithi092.stdout:5/651: readlink d0/de/d19/d1a/d1e/d3e/d4c/lc3 0 2024-09-17T01:52:19.674 INFO:tasks.workunit.client.1.smithi092.stdout:5/652: chown d0/de/d19/d3c/d41/fc0 69 1 2024-09-17T01:52:19.675 INFO:tasks.workunit.client.1.smithi092.stdout:5/653: rmdir d0/de/d19/d1a/d1e/d3e/d4c 39 2024-09-17T01:52:19.676 INFO:tasks.workunit.client.1.smithi092.stdout:5/654: chown d0/d7e/fb6 3662785 1 2024-09-17T01:52:19.679 INFO:tasks.workunit.client.1.smithi092.stdout:5/655: rename d0/de/d19/d1a/d1e/l3d to d0/de/d19/d3c/ld7 0 2024-09-17T01:52:19.681 INFO:tasks.workunit.client.1.smithi092.stdout:5/656: mknod d0/de/d19/d3c/d41/d8d/cd8 0 2024-09-17T01:52:19.684 INFO:tasks.workunit.client.1.smithi092.stdout:5/657: mknod d0/de/d19/d1a/d1e/d52/dbd/cd9 0 2024-09-17T01:52:19.688 INFO:tasks.workunit.client.1.smithi092.stdout:5/658: link d0/de/d19/d1a/d1e/f1b d0/d50/d70/d78/fda 0 2024-09-17T01:52:19.695 INFO:tasks.workunit.client.1.smithi092.stdout:5/659: write d0/de/d19/d1a/d1e/d52/d9a/db0/fb8 [7769680,60967] 0 2024-09-17T01:52:19.697 INFO:tasks.workunit.client.1.smithi092.stdout:5/660: mknod d0/de/d19/d3c/d41/cdb 0 2024-09-17T01:52:19.699 INFO:tasks.workunit.client.1.smithi092.stdout:5/661: mknod d0/de/d19/d1a/d1e/d74/dc8/dd5/cdc 0 2024-09-17T01:52:19.701 INFO:tasks.workunit.client.1.smithi092.stdout:5/662: creat d0/de/d19/d1a/d1e/d29/fdd x:0 0 0 2024-09-17T01:52:19.703 INFO:tasks.workunit.client.1.smithi092.stdout:5/663: symlink d0/d50/d70/d78/d8f/lde 0 2024-09-17T01:52:19.710 INFO:tasks.workunit.client.1.smithi092.stdout:5/664: write d0/de/d19/d3c/d41/f6e [1042862,102584] 0 2024-09-17T01:52:19.716 INFO:tasks.workunit.client.1.smithi092.stdout:5/665: dwrite d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:19.721 INFO:tasks.workunit.client.1.smithi092.stdout:5/666: rename d0/de/d19/d3c/d41/d8d/dcb to d0/de/d19/d1a/d1e/d74/ddf 0 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:6/758: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:8/719: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:3/811: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:2/774: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:7/829: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:4/974: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:1/955: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:9/824: sync 2024-09-17T01:52:19.724 INFO:tasks.workunit.client.1.smithi092.stdout:0/753: sync 2024-09-17T01:52:19.725 INFO:tasks.workunit.client.1.smithi092.stdout:5/667: mknod d0/de/d19/d1a/d1e/d3e/d4c/ce0 0 2024-09-17T01:52:19.728 INFO:tasks.workunit.client.1.smithi092.stdout:4/975: write d4/d7b/d7d/fbf [1124104,15208] 0 2024-09-17T01:52:19.728 INFO:tasks.workunit.client.1.smithi092.stdout:8/720: creat d15/d25/d27/d87/fef x:0 0 0 2024-09-17T01:52:19.728 INFO:tasks.workunit.client.1.smithi092.stdout:1/956: write db/d1d/d23/d55/fa9 [366815,51944] 0 2024-09-17T01:52:19.731 INFO:tasks.workunit.client.1.smithi092.stdout:1/957: readlink db/d6c/d7e/d82/ld7 0 2024-09-17T01:52:19.732 INFO:tasks.workunit.client.1.smithi092.stdout:5/668: fsync d0/de/d19/d3c/d41/d8d/fbe 0 2024-09-17T01:52:19.734 INFO:tasks.workunit.client.1.smithi092.stdout:6/759: mkdir d3/d10/d8c/d43/de7 0 2024-09-17T01:52:19.734 INFO:tasks.workunit.client.1.smithi092.stdout:9/825: dread d0/d7/d12/d34/d26/d54/d6b/f92 [0,4194304] 0 2024-09-17T01:52:19.737 INFO:tasks.workunit.client.1.smithi092.stdout:2/775: symlink d10/d5c/l100 0 2024-09-17T01:52:19.738 INFO:tasks.workunit.client.1.smithi092.stdout:2/776: chown d10/f1a 501 1 2024-09-17T01:52:19.740 INFO:tasks.workunit.client.1.smithi092.stdout:7/830: creat d3/d6/d13/d21/d2e/f114 x:0 0 0 2024-09-17T01:52:19.743 INFO:tasks.workunit.client.1.smithi092.stdout:0/754: write d3/da/fd3 [776070,108816] 0 2024-09-17T01:52:19.744 INFO:tasks.workunit.client.1.smithi092.stdout:1/958: write db/d1d/db5/f93 [1343041,91542] 0 2024-09-17T01:52:19.744 INFO:tasks.workunit.client.1.smithi092.stdout:8/721: unlink d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/d9a/la6 0 2024-09-17T01:52:19.746 INFO:tasks.workunit.client.1.smithi092.stdout:3/812: dwrite d4/d13/d2e/fc1 [0,4194304] 0 2024-09-17T01:52:19.747 INFO:tasks.workunit.client.1.smithi092.stdout:4/976: mknod d4/d5/d1d/c13a 0 2024-09-17T01:52:19.749 INFO:tasks.workunit.client.1.smithi092.stdout:5/669: dwrite d0/de/d19/d1a/d1e/d74/dc8/fd1 [0,4194304] 0 2024-09-17T01:52:19.753 INFO:tasks.workunit.client.1.smithi092.stdout:8/722: chown d15/d25/d27/d6e/fa9 1314665 1 2024-09-17T01:52:19.755 INFO:tasks.workunit.client.1.smithi092.stdout:8/723: chown d15/d25/d2b/d3d/c60 1 1 2024-09-17T01:52:19.755 INFO:tasks.workunit.client.1.smithi092.stdout:1/959: read db/d6c/d7e/d82/de8/f10e [344072,73903] 0 2024-09-17T01:52:19.756 INFO:tasks.workunit.client.1.smithi092.stdout:9/826: mkdir d0/d7c/dbd/df8 0 2024-09-17T01:52:19.757 INFO:tasks.workunit.client.1.smithi092.stdout:5/670: stat d0/de/d19/d1a/d1e/d52 0 2024-09-17T01:52:19.757 INFO:tasks.workunit.client.1.smithi092.stdout:1/960: chown db/f5f 21573 1 2024-09-17T01:52:19.823 INFO:tasks.workunit.client.1.smithi092.stdout:7/831: write d3/db/d26/d83/fd5 [4059396,35441] 0 2024-09-17T01:52:19.824 INFO:tasks.workunit.client.1.smithi092.stdout:3/813: rmdir d4/d20/d3f/dc0 39 2024-09-17T01:52:19.826 INFO:tasks.workunit.client.1.smithi092.stdout:8/724: creat d15/d25/d27/d6e/d95/ff0 x:0 0 0 2024-09-17T01:52:19.827 INFO:tasks.workunit.client.1.smithi092.stdout:9/827: dread d0/d7c/dbd/fcb [0,4194304] 0 2024-09-17T01:52:19.827 INFO:tasks.workunit.client.1.smithi092.stdout:6/760: write d3/fa [1347367,34530] 0 2024-09-17T01:52:19.828 INFO:tasks.workunit.client.1.smithi092.stdout:0/755: unlink d3/d2e/d3b/d48/d76/fb7 0 2024-09-17T01:52:19.830 INFO:tasks.workunit.client.1.smithi092.stdout:5/671: unlink d0/de/d19/d3c/d9e/cd6 0 2024-09-17T01:52:19.830 INFO:tasks.workunit.client.1.smithi092.stdout:1/961: symlink db/d6c/d7e/d82/def/l12f 0 2024-09-17T01:52:19.831 INFO:tasks.workunit.client.1.smithi092.stdout:8/725: mknod d15/d25/d27/d6e/d76/cf1 0 2024-09-17T01:52:19.834 INFO:tasks.workunit.client.1.smithi092.stdout:3/814: creat d4/d2f/f102 x:0 0 0 2024-09-17T01:52:19.835 INFO:tasks.workunit.client.1.smithi092.stdout:6/761: mknod d3/d10/d8c/d43/de7/ce8 0 2024-09-17T01:52:19.835 INFO:tasks.workunit.client.1.smithi092.stdout:8/726: stat d15/d25/d27/d6e/d76/cce 0 2024-09-17T01:52:19.837 INFO:tasks.workunit.client.1.smithi092.stdout:7/832: dwrite d3/db/f5e [0,4194304] 0 2024-09-17T01:52:19.837 INFO:tasks.workunit.client.1.smithi092.stdout:3/815: stat d4/d73/dba/dbe/fe4 0 2024-09-17T01:52:19.838 INFO:tasks.workunit.client.1.smithi092.stdout:9/828: rename d0/d7/d12/d34/d26/d54/f87 to d0/d7c/da9/ff9 0 2024-09-17T01:52:19.838 INFO:tasks.workunit.client.1.smithi092.stdout:6/762: chown d3/d10/d1f/d21/da5/f3e 29444706 1 2024-09-17T01:52:19.840 INFO:tasks.workunit.client.1.smithi092.stdout:7/833: chown d3/d6/d13/d21/d2e/d6e/f86 0 1 2024-09-17T01:52:19.840 INFO:tasks.workunit.client.1.smithi092.stdout:1/962: truncate db/d1d/f110 109480 0 2024-09-17T01:52:19.842 INFO:tasks.workunit.client.1.smithi092.stdout:1/963: write db/d1d/d23/da1/dc3/fe2 [1415074,4208] 0 2024-09-17T01:52:19.842 INFO:tasks.workunit.client.1.smithi092.stdout:2/777: dread d10/d4c/d80/d95/dc6/fca [0,4194304] 0 2024-09-17T01:52:19.845 INFO:tasks.workunit.client.1.smithi092.stdout:6/763: mknod d3/d10/d1f/d21/da5/d18/ce9 0 2024-09-17T01:52:19.846 INFO:tasks.workunit.client.1.smithi092.stdout:6/764: readlink d3/d10/d1f/d21/da5/l46 0 2024-09-17T01:52:19.846 INFO:tasks.workunit.client.1.smithi092.stdout:5/672: dread d0/d50/d70/d78/fda [0,4194304] 0 2024-09-17T01:52:19.849 INFO:tasks.workunit.client.1.smithi092.stdout:0/756: link d3/da/d1c/d3a/f66 d3/d2e/d3b/fe8 0 2024-09-17T01:52:19.854 INFO:tasks.workunit.client.1.smithi092.stdout:1/964: mknod db/d1d/db5/c130 0 2024-09-17T01:52:19.855 INFO:tasks.workunit.client.1.smithi092.stdout:9/829: mknod d0/d5/cfa 0 2024-09-17T01:52:19.858 INFO:tasks.workunit.client.1.smithi092.stdout:6/765: symlink d3/d10/d8c/d43/d5e/da0/lea 0 2024-09-17T01:52:19.859 INFO:tasks.workunit.client.1.smithi092.stdout:8/727: write fa [4590344,76427] 0 2024-09-17T01:52:19.859 INFO:tasks.workunit.client.1.smithi092.stdout:6/766: stat d3/d10/d8c/d43/d6a/l35 0 2024-09-17T01:52:19.860 INFO:tasks.workunit.client.1.smithi092.stdout:0/757: mknod d3/d2e/d3b/d72/d7a/ce9 0 2024-09-17T01:52:19.861 INFO:tasks.workunit.client.1.smithi092.stdout:0/758: write d3/d2e/d3b/d40/d7d/fd9 [480196,121085] 0 2024-09-17T01:52:19.862 INFO:tasks.workunit.client.1.smithi092.stdout:0/759: chown d3/d2e/d3b/d8f/d5f/db1 6011 1 2024-09-17T01:52:19.862 INFO:tasks.workunit.client.1.smithi092.stdout:3/816: rename d4/d16/f24 to d4/d2f/f103 0 2024-09-17T01:52:19.864 INFO:tasks.workunit.client.1.smithi092.stdout:1/965: fsync db/d1d/d23/d55/de5/fb6 0 2024-09-17T01:52:19.867 INFO:tasks.workunit.client.1.smithi092.stdout:5/673: mkdir d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/de1 0 2024-09-17T01:52:19.869 INFO:tasks.workunit.client.1.smithi092.stdout:6/767: creat d3/d10/d1f/d21/da5/d18/feb x:0 0 0 2024-09-17T01:52:19.869 INFO:tasks.workunit.client.1.smithi092.stdout:7/834: dwrite d3/db/d98/dce/d6a/f9b [0,4194304] 0 2024-09-17T01:52:19.872 INFO:tasks.workunit.client.1.smithi092.stdout:3/817: mkdir d4/d20/d31/d104 0 2024-09-17T01:52:19.874 INFO:tasks.workunit.client.1.smithi092.stdout:2/778: dwrite d10/f2a [4194304,4194304] 0 2024-09-17T01:52:19.875 INFO:tasks.workunit.client.1.smithi092.stdout:0/760: dread - d3/da/d15/d30/fcd zero size 2024-09-17T01:52:19.875 INFO:tasks.workunit.client.1.smithi092.stdout:6/768: stat d3/d10/d8c/d43/d5e/da0/lea 0 2024-09-17T01:52:19.878 INFO:tasks.workunit.client.1.smithi092.stdout:6/769: write d3/f6 [2036627,98128] 0 2024-09-17T01:52:19.878 INFO:tasks.workunit.client.1.smithi092.stdout:1/966: unlink db/d1d/d23/f89 0 2024-09-17T01:52:19.883 INFO:tasks.workunit.client.1.smithi092.stdout:1/967: chown db/d6c/db3/dea/deb/f10b 8661 1 2024-09-17T01:52:19.883 INFO:tasks.workunit.client.1.smithi092.stdout:2/779: creat d10/d55/dda/f101 x:0 0 0 2024-09-17T01:52:19.884 INFO:tasks.workunit.client.1.smithi092.stdout:1/968: write db/d6c/d7e/df2/f123 [68386,120512] 0 2024-09-17T01:52:19.886 INFO:tasks.workunit.client.1.smithi092.stdout:8/728: write d15/f1e [24139,25224] 0 2024-09-17T01:52:19.887 INFO:tasks.workunit.client.1.smithi092.stdout:3/818: mknod d4/d20/d39/d70/d95/da3/c105 0 2024-09-17T01:52:19.888 INFO:tasks.workunit.client.1.smithi092.stdout:3/819: truncate d4/d2f/fe3 701822 0 2024-09-17T01:52:19.889 INFO:tasks.workunit.client.1.smithi092.stdout:5/674: unlink d0/d77/c97 0 2024-09-17T01:52:19.889 INFO:tasks.workunit.client.1.smithi092.stdout:8/729: write d15/d25/d27/d6e/d95/dda/d40/d42/f45 [204504,83465] 0 2024-09-17T01:52:19.890 INFO:tasks.workunit.client.1.smithi092.stdout:7/835: mkdir d3/d6/d13/d21/d115 0 2024-09-17T01:52:19.890 INFO:tasks.workunit.client.1.smithi092.stdout:6/770: truncate d3/d10/d1f/d21/d28/f82 621406 0 2024-09-17T01:52:19.891 INFO:tasks.workunit.client.1.smithi092.stdout:7/836: fdatasync d3/d6/f1c 0 2024-09-17T01:52:19.893 INFO:tasks.workunit.client.1.smithi092.stdout:9/830: getdents d0/d7c/dbd 0 2024-09-17T01:52:19.894 INFO:tasks.workunit.client.1.smithi092.stdout:0/761: mknod d3/da/d15/cea 0 2024-09-17T01:52:19.898 INFO:tasks.workunit.client.1.smithi092.stdout:9/831: dread - d0/d7/d12/d34/d26/feb zero size 2024-09-17T01:52:19.903 INFO:tasks.workunit.client.1.smithi092.stdout:8/730: dwrite d15/d25/f68 [4194304,4194304] 0 2024-09-17T01:52:19.903 INFO:tasks.workunit.client.1.smithi092.stdout:0/762: symlink d3/d2e/d3b/d40/d7d/leb 0 2024-09-17T01:52:19.904 INFO:tasks.workunit.client.1.smithi092.stdout:2/780: dwrite d10/d1d/d2c/f57 [0,4194304] 0 2024-09-17T01:52:19.905 INFO:tasks.workunit.client.1.smithi092.stdout:7/837: mknod d3/d6/d13/d21/c116 0 2024-09-17T01:52:19.906 INFO:tasks.workunit.client.1.smithi092.stdout:1/969: write db/d6c/db3/dea/deb/fee [1209723,62557] 0 2024-09-17T01:52:19.906 INFO:tasks.workunit.client.1.smithi092.stdout:6/771: getdents d3/d10/d8c/d49/db9 0 2024-09-17T01:52:19.913 INFO:tasks.workunit.client.1.smithi092.stdout:0/763: readlink d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/lde 0 2024-09-17T01:52:19.914 INFO:tasks.workunit.client.1.smithi092.stdout:8/731: symlink d15/d25/d27/d6e/d95/dcf/lf2 0 2024-09-17T01:52:19.916 INFO:tasks.workunit.client.1.smithi092.stdout:7/838: creat d3/db/d98/dce/daf/f117 x:0 0 0 2024-09-17T01:52:19.918 INFO:tasks.workunit.client.1.smithi092.stdout:3/820: dwrite d4/d2f/d44/f77 [0,4194304] 0 2024-09-17T01:52:19.919 INFO:tasks.workunit.client.1.smithi092.stdout:2/781: rename d10/d1d/fd2 to d10/d1d/d2c/d5a/d7a/df5/f102 0 2024-09-17T01:52:19.919 INFO:tasks.workunit.client.1.smithi092.stdout:8/732: write d15/d25/d2b/d3d/dc6/fea [502261,36670] 0 2024-09-17T01:52:19.920 INFO:tasks.workunit.client.1.smithi092.stdout:1/970: fdatasync db/d1d/d23/f4c 0 2024-09-17T01:52:19.920 INFO:tasks.workunit.client.1.smithi092.stdout:5/675: dread d0/de/d19/d1a/d1e/f36 [0,4194304] 0 2024-09-17T01:52:19.922 INFO:tasks.workunit.client.1.smithi092.stdout:2/782: dread - d10/d55/dda/f101 zero size 2024-09-17T01:52:19.932 INFO:tasks.workunit.client.1.smithi092.stdout:2/783: mknod d10/d55/d84/c103 0 2024-09-17T01:52:19.936 INFO:tasks.workunit.client.1.smithi092.stdout:9/832: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:52:19.936 INFO:tasks.workunit.client.1.smithi092.stdout:7/839: creat d3/d2b/d84/da7/f118 x:0 0 0 2024-09-17T01:52:19.936 INFO:tasks.workunit.client.1.smithi092.stdout:6/772: rename d3/d10/f6f to d3/d25/da8/dad/dae/fec 0 2024-09-17T01:52:19.937 INFO:tasks.workunit.client.1.smithi092.stdout:5/676: dwrite d0/de/d19/d1a/d1e/f71 [0,4194304] 0 2024-09-17T01:52:19.940 INFO:tasks.workunit.client.1.smithi092.stdout:3/821: creat d4/d16/d1b/daf/f106 x:0 0 0 2024-09-17T01:52:19.941 INFO:tasks.workunit.client.1.smithi092.stdout:4/977: sync 2024-09-17T01:52:19.945 INFO:tasks.workunit.client.1.smithi092.stdout:8/733: dwrite d15/d25/d27/d6e/d95/dda/f50 [0,4194304] 0 2024-09-17T01:52:19.947 INFO:tasks.workunit.client.1.smithi092.stdout:8/734: chown d15/d25/d2b/d3d/d9f/l72 38255484 1 2024-09-17T01:52:19.947 INFO:tasks.workunit.client.1.smithi092.stdout:5/677: chown d0/de/d19/d1a/d1e/fa2 37318 1 2024-09-17T01:52:19.948 INFO:tasks.workunit.client.1.smithi092.stdout:6/773: fdatasync d3/d10/d8c/d43/d6a/d3d/f95 0 2024-09-17T01:52:19.949 INFO:tasks.workunit.client.1.smithi092.stdout:0/764: write d3/d2e/d3b/d72/fbe [249841,101963] 0 2024-09-17T01:52:19.955 INFO:tasks.workunit.client.1.smithi092.stdout:9/833: rename d0/d7c/da9/ff9 to d0/d5/d29/ffb 0 2024-09-17T01:52:19.956 INFO:tasks.workunit.client.1.smithi092.stdout:3/822: write d4/d13/d2e/d43/fc8 [399255,102892] 0 2024-09-17T01:52:19.957 INFO:tasks.workunit.client.1.smithi092.stdout:3/823: dread - d4/d20/fb0 zero size 2024-09-17T01:52:19.958 INFO:tasks.workunit.client.1.smithi092.stdout:4/978: creat d4/d5/d1d/d30/d3f/d4b/dff/d119/f13b x:0 0 0 2024-09-17T01:52:19.960 INFO:tasks.workunit.client.1.smithi092.stdout:7/840: link d3/db/d98/dce/fe2 d3/d6/d13/d21/d115/f119 0 2024-09-17T01:52:19.961 INFO:tasks.workunit.client.1.smithi092.stdout:1/971: dwrite db/d1d/d23/f5b [0,4194304] 0 2024-09-17T01:52:19.963 INFO:tasks.workunit.client.1.smithi092.stdout:5/678: unlink d0/fb7 0 2024-09-17T01:52:19.964 INFO:tasks.workunit.client.1.smithi092.stdout:0/765: symlink d3/dc8/dd2/lec 0 2024-09-17T01:52:19.967 INFO:tasks.workunit.client.1.smithi092.stdout:6/774: fsync d3/d10/d1f/d21/d1e/d55/f93 0 2024-09-17T01:52:19.970 INFO:tasks.workunit.client.1.smithi092.stdout:9/834: creat d0/d5/d29/ffc x:0 0 0 2024-09-17T01:52:19.971 INFO:tasks.workunit.client.1.smithi092.stdout:8/735: mkdir d15/d25/d27/df3 0 2024-09-17T01:52:19.972 INFO:tasks.workunit.client.1.smithi092.stdout:9/835: readlink d0/df/d17/d9d/lc7 0 2024-09-17T01:52:19.972 INFO:tasks.workunit.client.1.smithi092.stdout:8/736: chown d15/d25/d27/d6e/d76 1707985 1 2024-09-17T01:52:19.974 INFO:tasks.workunit.client.1.smithi092.stdout:4/979: mkdir d4/d13/d3b/d42/d76/d35/d3e/d7c/d13c 0 2024-09-17T01:52:19.977 INFO:tasks.workunit.client.1.smithi092.stdout:4/980: write d4/d13/f8f [1509402,20229] 0 2024-09-17T01:52:19.977 INFO:tasks.workunit.client.1.smithi092.stdout:2/784: getdents d10/d1d/d96/de7 0 2024-09-17T01:52:19.977 INFO:tasks.workunit.client.1.smithi092.stdout:5/679: write d0/d7e/fb6 [3055656,85612] 0 2024-09-17T01:52:19.978 INFO:tasks.workunit.client.1.smithi092.stdout:4/981: readlink d4/d5/l97 0 2024-09-17T01:52:19.979 INFO:tasks.workunit.client.1.smithi092.stdout:3/824: mknod d4/d73/c107 0 2024-09-17T01:52:19.984 INFO:tasks.workunit.client.1.smithi092.stdout:8/737: fdatasync d15/d25/d27/d6e/d95/dda/d3b/f79 0 2024-09-17T01:52:19.985 INFO:tasks.workunit.client.1.smithi092.stdout:9/836: dwrite d0/f6 [12582912,4194304] 0 2024-09-17T01:52:19.994 INFO:tasks.workunit.client.1.smithi092.stdout:1/972: rename db/d1d/d4b/d9a/f12b to db/f131 0 2024-09-17T01:52:19.994 INFO:tasks.workunit.client.1.smithi092.stdout:9/837: fdatasync d0/d7/d12/d86/d93/fd8 0 2024-09-17T01:52:19.996 INFO:tasks.workunit.client.1.smithi092.stdout:9/838: write d0/d7/d12/fda [3771093,66333] 0 2024-09-17T01:52:19.998 INFO:tasks.workunit.client.1.smithi092.stdout:8/738: mkdir d15/d25/d27/d6e/d95/dda/d40/d42/d93/df4 0 2024-09-17T01:52:19.999 INFO:tasks.workunit.client.1.smithi092.stdout:5/680: rmdir d0/de/d19/d1a/d1e/d74/dc8/dd5 39 2024-09-17T01:52:20.000 INFO:tasks.workunit.client.1.smithi092.stdout:0/766: write d3/d2e/d55/f70 [1370915,109180] 0 2024-09-17T01:52:20.001 INFO:tasks.workunit.client.1.smithi092.stdout:7/841: link d3/d6/d13/c32 d3/d6/dc2/ddc/c11a 0 2024-09-17T01:52:20.002 INFO:tasks.workunit.client.1.smithi092.stdout:0/767: chown d3/d73 1189190 1 2024-09-17T01:52:20.004 INFO:tasks.workunit.client.1.smithi092.stdout:3/825: rename d4/d20/d39/d70/ffd to d4/d20/d9f/f108 0 2024-09-17T01:52:20.004 INFO:tasks.workunit.client.1.smithi092.stdout:8/739: write d15/d25/d27/d6e/d76/fbe [333848,64166] 0 2024-09-17T01:52:20.004 INFO:tasks.workunit.client.1.smithi092.stdout:1/973: dwrite db/d1d/db5/f6b [0,4194304] 0 2024-09-17T01:52:20.009 INFO:tasks.workunit.client.1.smithi092.stdout:6/775: getdents d3 0 2024-09-17T01:52:20.010 INFO:tasks.workunit.client.1.smithi092.stdout:6/776: truncate d3/d70/fe1 883116 0 2024-09-17T01:52:20.012 INFO:tasks.workunit.client.1.smithi092.stdout:7/842: unlink d3/d6/d13/f100 0 2024-09-17T01:52:20.013 INFO:tasks.workunit.client.1.smithi092.stdout:2/785: dread d10/d8d/f76 [0,4194304] 0 2024-09-17T01:52:20.014 INFO:tasks.workunit.client.1.smithi092.stdout:0/768: dread d3/d2e/d3b/d72/fbe [0,4194304] 0 2024-09-17T01:52:20.015 INFO:tasks.workunit.client.1.smithi092.stdout:4/982: link d4/d13/d3b/d42/d76/d35/d3e/d7c/ddf/f69 d4/d5/d1d/d30/d3f/d4b/dff/f13d 0 2024-09-17T01:52:20.017 INFO:tasks.workunit.client.1.smithi092.stdout:1/974: chown db/d1d/d4b/d9a/lce 0 1 2024-09-17T01:52:20.019 INFO:tasks.workunit.client.1.smithi092.stdout:9/839: mknod d0/d7/de5/cfd 0 2024-09-17T01:52:20.021 INFO:tasks.workunit.client.1.smithi092.stdout:5/681: write d0/de/d19/d3c/fa0 [708537,81154] 0 2024-09-17T01:52:20.022 INFO:tasks.workunit.client.1.smithi092.stdout:3/826: mknod d4/d20/d3f/c109 0 2024-09-17T01:52:20.029 INFO:tasks.workunit.client.1.smithi092.stdout:8/740: write d15/d25/d27/d6e/d95/dda/d40/d42/f55 [2408270,45900] 0 2024-09-17T01:52:20.031 INFO:tasks.workunit.client.1.smithi092.stdout:1/975: creat db/d6c/d7e/d82/de8/f132 x:0 0 0 2024-09-17T01:52:20.032 INFO:tasks.workunit.client.1.smithi092.stdout:7/843: write d3/db/d26/d65/d9a/fc9 [741728,34325] 0 2024-09-17T01:52:20.033 INFO:tasks.workunit.client.1.smithi092.stdout:9/840: rmdir d0/df/d17/d9d 39 2024-09-17T01:52:20.036 INFO:tasks.workunit.client.1.smithi092.stdout:0/769: dread d3/f12 [0,4194304] 0 2024-09-17T01:52:20.038 INFO:tasks.workunit.client.1.smithi092.stdout:8/741: rmdir d15/d25/d27/d87 39 2024-09-17T01:52:20.038 INFO:tasks.workunit.client.1.smithi092.stdout:4/983: dwrite d4/d13/d3b/d42/d76/d35/d3e/f43 [0,4194304] 0 2024-09-17T01:52:20.039 INFO:tasks.workunit.client.1.smithi092.stdout:9/841: chown d0/d7/d12/d34/d26/f6f 123 1 2024-09-17T01:52:20.041 INFO:tasks.workunit.client.1.smithi092.stdout:2/786: symlink d10/d5c/l104 0 2024-09-17T01:52:20.043 INFO:tasks.workunit.client.1.smithi092.stdout:1/976: dwrite db/d6c/d7e/d82/fbd [4194304,4194304] 0 2024-09-17T01:52:20.043 INFO:tasks.workunit.client.1.smithi092.stdout:7/844: rename d3/d6/da1/f10d to d3/db/d98/dce/d61/f11b 0 2024-09-17T01:52:20.046 INFO:tasks.workunit.client.1.smithi092.stdout:6/777: getdents d3/d10/d8c/d43/d5e/d73/d8f/da4 0 2024-09-17T01:52:20.046 INFO:tasks.workunit.client.1.smithi092.stdout:5/682: fdatasync d0/d50/da5/fb9 0 2024-09-17T01:52:20.049 INFO:tasks.workunit.client.1.smithi092.stdout:4/984: unlink d4/d5/c1f 0 2024-09-17T01:52:20.052 INFO:tasks.workunit.client.1.smithi092.stdout:7/845: symlink d3/db/d26/d65/d9a/l11c 0 2024-09-17T01:52:20.054 INFO:tasks.workunit.client.1.smithi092.stdout:9/842: rmdir d0/df/d17/d9d 39 2024-09-17T01:52:20.057 INFO:tasks.workunit.client.1.smithi092.stdout:4/985: rename d4/d5/d1d/dae to d4/d5/d8/d99/dcf/d13e 0 2024-09-17T01:52:20.059 INFO:tasks.workunit.client.1.smithi092.stdout:4/986: fdatasync d4/d5/d8/d99/dcf/f100 0 2024-09-17T01:52:20.060 INFO:tasks.workunit.client.1.smithi092.stdout:2/787: unlink d10/d1d/d2c/d5a/d7a/cf7 0 2024-09-17T01:52:20.061 INFO:tasks.workunit.client.1.smithi092.stdout:1/977: dread db/d1d/d23/f45 [0,4194304] 0 2024-09-17T01:52:20.063 INFO:tasks.workunit.client.1.smithi092.stdout:7/846: unlink d3/db/d98/dce/l73 0 2024-09-17T01:52:20.064 INFO:tasks.workunit.client.1.smithi092.stdout:7/847: write d3/d2b/d84/fef [3651491,5827] 0 2024-09-17T01:52:20.066 INFO:tasks.workunit.client.1.smithi092.stdout:6/778: link d3/d10/d1f/d21/d1e/d55/f5b d3/d10/d8c/d43/d5e/da1/fed 0 2024-09-17T01:52:20.067 INFO:tasks.workunit.client.1.smithi092.stdout:5/683: write d0/d50/f5b [4086983,48773] 0 2024-09-17T01:52:20.068 INFO:tasks.workunit.client.1.smithi092.stdout:9/843: read d0/d7/d12/d34/d26/d54/d6b/f78 [3688660,22888] 0 2024-09-17T01:52:20.069 INFO:tasks.workunit.client.1.smithi092.stdout:5/684: write d0/d50/da5/fb9 [146423,97054] 0 2024-09-17T01:52:20.072 INFO:tasks.workunit.client.1.smithi092.stdout:1/978: truncate db/d1d/d2e/d62/fc0 1114482 0 2024-09-17T01:52:20.073 INFO:tasks.workunit.client.1.smithi092.stdout:7/848: creat d3/d6/dc2/dc5/f11d x:0 0 0 2024-09-17T01:52:20.074 INFO:tasks.workunit.client.1.smithi092.stdout:1/979: readlink db/d3b/l6a 0 2024-09-17T01:52:20.075 INFO:tasks.workunit.client.1.smithi092.stdout:9/844: readlink d0/df/d17/d9d/lc7 0 2024-09-17T01:52:20.080 INFO:tasks.workunit.client.1.smithi092.stdout:2/788: creat d10/d4c/d80/d95/f105 x:0 0 0 2024-09-17T01:52:20.081 INFO:tasks.workunit.client.1.smithi092.stdout:2/789: stat d10/d1d/d2c/d5a/d7a/df5 0 2024-09-17T01:52:20.084 INFO:tasks.workunit.client.1.smithi092.stdout:1/980: mkdir db/d1d/d2e/d62/d133 0 2024-09-17T01:52:20.086 INFO:tasks.workunit.client.1.smithi092.stdout:9/845: mkdir d0/df/d5d/dfe 0 2024-09-17T01:52:20.087 INFO:tasks.workunit.client.1.smithi092.stdout:4/987: link d4/d5/d1d/d30/l5d d4/d5/d1d/d138/l13f 0 2024-09-17T01:52:20.089 INFO:tasks.workunit.client.1.smithi092.stdout:7/849: dread d3/db/d26/f80 [0,4194304] 0 2024-09-17T01:52:20.090 INFO:tasks.workunit.client.1.smithi092.stdout:5/685: mkdir d0/de/d19/d1a/d1e/d3e/de2 0 2024-09-17T01:52:20.092 INFO:tasks.workunit.client.1.smithi092.stdout:6/779: write d3/d10/d1f/d21/da5/d18/f27 [835959,75592] 0 2024-09-17T01:52:20.094 INFO:tasks.workunit.client.1.smithi092.stdout:9/846: mkdir d0/d7/dcc/dff 0 2024-09-17T01:52:20.097 INFO:tasks.workunit.client.1.smithi092.stdout:7/850: creat d3/db/d98/dce/d6a/dc8/f11e x:0 0 0 2024-09-17T01:52:20.101 INFO:tasks.workunit.client.1.smithi092.stdout:6/780: unlink d3/d10/d1f/d21/d1e/lbf 0 2024-09-17T01:52:20.106 INFO:tasks.workunit.client.1.smithi092.stdout:7/851: unlink d3/d6/d13/c102 0 2024-09-17T01:52:20.108 INFO:tasks.workunit.client.1.smithi092.stdout:7/852: stat d3/d6/d13/d21/d2e/d6e/f53 0 2024-09-17T01:52:20.111 INFO:tasks.workunit.client.1.smithi092.stdout:1/981: getdents db/d1d/d4b/d9a 0 2024-09-17T01:52:20.112 INFO:tasks.workunit.client.1.smithi092.stdout:6/781: dwrite d3/d10/d8c/d43/d6a/fab [0,4194304] 0 2024-09-17T01:52:20.112 INFO:tasks.workunit.client.1.smithi092.stdout:5/686: getdents d0/de/d19/d3c/d41/d8d 0 2024-09-17T01:52:20.121 INFO:tasks.workunit.client.1.smithi092.stdout:1/982: read db/d1d/db5/f93 [631477,88627] 0 2024-09-17T01:52:20.122 INFO:tasks.workunit.client.1.smithi092.stdout:9/847: write d0/d5/fc1 [1501492,9952] 0 2024-09-17T01:52:20.123 INFO:tasks.workunit.client.1.smithi092.stdout:7/853: dwrite d3/d2b/d84/fca [0,4194304] 0 2024-09-17T01:52:20.124 INFO:tasks.workunit.client.1.smithi092.stdout:4/988: write d4/d5/d8/fdc [483944,97961] 0 2024-09-17T01:52:20.125 INFO:tasks.workunit.client.1.smithi092.stdout:9/848: write d0/f6 [5421837,75280] 0 2024-09-17T01:52:20.125 INFO:tasks.workunit.client.1.smithi092.stdout:2/790: write d10/d5c/f85 [609450,82771] 0 2024-09-17T01:52:20.128 INFO:tasks.workunit.client.1.smithi092.stdout:7/854: write d3/db/d98/dce/fda [106652,11946] 0 2024-09-17T01:52:20.130 INFO:tasks.workunit.client.1.smithi092.stdout:4/989: write d4/d13/d20/de0/f104 [953375,17556] 0 2024-09-17T01:52:20.131 INFO:tasks.workunit.client.1.smithi092.stdout:2/791: read d10/d55/f5b [2837296,76316] 0 2024-09-17T01:52:20.131 INFO:tasks.workunit.client.1.smithi092.stdout:9/849: unlink d0/df/d5d/la6 0 2024-09-17T01:52:20.149 INFO:tasks.workunit.client.1.smithi092.stdout:7/855: mknod d3/db/d98/dce/d60/d93/dfb/c11f 0 2024-09-17T01:52:20.150 INFO:tasks.workunit.client.1.smithi092.stdout:4/990: fsync d4/f62 0 2024-09-17T01:52:20.153 INFO:tasks.workunit.client.1.smithi092.stdout:1/983: dread db/d6c/d7e/d82/de8/ff9 [0,4194304] 0 2024-09-17T01:52:20.155 INFO:tasks.workunit.client.1.smithi092.stdout:1/984: dread - db/d6c/d7e/d82/f102 zero size 2024-09-17T01:52:20.156 INFO:tasks.workunit.client.1.smithi092.stdout:7/856: symlink d3/db/d26/l120 0 2024-09-17T01:52:20.157 INFO:tasks.workunit.client.1.smithi092.stdout:6/782: dwrite d3/d10/d1f/d21/d28/f2c [0,4194304] 0 2024-09-17T01:52:20.157 INFO:tasks.workunit.client.1.smithi092.stdout:2/792: mknod d10/d1d/d24/d6e/c106 0 2024-09-17T01:52:20.160 INFO:tasks.workunit.client.1.smithi092.stdout:4/991: fdatasync d4/d5/d1d/d30/f5b 0 2024-09-17T01:52:20.165 INFO:tasks.workunit.client.1.smithi092.stdout:2/793: unlink d10/d4c/d80/df9/f99 0 2024-09-17T01:52:20.167 INFO:tasks.workunit.client.1.smithi092.stdout:2/794: write d10/d5c/f85 [935048,74720] 0 2024-09-17T01:52:20.168 INFO:tasks.workunit.client.1.smithi092.stdout:6/783: unlink d3/c91 0 2024-09-17T01:52:20.170 INFO:tasks.workunit.client.1.smithi092.stdout:7/857: mkdir d3/d6/d13/d21/d115/d121 0 2024-09-17T01:52:20.171 INFO:tasks.workunit.client.1.smithi092.stdout:4/992: mknod d4/d5/d1d/c140 0 2024-09-17T01:52:20.173 INFO:tasks.workunit.client.1.smithi092.stdout:1/985: dread db/d1d/d23/d34/fb0 [0,4194304] 0 2024-09-17T01:52:20.175 INFO:tasks.workunit.client.1.smithi092.stdout:4/993: write d4/d13/d3b/d42/f86 [4655441,112862] 0 2024-09-17T01:52:20.177 INFO:tasks.workunit.client.1.smithi092.stdout:7/858: mknod d3/db/d98/dce/c122 0 2024-09-17T01:52:20.178 INFO:tasks.workunit.client.1.smithi092.stdout:7/859: chown d3/db/d98/dce/f6c 6196620 1 2024-09-17T01:52:20.180 INFO:tasks.workunit.client.1.smithi092.stdout:1/986: rename db/d1d/d2e/f32 to db/d1d/d23/da1/dc3/f134 0 2024-09-17T01:52:20.184 INFO:tasks.workunit.client.1.smithi092.stdout:1/987: symlink db/d6c/d7a/l135 0 2024-09-17T01:52:20.185 INFO:tasks.workunit.client.1.smithi092.stdout:7/860: truncate d3/d6/d13/f111 567197 0 2024-09-17T01:52:20.189 INFO:tasks.workunit.client.1.smithi092.stdout:6/784: truncate d3/d10/d1f/d21/f65 67798 0 2024-09-17T01:52:20.194 INFO:tasks.workunit.client.1.smithi092.stdout:4/994: dread d4/d5/d8/d92/fa3 [0,4194304] 0 2024-09-17T01:52:20.199 INFO:tasks.workunit.client.1.smithi092.stdout:2/795: dwrite d10/d55/f7e [0,4194304] 0 2024-09-17T01:52:20.201 INFO:tasks.workunit.client.1.smithi092.stdout:1/988: dwrite db/f87 [4194304,4194304] 0 2024-09-17T01:52:20.205 INFO:tasks.workunit.client.1.smithi092.stdout:4/995: rename d4/d5/d1d/f1a to d4/dbd/f141 0 2024-09-17T01:52:20.205 INFO:tasks.workunit.client.1.smithi092.stdout:1/989: write db/d1d/d23/d88/fff [1003959,25918] 0 2024-09-17T01:52:20.208 INFO:tasks.workunit.client.1.smithi092.stdout:7/861: dwrite d3/db/d26/d83/ff6 [0,4194304] 0 2024-09-17T01:52:20.209 INFO:tasks.workunit.client.1.smithi092.stdout:6/785: dwrite d3/f9e [0,4194304] 0 2024-09-17T01:52:20.213 INFO:tasks.workunit.client.1.smithi092.stdout:7/862: chown d3/fbe 3738969 1 2024-09-17T01:52:20.219 INFO:tasks.workunit.client.1.smithi092.stdout:6/786: mkdir d3/d10/d8c/d49/dee 0 2024-09-17T01:52:20.220 INFO:tasks.workunit.client.1.smithi092.stdout:7/863: truncate d3/d2b/d84/fef 5129998 0 2024-09-17T01:52:20.221 INFO:tasks.workunit.client.1.smithi092.stdout:1/990: rename db/d1d/f22 to db/d6c/d7e/dd1/f136 0 2024-09-17T01:52:20.221 INFO:tasks.workunit.client.1.smithi092.stdout:6/787: fdatasync d3/f33 0 2024-09-17T01:52:20.221 INFO:tasks.workunit.client.1.smithi092.stdout:4/996: dwrite d4/f1e [4194304,4194304] 0 2024-09-17T01:52:20.224 INFO:tasks.workunit.client.1.smithi092.stdout:1/991: write db/d3b/f48 [5092657,35434] 0 2024-09-17T01:52:20.224 INFO:tasks.workunit.client.1.smithi092.stdout:4/997: chown d4/d7b/d7d/f93 378224928 1 2024-09-17T01:52:20.226 INFO:tasks.workunit.client.1.smithi092.stdout:1/992: truncate db/d6c/db3/dea/deb/f10b 455376 0 2024-09-17T01:52:20.227 INFO:tasks.workunit.client.1.smithi092.stdout:7/864: write d3/db/d26/d6f/feb [1087025,43796] 0 2024-09-17T01:52:20.230 INFO:tasks.workunit.client.1.smithi092.stdout:4/998: unlink d4/d5/d8/f68 0 2024-09-17T01:52:20.233 INFO:tasks.workunit.client.1.smithi092.stdout:4/999: write d4/d5/fa2 [9352670,39239] 0 2024-09-17T01:52:20.233 INFO:tasks.workunit.client.1.smithi092.stdout:7/865: creat d3/db/d98/dce/d6a/dad/f123 x:0 0 0 2024-09-17T01:52:20.235 INFO:tasks.workunit.client.1.smithi092.stdout:6/788: getdents d3/d10/d1f 0 2024-09-17T01:52:20.235 INFO:tasks.workunit.client.1.smithi092.stdout:7/866: symlink d3/db/d26/d6f/l124 0 2024-09-17T01:52:20.237 INFO:tasks.workunit.client.1.smithi092.stdout:7/867: mkdir d3/db/d7b/d125 0 2024-09-17T01:52:20.238 INFO:tasks.workunit.client.1.smithi092.stdout:7/868: write d3/d6/fc7 [1765571,119693] 0 2024-09-17T01:52:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:19 smithi092 ceph-mon[33552]: pgmap v20: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 109 MiB/s rd, 261 MiB/s wr, 543 op/s 2024-09-17T01:52:20.255 INFO:tasks.workunit.client.1.smithi092.stdout:1/993: dwrite db/d1d/d23/f45 [0,4194304] 0 2024-09-17T01:52:20.257 INFO:tasks.workunit.client.1.smithi092.stdout:6/789: dread d3/d25/f9c [0,4194304] 0 2024-09-17T01:52:20.259 INFO:tasks.workunit.client.1.smithi092.stdout:1/994: rmdir db/d1d/d23/d55/de5/dd3 39 2024-09-17T01:52:20.261 INFO:tasks.workunit.client.1.smithi092.stdout:6/790: dread d3/d70/fe5 [0,4194304] 0 2024-09-17T01:52:20.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:19 smithi031 ceph-mon[27673]: pgmap v20: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 109 MiB/s rd, 261 MiB/s wr, 543 op/s 2024-09-17T01:52:20.266 INFO:tasks.workunit.client.1.smithi092.stdout:1/995: dwrite db/d3b/f48 [0,4194304] 0 2024-09-17T01:52:20.267 INFO:tasks.workunit.client.1.smithi092.stdout:6/791: rmdir d3/d10/d8c/d43/d5e/dd7 0 2024-09-17T01:52:20.267 INFO:tasks.workunit.client.1.smithi092.stdout:1/996: stat db/d3b/f127 0 2024-09-17T01:52:20.269 INFO:tasks.workunit.client.1.smithi092.stdout:6/792: write d3/f44 [3181356,26198] 0 2024-09-17T01:52:20.270 INFO:tasks.workunit.client.1.smithi092.stdout:1/997: dread - db/d6c/d7e/d82/de8/f132 zero size 2024-09-17T01:52:20.274 INFO:tasks.workunit.client.1.smithi092.stdout:6/793: getdents d3/d10/d8c/d43/d5e/da0 0 2024-09-17T01:52:20.276 INFO:tasks.workunit.client.1.smithi092.stdout:6/794: rmdir d3/d10/d8c/d43/d5e/d73/d8f 39 2024-09-17T01:52:20.280 INFO:tasks.workunit.client.1.smithi092.stdout:6/795: link d3/d70/lc4 d3/d10/d8c/d43/d5e/d73/d8f/da4/lef 0 2024-09-17T01:52:20.299 INFO:tasks.workunit.client.1.smithi092.stdout:6/796: dwrite d3/d10/d1f/d21/f7c [0,4194304] 0 2024-09-17T01:52:20.304 INFO:tasks.workunit.client.1.smithi092.stdout:6/797: write d3/d10/d1f/d21/d1e/fd4 [572616,71307] 0 2024-09-17T01:52:20.306 INFO:tasks.workunit.client.1.smithi092.stdout:6/798: creat d3/d10/d8c/d43/d6a/d3d/d72/ff0 x:0 0 0 2024-09-17T01:52:20.376 INFO:tasks.workunit.client.1.smithi092.stdout:6/799: link d3/d10/d1f/c68 d3/d10/d1f/d21/da5/cf1 0 2024-09-17T01:52:20.377 INFO:tasks.workunit.client.1.smithi092.stdout:6/800: stat d3/d10/d1f/d21/d1e/cd6 0 2024-09-17T01:52:20.378 INFO:tasks.workunit.client.1.smithi092.stdout:6/801: write d3/d10/d8c/d49/f75 [3610174,12218] 0 2024-09-17T01:52:20.378 INFO:tasks.workunit.client.1.smithi092.stdout:6/802: readlink d3/l22 0 2024-09-17T01:52:20.383 INFO:tasks.workunit.client.1.smithi092.stdout:6/803: dread d3/d25/da8/fba [0,4194304] 0 2024-09-17T01:52:20.595 INFO:tasks.workunit.client.1.smithi092.stdout:3/827: sync 2024-09-17T01:52:20.597 INFO:tasks.workunit.client.1.smithi092.stdout:3/828: mknod d4/c10a 0 2024-09-17T01:52:20.611 INFO:tasks.workunit.client.1.smithi092.stdout:3/829: write d4/d2f/d44/d3c/f45 [940767,56603] 0 2024-09-17T01:52:20.616 INFO:tasks.workunit.client.1.smithi092.stdout:3/830: rename d4/d13/d2e/d43/fcd to d4/d20/d31/f10b 0 2024-09-17T01:52:20.617 INFO:tasks.workunit.client.1.smithi092.stdout:3/831: symlink d4/d2f/d44/d83/l10c 0 2024-09-17T01:52:20.618 INFO:tasks.workunit.client.1.smithi092.stdout:3/832: write d4/d13/d2e/d43/fa2 [331933,107725] 0 2024-09-17T01:52:20.621 INFO:tasks.workunit.client.1.smithi092.stdout:3/833: rmdir d4/d13/d2e/d5f 39 2024-09-17T01:52:20.623 INFO:tasks.workunit.client.1.smithi092.stdout:3/834: mknod d4/d73/dba/dbe/c10d 0 2024-09-17T01:52:20.625 INFO:tasks.workunit.client.1.smithi092.stdout:3/835: rmdir d4/d2f/d44/d54 39 2024-09-17T01:52:20.626 INFO:tasks.workunit.client.1.smithi092.stdout:3/836: read - d4/d13/d2e/d5f/fec zero size 2024-09-17T01:52:20.628 INFO:tasks.workunit.client.1.smithi092.stdout:3/837: mknod d4/d13/d2e/d74/c10e 0 2024-09-17T01:52:20.630 INFO:tasks.workunit.client.1.smithi092.stdout:3/838: creat d4/d13/f10f x:0 0 0 2024-09-17T01:52:20.634 INFO:tasks.workunit.client.1.smithi092.stdout:3/839: dread d4/d2f/d44/d54/dda/fe5 [0,4194304] 0 2024-09-17T01:52:20.637 INFO:tasks.workunit.client.1.smithi092.stdout:3/840: truncate d4/d13/d2e/f75 2354545 0 2024-09-17T01:52:20.652 INFO:tasks.workunit.client.1.smithi092.stdout:3/841: dread d4/d20/d39/f5e [0,4194304] 0 2024-09-17T01:52:20.654 INFO:tasks.workunit.client.1.smithi092.stdout:3/842: readlink d4/d2f/lc4 0 2024-09-17T01:52:20.656 INFO:tasks.workunit.client.1.smithi092.stdout:3/843: fdatasync d4/d20/d3f/dc0/fd1 0 2024-09-17T01:52:20.658 INFO:tasks.workunit.client.1.smithi092.stdout:3/844: symlink d4/d13/d2e/d5f/d89/l110 0 2024-09-17T01:52:20.668 INFO:tasks.workunit.client.1.smithi092.stdout:3/845: dwrite d4/d2f/d44/d3c/fa1 [0,4194304] 0 2024-09-17T01:52:20.669 INFO:tasks.workunit.client.1.smithi092.stdout:3/846: truncate d4/d16/d1b/daf/fd4 4493199 0 2024-09-17T01:52:20.670 INFO:tasks.workunit.client.1.smithi092.stdout:3/847: fdatasync d4/d2f/fe3 0 2024-09-17T01:52:20.672 INFO:tasks.workunit.client.1.smithi092.stdout:3/848: fsync d4/d20/d9f/f108 0 2024-09-17T01:52:20.673 INFO:tasks.workunit.client.1.smithi092.stdout:3/849: fsync d4/d20/f7c 0 2024-09-17T01:52:20.678 INFO:tasks.workunit.client.1.smithi092.stdout:3/850: rename d4/d13/f10f to d4/d2f/d44/f111 0 2024-09-17T01:52:20.681 INFO:tasks.workunit.client.1.smithi092.stdout:3/851: truncate d4/d13/f1d 5267815 0 2024-09-17T01:52:20.681 INFO:tasks.workunit.client.1.smithi092.stdout:3/852: stat d4/d13/d2e/d43/fcb 0 2024-09-17T01:52:20.689 INFO:tasks.workunit.client.1.smithi092.stdout:3/853: truncate d4/d13/d2e/d43/fcb 940029 0 2024-09-17T01:52:20.690 INFO:tasks.workunit.client.1.smithi092.stdout:3/854: rmdir d4/d20/d39/d70/d95 39 2024-09-17T01:52:20.693 INFO:tasks.workunit.client.1.smithi092.stdout:3/855: mknod d4/d2f/c112 0 2024-09-17T01:52:20.694 INFO:tasks.workunit.client.1.smithi092.stdout:3/856: chown d4/d73/d8f/d92/fa0 5917 1 2024-09-17T01:52:20.695 INFO:tasks.workunit.client.1.smithi092.stdout:3/857: mknod d4/d13/d2e/d5f/c113 0 2024-09-17T01:52:20.700 INFO:tasks.workunit.client.1.smithi092.stdout:3/858: write d4/d13/d2e/d43/fcb [1850284,92700] 0 2024-09-17T01:52:20.700 INFO:tasks.workunit.client.1.smithi092.stdout:0/770: sync 2024-09-17T01:52:20.702 INFO:tasks.workunit.client.1.smithi092.stdout:3/859: write d4/d20/d39/d70/fca [3040091,30055] 0 2024-09-17T01:52:20.707 INFO:tasks.workunit.client.1.smithi092.stdout:3/860: readlink d4/d16/d1b/l82 0 2024-09-17T01:52:20.707 INFO:tasks.workunit.client.1.smithi092.stdout:0/771: dwrite d3/d2e/d55/f67 [0,4194304] 0 2024-09-17T01:52:20.711 INFO:tasks.workunit.client.1.smithi092.stdout:3/861: mknod d4/d2f/d44/d54/dda/c114 0 2024-09-17T01:52:20.715 INFO:tasks.workunit.client.1.smithi092.stdout:0/772: dwrite d3/d2e/d55/f70 [0,4194304] 0 2024-09-17T01:52:20.717 INFO:tasks.workunit.client.1.smithi092.stdout:0/773: chown d3/da/fa2 110913 1 2024-09-17T01:52:20.721 INFO:tasks.workunit.client.1.smithi092.stdout:3/862: rename d4/d20/d39/d70/d95/da3/lf1 to d4/d20/d39/d70/d95/da3/l115 0 2024-09-17T01:52:20.721 INFO:tasks.workunit.client.1.smithi092.stdout:3/863: dread - d4/d20/d3f/dc0/fd3 zero size 2024-09-17T01:52:20.722 INFO:tasks.workunit.client.1.smithi092.stdout:0/774: getdents d3/d2e/d3b/d48/d76 0 2024-09-17T01:52:20.724 INFO:tasks.workunit.client.1.smithi092.stdout:3/864: mkdir d4/d13/d116 0 2024-09-17T01:52:20.725 INFO:tasks.workunit.client.1.smithi092.stdout:0/775: mknod d3/da/d15/d30/ced 0 2024-09-17T01:52:20.726 INFO:tasks.workunit.client.1.smithi092.stdout:0/776: dread - d3/dc8/fa1 zero size 2024-09-17T01:52:20.728 INFO:tasks.workunit.client.1.smithi092.stdout:3/865: rename d4/d2f/d44/d3c/l46 to d4/d20/d9f/dd5/l117 0 2024-09-17T01:52:20.728 INFO:tasks.workunit.client.1.smithi092.stdout:0/777: dread - d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/fe4 zero size 2024-09-17T01:52:20.729 INFO:tasks.workunit.client.1.smithi092.stdout:3/866: fdatasync d4/d16/d1b/f55 0 2024-09-17T01:52:20.730 INFO:tasks.workunit.client.1.smithi092.stdout:0/778: truncate d3/d2e/d55/f70 4619130 0 2024-09-17T01:52:20.731 INFO:tasks.workunit.client.1.smithi092.stdout:3/867: rmdir d4/d13/d2e/d43 39 2024-09-17T01:52:20.732 INFO:tasks.workunit.client.1.smithi092.stdout:3/868: write d4/d2f/fe3 [812441,40753] 0 2024-09-17T01:52:20.736 INFO:tasks.workunit.client.1.smithi092.stdout:3/869: getdents d4/d73/d8f/d92 0 2024-09-17T01:52:20.740 INFO:tasks.workunit.client.1.smithi092.stdout:3/870: dread d4/f28 [0,4194304] 0 2024-09-17T01:52:20.747 INFO:tasks.workunit.client.1.smithi092.stdout:3/871: dwrite d4/d16/d1b/ff6 [0,4194304] 0 2024-09-17T01:52:20.752 INFO:tasks.workunit.client.1.smithi092.stdout:0/779: dread d3/da/d1c/f43 [0,4194304] 0 2024-09-17T01:52:20.753 INFO:tasks.workunit.client.1.smithi092.stdout:3/872: dread d4/d20/d31/f10b [0,4194304] 0 2024-09-17T01:52:20.754 INFO:tasks.workunit.client.1.smithi092.stdout:0/780: fdatasync d3/d73/f75 0 2024-09-17T01:52:20.758 INFO:tasks.workunit.client.1.smithi092.stdout:3/873: dread d4/d20/f86 [0,4194304] 0 2024-09-17T01:52:20.766 INFO:tasks.workunit.client.1.smithi092.stdout:3/874: dwrite d4/d20/fb0 [0,4194304] 0 2024-09-17T01:52:20.770 INFO:tasks.workunit.client.1.smithi092.stdout:3/875: mknod d4/d20/d39/d70/c118 0 2024-09-17T01:52:20.772 INFO:tasks.workunit.client.1.smithi092.stdout:3/876: chown d4/d2f/d44/d3c/cd7 74 1 2024-09-17T01:52:20.773 INFO:tasks.workunit.client.1.smithi092.stdout:3/877: chown d4/d2f/d44/d54 143546521 1 2024-09-17T01:52:20.776 INFO:tasks.workunit.client.1.smithi092.stdout:3/878: creat d4/d20/d3f/dc0/f119 x:0 0 0 2024-09-17T01:52:20.778 INFO:tasks.workunit.client.1.smithi092.stdout:3/879: mknod d4/d73/d7b/c11a 0 2024-09-17T01:52:20.780 INFO:tasks.workunit.client.1.smithi092.stdout:3/880: mknod d4/d16/dfa/c11b 0 2024-09-17T01:52:20.781 INFO:tasks.workunit.client.1.smithi092.stdout:0/781: dread d3/d2e/d3b/f94 [0,4194304] 0 2024-09-17T01:52:20.784 INFO:tasks.workunit.client.1.smithi092.stdout:3/881: read d4/d2f/d44/d3c/f3e [1543754,48063] 0 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:7/869: sync 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:8/742: sync 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:1/998: sync 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:5/687: sync 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:2/796: sync 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:6/804: sync 2024-09-17T01:52:20.785 INFO:tasks.workunit.client.1.smithi092.stdout:9/850: sync 2024-09-17T01:52:20.788 INFO:tasks.workunit.client.1.smithi092.stdout:6/805: chown d3/d10/d8c/d43 173063 1 2024-09-17T01:52:20.789 INFO:tasks.workunit.client.1.smithi092.stdout:0/782: rename d3/d2e/d3b/d40 to d3/dee 0 2024-09-17T01:52:20.792 INFO:tasks.workunit.client.1.smithi092.stdout:0/783: fdatasync d3/dee/d7d/fd9 0 2024-09-17T01:52:20.793 INFO:tasks.workunit.client.1.smithi092.stdout:6/806: rmdir d3/d8e 39 2024-09-17T01:52:20.794 INFO:tasks.workunit.client.1.smithi092.stdout:9/851: dread - d0/df/fa2 zero size 2024-09-17T01:52:20.795 INFO:tasks.workunit.client.1.smithi092.stdout:3/882: mkdir d4/d13/d2e/d11c 0 2024-09-17T01:52:20.796 INFO:tasks.workunit.client.1.smithi092.stdout:8/743: creat d15/d25/d27/d6e/d95/dda/d3b/d78/ff5 x:0 0 0 2024-09-17T01:52:20.796 INFO:tasks.workunit.client.1.smithi092.stdout:9/852: write d0/d5/d29/ffc [847935,117318] 0 2024-09-17T01:52:20.800 INFO:tasks.workunit.client.1.smithi092.stdout:3/883: dread - d4/d2f/f102 zero size 2024-09-17T01:52:20.801 INFO:tasks.workunit.client.1.smithi092.stdout:5/688: dwrite d0/de/d19/f1f [0,4194304] 0 2024-09-17T01:52:20.802 INFO:tasks.workunit.client.1.smithi092.stdout:3/884: stat d4/d20/d39/d70/d95 0 2024-09-17T01:52:20.803 INFO:tasks.workunit.client.1.smithi092.stdout:7/870: rename d3/db/d26/d6f/feb to d3/db/d98/dce/d6a/dc8/f126 0 2024-09-17T01:52:20.807 INFO:tasks.workunit.client.1.smithi092.stdout:0/784: rmdir d3/d58/d8e 39 2024-09-17T01:52:20.808 INFO:tasks.workunit.client.1.smithi092.stdout:2/797: getdents d10/d1d 0 2024-09-17T01:52:20.812 INFO:tasks.workunit.client.1.smithi092.stdout:9/853: mknod d0/d7/def/c100 0 2024-09-17T01:52:20.812 INFO:tasks.workunit.client.1.smithi092.stdout:0/785: write d3/da/fb [1275077,31213] 0 2024-09-17T01:52:20.813 INFO:tasks.workunit.client.1.smithi092.stdout:3/885: rmdir d4/d20 39 2024-09-17T01:52:20.814 INFO:tasks.workunit.client.1.smithi092.stdout:7/871: truncate d3/db/d98/dce/f6c 3207115 0 2024-09-17T01:52:20.815 INFO:tasks.workunit.client.1.smithi092.stdout:2/798: write d10/d1d/d2c/f57 [3631497,66075] 0 2024-09-17T01:52:20.816 INFO:tasks.workunit.client.1.smithi092.stdout:5/689: creat d0/de/d19/d1a/d1e/d52/d9a/db0/fe3 x:0 0 0 2024-09-17T01:52:20.817 INFO:tasks.workunit.client.1.smithi092.stdout:6/807: mkdir d3/d25/df2 0 2024-09-17T01:52:20.819 INFO:tasks.workunit.client.1.smithi092.stdout:7/872: write d3/d6/d13/d21/d2e/f114 [439500,59913] 0 2024-09-17T01:52:20.827 INFO:tasks.workunit.client.1.smithi092.stdout:6/808: creat d3/d10/d1f/d21/d1e/ff3 x:0 0 0 2024-09-17T01:52:20.829 INFO:tasks.workunit.client.1.smithi092.stdout:2/799: creat d10/d8d/d8f/d93/f107 x:0 0 0 2024-09-17T01:52:20.831 INFO:tasks.workunit.client.1.smithi092.stdout:1/999: dread db/d1d/d23/d55/de5/fb6 [0,4194304] 0 2024-09-17T01:52:20.835 INFO:tasks.workunit.client.1.smithi092.stdout:9/854: dwrite d0/f59 [0,4194304] 0 2024-09-17T01:52:20.837 INFO:tasks.workunit.client.1.smithi092.stdout:3/886: dwrite d4/d20/fb0 [0,4194304] 0 2024-09-17T01:52:20.839 INFO:tasks.workunit.client.1.smithi092.stdout:6/809: read d3/d10/d1f/d21/d28/f54 [2266950,11364] 0 2024-09-17T01:52:20.845 INFO:tasks.workunit.client.1.smithi092.stdout:5/690: write d0/de/d19/f89 [1363124,29841] 0 2024-09-17T01:52:20.850 INFO:tasks.workunit.client.1.smithi092.stdout:9/855: mkdir d0/d7/d12/d86/d93/d101 0 2024-09-17T01:52:20.854 INFO:tasks.workunit.client.1.smithi092.stdout:0/786: dwrite d3/d2e/d3b/d8f/fc3 [0,4194304] 0 2024-09-17T01:52:20.856 INFO:tasks.workunit.client.1.smithi092.stdout:0/787: readlink d3/dc8/l5a 0 2024-09-17T01:52:20.857 INFO:tasks.workunit.client.1.smithi092.stdout:8/744: link d15/d25/d2b/d3d/d9f/lbb d15/d25/d27/d6e/d95/dda/lf6 0 2024-09-17T01:52:20.860 INFO:tasks.workunit.client.1.smithi092.stdout:3/887: unlink d4/d20/d3f/c72 0 2024-09-17T01:52:20.861 INFO:tasks.workunit.client.1.smithi092.stdout:7/873: dwrite d3/db/d98/dce/fe2 [0,4194304] 0 2024-09-17T01:52:20.862 INFO:tasks.workunit.client.1.smithi092.stdout:9/856: mknod d0/df/d5d/dfe/c102 0 2024-09-17T01:52:20.864 INFO:tasks.workunit.client.1.smithi092.stdout:2/800: dwrite d10/d1d/d2c/f3d [0,4194304] 0 2024-09-17T01:52:20.865 INFO:tasks.workunit.client.1.smithi092.stdout:0/788: dread - d3/d2e/d3b/d48/fc6 zero size 2024-09-17T01:52:20.868 INFO:tasks.workunit.client.1.smithi092.stdout:0/789: chown d3/d2e/d55/d63/f6d 8013498 1 2024-09-17T01:52:20.871 INFO:tasks.workunit.client.1.smithi092.stdout:5/691: rename d0/d50/da5/fb9 to d0/d50/fe4 0 2024-09-17T01:52:20.874 INFO:tasks.workunit.client.1.smithi092.stdout:2/801: rmdir d10/d5c 39 2024-09-17T01:52:20.878 INFO:tasks.workunit.client.1.smithi092.stdout:2/802: dread - d10/d1d/d96/d77/d9c/dae/fd3 zero size 2024-09-17T01:52:20.880 INFO:tasks.workunit.client.1.smithi092.stdout:3/888: rename d4/d13/d2e/d5f/f62 to d4/d2f/d44/d54/f11d 0 2024-09-17T01:52:20.881 INFO:tasks.workunit.client.1.smithi092.stdout:9/857: mknod d0/d7/d12/d34/d26/c103 0 2024-09-17T01:52:20.882 INFO:tasks.workunit.client.1.smithi092.stdout:5/692: dwrite d0/de/d19/d3c/d9e/fce [0,4194304] 0 2024-09-17T01:52:20.884 INFO:tasks.workunit.client.1.smithi092.stdout:8/745: link d15/d25/d27/d6e/d95/dda/d3b/d78/ff5 d15/d25/d27/df3/ff7 0 2024-09-17T01:52:20.888 INFO:tasks.workunit.client.1.smithi092.stdout:9/858: dread - d0/d7c/da9/fc2 zero size 2024-09-17T01:52:20.890 INFO:tasks.workunit.client.1.smithi092.stdout:6/810: dwrite d3/d10/d1f/d21/d28/f82 [0,4194304] 0 2024-09-17T01:52:20.891 INFO:tasks.workunit.client.1.smithi092.stdout:3/889: chown d4/d13/c67 379892 1 2024-09-17T01:52:20.892 INFO:tasks.workunit.client.1.smithi092.stdout:2/803: fsync d10/d4c/d80/d95/fa0 0 2024-09-17T01:52:20.893 INFO:tasks.workunit.client.1.smithi092.stdout:3/890: read - d4/d2f/f102 zero size 2024-09-17T01:52:20.895 INFO:tasks.workunit.client.1.smithi092.stdout:3/891: read - d4/d73/fee zero size 2024-09-17T01:52:20.897 INFO:tasks.workunit.client.1.smithi092.stdout:2/804: readlink d10/l2f 0 2024-09-17T01:52:20.897 INFO:tasks.workunit.client.1.smithi092.stdout:6/811: write d3/d10/d1f/d21/d28/f82 [497443,107127] 0 2024-09-17T01:52:20.901 INFO:tasks.workunit.client.1.smithi092.stdout:7/874: link d3/d6/d13/f70 d3/d6/d13/f127 0 2024-09-17T01:52:20.904 INFO:tasks.workunit.client.1.smithi092.stdout:0/790: dread d3/d2e/d3b/f82 [0,4194304] 0 2024-09-17T01:52:20.905 INFO:tasks.workunit.client.1.smithi092.stdout:8/746: rename d15/d25/d27/d6e/ce8 to d15/d25/d2b/d3d/d9f/d8e/cf8 0 2024-09-17T01:52:20.907 INFO:tasks.workunit.client.1.smithi092.stdout:3/892: dwrite d4/d2f/f9a [0,4194304] 0 2024-09-17T01:52:20.910 INFO:tasks.workunit.client.1.smithi092.stdout:6/812: mknod d3/d10/d8c/d49/d7e/cf4 0 2024-09-17T01:52:20.911 INFO:tasks.workunit.client.1.smithi092.stdout:9/859: dwrite d0/d7c/dbd/ddd/fe9 [0,4194304] 0 2024-09-17T01:52:20.914 INFO:tasks.workunit.client.1.smithi092.stdout:9/860: readlink d0/d7/d12/d34/d26/l46 0 2024-09-17T01:52:20.914 INFO:tasks.workunit.client.1.smithi092.stdout:7/875: read d3/d2b/ffd [237118,107066] 0 2024-09-17T01:52:20.916 INFO:tasks.workunit.client.1.smithi092.stdout:5/693: rename d0/de/d19/d1a/d1e/f36 to d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/de1/fe5 0 2024-09-17T01:52:20.921 INFO:tasks.workunit.client.1.smithi092.stdout:6/813: creat d3/d25/da8/dad/dae/ff5 x:0 0 0 2024-09-17T01:52:20.923 INFO:tasks.workunit.client.1.smithi092.stdout:9/861: rmdir d0/d7/d12/d98 39 2024-09-17T01:52:20.923 INFO:tasks.workunit.client.1.smithi092.stdout:7/876: creat d3/db/d98/dce/d6a/dc8/f128 x:0 0 0 2024-09-17T01:52:20.924 INFO:tasks.workunit.client.1.smithi092.stdout:6/814: read d3/d10/d1f/d21/d28/f2c [4100720,19940] 0 2024-09-17T01:52:20.928 INFO:tasks.workunit.client.1.smithi092.stdout:2/805: rename d10/d54/cad to d10/d1d/d96/de7/c108 0 2024-09-17T01:52:20.932 INFO:tasks.workunit.client.1.smithi092.stdout:2/806: read d10/d8d/f52 [193758,102921] 0 2024-09-17T01:52:20.932 INFO:tasks.workunit.client.1.smithi092.stdout:7/877: write d3/db/d98/dce/d6a/dc8/f126 [4940932,88620] 0 2024-09-17T01:52:20.934 INFO:tasks.workunit.client.1.smithi092.stdout:0/791: write d3/d2e/d3b/d8f/f51 [4716290,20754] 0 2024-09-17T01:52:20.936 INFO:tasks.workunit.client.1.smithi092.stdout:5/694: creat d0/d77/fe6 x:0 0 0 2024-09-17T01:52:20.941 INFO:tasks.workunit.client.1.smithi092.stdout:7/878: symlink d3/d2b/d84/l129 0 2024-09-17T01:52:20.941 INFO:tasks.workunit.client.1.smithi092.stdout:2/807: truncate d10/d4c/d80/d95/fe5 1102023 0 2024-09-17T01:52:20.944 INFO:tasks.workunit.client.1.smithi092.stdout:5/695: creat d0/de/d19/d1a/fe7 x:0 0 0 2024-09-17T01:52:20.948 INFO:tasks.workunit.client.1.smithi092.stdout:8/747: getdents d15/d25/d27/d6e/d95/dda/d3b 0 2024-09-17T01:52:20.949 INFO:tasks.workunit.client.1.smithi092.stdout:7/879: mkdir d3/db/d98/dce/d61/d12a 0 2024-09-17T01:52:20.953 INFO:tasks.workunit.client.1.smithi092.stdout:6/815: creat d3/d10/d8c/d43/d5e/d73/ff6 x:0 0 0 2024-09-17T01:52:20.957 INFO:tasks.workunit.client.1.smithi092.stdout:3/893: rename d4/d20/d39/d70/c118 to d4/d13/c11e 0 2024-09-17T01:52:20.960 INFO:tasks.workunit.client.1.smithi092.stdout:8/748: rmdir d15/d25/d27/d6e/d95/dda/d40/d42 39 2024-09-17T01:52:20.961 INFO:tasks.workunit.client.1.smithi092.stdout:9/862: truncate d0/d7/d12/d34/d26/fce 1930986 0 2024-09-17T01:52:20.961 INFO:tasks.workunit.client.1.smithi092.stdout:5/696: dread d0/d50/d70/fcd [0,4194304] 0 2024-09-17T01:52:20.961 INFO:tasks.workunit.client.1.smithi092.stdout:6/816: mknod d3/d10/d8c/d43/d6a/d3d/cf7 0 2024-09-17T01:52:20.964 INFO:tasks.workunit.client.1.smithi092.stdout:8/749: stat d15/d25/d2b/d3d/d9f/lbb 0 2024-09-17T01:52:20.965 INFO:tasks.workunit.client.1.smithi092.stdout:0/792: dwrite d3/dee/f53 [4194304,4194304] 0 2024-09-17T01:52:20.970 INFO:tasks.workunit.client.1.smithi092.stdout:5/697: symlink d0/d23/le8 0 2024-09-17T01:52:20.975 INFO:tasks.workunit.client.1.smithi092.stdout:6/817: read d3/d10/d8c/d43/d5e/f5f [351190,37924] 0 2024-09-17T01:52:20.978 INFO:tasks.workunit.client.1.smithi092.stdout:5/698: dread d0/d50/fe4 [0,4194304] 0 2024-09-17T01:52:20.978 INFO:tasks.workunit.client.1.smithi092.stdout:2/808: dwrite d10/d1d/d2c/d56/f60 [0,4194304] 0 2024-09-17T01:52:20.979 INFO:tasks.workunit.client.1.smithi092.stdout:7/880: dread d3/d6/d13/d21/d2e/d6e/f41 [0,4194304] 0 2024-09-17T01:52:20.980 INFO:tasks.workunit.client.1.smithi092.stdout:9/863: dread d0/d7/d12/d34/d26/d54/d6b/f92 [0,4194304] 0 2024-09-17T01:52:20.981 INFO:tasks.workunit.client.1.smithi092.stdout:6/818: fdatasync d3/d10/d8c/d43/d6a/d3d/d72/fbb 0 2024-09-17T01:52:20.983 INFO:tasks.workunit.client.1.smithi092.stdout:8/750: rename d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/fc4 to d15/d25/d27/d6e/d95/dda/d40/d42/d6b/ff9 0 2024-09-17T01:52:20.984 INFO:tasks.workunit.client.1.smithi092.stdout:5/699: stat d0/d50/d70/d78/d8f 0 2024-09-17T01:52:20.986 INFO:tasks.workunit.client.1.smithi092.stdout:3/894: dwrite d4/d13/d2e/d43/fcb [0,4194304] 0 2024-09-17T01:52:20.990 INFO:tasks.workunit.client.1.smithi092.stdout:8/751: write d15/d25/d27/d49/fad [258057,120079] 0 2024-09-17T01:52:20.994 INFO:tasks.workunit.client.1.smithi092.stdout:3/895: mknod d4/d73/dba/dbe/c11f 0 2024-09-17T01:52:20.994 INFO:tasks.workunit.client.1.smithi092.stdout:5/700: mkdir d0/de/d19/d1a/d1e/d52/d9a/de9 0 2024-09-17T01:52:20.996 INFO:tasks.workunit.client.1.smithi092.stdout:0/793: dread d3/dee/d7d/fd9 [0,4194304] 0 2024-09-17T01:52:20.997 INFO:tasks.workunit.client.1.smithi092.stdout:2/809: mknod d10/d5c/c109 0 2024-09-17T01:52:21.001 INFO:tasks.workunit.client.1.smithi092.stdout:2/810: read d10/d1d/d2c/d56/f60 [1369742,7206] 0 2024-09-17T01:52:21.001 INFO:tasks.workunit.client.1.smithi092.stdout:9/864: dwrite d0/d5/fc1 [4194304,4194304] 0 2024-09-17T01:52:21.006 INFO:tasks.workunit.client.1.smithi092.stdout:5/701: chown d0/d7e/f85 20 1 2024-09-17T01:52:21.006 INFO:tasks.workunit.client.1.smithi092.stdout:9/865: write d0/d7/d12/d34/fc5 [1005905,94314] 0 2024-09-17T01:52:21.009 INFO:tasks.workunit.client.1.smithi092.stdout:2/811: rmdir d10/d1d/d2c/d56 39 2024-09-17T01:52:21.015 INFO:tasks.workunit.client.1.smithi092.stdout:6/819: dwrite d3/d10/d1f/d21/da5/f92 [0,4194304] 0 2024-09-17T01:52:21.016 INFO:tasks.workunit.client.1.smithi092.stdout:8/752: write d15/d25/d27/d6e/d95/dda/f91 [21962,102910] 0 2024-09-17T01:52:21.017 INFO:tasks.workunit.client.1.smithi092.stdout:9/866: mknod d0/d5/d29/c104 0 2024-09-17T01:52:21.024 INFO:tasks.workunit.client.1.smithi092.stdout:7/881: dwrite d3/db/d26/f62 [0,4194304] 0 2024-09-17T01:52:21.024 INFO:tasks.workunit.client.1.smithi092.stdout:5/702: unlink d0/de/d19/d3c/f8a 0 2024-09-17T01:52:21.025 INFO:tasks.workunit.client.1.smithi092.stdout:0/794: creat d3/da/d15/fef x:0 0 0 2024-09-17T01:52:21.025 INFO:tasks.workunit.client.1.smithi092.stdout:3/896: link d4/d20/d39/d70/d95/lab d4/d20/d9f/l120 0 2024-09-17T01:52:21.027 INFO:tasks.workunit.client.1.smithi092.stdout:5/703: chown d0/d50 7139259 1 2024-09-17T01:52:21.028 INFO:tasks.workunit.client.1.smithi092.stdout:2/812: chown d10/d5c/l5e 1 1 2024-09-17T01:52:21.029 INFO:tasks.workunit.client.1.smithi092.stdout:7/882: read d3/db/f4a [609695,78586] 0 2024-09-17T01:52:21.033 INFO:tasks.workunit.client.1.smithi092.stdout:2/813: chown d10/d4c/d80/fe9 13 1 2024-09-17T01:52:21.034 INFO:tasks.workunit.client.1.smithi092.stdout:6/820: readlink d3/d10/d1f/d21/d28/d2b/l38 0 2024-09-17T01:52:21.037 INFO:tasks.workunit.client.1.smithi092.stdout:8/753: dwrite d15/f1e [0,4194304] 0 2024-09-17T01:52:21.039 INFO:tasks.workunit.client.1.smithi092.stdout:9/867: creat d0/d7/d12/d86/f105 x:0 0 0 2024-09-17T01:52:21.046 INFO:tasks.workunit.client.1.smithi092.stdout:6/821: creat d3/d10/d1f/d21/d1e/d55/ff8 x:0 0 0 2024-09-17T01:52:21.048 INFO:tasks.workunit.client.1.smithi092.stdout:9/868: creat d0/d7/dcc/f106 x:0 0 0 2024-09-17T01:52:21.048 INFO:tasks.workunit.client.1.smithi092.stdout:0/795: dwrite d3/dc8/fa1 [0,4194304] 0 2024-09-17T01:52:21.051 INFO:tasks.workunit.client.1.smithi092.stdout:8/754: mknod d15/d25/d27/d6e/d95/dda/d40/d42/d93/cfa 0 2024-09-17T01:52:21.052 INFO:tasks.workunit.client.1.smithi092.stdout:7/883: truncate d3/db/d26/d83/fd5 244524 0 2024-09-17T01:52:21.054 INFO:tasks.workunit.client.1.smithi092.stdout:2/814: link d10/d4c/d80/d95/fa0 d10/d1d/d2c/d5a/d7a/df5/f10a 0 2024-09-17T01:52:21.057 INFO:tasks.workunit.client.1.smithi092.stdout:7/884: chown d3/db/d26/d6f/la2 1366067 1 2024-09-17T01:52:21.058 INFO:tasks.workunit.client.1.smithi092.stdout:5/704: dwrite d0/de/d19/d1a/d1e/d74/f83 [0,4194304] 0 2024-09-17T01:52:21.058 INFO:tasks.workunit.client.1.smithi092.stdout:0/796: fsync d3/d2e/d55/f70 0 2024-09-17T01:52:21.060 INFO:tasks.workunit.client.1.smithi092.stdout:8/755: truncate d15/d25/d2b/d63/faa 788572 0 2024-09-17T01:52:21.061 INFO:tasks.workunit.client.1.smithi092.stdout:6/822: chown d3/d10/d1f/d21/da5/d18/f6b 15399 1 2024-09-17T01:52:21.068 INFO:tasks.workunit.client.1.smithi092.stdout:3/897: dwrite d4/d20/f26 [4194304,4194304] 0 2024-09-17T01:52:21.070 INFO:tasks.workunit.client.1.smithi092.stdout:8/756: truncate d15/d25/d2b/d3d/dc6/fec 639360 0 2024-09-17T01:52:21.140 INFO:tasks.workunit.client.1.smithi092.stdout:7/885: symlink d3/db/d98/dce/d6a/l12b 0 2024-09-17T01:52:21.142 INFO:tasks.workunit.client.1.smithi092.stdout:0/797: write d3/dc8/f6e [650162,119770] 0 2024-09-17T01:52:21.145 INFO:tasks.workunit.client.1.smithi092.stdout:0/798: read d3/dee/f53 [3236406,128049] 0 2024-09-17T01:52:21.146 INFO:tasks.workunit.client.1.smithi092.stdout:0/799: chown d3/da/d15/fef 41946631 1 2024-09-17T01:52:21.151 INFO:tasks.workunit.client.1.smithi092.stdout:6/823: rmdir d3/d10/d8c/d43/d6a/d3d 39 2024-09-17T01:52:21.154 INFO:tasks.workunit.client.1.smithi092.stdout:5/705: symlink d0/de/d19/d1a/d1e/d29/lea 0 2024-09-17T01:52:21.156 INFO:tasks.workunit.client.1.smithi092.stdout:3/898: creat d4/d20/d39/d70/d95/f121 x:0 0 0 2024-09-17T01:52:21.157 INFO:tasks.workunit.client.1.smithi092.stdout:3/899: dread - d4/d20/d3f/ff9 zero size 2024-09-17T01:52:21.159 INFO:tasks.workunit.client.1.smithi092.stdout:8/757: mkdir d15/d25/d27/d6e/d95/dfb 0 2024-09-17T01:52:21.163 INFO:tasks.workunit.client.1.smithi092.stdout:7/886: dread d3/d6/d13/f127 [0,4194304] 0 2024-09-17T01:52:21.173 INFO:tasks.workunit.client.1.smithi092.stdout:3/900: mknod d4/d16/dfa/c122 0 2024-09-17T01:52:21.180 INFO:tasks.workunit.client.1.smithi092.stdout:7/887: creat d3/db/d26/d83/da6/f12c x:0 0 0 2024-09-17T01:52:21.182 INFO:tasks.workunit.client.1.smithi092.stdout:6/824: fsync d3/d10/d1f/d21/d1e/d55/f5b 0 2024-09-17T01:52:21.185 INFO:tasks.workunit.client.1.smithi092.stdout:2/815: getdents d10/d8d 0 2024-09-17T01:52:21.186 INFO:tasks.workunit.client.1.smithi092.stdout:7/888: mknod d3/d6/dc2/dc5/c12d 0 2024-09-17T01:52:21.192 INFO:tasks.workunit.client.1.smithi092.stdout:3/901: link d4/d13/d2e/d5f/c9d d4/d20/d3f/dc0/c123 0 2024-09-17T01:52:21.196 INFO:tasks.workunit.client.1.smithi092.stdout:3/902: dread d4/d2f/fe3 [0,4194304] 0 2024-09-17T01:52:21.198 INFO:tasks.workunit.client.1.smithi092.stdout:3/903: write d4/d2f/f102 [25710,48067] 0 2024-09-17T01:52:21.201 INFO:tasks.workunit.client.1.smithi092.stdout:3/904: truncate d4/d13/d2e/d5f/f5c 842941 0 2024-09-17T01:52:21.230 INFO:tasks.workunit.client.1.smithi092.stdout:9/869: dwrite d0/d7/d12/d34/f3a [0,4194304] 0 2024-09-17T01:52:21.238 INFO:tasks.workunit.client.1.smithi092.stdout:9/870: link d0/d7/d12/d34/d26/l48 d0/d5/d3e/l107 0 2024-09-17T01:52:21.239 INFO:tasks.workunit.client.1.smithi092.stdout:9/871: fdatasync d0/d7/d12/d34/fc5 0 2024-09-17T01:52:21.246 INFO:tasks.workunit.client.1.smithi092.stdout:5/706: dwrite d0/de/d19/d1a/d1e/fa2 [0,4194304] 0 2024-09-17T01:52:21.257 INFO:tasks.workunit.client.1.smithi092.stdout:5/707: getdents d0/d50 0 2024-09-17T01:52:21.259 INFO:tasks.workunit.client.1.smithi092.stdout:5/708: stat d0/de/d19/l91 0 2024-09-17T01:52:21.261 INFO:tasks.workunit.client.1.smithi092.stdout:2/816: dwrite d10/fcc [0,4194304] 0 2024-09-17T01:52:21.263 INFO:tasks.workunit.client.1.smithi092.stdout:2/817: write d10/d8d/d8f/d93/f107 [626726,94341] 0 2024-09-17T01:52:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: Adjusting osd_memory_target on smithi092 to 2240M 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:52:21.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:20 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:52:21.266 INFO:tasks.workunit.client.1.smithi092.stdout:3/905: write d4/d20/d39/f5e [3110101,62305] 0 2024-09-17T01:52:21.266 INFO:tasks.workunit.client.1.smithi092.stdout:3/906: write d4/f30 [6637121,28992] 0 2024-09-17T01:52:21.267 INFO:tasks.workunit.client.1.smithi092.stdout:3/907: fsync d4/d20/f7c 0 2024-09-17T01:52:21.268 INFO:tasks.workunit.client.1.smithi092.stdout:3/908: write d4/d2f/f4f [3016087,94149] 0 2024-09-17T01:52:21.269 INFO:tasks.workunit.client.1.smithi092.stdout:2/818: rename d10/d4c/d80/df9 to d10/d8d/d9e/dfd/d10b 0 2024-09-17T01:52:21.273 INFO:tasks.workunit.client.1.smithi092.stdout:3/909: rmdir d4/d13/d2e/d74 39 2024-09-17T01:52:21.275 INFO:tasks.workunit.client.1.smithi092.stdout:2/819: symlink d10/l10c 0 2024-09-17T01:52:21.276 INFO:tasks.workunit.client.1.smithi092.stdout:8/758: rmdir d15/d25/d27/d6e/d95/dda/d40 39 2024-09-17T01:52:21.277 INFO:tasks.workunit.client.1.smithi092.stdout:3/910: fdatasync d4/d20/f81 0 2024-09-17T01:52:21.280 INFO:tasks.workunit.client.1.smithi092.stdout:0/800: unlink d3/d2e/f84 0 2024-09-17T01:52:21.283 INFO:tasks.workunit.client.1.smithi092.stdout:2/820: creat d10/d1d/d2c/d56/f10d x:0 0 0 2024-09-17T01:52:21.285 INFO:tasks.workunit.client.1.smithi092.stdout:8/759: mkdir d15/d25/d27/dfc 0 2024-09-17T01:52:21.287 INFO:tasks.workunit.client.1.smithi092.stdout:0/801: symlink d3/d2e/d55/d63/d81/d9c/lf0 0 2024-09-17T01:52:21.288 INFO:tasks.workunit.client.1.smithi092.stdout:0/802: chown d3/f77 24271 1 2024-09-17T01:52:21.290 INFO:tasks.workunit.client.1.smithi092.stdout:8/760: truncate d15/d25/d27/d6e/d76/d83/d98/fb3 207695 0 2024-09-17T01:52:21.292 INFO:tasks.workunit.client.1.smithi092.stdout:0/803: creat d3/d2e/d55/ff1 x:0 0 0 2024-09-17T01:52:21.293 INFO:tasks.workunit.client.1.smithi092.stdout:8/761: unlink d15/d25/d27/d6e/fd8 0 2024-09-17T01:52:21.297 INFO:tasks.workunit.client.1.smithi092.stdout:9/872: truncate d0/d7/d12/d34/d26/f6f 6820256 0 2024-09-17T01:52:21.299 INFO:tasks.workunit.client.1.smithi092.stdout:9/873: chown d0/d7/d12/d34/d26/feb 9 1 2024-09-17T01:52:21.299 INFO:tasks.workunit.client.1.smithi092.stdout:5/709: dread d0/de/d19/d1a/d1e/d3e/d4c/f5d [0,4194304] 0 2024-09-17T01:52:21.301 INFO:tasks.workunit.client.1.smithi092.stdout:8/762: creat d15/d25/d27/d6e/d95/dda/d40/d42/ffd x:0 0 0 2024-09-17T01:52:21.305 INFO:tasks.workunit.client.1.smithi092.stdout:5/710: mkdir d0/de/d19/d1a/d1e/d29/deb 0 2024-09-17T01:52:21.308 INFO:tasks.workunit.client.1.smithi092.stdout:5/711: mkdir d0/de/d19/d3c/d41/dec 0 2024-09-17T01:52:21.308 INFO:tasks.workunit.client.1.smithi092.stdout:3/911: write d4/d73/f7e [1332669,10304] 0 2024-09-17T01:52:21.310 INFO:tasks.workunit.client.1.smithi092.stdout:8/763: dwrite d15/d25/d27/d49/dd7/fb7 [4194304,4194304] 0 2024-09-17T01:52:21.312 INFO:tasks.workunit.client.1.smithi092.stdout:3/912: write d4/d16/d1b/ff6 [3579205,42400] 0 2024-09-17T01:52:21.315 INFO:tasks.workunit.client.1.smithi092.stdout:0/804: write d3/da/d1c/d3a/f66 [4855259,13793] 0 2024-09-17T01:52:21.318 INFO:tasks.workunit.client.1.smithi092.stdout:2/821: dwrite d10/d1d/d2c/d56/f78 [0,4194304] 0 2024-09-17T01:52:21.319 INFO:tasks.workunit.client.1.smithi092.stdout:5/712: creat d0/de/d19/d3c/d41/dec/fed x:0 0 0 2024-09-17T01:52:21.321 INFO:tasks.workunit.client.1.smithi092.stdout:3/913: symlink d4/d2f/d44/d54/dda/l124 0 2024-09-17T01:52:21.323 INFO:tasks.workunit.client.1.smithi092.stdout:8/764: rmdir d15/d25/d27/d87 39 2024-09-17T01:52:21.327 INFO:tasks.workunit.client.1.smithi092.stdout:0/805: dread d3/da/d1c/f43 [0,4194304] 0 2024-09-17T01:52:21.328 INFO:tasks.workunit.client.1.smithi092.stdout:3/914: symlink d4/d13/d2e/d74/l125 0 2024-09-17T01:52:21.329 INFO:tasks.workunit.client.1.smithi092.stdout:3/915: fdatasync d4/d73/f7e 0 2024-09-17T01:52:21.329 INFO:tasks.workunit.client.1.smithi092.stdout:9/874: dwrite d0/df/f67 [4194304,4194304] 0 2024-09-17T01:52:21.332 INFO:tasks.workunit.client.1.smithi092.stdout:5/713: rename d0/d7e/fb6 to d0/de/d19/d1a/d1e/d29/deb/fee 0 2024-09-17T01:52:21.334 INFO:tasks.workunit.client.1.smithi092.stdout:2/822: creat d10/d1d/d96/d77/f10e x:0 0 0 2024-09-17T01:52:21.335 INFO:tasks.workunit.client.1.smithi092.stdout:5/714: chown d0/de/d19/d1a/d1e/d29/c96 2118486 1 2024-09-17T01:52:21.336 INFO:tasks.workunit.client.1.smithi092.stdout:3/916: dread d4/d73/d8f/d92/fa0 [0,4194304] 0 2024-09-17T01:52:21.338 INFO:tasks.workunit.client.1.smithi092.stdout:3/917: read d4/d13/d2e/d43/fcb [326266,24828] 0 2024-09-17T01:52:21.338 INFO:tasks.workunit.client.1.smithi092.stdout:2/823: read d10/d8d/d9e/dfd/d10b/f87 [520030,46143] 0 2024-09-17T01:52:21.342 INFO:tasks.workunit.client.1.smithi092.stdout:5/715: creat d0/d7e/fef x:0 0 0 2024-09-17T01:52:21.345 INFO:tasks.workunit.client.1.smithi092.stdout:3/918: rmdir d4/d20/d39 39 2024-09-17T01:52:21.347 INFO:tasks.workunit.client.1.smithi092.stdout:2/824: dwrite d10/d1d/d96/d77/f47 [0,4194304] 0 2024-09-17T01:52:21.350 INFO:tasks.workunit.client.1.smithi092.stdout:5/716: mknod d0/d7e/cf0 0 2024-09-17T01:52:21.351 INFO:tasks.workunit.client.1.smithi092.stdout:8/765: getdents d15/d25/d27/d6e/d95/dda/d40/d42/d93 0 2024-09-17T01:52:21.357 INFO:tasks.workunit.client.1.smithi092.stdout:5/717: creat d0/d77/ff1 x:0 0 0 2024-09-17T01:52:21.358 INFO:tasks.workunit.client.1.smithi092.stdout:0/806: write d3/d58/d8e/fa3 [15712,30031] 0 2024-09-17T01:52:21.360 INFO:tasks.workunit.client.1.smithi092.stdout:8/766: dwrite d15/d25/d2b/d63/fe1 [0,4194304] 0 2024-09-17T01:52:21.362 INFO:tasks.workunit.client.1.smithi092.stdout:2/825: dread d10/d55/d84/fbb [0,4194304] 0 2024-09-17T01:52:21.363 INFO:tasks.workunit.client.1.smithi092.stdout:5/718: read d0/de/d19/d3c/d41/f43 [3437635,75340] 0 2024-09-17T01:52:21.366 INFO:tasks.workunit.client.1.smithi092.stdout:0/807: read d3/da/d1c/f45 [2205523,506] 0 2024-09-17T01:52:21.368 INFO:tasks.workunit.client.1.smithi092.stdout:2/826: write fd [212220,23100] 0 2024-09-17T01:52:21.371 INFO:tasks.workunit.client.1.smithi092.stdout:0/808: write d3/dee/d7d/fda [938224,105762] 0 2024-09-17T01:52:21.373 INFO:tasks.workunit.client.1.smithi092.stdout:9/875: dwrite d0/d7/d12/d34/d26/d54/fa0 [0,4194304] 0 2024-09-17T01:52:21.374 INFO:tasks.workunit.client.1.smithi092.stdout:3/919: dread d4/d16/f48 [0,4194304] 0 2024-09-17T01:52:21.376 INFO:tasks.workunit.client.1.smithi092.stdout:2/827: write d10/d3a/d97/fc8 [948568,19214] 0 2024-09-17T01:52:21.378 INFO:tasks.workunit.client.1.smithi092.stdout:8/767: dread d15/d25/d27/d49/dd7/fb7 [4194304,4194304] 0 2024-09-17T01:52:21.382 INFO:tasks.workunit.client.1.smithi092.stdout:5/719: dwrite d0/de/d19/d3c/fa0 [0,4194304] 0 2024-09-17T01:52:21.383 INFO:tasks.workunit.client.1.smithi092.stdout:3/920: dread d4/d20/d31/f10b [0,4194304] 0 2024-09-17T01:52:21.384 INFO:tasks.workunit.client.1.smithi092.stdout:9/876: unlink d0/d7/d12/c43 0 2024-09-17T01:52:21.386 INFO:tasks.workunit.client.1.smithi092.stdout:2/828: getdents d10/d4c/df4 0 2024-09-17T01:52:21.389 INFO:tasks.workunit.client.1.smithi092.stdout:3/921: mknod d4/d20/d31/d104/c126 0 2024-09-17T01:52:21.391 INFO:tasks.workunit.client.1.smithi092.stdout:9/877: mkdir d0/d7/d12/d98/dc6/d108 0 2024-09-17T01:52:21.395 INFO:tasks.workunit.client.1.smithi092.stdout:8/768: getdents d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1 0 2024-09-17T01:52:21.396 INFO:tasks.workunit.client.1.smithi092.stdout:9/878: dread - d0/d7/d12/d86/fbb zero size 2024-09-17T01:52:21.399 INFO:tasks.workunit.client.1.smithi092.stdout:5/720: dread d0/d7e/f85 [0,4194304] 0 2024-09-17T01:52:21.399 INFO:tasks.workunit.client.1.smithi092.stdout:0/809: dwrite d3/d2e/d55/d63/d81/d9c/fbd [0,4194304] 0 2024-09-17T01:52:21.402 INFO:tasks.workunit.client.1.smithi092.stdout:0/810: read - d3/dc8/fb4 zero size 2024-09-17T01:52:21.404 INFO:tasks.workunit.client.1.smithi092.stdout:3/922: getdents d4/d20/d31/d104 0 2024-09-17T01:52:21.407 INFO:tasks.workunit.client.1.smithi092.stdout:9/879: getdents d0/d7/de5 0 2024-09-17T01:52:21.407 INFO:tasks.workunit.client.1.smithi092.stdout:2/829: write d10/d1d/d2c/d5a/d7a/df5/f10a [3430700,26039] 0 2024-09-17T01:52:21.409 INFO:tasks.workunit.client.1.smithi092.stdout:0/811: creat d3/d2e/d3b/d72/ff2 x:0 0 0 2024-09-17T01:52:21.412 INFO:tasks.workunit.client.1.smithi092.stdout:3/923: chown d4/d20/d39/d70 4 1 2024-09-17T01:52:21.413 INFO:tasks.workunit.client.1.smithi092.stdout:0/812: fdatasync d3/dee/d7d/f8b 0 2024-09-17T01:52:21.414 INFO:tasks.workunit.client.1.smithi092.stdout:8/769: getdents d15/d25/d27/d6e/d76/d83/d98 0 2024-09-17T01:52:21.415 INFO:tasks.workunit.client.1.smithi092.stdout:2/830: mkdir d10/d10f 0 2024-09-17T01:52:21.416 INFO:tasks.workunit.client.1.smithi092.stdout:3/924: mknod d4/d20/d31/d104/c127 0 2024-09-17T01:52:21.417 INFO:tasks.workunit.client.1.smithi092.stdout:5/721: dread d0/de/d19/d1a/d1e/f18 [0,4194304] 0 2024-09-17T01:52:21.418 INFO:tasks.workunit.client.1.smithi092.stdout:0/813: symlink d3/dee/lf3 0 2024-09-17T01:52:21.426 INFO:tasks.workunit.client.1.smithi092.stdout:2/831: rename d10/d1d/d2c/d56/f10d to d10/db9/f110 0 2024-09-17T01:52:21.427 INFO:tasks.workunit.client.1.smithi092.stdout:8/770: getdents d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/da0 0 2024-09-17T01:52:21.431 INFO:tasks.workunit.client.1.smithi092.stdout:3/925: dread d4/d2f/d44/d54/f11d [0,4194304] 0 2024-09-17T01:52:21.435 INFO:tasks.workunit.client.1.smithi092.stdout:8/771: dwrite d15/d25/d2b/d3d/d9f/d8e/fdd [0,4194304] 0 2024-09-17T01:52:21.436 INFO:tasks.workunit.client.1.smithi092.stdout:9/880: dread d0/d7/d12/d34/d26/d54/d6b/f78 [0,4194304] 0 2024-09-17T01:52:21.449 INFO:tasks.workunit.client.1.smithi092.stdout:2/832: creat d10/d4c/d80/d95/dc6/f111 x:0 0 0 2024-09-17T01:52:21.452 INFO:tasks.workunit.client.1.smithi092.stdout:8/772: write d15/d6f/d8b/f99 [313430,40566] 0 2024-09-17T01:52:21.455 INFO:tasks.workunit.client.1.smithi092.stdout:8/773: chown d15/d25/d27/d6e/d95 19635917 1 2024-09-17T01:52:21.455 INFO:tasks.workunit.client.1.smithi092.stdout:0/814: link d3/d2e/d3b/la0 d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/lf4 0 2024-09-17T01:52:21.458 INFO:tasks.workunit.client.1.smithi092.stdout:8/774: write f7 [934335,44186] 0 2024-09-17T01:52:21.459 INFO:tasks.workunit.client.1.smithi092.stdout:5/722: dwrite d0/fa9 [0,4194304] 0 2024-09-17T01:52:21.459 INFO:tasks.workunit.client.1.smithi092.stdout:3/926: dread d4/f18 [0,4194304] 0 2024-09-17T01:52:21.463 INFO:tasks.workunit.client.1.smithi092.stdout:0/815: symlink d3/d2e/d55/d63/lf5 0 2024-09-17T01:52:21.465 INFO:tasks.workunit.client.1.smithi092.stdout:5/723: fdatasync d0/d50/d70/d78/d8f/fa4 0 2024-09-17T01:52:21.467 INFO:tasks.workunit.client.1.smithi092.stdout:3/927: creat d4/d2f/d44/d54/dda/f128 x:0 0 0 2024-09-17T01:52:21.470 INFO:tasks.workunit.client.1.smithi092.stdout:0/816: creat d3/d2e/d3b/d72/ff6 x:0 0 0 2024-09-17T01:52:21.471 INFO:tasks.workunit.client.1.smithi092.stdout:0/817: fsync d3/d2e/d3b/d8f/fc3 0 2024-09-17T01:52:21.473 INFO:tasks.workunit.client.1.smithi092.stdout:2/833: link d10/d55/d84/fbb d10/d4c/d80/f112 0 2024-09-17T01:52:21.474 INFO:tasks.workunit.client.1.smithi092.stdout:2/834: stat d10/db9 0 2024-09-17T01:52:21.477 INFO:tasks.workunit.client.1.smithi092.stdout:0/818: rmdir d3/dc8/dd2 39 2024-09-17T01:52:21.479 INFO:tasks.workunit.client.1.smithi092.stdout:2/835: mknod d10/d8d/d8f/d93/c113 0 2024-09-17T01:52:21.480 INFO:tasks.workunit.client.1.smithi092.stdout:0/819: truncate d3/d2e/d55/d63/dc1/fd6 1096932 0 2024-09-17T01:52:21.483 INFO:tasks.workunit.client.1.smithi092.stdout:0/820: truncate d3/f17 8506592 0 2024-09-17T01:52:21.484 INFO:tasks.workunit.client.1.smithi092.stdout:2/836: symlink d10/d4c/d80/d95/dc6/dc9/l114 0 2024-09-17T01:52:21.488 INFO:tasks.workunit.client.1.smithi092.stdout:5/724: dread d0/de/d19/f69 [0,4194304] 0 2024-09-17T01:52:21.488 INFO:tasks.workunit.client.1.smithi092.stdout:2/837: mkdir d10/d4c/df4/d115 0 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: Adjusting osd_memory_target on smithi092 to 2240M 2024-09-17T01:52:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:21.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:52:21.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:52:21.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:52:21.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:20 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:52:21.490 INFO:tasks.workunit.client.1.smithi092.stdout:2/838: read d10/d4c/d80/d95/dc6/fca [2214775,14451] 0 2024-09-17T01:52:21.490 INFO:tasks.workunit.client.1.smithi092.stdout:5/725: mknod d0/de/d19/cf2 0 2024-09-17T01:52:21.493 INFO:tasks.workunit.client.1.smithi092.stdout:9/881: truncate d0/d7/d12/d34/d26/d54/f24 1979121 0 2024-09-17T01:52:21.493 INFO:tasks.workunit.client.1.smithi092.stdout:9/882: read - d0/df/fa2 zero size 2024-09-17T01:52:21.496 INFO:tasks.workunit.client.1.smithi092.stdout:2/839: rename d10/d3a/d97/da8 to d10/d4c/df4/d116 0 2024-09-17T01:52:21.499 INFO:tasks.workunit.client.1.smithi092.stdout:2/840: unlink d10/fcc 0 2024-09-17T01:52:21.502 INFO:tasks.workunit.client.1.smithi092.stdout:9/883: rename d0/d5/d29/ded to d0/df/d5d/d109 0 2024-09-17T01:52:21.504 INFO:tasks.workunit.client.1.smithi092.stdout:9/884: dread - d0/d7/d12/d34/d26/d54/f8b zero size 2024-09-17T01:52:21.514 INFO:tasks.workunit.client.1.smithi092.stdout:8/775: dwrite d15/d25/d2b/d63/fdb [0,4194304] 0 2024-09-17T01:52:21.514 INFO:tasks.workunit.client.1.smithi092.stdout:5/726: dread d0/de/d19/d1a/f22 [0,4194304] 0 2024-09-17T01:52:21.516 INFO:tasks.workunit.client.1.smithi092.stdout:9/885: chown d0/d7/d12/d34/d26/d54/f24 273522 1 2024-09-17T01:52:21.520 INFO:tasks.workunit.client.1.smithi092.stdout:8/776: fdatasync d15/d25/d2b/d3d/d9f/f5c 0 2024-09-17T01:52:21.522 INFO:tasks.workunit.client.1.smithi092.stdout:0/821: dwrite d3/f77 [4194304,4194304] 0 2024-09-17T01:52:21.522 INFO:tasks.workunit.client.1.smithi092.stdout:5/727: mkdir d0/d50/d70/df3 0 2024-09-17T01:52:21.524 INFO:tasks.workunit.client.1.smithi092.stdout:3/928: dwrite d4/d13/d2e/f75 [0,4194304] 0 2024-09-17T01:52:21.529 INFO:tasks.workunit.client.1.smithi092.stdout:9/886: creat d0/d5/d29/f10a x:0 0 0 2024-09-17T01:52:21.531 INFO:tasks.workunit.client.1.smithi092.stdout:2/841: dread d10/d55/dda/fa1 [0,4194304] 0 2024-09-17T01:52:21.531 INFO:tasks.workunit.client.1.smithi092.stdout:3/929: rmdir d4/d16 39 2024-09-17T01:52:21.534 INFO:tasks.workunit.client.1.smithi092.stdout:0/822: creat d3/d2e/d55/dcf/ff7 x:0 0 0 2024-09-17T01:52:21.538 INFO:tasks.workunit.client.1.smithi092.stdout:9/887: unlink d0/d7/d12/d34/d26/d54/f9f 0 2024-09-17T01:52:21.539 INFO:tasks.workunit.client.1.smithi092.stdout:9/888: stat d0/d7c/da9/fc2 0 2024-09-17T01:52:21.540 INFO:tasks.workunit.client.1.smithi092.stdout:0/823: mkdir d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/df8 0 2024-09-17T01:52:21.541 INFO:tasks.workunit.client.1.smithi092.stdout:0/824: fsync d3/da/d1c/fc5 0 2024-09-17T01:52:21.541 INFO:tasks.workunit.client.1.smithi092.stdout:9/889: mknod d0/d7/def/c10b 0 2024-09-17T01:52:21.542 INFO:tasks.workunit.client.1.smithi092.stdout:5/728: getdents d0/de/d19/d1a/d1e/d74/dc8 0 2024-09-17T01:52:21.545 INFO:tasks.workunit.client.1.smithi092.stdout:0/825: symlink d3/d2e/d55/d63/d81/d9c/lf9 0 2024-09-17T01:52:21.546 INFO:tasks.workunit.client.1.smithi092.stdout:5/729: mkdir d0/d50/d70/df4 0 2024-09-17T01:52:21.547 INFO:tasks.workunit.client.1.smithi092.stdout:5/730: readlink d0/de/d19/d1a/d1e/l7a 0 2024-09-17T01:52:21.548 INFO:tasks.workunit.client.1.smithi092.stdout:9/890: truncate d0/df/f66 2224600 0 2024-09-17T01:52:21.550 INFO:tasks.workunit.client.1.smithi092.stdout:5/731: mknod d0/de/d19/d1a/cf5 0 2024-09-17T01:52:21.551 INFO:tasks.workunit.client.1.smithi092.stdout:0/826: mkdir d3/dc8/dfa 0 2024-09-17T01:52:21.551 INFO:tasks.workunit.client.1.smithi092.stdout:8/777: write d15/d25/d27/d6e/d95/dda/d40/d42/d6b/fb4 [753812,98995] 0 2024-09-17T01:52:21.552 INFO:tasks.workunit.client.1.smithi092.stdout:9/891: mknod d0/d7/d12/d98/c10c 0 2024-09-17T01:52:21.554 INFO:tasks.workunit.client.1.smithi092.stdout:5/732: creat d0/de/d19/d3c/d41/ff6 x:0 0 0 2024-09-17T01:52:21.556 INFO:tasks.workunit.client.1.smithi092.stdout:5/733: chown d0/d50/d70/c95 24 1 2024-09-17T01:52:21.556 INFO:tasks.workunit.client.1.smithi092.stdout:2/842: dread d10/d1d/d96/d77/d9c/dae/fc5 [0,4194304] 0 2024-09-17T01:52:21.558 INFO:tasks.workunit.client.1.smithi092.stdout:0/827: rename d3/da/d1c to d3/dee/d7d/dfb 0 2024-09-17T01:52:21.560 INFO:tasks.workunit.client.1.smithi092.stdout:5/734: fdatasync d0/de/d19/d1a/d1e/d29/f60 0 2024-09-17T01:52:21.560 INFO:tasks.workunit.client.1.smithi092.stdout:9/892: creat d0/d7c/f10d x:0 0 0 2024-09-17T01:52:21.562 INFO:tasks.workunit.client.1.smithi092.stdout:5/735: rename d0 to d0/d77/df7 22 2024-09-17T01:52:21.562 INFO:tasks.workunit.client.1.smithi092.stdout:3/930: dread d4/d20/d3f/f9c [0,4194304] 0 2024-09-17T01:52:21.562 INFO:tasks.workunit.client.1.smithi092.stdout:9/893: chown d0/d7c/f8e 0 1 2024-09-17T01:52:21.562 INFO:tasks.workunit.client.1.smithi092.stdout:2/843: truncate d10/d1d/d2c/fcf 913902 0 2024-09-17T01:52:21.563 INFO:tasks.workunit.client.1.smithi092.stdout:0/828: symlink d3/d2e/d3b/d72/d7a/lfc 0 2024-09-17T01:52:21.565 INFO:tasks.workunit.client.1.smithi092.stdout:8/778: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/d93/f97 [4194304,4194304] 0 2024-09-17T01:52:21.565 INFO:tasks.workunit.client.1.smithi092.stdout:2/844: dread - d10/d55/d84/fcd zero size 2024-09-17T01:52:21.566 INFO:tasks.workunit.client.1.smithi092.stdout:5/736: fsync d0/de/d19/d1a/d1e/f18 0 2024-09-17T01:52:21.573 INFO:tasks.workunit.client.1.smithi092.stdout:3/931: dread d4/d13/d2e/d43/fa2 [0,4194304] 0 2024-09-17T01:52:21.573 INFO:tasks.workunit.client.1.smithi092.stdout:9/894: mknod d0/d7/d12/d34/d26/d54/d6b/c10e 0 2024-09-17T01:52:21.573 INFO:tasks.workunit.client.1.smithi092.stdout:2/845: creat d10/d4c/f117 x:0 0 0 2024-09-17T01:52:21.575 INFO:tasks.workunit.client.1.smithi092.stdout:2/846: write d10/d1d/d2c/fb5 [892192,81397] 0 2024-09-17T01:52:21.577 INFO:tasks.workunit.client.1.smithi092.stdout:2/847: chown d10/d8d/c79 38 1 2024-09-17T01:52:21.578 INFO:tasks.workunit.client.1.smithi092.stdout:8/779: link d15/d25/d2b/d63/lb6 d15/d25/d27/d6e/d76/d83/lfe 0 2024-09-17T01:52:21.580 INFO:tasks.workunit.client.1.smithi092.stdout:2/848: readlink d10/d1d/d2c/l51 0 2024-09-17T01:52:21.580 INFO:tasks.workunit.client.1.smithi092.stdout:9/895: dwrite d0/d7/d12/d86/d93/d96/f8d [0,4194304] 0 2024-09-17T01:52:21.582 INFO:tasks.workunit.client.1.smithi092.stdout:0/829: link d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/dad/lf4 d3/d58/lfd 0 2024-09-17T01:52:21.589 INFO:tasks.workunit.client.1.smithi092.stdout:0/830: creat d3/d2e/d55/d63/d81/d9c/ffe x:0 0 0 2024-09-17T01:52:21.590 INFO:tasks.workunit.client.1.smithi092.stdout:2/849: dwrite d10/d1d/d2c/d5a/d7a/fed [0,4194304] 0 2024-09-17T01:52:21.593 INFO:tasks.workunit.client.1.smithi092.stdout:8/780: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/d6b/ff9 [0,4194304] 0 2024-09-17T01:52:21.593 INFO:tasks.workunit.client.1.smithi092.stdout:9/896: dwrite d0/d7c/f8e [0,4194304] 0 2024-09-17T01:52:21.607 INFO:tasks.workunit.client.1.smithi092.stdout:2/850: rename d10/d1d/d2c/d5a/d7a/f7b to d10/d4c/d80/d95/dc6/dc9/f118 0 2024-09-17T01:52:21.608 INFO:tasks.workunit.client.1.smithi092.stdout:2/851: readlink d10/d1d/d2c/d5a/lc7 0 2024-09-17T01:52:21.609 INFO:tasks.workunit.client.1.smithi092.stdout:8/781: symlink d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/lff 0 2024-09-17T01:52:21.612 INFO:tasks.workunit.client.1.smithi092.stdout:2/852: mknod d10/d1d/d2c/d56/c119 0 2024-09-17T01:52:21.615 INFO:tasks.workunit.client.1.smithi092.stdout:8/782: rename d15/d25/d27/d6e/d95/dda/lb2 to d15/d25/d2b/d3d/d9f/d8e/l100 0 2024-09-17T01:52:21.616 INFO:tasks.workunit.client.1.smithi092.stdout:8/783: chown d15/d25/d2b/d63 12045804 1 2024-09-17T01:52:21.618 INFO:tasks.workunit.client.1.smithi092.stdout:8/784: read d15/d25/d2b/d63/faa [441836,62980] 0 2024-09-17T01:52:21.618 INFO:tasks.workunit.client.1.smithi092.stdout:3/932: write d4/d13/f14 [986845,62126] 0 2024-09-17T01:52:21.620 INFO:tasks.workunit.client.1.smithi092.stdout:8/785: write d15/d25/d2b/d3d/d9f/d8e/fdd [5111921,78743] 0 2024-09-17T01:52:21.621 INFO:tasks.workunit.client.1.smithi092.stdout:5/737: truncate d0/de/d19/d3c/d41/f6e 32825 0 2024-09-17T01:52:21.622 INFO:tasks.workunit.client.1.smithi092.stdout:5/738: write d0/de/d19/f89 [2198966,33297] 0 2024-09-17T01:52:21.625 INFO:tasks.workunit.client.1.smithi092.stdout:2/853: link d10/d1d/d96/d77/c68 d10/d8d/d9e/dfd/c11a 0 2024-09-17T01:52:21.629 INFO:tasks.workunit.client.1.smithi092.stdout:3/933: mknod d4/d13/c129 0 2024-09-17T01:52:21.629 INFO:tasks.workunit.client.1.smithi092.stdout:0/831: write d3/d2e/d3b/d8f/f7c [1281839,94603] 0 2024-09-17T01:52:21.631 INFO:tasks.workunit.client.1.smithi092.stdout:5/739: rename d0/de/d19/d1a/d1e/d29/deb to d0/de/dd4/df8 0 2024-09-17T01:52:21.631 INFO:tasks.workunit.client.1.smithi092.stdout:8/786: dread d15/d25/d2b/d63/fbf [0,4194304] 0 2024-09-17T01:52:21.632 INFO:tasks.workunit.client.1.smithi092.stdout:3/934: truncate d4/d20/d39/d70/d95/f121 1041310 0 2024-09-17T01:52:21.636 INFO:tasks.workunit.client.1.smithi092.stdout:0/832: chown d3/d2e/d3b/d8f/d5f/db1/dd8/cae 0 1 2024-09-17T01:52:21.639 INFO:tasks.workunit.client.1.smithi092.stdout:8/787: fdatasync d15/d25/d27/d49/dd7/fb7 0 2024-09-17T01:52:21.640 INFO:tasks.workunit.client.1.smithi092.stdout:3/935: read d4/d13/f63 [1760778,96745] 0 2024-09-17T01:52:21.641 INFO:tasks.workunit.client.1.smithi092.stdout:9/897: dwrite d0/d7/d12/d34/d26/d54/f24 [0,4194304] 0 2024-09-17T01:52:21.644 INFO:tasks.workunit.client.1.smithi092.stdout:2/854: truncate d10/d55/d84/fbb 417871 0 2024-09-17T01:52:21.644 INFO:tasks.workunit.client.1.smithi092.stdout:8/788: readlink d15/d25/d27/d6e/d95/dda/d40/d42/d6b/dd9/le7 0 2024-09-17T01:52:21.644 INFO:tasks.workunit.client.1.smithi092.stdout:9/898: dread - d0/d7/d12/d34/d26/fe4 zero size 2024-09-17T01:52:21.645 INFO:tasks.workunit.client.1.smithi092.stdout:0/833: fdatasync d3/d2e/f5c 0 2024-09-17T01:52:21.647 INFO:tasks.workunit.client.1.smithi092.stdout:0/834: chown d3/da/fd3 57 1 2024-09-17T01:52:21.647 INFO:tasks.workunit.client.1.smithi092.stdout:0/835: fdatasync d3/f4 0 2024-09-17T01:52:21.648 INFO:tasks.workunit.client.1.smithi092.stdout:3/936: stat d4/d2f/d44/d3c/lb9 0 2024-09-17T01:52:21.654 INFO:tasks.workunit.client.1.smithi092.stdout:2/855: dread d10/f14 [0,4194304] 0 2024-09-17T01:52:21.655 INFO:tasks.workunit.client.1.smithi092.stdout:5/740: dread d0/de/d19/d1a/d1e/f71 [0,4194304] 0 2024-09-17T01:52:21.657 INFO:tasks.workunit.client.1.smithi092.stdout:3/937: fsync d4/d16/d1b/f55 0 2024-09-17T01:52:21.659 INFO:tasks.workunit.client.1.smithi092.stdout:8/789: dwrite f1 [0,4194304] 0 2024-09-17T01:52:21.662 INFO:tasks.workunit.client.1.smithi092.stdout:0/836: dread d3/d2e/d3b/f94 [0,4194304] 0 2024-09-17T01:52:21.663 INFO:tasks.workunit.client.1.smithi092.stdout:3/938: readlink d4/d13/d2e/d5f/d89/lc2 0 2024-09-17T01:52:21.666 INFO:tasks.workunit.client.1.smithi092.stdout:5/741: dread d0/d50/d70/d78/fda [0,4194304] 0 2024-09-17T01:52:21.669 INFO:tasks.workunit.client.1.smithi092.stdout:0/837: symlink d3/d2e/d55/d63/lff 0 2024-09-17T01:52:21.672 INFO:tasks.workunit.client.1.smithi092.stdout:9/899: dwrite d0/d7/d12/f8f [0,4194304] 0 2024-09-17T01:52:21.672 INFO:tasks.workunit.client.1.smithi092.stdout:5/742: mknod d0/de/d19/d1a/d1e/cf9 0 2024-09-17T01:52:21.674 INFO:tasks.workunit.client.1.smithi092.stdout:8/790: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/d93/f97 [0,4194304] 0 2024-09-17T01:52:21.675 INFO:tasks.workunit.client.1.smithi092.stdout:5/743: chown d0/fa9 2 1 2024-09-17T01:52:21.677 INFO:tasks.workunit.client.1.smithi092.stdout:3/939: dwrite d4/d2f/d44/d3c/f90 [0,4194304] 0 2024-09-17T01:52:21.678 INFO:tasks.workunit.client.1.smithi092.stdout:5/744: stat d0/de/d19/d1a/d1e/d52/dbd 0 2024-09-17T01:52:21.682 INFO:tasks.workunit.client.1.smithi092.stdout:0/838: symlink d3/d2e/d55/d63/d81/l100 0 2024-09-17T01:52:21.684 INFO:tasks.workunit.client.1.smithi092.stdout:0/839: truncate d3/d2e/d55/d63/fc0 4731537 0 2024-09-17T01:52:21.684 INFO:tasks.workunit.client.1.smithi092.stdout:8/791: symlink d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/l101 0 2024-09-17T01:52:21.688 INFO:tasks.workunit.client.1.smithi092.stdout:0/840: fsync d3/d2e/d3b/d8f/f52 0 2024-09-17T01:52:21.689 INFO:tasks.workunit.client.1.smithi092.stdout:3/940: mknod d4/d13/d2e/c12a 0 2024-09-17T01:52:21.692 INFO:tasks.workunit.client.1.smithi092.stdout:3/941: write d4/d16/d1b/daf/f106 [1035199,110831] 0 2024-09-17T01:52:21.693 INFO:tasks.workunit.client.1.smithi092.stdout:0/841: mknod d3/d2e/d55/d63/d81/d9c/c101 0 2024-09-17T01:52:21.694 INFO:tasks.workunit.client.1.smithi092.stdout:8/792: dwrite d15/d25/d2b/d3d/dc6/fec [0,4194304] 0 2024-09-17T01:52:21.698 INFO:tasks.workunit.client.1.smithi092.stdout:3/942: mknod d4/c12b 0 2024-09-17T01:52:21.699 INFO:tasks.workunit.client.1.smithi092.stdout:8/793: creat d15/d25/d2b/d3d/dc6/f102 x:0 0 0 2024-09-17T01:52:21.701 INFO:tasks.workunit.client.1.smithi092.stdout:3/943: mknod d4/d20/d39/d70/d95/c12c 0 2024-09-17T01:52:21.702 INFO:tasks.workunit.client.1.smithi092.stdout:3/944: chown d4/d2f/d44/d3c/cd7 100753 1 2024-09-17T01:52:21.706 INFO:tasks.workunit.client.1.smithi092.stdout:3/945: rmdir d4/d20/d39/d70/d95/dad 0 2024-09-17T01:52:21.706 INFO:tasks.workunit.client.1.smithi092.stdout:3/946: chown d4/d13/c129 71933773 1 2024-09-17T01:52:21.709 INFO:tasks.workunit.client.1.smithi092.stdout:3/947: symlink d4/d20/d39/d70/d95/da3/l12d 0 2024-09-17T01:52:21.710 INFO:tasks.workunit.client.1.smithi092.stdout:5/745: write d0/d50/d70/fcd [1124296,130728] 0 2024-09-17T01:52:21.711 INFO:tasks.workunit.client.1.smithi092.stdout:5/746: dread - d0/de/d19/d3c/d41/f73 zero size 2024-09-17T01:52:21.713 INFO:tasks.workunit.client.1.smithi092.stdout:3/948: creat d4/d13/d2e/d11c/f12e x:0 0 0 2024-09-17T01:52:21.714 INFO:tasks.workunit.client.1.smithi092.stdout:3/949: write d4/d20/d39/d70/d95/f121 [972343,26128] 0 2024-09-17T01:52:21.715 INFO:tasks.workunit.client.1.smithi092.stdout:5/747: creat d0/de/d19/d1a/d1e/d74/ffa x:0 0 0 2024-09-17T01:52:21.717 INFO:tasks.workunit.client.1.smithi092.stdout:3/950: mknod d4/d13/d2e/d74/c12f 0 2024-09-17T01:52:21.718 INFO:tasks.workunit.client.1.smithi092.stdout:5/748: fsync d0/de/d19/d1a/d1e/d52/d9a/fc2 0 2024-09-17T01:52:21.722 INFO:tasks.workunit.client.1.smithi092.stdout:5/749: write d0/fbc [777805,109989] 0 2024-09-17T01:52:21.728 INFO:tasks.workunit.client.1.smithi092.stdout:0/842: dread d3/d2e/d3b/f82 [0,4194304] 0 2024-09-17T01:52:21.728 INFO:tasks.workunit.client.1.smithi092.stdout:8/794: dread d15/d25/d27/f3e [0,4194304] 0 2024-09-17T01:52:21.728 INFO:tasks.workunit.client.1.smithi092.stdout:0/843: chown d3/dee/d7d/dfb/fc5 26 1 2024-09-17T01:52:21.731 INFO:tasks.workunit.client.1.smithi092.stdout:5/750: dwrite d0/d77/fe6 [0,4194304] 0 2024-09-17T01:52:21.733 INFO:tasks.workunit.client.1.smithi092.stdout:8/795: rename f14 to d15/d6f/d8b/f103 0 2024-09-17T01:52:21.733 INFO:tasks.workunit.client.1.smithi092.stdout:3/951: write d4/d20/f86 [1103842,87562] 0 2024-09-17T01:52:21.734 INFO:tasks.workunit.client.1.smithi092.stdout:0/844: symlink d3/da/d15/dab/l102 0 2024-09-17T01:52:21.736 INFO:tasks.workunit.client.1.smithi092.stdout:5/751: symlink d0/d50/da5/lfb 0 2024-09-17T01:52:21.739 INFO:tasks.workunit.client.1.smithi092.stdout:8/796: creat d15/d25/d2b/d3d/d9f/f104 x:0 0 0 2024-09-17T01:52:21.739 INFO:tasks.workunit.client.1.smithi092.stdout:0/845: symlink d3/d58/l103 0 2024-09-17T01:52:21.741 INFO:tasks.workunit.client.1.smithi092.stdout:5/752: unlink d0/de/d19/d1a/d1e/d29/fdd 0 2024-09-17T01:52:21.744 INFO:tasks.workunit.client.1.smithi092.stdout:5/753: mknod d0/d50/d70/cfc 0 2024-09-17T01:52:21.745 INFO:tasks.workunit.client.1.smithi092.stdout:5/754: chown d0/d50/d70/c95 945422113 1 2024-09-17T01:52:21.747 INFO:tasks.workunit.client.1.smithi092.stdout:0/846: dwrite d3/dee/d7d/fda [0,4194304] 0 2024-09-17T01:52:21.750 INFO:tasks.workunit.client.1.smithi092.stdout:5/755: mknod d0/de/d19/d3c/d9e/cfd 0 2024-09-17T01:52:21.754 INFO:tasks.workunit.client.1.smithi092.stdout:5/756: readlink d0/d7e/l94 0 2024-09-17T01:52:21.755 INFO:tasks.workunit.client.1.smithi092.stdout:8/797: dread d15/d25/d27/d6e/d95/dda/d40/d42/f4b [0,4194304] 0 2024-09-17T01:52:21.758 INFO:tasks.workunit.client.1.smithi092.stdout:5/757: unlink d0/c2b 0 2024-09-17T01:52:21.758 INFO:tasks.workunit.client.1.smithi092.stdout:3/952: dread d4/d2f/f103 [0,4194304] 0 2024-09-17T01:52:21.759 INFO:tasks.workunit.client.1.smithi092.stdout:8/798: creat d15/d25/d27/d6e/d95/dda/d3b/d78/f105 x:0 0 0 2024-09-17T01:52:21.760 INFO:tasks.workunit.client.1.smithi092.stdout:5/758: fdatasync d0/de/d19/d3c/d41/d8d/fc9 0 2024-09-17T01:52:21.760 INFO:tasks.workunit.client.1.smithi092.stdout:3/953: write d4/d20/d39/fac [2575575,53097] 0 2024-09-17T01:52:21.761 INFO:tasks.workunit.client.1.smithi092.stdout:3/954: chown d4/d73/fee 437546677 1 2024-09-17T01:52:21.764 INFO:tasks.workunit.client.1.smithi092.stdout:5/759: mkdir d0/d23/dfe 0 2024-09-17T01:52:21.767 INFO:tasks.workunit.client.1.smithi092.stdout:3/955: mkdir d4/d13/d2e/d43/d130 0 2024-09-17T01:52:21.767 INFO:tasks.workunit.client.1.smithi092.stdout:3/956: dread - d4/d73/dba/dbe/fe4 zero size 2024-09-17T01:52:21.770 INFO:tasks.workunit.client.1.smithi092.stdout:3/957: dread d4/d20/d31/f10b [0,4194304] 0 2024-09-17T01:52:21.772 INFO:tasks.workunit.client.1.smithi092.stdout:3/958: mkdir d4/d20/d31/d131 0 2024-09-17T01:52:21.775 INFO:tasks.workunit.client.1.smithi092.stdout:5/760: write d0/de/d19/f6c [30656,118475] 0 2024-09-17T01:52:21.779 INFO:tasks.workunit.client.1.smithi092.stdout:3/959: mknod d4/d13/d2e/d5f/c132 0 2024-09-17T01:52:21.779 INFO:tasks.workunit.client.1.smithi092.stdout:0/847: dwrite d3/dee/d7d/dfb/f7b [0,4194304] 0 2024-09-17T01:52:21.779 INFO:tasks.workunit.client.1.smithi092.stdout:5/761: creat d0/de/d19/d1a/d1e/d74/fff x:0 0 0 2024-09-17T01:52:21.783 INFO:tasks.workunit.client.1.smithi092.stdout:0/848: stat d3/d2e/d55/d63/d81/d9c/lf9 0 2024-09-17T01:52:21.783 INFO:tasks.workunit.client.1.smithi092.stdout:8/799: dwrite d15/d25/d2b/d63/faa [0,4194304] 0 2024-09-17T01:52:21.785 INFO:tasks.workunit.client.1.smithi092.stdout:8/800: readlink d15/d25/d2b/d3d/d9f/d8e/la3 0 2024-09-17T01:52:21.786 INFO:tasks.workunit.client.1.smithi092.stdout:0/849: write d3/d2e/d3b/d8f/fb6 [2611852,128918] 0 2024-09-17T01:52:21.789 INFO:tasks.workunit.client.1.smithi092.stdout:5/762: creat d0/de/d19/d1a/d1e/f100 x:0 0 0 2024-09-17T01:52:21.790 INFO:tasks.workunit.client.1.smithi092.stdout:5/763: chown d0/de/d19/d1a/d1e/d74/dc8 17774111 1 2024-09-17T01:52:21.792 INFO:tasks.workunit.client.1.smithi092.stdout:0/850: rmdir d3/dc8/dd2 39 2024-09-17T01:52:21.793 INFO:tasks.workunit.client.1.smithi092.stdout:8/801: mknod d15/d25/d27/d6e/d95/dda/d3b/d78/d9e/da0/c106 0 2024-09-17T01:52:21.797 INFO:tasks.workunit.client.1.smithi092.stdout:3/960: dwrite d4/d16/d1b/f87 [0,4194304] 0 2024-09-17T01:52:21.797 INFO:tasks.workunit.client.1.smithi092.stdout:5/764: getdents d0/de/d19/d1a/d1e/d74/ddf 0 2024-09-17T01:52:21.801 INFO:tasks.workunit.client.1.smithi092.stdout:8/802: mknod d15/d25/d27/d6e/d95/dda/d3b/d78/c107 0 2024-09-17T01:52:21.808 INFO:tasks.workunit.client.1.smithi092.stdout:5/765: dwrite d0/d77/fe6 [0,4194304] 0 2024-09-17T01:52:21.814 INFO:tasks.workunit.client.1.smithi092.stdout:3/961: dwrite d4/d2f/d44/d54/ff2 [0,4194304] 0 2024-09-17T01:52:21.816 INFO:tasks.workunit.client.1.smithi092.stdout:8/803: dwrite d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/f84 [0,4194304] 0 2024-09-17T01:52:21.820 INFO:tasks.workunit.client.1.smithi092.stdout:8/804: read d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/f84 [580654,49978] 0 2024-09-17T01:52:21.822 INFO:tasks.workunit.client.1.smithi092.stdout:3/962: dread d4/d20/d3f/fc9 [0,4194304] 0 2024-09-17T01:52:21.823 INFO:tasks.workunit.client.1.smithi092.stdout:0/851: dwrite d3/d73/f75 [0,4194304] 0 2024-09-17T01:52:21.825 INFO:tasks.workunit.client.1.smithi092.stdout:8/805: mkdir d15/d25/d27/d6e/d108 0 2024-09-17T01:52:21.828 INFO:tasks.workunit.client.1.smithi092.stdout:0/852: mknod d3/da/c104 0 2024-09-17T01:52:21.828 INFO:tasks.workunit.client.1.smithi092.stdout:3/963: symlink d4/d20/d31/d131/l133 0 2024-09-17T01:52:21.831 INFO:tasks.workunit.client.1.smithi092.stdout:8/806: mkdir d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/d109 0 2024-09-17T01:52:21.834 INFO:tasks.workunit.client.1.smithi092.stdout:0/853: creat d3/d2e/d3b/f105 x:0 0 0 2024-09-17T01:52:21.835 INFO:tasks.workunit.client.1.smithi092.stdout:8/807: unlink d15/d25/d27/d6e/cd6 0 2024-09-17T01:52:21.836 INFO:tasks.workunit.client.1.smithi092.stdout:0/854: symlink d3/dee/d7d/dfb/d3a/l106 0 2024-09-17T01:52:21.840 INFO:tasks.workunit.client.1.smithi092.stdout:8/808: truncate d15/d25/f5a 412044 0 2024-09-17T01:52:21.842 INFO:tasks.workunit.client.1.smithi092.stdout:0/855: creat d3/d2e/d3b/d48/f107 x:0 0 0 2024-09-17T01:52:21.847 INFO:tasks.workunit.client.1.smithi092.stdout:8/809: rename d15/d25/d27/d6e/d95/dda/l7f to d15/d6f/l10a 0 2024-09-17T01:52:21.851 INFO:tasks.workunit.client.1.smithi092.stdout:8/810: creat d15/d25/d27/d6e/d95/dda/d3b/f10b x:0 0 0 2024-09-17T01:52:21.852 INFO:tasks.workunit.client.1.smithi092.stdout:5/766: dread d0/de/d19/d1a/d1e/d52/d9a/db0/fb8 [4194304,4194304] 0 2024-09-17T01:52:21.854 INFO:tasks.workunit.client.1.smithi092.stdout:5/767: chown d0/de/d19/d1a/d1e/f5f 0 1 2024-09-17T01:52:21.854 INFO:tasks.workunit.client.1.smithi092.stdout:5/768: stat d0/de/f8e 0 2024-09-17T01:52:21.856 INFO:tasks.workunit.client.1.smithi092.stdout:8/811: mknod d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/d109/c10c 0 2024-09-17T01:52:21.857 INFO:tasks.workunit.client.1.smithi092.stdout:3/964: dread d4/d2f/f53 [0,4194304] 0 2024-09-17T01:52:21.859 INFO:tasks.workunit.client.1.smithi092.stdout:5/769: rename d0/de/d19/d3c/fa0 to d0/de/d19/d1a/d1e/d29/f101 0 2024-09-17T01:52:21.864 INFO:tasks.workunit.client.1.smithi092.stdout:8/812: dwrite d15/d6f/d8b/fbd [0,4194304] 0 2024-09-17T01:52:21.872 INFO:tasks.workunit.client.1.smithi092.stdout:8/813: read ff [25537,74615] 0 2024-09-17T01:52:21.874 INFO:tasks.workunit.client.1.smithi092.stdout:0/856: dwrite d3/d2e/d3b/d72/d7a/f9f [0,4194304] 0 2024-09-17T01:52:21.923 INFO:tasks.workunit.client.1.smithi092.stdout:0/857: dwrite d3/dee/d7d/dfb/f7b [0,4194304] 0 2024-09-17T01:52:21.928 INFO:tasks.workunit.client.1.smithi092.stdout:8/814: write d15/d6f/d8b/f103 [1195319,118449] 0 2024-09-17T01:52:21.929 INFO:tasks.workunit.client.1.smithi092.stdout:6/825: sync 2024-09-17T01:52:21.929 INFO:tasks.workunit.client.1.smithi092.stdout:3/965: dread d4/d13/f1d [0,4194304] 0 2024-09-17T01:52:21.934 INFO:tasks.workunit.client.1.smithi092.stdout:5/770: dwrite d0/de/d19/d1a/d1e/d74/f8b [0,4194304] 0 2024-09-17T01:52:21.940 INFO:tasks.workunit.client.1.smithi092.stdout:3/966: dread d4/d20/f81 [0,4194304] 0 2024-09-17T01:52:21.940 INFO:tasks.workunit.client.1.smithi092.stdout:0/858: dwrite d3/da/d15/f4e [0,4194304] 0 2024-09-17T01:52:21.943 INFO:tasks.workunit.client.1.smithi092.stdout:8/815: fsync d15/d25/d27/d6e/d95/dda/d40/d42/d43/d8d/fdf 0 2024-09-17T01:52:21.945 INFO:tasks.workunit.client.1.smithi092.stdout:3/967: write d4/d20/d3f/ff9 [795049,48343] 0 2024-09-17T01:52:21.951 INFO:tasks.workunit.client.1.smithi092.stdout:5/771: creat d0/de/d19/d1a/d1e/d74/dc8/dd5/f102 x:0 0 0 2024-09-17T01:52:21.953 INFO:tasks.workunit.client.1.smithi092.stdout:0/859: link d3/d2e/d3b/f94 d3/d2e/d55/f108 0 2024-09-17T01:52:21.954 INFO:tasks.workunit.client.1.smithi092.stdout:6/826: dwrite d3/d10/d1f/d21/d28/d2b/f2e [4194304,4194304] 0 2024-09-17T01:52:21.955 INFO:tasks.workunit.client.1.smithi092.stdout:8/816: truncate d15/d25/d27/d6e/d95/dda/d40/d42/d43/d8d/fdf 945382 0 2024-09-17T01:52:21.958 INFO:tasks.workunit.client.1.smithi092.stdout:5/772: mkdir d0/de/d19/d1a/d1e/d74/dc8/dd5/d103 0 2024-09-17T01:52:21.959 INFO:tasks.workunit.client.1.smithi092.stdout:3/968: dread d4/d2f/d44/d3c/f3e [0,4194304] 0 2024-09-17T01:52:21.967 INFO:tasks.workunit.client.1.smithi092.stdout:3/969: dread d4/d2f/d44/d54/f88 [0,4194304] 0 2024-09-17T01:52:21.967 INFO:tasks.workunit.client.1.smithi092.stdout:5/773: dread d0/de/d19/d1a/d1e/d29/f101 [0,4194304] 0 2024-09-17T01:52:21.968 INFO:tasks.workunit.client.1.smithi092.stdout:8/817: rename d15/d25/d2b/d3d/d9f/c85 to d15/d25/d27/c10d 0 2024-09-17T01:52:21.970 INFO:tasks.workunit.client.1.smithi092.stdout:8/818: chown d15/d25/d27/d6e/fc0 0 1 2024-09-17T01:52:21.972 INFO:tasks.workunit.client.1.smithi092.stdout:6/827: rename d3/d10/d8c to d3/d10/d1f/d21/da5/d18/df9 0 2024-09-17T01:52:21.973 INFO:tasks.workunit.client.1.smithi092.stdout:6/828: read - d3/d25/da8/fb1 zero size 2024-09-17T01:52:21.974 INFO:tasks.workunit.client.1.smithi092.stdout:5/774: symlink d0/de/d19/d1a/d1e/d52/d9a/l104 0 2024-09-17T01:52:21.975 INFO:tasks.workunit.client.1.smithi092.stdout:5/775: chown d0/d23/c26 573011305 1 2024-09-17T01:52:21.976 INFO:tasks.workunit.client.1.smithi092.stdout:8/819: mkdir d15/d25/d2b/d3d/d9f/d10e 0 2024-09-17T01:52:21.976 INFO:tasks.workunit.client.1.smithi092.stdout:3/970: dwrite d4/d2f/d44/d54/f11d [0,4194304] 0 2024-09-17T01:52:21.977 INFO:tasks.workunit.client.1.smithi092.stdout:3/971: fsync d4/d20/f84 0 2024-09-17T01:52:21.982 INFO:tasks.workunit.client.1.smithi092.stdout:0/860: truncate d3/dc8/f6e 25041 0 2024-09-17T01:52:21.990 INFO:tasks.workunit.client.1.smithi092.stdout:6/829: creat d3/ffa x:0 0 0 2024-09-17T01:52:21.991 INFO:tasks.workunit.client.1.smithi092.stdout:6/830: chown d3/d10/d1f/d21/da5/d18/df9/le0 181 1 2024-09-17T01:52:21.993 INFO:tasks.workunit.client.1.smithi092.stdout:8/820: link d15/d25/d27/d6e/d95/dda/d3b/d78/fb0 d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/f10f 0 2024-09-17T01:52:21.994 INFO:tasks.workunit.client.1.smithi092.stdout:0/861: write d3/d2e/d3b/d8f/d5f/f7f [668975,70904] 0 2024-09-17T01:52:21.995 INFO:tasks.workunit.client.1.smithi092.stdout:5/776: getdents d0/d50 0 2024-09-17T01:52:21.997 INFO:tasks.workunit.client.1.smithi092.stdout:5/777: write d0/de/d19/d1a/d1e/d74/dc8/dd5/f102 [898567,106973] 0 2024-09-17T01:52:21.999 INFO:tasks.workunit.client.1.smithi092.stdout:3/972: dread d4/d20/fb0 [0,4194304] 0 2024-09-17T01:52:21.999 INFO:tasks.workunit.client.1.smithi092.stdout:8/821: fdatasync d15/d25/d27/d6e/d95/dda/d40/d42/f4b 0 2024-09-17T01:52:22.001 INFO:tasks.workunit.client.1.smithi092.stdout:6/831: rename d3/d70/lc4 to d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/d8f/lfb 0 2024-09-17T01:52:22.002 INFO:tasks.workunit.client.1.smithi092.stdout:8/822: write d15/d25/d27/d6e/d95/dda/d40/d42/ffd [559111,25994] 0 2024-09-17T01:52:22.006 INFO:tasks.workunit.client.1.smithi092.stdout:5/778: creat d0/de/dd4/df8/f105 x:0 0 0 2024-09-17T01:52:22.007 INFO:tasks.workunit.client.1.smithi092.stdout:8/823: mkdir d15/d6f/d8b/d110 0 2024-09-17T01:52:22.007 INFO:tasks.workunit.client.1.smithi092.stdout:8/824: fsync d15/d25/d2b/d3d/dc6/f102 0 2024-09-17T01:52:22.009 INFO:tasks.workunit.client.1.smithi092.stdout:8/825: write d15/d25/d27/d6e/d95/dda/d40/d42/f45 [893377,11750] 0 2024-09-17T01:52:22.012 INFO:tasks.workunit.client.1.smithi092.stdout:5/779: mknod d0/d77/c106 0 2024-09-17T01:52:22.014 INFO:tasks.workunit.client.1.smithi092.stdout:6/832: mkdir d3/d10/d1f/d21/da5/d18/df9/d49/dee/dfc 0 2024-09-17T01:52:22.017 INFO:tasks.workunit.client.1.smithi092.stdout:5/780: creat d0/de/d19/d1a/f107 x:0 0 0 2024-09-17T01:52:22.017 INFO:tasks.workunit.client.1.smithi092.stdout:8/826: mknod d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/d9a/c111 0 2024-09-17T01:52:22.018 INFO:tasks.workunit.client.1.smithi092.stdout:3/973: dwrite d4/d16/f80 [0,4194304] 0 2024-09-17T01:52:22.022 INFO:tasks.workunit.client.1.smithi092.stdout:5/781: mknod d0/de/dd4/c108 0 2024-09-17T01:52:22.025 INFO:tasks.workunit.client.1.smithi092.stdout:0/862: dwrite d3/dc8/f6e [0,4194304] 0 2024-09-17T01:52:22.028 INFO:tasks.workunit.client.1.smithi092.stdout:5/782: readlink d0/de/d19/d1a/d1e/d52/d9a/db0/lb4 0 2024-09-17T01:52:22.028 INFO:tasks.workunit.client.1.smithi092.stdout:6/833: creat d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/ffd x:0 0 0 2024-09-17T01:52:22.034 INFO:tasks.workunit.client.1.smithi092.stdout:5/783: symlink d0/d50/d70/d78/d8f/l109 0 2024-09-17T01:52:22.035 INFO:tasks.workunit.client.1.smithi092.stdout:3/974: dwrite d4/d2f/d44/d54/f11d [0,4194304] 0 2024-09-17T01:52:22.039 INFO:tasks.workunit.client.1.smithi092.stdout:8/827: dwrite d15/d25/d27/d6e/d95/dda/d3b/d78/fc7 [0,4194304] 0 2024-09-17T01:52:22.047 INFO:tasks.workunit.client.1.smithi092.stdout:8/828: write f1 [3795577,90191] 0 2024-09-17T01:52:22.049 INFO:tasks.workunit.client.1.smithi092.stdout:5/784: getdents d0/de/d19/d1a/d1e/d52 0 2024-09-17T01:52:22.049 INFO:tasks.workunit.client.1.smithi092.stdout:8/829: write d15/d25/d27/d49/feb [1232368,33923] 0 2024-09-17T01:52:22.051 INFO:tasks.workunit.client.1.smithi092.stdout:5/785: write d0/de/d19/d1a/d1e/d3e/f59 [4079558,7847] 0 2024-09-17T01:52:22.054 INFO:tasks.workunit.client.1.smithi092.stdout:8/830: creat d15/d25/f112 x:0 0 0 2024-09-17T01:52:22.055 INFO:tasks.workunit.client.1.smithi092.stdout:8/831: fsync d15/d25/d27/d6e/d95/dda/d40/d42/f45 0 2024-09-17T01:52:22.058 INFO:tasks.workunit.client.1.smithi092.stdout:8/832: stat d15/d25/d27/d6e/d76/d83/d98/fb3 0 2024-09-17T01:52:22.058 INFO:tasks.workunit.client.1.smithi092.stdout:5/786: dwrite d0/de/d19/f89 [0,4194304] 0 2024-09-17T01:52:22.060 INFO:tasks.workunit.client.1.smithi092.stdout:5/787: readlink d0/de/d19/d1a/d1e/d29/lcf 0 2024-09-17T01:52:22.062 INFO:tasks.workunit.client.1.smithi092.stdout:0/863: write d3/dc8/fb4 [1038252,86986] 0 2024-09-17T01:52:22.063 INFO:tasks.workunit.client.1.smithi092.stdout:5/788: unlink d0/de/d19/d1a/d1e/d74/dc8/cc6 0 2024-09-17T01:52:22.064 INFO:tasks.workunit.client.1.smithi092.stdout:0/864: symlink d3/da/d15/dab/l109 0 2024-09-17T01:52:22.065 INFO:tasks.workunit.client.1.smithi092.stdout:5/789: mknod d0/de/dd4/c10a 0 2024-09-17T01:52:22.068 INFO:tasks.workunit.client.1.smithi092.stdout:5/790: truncate d0/d7e/f85 1130760 0 2024-09-17T01:52:22.070 INFO:tasks.workunit.client.1.smithi092.stdout:5/791: chown d0/d7e/cf0 93169762 1 2024-09-17T01:52:22.072 INFO:tasks.workunit.client.1.smithi092.stdout:5/792: fsync d0/de/d19/d1a/d1e/d52/d9a/db0/fe3 0 2024-09-17T01:52:22.076 INFO:tasks.workunit.client.1.smithi092.stdout:6/834: dwrite d3/d10/d1f/d21/da5/fa6 [0,4194304] 0 2024-09-17T01:52:22.080 INFO:tasks.workunit.client.1.smithi092.stdout:5/793: creat d0/d50/d70/d78/d8f/f10b x:0 0 0 2024-09-17T01:52:22.080 INFO:tasks.workunit.client.1.smithi092.stdout:0/865: write d3/d2e/d55/d63/d81/fac [2714196,56234] 0 2024-09-17T01:52:22.081 INFO:tasks.workunit.client.1.smithi092.stdout:5/794: stat d0/de/d19/d1a/d1e/cab 0 2024-09-17T01:52:22.082 INFO:tasks.workunit.client.1.smithi092.stdout:6/835: read d3/d10/d1f/d21/da5/d18/f27 [972916,31189] 0 2024-09-17T01:52:22.084 INFO:tasks.workunit.client.1.smithi092.stdout:8/833: dwrite d15/d25/d27/d49/f9c [0,4194304] 0 2024-09-17T01:52:22.085 INFO:tasks.workunit.client.1.smithi092.stdout:5/795: unlink d0/d50/d70/fcd 0 2024-09-17T01:52:22.091 INFO:tasks.workunit.client.1.smithi092.stdout:6/836: rename d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f50 to d3/d10/d1f/d21/d1e/d55/ffe 0 2024-09-17T01:52:22.092 INFO:tasks.workunit.client.1.smithi092.stdout:5/796: dread d0/de/d19/d1a/d1e/f71 [0,4194304] 0 2024-09-17T01:52:22.097 INFO:tasks.workunit.client.1.smithi092.stdout:6/837: creat d3/d10/d1f/d21/da5/d18/df9/d49/dee/dfc/fff x:0 0 0 2024-09-17T01:52:22.097 INFO:tasks.workunit.client.1.smithi092.stdout:5/797: symlink d0/d23/dfe/l10c 0 2024-09-17T01:52:22.099 INFO:tasks.workunit.client.1.smithi092.stdout:6/838: rmdir d3/d25/da8/dad/dae 39 2024-09-17T01:52:22.100 INFO:tasks.workunit.client.1.smithi092.stdout:6/839: chown d3/d10/d1f/d21/d1e/d55/f93 1 1 2024-09-17T01:52:22.101 INFO:tasks.workunit.client.1.smithi092.stdout:5/798: rename d0/de/d19/d1a/d1e/d52/dbd/cd9 to d0/d50/d70/d78/d8f/c10d 0 2024-09-17T01:52:22.105 INFO:tasks.workunit.client.1.smithi092.stdout:5/799: mknod d0/de/d19/d1a/d1e/d52/c10e 0 2024-09-17T01:52:22.107 INFO:tasks.workunit.client.1.smithi092.stdout:6/840: getdents d3/d10/d1f/d21/da5/d18/df9/d43/d5e 0 2024-09-17T01:52:22.108 INFO:tasks.workunit.client.1.smithi092.stdout:5/800: creat d0/de/d19/d3c/d41/dec/f10f x:0 0 0 2024-09-17T01:52:22.110 INFO:tasks.workunit.client.1.smithi092.stdout:6/841: creat d3/d10/d1f/d21/da5/d18/df9/d43/d5e/da1/f100 x:0 0 0 2024-09-17T01:52:22.111 INFO:tasks.workunit.client.1.smithi092.stdout:5/801: mknod d0/d50/d70/df4/c110 0 2024-09-17T01:52:22.112 INFO:tasks.workunit.client.1.smithi092.stdout:6/842: stat d3/d10/d1f/d21/da5/d18/fcb 0 2024-09-17T01:52:22.113 INFO:tasks.workunit.client.1.smithi092.stdout:8/834: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/f5f [0,4194304] 0 2024-09-17T01:52:22.114 INFO:tasks.workunit.client.1.smithi092.stdout:5/802: symlink d0/d7e/l111 0 2024-09-17T01:52:22.117 INFO:tasks.workunit.client.1.smithi092.stdout:8/835: creat d15/d25/d27/d6e/d95/dda/d40/d42/d43/f113 x:0 0 0 2024-09-17T01:52:22.117 INFO:tasks.workunit.client.1.smithi092.stdout:5/803: mknod d0/de/d19/d1a/d1e/d52/dbd/c112 0 2024-09-17T01:52:22.120 INFO:tasks.workunit.client.1.smithi092.stdout:5/804: creat d0/d7e/f113 x:0 0 0 2024-09-17T01:52:22.121 INFO:tasks.workunit.client.1.smithi092.stdout:8/836: chown d15/d25/d27/d6e/d95/dda/d40/d42/d6b/fb4 0 1 2024-09-17T01:52:22.121 INFO:tasks.workunit.client.1.smithi092.stdout:6/843: dwrite d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/ff6 [0,4194304] 0 2024-09-17T01:52:22.127 INFO:tasks.workunit.client.1.smithi092.stdout:5/805: mkdir d0/d50/d70/d114 0 2024-09-17T01:52:22.129 INFO:tasks.workunit.client.1.smithi092.stdout:5/806: chown d0/de/f6f 7 1 2024-09-17T01:52:22.131 INFO:tasks.workunit.client.1.smithi092.stdout:6/844: dread d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/fd9 [0,4194304] 0 2024-09-17T01:52:22.131 INFO:tasks.workunit.client.1.smithi092.stdout:5/807: readlink d0/de/d19/d1a/d1e/d52/d9a/db0/lb4 0 2024-09-17T01:52:22.134 INFO:tasks.workunit.client.1.smithi092.stdout:5/808: mknod d0/d23/dfe/c115 0 2024-09-17T01:52:22.136 INFO:tasks.workunit.client.1.smithi092.stdout:8/837: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/d43/f90 [0,4194304] 0 2024-09-17T01:52:22.137 INFO:tasks.workunit.client.1.smithi092.stdout:6/845: fdatasync d3/d10/d1f/d21/d1e/d55/f5b 0 2024-09-17T01:52:22.137 INFO:tasks.workunit.client.1.smithi092.stdout:5/809: dread d0/de/d19/d1a/d1e/f1b [0,4194304] 0 2024-09-17T01:52:22.144 INFO:tasks.workunit.client.1.smithi092.stdout:8/838: dread d15/d25/d27/d6e/d95/dda/d40/f96 [0,4194304] 0 2024-09-17T01:52:22.144 INFO:tasks.workunit.client.1.smithi092.stdout:5/810: mknod d0/d23/c116 0 2024-09-17T01:52:22.146 INFO:tasks.workunit.client.1.smithi092.stdout:6/846: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:52:22.148 INFO:tasks.workunit.client.1.smithi092.stdout:8/839: readlink d15/d25/d27/d6e/d95/dda/le3 0 2024-09-17T01:52:22.148 INFO:tasks.workunit.client.1.smithi092.stdout:6/847: write d3/d10/d1f/d21/d28/fbd [586009,40437] 0 2024-09-17T01:52:22.151 INFO:tasks.workunit.client.1.smithi092.stdout:5/811: truncate d0/de/d19/d3c/d41/d8d/fb2 1170810 0 2024-09-17T01:52:22.153 INFO:tasks.workunit.client.1.smithi092.stdout:5/812: chown d0/de/d19/d3c/d9e/cfd 3583461 1 2024-09-17T01:52:22.153 INFO:tasks.workunit.client.1.smithi092.stdout:8/840: stat d15/d25/d27/d6e/d95/dda/d40/d42/f4b 0 2024-09-17T01:52:22.157 INFO:tasks.workunit.client.1.smithi092.stdout:8/841: truncate d15/d25/d27/d6e/fac 423413 0 2024-09-17T01:52:22.160 INFO:tasks.workunit.client.1.smithi092.stdout:5/813: rename d0/de/d19/d3c/d41/d8d/fb2 to d0/de/d19/d1a/d1e/d74/dc8/f117 0 2024-09-17T01:52:22.161 INFO:tasks.workunit.client.1.smithi092.stdout:8/842: unlink d15/d25/d27/d49/fad 0 2024-09-17T01:52:22.163 INFO:tasks.workunit.client.1.smithi092.stdout:5/814: creat d0/de/d19/d1a/d1e/d52/f118 x:0 0 0 2024-09-17T01:52:22.168 INFO:tasks.workunit.client.1.smithi092.stdout:6/848: write d3/d10/d1f/d21/da5/d18/df9/f24 [6473541,40226] 0 2024-09-17T01:52:22.173 INFO:tasks.workunit.client.1.smithi092.stdout:6/849: getdents d3/d25 0 2024-09-17T01:52:22.173 INFO:tasks.workunit.client.1.smithi092.stdout:8/843: write ff [898626,70419] 0 2024-09-17T01:52:22.173 INFO:tasks.workunit.client.1.smithi092.stdout:6/850: fsync d3/d10/d1f/f59 0 2024-09-17T01:52:22.175 INFO:tasks.workunit.client.1.smithi092.stdout:8/844: fsync d15/d25/d2b/d3d/dc6/fec 0 2024-09-17T01:52:22.178 INFO:tasks.workunit.client.1.smithi092.stdout:8/845: mknod d15/d25/d27/d6e/d95/dda/d40/d42/d6b/dd9/c114 0 2024-09-17T01:52:22.179 INFO:tasks.workunit.client.1.smithi092.stdout:8/846: write ff [3018110,68314] 0 2024-09-17T01:52:22.185 INFO:tasks.workunit.client.1.smithi092.stdout:6/851: dwrite d3/d10/d1f/d21/d1e/d55/f93 [0,4194304] 0 2024-09-17T01:52:22.189 INFO:tasks.workunit.client.1.smithi092.stdout:6/852: write d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/f90 [1667016,39528] 0 2024-09-17T01:52:22.194 INFO:tasks.workunit.client.1.smithi092.stdout:6/853: rmdir d3/d10/d1f/d21 39 2024-09-17T01:52:22.195 INFO:tasks.workunit.client.1.smithi092.stdout:8/847: dread d15/d25/d27/d6e/d95/dda/d40/f7b [0,4194304] 0 2024-09-17T01:52:22.200 INFO:tasks.workunit.client.1.smithi092.stdout:6/854: unlink d3/d10/d1f/d21/da5/d18/df9/d49/fb3 0 2024-09-17T01:52:22.200 INFO:tasks.workunit.client.1.smithi092.stdout:8/848: getdents d15/d25/d27/d6e/d95/dda/d40/d42/ded 0 2024-09-17T01:52:22.204 INFO:tasks.workunit.client.1.smithi092.stdout:8/849: chown d15/d25/d27/d6e/d95/dda/d3b/d78/cc8 1239856455 1 2024-09-17T01:52:22.208 INFO:tasks.workunit.client.1.smithi092.stdout:6/855: getdents d3/d10/d1f/d21/da5/d18/df9/d43/d5e/da1 0 2024-09-17T01:52:22.214 INFO:tasks.workunit.client.1.smithi092.stdout:6/856: link d3/f44 d3/d10/d1f/d21/da5/d18/df9/f101 0 2024-09-17T01:52:22.218 INFO:tasks.workunit.client.1.smithi092.stdout:6/857: read d3/d10/d1f/d21/da5/d18/df9/d43/faf [1117256,55299] 0 2024-09-17T01:52:22.220 INFO:tasks.workunit.client.1.smithi092.stdout:6/858: write d3/d10/d1f/d21/d28/d2b/fc2 [571532,39979] 0 2024-09-17T01:52:22.223 INFO:tasks.workunit.client.1.smithi092.stdout:6/859: mknod d3/d10/d1f/c102 0 2024-09-17T01:52:22.231 INFO:tasks.workunit.client.1.smithi092.stdout:6/860: rename d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f97 to d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f103 0 2024-09-17T01:52:22.234 INFO:tasks.workunit.client.1.smithi092.stdout:8/850: dread d15/f34 [0,4194304] 0 2024-09-17T01:52:22.235 INFO:tasks.workunit.client.1.smithi092.stdout:6/861: mkdir d3/d8e/d104 0 2024-09-17T01:52:22.235 INFO:tasks.workunit.client.1.smithi092.stdout:8/851: write d15/d25/d2b/d3d/dc6/fe2 [147766,7618] 0 2024-09-17T01:52:22.241 INFO:tasks.workunit.client.1.smithi092.stdout:8/852: link d15/d25/d27/d6e/d76/d83/d98/fb3 d15/d25/d2b/f115 0 2024-09-17T01:52:22.243 INFO:tasks.workunit.client.1.smithi092.stdout:8/853: chown d15/d25/d27/d6e/d95/dda/d3b/d78/cd1 80787414 1 2024-09-17T01:52:22.252 INFO:tasks.workunit.client.1.smithi092.stdout:8/854: dwrite d15/d25/d2b/d63/fb8 [0,4194304] 0 2024-09-17T01:52:22.255 INFO:tasks.workunit.client.1.smithi092.stdout:6/862: dread d3/d10/d1f/f59 [0,4194304] 0 2024-09-17T01:52:22.256 INFO:tasks.workunit.client.1.smithi092.stdout:8/855: symlink d15/d25/d27/l116 0 2024-09-17T01:52:22.259 INFO:tasks.workunit.client.1.smithi092.stdout:6/863: chown d3/d25/da8/dad/dae/ff5 73503437 1 2024-09-17T01:52:22.261 INFO:tasks.workunit.client.1.smithi092.stdout:6/864: dread - d3/d10/d1f/d21/d28/fc7 zero size 2024-09-17T01:52:22.262 INFO:tasks.workunit.client.1.smithi092.stdout:8/856: dread d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/f84 [0,4194304] 0 2024-09-17T01:52:22.266 INFO:tasks.workunit.client.1.smithi092.stdout:7/889: sync 2024-09-17T01:52:22.268 INFO:tasks.workunit.client.1.smithi092.stdout:6/865: rename d3/d25/da8/dad/dae to d3/d10/d1f/d21/da5/d18/df9/d105 0 2024-09-17T01:52:22.268 INFO:tasks.workunit.client.1.smithi092.stdout:7/890: truncate d3/db/d26/d83/dec/fff 448526 0 2024-09-17T01:52:22.274 INFO:tasks.workunit.client.1.smithi092.stdout:7/891: mkdir d3/d6/d13/d12e 0 2024-09-17T01:52:22.280 INFO:tasks.workunit.client.1.smithi092.stdout:7/892: mkdir d3/d6/dc2/dc5/d12f 0 2024-09-17T01:52:22.280 INFO:tasks.workunit.client.1.smithi092.stdout:6/866: dread d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f103 [0,4194304] 0 2024-09-17T01:52:22.281 INFO:tasks.workunit.client.1.smithi092.stdout:7/893: write d3/db/d98/dce/d60/ffc [462325,84542] 0 2024-09-17T01:52:22.285 INFO:tasks.workunit.client.1.smithi092.stdout:6/867: rename d3/d10/d1f/d21/d28/d2b/l38 to d3/d70/l106 0 2024-09-17T01:52:22.290 INFO:tasks.workunit.client.1.smithi092.stdout:6/868: symlink d3/d10/d1f/d21/d28/d2b/l107 0 2024-09-17T01:52:22.292 INFO:tasks.workunit.client.1.smithi092.stdout:7/894: dwrite d3/db/d26/f80 [0,4194304] 0 2024-09-17T01:52:22.297 INFO:tasks.workunit.client.1.smithi092.stdout:7/895: creat d3/d6/f130 x:0 0 0 2024-09-17T01:52:22.301 INFO:tasks.workunit.client.1.smithi092.stdout:6/869: dwrite d3/d10/d1f/d21/da5/d18/df9/d49/dee/dfc/fff [0,4194304] 0 2024-09-17T01:52:22.308 INFO:tasks.workunit.client.1.smithi092.stdout:6/870: rename d3/d10/d1f/d21/d28/f2c to d3/d8e/f108 0 2024-09-17T01:52:22.309 INFO:tasks.workunit.client.1.smithi092.stdout:7/896: getdents d3/db/d98/dce/d6a 0 2024-09-17T01:52:22.311 INFO:tasks.workunit.client.1.smithi092.stdout:6/871: write d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/f94 [299865,119437] 0 2024-09-17T01:52:22.317 INFO:tasks.workunit.client.1.smithi092.stdout:6/872: fsync d3/d10/d1f/d21/da5/d18/df9/d43/d5e/da1/fed 0 2024-09-17T01:52:22.318 INFO:tasks.workunit.client.1.smithi092.stdout:6/873: write d3/f6 [1668688,112715] 0 2024-09-17T01:52:22.323 INFO:tasks.workunit.client.1.smithi092.stdout:6/874: mknod d3/d25/c109 0 2024-09-17T01:52:22.331 INFO:tasks.workunit.client.1.smithi092.stdout:7/897: getdents d3/d6/dc2/dc5/d12f 0 2024-09-17T01:52:22.338 INFO:tasks.workunit.client.1.smithi092.stdout:6/875: symlink d3/d25/df2/l10a 0 2024-09-17T01:52:22.339 INFO:tasks.workunit.client.1.smithi092.stdout:7/898: dwrite d3/db/d98/dce/fcb [0,4194304] 0 2024-09-17T01:52:22.341 INFO:tasks.workunit.client.1.smithi092.stdout:6/876: fsync d3/d10/d1f/d21/d28/f82 0 2024-09-17T01:52:22.342 INFO:tasks.workunit.client.1.smithi092.stdout:7/899: chown d3/d6/da1 719148 1 2024-09-17T01:52:22.343 INFO:tasks.workunit.client.1.smithi092.stdout:7/900: rmdir d3/d6/dc2/ddc 39 2024-09-17T01:52:22.345 INFO:tasks.workunit.client.1.smithi092.stdout:6/877: creat d3/d10/d1f/d21/da5/d18/df9/d49/dee/dfc/f10b x:0 0 0 2024-09-17T01:52:22.346 INFO:tasks.workunit.client.1.smithi092.stdout:7/901: getdents d3/d2b/d84/df3 0 2024-09-17T01:52:22.348 INFO:tasks.workunit.client.1.smithi092.stdout:7/902: dread - d3/db/d98/dce/d61/f11b zero size 2024-09-17T01:52:22.354 INFO:tasks.workunit.client.1.smithi092.stdout:7/903: link d3/d6/f9c d3/db/d98/dce/f131 0 2024-09-17T01:52:22.357 INFO:tasks.workunit.client.1.smithi092.stdout:7/904: mkdir d3/d6/d13/db7/d132 0 2024-09-17T01:52:22.358 INFO:tasks.workunit.client.1.smithi092.stdout:7/905: symlink d3/d6/dc2/dc5/l133 0 2024-09-17T01:52:22.363 INFO:tasks.workunit.client.1.smithi092.stdout:6/878: write d3/d25/da8/fba [1137973,115266] 0 2024-09-17T01:52:22.366 INFO:tasks.workunit.client.1.smithi092.stdout:7/906: link d3/d6/d13/d21/d2e/d6e/f41 d3/d6/d13/d21/f134 0 2024-09-17T01:52:22.367 INFO:tasks.workunit.client.1.smithi092.stdout:7/907: write d3/fc [6090478,85336] 0 2024-09-17T01:52:22.368 INFO:tasks.workunit.client.1.smithi092.stdout:6/879: creat d3/d10/d1f/d21/d1e/d55/f10c x:0 0 0 2024-09-17T01:52:22.369 INFO:tasks.workunit.client.1.smithi092.stdout:6/880: readlink d3/d10/d1f/d21/da5/l76 0 2024-09-17T01:52:22.370 INFO:tasks.workunit.client.1.smithi092.stdout:7/908: fdatasync d3/db/d26/d83/da6/fb1 0 2024-09-17T01:52:22.371 INFO:tasks.workunit.client.1.smithi092.stdout:7/909: dread - d3/d6/d13/db7/f10a zero size 2024-09-17T01:52:22.371 INFO:tasks.workunit.client.1.smithi092.stdout:6/881: dread - d3/d10/d1f/d21/da5/d18/df9/d43/d6a/fca zero size 2024-09-17T01:52:22.374 INFO:tasks.workunit.client.1.smithi092.stdout:7/910: mknod d3/d6/dc2/dc5/c135 0 2024-09-17T01:52:22.380 INFO:tasks.workunit.client.1.smithi092.stdout:7/911: rmdir d3/d6/dc2/dc5/d12f 0 2024-09-17T01:52:22.386 INFO:tasks.workunit.client.1.smithi092.stdout:6/882: write d3/d10/d1f/d21/f3b [1982750,42719] 0 2024-09-17T01:52:22.387 INFO:tasks.workunit.client.1.smithi092.stdout:7/912: write d3/db/f15 [5926099,59093] 0 2024-09-17T01:52:22.388 INFO:tasks.workunit.client.1.smithi092.stdout:6/883: readlink d3/d10/d1f/d21/da5/d18/df9/d43/la3 0 2024-09-17T01:52:22.392 INFO:tasks.workunit.client.1.smithi092.stdout:7/913: truncate d3/d6/da1/fa8 261128 0 2024-09-17T01:52:22.392 INFO:tasks.workunit.client.1.smithi092.stdout:7/914: write d3/d6/f130 [174695,22300] 0 2024-09-17T01:52:22.392 INFO:tasks.workunit.client.1.smithi092.stdout:6/884: creat d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/d8f/f10d x:0 0 0 2024-09-17T01:52:22.393 INFO:tasks.workunit.client.1.smithi092.stdout:7/915: write d3/db/d98/dce/fda [170695,58696] 0 2024-09-17T01:52:22.393 INFO:tasks.workunit.client.1.smithi092.stdout:6/885: readlink d3/d10/d1f/d21/d28/lcf 0 2024-09-17T01:52:22.397 INFO:tasks.workunit.client.1.smithi092.stdout:6/886: creat d3/d10/d1f/d21/da5/d18/df9/d43/d5e/f10e x:0 0 0 2024-09-17T01:52:22.399 INFO:tasks.workunit.client.1.smithi092.stdout:7/916: dwrite d3/d6/d13/f7d [0,4194304] 0 2024-09-17T01:52:22.402 INFO:tasks.workunit.client.1.smithi092.stdout:7/917: symlink d3/d2b/d84/da7/l136 0 2024-09-17T01:52:22.404 INFO:tasks.workunit.client.1.smithi092.stdout:6/887: write d3/d10/d1f/d21/da5/d18/df9/f101 [594718,16425] 0 2024-09-17T01:52:22.406 INFO:tasks.workunit.client.1.smithi092.stdout:6/888: write d3/d10/d1f/d21/d28/d2b/fdc [841544,31064] 0 2024-09-17T01:52:22.409 INFO:tasks.workunit.client.1.smithi092.stdout:6/889: creat d3/d10/f10f x:0 0 0 2024-09-17T01:52:22.414 INFO:tasks.workunit.client.1.smithi092.stdout:6/890: creat d3/d10/d1f/d21/d28/d2b/f110 x:0 0 0 2024-09-17T01:52:22.415 INFO:tasks.workunit.client.1.smithi092.stdout:7/918: dwrite d3/d2b/d84/da7/f68 [4194304,4194304] 0 2024-09-17T01:52:22.423 INFO:tasks.workunit.client.1.smithi092.stdout:7/919: dwrite d3/db/d26/f62 [0,4194304] 0 2024-09-17T01:52:22.424 INFO:tasks.workunit.client.1.smithi092.stdout:7/920: stat d3/db/d98/dce/daf/f103 0 2024-09-17T01:52:22.426 INFO:tasks.workunit.client.1.smithi092.stdout:7/921: dread - d3/fbe zero size 2024-09-17T01:52:22.435 INFO:tasks.workunit.client.1.smithi092.stdout:6/891: dread d3/d10/f57 [0,4194304] 0 2024-09-17T01:52:22.458 INFO:tasks.workunit.client.1.smithi092.stdout:6/892: mknod d3/d10/c111 0 2024-09-17T01:52:22.458 INFO:tasks.workunit.client.1.smithi092.stdout:6/893: stat d3 0 2024-09-17T01:52:22.460 INFO:tasks.workunit.client.1.smithi092.stdout:6/894: unlink f2 0 2024-09-17T01:52:22.461 INFO:tasks.workunit.client.1.smithi092.stdout:6/895: chown d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/ff6 3 1 2024-09-17T01:52:22.462 INFO:tasks.workunit.client.1.smithi092.stdout:6/896: readlink d3/d8e/lb5 0 2024-09-17T01:52:22.464 INFO:tasks.workunit.client.1.smithi092.stdout:6/897: truncate d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/ff0 642852 0 2024-09-17T01:52:22.465 INFO:tasks.workunit.client.1.smithi092.stdout:6/898: mkdir d3/d10/d1f/d21/da5/d18/df9/d49/d112 0 2024-09-17T01:52:22.466 INFO:tasks.workunit.client.1.smithi092.stdout:6/899: write d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/ffd [947426,53114] 0 2024-09-17T01:52:22.471 INFO:tasks.workunit.client.1.smithi092.stdout:6/900: rename d3/d25/l3c to d3/d10/d1f/d21/da5/d18/df9/l113 0 2024-09-17T01:52:22.472 INFO:tasks.workunit.client.1.smithi092.stdout:6/901: write d3/d10/d1f/d21/da5/d18/df9/d49/dee/dfc/f10b [575490,16504] 0 2024-09-17T01:52:22.474 INFO:tasks.workunit.client.1.smithi092.stdout:6/902: dread - d3/d10/d1f/d21/da5/d18/df9/d49/d7e/fdd zero size 2024-09-17T01:52:22.479 INFO:tasks.workunit.client.1.smithi092.stdout:6/903: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: pgmap v21: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 127 MiB/s rd, 300 MiB/s wr, 621 op/s 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:22 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.507 INFO:tasks.workunit.client.1.smithi092.stdout:6/904: dread d3/d10/d1f/f32 [4194304,4194304] 0 2024-09-17T01:52:22.513 INFO:tasks.workunit.client.1.smithi092.stdout:6/905: dwrite d3/d10/d1f/d21/d28/fbd [0,4194304] 0 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: pgmap v21: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 127 MiB/s rd, 300 MiB/s wr, 621 op/s 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:52:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:22 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:22.517 INFO:tasks.workunit.client.1.smithi092.stdout:6/906: unlink d3/d10/d1f/d21/da5/d18/df9/d49/d7e/fc6 0 2024-09-17T01:52:22.521 INFO:tasks.workunit.client.1.smithi092.stdout:6/907: creat d3/d10/d1f/d21/da5/d18/df9/d49/d7e/f114 x:0 0 0 2024-09-17T01:52:22.524 INFO:tasks.workunit.client.1.smithi092.stdout:6/908: unlink d3/d10/d1f/d21/da5/d18/df9/d43/d5e/da1/f100 0 2024-09-17T01:52:22.531 INFO:tasks.workunit.client.1.smithi092.stdout:6/909: dwrite d3/d10/d1f/d21/da5/d18/df9/d49/dee/dfc/f10b [0,4194304] 0 2024-09-17T01:52:22.531 INFO:tasks.workunit.client.1.smithi092.stdout:2/856: sync 2024-09-17T01:52:22.549 INFO:tasks.workunit.client.1.smithi092.stdout:6/910: dread f1 [0,4194304] 0 2024-09-17T01:52:22.552 INFO:tasks.workunit.client.1.smithi092.stdout:2/857: dread d10/d1d/d2c/d56/f78 [0,4194304] 0 2024-09-17T01:52:22.553 INFO:tasks.workunit.client.1.smithi092.stdout:6/911: link d3/d10/d1f/d21/da5/d18/df9/le0 d3/d70/l115 0 2024-09-17T01:52:22.555 INFO:tasks.workunit.client.1.smithi092.stdout:2/858: mkdir d10/d1d/d96/d77/d9c/d11b 0 2024-09-17T01:52:22.557 INFO:tasks.workunit.client.1.smithi092.stdout:2/859: creat d10/d1d/f11c x:0 0 0 2024-09-17T01:52:22.558 INFO:tasks.workunit.client.1.smithi092.stdout:6/912: creat d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f116 x:0 0 0 2024-09-17T01:52:22.559 INFO:tasks.workunit.client.1.smithi092.stdout:6/913: write d3/d10/d1f/d21/d28/f54 [4132670,13482] 0 2024-09-17T01:52:22.569 INFO:tasks.workunit.client.1.smithi092.stdout:2/860: truncate d10/d1d/d2c/d5a/d7a/fed 1401464 0 2024-09-17T01:52:22.571 INFO:tasks.workunit.client.1.smithi092.stdout:2/861: creat d10/db9/f11d x:0 0 0 2024-09-17T01:52:22.574 INFO:tasks.workunit.client.1.smithi092.stdout:2/862: mkdir d10/d4c/d80/d95/dc6/d11e 0 2024-09-17T01:52:22.575 INFO:tasks.workunit.client.1.smithi092.stdout:6/914: dread d3/d10/d1f/d21/d28/f82 [0,4194304] 0 2024-09-17T01:52:22.609 INFO:tasks.workunit.client.1.smithi092.stdout:2/863: symlink d10/d1d/d96/d77/d9c/l11f 0 2024-09-17T01:52:22.663 INFO:tasks.workunit.client.1.smithi092.stdout:6/915: creat d3/d25/da8/dad/f117 x:0 0 0 2024-09-17T01:52:22.663 INFO:tasks.workunit.client.1.smithi092.stdout:6/916: readlink d3/d25/df2/l10a 0 2024-09-17T01:52:22.663 INFO:tasks.workunit.client.1.smithi092.stdout:2/864: dwrite d10/db9/f11d [0,4194304] 0 2024-09-17T01:52:22.663 INFO:tasks.workunit.client.1.smithi092.stdout:6/917: mknod d3/c118 0 2024-09-17T01:52:22.663 INFO:tasks.workunit.client.1.smithi092.stdout:2/865: mknod d10/d1d/d2c/d5a/d7a/df5/c120 0 2024-09-17T01:52:22.663 INFO:tasks.workunit.client.1.smithi092.stdout:6/918: truncate d3/d10/d1f/f30 465930 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:2/866: symlink d10/d8d/d9e/l121 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:6/919: creat d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/d8f/f119 x:0 0 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:2/867: truncate d10/d4c/f72 278339 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:2/868: fsync d10/d1d/d2c/d56/f60 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:6/920: rename d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/f88 to d3/d10/d1f/d21/f11a 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:2/869: mknod d10/db9/c122 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:6/921: rename d3/d10/d1f/d21/da5/d18/df9/d49/d7e to d3/d10/d1f/d21/da5/d18/d11b 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:6/922: creat d3/d10/f11c x:0 0 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:6/923: mknod d3/d10/d1f/d21/da5/d18/df9/d49/dee/c11d 0 2024-09-17T01:52:22.664 INFO:tasks.workunit.client.1.smithi092.stdout:6/924: mknod d3/d25/df2/c11e 0 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:2/870: dread d10/d1d/d24/f29 [0,4194304] 0 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:2/871: read - d10/fd0 zero size 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:6/925: dwrite d3/d10/d1f/d21/d28/d2b/f110 [0,4194304] 0 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:6/926: fdatasync d3/f6 0 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:2/872: link d10/d1d/d2c/f7d d10/d1d/d96/d77/d9c/dae/f123 0 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:6/927: rename d3/d10/d1f/d21/da5/d18/df9/d105/ff5 to d3/d10/f11f 0 2024-09-17T01:52:22.665 INFO:tasks.workunit.client.1.smithi092.stdout:6/928: getdents d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72 0 2024-09-17T01:52:22.666 INFO:tasks.workunit.client.1.smithi092.stdout:2/873: write d10/d1d/d24/f43 [1306977,35148] 0 2024-09-17T01:52:22.666 INFO:tasks.workunit.client.1.smithi092.stdout:2/874: stat d10/d8d/d8f/d93/cf1 0 2024-09-17T01:52:22.668 INFO:tasks.workunit.client.1.smithi092.stdout:2/875: mkdir d10/d55/dda/da3/dbd/d124 0 2024-09-17T01:52:22.669 INFO:tasks.workunit.client.1.smithi092.stdout:6/929: truncate d3/d8e/f108 2142385 0 2024-09-17T01:52:22.678 INFO:tasks.workunit.client.1.smithi092.stdout:6/930: truncate d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/fbb 743744 0 2024-09-17T01:52:22.680 INFO:tasks.workunit.client.1.smithi092.stdout:6/931: creat d3/d8e/d104/f120 x:0 0 0 2024-09-17T01:52:22.684 INFO:tasks.workunit.client.1.smithi092.stdout:2/876: dread d10/d3a/d97/f98 [0,4194304] 0 2024-09-17T01:52:22.686 INFO:tasks.workunit.client.1.smithi092.stdout:2/877: truncate d10/d8d/d8f/fb6 4550478 0 2024-09-17T01:52:22.687 INFO:tasks.workunit.client.1.smithi092.stdout:2/878: write d10/d1d/d24/f43 [49942,112577] 0 2024-09-17T01:52:22.689 INFO:tasks.workunit.client.1.smithi092.stdout:6/932: truncate d3/d10/d1f/d21/d1e/d55/f93 1119617 0 2024-09-17T01:52:22.691 INFO:tasks.workunit.client.1.smithi092.stdout:6/933: unlink d3/d8e/ld2 0 2024-09-17T01:52:22.692 INFO:tasks.workunit.client.1.smithi092.stdout:2/879: link d10/db9/lde d10/d1d/d2c/d5a/d7a/l125 0 2024-09-17T01:52:22.694 INFO:tasks.workunit.client.1.smithi092.stdout:2/880: chown d10/d1d/d2c/fcf 0 1 2024-09-17T01:52:22.696 INFO:tasks.workunit.client.1.smithi092.stdout:6/934: link d3/d10/d1f/d21/d1e/cd6 d3/d10/d1f/d21/d1e/d55/c121 0 2024-09-17T01:52:22.699 INFO:tasks.workunit.client.1.smithi092.stdout:6/935: mkdir d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/d122 0 2024-09-17T01:52:22.702 INFO:tasks.workunit.client.1.smithi092.stdout:6/936: symlink d3/d10/l123 0 2024-09-17T01:52:22.703 INFO:tasks.workunit.client.1.smithi092.stdout:2/881: write d10/d8d/f52 [98982,90391] 0 2024-09-17T01:52:22.706 INFO:tasks.workunit.client.1.smithi092.stdout:2/882: unlink d10/d55/dda/fc0 0 2024-09-17T01:52:22.707 INFO:tasks.workunit.client.1.smithi092.stdout:6/937: truncate d3/d10/d1f/d21/da5/d18/d11b/fdd 545973 0 2024-09-17T01:52:22.712 INFO:tasks.workunit.client.1.smithi092.stdout:2/883: dwrite d10/db9/f110 [0,4194304] 0 2024-09-17T01:52:22.714 INFO:tasks.workunit.client.1.smithi092.stdout:6/938: write d3/d10/d1f/d21/d28/fbd [4397917,97485] 0 2024-09-17T01:52:22.719 INFO:tasks.workunit.client.1.smithi092.stdout:2/884: dwrite d10/d4c/d80/d95/fa0 [0,4194304] 0 2024-09-17T01:52:22.813 INFO:tasks.workunit.client.1.smithi092.stdout:9/900: sync 2024-09-17T01:52:22.815 INFO:tasks.workunit.client.1.smithi092.stdout:9/901: dwrite d0/df/d5d/ff7 [0,4194304] 0 2024-09-17T01:52:22.835 INFO:tasks.workunit.client.1.smithi092.stdout:9/902: dread d0/d5/fc1 [4194304,4194304] 0 2024-09-17T01:52:22.836 INFO:tasks.workunit.client.1.smithi092.stdout:9/903: stat d0/d5/fc1 0 2024-09-17T01:52:22.837 INFO:tasks.workunit.client.1.smithi092.stdout:9/904: mknod d0/d7c/dbd/ddd/c10f 0 2024-09-17T01:52:22.839 INFO:tasks.workunit.client.1.smithi092.stdout:9/905: write d0/d7/d12/d86/d93/faf [2838854,128913] 0 2024-09-17T01:52:22.840 INFO:tasks.workunit.client.1.smithi092.stdout:9/906: mkdir d0/df/d5d/dfe/d110 0 2024-09-17T01:52:22.842 INFO:tasks.workunit.client.1.smithi092.stdout:9/907: fsync d0/d7/d12/d34/d26/d54/fa8 0 2024-09-17T01:52:22.929 INFO:tasks.workunit.client.1.smithi092.stdout:9/908: creat d0/d7/d12/d34/d26/f111 x:0 0 0 2024-09-17T01:52:22.931 INFO:tasks.workunit.client.1.smithi092.stdout:9/909: rmdir d0/d7/d12/d34/d26/d54/d6b/dc4 39 2024-09-17T01:52:22.937 INFO:tasks.workunit.client.1.smithi092.stdout:9/910: dwrite d0/d7/d12/f99 [0,4194304] 0 2024-09-17T01:52:22.940 INFO:tasks.workunit.client.1.smithi092.stdout:9/911: truncate d0/d7/d12/d34/f56 657428 0 2024-09-17T01:52:22.944 INFO:tasks.workunit.client.1.smithi092.stdout:9/912: creat d0/d5/d3e/daa/f112 x:0 0 0 2024-09-17T01:52:22.946 INFO:tasks.workunit.client.1.smithi092.stdout:9/913: mkdir d0/d7/def/d113 0 2024-09-17T01:52:22.950 INFO:tasks.workunit.client.1.smithi092.stdout:9/914: link d0/d7/d12/fd4 d0/df/d5d/f114 0 2024-09-17T01:52:22.950 INFO:tasks.workunit.client.1.smithi092.stdout:9/915: chown d0/d7/d21/fa5 10 1 2024-09-17T01:52:22.951 INFO:tasks.workunit.client.1.smithi092.stdout:9/916: readlink d0/d7c/dbd/le6 0 2024-09-17T01:52:22.952 INFO:tasks.workunit.client.1.smithi092.stdout:9/917: chown d0/d7/d12/d86/d93/ccd 113 1 2024-09-17T01:52:22.960 INFO:tasks.workunit.client.1.smithi092.stdout:9/918: truncate d0/df/d17/d9d/fb1 2165729 0 2024-09-17T01:52:22.961 INFO:tasks.workunit.client.1.smithi092.stdout:9/919: rmdir d0/df/d5d/d109 39 2024-09-17T01:52:22.963 INFO:tasks.workunit.client.1.smithi092.stdout:9/920: symlink d0/l115 0 2024-09-17T01:52:22.963 INFO:tasks.workunit.client.1.smithi092.stdout:9/921: chown d0/df/d5d 2245292 1 2024-09-17T01:52:22.965 INFO:tasks.workunit.client.1.smithi092.stdout:9/922: mknod d0/d5/c116 0 2024-09-17T01:52:22.970 INFO:tasks.workunit.client.1.smithi092.stdout:5/815: sync 2024-09-17T01:52:22.970 INFO:tasks.workunit.client.1.smithi092.stdout:0/866: sync 2024-09-17T01:52:22.970 INFO:tasks.workunit.client.1.smithi092.stdout:3/975: sync 2024-09-17T01:52:22.975 INFO:tasks.workunit.client.1.smithi092.stdout:0/867: creat d3/da/d15/d30/f10a x:0 0 0 2024-09-17T01:52:22.976 INFO:tasks.workunit.client.1.smithi092.stdout:0/868: chown d3/dee/c65 50243 1 2024-09-17T01:52:22.980 INFO:tasks.workunit.client.1.smithi092.stdout:5/816: mkdir d0/de/d19/d1a/d1e/d52/d9a/de9/d119 0 2024-09-17T01:52:22.984 INFO:tasks.workunit.client.1.smithi092.stdout:5/817: readlink d0/de/d19/d1a/d1e/d3e/la7 0 2024-09-17T01:52:22.985 INFO:tasks.workunit.client.1.smithi092.stdout:9/923: dwrite d0/d7/d12/d86/fbb [0,4194304] 0 2024-09-17T01:52:22.987 INFO:tasks.workunit.client.1.smithi092.stdout:5/818: write d0/de/d19/d3c/fcc [358486,4604] 0 2024-09-17T01:52:22.991 INFO:tasks.workunit.client.1.smithi092.stdout:3/976: dwrite d4/d13/f63 [0,4194304] 0 2024-09-17T01:52:22.996 INFO:tasks.workunit.client.1.smithi092.stdout:9/924: dwrite d0/f32 [0,4194304] 0 2024-09-17T01:52:23.001 INFO:tasks.workunit.client.1.smithi092.stdout:3/977: truncate d4/d20/d3f/fd8 5170364 0 2024-09-17T01:52:23.005 INFO:tasks.workunit.client.1.smithi092.stdout:5/819: dread d0/de/d19/d1a/d1e/f75 [0,4194304] 0 2024-09-17T01:52:23.007 INFO:tasks.workunit.client.1.smithi092.stdout:9/925: link d0/cb9 d0/d7/d12/d34/c117 0 2024-09-17T01:52:23.009 INFO:tasks.workunit.client.1.smithi092.stdout:0/869: dread d3/d2e/d55/d63/f93 [0,4194304] 0 2024-09-17T01:52:23.010 INFO:tasks.workunit.client.1.smithi092.stdout:3/978: dwrite d4/d20/d9f/f108 [0,4194304] 0 2024-09-17T01:52:23.011 INFO:tasks.workunit.client.1.smithi092.stdout:9/926: mknod d0/d7/d21/c118 0 2024-09-17T01:52:23.012 INFO:tasks.workunit.client.1.smithi092.stdout:5/820: mknod d0/de/d19/d1a/d1e/d52/d9a/de9/d119/c11a 0 2024-09-17T01:52:23.018 INFO:tasks.workunit.client.1.smithi092.stdout:9/927: creat d0/d7/d12/d86/f119 x:0 0 0 2024-09-17T01:52:23.020 INFO:tasks.workunit.client.1.smithi092.stdout:0/870: dwrite d3/d2e/d55/f70 [0,4194304] 0 2024-09-17T01:52:23.024 INFO:tasks.workunit.client.1.smithi092.stdout:9/928: fdatasync d0/df/d17/f7b 0 2024-09-17T01:52:23.027 INFO:tasks.workunit.client.1.smithi092.stdout:0/871: mknod d3/d2e/d3b/d48/c10b 0 2024-09-17T01:52:23.031 INFO:tasks.workunit.client.1.smithi092.stdout:7/922: sync 2024-09-17T01:52:23.031 INFO:tasks.workunit.client.1.smithi092.stdout:8/857: sync 2024-09-17T01:52:23.032 INFO:tasks.workunit.client.1.smithi092.stdout:5/821: rename d0/d50/d70/d78/d8f/c10d to d0/de/d19/d1a/d1e/d74/dc8/dd5/d103/c11b 0 2024-09-17T01:52:23.034 INFO:tasks.workunit.client.1.smithi092.stdout:8/858: chown d15/d25/d27/d6e/d95/dda/d40/d42/f92 1000962877 1 2024-09-17T01:52:23.038 INFO:tasks.workunit.client.1.smithi092.stdout:7/923: creat d3/db/d26/d83/f137 x:0 0 0 2024-09-17T01:52:23.040 INFO:tasks.workunit.client.1.smithi092.stdout:0/872: mkdir d3/dee/d7d/dfb/d10c 0 2024-09-17T01:52:23.041 INFO:tasks.workunit.client.1.smithi092.stdout:9/929: rmdir d0/d7/d12 39 2024-09-17T01:52:23.045 INFO:tasks.workunit.client.1.smithi092.stdout:5/822: dwrite d0/d50/d70/d78/d8f/f10b [0,4194304] 0 2024-09-17T01:52:23.049 INFO:tasks.workunit.client.1.smithi092.stdout:3/979: dread d4/d2f/d44/f77 [0,4194304] 0 2024-09-17T01:52:23.054 INFO:tasks.workunit.client.1.smithi092.stdout:8/859: getdents d15/d25/d27/d6e/d95/dda/d40/d42 0 2024-09-17T01:52:23.056 INFO:tasks.workunit.client.1.smithi092.stdout:7/924: dwrite d3/d2b/d84/fca [0,4194304] 0 2024-09-17T01:52:23.058 INFO:tasks.workunit.client.1.smithi092.stdout:0/873: write d3/dee/d7d/f8b [875960,32727] 0 2024-09-17T01:52:23.059 INFO:tasks.workunit.client.1.smithi092.stdout:8/860: write d15/d25/d27/d6e/d95/dda/f7a [2198874,4571] 0 2024-09-17T01:52:23.062 INFO:tasks.workunit.client.1.smithi092.stdout:9/930: dwrite d0/d5/d3e/daa/f112 [0,4194304] 0 2024-09-17T01:52:23.069 INFO:tasks.workunit.client.1.smithi092.stdout:9/931: fdatasync d0/fbe 0 2024-09-17T01:52:23.070 INFO:tasks.workunit.client.1.smithi092.stdout:6/939: sync 2024-09-17T01:52:23.070 INFO:tasks.workunit.client.1.smithi092.stdout:9/932: readlink d0/l115 0 2024-09-17T01:52:23.070 INFO:tasks.workunit.client.1.smithi092.stdout:2/885: sync 2024-09-17T01:52:23.070 INFO:tasks.workunit.client.1.smithi092.stdout:8/861: dread d15/d25/d27/d6e/fac [0,4194304] 0 2024-09-17T01:52:23.071 INFO:tasks.workunit.client.1.smithi092.stdout:7/925: truncate d3/d6/d13/d21/d2e/d6e/f86 3017098 0 2024-09-17T01:52:23.074 INFO:tasks.workunit.client.1.smithi092.stdout:5/823: dread d0/de/d19/d1a/d1e/f1d [0,4194304] 0 2024-09-17T01:52:23.075 INFO:tasks.workunit.client.1.smithi092.stdout:5/824: stat d0/de/d19/d1a/d1e/f1d 0 2024-09-17T01:52:23.077 INFO:tasks.workunit.client.1.smithi092.stdout:8/862: symlink d15/d25/d27/d6e/d76/d83/d98/l117 0 2024-09-17T01:52:23.078 INFO:tasks.workunit.client.1.smithi092.stdout:9/933: dread - d0/d7/d12/d98/dc6/fd7 zero size 2024-09-17T01:52:23.079 INFO:tasks.workunit.client.1.smithi092.stdout:6/940: creat d3/d10/d1f/d21/da5/d18/df9/d49/d112/f124 x:0 0 0 2024-09-17T01:52:23.081 INFO:tasks.workunit.client.1.smithi092.stdout:0/874: getdents d3/d2e 0 2024-09-17T01:52:23.081 INFO:tasks.workunit.client.1.smithi092.stdout:6/941: dread d3/d10/d1f/d21/d1e/fd4 [0,4194304] 0 2024-09-17T01:52:23.083 INFO:tasks.workunit.client.1.smithi092.stdout:2/886: write d10/d8d/f76 [3687001,101601] 0 2024-09-17T01:52:23.084 INFO:tasks.workunit.client.1.smithi092.stdout:3/980: truncate d4/d2f/d44/d3c/f90 1834065 0 2024-09-17T01:52:23.086 INFO:tasks.workunit.client.1.smithi092.stdout:8/863: write d15/f1d [198024,98043] 0 2024-09-17T01:52:23.086 INFO:tasks.workunit.client.1.smithi092.stdout:9/934: symlink d0/d7/d12/d86/d93/l11a 0 2024-09-17T01:52:23.089 INFO:tasks.workunit.client.1.smithi092.stdout:0/875: rmdir d3/d2e/d3b/d48/d76 39 2024-09-17T01:52:23.091 INFO:tasks.workunit.client.1.smithi092.stdout:7/926: truncate d3/db/f4a 2436260 0 2024-09-17T01:52:23.092 INFO:tasks.workunit.client.1.smithi092.stdout:2/887: mkdir d10/d4c/d80/d95/dc6/d126 0 2024-09-17T01:52:23.093 INFO:tasks.workunit.client.1.smithi092.stdout:3/981: creat d4/d73/d8f/d9e/f134 x:0 0 0 2024-09-17T01:52:23.095 INFO:tasks.workunit.client.1.smithi092.stdout:9/935: mkdir d0/df/d17/d9d/d11b 0 2024-09-17T01:52:23.101 INFO:tasks.workunit.client.1.smithi092.stdout:7/927: dwrite d3/d6/dc2/dc5/f11d [0,4194304] 0 2024-09-17T01:52:23.103 INFO:tasks.workunit.client.1.smithi092.stdout:6/942: fsync d3/d10/d1f/d21/f65 0 2024-09-17T01:52:23.107 INFO:tasks.workunit.client.1.smithi092.stdout:6/943: readlink d3/d10/d1f/d21/l58 0 2024-09-17T01:52:23.107 INFO:tasks.workunit.client.1.smithi092.stdout:5/825: dwrite d0/de/d19/d1a/d1e/d29/f7c [0,4194304] 0 2024-09-17T01:52:23.111 INFO:tasks.workunit.client.1.smithi092.stdout:3/982: mkdir d4/d2f/d44/d54/dda/d135 0 2024-09-17T01:52:23.111 INFO:tasks.workunit.client.1.smithi092.stdout:9/936: creat d0/d7c/da9/f11c x:0 0 0 2024-09-17T01:52:23.119 INFO:tasks.workunit.client.1.smithi092.stdout:6/944: unlink d3/d10/d1f/d21/da5/d18/d11b/cb0 0 2024-09-17T01:52:23.119 INFO:tasks.workunit.client.1.smithi092.stdout:8/864: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/d43/f88 [0,4194304] 0 2024-09-17T01:52:23.122 INFO:tasks.workunit.client.1.smithi092.stdout:0/876: dread d3/d2e/d3b/fe8 [0,4194304] 0 2024-09-17T01:52:23.124 INFO:tasks.workunit.client.1.smithi092.stdout:5/826: dwrite d0/d50/da5/fae [0,4194304] 0 2024-09-17T01:52:23.129 INFO:tasks.workunit.client.1.smithi092.stdout:9/937: mkdir d0/df/d17/de3/d11d 0 2024-09-17T01:52:23.129 INFO:tasks.workunit.client.1.smithi092.stdout:5/827: truncate d0/d50/d70/f81 4207352 0 2024-09-17T01:52:23.132 INFO:tasks.workunit.client.1.smithi092.stdout:8/865: dwrite f7 [0,4194304] 0 2024-09-17T01:52:23.135 INFO:tasks.workunit.client.1.smithi092.stdout:7/928: rename d3/db/d26/d65/ff8 to d3/db/d26/d83/f138 0 2024-09-17T01:52:23.136 INFO:tasks.workunit.client.1.smithi092.stdout:0/877: mkdir d3/da/d15/d10d 0 2024-09-17T01:52:23.138 INFO:tasks.workunit.client.1.smithi092.stdout:6/945: creat d3/d10/d1f/d21/d28/d2b/f125 x:0 0 0 2024-09-17T01:52:23.143 INFO:tasks.workunit.client.1.smithi092.stdout:6/946: read d3/d10/d1f/d21/f7c [2068236,51816] 0 2024-09-17T01:52:23.146 INFO:tasks.workunit.client.1.smithi092.stdout:3/983: dread d4/d16/f80 [0,4194304] 0 2024-09-17T01:52:23.146 INFO:tasks.workunit.client.1.smithi092.stdout:8/866: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/f55 [0,4194304] 0 2024-09-17T01:52:23.147 INFO:tasks.workunit.client.1.smithi092.stdout:7/929: dwrite d3/d2b/d3a/f3e [4194304,4194304] 0 2024-09-17T01:52:23.153 INFO:tasks.workunit.client.1.smithi092.stdout:3/984: creat d4/d73/dba/f136 x:0 0 0 2024-09-17T01:52:23.158 INFO:tasks.workunit.client.1.smithi092.stdout:8/867: symlink d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/d9a/l118 0 2024-09-17T01:52:23.158 INFO:tasks.workunit.client.1.smithi092.stdout:3/985: stat d4/d13/d2e/d5f 0 2024-09-17T01:52:23.158 INFO:tasks.workunit.client.1.smithi092.stdout:6/947: dwrite d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/ffd [0,4194304] 0 2024-09-17T01:52:23.160 INFO:tasks.workunit.client.1.smithi092.stdout:6/948: chown d3/fa 134 1 2024-09-17T01:52:23.164 INFO:tasks.workunit.client.1.smithi092.stdout:6/949: write d3/d10/d1f/d21/d28/f2f [4125363,14213] 0 2024-09-17T01:52:23.165 INFO:tasks.workunit.client.1.smithi092.stdout:8/868: write d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/da1/f84 [3839566,126018] 0 2024-09-17T01:52:23.168 INFO:tasks.workunit.client.1.smithi092.stdout:3/986: dwrite d4/d16/d1b/daf/f106 [0,4194304] 0 2024-09-17T01:52:23.170 INFO:tasks.workunit.client.1.smithi092.stdout:8/869: stat d15/d25/d27/d6e/d95/dda/d3b/f7e 0 2024-09-17T01:52:23.171 INFO:tasks.workunit.client.1.smithi092.stdout:6/950: write d3/d10/d1f/d21/d28/fbd [3179827,98737] 0 2024-09-17T01:52:23.173 INFO:tasks.workunit.client.1.smithi092.stdout:0/878: dwrite d3/d2e/d55/f6a [4194304,4194304] 0 2024-09-17T01:52:23.175 INFO:tasks.workunit.client.1.smithi092.stdout:3/987: write d4/d2f/f9a [840267,15020] 0 2024-09-17T01:52:23.176 INFO:tasks.workunit.client.1.smithi092.stdout:5/828: write d0/de/d19/d1a/d1e/d74/dc8/dd5/f4b [656312,37479] 0 2024-09-17T01:52:23.179 INFO:tasks.workunit.client.1.smithi092.stdout:3/988: chown d4/d20/d31/c6b 104325 1 2024-09-17T01:52:23.184 INFO:tasks.workunit.client.1.smithi092.stdout:8/870: creat d15/d25/d27/d6e/d95/dda/d3b/d78/d9b/d109/f119 x:0 0 0 2024-09-17T01:52:23.186 INFO:tasks.workunit.client.1.smithi092.stdout:0/879: chown d3/dc8/dd2/ddb 56 1 2024-09-17T01:52:23.187 INFO:tasks.workunit.client.1.smithi092.stdout:7/930: dwrite d3/d6/d13/d21/d2e/d6e/fc4 [4194304,4194304] 0 2024-09-17T01:52:23.188 INFO:tasks.workunit.client.1.smithi092.stdout:5/829: mknod d0/d7e/d90/c11c 0 2024-09-17T01:52:23.191 INFO:tasks.workunit.client.1.smithi092.stdout:3/989: dread d4/d73/d8f/d92/fa0 [0,4194304] 0 2024-09-17T01:52:23.192 INFO:tasks.workunit.client.1.smithi092.stdout:6/951: truncate d3/d10/d1f/d21/da5/d18/df9/d43/d5e/d73/d8f/f10d 732852 0 2024-09-17T01:52:23.193 INFO:tasks.workunit.client.1.smithi092.stdout:0/880: truncate d3/d2e/d55/ff1 1013933 0 2024-09-17T01:52:23.193 INFO:tasks.workunit.client.1.smithi092.stdout:6/952: chown d3/d10/f57 0 1 2024-09-17T01:52:23.194 INFO:tasks.workunit.client.1.smithi092.stdout:7/931: rename d3/db/d98/l9e to d3/db/d98/dce/d6a/l139 0 2024-09-17T01:52:23.195 INFO:tasks.workunit.client.1.smithi092.stdout:5/830: symlink d0/de/d19/d3c/l11d 0 2024-09-17T01:52:23.196 INFO:tasks.workunit.client.1.smithi092.stdout:8/871: creat d15/d25/d27/d87/f11a x:0 0 0 2024-09-17T01:52:23.199 INFO:tasks.workunit.client.1.smithi092.stdout:0/881: rename d3/dee/d7d/dfb/d3a/f66 to d3/d2e/d3b/da7/f10e 0 2024-09-17T01:52:23.200 INFO:tasks.workunit.client.1.smithi092.stdout:0/882: write d3/dc8/f6e [3859881,78264] 0 2024-09-17T01:52:23.202 INFO:tasks.workunit.client.1.smithi092.stdout:5/831: rename d0/de to d0/de/d19/d1a/d1e/d11e 22 2024-09-17T01:52:23.202 INFO:tasks.workunit.client.1.smithi092.stdout:6/953: dread d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/ffd [0,4194304] 0 2024-09-17T01:52:23.203 INFO:tasks.workunit.client.1.smithi092.stdout:8/872: creat d15/d6f/d8b/d110/f11b x:0 0 0 2024-09-17T01:52:23.204 INFO:tasks.workunit.client.1.smithi092.stdout:5/832: chown d0/de/d19/d3c/d41/dec 21 1 2024-09-17T01:52:23.205 INFO:tasks.workunit.client.1.smithi092.stdout:0/883: mknod d3/d2e/d55/c10f 0 2024-09-17T01:52:23.206 INFO:tasks.workunit.client.1.smithi092.stdout:7/932: creat d3/d6/d13/d21/f13a x:0 0 0 2024-09-17T01:52:23.209 INFO:tasks.workunit.client.1.smithi092.stdout:0/884: readlink d3/d2e/d3b/d48/d76/l85 0 2024-09-17T01:52:23.209 INFO:tasks.workunit.client.1.smithi092.stdout:8/873: symlink d15/d25/d27/d6e/de0/l11c 0 2024-09-17T01:52:23.211 INFO:tasks.workunit.client.1.smithi092.stdout:6/954: creat d3/f126 x:0 0 0 2024-09-17T01:52:23.211 INFO:tasks.workunit.client.1.smithi092.stdout:0/885: chown d3/dee/d7d/leb 0 1 2024-09-17T01:52:23.213 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:23 smithi031 ceph-mon[27673]: Reconfiguring prometheus.smithi031 (dependencies changed)... 2024-09-17T01:52:23.213 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:23 smithi031 ceph-mon[27673]: Reconfiguring daemon prometheus.smithi031 on smithi031 2024-09-17T01:52:23.213 INFO:tasks.workunit.client.1.smithi092.stdout:8/874: fsync d15/d25/d2b/d63/fe1 0 2024-09-17T01:52:23.213 INFO:tasks.workunit.client.1.smithi092.stdout:5/833: dread d0/de/d19/d1a/f7b [0,4194304] 0 2024-09-17T01:52:23.216 INFO:tasks.workunit.client.1.smithi092.stdout:7/933: dwrite d3/d6/f130 [0,4194304] 0 2024-09-17T01:52:23.221 INFO:tasks.workunit.client.1.smithi092.stdout:0/886: creat d3/d2e/d3b/d8f/d5f/db1/dd8/d6b/f110 x:0 0 0 2024-09-17T01:52:23.221 INFO:tasks.workunit.client.1.smithi092.stdout:5/834: creat d0/de/d19/d1a/d1e/d74/f11f x:0 0 0 2024-09-17T01:52:23.222 INFO:tasks.workunit.client.1.smithi092.stdout:7/934: readlink d3/d6/ld9 0 2024-09-17T01:52:23.223 INFO:tasks.workunit.client.1.smithi092.stdout:0/887: write d3/d73/f75 [4328343,58720] 0 2024-09-17T01:52:23.224 INFO:tasks.workunit.client.1.smithi092.stdout:5/835: stat d0/d50/d70/f81 0 2024-09-17T01:52:23.224 INFO:tasks.workunit.client.1.smithi092.stdout:6/955: dwrite d3/f44 [0,4194304] 0 2024-09-17T01:52:23.227 INFO:tasks.workunit.client.1.smithi092.stdout:8/875: rename d15/d25/d27/d6e/d95/dda/d3b to d15/d25/d27/d6e/d95/dfb/d11d 0 2024-09-17T01:52:23.234 INFO:tasks.workunit.client.1.smithi092.stdout:5/836: write d0/de/d19/d1a/d1e/f1d [1645422,42833] 0 2024-09-17T01:52:23.236 INFO:tasks.workunit.client.1.smithi092.stdout:8/876: creat d15/d25/d2b/d63/f11e x:0 0 0 2024-09-17T01:52:23.237 INFO:tasks.workunit.client.1.smithi092.stdout:6/956: dwrite d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/ff0 [0,4194304] 0 2024-09-17T01:52:23.243 INFO:tasks.workunit.client.1.smithi092.stdout:0/888: getdents d3/d2e/d3b/d8f/d5f/db1 0 2024-09-17T01:52:23.245 INFO:tasks.workunit.client.1.smithi092.stdout:8/877: link d15/d25/f68 d15/d25/d27/d6e/d95/dfb/d11d/d78/d9e/f11f 0 2024-09-17T01:52:23.246 INFO:tasks.workunit.client.1.smithi092.stdout:8/878: fsync d15/d25/d27/d49/feb 0 2024-09-17T01:52:23.248 INFO:tasks.workunit.client.1.smithi092.stdout:8/879: write d15/d25/d27/d6e/d95/dfb/d11d/f79 [964285,80982] 0 2024-09-17T01:52:23.249 INFO:tasks.workunit.client.1.smithi092.stdout:5/837: creat d0/f120 x:0 0 0 2024-09-17T01:52:23.251 INFO:tasks.workunit.client.1.smithi092.stdout:8/880: write d15/d25/d27/d6e/d95/dfb/d11d/d78/f105 [132980,69978] 0 2024-09-17T01:52:23.254 INFO:tasks.workunit.client.1.smithi092.stdout:5/838: mkdir d0/de/d121 0 2024-09-17T01:52:23.257 INFO:tasks.workunit.client.1.smithi092.stdout:6/957: write d3/d10/f57 [796536,33774] 0 2024-09-17T01:52:23.258 INFO:tasks.workunit.client.1.smithi092.stdout:8/881: read d15/d6f/d8b/f99 [2273015,15758] 0 2024-09-17T01:52:23.259 INFO:tasks.workunit.client.1.smithi092.stdout:5/839: write d0/de/d19/d1a/d1e/d74/f83 [845685,17504] 0 2024-09-17T01:52:23.259 INFO:tasks.workunit.client.1.smithi092.stdout:7/935: dwrite d3/d2b/d37/ff2 [0,4194304] 0 2024-09-17T01:52:23.264 INFO:tasks.workunit.client.1.smithi092.stdout:6/958: readlink d3/d10/d1f/d21/da5/l76 0 2024-09-17T01:52:23.264 INFO:tasks.workunit.client.1.smithi092.stdout:5/840: chown d0/d50/d70/d78 13754 1 2024-09-17T01:52:23.265 INFO:tasks.workunit.client.1.smithi092.stdout:0/889: write d3/d2e/d3b/d8f/f52 [3758847,106514] 0 2024-09-17T01:52:23.267 INFO:tasks.workunit.client.1.smithi092.stdout:8/882: symlink d15/d25/d27/d6e/d95/dda/d40/d42/d6b/l120 0 2024-09-17T01:52:23.267 INFO:tasks.workunit.client.1.smithi092.stdout:6/959: chown d3/d10/d1f/d21/d1e/d55/c61 180982 1 2024-09-17T01:52:23.268 INFO:tasks.workunit.client.1.smithi092.stdout:7/936: creat d3/d6/d13/d21/d2e/d6e/f13b x:0 0 0 2024-09-17T01:52:23.270 INFO:tasks.workunit.client.1.smithi092.stdout:7/937: write d3/d2b/d3a/f3e [1541399,13312] 0 2024-09-17T01:52:23.271 INFO:tasks.workunit.client.1.smithi092.stdout:6/960: chown d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f116 7 1 2024-09-17T01:52:23.271 INFO:tasks.workunit.client.1.smithi092.stdout:0/890: creat d3/d2e/d55/d63/d81/d9c/f111 x:0 0 0 2024-09-17T01:52:23.272 INFO:tasks.workunit.client.1.smithi092.stdout:0/891: readlink d3/dee/d7d/dfb/d3a/l4c 0 2024-09-17T01:52:23.275 INFO:tasks.workunit.client.1.smithi092.stdout:8/883: creat d15/d6f/f121 x:0 0 0 2024-09-17T01:52:23.276 INFO:tasks.workunit.client.1.smithi092.stdout:0/892: dread d3/d2e/d3b/da7/f10e [4194304,4194304] 0 2024-09-17T01:52:23.278 INFO:tasks.workunit.client.1.smithi092.stdout:5/841: truncate d0/de/d19/f89 4008553 0 2024-09-17T01:52:23.279 INFO:tasks.workunit.client.1.smithi092.stdout:7/938: dwrite d3/d6/d13/d21/d2e/d6e/f53 [4194304,4194304] 0 2024-09-17T01:52:23.279 INFO:tasks.workunit.client.1.smithi092.stdout:8/884: creat d15/d25/d2b/d3d/dc6/f122 x:0 0 0 2024-09-17T01:52:23.281 INFO:tasks.workunit.client.1.smithi092.stdout:0/893: mkdir d3/d2e/d55/d63/d81/d9c/d112 0 2024-09-17T01:52:23.282 INFO:tasks.workunit.client.1.smithi092.stdout:5/842: fdatasync d0/f6d 0 2024-09-17T01:52:23.283 INFO:tasks.workunit.client.1.smithi092.stdout:8/885: symlink d15/d25/d2b/d3d/d9f/d10e/l123 0 2024-09-17T01:52:23.285 INFO:tasks.workunit.client.1.smithi092.stdout:0/894: creat d3/d2e/d3b/da7/f113 x:0 0 0 2024-09-17T01:52:23.285 INFO:tasks.workunit.client.1.smithi092.stdout:0/895: chown d3/da/d15/dab 64053 1 2024-09-17T01:52:23.288 INFO:tasks.workunit.client.1.smithi092.stdout:8/886: dread - d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/f10f zero size 2024-09-17T01:52:23.290 INFO:tasks.workunit.client.1.smithi092.stdout:5/843: creat d0/d50/d70/df3/f122 x:0 0 0 2024-09-17T01:52:23.293 INFO:tasks.workunit.client.1.smithi092.stdout:8/887: symlink d15/d25/d27/d6e/d95/dda/d40/d42/d93/l124 0 2024-09-17T01:52:23.294 INFO:tasks.workunit.client.1.smithi092.stdout:7/939: link d3/db/d98/dce/d6a/ff7 d3/d6/dc2/ddc/df9/f13c 0 2024-09-17T01:52:23.295 INFO:tasks.workunit.client.1.smithi092.stdout:8/888: write d15/d25/d27/d6e/d95/dda/d40/d42/ffd [1600987,58358] 0 2024-09-17T01:52:23.295 INFO:tasks.workunit.client.1.smithi092.stdout:7/940: chown d3/db/d98 0 1 2024-09-17T01:52:23.297 INFO:tasks.workunit.client.1.smithi092.stdout:8/889: mkdir d15/d25/d27/d87/d125 0 2024-09-17T01:52:23.299 INFO:tasks.workunit.client.1.smithi092.stdout:8/890: write d15/d25/d27/d49/dd7/fb7 [1206244,34797] 0 2024-09-17T01:52:23.302 INFO:tasks.workunit.client.1.smithi092.stdout:8/891: stat d15/d25/d27/d6e/d76/d83/lfe 0 2024-09-17T01:52:23.303 INFO:tasks.workunit.client.1.smithi092.stdout:5/844: write d0/de/f8e [4203431,87700] 0 2024-09-17T01:52:23.306 INFO:tasks.workunit.client.1.smithi092.stdout:5/845: chown d0/de/d19/d1a/d1e/f1d 188 1 2024-09-17T01:52:23.308 INFO:tasks.workunit.client.1.smithi092.stdout:8/892: dwrite d15/d25/d2b/d63/fe1 [0,4194304] 0 2024-09-17T01:52:23.309 INFO:tasks.workunit.client.1.smithi092.stdout:5/846: creat d0/de/d19/d1a/f123 x:0 0 0 2024-09-17T01:52:23.313 INFO:tasks.workunit.client.1.smithi092.stdout:5/847: truncate d0/d50/d70/d78/d8f/f10b 5158095 0 2024-09-17T01:52:23.314 INFO:tasks.workunit.client.1.smithi092.stdout:8/893: symlink d15/d25/d27/d6e/d95/dda/d40/d42/ded/l126 0 2024-09-17T01:52:23.316 INFO:tasks.workunit.client.1.smithi092.stdout:7/941: dread d3/d6/d13/d21/d115/f119 [0,4194304] 0 2024-09-17T01:52:23.319 INFO:tasks.workunit.client.1.smithi092.stdout:7/942: truncate d3/db/d98/dce/d6a/dc8/f128 1032300 0 2024-09-17T01:52:23.320 INFO:tasks.workunit.client.1.smithi092.stdout:5/848: getdents d0/de/d19/d1a/d1e/d52/d9a/de9/d119 0 2024-09-17T01:52:23.320 INFO:tasks.workunit.client.1.smithi092.stdout:5/849: chown d0/d50/fb3 94 1 2024-09-17T01:52:23.321 INFO:tasks.workunit.client.1.smithi092.stdout:7/943: creat d3/d6/d13/d21/d2e/d6e/f13d x:0 0 0 2024-09-17T01:52:23.325 INFO:tasks.workunit.client.1.smithi092.stdout:7/944: creat d3/db/d26/d83/f13e x:0 0 0 2024-09-17T01:52:23.326 INFO:tasks.workunit.client.1.smithi092.stdout:5/850: getdents d0/d50/da5 0 2024-09-17T01:52:23.329 INFO:tasks.workunit.client.1.smithi092.stdout:5/851: symlink d0/de/d19/d1a/l124 0 2024-09-17T01:52:23.330 INFO:tasks.workunit.client.1.smithi092.stdout:8/894: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/f92 [4194304,4194304] 0 2024-09-17T01:52:23.331 INFO:tasks.workunit.client.1.smithi092.stdout:7/945: creat d3/d6/d13/d12e/f13f x:0 0 0 2024-09-17T01:52:23.331 INFO:tasks.workunit.client.1.smithi092.stdout:5/852: chown d0/de/d19/f6c 214394 1 2024-09-17T01:52:23.334 INFO:tasks.workunit.client.1.smithi092.stdout:7/946: mknod d3/db/d26/d6f/c140 0 2024-09-17T01:52:23.340 INFO:tasks.workunit.client.1.smithi092.stdout:8/895: dwrite d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/da1/f84 [0,4194304] 0 2024-09-17T01:52:23.347 INFO:tasks.workunit.client.1.smithi092.stdout:5/853: dwrite d0/de/d19/f92 [0,4194304] 0 2024-09-17T01:52:23.348 INFO:tasks.workunit.client.1.smithi092.stdout:8/896: rename d15/d25/d27/d6e/d76/d83/d98 to d15/d25/d27/d87/d125/d127 0 2024-09-17T01:52:23.348 INFO:tasks.workunit.client.1.smithi092.stdout:7/947: link d3/d6/dc2/ddc/df9/f13c d3/db/d98/dce/d60/d93/dfb/f141 0 2024-09-17T01:52:23.353 INFO:tasks.workunit.client.1.smithi092.stdout:8/897: creat d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/da1/d9a/f128 x:0 0 0 2024-09-17T01:52:23.356 INFO:tasks.workunit.client.1.smithi092.stdout:8/898: creat d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/da1/d9a/f129 x:0 0 0 2024-09-17T01:52:23.360 INFO:tasks.workunit.client.1.smithi092.stdout:8/899: link d15/d25/d2b/d3d/d9f/d8e/lb1 d15/d25/d27/d6e/d95/dda/d40/d42/d43/l12a 0 2024-09-17T01:52:23.360 INFO:tasks.workunit.client.1.smithi092.stdout:8/900: chown d15/d25/d2b/d63 42007 1 2024-09-17T01:52:23.362 INFO:tasks.workunit.client.1.smithi092.stdout:8/901: truncate d15/d25/d27/d6e/d95/dda/f50 4865262 0 2024-09-17T01:52:23.362 INFO:tasks.workunit.client.1.smithi092.stdout:8/902: chown d15/d25/d27/d49/dd7 0 1 2024-09-17T01:52:23.366 INFO:tasks.workunit.client.1.smithi092.stdout:8/903: rename d15/d6f/d8b/fbd to d15/d25/d27/d6e/f12b 0 2024-09-17T01:52:23.367 INFO:tasks.workunit.client.1.smithi092.stdout:8/904: chown d15/d25/d27/d6e/d95/dda/d40/l4e 51 1 2024-09-17T01:52:23.371 INFO:tasks.workunit.client.1.smithi092.stdout:8/905: dwrite d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/da1/d9a/fcb [0,4194304] 0 2024-09-17T01:52:23.374 INFO:tasks.workunit.client.1.smithi092.stdout:8/906: symlink d15/d25/d27/d6e/d76/d83/l12c 0 2024-09-17T01:52:23.377 INFO:tasks.workunit.client.1.smithi092.stdout:8/907: mkdir d15/d6f/d8b/d12d 0 2024-09-17T01:52:23.382 INFO:tasks.workunit.client.1.smithi092.stdout:8/908: getdents d15/d25/d27/d6e/d95/dda/d40/d42/d43/d8d 0 2024-09-17T01:52:23.383 INFO:tasks.workunit.client.1.smithi092.stdout:8/909: chown d15/d6f/l10a 174 1 2024-09-17T01:52:23.385 INFO:tasks.workunit.client.1.smithi092.stdout:8/910: symlink d15/d25/d27/d87/d125/d127/l12e 0 2024-09-17T01:52:23.386 INFO:tasks.workunit.client.1.smithi092.stdout:8/911: fdatasync d15/d25/d2b/d63/fb8 0 2024-09-17T01:52:23.387 INFO:tasks.workunit.client.1.smithi092.stdout:8/912: fsync d15/d25/d27/d6e/d95/dda/d40/d42/ffd 0 2024-09-17T01:52:23.392 INFO:tasks.workunit.client.1.smithi092.stdout:8/913: rename d15/d25/d27/d49/dd7 to d15/d25/d12f 0 2024-09-17T01:52:23.395 INFO:tasks.workunit.client.1.smithi092.stdout:8/914: rename d15/d25/d27/d6e/d95/dda/d40/l57 to d15/d25/d27/d49/l130 0 2024-09-17T01:52:23.395 INFO:tasks.workunit.client.1.smithi092.stdout:8/915: chown c10 95483326 1 2024-09-17T01:52:23.397 INFO:tasks.workunit.client.1.smithi092.stdout:8/916: mknod d15/d6f/c131 0 2024-09-17T01:52:23.400 INFO:tasks.workunit.client.1.smithi092.stdout:8/917: link d15/d25/d27/d6e/d95/dda/d40/d42/d6b/dd9/le7 d15/d25/d27/d6e/d95/dda/d40/d42/d93/df4/l132 0 2024-09-17T01:52:23.402 INFO:tasks.workunit.client.1.smithi092.stdout:8/918: creat d15/d25/d27/d6e/d95/dda/d40/d42/d43/d8d/f133 x:0 0 0 2024-09-17T01:52:23.403 INFO:tasks.workunit.client.1.smithi092.stdout:8/919: dread - d15/d25/d27/df3/ff7 zero size 2024-09-17T01:52:23.406 INFO:tasks.workunit.client.1.smithi092.stdout:8/920: truncate d15/d25/d27/d6e/d95/dfb/d11d/f5d 3778458 0 2024-09-17T01:52:23.410 INFO:tasks.workunit.client.1.smithi092.stdout:8/921: creat d15/d25/d2b/f134 x:0 0 0 2024-09-17T01:52:23.416 INFO:tasks.workunit.client.1.smithi092.stdout:8/922: dwrite d15/d25/d27/d49/f9c [0,4194304] 0 2024-09-17T01:52:23.416 INFO:tasks.workunit.client.1.smithi092.stdout:8/923: write d15/d25/d27/d6e/d95/dda/d40/d42/d6b/ff9 [4851009,53921] 0 2024-09-17T01:52:23.419 INFO:tasks.workunit.client.1.smithi092.stdout:8/924: dread d15/d25/d27/d6e/d95/dda/d40/d42/f4b [0,4194304] 0 2024-09-17T01:52:23.431 INFO:tasks.workunit.client.1.smithi092.stdout:8/925: write d15/d25/d2b/d3d/d9f/f5c [410262,52342] 0 2024-09-17T01:52:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:23 smithi092 ceph-mon[33552]: Reconfiguring prometheus.smithi031 (dependencies changed)... 2024-09-17T01:52:23.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:23 smithi092 ceph-mon[33552]: Reconfiguring daemon prometheus.smithi031 on smithi031 2024-09-17T01:52:23.587 INFO:tasks.workunit.client.1.smithi092.stdout:9/938: sync 2024-09-17T01:52:23.587 INFO:tasks.workunit.client.1.smithi092.stdout:2/888: sync 2024-09-17T01:52:23.588 INFO:tasks.workunit.client.1.smithi092.stdout:9/939: fdatasync d0/d7/d12/d34/d26/feb 0 2024-09-17T01:52:23.590 INFO:tasks.workunit.client.1.smithi092.stdout:2/889: mknod d10/d55/dda/da3/dbd/d124/c127 0 2024-09-17T01:52:23.594 INFO:tasks.workunit.client.1.smithi092.stdout:2/890: link d10/d1d/d24/d6e/c75 d10/d8d/d9e/dfd/d10b/c128 0 2024-09-17T01:52:23.595 INFO:tasks.workunit.client.1.smithi092.stdout:2/891: write d10/d8d/f76 [4254183,44785] 0 2024-09-17T01:52:23.595 INFO:tasks.workunit.client.1.smithi092.stdout:2/892: chown d10/d1d/d2c/l51 5675395 1 2024-09-17T01:52:23.596 INFO:tasks.workunit.client.1.smithi092.stdout:2/893: dread - d10/d55/dda/f101 zero size 2024-09-17T01:52:23.599 INFO:tasks.workunit.client.1.smithi092.stdout:2/894: getdents d10/d4c/d80/d95/dc6/d11e 0 2024-09-17T01:52:23.601 INFO:tasks.workunit.client.1.smithi092.stdout:2/895: mknod d10/d54/c129 0 2024-09-17T01:52:23.618 INFO:tasks.workunit.client.1.smithi092.stdout:2/896: write d10/d3a/f3f [3291803,16690] 0 2024-09-17T01:52:23.620 INFO:tasks.workunit.client.1.smithi092.stdout:9/940: dwrite d0/d7/d12/fde [0,4194304] 0 2024-09-17T01:52:23.621 INFO:tasks.workunit.client.1.smithi092.stdout:2/897: write d10/d1d/d2c/d56/f60 [3097990,41527] 0 2024-09-17T01:52:23.622 INFO:tasks.workunit.client.1.smithi092.stdout:9/941: write d0/d7c/da9/f11c [875334,17593] 0 2024-09-17T01:52:23.634 INFO:tasks.workunit.client.1.smithi092.stdout:2/898: write d10/d1d/d96/d77/d9c/fd7 [3715094,127555] 0 2024-09-17T01:52:23.639 INFO:tasks.workunit.client.1.smithi092.stdout:9/942: dwrite d0/d7/d12/d34/fad [0,4194304] 0 2024-09-17T01:52:23.641 INFO:tasks.workunit.client.1.smithi092.stdout:9/943: getdents d0/d7/de5 0 2024-09-17T01:52:23.648 INFO:tasks.workunit.client.1.smithi092.stdout:9/944: dwrite d0/d5/f45 [0,4194304] 0 2024-09-17T01:52:23.649 INFO:tasks.workunit.client.1.smithi092.stdout:9/945: chown d0/df/l53 1 1 2024-09-17T01:52:23.652 INFO:tasks.workunit.client.1.smithi092.stdout:9/946: readlink d0/d7/lc 0 2024-09-17T01:52:23.654 INFO:tasks.workunit.client.1.smithi092.stdout:9/947: rename d0/d5 to d0/d7c/dbd/ddd/d11e 0 2024-09-17T01:52:23.656 INFO:tasks.workunit.client.1.smithi092.stdout:9/948: write d0/d7/d12/d86/fbb [167639,120584] 0 2024-09-17T01:52:23.659 INFO:tasks.workunit.client.1.smithi092.stdout:9/949: read d0/d7/d21/f75 [306161,114571] 0 2024-09-17T01:52:23.660 INFO:tasks.workunit.client.1.smithi092.stdout:9/950: fdatasync d0/d7/d12/d86/d93/d96/f8d 0 2024-09-17T01:52:23.662 INFO:tasks.workunit.client.1.smithi092.stdout:9/951: symlink d0/d7/d12/d34/l11f 0 2024-09-17T01:52:23.663 INFO:tasks.workunit.client.1.smithi092.stdout:9/952: dread - d0/d7/d12/d86/f105 zero size 2024-09-17T01:52:23.664 INFO:tasks.workunit.client.1.smithi092.stdout:9/953: chown d0/d7/d12/d34/d26/d54/d6b/f92 0 1 2024-09-17T01:52:23.669 INFO:tasks.workunit.client.1.smithi092.stdout:9/954: truncate d0/f6 9576035 0 2024-09-17T01:52:23.674 INFO:tasks.workunit.client.1.smithi092.stdout:9/955: write d0/d7/d12/d34/d26/d54/d6b/dc4/fd1 [926627,96169] 0 2024-09-17T01:52:23.676 INFO:tasks.workunit.client.1.smithi092.stdout:9/956: fdatasync d0/d7/d21/f75 0 2024-09-17T01:52:23.678 INFO:tasks.workunit.client.1.smithi092.stdout:9/957: mknod d0/d7/d12/c120 0 2024-09-17T01:52:23.679 INFO:tasks.workunit.client.1.smithi092.stdout:3/990: sync 2024-09-17T01:52:23.679 INFO:tasks.workunit.client.1.smithi092.stdout:6/961: sync 2024-09-17T01:52:23.681 INFO:tasks.workunit.client.1.smithi092.stdout:6/962: chown d3/d10/d1f/d21/d1e/d55/c121 702 1 2024-09-17T01:52:23.682 INFO:tasks.workunit.client.1.smithi092.stdout:6/963: truncate d3/f126 1000329 0 2024-09-17T01:52:23.682 INFO:tasks.workunit.client.1.smithi092.stdout:9/958: creat d0/d7/d12/d34/d26/d54/d6b/f121 x:0 0 0 2024-09-17T01:52:23.683 INFO:tasks.workunit.client.1.smithi092.stdout:9/959: fdatasync d0/d7c/dbd/ddd/d11e/d29/f10a 0 2024-09-17T01:52:23.684 INFO:tasks.workunit.client.1.smithi092.stdout:9/960: dread - d0/d7/d12/d86/fc8 zero size 2024-09-17T01:52:23.686 INFO:tasks.workunit.client.1.smithi092.stdout:9/961: write d0/d7/d12/d34/d26/d54/fa0 [4494045,86600] 0 2024-09-17T01:52:23.689 INFO:tasks.workunit.client.1.smithi092.stdout:6/964: dwrite d3/d10/d1f/d21/da5/d18/df9/d43/d6a/f116 [0,4194304] 0 2024-09-17T01:52:23.690 INFO:tasks.workunit.client.1.smithi092.stdout:9/962: symlink d0/df/d17/d9d/d11b/l122 0 2024-09-17T01:52:23.695 INFO:tasks.workunit.client.1.smithi092.stdout:9/963: mkdir d0/d7c/dbd/d123 0 2024-09-17T01:52:23.696 INFO:tasks.workunit.client.1.smithi092.stdout:9/964: read d0/d7/d12/d86/fbb [1642984,48524] 0 2024-09-17T01:52:23.698 INFO:tasks.workunit.client.1.smithi092.stdout:9/965: mknod d0/df/d17/d9d/c124 0 2024-09-17T01:52:23.699 INFO:tasks.workunit.client.1.smithi092.stdout:9/966: readlink d0/d7c/dbd/lc0 0 2024-09-17T01:52:23.700 INFO:tasks.workunit.client.1.smithi092.stdout:9/967: write d0/d7/d12/d34/fc5 [2131987,35848] 0 2024-09-17T01:52:23.701 INFO:tasks.workunit.client.1.smithi092.stdout:9/968: stat d0/d7/d12/d34/fc5 0 2024-09-17T01:52:23.701 INFO:tasks.workunit.client.1.smithi092.stdout:9/969: fdatasync d0/d7c/f8e 0 2024-09-17T01:52:23.704 INFO:tasks.workunit.client.1.smithi092.stdout:9/970: link d0/d7/d12/d86/d93/d96/fb3 d0/d7c/f125 0 2024-09-17T01:52:23.706 INFO:tasks.workunit.client.1.smithi092.stdout:9/971: getdents d0/d7/d12/d86/d93 0 2024-09-17T01:52:23.719 INFO:tasks.workunit.client.1.smithi092.stdout:9/972: dread d0/d7c/da9/fe8 [0,4194304] 0 2024-09-17T01:52:23.720 INFO:tasks.workunit.client.1.smithi092.stdout:9/973: write d0/d7c/dbd/ddd/d11e/d29/f10a [477026,21457] 0 2024-09-17T01:52:23.722 INFO:tasks.workunit.client.1.smithi092.stdout:9/974: symlink d0/df/d17/de3/l126 0 2024-09-17T01:52:23.723 INFO:tasks.workunit.client.1.smithi092.stdout:9/975: chown d0/d7/d12/d34/d26/l48 141469237 1 2024-09-17T01:52:23.725 INFO:tasks.workunit.client.1.smithi092.stdout:9/976: unlink d0/d7/d12/d34/d26/d54/f24 0 2024-09-17T01:52:23.734 INFO:tasks.workunit.client.1.smithi092.stdout:9/977: dread d0/d7/d12/d34/d26/f90 [0,4194304] 0 2024-09-17T01:52:23.735 INFO:tasks.workunit.client.1.smithi092.stdout:9/978: chown d0/d7/d12/d34/d26/d54/d6b/c10e 5820 1 2024-09-17T01:52:23.737 INFO:tasks.workunit.client.1.smithi092.stdout:9/979: unlink d0/d7/d21/cdb 0 2024-09-17T01:52:23.738 INFO:tasks.workunit.client.1.smithi092.stdout:9/980: stat d0/d7c/dbd/ddd/d11e/d29/f91 0 2024-09-17T01:52:23.767 INFO:tasks.workunit.client.1.smithi092.stdout:6/965: truncate d3/d10/d1f/d21/d28/f2f 2042051 0 2024-09-17T01:52:23.767 INFO:tasks.workunit.client.1.smithi092.stdout:6/966: chown d3/d25/da8/fb1 12075 1 2024-09-17T01:52:23.769 INFO:tasks.workunit.client.1.smithi092.stdout:6/967: fsync d3/fdb 0 2024-09-17T01:52:23.771 INFO:tasks.workunit.client.1.smithi092.stdout:6/968: chown d3/d10/d1f/d21/da5/d18/df9/d49/d112/f124 1 1 2024-09-17T01:52:23.776 INFO:tasks.workunit.client.1.smithi092.stdout:6/969: dread d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/fbb [0,4194304] 0 2024-09-17T01:52:23.789 INFO:tasks.workunit.client.1.smithi092.stdout:6/970: dread d3/d70/fe5 [0,4194304] 0 2024-09-17T01:52:23.791 INFO:tasks.workunit.client.1.smithi092.stdout:6/971: creat d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/f127 x:0 0 0 2024-09-17T01:52:23.793 INFO:tasks.workunit.client.1.smithi092.stdout:6/972: creat d3/d10/d1f/d21/da5/d18/df9/d43/d5e/da1/f128 x:0 0 0 2024-09-17T01:52:23.795 INFO:tasks.workunit.client.1.smithi092.stdout:6/973: creat d3/d10/d1f/d21/da5/d18/df9/d105/f129 x:0 0 0 2024-09-17T01:52:23.797 INFO:tasks.workunit.client.1.smithi092.stdout:6/974: creat d3/d10/d1f/d21/da5/d18/df9/d43/f12a x:0 0 0 2024-09-17T01:52:23.797 INFO:tasks.workunit.client.1.smithi092.stdout:6/975: rmdir d3/d10/d1f/d21 39 2024-09-17T01:52:23.839 INFO:tasks.workunit.client.1.smithi092.stdout:0/896: sync 2024-09-17T01:52:23.839 INFO:tasks.workunit.client.1.smithi092.stdout:0/897: chown d3/da/fd3 35993 1 2024-09-17T01:52:23.852 INFO:tasks.workunit.client.1.smithi092.stdout:6/976: mknod d3/d10/d1f/d21/d28/d2b/c12b 0 2024-09-17T01:52:23.855 INFO:tasks.workunit.client.1.smithi092.stdout:6/977: truncate d3/d10/d1f/d21/da5/d18/d11b/f114 291956 0 2024-09-17T01:52:23.855 INFO:tasks.workunit.client.1.smithi092.stdout:0/898: link d3/le d3/dee/d7d/dfb/d10c/l114 0 2024-09-17T01:52:23.858 INFO:tasks.workunit.client.1.smithi092.stdout:6/978: creat d3/d10/d1f/d21/da5/d18/df9/d43/f12c x:0 0 0 2024-09-17T01:52:23.861 INFO:tasks.workunit.client.1.smithi092.stdout:6/979: creat d3/d10/d1f/d21/da5/d18/f12d x:0 0 0 2024-09-17T01:52:23.862 INFO:tasks.workunit.client.1.smithi092.stdout:0/899: getdents d3/d2e/d55/d63/d81 0 2024-09-17T01:52:23.868 INFO:tasks.workunit.client.1.smithi092.stdout:6/980: mkdir d3/d10/d1f/d21/d28/d2b/d12e 0 2024-09-17T01:52:23.869 INFO:tasks.workunit.client.1.smithi092.stdout:0/900: symlink d3/da/d15/d10d/l115 0 2024-09-17T01:52:23.869 INFO:tasks.workunit.client.1.smithi092.stdout:6/981: chown d3/d10/d1f/d21/d28/fc7 6335 1 2024-09-17T01:52:23.872 INFO:tasks.workunit.client.1.smithi092.stdout:6/982: truncate d3/d8e/f108 2103850 0 2024-09-17T01:52:23.873 INFO:tasks.workunit.client.1.smithi092.stdout:0/901: truncate d3/d2e/d55/f108 452580 0 2024-09-17T01:52:23.877 INFO:tasks.workunit.client.1.smithi092.stdout:0/902: getdents d3/da 0 2024-09-17T01:52:23.879 INFO:tasks.workunit.client.1.smithi092.stdout:6/983: dwrite d3/f44 [0,4194304] 0 2024-09-17T01:52:23.883 INFO:tasks.workunit.client.1.smithi092.stdout:0/903: rename d3/d2e/d3b/d8f/d5f/db1/dd8/d6b to d3/dee/d116 0 2024-09-17T01:52:23.885 INFO:tasks.workunit.client.1.smithi092.stdout:0/904: write d3/da/fb [573370,92071] 0 2024-09-17T01:52:23.885 INFO:tasks.workunit.client.1.smithi092.stdout:6/984: fdatasync d3/f33 0 2024-09-17T01:52:23.886 INFO:tasks.workunit.client.1.smithi092.stdout:6/985: fsync d3/f6 0 2024-09-17T01:52:23.888 INFO:tasks.workunit.client.1.smithi092.stdout:0/905: mkdir d3/d2e/d55/d63/d81/d9c/d112/d117 0 2024-09-17T01:52:23.893 INFO:tasks.workunit.client.1.smithi092.stdout:6/986: dread d3/d10/d1f/d21/d28/d2b/fdc [0,4194304] 0 2024-09-17T01:52:23.895 INFO:tasks.workunit.client.1.smithi092.stdout:6/987: creat d3/d10/d1f/d21/da5/d18/df9/d43/d6a/d3d/d72/d122/f12f x:0 0 0 2024-09-17T01:52:23.902 INFO:tasks.workunit.client.1.smithi092.stdout:6/988: getdents d3/d25/df2 0 2024-09-17T01:52:23.907 INFO:tasks.workunit.client.1.smithi092.stdout:0/906: dread d3/da/d15/d30/f41 [0,4194304] 0 2024-09-17T01:52:23.910 INFO:tasks.workunit.client.1.smithi092.stdout:6/989: dwrite d3/d10/d1f/f30 [0,4194304] 0 2024-09-17T01:52:23.911 INFO:tasks.workunit.client.1.smithi092.stdout:6/990: read - d3/ffa zero size 2024-09-17T01:52:23.916 INFO:tasks.workunit.client.1.smithi092.stdout:0/907: link d3/dee/d7d/dfb/c3f d3/da/c118 0 2024-09-17T01:52:23.917 INFO:tasks.workunit.client.1.smithi092.stdout:0/908: stat d3/d2e/d3b/da7 0 2024-09-17T01:52:23.917 INFO:tasks.workunit.client.1.smithi092.stdout:0/909: chown d3/dc8/fb4 1159 1 2024-09-17T01:52:23.923 INFO:tasks.workunit.client.1.smithi092.stdout:6/991: dwrite d3/d10/d1f/d21/fda [0,4194304] 0 2024-09-17T01:52:23.927 INFO:tasks.workunit.client.1.smithi092.stdout:6/992: readlink d3/d70/l106 0 2024-09-17T01:52:23.932 INFO:tasks.workunit.client.1.smithi092.stdout:6/993: link d3/d10/d1f/f52 d3/f130 0 2024-09-17T01:52:23.933 INFO:tasks.workunit.client.1.smithi092.stdout:0/910: dread d3/d2e/d3b/d8f/fb6 [0,4194304] 0 2024-09-17T01:52:23.934 INFO:tasks.workunit.client.1.smithi092.stdout:6/994: creat d3/d10/d1f/d21/da5/d18/df9/d43/d5e/da1/f131 x:0 0 0 2024-09-17T01:52:23.937 INFO:tasks.workunit.client.1.smithi092.stdout:6/995: fsync d3/d10/d1f/d21/d28/f2f 0 2024-09-17T01:52:23.941 INFO:tasks.workunit.client.1.smithi092.stdout:0/911: write d3/d2e/d3b/d72/fbe [464222,76450] 0 2024-09-17T01:52:23.944 INFO:tasks.workunit.client.1.smithi092.stdout:6/996: dwrite d3/d70/fe1 [0,4194304] 0 2024-09-17T01:52:23.946 INFO:tasks.workunit.client.1.smithi092.stdout:6/997: mkdir d3/d8e/d132 0 2024-09-17T01:52:23.949 INFO:tasks.workunit.client.1.smithi092.stdout:6/998: creat d3/d10/d1f/d21/d28/d2b/d12e/f133 x:0 0 0 2024-09-17T01:52:23.950 INFO:tasks.workunit.client.1.smithi092.stdout:6/999: stat d3/d10/d1f/d21/d1e/d55/c6d 0 2024-09-17T01:52:23.953 INFO:tasks.workunit.client.1.smithi092.stdout:0/912: dread d3/d2e/d55/d63/d81/fac [0,4194304] 0 2024-09-17T01:52:23.955 INFO:tasks.workunit.client.1.smithi092.stdout:0/913: getdents d3/d2e/d3b/d48/d76 0 2024-09-17T01:52:23.957 INFO:tasks.workunit.client.1.smithi092.stdout:0/914: creat d3/d2e/d3b/d8f/f119 x:0 0 0 2024-09-17T01:52:23.959 INFO:tasks.workunit.client.1.smithi092.stdout:0/915: truncate d3/d73/fbb 189187 0 2024-09-17T01:52:23.972 INFO:tasks.workunit.client.1.smithi092.stdout:0/916: dread d3/f28 [0,4194304] 0 2024-09-17T01:52:23.975 INFO:tasks.workunit.client.1.smithi092.stdout:0/917: mknod d3/da/d15/d10d/c11a 0 2024-09-17T01:52:23.978 INFO:tasks.workunit.client.1.smithi092.stdout:0/918: creat d3/dc8/f11b x:0 0 0 2024-09-17T01:52:23.984 INFO:tasks.workunit.client.1.smithi092.stdout:0/919: write d3/d2e/d3b/d8f/fbf [789050,60570] 0 2024-09-17T01:52:23.988 INFO:tasks.workunit.client.1.smithi092.stdout:0/920: dread d3/d2e/d3b/fb9 [0,4194304] 0 2024-09-17T01:52:23.990 INFO:tasks.workunit.client.1.smithi092.stdout:0/921: fsync d3/dee/d7d/dfb/f45 0 2024-09-17T01:52:23.992 INFO:tasks.workunit.client.1.smithi092.stdout:0/922: creat d3/dee/d7d/dfb/d3a/f11c x:0 0 0 2024-09-17T01:52:23.993 INFO:tasks.workunit.client.1.smithi092.stdout:0/923: write d3/dc8/fa1 [73902,71584] 0 2024-09-17T01:52:23.994 INFO:tasks.workunit.client.1.smithi092.stdout:0/924: write d3/dee/d7d/fda [81728,124626] 0 2024-09-17T01:52:23.998 INFO:tasks.workunit.client.1.smithi092.stdout:0/925: unlink d3/da/fa2 0 2024-09-17T01:52:23.999 INFO:tasks.workunit.client.1.smithi092.stdout:0/926: symlink d3/d2e/d3b/d72/l11d 0 2024-09-17T01:52:24.000 INFO:tasks.workunit.client.1.smithi092.stdout:0/927: write d3/dee/d7d/dfb/f7b [939955,66974] 0 2024-09-17T01:52:24.002 INFO:tasks.workunit.client.1.smithi092.stdout:5/854: sync 2024-09-17T01:52:24.003 INFO:tasks.workunit.client.1.smithi092.stdout:0/928: mkdir d3/d2e/d3b/d48/d11e 0 2024-09-17T01:52:24.006 INFO:tasks.workunit.client.1.smithi092.stdout:5/855: mknod d0/de/d19/d1a/d1e/c125 0 2024-09-17T01:52:24.008 INFO:tasks.workunit.client.1.smithi092.stdout:5/856: creat d0/de/d19/d3c/d41/d8d/f126 x:0 0 0 2024-09-17T01:52:24.008 INFO:tasks.workunit.client.1.smithi092.stdout:0/929: write d3/dee/f54 [4185676,38301] 0 2024-09-17T01:52:24.012 INFO:tasks.workunit.client.1.smithi092.stdout:0/930: rename d3/da/d15/d30/cc4 to d3/dee/c11f 0 2024-09-17T01:52:24.014 INFO:tasks.workunit.client.1.smithi092.stdout:0/931: fsync d3/d2e/d3b/d48/fc6 0 2024-09-17T01:52:24.018 INFO:tasks.workunit.client.1.smithi092.stdout:5/857: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:24.021 INFO:tasks.workunit.client.1.smithi092.stdout:5/858: mkdir d0/de/d19/d1a/d1e/d52/d9a/de9/d127 0 2024-09-17T01:52:24.032 INFO:tasks.workunit.client.1.smithi092.stdout:5/859: dwrite d0/de/d19/d3c/d41/f73 [0,4194304] 0 2024-09-17T01:52:24.032 INFO:tasks.workunit.client.1.smithi092.stdout:0/932: dread d3/dc8/f6e [0,4194304] 0 2024-09-17T01:52:24.033 INFO:tasks.workunit.client.1.smithi092.stdout:5/860: chown d0/d50/d70/d78/d8f/fa4 18106539 1 2024-09-17T01:52:24.035 INFO:tasks.workunit.client.1.smithi092.stdout:7/948: sync 2024-09-17T01:52:24.035 INFO:tasks.workunit.client.1.smithi092.stdout:8/926: sync 2024-09-17T01:52:24.036 INFO:tasks.workunit.client.1.smithi092.stdout:8/927: chown d15/d25/d12f 463486 1 2024-09-17T01:52:24.037 INFO:tasks.workunit.client.1.smithi092.stdout:5/861: write d0/d23/f4d [2913651,13102] 0 2024-09-17T01:52:24.038 INFO:tasks.workunit.client.1.smithi092.stdout:0/933: rmdir d3/dee/d116/dad/df8 0 2024-09-17T01:52:24.041 INFO:tasks.workunit.client.1.smithi092.stdout:5/862: chown d0/de/d19/d1a/d1e/d3e/d4c/l56 3 1 2024-09-17T01:52:24.043 INFO:tasks.workunit.client.1.smithi092.stdout:5/863: chown d0/d50/d70/d78/d8f/f10b 3325 1 2024-09-17T01:52:24.043 INFO:tasks.workunit.client.1.smithi092.stdout:7/949: dwrite d3/db/d98/dce/daf/f117 [0,4194304] 0 2024-09-17T01:52:24.044 INFO:tasks.workunit.client.1.smithi092.stdout:5/864: chown d0/de/d19/d3c/cd0 6000810 1 2024-09-17T01:52:24.047 INFO:tasks.workunit.client.1.smithi092.stdout:7/950: creat d3/db/d7b/f142 x:0 0 0 2024-09-17T01:52:24.050 INFO:tasks.workunit.client.1.smithi092.stdout:5/865: rename d0/de/d19/d1a/d1e/d29/lcf to d0/d23/dfe/l128 0 2024-09-17T01:52:24.053 INFO:tasks.workunit.client.1.smithi092.stdout:7/951: creat d3/db/d26/d83/da6/f143 x:0 0 0 2024-09-17T01:52:24.054 INFO:tasks.workunit.client.1.smithi092.stdout:5/866: creat d0/de/d19/f129 x:0 0 0 2024-09-17T01:52:24.055 INFO:tasks.workunit.client.1.smithi092.stdout:7/952: creat d3/d6/dc2/dc5/f144 x:0 0 0 2024-09-17T01:52:24.055 INFO:tasks.workunit.client.1.smithi092.stdout:8/928: write d15/d25/d27/d6e/d95/dfb/d11d/f5d [1339320,112347] 0 2024-09-17T01:52:24.058 INFO:tasks.workunit.client.1.smithi092.stdout:5/867: fdatasync d0/d7e/f85 0 2024-09-17T01:52:24.060 INFO:tasks.workunit.client.1.smithi092.stdout:5/868: chown d0/de/d19/d3c 0 1 2024-09-17T01:52:24.063 INFO:tasks.workunit.client.1.smithi092.stdout:7/953: dwrite d3/d6/d13/d21/f13a [0,4194304] 0 2024-09-17T01:52:24.065 INFO:tasks.workunit.client.1.smithi092.stdout:5/869: mkdir d0/de/d121/d12a 0 2024-09-17T01:52:24.068 INFO:tasks.workunit.client.1.smithi092.stdout:5/870: fsync d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/de1/fe5 0 2024-09-17T01:52:24.070 INFO:tasks.workunit.client.1.smithi092.stdout:5/871: chown d0/d77/c106 181 1 2024-09-17T01:52:24.074 INFO:tasks.workunit.client.1.smithi092.stdout:8/929: dwrite d15/d25/d27/df3/ff7 [0,4194304] 0 2024-09-17T01:52:24.076 INFO:tasks.workunit.client.1.smithi092.stdout:8/930: dread - d15/d25/d2b/d3d/d9f/f104 zero size 2024-09-17T01:52:24.080 INFO:tasks.workunit.client.1.smithi092.stdout:7/954: truncate d3/d6/d13/f111 577609 0 2024-09-17T01:52:24.081 INFO:tasks.workunit.client.1.smithi092.stdout:8/931: fdatasync d15/d25/d27/d6e/d95/dda/d40/d42/d43/d8d/fdf 0 2024-09-17T01:52:24.084 INFO:tasks.workunit.client.1.smithi092.stdout:5/872: truncate d0/d50/fb3 1038868 0 2024-09-17T01:52:24.085 INFO:tasks.workunit.client.1.smithi092.stdout:8/932: truncate d15/d25/d27/d6e/d95/dda/d40/d42/d43/f113 959150 0 2024-09-17T01:52:24.086 INFO:tasks.workunit.client.1.smithi092.stdout:8/933: fsync d15/d6f/d8b/f103 0 2024-09-17T01:52:24.087 INFO:tasks.workunit.client.1.smithi092.stdout:7/955: unlink d3/d6/dc2/ddc/c11a 0 2024-09-17T01:52:24.088 INFO:tasks.workunit.client.1.smithi092.stdout:7/956: chown d3/db/d98/dce/d6a/c82 1869 1 2024-09-17T01:52:24.088 INFO:tasks.workunit.client.1.smithi092.stdout:5/873: mknod d0/de/d19/d1a/d1e/d3e/d4c/c12b 0 2024-09-17T01:52:24.090 INFO:tasks.workunit.client.1.smithi092.stdout:8/934: mkdir d15/d25/d2b/d3d/d135 0 2024-09-17T01:52:24.092 INFO:tasks.workunit.client.1.smithi092.stdout:7/957: creat d3/db/d26/d6f/f145 x:0 0 0 2024-09-17T01:52:24.094 INFO:tasks.workunit.client.1.smithi092.stdout:5/874: creat d0/de/d19/f12c x:0 0 0 2024-09-17T01:52:24.094 INFO:tasks.workunit.client.1.smithi092.stdout:7/958: rmdir d3/db/d26 39 2024-09-17T01:52:24.095 INFO:tasks.workunit.client.1.smithi092.stdout:5/875: chown d0/de/d19/d1a/d1e/d3e/de2 53982 1 2024-09-17T01:52:24.096 INFO:tasks.workunit.client.1.smithi092.stdout:5/876: chown d0/de/dd4/df8/f105 9110651 1 2024-09-17T01:52:24.102 INFO:tasks.workunit.client.1.smithi092.stdout:7/959: unlink d3/db/d26/d83/ffa 0 2024-09-17T01:52:24.105 INFO:tasks.workunit.client.1.smithi092.stdout:7/960: creat d3/db/d98/dce/d6a/dad/f146 x:0 0 0 2024-09-17T01:52:24.107 INFO:tasks.workunit.client.1.smithi092.stdout:7/961: fsync d3/d6/d13/d21/d2e/d6e/f53 0 2024-09-17T01:52:24.107 INFO:tasks.workunit.client.1.smithi092.stdout:7/962: stat d3/d6/d13/d21/d115 0 2024-09-17T01:52:24.110 INFO:tasks.workunit.client.1.smithi092.stdout:7/963: symlink d3/db/d26/d6f/l147 0 2024-09-17T01:52:24.114 INFO:tasks.workunit.client.1.smithi092.stdout:5/877: dwrite d0/de/d19/f6b [0,4194304] 0 2024-09-17T01:52:24.116 INFO:tasks.workunit.client.1.smithi092.stdout:5/878: fsync d0/de/d19/d1a/d1e/d74/dc8/dd5/f4b 0 2024-09-17T01:52:24.117 INFO:tasks.workunit.client.1.smithi092.stdout:7/964: link d3/db/l7f d3/d6/d13/d12e/l148 0 2024-09-17T01:52:24.119 INFO:tasks.workunit.client.1.smithi092.stdout:7/965: fsync d3/db/d26/d65/f9d 0 2024-09-17T01:52:24.123 INFO:tasks.workunit.client.1.smithi092.stdout:7/966: mkdir d3/d6/dc2/dc5/d149 0 2024-09-17T01:52:24.129 INFO:tasks.workunit.client.1.smithi092.stdout:5/879: truncate d0/d50/fe4 81424 0 2024-09-17T01:52:24.132 INFO:tasks.workunit.client.1.smithi092.stdout:5/880: rename d0/d50/da5/fae to d0/de/d19/d1a/d1e/d74/f12d 0 2024-09-17T01:52:24.134 INFO:tasks.workunit.client.1.smithi092.stdout:5/881: read - d0/de/d19/d1a/d1e/f4e zero size 2024-09-17T01:52:24.135 INFO:tasks.workunit.client.1.smithi092.stdout:5/882: chown d0/de/c30 1003674 1 2024-09-17T01:52:24.142 INFO:tasks.workunit.client.1.smithi092.stdout:5/883: dwrite d0/de/d19/f69 [0,4194304] 0 2024-09-17T01:52:24.160 INFO:tasks.workunit.client.1.smithi092.stdout:7/967: dread d3/d6/d13/d21/f36 [0,4194304] 0 2024-09-17T01:52:24.164 INFO:tasks.workunit.client.1.smithi092.stdout:7/968: readlink d3/db/d98/dce/d6a/l139 0 2024-09-17T01:52:24.172 INFO:tasks.workunit.client.1.smithi092.stdout:7/969: dwrite d3/d6/d13/d21/d2e/d6e/fc4 [0,4194304] 0 2024-09-17T01:52:24.180 INFO:tasks.workunit.client.1.smithi092.stdout:5/884: dread d0/f53 [0,4194304] 0 2024-09-17T01:52:24.188 INFO:tasks.workunit.client.1.smithi092.stdout:5/885: rmdir d0/de/d19/d1a/d1e/d52/d9a/db0/dc1 0 2024-09-17T01:52:24.189 INFO:tasks.workunit.client.1.smithi092.stdout:5/886: chown d0/d23/dfe 1048429 1 2024-09-17T01:52:24.191 INFO:tasks.workunit.client.1.smithi092.stdout:5/887: write d0/de/d19/d1a/d1e/d29/f7c [4919413,61972] 0 2024-09-17T01:52:24.193 INFO:tasks.workunit.client.1.smithi092.stdout:5/888: readlink d0/de/d19/d1a/l124 0 2024-09-17T01:52:24.193 INFO:tasks.workunit.client.1.smithi092.stdout:7/970: dwrite d3/d6/dc2/ddc/fee [0,4194304] 0 2024-09-17T01:52:24.195 INFO:tasks.workunit.client.1.smithi092.stdout:5/889: mkdir d0/d23/d12e 0 2024-09-17T01:52:24.199 INFO:tasks.workunit.client.1.smithi092.stdout:7/971: mkdir d3/db/d98/dce/d6a/dc8/d14a 0 2024-09-17T01:52:24.202 INFO:tasks.workunit.client.1.smithi092.stdout:5/890: mkdir d0/de/d19/d1a/d1e/d52/d9a/de9/d119/d12f 0 2024-09-17T01:52:24.203 INFO:tasks.workunit.client.1.smithi092.stdout:7/972: symlink d3/l14b 0 2024-09-17T01:52:24.203 INFO:tasks.workunit.client.1.smithi092.stdout:5/891: fdatasync d0/de/d19/d3c/d41/dec/f10f 0 2024-09-17T01:52:24.205 INFO:tasks.workunit.client.1.smithi092.stdout:7/973: chown d3/d2b/d84/fab 106675 1 2024-09-17T01:52:24.207 INFO:tasks.workunit.client.1.smithi092.stdout:7/974: dread - d3/d6/dc2/dc5/f144 zero size 2024-09-17T01:52:24.210 INFO:tasks.workunit.client.1.smithi092.stdout:7/975: creat d3/db/d26/d83/da6/f14c x:0 0 0 2024-09-17T01:52:24.211 INFO:tasks.workunit.client.1.smithi092.stdout:7/976: dread - d3/db/d26/d83/f137 zero size 2024-09-17T01:52:24.215 INFO:tasks.workunit.client.1.smithi092.stdout:7/977: creat d3/d6/d13/d21/d115/d121/f14d x:0 0 0 2024-09-17T01:52:24.217 INFO:tasks.workunit.client.1.smithi092.stdout:7/978: dread - d3/db/d26/d83/f137 zero size 2024-09-17T01:52:24.220 INFO:tasks.workunit.client.1.smithi092.stdout:7/979: fdatasync d3/db/d26/d83/f13e 0 2024-09-17T01:52:24.220 INFO:tasks.workunit.client.1.smithi092.stdout:5/892: dwrite d0/d50/fe4 [0,4194304] 0 2024-09-17T01:52:24.221 INFO:tasks.workunit.client.1.smithi092.stdout:9/981: sync 2024-09-17T01:52:24.221 INFO:tasks.workunit.client.1.smithi092.stdout:3/991: sync 2024-09-17T01:52:24.221 INFO:tasks.workunit.client.1.smithi092.stdout:2/899: sync 2024-09-17T01:52:24.222 INFO:tasks.workunit.client.1.smithi092.stdout:2/900: stat d10/d8d/d8f/dc1 0 2024-09-17T01:52:24.223 INFO:tasks.workunit.client.1.smithi092.stdout:5/893: fdatasync d0/de/d19/d1a/d1e/d74/ffa 0 2024-09-17T01:52:24.229 INFO:tasks.workunit.client.1.smithi092.stdout:7/980: truncate d3/d6/d13/d21/f134 1339615 0 2024-09-17T01:52:24.229 INFO:tasks.workunit.client.1.smithi092.stdout:3/992: creat d4/d13/d2e/d5f/d89/f137 x:0 0 0 2024-09-17T01:52:24.232 INFO:tasks.workunit.client.1.smithi092.stdout:9/982: creat d0/d7/dcc/dff/f127 x:0 0 0 2024-09-17T01:52:24.236 INFO:tasks.workunit.client.1.smithi092.stdout:3/993: rename d4/d2f/d44/d54/dda/fe5 to d4/d20/d3f/dc0/f138 0 2024-09-17T01:52:24.239 INFO:tasks.workunit.client.1.smithi092.stdout:9/983: fsync d0/d7/d12/d34/d26/d54/f8b 0 2024-09-17T01:52:24.245 INFO:tasks.workunit.client.1.smithi092.stdout:5/894: getdents d0/de/d19/d1a/d1e 0 2024-09-17T01:52:24.246 INFO:tasks.workunit.client.1.smithi092.stdout:7/981: getdents d3/d6/da1 0 2024-09-17T01:52:24.248 INFO:tasks.workunit.client.1.smithi092.stdout:2/901: dread d10/d1d/d96/d77/d9c/fd7 [0,4194304] 0 2024-09-17T01:52:24.255 INFO:tasks.workunit.client.1.smithi092.stdout:3/994: link d4/d13/d2e/d5f/c9d d4/d16/c139 0 2024-09-17T01:52:24.259 INFO:tasks.workunit.client.1.smithi092.stdout:3/995: mknod d4/d16/d1b/c13a 0 2024-09-17T01:52:24.260 INFO:tasks.workunit.client.1.smithi092.stdout:9/984: dread d0/d7c/dbd/ddd/d11e/d29/ffb [0,4194304] 0 2024-09-17T01:52:24.262 INFO:tasks.workunit.client.1.smithi092.stdout:9/985: readlink d0/d7/d12/d34/l11f 0 2024-09-17T01:52:24.262 INFO:tasks.workunit.client.1.smithi092.stdout:7/982: rename d3/db/d98/dce/d60/d93/dfb/c112 to d3/d6/d13/d21/d2e/c14e 0 2024-09-17T01:52:24.263 INFO:tasks.workunit.client.1.smithi092.stdout:3/996: truncate d4/d20/d39/d70/d95/f121 1146084 0 2024-09-17T01:52:24.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:24 smithi031 ceph-mon[27673]: pgmap v22: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 251 MiB/s wr, 585 op/s 2024-09-17T01:52:24.264 INFO:tasks.workunit.client.1.smithi092.stdout:3/997: read - d4/d73/d8f/d9e/f134 zero size 2024-09-17T01:52:24.265 INFO:tasks.workunit.client.1.smithi092.stdout:7/983: rmdir d3/d6/d13/d12e 39 2024-09-17T01:52:24.268 INFO:tasks.workunit.client.1.smithi092.stdout:3/998: read d4/d2f/d44/d54/ff2 [766167,86064] 0 2024-09-17T01:52:24.270 INFO:tasks.workunit.client.1.smithi092.stdout:2/902: dread d10/d1d/d2c/d56/f60 [0,4194304] 0 2024-09-17T01:52:24.272 INFO:tasks.workunit.client.1.smithi092.stdout:3/999: mkdir d4/d20/d31/d131/d13b 0 2024-09-17T01:52:24.274 INFO:tasks.workunit.client.1.smithi092.stdout:2/903: creat d10/d1d/d2c/d5a/d7a/df5/f12a x:0 0 0 2024-09-17T01:52:24.274 INFO:tasks.workunit.client.1.smithi092.stdout:5/895: truncate d0/d77/fe6 485390 0 2024-09-17T01:52:24.283 INFO:tasks.workunit.client.1.smithi092.stdout:2/904: write d10/d8d/d9e/dfd/d10b/f87 [1532188,96734] 0 2024-09-17T01:52:24.284 INFO:tasks.workunit.client.1.smithi092.stdout:9/986: dread d0/d7/d21/fa5 [0,4194304] 0 2024-09-17T01:52:24.285 INFO:tasks.workunit.client.1.smithi092.stdout:7/984: dwrite d3/d6/d13/d21/f38 [4194304,4194304] 0 2024-09-17T01:52:24.290 INFO:tasks.workunit.client.1.smithi092.stdout:2/905: symlink d10/d8d/l12b 0 2024-09-17T01:52:24.291 INFO:tasks.workunit.client.1.smithi092.stdout:7/985: fsync d3/d6/dc2/dc5/f107 0 2024-09-17T01:52:24.295 INFO:tasks.workunit.client.1.smithi092.stdout:5/896: dwrite d0/d50/d70/d78/fda [0,4194304] 0 2024-09-17T01:52:24.298 INFO:tasks.workunit.client.1.smithi092.stdout:2/906: truncate d10/d4c/d80/f112 197687 0 2024-09-17T01:52:24.299 INFO:tasks.workunit.client.1.smithi092.stdout:7/986: truncate d3/db/d7b/fbc 2424988 0 2024-09-17T01:52:24.305 INFO:tasks.workunit.client.1.smithi092.stdout:7/987: symlink d3/db/d98/dce/d60/d93/l14f 0 2024-09-17T01:52:24.305 INFO:tasks.workunit.client.1.smithi092.stdout:9/987: dwrite d0/f4c [0,4194304] 0 2024-09-17T01:52:24.310 INFO:tasks.workunit.client.1.smithi092.stdout:5/897: write d0/d50/fb3 [1791869,64853] 0 2024-09-17T01:52:24.313 INFO:tasks.workunit.client.1.smithi092.stdout:5/898: write d0/de/d19/d3c/d41/f73 [5007064,57787] 0 2024-09-17T01:52:24.316 INFO:tasks.workunit.client.1.smithi092.stdout:5/899: write d0/de/d19/d3c/fcc [381029,45111] 0 2024-09-17T01:52:24.320 INFO:tasks.workunit.client.1.smithi092.stdout:5/900: readlink d0/de/d19/d1a/d1e/d29/lea 0 2024-09-17T01:52:24.321 INFO:tasks.workunit.client.1.smithi092.stdout:2/907: dread d10/d1d/d2c/d56/f78 [0,4194304] 0 2024-09-17T01:52:24.323 INFO:tasks.workunit.client.1.smithi092.stdout:5/901: dread - d0/d50/d70/d78/d8f/fa4 zero size 2024-09-17T01:52:24.323 INFO:tasks.workunit.client.1.smithi092.stdout:7/988: write d3/db/d98/dce/d6a/ff7 [504229,20143] 0 2024-09-17T01:52:24.323 INFO:tasks.workunit.client.1.smithi092.stdout:9/988: dwrite d0/d7c/dbd/ddd/d11e/f8 [0,4194304] 0 2024-09-17T01:52:24.325 INFO:tasks.workunit.client.1.smithi092.stdout:5/902: readlink d0/d77/l7d 0 2024-09-17T01:52:24.327 INFO:tasks.workunit.client.1.smithi092.stdout:9/989: dread - d0/d7/d12/d86/fc8 zero size 2024-09-17T01:52:24.328 INFO:tasks.workunit.client.1.smithi092.stdout:5/903: symlink d0/de/d19/d3c/d41/dec/l130 0 2024-09-17T01:52:24.333 INFO:tasks.workunit.client.1.smithi092.stdout:5/904: creat d0/de/f131 x:0 0 0 2024-09-17T01:52:24.335 INFO:tasks.workunit.client.1.smithi092.stdout:9/990: rename d0/d7c/dbd/ddd/d11e/d3e/daa/f112 to d0/df/d5d/d109/f128 0 2024-09-17T01:52:24.336 INFO:tasks.workunit.client.1.smithi092.stdout:7/989: link d3/c57 d3/d6/dc2/ddc/df9/c150 0 2024-09-17T01:52:24.339 INFO:tasks.workunit.client.1.smithi092.stdout:2/908: dread d10/d8d/f31 [0,4194304] 0 2024-09-17T01:52:24.341 INFO:tasks.workunit.client.1.smithi092.stdout:7/990: rename d3/c57 to d3/db/d26/d83/da6/c151 0 2024-09-17T01:52:24.342 INFO:tasks.workunit.client.1.smithi092.stdout:9/991: mknod d0/d7c/dbd/df8/c129 0 2024-09-17T01:52:24.342 INFO:tasks.workunit.client.1.smithi092.stdout:7/991: dread - d3/d2b/d84/da7/f118 zero size 2024-09-17T01:52:24.346 INFO:tasks.workunit.client.1.smithi092.stdout:9/992: symlink d0/d7/d21/dd9/l12a 0 2024-09-17T01:52:24.349 INFO:tasks.workunit.client.1.smithi092.stdout:9/993: mkdir d0/d7c/dbd/ddd/d11e/d3e/daa/d12b 0 2024-09-17T01:52:24.351 INFO:tasks.workunit.client.1.smithi092.stdout:9/994: stat d0/d7c/dbd/ddd/d11e/d3e 0 2024-09-17T01:52:24.352 INFO:tasks.workunit.client.1.smithi092.stdout:9/995: stat d0/d7/dcc/f106 0 2024-09-17T01:52:24.354 INFO:tasks.workunit.client.1.smithi092.stdout:7/992: dread d3/db/f15 [4194304,4194304] 0 2024-09-17T01:52:24.355 INFO:tasks.workunit.client.1.smithi092.stdout:5/905: dwrite d0/de/d19/d1a/d1e/d52/d9a/fc2 [0,4194304] 0 2024-09-17T01:52:24.357 INFO:tasks.workunit.client.1.smithi092.stdout:9/996: symlink d0/df/d5d/l12c 0 2024-09-17T01:52:24.361 INFO:tasks.workunit.client.1.smithi092.stdout:2/909: dread d10/d8d/d9e/dfd/d10b/f90 [0,4194304] 0 2024-09-17T01:52:24.370 INFO:tasks.workunit.client.1.smithi092.stdout:7/993: getdents d3/db/d26 0 2024-09-17T01:52:24.370 INFO:tasks.workunit.client.1.smithi092.stdout:2/910: truncate d10/d5c/f85 930949 0 2024-09-17T01:52:24.374 INFO:tasks.workunit.client.1.smithi092.stdout:5/906: dwrite d0/d50/d70/d78/d8f/fa4 [0,4194304] 0 2024-09-17T01:52:24.375 INFO:tasks.workunit.client.1.smithi092.stdout:9/997: dwrite d0/d7/fab [4194304,4194304] 0 2024-09-17T01:52:24.375 INFO:tasks.workunit.client.1.smithi092.stdout:2/911: write d10/d1d/d2c/fb5 [1768097,29769] 0 2024-09-17T01:52:24.380 INFO:tasks.workunit.client.1.smithi092.stdout:5/907: mknod d0/d50/da5/c132 0 2024-09-17T01:52:24.382 INFO:tasks.workunit.client.1.smithi092.stdout:5/908: truncate d0/de/d19/d1a/f123 571431 0 2024-09-17T01:52:24.383 INFO:tasks.workunit.client.1.smithi092.stdout:9/998: creat d0/d7/def/d113/f12d x:0 0 0 2024-09-17T01:52:24.386 INFO:tasks.workunit.client.1.smithi092.stdout:9/999: mkdir d0/d7/dcc/d12e 0 2024-09-17T01:52:24.386 INFO:tasks.workunit.client.1.smithi092.stdout:7/994: dwrite d3/db/d26/d65/f9d [0,4194304] 0 2024-09-17T01:52:24.389 INFO:tasks.workunit.client.1.smithi092.stdout:7/995: rmdir d3/d6/d13/d21/d2e 39 2024-09-17T01:52:24.392 INFO:tasks.workunit.client.1.smithi092.stdout:7/996: creat d3/db/d26/d65/d9a/f152 x:0 0 0 2024-09-17T01:52:24.394 INFO:tasks.workunit.client.1.smithi092.stdout:0/934: sync 2024-09-17T01:52:24.397 INFO:tasks.workunit.client.1.smithi092.stdout:7/997: mknod d3/d6/d13/d21/d2e/d6e/c153 0 2024-09-17T01:52:24.397 INFO:tasks.workunit.client.1.smithi092.stdout:7/998: chown d3/d6/d13/f7d 17396 1 2024-09-17T01:52:24.398 INFO:tasks.workunit.client.1.smithi092.stdout:5/909: write d0/de/d19/d1a/d1e/d3e/d4c/faa [915741,46902] 0 2024-09-17T01:52:24.399 INFO:tasks.workunit.client.1.smithi092.stdout:7/999: write d3/fc [5256784,53440] 0 2024-09-17T01:52:24.399 INFO:tasks.workunit.client.1.smithi092.stdout:5/910: stat d0/de/d19/d3c/d41/dec/fed 0 2024-09-17T01:52:24.405 INFO:tasks.workunit.client.1.smithi092.stdout:5/911: dwrite d0/fd [0,4194304] 0 2024-09-17T01:52:24.409 INFO:tasks.workunit.client.1.smithi092.stdout:5/912: creat d0/de/d19/d1a/d1e/d52/d9a/db0/f133 x:0 0 0 2024-09-17T01:52:24.411 INFO:tasks.workunit.client.1.smithi092.stdout:2/912: dread d10/d1d/d2c/d56/d66/ff3 [0,4194304] 0 2024-09-17T01:52:24.413 INFO:tasks.workunit.client.1.smithi092.stdout:2/913: unlink d10/d1d/d2c/f3d 0 2024-09-17T01:52:24.414 INFO:tasks.workunit.client.1.smithi092.stdout:5/913: read d0/de/d19/d1a/d1e/d3e/f63 [4186882,3576] 0 2024-09-17T01:52:24.419 INFO:tasks.workunit.client.1.smithi092.stdout:2/914: read d10/d1d/d2c/d5a/d7a/fed [491053,118744] 0 2024-09-17T01:52:24.420 INFO:tasks.workunit.client.1.smithi092.stdout:2/915: mknod d10/d55/d84/c12c 0 2024-09-17T01:52:24.421 INFO:tasks.workunit.client.1.smithi092.stdout:2/916: write d10/d1d/d96/d77/f10e [594692,64019] 0 2024-09-17T01:52:24.422 INFO:tasks.workunit.client.1.smithi092.stdout:2/917: truncate d10/d1d/d96/d77/f9f 1268496 0 2024-09-17T01:52:24.437 INFO:tasks.workunit.client.1.smithi092.stdout:2/918: dread d10/d1d/d24/d6e/f9d [0,4194304] 0 2024-09-17T01:52:24.441 INFO:tasks.workunit.client.1.smithi092.stdout:2/919: link d10/d3a/fbe d10/d1d/d2c/d5a/f12d 0 2024-09-17T01:52:24.444 INFO:tasks.workunit.client.1.smithi092.stdout:2/920: dwrite d10/d3a/f3f [0,4194304] 0 2024-09-17T01:52:24.452 INFO:tasks.workunit.client.1.smithi092.stdout:2/921: write d10/d1d/d96/d77/f9b [1876703,17277] 0 2024-09-17T01:52:24.456 INFO:tasks.workunit.client.1.smithi092.stdout:2/922: rename d10/d5c to d10/d1d/d2c/d56/d66/d12e 0 2024-09-17T01:52:24.459 INFO:tasks.workunit.client.1.smithi092.stdout:2/923: rmdir d10/d1d/d96/d77 39 2024-09-17T01:52:24.462 INFO:tasks.workunit.client.1.smithi092.stdout:2/924: mkdir d10/d4c/d12f 0 2024-09-17T01:52:24.465 INFO:tasks.workunit.client.1.smithi092.stdout:2/925: dread d10/d1d/d2c/d56/d66/ff3 [0,4194304] 0 2024-09-17T01:52:24.471 INFO:tasks.workunit.client.1.smithi092.stdout:2/926: dwrite d10/db9/f11d [0,4194304] 0 2024-09-17T01:52:24.474 INFO:tasks.workunit.client.1.smithi092.stdout:2/927: creat d10/d3a/d97/f130 x:0 0 0 2024-09-17T01:52:24.475 INFO:tasks.workunit.client.1.smithi092.stdout:2/928: creat d10/d4c/d80/d95/db3/f131 x:0 0 0 2024-09-17T01:52:24.477 INFO:tasks.workunit.client.1.smithi092.stdout:2/929: write d10/d1d/d24/d6e/faf [53914,4298] 0 2024-09-17T01:52:24.479 INFO:tasks.workunit.client.1.smithi092.stdout:2/930: creat d10/d1d/d2c/d5a/d7a/f132 x:0 0 0 2024-09-17T01:52:24.481 INFO:tasks.workunit.client.1.smithi092.stdout:2/931: creat d10/d1d/d96/de7/f133 x:0 0 0 2024-09-17T01:52:24.482 INFO:tasks.workunit.client.1.smithi092.stdout:2/932: dread - d10/d4c/f117 zero size 2024-09-17T01:52:24.487 INFO:tasks.workunit.client.1.smithi092.stdout:2/933: dwrite d10/d1d/d2c/f57 [0,4194304] 0 2024-09-17T01:52:24.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:24 smithi092 ceph-mon[33552]: pgmap v22: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 251 MiB/s wr, 585 op/s 2024-09-17T01:52:24.491 INFO:tasks.workunit.client.1.smithi092.stdout:2/934: write d10/d1d/d96/d77/d9c/dae/fc5 [4797330,32419] 0 2024-09-17T01:52:24.491 INFO:tasks.workunit.client.1.smithi092.stdout:2/935: chown d10/d1d/d96/d77/d9c 1843587983 1 2024-09-17T01:52:24.492 INFO:tasks.workunit.client.1.smithi092.stdout:2/936: write d10/d3a/d97/fc8 [461153,10947] 0 2024-09-17T01:52:24.500 INFO:tasks.workunit.client.1.smithi092.stdout:2/937: write d10/d4c/d80/f112 [643461,25156] 0 2024-09-17T01:52:24.502 INFO:tasks.workunit.client.1.smithi092.stdout:2/938: creat d10/d55/dda/da3/dbd/d124/f134 x:0 0 0 2024-09-17T01:52:24.507 INFO:tasks.workunit.client.1.smithi092.stdout:2/939: rename d10/d55/dda to d10/d1d/d2c/d5a/d135 0 2024-09-17T01:52:24.509 INFO:tasks.workunit.client.1.smithi092.stdout:2/940: read d10/d8d/d9e/dfd/d10b/f87 [3319887,101736] 0 2024-09-17T01:52:24.511 INFO:tasks.workunit.client.1.smithi092.stdout:2/941: rmdir d10/d4c/d12f 0 2024-09-17T01:52:24.534 INFO:tasks.workunit.client.1.smithi092.stdout:2/942: mkdir d10/d4c/d80/d95/dc6/d11e/d136 0 2024-09-17T01:52:24.536 INFO:tasks.workunit.client.1.smithi092.stdout:2/943: unlink d10/d1d/d96/d77/f10e 0 2024-09-17T01:52:24.538 INFO:tasks.workunit.client.1.smithi092.stdout:2/944: mkdir d10/d1d/d24/d6e/d137 0 2024-09-17T01:52:24.541 INFO:tasks.workunit.client.1.smithi092.stdout:2/945: link d10/d1d/d2c/l51 d10/d8d/d9e/dfd/d10b/l138 0 2024-09-17T01:52:24.542 INFO:tasks.workunit.client.1.smithi092.stdout:2/946: dread - d10/d4c/d80/ff0 zero size 2024-09-17T01:52:24.542 INFO:tasks.workunit.client.1.smithi092.stdout:2/947: chown d10/d8d/d9e 8875 1 2024-09-17T01:52:24.544 INFO:tasks.workunit.client.1.smithi092.stdout:2/948: write d10/d1d/d2c/d56/f78 [864374,125139] 0 2024-09-17T01:52:24.546 INFO:tasks.workunit.client.1.smithi092.stdout:2/949: getdents d10/d4c/d80/dd8 0 2024-09-17T01:52:24.552 INFO:tasks.workunit.client.1.smithi092.stdout:2/950: dwrite d10/db9/f11d [0,4194304] 0 2024-09-17T01:52:24.558 INFO:tasks.workunit.client.1.smithi092.stdout:2/951: link d10/d4c/d80/d95/fe5 d10/d1d/d2c/d5a/d7a/f139 0 2024-09-17T01:52:24.562 INFO:tasks.workunit.client.1.smithi092.stdout:2/952: link d10/d4c/d80/l8c d10/d54/l13a 0 2024-09-17T01:52:24.563 INFO:tasks.workunit.client.1.smithi092.stdout:2/953: chown d10/d1d/d2c/d56/d66/d12e/l5e 7 1 2024-09-17T01:52:24.568 INFO:tasks.workunit.client.1.smithi092.stdout:2/954: dwrite d10/d4c/d80/d95/fa0 [0,4194304] 0 2024-09-17T01:52:24.569 INFO:tasks.workunit.client.1.smithi092.stdout:2/955: dread - d10/d1d/d96/d77/d9c/dae/fd3 zero size 2024-09-17T01:52:24.597 INFO:tasks.workunit.client.1.smithi092.stdout:2/956: write d10/d1d/f8b [1943226,55321] 0 2024-09-17T01:52:24.599 INFO:tasks.workunit.client.1.smithi092.stdout:2/957: read d10/d1d/d24/f4f [3754822,127] 0 2024-09-17T01:52:24.607 INFO:tasks.workunit.client.1.smithi092.stdout:2/958: dwrite d10/d4c/d80/d95/db3/ffe [0,4194304] 0 2024-09-17T01:52:24.610 INFO:tasks.workunit.client.1.smithi092.stdout:2/959: creat d10/d1d/d2c/d5a/d135/da3/dbd/f13b x:0 0 0 2024-09-17T01:52:24.620 INFO:tasks.workunit.client.1.smithi092.stdout:2/960: write d10/d1d/d2c/fcf [1190026,120625] 0 2024-09-17T01:52:24.629 INFO:tasks.workunit.client.1.smithi092.stdout:8/935: sync 2024-09-17T01:52:24.630 INFO:tasks.workunit.client.1.smithi092.stdout:8/936: chown d15/f34 7647 1 2024-09-17T01:52:24.633 INFO:tasks.workunit.client.1.smithi092.stdout:2/961: dread d10/d8d/d9e/dfd/d10b/f87 [0,4194304] 0 2024-09-17T01:52:24.634 INFO:tasks.workunit.client.1.smithi092.stdout:2/962: stat d10/d4c/d80/d95/f105 0 2024-09-17T01:52:24.635 INFO:tasks.workunit.client.1.smithi092.stdout:8/937: dwrite d15/d25/d27/d6e/d95/dfb/d11d/d78/f105 [0,4194304] 0 2024-09-17T01:52:24.635 INFO:tasks.workunit.client.1.smithi092.stdout:2/963: write d10/d1d/d2c/d5a/d7a/f132 [1029531,11389] 0 2024-09-17T01:52:24.641 INFO:tasks.workunit.client.1.smithi092.stdout:2/964: dread d10/d4c/d80/d95/fa0 [0,4194304] 0 2024-09-17T01:52:24.642 INFO:tasks.workunit.client.1.smithi092.stdout:8/938: rename d15/d25/d27/d6e/d95/dfb/d11d/d78/ff5 to d15/d25/d2b/d3d/f136 0 2024-09-17T01:52:24.642 INFO:tasks.workunit.client.1.smithi092.stdout:2/965: fsync d10/d1d/d24/f43 0 2024-09-17T01:52:24.644 INFO:tasks.workunit.client.1.smithi092.stdout:8/939: write d15/d25/d27/d6e/d95/dda/d40/f7b [1811602,110890] 0 2024-09-17T01:52:24.648 INFO:tasks.workunit.client.1.smithi092.stdout:2/966: mkdir d10/d4c/d80/dd8/d13c 0 2024-09-17T01:52:24.648 INFO:tasks.workunit.client.1.smithi092.stdout:8/940: rmdir d15/d25/d27/d6e/d95/dda/d40 39 2024-09-17T01:52:24.649 INFO:tasks.workunit.client.1.smithi092.stdout:8/941: stat d15/d6f 0 2024-09-17T01:52:24.652 INFO:tasks.workunit.client.1.smithi092.stdout:2/967: dwrite d10/d8d/d8f/d93/f107 [0,4194304] 0 2024-09-17T01:52:24.653 INFO:tasks.workunit.client.1.smithi092.stdout:8/942: fsync d15/d25/d2b/d3d/f136 0 2024-09-17T01:52:24.655 INFO:tasks.workunit.client.1.smithi092.stdout:2/968: symlink d10/d4c/df4/d116/l13d 0 2024-09-17T01:52:24.657 INFO:tasks.workunit.client.1.smithi092.stdout:8/943: creat d15/d25/d27/d87/d125/f137 x:0 0 0 2024-09-17T01:52:24.658 INFO:tasks.workunit.client.1.smithi092.stdout:2/969: creat d10/d4c/d80/dd8/f13e x:0 0 0 2024-09-17T01:52:24.660 INFO:tasks.workunit.client.1.smithi092.stdout:2/970: symlink d10/d1d/d2c/d5a/l13f 0 2024-09-17T01:52:24.663 INFO:tasks.workunit.client.1.smithi092.stdout:8/944: link d15/d6f/d8b/f99 d15/d25/d27/d6e/d95/dda/d40/d42/d43/f138 0 2024-09-17T01:52:24.663 INFO:tasks.workunit.client.1.smithi092.stdout:2/971: creat d10/d4c/d80/d95/db3/f140 x:0 0 0 2024-09-17T01:52:24.664 INFO:tasks.workunit.client.1.smithi092.stdout:8/945: stat d15/d25/d2b/c65 0 2024-09-17T01:52:24.665 INFO:tasks.workunit.client.1.smithi092.stdout:2/972: rmdir d10/d1d/d96/d77/dce 39 2024-09-17T01:52:24.666 INFO:tasks.workunit.client.1.smithi092.stdout:2/973: stat d10/d4c/d80/d95/dc6/d126 0 2024-09-17T01:52:24.666 INFO:tasks.workunit.client.1.smithi092.stdout:8/946: mknod d15/d25/d27/c139 0 2024-09-17T01:52:24.667 INFO:tasks.workunit.client.1.smithi092.stdout:8/947: write ff [1999109,16357] 0 2024-09-17T01:52:24.668 INFO:tasks.workunit.client.1.smithi092.stdout:2/974: mkdir d10/d1d/d141 0 2024-09-17T01:52:24.670 INFO:tasks.workunit.client.1.smithi092.stdout:8/948: creat d15/d6f/d8b/d12d/f13a x:0 0 0 2024-09-17T01:52:24.672 INFO:tasks.workunit.client.1.smithi092.stdout:8/949: chown d15/d25/d27/d6e/d95/dda/f38 890308629 1 2024-09-17T01:52:24.675 INFO:tasks.workunit.client.1.smithi092.stdout:2/975: dwrite d10/db9/f110 [4194304,4194304] 0 2024-09-17T01:52:24.678 INFO:tasks.workunit.client.1.smithi092.stdout:2/976: dread - d10/d1d/d96/d77/d9c/dae/fd3 zero size 2024-09-17T01:52:24.682 INFO:tasks.workunit.client.1.smithi092.stdout:2/977: dread d10/d4c/d80/d95/db3/ffe [0,4194304] 0 2024-09-17T01:52:24.683 INFO:tasks.workunit.client.1.smithi092.stdout:8/950: link d15/d25/d27/d6e/d95/dda/d40/d42/d93/l124 d15/d25/d27/d6e/d95/dda/l13b 0 2024-09-17T01:52:24.686 INFO:tasks.workunit.client.1.smithi092.stdout:8/951: getdents d15/d6f/de5 0 2024-09-17T01:52:24.690 INFO:tasks.workunit.client.1.smithi092.stdout:2/978: dwrite d10/d8d/d8f/d93/f107 [0,4194304] 0 2024-09-17T01:52:24.692 INFO:tasks.workunit.client.1.smithi092.stdout:2/979: stat d10/d1d/d2c/d56/ca7 0 2024-09-17T01:52:24.694 INFO:tasks.workunit.client.1.smithi092.stdout:2/980: symlink d10/d4c/l142 0 2024-09-17T01:52:24.694 INFO:tasks.workunit.client.1.smithi092.stdout:2/981: stat d10/d1d/d96/d77/ld6 0 2024-09-17T01:52:24.696 INFO:tasks.workunit.client.1.smithi092.stdout:8/952: dwrite d15/d25/d27/d6e/d95/dda/f38 [0,4194304] 0 2024-09-17T01:52:24.715 INFO:tasks.workunit.client.1.smithi092.stdout:2/982: dread d10/d1d/d96/d77/f47 [0,4194304] 0 2024-09-17T01:52:24.716 INFO:tasks.workunit.client.1.smithi092.stdout:2/983: chown d10/d54/l13a 21455172 1 2024-09-17T01:52:24.719 INFO:tasks.workunit.client.1.smithi092.stdout:2/984: rename d10/d4c/d80/dd8 to d10/d1d/d141/d143 0 2024-09-17T01:52:24.721 INFO:tasks.workunit.client.1.smithi092.stdout:2/985: mknod d10/d1d/d2c/d56/c144 0 2024-09-17T01:52:24.726 INFO:tasks.workunit.client.1.smithi092.stdout:2/986: dwrite d10/d1d/d141/d143/f13e [0,4194304] 0 2024-09-17T01:52:24.728 INFO:tasks.workunit.client.1.smithi092.stdout:2/987: symlink d10/d8d/d9e/l145 0 2024-09-17T01:52:24.729 INFO:tasks.workunit.client.1.smithi092.stdout:2/988: read d10/d1d/d2c/d56/d66/ff3 [203392,17946] 0 2024-09-17T01:52:24.730 INFO:tasks.workunit.client.1.smithi092.stdout:2/989: chown d10/d4c/d80/l8c 331979 1 2024-09-17T01:52:24.735 INFO:tasks.workunit.client.1.smithi092.stdout:2/990: write d10/d4c/d80/d95/fe5 [761626,44655] 0 2024-09-17T01:52:24.826 INFO:tasks.workunit.client.1.smithi092.stdout:0/935: sync 2024-09-17T01:52:24.827 INFO:tasks.workunit.client.1.smithi092.stdout:0/936: chown d3/da/l98 3 1 2024-09-17T01:52:24.833 INFO:tasks.workunit.client.1.smithi092.stdout:0/937: dwrite d3/d2e/d3b/d72/ff2 [0,4194304] 0 2024-09-17T01:52:24.848 INFO:tasks.workunit.client.1.smithi092.stdout:0/938: dread d3/d2e/d3b/d8f/fc3 [0,4194304] 0 2024-09-17T01:52:24.850 INFO:tasks.workunit.client.1.smithi092.stdout:0/939: readlink d3/ld5 0 2024-09-17T01:52:24.851 INFO:tasks.workunit.client.1.smithi092.stdout:0/940: mkdir d3/d2e/d3b/d72/d7a/d120 0 2024-09-17T01:52:24.853 INFO:tasks.workunit.client.1.smithi092.stdout:0/941: mknod d3/d2e/d55/d63/d81/de3/c121 0 2024-09-17T01:52:24.856 INFO:tasks.workunit.client.1.smithi092.stdout:0/942: read - d3/da/d15/dab/fe5 zero size 2024-09-17T01:52:24.856 INFO:tasks.workunit.client.1.smithi092.stdout:0/943: mknod d3/d2e/d55/d63/d81/c122 0 2024-09-17T01:52:24.857 INFO:tasks.workunit.client.1.smithi092.stdout:0/944: mkdir d3/dc8/dd2/d123 0 2024-09-17T01:52:24.859 INFO:tasks.workunit.client.1.smithi092.stdout:0/945: read d3/da/fb [2408988,123196] 0 2024-09-17T01:52:24.868 INFO:tasks.workunit.client.1.smithi092.stdout:0/946: dwrite d3/d2e/d55/d63/f93 [0,4194304] 0 2024-09-17T01:52:24.869 INFO:tasks.workunit.client.1.smithi092.stdout:0/947: fdatasync d3/d2e/d3b/f105 0 2024-09-17T01:52:24.873 INFO:tasks.workunit.client.1.smithi092.stdout:0/948: link d3/d2e/d55/d63/lce d3/d2e/d3b/d8f/l124 0 2024-09-17T01:52:24.878 INFO:tasks.workunit.client.1.smithi092.stdout:0/949: mkdir d3/d2e/d55/d63/d81/d9c/d112/d117/d125 0 2024-09-17T01:52:24.954 INFO:tasks.workunit.client.1.smithi092.stdout:8/953: sync 2024-09-17T01:52:24.955 INFO:tasks.workunit.client.1.smithi092.stdout:5/914: sync 2024-09-17T01:52:24.956 INFO:tasks.workunit.client.1.smithi092.stdout:8/954: creat d15/d25/d27/d6e/de0/f13c x:0 0 0 2024-09-17T01:52:24.958 INFO:tasks.workunit.client.1.smithi092.stdout:8/955: write d15/d25/d27/d6e/d95/dda/d40/d42/f45 [1013718,117718] 0 2024-09-17T01:52:24.958 INFO:tasks.workunit.client.1.smithi092.stdout:5/915: rename d0/de/d19/d1a/f7b to d0/de/d19/d1a/d1e/d3e/f134 0 2024-09-17T01:52:24.959 INFO:tasks.workunit.client.1.smithi092.stdout:8/956: fsync d15/d25/d2b/f134 0 2024-09-17T01:52:24.961 INFO:tasks.workunit.client.1.smithi092.stdout:5/916: symlink d0/d7e/d90/l135 0 2024-09-17T01:52:24.967 INFO:tasks.workunit.client.1.smithi092.stdout:5/917: dwrite d0/d50/fe4 [0,4194304] 0 2024-09-17T01:52:24.968 INFO:tasks.workunit.client.1.smithi092.stdout:5/918: write d0/de/d19/f6c [747881,128838] 0 2024-09-17T01:52:24.971 INFO:tasks.workunit.client.1.smithi092.stdout:5/919: creat d0/de/d19/d3c/d41/d8d/f136 x:0 0 0 2024-09-17T01:52:24.976 INFO:tasks.workunit.client.1.smithi092.stdout:8/957: dread d15/d25/d27/d6e/d95/dfb/d11d/f7e [0,4194304] 0 2024-09-17T01:52:24.976 INFO:tasks.workunit.client.1.smithi092.stdout:5/920: creat d0/de/d19/d1a/d1e/d52/d9a/de9/d119/d12f/f137 x:0 0 0 2024-09-17T01:52:24.979 INFO:tasks.workunit.client.1.smithi092.stdout:8/958: truncate d15/d25/d27/d6e/d95/dda/d40/d42/d43/f113 1578812 0 2024-09-17T01:52:24.979 INFO:tasks.workunit.client.1.smithi092.stdout:5/921: unlink d0/d77/c106 0 2024-09-17T01:52:24.980 INFO:tasks.workunit.client.1.smithi092.stdout:0/950: sync 2024-09-17T01:52:24.980 INFO:tasks.workunit.client.1.smithi092.stdout:2/991: sync 2024-09-17T01:52:24.980 INFO:tasks.workunit.client.1.smithi092.stdout:8/959: write d15/d25/d2b/d3d/d9f/f104 [959200,59129] 0 2024-09-17T01:52:24.982 INFO:tasks.workunit.client.1.smithi092.stdout:5/922: creat d0/d50/d70/d114/f138 x:0 0 0 2024-09-17T01:52:24.982 INFO:tasks.workunit.client.1.smithi092.stdout:8/960: chown d15/d25/d27/d6e/d95/dda/d40/d42/d93/df4 4990 1 2024-09-17T01:52:24.984 INFO:tasks.workunit.client.1.smithi092.stdout:5/923: write d0/de/d19/d1a/d1e/f1b [4203126,97704] 0 2024-09-17T01:52:24.984 INFO:tasks.workunit.client.1.smithi092.stdout:8/961: readlink d15/d25/d27/d6e/d76/d83/lfe 0 2024-09-17T01:52:24.985 INFO:tasks.workunit.client.1.smithi092.stdout:0/951: symlink d3/dc8/dd2/d123/l126 0 2024-09-17T01:52:24.986 INFO:tasks.workunit.client.1.smithi092.stdout:8/962: read d15/f1f [4185,6061] 0 2024-09-17T01:52:24.987 INFO:tasks.workunit.client.1.smithi092.stdout:5/924: truncate d0/de/d19/d3c/fcc 1182052 0 2024-09-17T01:52:24.990 INFO:tasks.workunit.client.1.smithi092.stdout:0/952: creat d3/d2e/d55/d63/d81/f127 x:0 0 0 2024-09-17T01:52:24.993 INFO:tasks.workunit.client.1.smithi092.stdout:8/963: dread d15/d25/d27/d6e/d95/dda/f38 [0,4194304] 0 2024-09-17T01:52:24.993 INFO:tasks.workunit.client.1.smithi092.stdout:5/925: dread d0/de/d19/d1a/d1e/f1b [0,4194304] 0 2024-09-17T01:52:24.995 INFO:tasks.workunit.client.1.smithi092.stdout:2/992: write d10/d8d/d9e/dfd/d10b/f90 [3519407,36560] 0 2024-09-17T01:52:24.999 INFO:tasks.workunit.client.1.smithi092.stdout:5/926: mknod d0/de/d19/d1a/d1e/d52/d9a/de9/d119/d12f/c139 0 2024-09-17T01:52:25.000 INFO:tasks.workunit.client.1.smithi092.stdout:5/927: chown d0/d7e/d90/l135 47789262 1 2024-09-17T01:52:25.000 INFO:tasks.workunit.client.1.smithi092.stdout:2/993: dread d10/d4c/d80/d95/db3/ffe [0,4194304] 0 2024-09-17T01:52:25.000 INFO:tasks.workunit.client.1.smithi092.stdout:0/953: rmdir d3/d2e/d3b/d48/d11e 0 2024-09-17T01:52:25.004 INFO:tasks.workunit.client.1.smithi092.stdout:2/994: rename d10/d1d/d96/lfa to d10/d1d/d141/l146 0 2024-09-17T01:52:25.005 INFO:tasks.workunit.client.1.smithi092.stdout:5/928: creat d0/de/d19/d1a/d1e/d52/d9a/de9/f13a x:0 0 0 2024-09-17T01:52:25.006 INFO:tasks.workunit.client.1.smithi092.stdout:2/995: chown d10/d1d/d96/d77/ld6 236729 1 2024-09-17T01:52:25.007 INFO:tasks.workunit.client.1.smithi092.stdout:8/964: dwrite d15/d25/d27/d6e/d95/dda/d40/d42/f4b [0,4194304] 0 2024-09-17T01:52:25.010 INFO:tasks.workunit.client.1.smithi092.stdout:8/965: symlink d15/d25/d27/d87/l13d 0 2024-09-17T01:52:25.013 INFO:tasks.workunit.client.1.smithi092.stdout:5/929: truncate d0/de/d19/d1a/d1e/d52/d9a/de9/f13a 110092 0 2024-09-17T01:52:25.015 INFO:tasks.workunit.client.1.smithi092.stdout:2/996: dwrite d10/d55/f5b [4194304,4194304] 0 2024-09-17T01:52:25.017 INFO:tasks.workunit.client.1.smithi092.stdout:8/966: write d15/d25/d27/d6e/f12b [255684,92928] 0 2024-09-17T01:52:25.023 INFO:tasks.workunit.client.1.smithi092.stdout:5/930: creat d0/f13b x:0 0 0 2024-09-17T01:52:25.024 INFO:tasks.workunit.client.1.smithi092.stdout:8/967: symlink d15/d6f/d8b/d110/l13e 0 2024-09-17T01:52:25.024 INFO:tasks.workunit.client.1.smithi092.stdout:0/954: truncate d3/d2e/d3b/d8f/d5f/f7f 738420 0 2024-09-17T01:52:25.025 INFO:tasks.workunit.client.1.smithi092.stdout:5/931: symlink d0/d23/d12e/l13c 0 2024-09-17T01:52:25.027 INFO:tasks.workunit.client.1.smithi092.stdout:8/968: creat d15/d25/d2b/d3d/d9f/d8e/f13f x:0 0 0 2024-09-17T01:52:25.029 INFO:tasks.workunit.client.1.smithi092.stdout:8/969: readlink d15/d25/d27/d6e/d95/dda/d40/lb9 0 2024-09-17T01:52:25.030 INFO:tasks.workunit.client.1.smithi092.stdout:0/955: rename d3/dee/d7d/leb to d3/l128 0 2024-09-17T01:52:25.033 INFO:tasks.workunit.client.1.smithi092.stdout:2/997: dwrite d10/d1d/d2c/d5a/d7a/fed [0,4194304] 0 2024-09-17T01:52:25.033 INFO:tasks.workunit.client.1.smithi092.stdout:8/970: unlink d15/d25/d27/d6e/fc0 0 2024-09-17T01:52:25.038 INFO:tasks.workunit.client.1.smithi092.stdout:5/932: getdents d0/de/d19/d1a/d1e 0 2024-09-17T01:52:25.043 INFO:tasks.workunit.client.1.smithi092.stdout:2/998: dwrite d10/d1d/d96/d77/d9c/dae/fc5 [0,4194304] 0 2024-09-17T01:52:25.046 INFO:tasks.workunit.client.1.smithi092.stdout:2/999: fdatasync d10/d8d/d8f/fd4 0 2024-09-17T01:52:25.047 INFO:tasks.workunit.client.1.smithi092.stdout:8/971: dread d15/d25/d27/d6e/d95/dfb/d11d/d78/f82 [0,4194304] 0 2024-09-17T01:52:25.049 INFO:tasks.workunit.client.1.smithi092.stdout:5/933: dwrite d0/de/d19/d1a/d1e/d52/d9a/db0/f133 [0,4194304] 0 2024-09-17T01:52:25.050 INFO:tasks.workunit.client.1.smithi092.stdout:0/956: write d3/da/d15/d30/f41 [639782,200] 0 2024-09-17T01:52:25.052 INFO:tasks.workunit.client.1.smithi092.stdout:5/934: fsync d0/de/d19/d1a/d1e/d3e/d4c/faa 0 2024-09-17T01:52:25.052 INFO:tasks.workunit.client.1.smithi092.stdout:0/957: stat d3/d2e/d55/d63/d81/c122 0 2024-09-17T01:52:25.056 INFO:tasks.workunit.client.1.smithi092.stdout:8/972: mkdir d15/d25/d27/d6e/d95/dfb/d11d/d78/d9e/da0/d140 0 2024-09-17T01:52:25.058 INFO:tasks.workunit.client.1.smithi092.stdout:5/935: symlink d0/d50/d70/d78/d8f/l13d 0 2024-09-17T01:52:25.059 INFO:tasks.workunit.client.1.smithi092.stdout:0/958: dread d3/f12 [0,4194304] 0 2024-09-17T01:52:25.065 INFO:tasks.workunit.client.1.smithi092.stdout:5/936: rename d0/d23/le8 to d0/d50/d70/d78/d8f/l13e 0 2024-09-17T01:52:25.067 INFO:tasks.workunit.client.1.smithi092.stdout:5/937: dread d0/fbc [0,4194304] 0 2024-09-17T01:52:25.068 INFO:tasks.workunit.client.1.smithi092.stdout:5/938: creat d0/de/d19/d1a/d1e/d52/d9a/de9/f13f x:0 0 0 2024-09-17T01:52:25.072 INFO:tasks.workunit.client.1.smithi092.stdout:8/973: rmdir d15/d25/d27/d6e/d95 39 2024-09-17T01:52:25.075 INFO:tasks.workunit.client.1.smithi092.stdout:5/939: truncate d0/fa9 3215784 0 2024-09-17T01:52:25.076 INFO:tasks.workunit.client.1.smithi092.stdout:8/974: unlink d15/d25/d27/d6e/d95/dda/d40/l4e 0 2024-09-17T01:52:25.078 INFO:tasks.workunit.client.1.smithi092.stdout:8/975: rmdir d15/d25/d27/d87/d125 39 2024-09-17T01:52:25.083 INFO:tasks.workunit.client.1.smithi092.stdout:5/940: write d0/d77/fe6 [462792,43448] 0 2024-09-17T01:52:25.084 INFO:tasks.workunit.client.1.smithi092.stdout:8/976: write d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/fba [3511587,74211] 0 2024-09-17T01:52:25.086 INFO:tasks.workunit.client.1.smithi092.stdout:5/941: mkdir d0/de/d19/d3c/d41/d8d/d140 0 2024-09-17T01:52:25.087 INFO:tasks.workunit.client.1.smithi092.stdout:8/977: mknod d15/d25/d2b/d63/c141 0 2024-09-17T01:52:25.087 INFO:tasks.workunit.client.1.smithi092.stdout:8/978: stat d15/d25/d27 0 2024-09-17T01:52:25.088 INFO:tasks.workunit.client.1.smithi092.stdout:8/979: dread - d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/f10f zero size 2024-09-17T01:52:25.088 INFO:tasks.workunit.client.1.smithi092.stdout:5/942: rename d0/de/d19/d1a/d1e/d74/cc7 to d0/d50/d70/c141 0 2024-09-17T01:52:25.090 INFO:tasks.workunit.client.1.smithi092.stdout:8/980: mkdir d15/d25/d27/d49/d142 0 2024-09-17T01:52:25.091 INFO:tasks.workunit.client.1.smithi092.stdout:5/943: mknod d0/de/d19/d1a/d1e/d74/c142 0 2024-09-17T01:52:25.093 INFO:tasks.workunit.client.1.smithi092.stdout:5/944: write d0/de/d19/d1a/d1e/f1b [1373381,41174] 0 2024-09-17T01:52:25.094 INFO:tasks.workunit.client.1.smithi092.stdout:8/981: dread d15/d25/d27/d6e/d95/dda/f38 [0,4194304] 0 2024-09-17T01:52:25.096 INFO:tasks.workunit.client.1.smithi092.stdout:5/945: creat d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/f143 x:0 0 0 2024-09-17T01:52:25.097 INFO:tasks.workunit.client.1.smithi092.stdout:5/946: symlink d0/de/d19/d3c/l144 0 2024-09-17T01:52:25.098 INFO:tasks.workunit.client.1.smithi092.stdout:5/947: fsync d0/de/d19/d1a/d1e/fa2 0 2024-09-17T01:52:25.099 INFO:tasks.workunit.client.1.smithi092.stdout:5/948: read - d0/d50/d70/d114/f138 zero size 2024-09-17T01:52:25.101 INFO:tasks.workunit.client.1.smithi092.stdout:5/949: unlink d0/de/d19/d1a/d1e/d74/fff 0 2024-09-17T01:52:25.105 INFO:tasks.workunit.client.1.smithi092.stdout:5/950: dread d0/de/d19/d1a/d1e/d52/d9a/db0/f133 [0,4194304] 0 2024-09-17T01:52:25.108 INFO:tasks.workunit.client.1.smithi092.stdout:5/951: mkdir d0/d50/d70/df3/d145 0 2024-09-17T01:52:25.110 INFO:tasks.workunit.client.1.smithi092.stdout:5/952: creat d0/de/d19/d1a/d1e/d74/ddf/f146 x:0 0 0 2024-09-17T01:52:25.115 INFO:tasks.workunit.client.1.smithi092.stdout:5/953: write d0/de/d19/d1a/d1e/d3e/d4c/f5d [4121871,41830] 0 2024-09-17T01:52:25.117 INFO:tasks.workunit.client.1.smithi092.stdout:5/954: symlink d0/de/d19/d1a/l147 0 2024-09-17T01:52:25.117 INFO:tasks.workunit.client.1.smithi092.stdout:5/955: dread - d0/de/d19/d1a/d1e/f4e zero size 2024-09-17T01:52:25.118 INFO:tasks.workunit.client.1.smithi092.stdout:5/956: mknod d0/d50/d70/c148 0 2024-09-17T01:52:25.119 INFO:tasks.workunit.client.1.smithi092.stdout:5/957: fsync d0/de/d19/f12c 0 2024-09-17T01:52:25.124 INFO:tasks.workunit.client.1.smithi092.stdout:5/958: dwrite d0/de/d19/d1a/d1e/d29/f101 [0,4194304] 0 2024-09-17T01:52:25.125 INFO:tasks.workunit.client.1.smithi092.stdout:5/959: write d0/d50/d70/df3/f122 [939181,17948] 0 2024-09-17T01:52:25.126 INFO:tasks.workunit.client.1.smithi092.stdout:5/960: dread - d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/f143 zero size 2024-09-17T01:52:25.128 INFO:tasks.workunit.client.1.smithi092.stdout:5/961: creat d0/de/dd4/df8/f149 x:0 0 0 2024-09-17T01:52:25.128 INFO:tasks.workunit.client.1.smithi092.stdout:5/962: truncate d0/fbc 1322168 0 2024-09-17T01:52:25.131 INFO:tasks.workunit.client.1.smithi092.stdout:5/963: getdents d0/d23/d12e 0 2024-09-17T01:52:25.134 INFO:tasks.workunit.client.1.smithi092.stdout:5/964: read d0/de/d19/d1a/d1e/d74/dc8/dd5/f4b [373227,38756] 0 2024-09-17T01:52:25.135 INFO:tasks.workunit.client.1.smithi092.stdout:5/965: chown d0/de/d19/d1a/l147 53 1 2024-09-17T01:52:25.136 INFO:tasks.workunit.client.1.smithi092.stdout:5/966: write d0/de/d19/d1a/d1e/d52/d9a/fc2 [2294378,58388] 0 2024-09-17T01:52:25.138 INFO:tasks.workunit.client.1.smithi092.stdout:5/967: dread - d0/de/d19/d3c/d41/fc0 zero size 2024-09-17T01:52:25.139 INFO:tasks.workunit.client.1.smithi092.stdout:5/968: readlink d0/de/d19/d1a/l65 0 2024-09-17T01:52:25.145 INFO:tasks.workunit.client.1.smithi092.stdout:5/969: dread d0/de/d19/d1a/d1e/f71 [0,4194304] 0 2024-09-17T01:52:25.148 INFO:tasks.workunit.client.1.smithi092.stdout:5/970: creat d0/de/d19/d1a/d1e/d3e/d4c/f14a x:0 0 0 2024-09-17T01:52:25.155 INFO:tasks.workunit.client.1.smithi092.stdout:5/971: dwrite d0/d7e/d90/fb1 [0,4194304] 0 2024-09-17T01:52:25.178 INFO:tasks.workunit.client.1.smithi092.stdout:5/972: dread d0/d50/d70/f81 [0,4194304] 0 2024-09-17T01:52:25.180 INFO:tasks.workunit.client.1.smithi092.stdout:5/973: mknod d0/de/d19/d1a/d1e/d3e/d4c/c14b 0 2024-09-17T01:52:25.185 INFO:tasks.workunit.client.1.smithi092.stdout:5/974: getdents d0/d50/d70/df3 0 2024-09-17T01:52:25.194 INFO:tasks.workunit.client.1.smithi092.stdout:5/975: dwrite d0/de/d19/d1a/d1e/d3e/f59 [0,4194304] 0 2024-09-17T01:52:25.198 INFO:tasks.workunit.client.1.smithi092.stdout:5/976: creat d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/f14c x:0 0 0 2024-09-17T01:52:25.203 INFO:tasks.workunit.client.1.smithi092.stdout:5/977: creat d0/d50/d70/d78/f14d x:0 0 0 2024-09-17T01:52:25.206 INFO:tasks.workunit.client.1.smithi092.stdout:5/978: read d0/de/d19/d1a/d1e/d74/dc8/dd5/f102 [281359,122342] 0 2024-09-17T01:52:25.208 INFO:tasks.workunit.client.1.smithi092.stdout:5/979: dread - d0/de/d19/d1a/d1e/d52/d9a/db0/fe3 zero size 2024-09-17T01:52:25.212 INFO:tasks.workunit.client.1.smithi092.stdout:5/980: creat d0/de/d19/d1a/d1e/d3e/de2/f14e x:0 0 0 2024-09-17T01:52:25.215 INFO:tasks.workunit.client.1.smithi092.stdout:5/981: truncate d0/de/d19/d1a/f22 2415277 0 2024-09-17T01:52:25.236 INFO:tasks.workunit.client.1.smithi092.stdout:0/959: sync 2024-09-17T01:52:25.239 INFO:tasks.workunit.client.1.smithi092.stdout:0/960: dread d3/d2e/d55/ff1 [0,4194304] 0 2024-09-17T01:52:25.241 INFO:tasks.workunit.client.1.smithi092.stdout:0/961: readlink d3/d2e/d3b/d8f/lb5 0 2024-09-17T01:52:25.249 INFO:tasks.workunit.client.1.smithi092.stdout:5/982: dread d0/d50/d70/d78/d8f/f10b [0,4194304] 0 2024-09-17T01:52:25.252 INFO:tasks.workunit.client.1.smithi092.stdout:5/983: unlink d0/d23/l2d 0 2024-09-17T01:52:25.255 INFO:tasks.workunit.client.1.smithi092.stdout:5/984: creat d0/de/dd4/f14f x:0 0 0 2024-09-17T01:52:25.262 INFO:tasks.workunit.client.1.smithi092.stdout:5/985: link d0/de/d19/d1a/d1e/d3e/f63 d0/de/d19/d1a/d1e/d52/d9a/db0/dd3/f150 0 2024-09-17T01:52:25.264 INFO:tasks.workunit.client.1.smithi092.stdout:5/986: write d0/de/d19/d1a/d1e/d3e/d4c/f5d [4430751,125630] 0 2024-09-17T01:52:25.268 INFO:tasks.workunit.client.1.smithi092.stdout:5/987: mknod d0/de/d19/d3c/d41/dec/c151 0 2024-09-17T01:52:25.269 INFO:tasks.workunit.client.1.smithi092.stdout:0/962: dread d3/f4 [0,4194304] 0 2024-09-17T01:52:25.270 INFO:tasks.workunit.client.1.smithi092.stdout:5/988: readlink d0/de/d19/d1a/d1e/d3e/d4c/lc3 0 2024-09-17T01:52:25.270 INFO:tasks.workunit.client.1.smithi092.stdout:0/963: stat d3/d2e/d3b/d8f/f119 0 2024-09-17T01:52:25.273 INFO:tasks.workunit.client.1.smithi092.stdout:5/989: symlink d0/de/d19/d1a/d1e/d29/l152 0 2024-09-17T01:52:25.279 INFO:tasks.workunit.client.1.smithi092.stdout:5/990: link d0/de/d19/d1a/d1e/d74/f11f d0/de/d19/d3c/d41/f153 0 2024-09-17T01:52:25.279 INFO:tasks.workunit.client.1.smithi092.stdout:8/982: sync 2024-09-17T01:52:25.281 INFO:tasks.workunit.client.1.smithi092.stdout:8/983: chown d15/d25/d2b/d3d/d9f/d8e/la3 232 1 2024-09-17T01:52:25.284 INFO:tasks.workunit.client.1.smithi092.stdout:8/984: chown d15/d25/f5a 3131040 1 2024-09-17T01:52:25.285 INFO:tasks.workunit.client.1.smithi092.stdout:8/985: write f7 [1445585,75494] 0 2024-09-17T01:52:25.288 INFO:tasks.workunit.client.1.smithi092.stdout:5/991: dwrite d0/de/d19/d1a/d1e/d52/d9a/db0/fb8 [0,4194304] 0 2024-09-17T01:52:25.299 INFO:tasks.workunit.client.1.smithi092.stdout:0/964: dwrite d3/d2e/d3b/d8f/d5f/db1/dd8/f80 [0,4194304] 0 2024-09-17T01:52:25.302 INFO:tasks.workunit.client.1.smithi092.stdout:0/965: write d3/dee/d116/f110 [297611,28880] 0 2024-09-17T01:52:25.303 INFO:tasks.workunit.client.1.smithi092.stdout:0/966: stat d3/d2e/d3b/d8f/fc3 0 2024-09-17T01:52:25.308 INFO:tasks.workunit.client.1.smithi092.stdout:5/992: dwrite d0/de/d19/d1a/d1e/f4e [0,4194304] 0 2024-09-17T01:52:25.312 INFO:tasks.workunit.client.1.smithi092.stdout:0/967: dwrite d3/d73/f75 [0,4194304] 0 2024-09-17T01:52:25.313 INFO:tasks.workunit.client.1.smithi092.stdout:5/993: creat d0/de/d19/d1a/d1e/f154 x:0 0 0 2024-09-17T01:52:25.318 INFO:tasks.workunit.client.1.smithi092.stdout:0/968: unlink d3/d73/f9d 0 2024-09-17T01:52:25.319 INFO:tasks.workunit.client.1.smithi092.stdout:8/986: dread d15/d25/d2b/d63/fb8 [0,4194304] 0 2024-09-17T01:52:25.321 INFO:tasks.workunit.client.1.smithi092.stdout:0/969: write d3/f4 [3195488,73059] 0 2024-09-17T01:52:25.321 INFO:tasks.workunit.client.1.smithi092.stdout:0/970: stat d3/d2e/d55 0 2024-09-17T01:52:25.323 INFO:tasks.workunit.client.1.smithi092.stdout:0/971: write d3/dee/f54 [1712037,127676] 0 2024-09-17T01:52:25.324 INFO:tasks.workunit.client.1.smithi092.stdout:8/987: unlink d15/d25/d2b/d3d/d9f/l73 0 2024-09-17T01:52:25.326 INFO:tasks.workunit.client.1.smithi092.stdout:8/988: mkdir d15/d143 0 2024-09-17T01:52:25.327 INFO:tasks.workunit.client.1.smithi092.stdout:8/989: fsync d15/d25/f112 0 2024-09-17T01:52:25.328 INFO:tasks.workunit.client.1.smithi092.stdout:8/990: fdatasync d15/d25/d27/d6e/de0/f13c 0 2024-09-17T01:52:25.330 INFO:tasks.workunit.client.1.smithi092.stdout:0/972: rename d3/dee/d7d/dfb/f8c to d3/da/d15/dba/f129 0 2024-09-17T01:52:25.331 INFO:tasks.workunit.client.1.smithi092.stdout:0/973: readlink d3/d2e/d3b/d48/d76/lc7 0 2024-09-17T01:52:25.333 INFO:tasks.workunit.client.1.smithi092.stdout:8/991: creat d15/d25/d27/d87/f144 x:0 0 0 2024-09-17T01:52:25.334 INFO:tasks.workunit.client.1.smithi092.stdout:8/992: chown d15/d25/d27/d6e/d76/cf1 13186 1 2024-09-17T01:52:25.336 INFO:tasks.workunit.client.1.smithi092.stdout:8/993: creat d15/d6f/d8b/d110/f145 x:0 0 0 2024-09-17T01:52:25.339 INFO:tasks.workunit.client.1.smithi092.stdout:0/974: dread d3/dc8/fb4 [0,4194304] 0 2024-09-17T01:52:25.344 INFO:tasks.workunit.client.1.smithi092.stdout:8/994: dwrite d15/d25/d27/d6e/d95/dfb/d11d/d78/d9b/d109/f119 [0,4194304] 0 2024-09-17T01:52:25.345 INFO:tasks.workunit.client.1.smithi092.stdout:0/975: unlink d3/l9 0 2024-09-17T01:52:25.351 INFO:tasks.workunit.client.1.smithi092.stdout:8/995: rename d15/d25/d27/d6e/fac to d15/d25/d27/d6e/d95/f146 0 2024-09-17T01:52:25.352 INFO:tasks.workunit.client.1.smithi092.stdout:0/976: link d3/d2e/d3b/d8f/fbf d3/d2e/d3b/d72/f12a 0 2024-09-17T01:52:25.354 INFO:tasks.workunit.client.1.smithi092.stdout:8/996: write d15/d25/d27/d6e/d95/dda/f38 [1701454,102126] 0 2024-09-17T01:52:25.364 INFO:tasks.workunit.client.1.smithi092.stdout:8/997: creat d15/d25/d27/d6e/d95/dda/d40/f147 x:0 0 0 2024-09-17T01:52:25.364 INFO:tasks.workunit.client.1.smithi092.stdout:8/998: fdatasync d15/f1e 0 2024-09-17T01:52:25.367 INFO:tasks.workunit.client.1.smithi092.stdout:0/977: rename d3/d2e/d55/d63/d81/de3 to d3/d12b 0 2024-09-17T01:52:25.369 INFO:tasks.workunit.client.1.smithi092.stdout:8/999: read d15/d25/d27/d6e/d95/dda/d40/d42/ffd [1646927,116641] 0 2024-09-17T01:52:25.371 INFO:tasks.workunit.client.1.smithi092.stdout:0/978: truncate d3/d2e/d3b/d8f/d5f/f79 2308228 0 2024-09-17T01:52:25.379 INFO:tasks.workunit.client.1.smithi092.stdout:0/979: dread d3/d2e/d3b/d72/f89 [0,4194304] 0 2024-09-17T01:52:25.381 INFO:tasks.workunit.client.1.smithi092.stdout:0/980: chown d3/d2e/d3b/d72/d7a/lfc 1719978 1 2024-09-17T01:52:25.382 INFO:tasks.workunit.client.1.smithi092.stdout:0/981: write d3/d2e/d55/d63/f93 [2598192,81110] 0 2024-09-17T01:52:25.385 INFO:tasks.workunit.client.1.smithi092.stdout:0/982: dread d3/d2e/d55/d63/dc1/fd6 [0,4194304] 0 2024-09-17T01:52:25.607 INFO:tasks.workunit.client.1.smithi092.stdout:5/994: sync 2024-09-17T01:52:25.608 INFO:tasks.workunit.client.1.smithi092.stdout:5/995: write d0/fa9 [4117735,8134] 0 2024-09-17T01:52:25.611 INFO:tasks.workunit.client.1.smithi092.stdout:5/996: mknod d0/de/d19/d1a/d1e/d52/d9a/c155 0 2024-09-17T01:52:25.727 INFO:tasks.workunit.client.1.smithi092.stdout:0/983: sync 2024-09-17T01:52:25.729 INFO:tasks.workunit.client.1.smithi092.stdout:0/984: fdatasync d3/da/f9e 0 2024-09-17T01:52:25.744 INFO:tasks.workunit.client.1.smithi092.stdout:0/985: dread d3/dee/d7d/dfb/d3a/f57 [0,4194304] 0 2024-09-17T01:52:25.746 INFO:tasks.workunit.client.1.smithi092.stdout:0/986: chown d3/d2e/d55/d63/f6d 9455 1 2024-09-17T01:52:25.747 INFO:tasks.workunit.client.1.smithi092.stdout:0/987: symlink d3/d58/d8e/l12c 0 2024-09-17T01:52:25.749 INFO:tasks.workunit.client.1.smithi092.stdout:0/988: mkdir d3/d2e/d3b/d8f/d12d 0 2024-09-17T01:52:25.750 INFO:tasks.workunit.client.1.smithi092.stdout:0/989: rmdir d3/d2e/d55/dcf 39 2024-09-17T01:52:25.755 INFO:tasks.workunit.client.1.smithi092.stdout:5/997: sync 2024-09-17T01:52:25.756 INFO:tasks.workunit.client.1.smithi092.stdout:0/990: dwrite d3/d2e/d3b/f82 [0,4194304] 0 2024-09-17T01:52:25.758 INFO:tasks.workunit.client.1.smithi092.stdout:5/998: creat d0/de/d19/f156 x:0 0 0 2024-09-17T01:52:25.759 INFO:tasks.workunit.client.1.smithi092.stdout:5/999: dread - d0/d7e/fef zero size 2024-09-17T01:52:25.761 INFO:tasks.workunit.client.1.smithi092.stdout:0/991: getdents d3/d2e/d55/d63/d81/d9c/d112/d117 0 2024-09-17T01:52:25.765 INFO:tasks.workunit.client.1.smithi092.stdout:0/992: getdents d3/d2e/d3b/d72 0 2024-09-17T01:52:25.769 INFO:tasks.workunit.client.1.smithi092.stdout:0/993: dread d3/d2e/d55/d63/f93 [0,4194304] 0 2024-09-17T01:52:25.771 INFO:tasks.workunit.client.1.smithi092.stdout:0/994: fsync d3/f17 0 2024-09-17T01:52:25.773 INFO:tasks.workunit.client.1.smithi092.stdout:0/995: write d3/dee/d7d/dfb/f7b [169861,107331] 0 2024-09-17T01:52:25.776 INFO:tasks.workunit.client.1.smithi092.stdout:0/996: symlink d3/l12e 0 2024-09-17T01:52:25.790 INFO:tasks.workunit.client.1.smithi092.stdout:0/997: dread d3/d2e/d3b/d8f/f51 [0,4194304] 0 2024-09-17T01:52:25.790 INFO:tasks.workunit.client.1.smithi092.stdout:0/998: chown d3/d58/l103 308324 1 2024-09-17T01:52:25.793 INFO:tasks.workunit.client.1.smithi092.stdout:0/999: link d3/dee/d116/l6f d3/d2e/d3b/d72/l12f 0 2024-09-17T01:52:25.796 INFO:tasks.workunit.client.1.smithi092.stderr:+ rm -rf -- ./tmp.r0q6yJscA6 2024-09-17T01:52:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:26 smithi092 ceph-mon[33552]: pgmap v23: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 92 MiB/s rd, 220 MiB/s wr, 481 op/s 2024-09-17T01:52:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:26 smithi031 ceph-mon[27673]: pgmap v23: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 92 MiB/s rd, 220 MiB/s wr, 481 op/s 2024-09-17T01:52:28.366 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:28 smithi031 ceph-mon[27673]: pgmap v24: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 118 MiB/s rd, 281 MiB/s wr, 663 op/s 2024-09-17T01:52:28.367 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:28 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:28.367 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:28 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:28.367 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:28 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:52:28.367 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:28 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:28 smithi092 ceph-mon[33552]: pgmap v24: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 118 MiB/s rd, 281 MiB/s wr, 663 op/s 2024-09-17T01:52:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:28 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:28 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:28 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:52:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:28 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 -- 172.21.15.31:0/1713300664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 msgr2=0x7f7910101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 --2- 172.21.15.31:0/1713300664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f7910101890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7900009910 tx=0x7f7900009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 -- 172.21.15.31:0/1713300664 shutdown_connections 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 --2- 172.21.15.31:0/1713300664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f7910101890 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 --2- 172.21.15.31:0/1713300664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 0x7f7910100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 -- 172.21.15.31:0/1713300664 >> 172.21.15.31:0/1713300664 conn(0x7f79100fb7f0 msgr2=0x7f79100fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 -- 172.21.15.31:0/1713300664 shutdown_connections 2024-09-17T01:52:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.980+0000 7f7917364700 1 -- 172.21.15.31:0/1713300664 wait complete. 2024-09-17T01:52:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7917364700 1 Processor -- start 2024-09-17T01:52:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7917364700 1 -- start start 2024-09-17T01:52:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7917364700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 0x7f7910197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7917364700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f79101981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7917364700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79101987d0 con 0x7f7910101440 2024-09-17T01:52:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7917364700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910198940 con 0x7f7910100240 2024-09-17T01:52:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f79148ff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f79101981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f79148ff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f79101981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57146/0 (socket says 172.21.15.31:57146) 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f79148ff700 1 -- 172.21.15.31:0/4234555148 learned_addr learned my addr 172.21.15.31:0/4234555148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.981+0000 7f7915100700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 0x7f7910197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.982+0000 7f7915100700 1 -- 172.21.15.31:0/4234555148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 msgr2=0x7f79101981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.982+0000 7f7915100700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f79101981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.982+0000 7f7915100700 1 -- 172.21.15.31:0/4234555148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000095f0 con 0x7f7910100240 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.982+0000 7f7915100700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 0x7f7910197c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f790c00e940 tx=0x7f790c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.982+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c0041f0 con 0x7f7910100240 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.983+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791019d3d0 con 0x7f7910100240 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.983+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f790c004350 con 0x7f7910100240 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.983+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c003c80 con 0x7f7910100240 2024-09-17T01:52:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.983+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791019d920 con 0x7f7910100240 2024-09-17T01:52:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.984+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7910105520 con 0x7f7910100240 2024-09-17T01:52:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.984+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f790c00c7c0 con 0x7f7910100240 2024-09-17T01:52:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.985+0000 7f79067fc700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f78fc06d600 0x7f78fc06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.985+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f790c014070 con 0x7f7910100240 2024-09-17T01:52:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.985+0000 7f79148ff700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f78fc06d600 0x7f78fc06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.986+0000 7f79148ff700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f78fc06d600 0x7f78fc06fab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79101991a0 tx=0x7f7900005940 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:28.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:28.991+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f790c056940 con 0x7f7910100240 2024-09-17T01:52:29.316 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:29 smithi031 ceph-mon[27673]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:52:29.316 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:29 smithi031 ceph-mon[27673]: Upgrade: Need to upgrade myself (mgr.smithi092.tjdpfw) 2024-09-17T01:52:29.316 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:29 smithi031 ceph-mon[27673]: Upgrade: Need to upgrade myself (mgr.smithi092.tjdpfw) 2024-09-17T01:52:29.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.349+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7910061190 con 0x7f78fc06d600 2024-09-17T01:52:29.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.350+0000 7f79067fc700 1 -- 172.21.15.31:0/4234555148 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f7910061190 con 0x7f78fc06d600 2024-09-17T01:52:29.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.354+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f78fc06d600 msgr2=0x7f78fc06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.354+0000 7f7917364700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f78fc06d600 0x7f78fc06fab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79101991a0 tx=0x7f7900005940 comp rx=0 tx=0).stop 2024-09-17T01:52:29.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.355+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 msgr2=0x7f7910197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.355+0000 7f7917364700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 0x7f7910197c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f790c00e940 tx=0x7f790c00ec50 comp rx=0 tx=0).stop 2024-09-17T01:52:29.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.356+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 shutdown_connections 2024-09-17T01:52:29.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.356+0000 7f7917364700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f78fc06d600 0x7f78fc06fab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.356+0000 7f7917364700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7910100240 0x7f7910197c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.356+0000 7f7917364700 1 --2- 172.21.15.31:0/4234555148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7910101440 0x7f79101981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.356+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 >> 172.21.15.31:0/4234555148 conn(0x7f79100fb7f0 msgr2=0x7f7910102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:29.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.358+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 shutdown_connections 2024-09-17T01:52:29.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.358+0000 7f7917364700 1 -- 172.21.15.31:0/4234555148 wait complete. 2024-09-17T01:52:29.376 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:52:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:29 smithi092 ceph-mon[33552]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:52:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:29 smithi092 ceph-mon[33552]: Upgrade: Need to upgrade myself (mgr.smithi092.tjdpfw) 2024-09-17T01:52:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:29 smithi092 ceph-mon[33552]: Upgrade: Need to upgrade myself (mgr.smithi092.tjdpfw) 2024-09-17T01:52:29.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 -- 172.21.15.31:0/2668545517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4103350 msgr2=0x7efdd41057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 --2- 172.21.15.31:0/2668545517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4103350 0x7efdd41057b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009910 tx=0x7efdc8009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:29.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 -- 172.21.15.31:0/2668545517 shutdown_connections 2024-09-17T01:52:29.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 --2- 172.21.15.31:0/2668545517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4103350 0x7efdd41057b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 --2- 172.21.15.31:0/2668545517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4069ae0 0x7efdd4102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 -- 172.21.15.31:0/2668545517 >> 172.21.15.31:0/2668545517 conn(0x7efdd40fa7a0 msgr2=0x7efdd40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:29.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 -- 172.21.15.31:0/2668545517 shutdown_connections 2024-09-17T01:52:29.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.549+0000 7efdd8f35700 1 -- 172.21.15.31:0/2668545517 wait complete. 2024-09-17T01:52:29.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.550+0000 7efdd8f35700 1 Processor -- start 2024-09-17T01:52:29.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.550+0000 7efdd8f35700 1 -- start start 2024-09-17T01:52:29.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd8f35700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 0x7efdd4195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:29.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd8f35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4103350 0x7efdd4196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd8f35700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd41969b0 con 0x7efdd4069ae0 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd8f35700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4196af0 con 0x7efdd4103350 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 0x7efdd4195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 0x7efdd4195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57160/0 (socket says 172.21.15.31:57160) 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd259c700 1 -- 172.21.15.31:0/3311371542 learned_addr learned my addr 172.21.15.31:0/3311371542 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.551+0000 7efdd1d9b700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4103350 0x7efdd4196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdd259c700 1 -- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4103350 msgr2=0x7efdd4196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdd259c700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4103350 0x7efdd4196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdd259c700 1 -- 172.21.15.31:0/3311371542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80095f0 con 0x7efdd4069ae0 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdd1d9b700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4103350 0x7efdd4196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:52:29.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdd259c700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 0x7efdd4195e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e8c0 tx=0x7efdc400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:29.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc400cba0 con 0x7efdd4069ae0 2024-09-17T01:52:29.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd40fec50 con 0x7efdd4069ae0 2024-09-17T01:52:29.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.552+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efdc400eec0 con 0x7efdd4069ae0 2024-09-17T01:52:29.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.553+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd40ff1a0 con 0x7efdd4069ae0 2024-09-17T01:52:29.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.553+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc4018610 con 0x7efdd4069ae0 2024-09-17T01:52:29.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.554+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd418fc30 con 0x7efdd4069ae0 2024-09-17T01:52:29.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.555+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7efdc400cd00 con 0x7efdd4069ae0 2024-09-17T01:52:29.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.555+0000 7efdc37fe700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7efdbc06d650 0x7efdbc06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:29.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.556+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7efdc4014070 con 0x7efdd4069ae0 2024-09-17T01:52:29.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.556+0000 7efdd1d9b700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7efdbc06d650 0x7efdbc06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:29.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.556+0000 7efdd1d9b700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7efdbc06d650 0x7efdbc06fb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009fd0 tx=0x7efdc8005940 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:29.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.561+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7efdc40539d0 con 0x7efdd4069ae0 2024-09-17T01:52:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.954+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdd4061190 con 0x7efdbc06d650 2024-09-17T01:52:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.956+0000 7efdc37fe700 1 -- 172.21.15.31:0/3311371542 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7efdd4061190 con 0x7efdbc06d650 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7efdbc06d650 msgr2=0x7efdbc06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7efdbc06d650 0x7efdbc06fb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009fd0 tx=0x7efdc8005940 comp rx=0 tx=0).stop 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 msgr2=0x7efdd4195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 0x7efdd4195e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e8c0 tx=0x7efdc400ec80 comp rx=0 tx=0).stop 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 shutdown_connections 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7efdbc06d650 0x7efdbc06fb00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdd4069ae0 0x7efdd4195e50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 --2- 172.21.15.31:0/3311371542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efdd4103350 0x7efdd4196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.958+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 >> 172.21.15.31:0/3311371542 conn(0x7efdd40fa7a0 msgr2=0x7efdd40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.959+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 shutdown_connections 2024-09-17T01:52:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:29.959+0000 7efdd8f35700 1 -- 172.21.15.31:0/3311371542 wait complete. 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 -- 172.21.15.31:0/1146959400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 msgr2=0x7f93ec100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 --2- 172.21.15.31:0/1146959400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 0x7f93ec100790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009910 tx=0x7f93e0009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 -- 172.21.15.31:0/1146959400 shutdown_connections 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 --2- 172.21.15.31:0/1146959400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 0x7f93ec100790 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 --2- 172.21.15.31:0/1146959400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 -- 172.21.15.31:0/1146959400 >> 172.21.15.31:0/1146959400 conn(0x7f93ec0fa6d0 msgr2=0x7f93ec0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 -- 172.21.15.31:0/1146959400 shutdown_connections 2024-09-17T01:52:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.102+0000 7f93f16de700 1 -- 172.21.15.31:0/1146959400 wait complete. 2024-09-17T01:52:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.103+0000 7f93f16de700 1 Processor -- start 2024-09-17T01:52:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.103+0000 7f93f16de700 1 -- start start 2024-09-17T01:52:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.103+0000 7f93f16de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.103+0000 7f93f16de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 0x7f93ec1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.103+0000 7f93f16de700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1987e0 con 0x7f93ec100340 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.103+0000 7f93f16de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec198950 con 0x7f93ec0ff140 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:34722/0 (socket says 172.21.15.31:34722) 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 -- 172.21.15.31:0/2928346185 learned_addr learned my addr 172.21.15.31:0/2928346185 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93ea7fc700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 0x7f93ec1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 -- 172.21.15.31:0/2928346185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 msgr2=0x7f93ec1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 0x7f93ec1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 -- 172.21.15.31:0/2928346185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00095f0 con 0x7f93ec0ff140 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93eaffd700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec197ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00e8f0 tx=0x7f93dc00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.104+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc009790 con 0x7f93ec0ff140 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.105+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f93dc00c810 con 0x7f93ec0ff140 2024-09-17T01:52:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.105+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc003d20 con 0x7f93ec0ff140 2024-09-17T01:52:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.105+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec19d3e0 con 0x7f93ec0ff140 2024-09-17T01:52:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.106+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec19d930 con 0x7f93ec0ff140 2024-09-17T01:52:30.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.107+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec107c90 con 0x7f93ec0ff140 2024-09-17T01:52:30.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.108+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f93dc0041f0 con 0x7f93ec0ff140 2024-09-17T01:52:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.109+0000 7f93d3fff700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f93d406d5f0 0x7f93d406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.109+0000 7f93ea7fc700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f93d406d5f0 0x7f93d406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.109+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f93dc014070 con 0x7f93ec0ff140 2024-09-17T01:52:30.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.110+0000 7f93ea7fc700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f93d406d5f0 0x7f93d406faa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93ec1991b0 tx=0x7f93e0005fd0 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:30.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.115+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f93dc057040 con 0x7f93ec0ff140 2024-09-17T01:52:30.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: pgmap v25: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 68 MiB/s rd, 160 MiB/s wr, 408 op/s 2024-09-17T01:52:30.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:30.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:30.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:52:30.214 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:52:30.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:52:30.215 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:30 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: pgmap v25: 65 pgs: 65 active+clean; 3.5 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 68 MiB/s rd, 160 MiB/s wr, 408 op/s 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:52:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:30 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:52:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.505+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93ec0694e0 con 0x7f93d406d5f0 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.519+0000 7f93d3fff700 1 -- 172.21.15.31:0/2928346185 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f93ec0694e0 con 0x7f93d406d5f0 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (7m) 17s ago 8m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (8m) 17s ago 8m 7738k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (7m) 37s ago 7m 7646k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (8m) 17s ago 8m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:52:30.517 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (7m) 37s ago 7m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (7m) 17s ago 8m 86.1M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (3m) 17s ago 3m 70.2M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (3m) 17s ago 3m 107M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (3m) 37s ago 3m 64.6M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (3m) 37s ago 3m 111M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:9283,8765,8443 running (10m) 17s ago 10m 184M - 18.2.0 dc2bc1663786 5a9379d38d8b 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (69s) 37s ago 7m 481M - 19.1.1-330-gc2ddf972 ebb0615149de d8e0fe42865a 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (10m) 17s ago 10m 47.8M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (7m) 37s ago 7m 38.7M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (8m) 17s ago 8m 16.6M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (7m) 37s ago 7m 15.4M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (6m) 17s ago 6m 115M 1217M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:52:30.518 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (6m) 17s ago 6m 133M 1217M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:52:30.519 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (5m) 17s ago 5m 107M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:52:30.519 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (5m) 37s ago 5m 139M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:52:30.519 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (5m) 37s ago 5m 129M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:52:30.519 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (4m) 37s ago 4m 120M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:52:30.519 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 starting - - - - 2024-09-17T01:52:30.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f93d406d5f0 msgr2=0x7f93d406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f93d406d5f0 0x7f93d406faa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93ec1991b0 tx=0x7f93e0005fd0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 msgr2=0x7f93ec197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec197ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00e8f0 tx=0x7f93dc00ec00 comp rx=0 tx=0).stop 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 shutdown_connections 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f93d406d5f0 0x7f93d406faa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93ec0ff140 0x7f93ec197ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 --2- 172.21.15.31:0/2928346185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93ec100340 0x7f93ec1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 >> 172.21.15.31:0/2928346185 conn(0x7f93ec0fa6d0 msgr2=0x7f93ec068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 shutdown_connections 2024-09-17T01:52:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.522+0000 7f93f16de700 1 -- 172.21.15.31:0/2928346185 wait complete. 2024-09-17T01:52:30.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.646+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/3284526600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 msgr2=0x7fc9ac0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.646+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/3284526600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac0ff540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009910 tx=0x7fc9a0009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/3284526600 shutdown_connections 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/3284526600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 0x7fc9ac100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/3284526600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac0ff540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/3284526600 >> 172.21.15.31:0/3284526600 conn(0x7fc9ac0fa780 msgr2=0x7fc9ac0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/3284526600 shutdown_connections 2024-09-17T01:52:30.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/3284526600 wait complete. 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.647+0000 7fc9b2ec5700 1 Processor -- start 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b2ec5700 1 -- start start 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b2ec5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac1949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b2ec5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 0x7fc9ac194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b2ec5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac195510 con 0x7fc9ac0ff130 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b2ec5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac195650 con 0x7fc9ac1003d0 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b0c61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac1949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 0x7fc9ac194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b0c61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac1949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57178/0 (socket says 172.21.15.31:57178) 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b0c61700 1 -- 172.21.15.31:0/2781214244 learned_addr learned my addr 172.21.15.31:0/2781214244 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9abfff700 1 -- 172.21.15.31:0/2781214244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 msgr2=0x7fc9ac1949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9abfff700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac1949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9abfff700 1 -- 172.21.15.31:0/2781214244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00095f0 con 0x7fc9ac1003d0 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9b0c61700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac1949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.648+0000 7fc9abfff700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 0x7fc9ac194ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc99800e970 tx=0x7fc99800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.649+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc99800c9d0 con 0x7fc9ac1003d0 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.649+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac19a100 con 0x7fc9ac1003d0 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.649+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc998010430 con 0x7fc9ac1003d0 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.649+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc998018650 con 0x7fc9ac1003d0 2024-09-17T01:52:30.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.649+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac19a650 con 0x7fc9ac1003d0 2024-09-17T01:52:30.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.650+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac107c10 con 0x7fc9ac1003d0 2024-09-17T01:52:30.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.651+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7fc9980105a0 con 0x7fc9ac1003d0 2024-09-17T01:52:30.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.651+0000 7fc9a9ffb700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc99c06d600 0x7fc99c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.651+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc998014070 con 0x7fc9ac1003d0 2024-09-17T01:52:30.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.652+0000 7fc9b0c61700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc99c06d600 0x7fc99c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.652+0000 7fc9b0c61700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc99c06d600 0x7fc99c06fab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a0005940 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:30.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:30.657+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc9980539d0 con 0x7fc9ac1003d0 2024-09-17T01:52:31.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.054+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9ac107dd0 con 0x7fc9ac1003d0 2024-09-17T01:52:31.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.054+0000 7fc9a9ffb700 1 -- 172.21.15.31:0/2781214244 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7fc99805a2f0 con 0x7fc9ac1003d0 2024-09-17T01:52:31.052 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:52:31.052 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:52:31.052 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:52:31.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-17T01:52:31.053 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:52:31.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:52:31.054 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc99c06d600 msgr2=0x7fc99c06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc99c06d600 0x7fc99c06fab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a0005940 comp rx=0 tx=0).stop 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 msgr2=0x7fc9ac194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 0x7fc9ac194ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc99800e970 tx=0x7fc99800ec80 comp rx=0 tx=0).stop 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 shutdown_connections 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7fc99c06d600 0x7fc99c06fab0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0ff130 0x7fc9ac1949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 --2- 172.21.15.31:0/2781214244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9ac1003d0 0x7fc9ac194ef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 >> 172.21.15.31:0/2781214244 conn(0x7fc9ac0fa780 msgr2=0x7fc9ac103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 shutdown_connections 2024-09-17T01:52:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.057+0000 7fc9b2ec5700 1 -- 172.21.15.31:0/2781214244 wait complete. 2024-09-17T01:52:31.210 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:31 smithi031 ceph-mon[27673]: Upgrade: Updating mgr.smithi031.ealpiz 2024-09-17T01:52:31.210 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:31 smithi031 ceph-mon[27673]: Deploying daemon mgr.smithi031.ealpiz on smithi031 2024-09-17T01:52:31.210 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:31 smithi031 ceph-mon[27673]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:31.211 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:31 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:31.211 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:31 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2781214244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.227+0000 7f32e876f700 1 -- 172.21.15.31:0/1128977384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e00723e0 msgr2=0x7f32e0109e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.227+0000 7f32e876f700 1 --2- 172.21.15.31:0/1128977384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e00723e0 0x7f32e0109e00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009910 tx=0x7f32dc009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.227+0000 7f32e876f700 1 -- 172.21.15.31:0/1128977384 shutdown_connections 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.227+0000 7f32e876f700 1 --2- 172.21.15.31:0/1128977384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e00723e0 0x7f32e0109e00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.227+0000 7f32e876f700 1 --2- 172.21.15.31:0/1128977384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e0071a00 0x7f32e0071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.227+0000 7f32e876f700 1 -- 172.21.15.31:0/1128977384 >> 172.21.15.31:0/1128977384 conn(0x7f32e006d110 msgr2=0x7f32e006f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:31.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.228+0000 7f32e876f700 1 -- 172.21.15.31:0/1128977384 shutdown_connections 2024-09-17T01:52:31.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.228+0000 7f32e876f700 1 -- 172.21.15.31:0/1128977384 wait complete. 2024-09-17T01:52:31.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.228+0000 7f32e876f700 1 Processor -- start 2024-09-17T01:52:31.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.228+0000 7f32e876f700 1 -- start start 2024-09-17T01:52:31.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e876f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e0071a00 0x7f32e01173f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:31.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e876f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e00723e0 0x7f32e0117930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:31.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e876f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0117f50 con 0x7f32e0071a00 2024-09-17T01:52:31.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e876f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0118090 con 0x7f32e00723e0 2024-09-17T01:52:31.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e5d0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e00723e0 0x7f32e0117930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:31.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e5d0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e00723e0 0x7f32e0117930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:34750/0 (socket says 172.21.15.31:34750) 2024-09-17T01:52:31.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e5d0a700 1 -- 172.21.15.31:0/3536530551 learned_addr learned my addr 172.21.15.31:0/3536530551 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:31.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.229+0000 7f32e650b700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e0071a00 0x7f32e01173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32e650b700 1 -- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e00723e0 msgr2=0x7f32e0117930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32e650b700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e00723e0 0x7f32e0117930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32e650b700 1 -- 172.21.15.31:0/3536530551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc0095f0 con 0x7f32e0071a00 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32e650b700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e0071a00 0x7f32e01173f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32d000bcf0 tx=0x7f32d000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d000cbd0 con 0x7f32e0071a00 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e0118b20 con 0x7f32e0071a00 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32d000cd30 con 0x7f32e0071a00 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d0012810 con 0x7f32e0071a00 2024-09-17T01:52:31.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.230+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e0119070 con 0x7f32e0071a00 2024-09-17T01:52:31.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.232+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e010ccc0 con 0x7f32e0071a00 2024-09-17T01:52:31.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.233+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f32d0012970 con 0x7f32e0071a00 2024-09-17T01:52:31.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.233+0000 7f32d77fe700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f32c806d5f0 0x7f32c806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:31.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.234+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f32d0006e40 con 0x7f32e0071a00 2024-09-17T01:52:31.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.234+0000 7f32e5d0a700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f32c806d5f0 0x7f32c806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:31.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.236+0000 7f32e5d0a700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f32c806d5f0 0x7f32c806faa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32dc006010 tx=0x7f32dc00b540 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:31.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.242+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f32d00509d0 con 0x7f32e0071a00 2024-09-17T01:52:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:31 smithi092 ceph-mon[33552]: Upgrade: Updating mgr.smithi031.ealpiz 2024-09-17T01:52:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:31 smithi092 ceph-mon[33552]: Deploying daemon mgr.smithi031.ealpiz on smithi031 2024-09-17T01:52:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:31 smithi092 ceph-mon[33552]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:31 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:31 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2781214244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:52:31.665 INFO:teuthology.orchestra.run.smithi031.stdout:e16 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 16 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:51:19.622148+0000 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:52:31.667 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:52:31.668 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:52:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:52:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:52:31.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.666+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32e0119710 con 0x7f32e0071a00 2024-09-17T01:52:31.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.667+0000 7f32d77fe700 1 -- 172.21.15.31:0/3536530551 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1863 (secure 0 0 0) 0x7f32d0019760 con 0x7f32e0071a00 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f32c806d5f0 msgr2=0x7f32c806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f32c806d5f0 0x7f32c806faa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32dc006010 tx=0x7f32dc00b540 comp rx=0 tx=0).stop 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e0071a00 msgr2=0x7f32e01173f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e0071a00 0x7f32e01173f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32d000bcf0 tx=0x7f32d000c040 comp rx=0 tx=0).stop 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 shutdown_connections 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f32c806d5f0 0x7f32c806faa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32e0071a00 0x7f32e01173f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 --2- 172.21.15.31:0/3536530551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32e00723e0 0x7f32e0117930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 >> 172.21.15.31:0/3536530551 conn(0x7f32e006d110 msgr2=0x7f32e006e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 shutdown_connections 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.670+0000 7f32e876f700 1 -- 172.21.15.31:0/3536530551 wait complete. 2024-09-17T01:52:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 -- 172.21.15.31:0/2776645709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 msgr2=0x7f11600fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 --2- 172.21.15.31:0/2776645709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 0x7f11600fe910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f115c009910 tx=0x7f115c009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 -- 172.21.15.31:0/2776645709 shutdown_connections 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 --2- 172.21.15.31:0/2776645709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f1160101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 --2- 172.21.15.31:0/2776645709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 0x7f11600fe910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 -- 172.21.15.31:0/2776645709 >> 172.21.15.31:0/2776645709 conn(0x7f11600f9f10 msgr2=0x7f11600fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:31.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 -- 172.21.15.31:0/2776645709 shutdown_connections 2024-09-17T01:52:31.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.813+0000 7f1167779700 1 -- 172.21.15.31:0/2776645709 wait complete. 2024-09-17T01:52:31.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.814+0000 7f1167779700 1 Processor -- start 2024-09-17T01:52:31.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.814+0000 7f1167779700 1 -- start start 2024-09-17T01:52:31.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.814+0000 7f1167779700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 0x7f1160100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:31.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1167779700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f11600ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:31.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1167779700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1160199780 con 0x7f11600fe500 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1167779700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601998c0 con 0x7f11600fee50 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f11600ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f11600ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:34766/0 (socket says 172.21.15.31:34766) 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 -- 172.21.15.31:0/2130146929 learned_addr learned my addr 172.21.15.31:0/2130146929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1165515700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 0x7f1160100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 -- 172.21.15.31:0/2130146929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 msgr2=0x7f1160100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 0x7f1160100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 -- 172.21.15.31:0/2130146929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0095f0 con 0x7f11600fee50 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1164d14700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f11600ff530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f115000e8c0 tx=0x7f115000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:31.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f115000c9b0 con 0x7f11600fee50 2024-09-17T01:52:31.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.815+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11600ffa70 con 0x7f11600fee50 2024-09-17T01:52:31.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.816+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11600fff90 con 0x7f11600fee50 2024-09-17T01:52:31.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.816+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1150010430 con 0x7f11600fee50 2024-09-17T01:52:31.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.816+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11500185f0 con 0x7f11600fee50 2024-09-17T01:52:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.817+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1144005320 con 0x7f11600fee50 2024-09-17T01:52:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.817+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f115000cb10 con 0x7f11600fee50 2024-09-17T01:52:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.818+0000 7f11567fc700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f114c06d650 0x7f114c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.818+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1150014070 con 0x7f11600fee50 2024-09-17T01:52:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.818+0000 7f1165515700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f114c06d650 0x7f114c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:31.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.819+0000 7f1165515700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f114c06d650 0x7f114c06fb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f115c009fd0 tx=0x7f115c005940 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:31.825+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f11500539d0 con 0x7f11600fee50 2024-09-17T01:52:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.164+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 --> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1144000bf0 con 0x7f114c06d650 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.165+0000 7f11567fc700 1 -- 172.21.15.31:0/2130146929 <== mgr.24401 v2:172.21.15.92:6828/1181363142 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f1144000bf0 con 0x7f114c06d650 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [], 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:52:32.163 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:52:32.164 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:52:32.164 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f114c06d650 msgr2=0x7f114c06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f114c06d650 0x7f114c06fb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f115c009fd0 tx=0x7f115c005940 comp rx=0 tx=0).stop 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 msgr2=0x7f11600ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f11600ff530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f115000e8c0 tx=0x7f115000ebd0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 shutdown_connections 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f114c06d650 0x7f114c06fb00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600fe500 0x7f1160100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 --2- 172.21.15.31:0/2130146929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11600fee50 0x7f11600ff530 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 >> 172.21.15.31:0/2130146929 conn(0x7f11600f9f10 msgr2=0x7f11601047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 shutdown_connections 2024-09-17T01:52:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.168+0000 7f1167779700 1 -- 172.21.15.31:0/2130146929 wait complete. 2024-09-17T01:52:32.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:32 smithi031 ceph-mon[27673]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:32.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:32 smithi031 ceph-mon[27673]: pgmap v26: 65 pgs: 65 active+clean; 2.6 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 69 MiB/s rd, 161 MiB/s wr, 504 op/s 2024-09-17T01:52:32.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:32 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3536530551' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:52:32.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 -- 172.21.15.31:0/712789429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738100250 msgr2=0x7f3738100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 --2- 172.21.15.31:0/712789429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738100250 0x7f3738100660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3728009910 tx=0x7f3728009c20 comp rx=0 tx=0).stop 2024-09-17T01:52:32.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 -- 172.21.15.31:0/712789429 shutdown_connections 2024-09-17T01:52:32.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 --2- 172.21.15.31:0/712789429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738101450 0x7f37381018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 --2- 172.21.15.31:0/712789429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738100250 0x7f3738100660 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 -- 172.21.15.31:0/712789429 >> 172.21.15.31:0/712789429 conn(0x7f37380fb7e0 msgr2=0x7f37380fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:32.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 -- 172.21.15.31:0/712789429 shutdown_connections 2024-09-17T01:52:32.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.340+0000 7f373dcae700 1 -- 172.21.15.31:0/712789429 wait complete. 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.341+0000 7f373dcae700 1 Processor -- start 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.341+0000 7f373dcae700 1 -- start start 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f373dcae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 0x7f3738197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f373dcae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738101450 0x7f3738198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f373dcae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3738198870 con 0x7f3738101450 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f373dcae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373819d280 con 0x7f3738100250 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738101450 0x7f3738198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f37377fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 0x7f3738197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f37377fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 0x7f3738197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:34774/0 (socket says 172.21.15.31:34774) 2024-09-17T01:52:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f37377fe700 1 -- 172.21.15.31:0/3437488975 learned_addr learned my addr 172.21.15.31:0/3437488975 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f37377fe700 1 -- 172.21.15.31:0/3437488975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738101450 msgr2=0x7f3738198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f37377fe700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738101450 0x7f3738198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.342+0000 7f37377fe700 1 -- 172.21.15.31:0/3437488975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37280095f0 con 0x7f3738100250 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.343+0000 7f37377fe700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 0x7f3738197d10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f372800fa00 tx=0x7f372800fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.343+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372801d070 con 0x7f3738100250 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.343+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f372800fe90 con 0x7f3738100250 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.343+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373819d420 con 0x7f3738100250 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.343+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3728017630 con 0x7f3738100250 2024-09-17T01:52:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.343+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373819d8e0 con 0x7f3738100250 2024-09-17T01:52:32.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.344+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3738105530 con 0x7f3738100250 2024-09-17T01:52:32.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.345+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) v1 ==== 91261+0+0 (secure 0 0 0) 0x7f3728003680 con 0x7f3738100250 2024-09-17T01:52:32.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.345+0000 7f3734ff9700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f372006d600 0x7f372006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:32.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.345+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f372808e130 con 0x7f3738100250 2024-09-17T01:52:32.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.345+0000 7f3736ffd700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f372006d600 0x7f372006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.346+0000 7f3736ffd700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f372006d600 0x7f372006fab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f372c009c60 tx=0x7f372c009260 comp rx=0 tx=0).ready entity=mgr.24401 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:32.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.350+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3728057810 con 0x7f3738100250 2024-09-17T01:52:32.389 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:32 smithi092 ceph-mon[33552]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:32.389 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:32 smithi092 ceph-mon[33552]: pgmap v26: 65 pgs: 65 active+clean; 2.6 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 69 MiB/s rd, 161 MiB/s wr, 504 op/s 2024-09-17T01:52:32.389 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:32 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3536530551' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:52:32.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.744+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f373802cc30 con 0x7f3738100250 2024-09-17T01:52:32.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.744+0000 7f3734ff9700 1 -- 172.21.15.31:0/3437488975 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3728003e60 con 0x7f3738100250 2024-09-17T01:52:32.743 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f372006d600 msgr2=0x7f372006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f372006d600 0x7f372006fab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f372c009c60 tx=0x7f372c009260 comp rx=0 tx=0).stop 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 msgr2=0x7f3738197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 0x7f3738197d10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f372800fa00 tx=0x7f372800fa30 comp rx=0 tx=0).stop 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 shutdown_connections 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:6828/1181363142,v1:172.21.15.92:6829/1181363142] conn(0x7f372006d600 0x7f372006fab0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3738100250 0x7f3738197d10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 --2- 172.21.15.31:0/3437488975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3738101450 0x7f3738198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.747+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 >> 172.21.15.31:0/3437488975 conn(0x7f37380fb7e0 msgr2=0x7f3738102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:32.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.748+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 shutdown_connections 2024-09-17T01:52:32.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:52:32.748+0000 7f373dcae700 1 -- 172.21.15.31:0/3437488975 wait complete. 2024-09-17T01:52:32.799 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:52:32.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T01:52:33.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:33 smithi092 ceph-mon[33552]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:33.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:33 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/3437488975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:52:33.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:33 smithi031 ceph-mon[27673]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:33.512 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:33 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/3437488975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:52:34.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:34 smithi092 ceph-mon[33552]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 123 MiB/s wr, 443 op/s 2024-09-17T01:52:34.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:34 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:34.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:34 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:34.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:34 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:34.250 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:34 smithi031 ceph-mon[27673]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 123 MiB/s wr, 443 op/s 2024-09-17T01:52:34.250 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:34 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:34.250 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:34 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:34.250 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:34 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:36 smithi092 ceph-mon[33552]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 27 MiB/s rd, 63 MiB/s wr, 294 op/s 2024-09-17T01:52:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:36 smithi031 ceph-mon[27673]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 27 MiB/s rd, 63 MiB/s wr, 294 op/s 2024-09-17T01:52:36.681 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:52:36.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-17T01:52:37.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:37 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:52:37.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:37 smithi031 ceph-mon[27673]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:52:38.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:38 smithi031 ceph-mon[27673]: pgmap v29: 65 pgs: 65 active+clean; 794 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 28 MiB/s rd, 64 MiB/s wr, 413 op/s 2024-09-17T01:52:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:38 smithi092 ceph-mon[33552]: pgmap v29: 65 pgs: 65 active+clean; 794 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 28 MiB/s rd, 64 MiB/s wr, 413 op/s 2024-09-17T01:52:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:40 smithi092 ceph-mon[33552]: pgmap v30: 65 pgs: 65 active+clean; 794 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-09-17T01:52:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:40 smithi031 ceph-mon[27673]: pgmap v30: 65 pgs: 65 active+clean; 794 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-09-17T01:52:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: Standby manager daemon smithi031.ealpiz restarted 2024-09-17T01:52:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: Standby manager daemon smithi031.ealpiz started 2024-09-17T01:52:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/crt"}]: dispatch 2024-09-17T01:52:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:52:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/key"}]: dispatch 2024-09-17T01:52:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:52:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:41 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: Standby manager daemon smithi031.ealpiz restarted 2024-09-17T01:52:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: Standby manager daemon smithi031.ealpiz started 2024-09-17T01:52:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/crt"}]: dispatch 2024-09-17T01:52:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:52:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi031.ealpiz/key"}]: dispatch 2024-09-17T01:52:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:52:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:41 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:42 smithi092 ceph-mon[33552]: pgmap v31: 65 pgs: 65 active+clean; 461 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 343 op/s 2024-09-17T01:52:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:42 smithi092 ceph-mon[33552]: mgrmap e25: smithi092.tjdpfw(active, since 56s), standbys: smithi031.ealpiz 2024-09-17T01:52:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:42 smithi031 ceph-mon[27673]: pgmap v31: 65 pgs: 65 active+clean; 461 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 343 op/s 2024-09-17T01:52:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:42 smithi031 ceph-mon[27673]: mgrmap e25: smithi092.tjdpfw(active, since 56s), standbys: smithi031.ealpiz 2024-09-17T01:52:44.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:44 smithi092 ceph-mon[33552]: pgmap v32: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 322 op/s 2024-09-17T01:52:44.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:44 smithi031 ceph-mon[27673]: pgmap v32: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 322 op/s 2024-09-17T01:52:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:46 smithi092 ceph-mon[33552]: pgmap v33: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 304 op/s 2024-09-17T01:52:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:46 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:46 smithi031 ceph-mon[27673]: pgmap v33: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 304 op/s 2024-09-17T01:52:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:46 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:48.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:48 smithi092 ceph-mon[33552]: pgmap v34: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 541 op/s 2024-09-17T01:52:48.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:48 smithi031 ceph-mon[27673]: pgmap v34: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 541 op/s 2024-09-17T01:52:50.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:50 smithi092 ceph-mon[33552]: pgmap v35: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 421 op/s 2024-09-17T01:52:50.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:50 smithi031 ceph-mon[27673]: pgmap v35: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 421 op/s 2024-09-17T01:52:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:52 smithi092 ceph-mon[33552]: pgmap v36: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 619 op/s 2024-09-17T01:52:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:52 smithi031 ceph-mon[27673]: pgmap v36: 65 pgs: 65 active+clean; 292 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 619 op/s 2024-09-17T01:52:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:54 smithi092 ceph-mon[33552]: pgmap v37: 65 pgs: 65 active+clean; 290 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 561 op/s 2024-09-17T01:52:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:54 smithi031 ceph-mon[27673]: pgmap v37: 65 pgs: 65 active+clean; 290 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 561 op/s 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:56.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr fail", "who": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr fail", "who": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd='[{"prefix": "mgr fail", "who": "smithi092.tjdpfw"}]': finished 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: mgrmap e26: smithi031.ealpiz(active, starting, since 0.0060686s) 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:52:56.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:56.017 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:52:56.018 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:56.018 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:55 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:52:56.196 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:56.196 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:56.196 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:52:56.196 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:52:56.196 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' 2024-09-17T01:52:56.196 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 172.21.15.92:0/2250342913' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr fail", "who": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "mgr fail", "who": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.24401 ' entity='mgr.smithi092.tjdpfw' cmd='[{"prefix": "mgr fail", "who": "smithi092.tjdpfw"}]': finished 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: mgrmap e26: smithi031.ealpiz(active, starting, since 0.0060686s) 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:52:56.197 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:52:56.198 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:55 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:52:57.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:57 smithi092 ceph-mon[33552]: mgrmap e27: smithi031.ealpiz(active, since 1.10184s) 2024-09-17T01:52:57.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:57 smithi092 ceph-mon[33552]: pgmap v3: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:52:57.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:57 smithi031 ceph-mon[27673]: mgrmap e27: smithi031.ealpiz(active, since 1.10184s) 2024-09-17T01:52:57.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:57 smithi031 ceph-mon[27673]: pgmap v3: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:52:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:58 smithi092 ceph-mon[33552]: pgmap v4: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:52:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:58 smithi092 ceph-mon[33552]: mgrmap e28: smithi031.ealpiz(active, since 2s) 2024-09-17T01:52:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:58 smithi031 ceph-mon[27673]: pgmap v4: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:52:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:58 smithi031 ceph-mon[27673]: mgrmap e28: smithi031.ealpiz(active, since 2s) 2024-09-17T01:52:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:59 smithi031 ceph-mon[27673]: [17/Sep/2024:01:52:57] ENGINE Bus STARTING 2024-09-17T01:52:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:59 smithi031 ceph-mon[27673]: [17/Sep/2024:01:52:58] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:52:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:59 smithi031 ceph-mon[27673]: [17/Sep/2024:01:52:58] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:59 smithi031 ceph-mon[27673]: [17/Sep/2024:01:52:58] ENGINE Bus STARTED 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:52:59 smithi031 ceph-mon[27673]: [17/Sep/2024:01:52:58] ENGINE Error in HTTPServer.serve 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Traceback (most recent call last): 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._run(expiration_interval) 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:52:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: s = self.context.wrap_socket( 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: return self.sslsocket_class._create( 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self.do_handshake() 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._sslobj.do_handshake() 2024-09-17T01:52:59.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:59 smithi092 ceph-mon[33552]: [17/Sep/2024:01:52:57] ENGINE Bus STARTING 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:59 smithi092 ceph-mon[33552]: [17/Sep/2024:01:52:58] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:59 smithi092 ceph-mon[33552]: [17/Sep/2024:01:52:58] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:59 smithi092 ceph-mon[33552]: [17/Sep/2024:01:52:58] ENGINE Bus STARTED 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:52:59 smithi092 ceph-mon[33552]: [17/Sep/2024:01:52:58] ENGINE Error in HTTPServer.serve 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Traceback (most recent call last): 2024-09-17T01:52:59.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._run(expiration_interval) 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: s = self.context.wrap_socket( 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: return self.sslsocket_class._create( 2024-09-17T01:52:59.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:52:59.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self.do_handshake() 2024-09-17T01:52:59.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:52:59.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._sslobj.do_handshake() 2024-09-17T01:52:59.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:53:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:00 smithi092 ceph-mon[33552]: pgmap v5: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:00 smithi092 ceph-mon[33552]: mgrmap e29: smithi031.ealpiz(active, since 4s) 2024-09-17T01:53:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:00 smithi031 ceph-mon[27673]: pgmap v5: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:00 smithi031 ceph-mon[27673]: mgrmap e29: smithi031.ealpiz(active, since 4s) 2024-09-17T01:53:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:02 smithi031 ceph-mon[27673]: pgmap v6: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:02 smithi031 ceph-mon[27673]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:53:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:02 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:53:02.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:02 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:53:02.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:02 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:53:02.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:02 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:53:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:02 smithi092 ceph-mon[33552]: pgmap v6: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:02 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:53:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:02 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:53:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:02 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:53:02.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:02 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:53:02.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:02 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/2434203030' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:53:02.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.874+0000 7f3e11767700 1 -- 172.21.15.31:0/1624072532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 msgr2=0x7f3e0c072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:02.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.874+0000 7f3e11767700 1 --2- 172.21.15.31:0/1624072532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c072210 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009910 tx=0x7f3dfc009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:02.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.875+0000 7f3e11767700 1 -- 172.21.15.31:0/1624072532 shutdown_connections 2024-09-17T01:53:02.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.875+0000 7f3e11767700 1 --2- 172.21.15.31:0/1624072532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c072750 0x7f3e0c107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:02.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.875+0000 7f3e11767700 1 --2- 172.21.15.31:0/1624072532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c072210 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:02.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.875+0000 7f3e11767700 1 -- 172.21.15.31:0/1624072532 >> 172.21.15.31:0/1624072532 conn(0x7f3e0c06d110 msgr2=0x7f3e0c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:02.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.875+0000 7f3e11767700 1 -- 172.21.15.31:0/1624072532 shutdown_connections 2024-09-17T01:53:02.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.875+0000 7f3e11767700 1 -- 172.21.15.31:0/1624072532 wait complete. 2024-09-17T01:53:02.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.876+0000 7f3e11767700 1 Processor -- start 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e11767700 1 -- start start 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e11767700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c19e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e11767700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c072750 0x7f3e0c19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e11767700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c19ee30 con 0x7f3e0c071e00 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e11767700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c19ef70 con 0x7f3e0c072750 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e0affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c19e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e0affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c19e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52800/0 (socket says 172.21.15.31:52800) 2024-09-17T01:53:02.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e0affd700 1 -- 172.21.15.31:0/545267986 learned_addr learned my addr 172.21.15.31:0/545267986 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:02.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.877+0000 7f3e0a7fc700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c072750 0x7f3e0c19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:02.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.878+0000 7f3e0affd700 1 -- 172.21.15.31:0/545267986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c072750 msgr2=0x7f3e0c19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:02.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.878+0000 7f3e0affd700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c072750 0x7f3e0c19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:02.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.878+0000 7f3e0affd700 1 -- 172.21.15.31:0/545267986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc0095f0 con 0x7f3e0c071e00 2024-09-17T01:53:02.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.878+0000 7f3e0affd700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c19e2d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00fa00 tx=0x7f3dfc00fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:02.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.879+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dfc01d070 con 0x7f3e0c071e00 2024-09-17T01:53:02.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.879+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c1a39c0 con 0x7f3e0c071e00 2024-09-17T01:53:02.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.879+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c109140 con 0x7f3e0c071e00 2024-09-17T01:53:02.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.880+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3dfc005640 con 0x7f3e0c071e00 2024-09-17T01:53:02.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.880+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dfc017400 con 0x7f3e0c071e00 2024-09-17T01:53:02.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.881+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c1115b0 con 0x7f3e0c071e00 2024-09-17T01:53:02.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.882+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f3dfc017580 con 0x7f3e0c071e00 2024-09-17T01:53:02.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.883+0000 7f3df3fff700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f3df406e4c0 0x7f3df4070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:02.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.883+0000 7f3e0a7fc700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f3df406e4c0 0x7f3df4070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:02.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.883+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f3dfc08f810 con 0x7f3e0c071e00 2024-09-17T01:53:02.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.884+0000 7f3e0a7fc700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f3df406e4c0 0x7f3df4070970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c072b80 tx=0x7f3e00009260 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:02.891+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3dfc05c550 con 0x7f3e0c071e00 2024-09-17T01:53:03.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.248+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e0c10e7a0 con 0x7f3df406e4c0 2024-09-17T01:53:03.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.254+0000 7f3df3fff700 1 -- 172.21.15.31:0/545267986 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3e0c10e7a0 con 0x7f3df406e4c0 2024-09-17T01:53:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.256+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f3df406e4c0 msgr2=0x7f3df4070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f3df406e4c0 0x7f3df4070970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c072b80 tx=0x7f3e00009260 comp rx=0 tx=0).stop 2024-09-17T01:53:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 msgr2=0x7f3e0c19e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c19e2d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00fa00 tx=0x7f3dfc00fa30 comp rx=0 tx=0).stop 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 shutdown_connections 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f3df406e4c0 0x7f3df4070970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e0c071e00 0x7f3e0c19e2d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 --2- 172.21.15.31:0/545267986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e0c072750 0x7f3e0c19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 >> 172.21.15.31:0/545267986 conn(0x7f3e0c06d110 msgr2=0x7f3e0c10d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 shutdown_connections 2024-09-17T01:53:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.257+0000 7f3e11767700 1 -- 172.21.15.31:0/545267986 wait complete. 2024-09-17T01:53:03.267 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:53:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 -- 172.21.15.31:0/2978625250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4103600 msgr2=0x7ff5d41059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 --2- 172.21.15.31:0/2978625250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4103600 0x7ff5d41059e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009910 tx=0x7ff5c8009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 -- 172.21.15.31:0/2978625250 shutdown_connections 2024-09-17T01:53:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 --2- 172.21.15.31:0/2978625250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4103600 0x7ff5d41059e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 --2- 172.21.15.31:0/2978625250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 -- 172.21.15.31:0/2978625250 >> 172.21.15.31:0/2978625250 conn(0x7ff5d40fa700 msgr2=0x7ff5d40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.382+0000 7ff5d9266700 1 -- 172.21.15.31:0/2978625250 shutdown_connections 2024-09-17T01:53:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.383+0000 7ff5d9266700 1 -- 172.21.15.31:0/2978625250 wait complete. 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.383+0000 7ff5d9266700 1 Processor -- start 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d9266700 1 -- start start 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d9266700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d9266700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4103600 0x7ff5d40fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d9266700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40ff1d0 con 0x7ff5d4100ce0 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d9266700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40ff310 con 0x7ff5d4103600 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d27fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4103600 0x7ff5d40fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52818/0 (socket says 172.21.15.31:52818) 2024-09-17T01:53:03.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d2ffd700 1 -- 172.21.15.31:0/3130377111 learned_addr learned my addr 172.21.15.31:0/3130377111 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:03.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d27fc700 1 -- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 msgr2=0x7ff5d41005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d27fc700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d27fc700 1 -- 172.21.15.31:0/3130377111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80095f0 con 0x7ff5d4103600 2024-09-17T01:53:03.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.384+0000 7ff5d2ffd700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:53:03.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.385+0000 7ff5d27fc700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4103600 0x7ff5d40fec90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000c00 tx=0x7ff5c800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.385+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c801d070 con 0x7ff5d4103600 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.385+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d40ff590 con 0x7ff5d4103600 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.385+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40ffa80 con 0x7ff5d4103600 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.385+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5c8005dc0 con 0x7ff5d4103600 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.385+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c8017400 con 0x7ff5d4103600 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.386+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0005320 con 0x7ff5d4103600 2024-09-17T01:53:03.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.387+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7ff5c800fa40 con 0x7ff5d4103600 2024-09-17T01:53:03.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.387+0000 7ff5bbfff700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff5bc06e440 0x7ff5bc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:03.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.387+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff5c808f670 con 0x7ff5d4103600 2024-09-17T01:53:03.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.387+0000 7ff5d2ffd700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff5bc06e440 0x7ff5bc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:03.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.388+0000 7ff5d2ffd700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff5bc06e440 0x7ff5bc0708f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4011550 tx=0x7ff5c4009260 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:03.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.392+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff5c805c640 con 0x7ff5d4103600 2024-09-17T01:53:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:03 smithi092 ceph-mon[33552]: mgrmap e30: smithi031.ealpiz(active, since 7s), standbys: smithi092.tjdpfw 2024-09-17T01:53:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:03 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:53:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:03 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:03 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:03.503 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:03 smithi031 ceph-mon[27673]: mgrmap e30: smithi031.ealpiz(active, since 7s), standbys: smithi092.tjdpfw 2024-09-17T01:53:03.503 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:03 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:53:03.503 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:03 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:03.503 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:03 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:03.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.876+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5c0000bf0 con 0x7ff5bc06e440 2024-09-17T01:53:03.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.878+0000 7ff5bbfff700 1 -- 172.21.15.31:0/3130377111 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff5c0000bf0 con 0x7ff5bc06e440 2024-09-17T01:53:03.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.883+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff5bc06e440 msgr2=0x7ff5bc0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.883+0000 7ff5d9266700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff5bc06e440 0x7ff5bc0708f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4011550 tx=0x7ff5c4009260 comp rx=0 tx=0).stop 2024-09-17T01:53:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.883+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4103600 msgr2=0x7ff5d40fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.883+0000 7ff5d9266700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4103600 0x7ff5d40fec90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000c00 tx=0x7ff5c800f690 comp rx=0 tx=0).stop 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 shutdown_connections 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff5bc06e440 0x7ff5bc0708f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5d4100ce0 0x7ff5d41005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 --2- 172.21.15.31:0/3130377111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5d4103600 0x7ff5d40fec90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 >> 172.21.15.31:0/3130377111 conn(0x7ff5d40fa700 msgr2=0x7ff5d40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 shutdown_connections 2024-09-17T01:53:03.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:03.884+0000 7ff5d9266700 1 -- 172.21.15.31:0/3130377111 wait complete. 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 -- 172.21.15.31:0/2112071892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40ffb60 msgr2=0x7f05d40fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 --2- 172.21.15.31:0/2112071892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40ffb60 0x7f05d40fffd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009870 tx=0x7f05c8009b80 comp rx=0 tx=0).stop 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 -- 172.21.15.31:0/2112071892 shutdown_connections 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 --2- 172.21.15.31:0/2112071892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40ffb60 0x7f05d40fffd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 --2- 172.21.15.31:0/2112071892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d40fe8c0 0x7f05d40fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 -- 172.21.15.31:0/2112071892 >> 172.21.15.31:0/2112071892 conn(0x7f05d40f9f10 msgr2=0x7f05d40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.062+0000 7f05d9235700 1 -- 172.21.15.31:0/2112071892 shutdown_connections 2024-09-17T01:53:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.063+0000 7f05d9235700 1 -- 172.21.15.31:0/2112071892 wait complete. 2024-09-17T01:53:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.064+0000 7f05d9235700 1 Processor -- start 2024-09-17T01:53:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.065+0000 7f05d9235700 1 -- start start 2024-09-17T01:53:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.065+0000 7f05d9235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 0x7f05d4195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d9235700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d40ffb60 0x7f05d4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d2d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 0x7f05d4195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d2d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 0x7f05d4195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:45900/0 (socket says 172.21.15.31:45900) 2024-09-17T01:53:04.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d2d9d700 1 -- 172.21.15.31:0/256954134 learned_addr learned my addr 172.21.15.31:0/256954134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:04.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d40ffb60 0x7f05d4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4196610 con 0x7f05d40ffb60 2024-09-17T01:53:04.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.066+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4196750 con 0x7f05d40fe8c0 2024-09-17T01:53:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.067+0000 7f05d2d9d700 1 -- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d40ffb60 msgr2=0x7f05d4195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.067+0000 7f05d2d9d700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d40ffb60 0x7f05d4195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.067+0000 7f05d2d9d700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c400a700 con 0x7f05d40fe8c0 2024-09-17T01:53:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.067+0000 7f05d2d9d700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 0x7f05d4195ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05c400eca0 tx=0x7f05c400c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.067+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c4004020 con 0x7f05d40fe8c0 2024-09-17T01:53:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.068+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c8009520 con 0x7f05d40fe8c0 2024-09-17T01:53:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.068+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05c4003680 con 0x7f05d40fe8c0 2024-09-17T01:53:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.068+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c4016680 con 0x7f05d40fe8c0 2024-09-17T01:53:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.068+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d419b5c0 con 0x7f05d40fe8c0 2024-09-17T01:53:04.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.069+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d418f9f0 con 0x7f05d40fe8c0 2024-09-17T01:53:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.070+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f05c4004180 con 0x7f05d40fe8c0 2024-09-17T01:53:04.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.070+0000 7f05bbfff700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f05bc06e480 0x7f05bc070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.070+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f05c408e5e0 con 0x7f05d40fe8c0 2024-09-17T01:53:04.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.070+0000 7f05d259c700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f05bc06e480 0x7f05bc070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.071+0000 7f05d259c700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f05bc06e480 0x7f05bc070930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05c800b6f0 tx=0x7f05c8019040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.075+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f05c405b670 con 0x7f05d40fe8c0 2024-09-17T01:53:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.332+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05d4061190 con 0x7f05bc06e480 2024-09-17T01:53:04.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.344+0000 7f05bbfff700 1 -- 172.21.15.31:0/256954134 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f05d4061190 con 0x7f05bc06e480 2024-09-17T01:53:04.342 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (7m) 1s ago 9m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (9m) 1s ago 9m 7834k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (8m) 71s ago 8m 7646k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (9m) 1s ago 9m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (8m) 71s ago 8m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (7m) 1s ago 8m 87.3M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (3m) 1s ago 3m 93.2M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (3m) 1s ago 3m 141M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (3m) 71s ago 3m 64.6M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (3m) 71s ago 3m 111M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (30s) 1s ago 10m 473M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:53:04.343 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (103s) 71s ago 8m 481M - 19.1.1-330-gc2ddf972 ebb0615149de d8e0fe42865a 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (10m) 1s ago 10m 51.6M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (8m) 71s ago 8m 38.7M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (9m) 1s ago 9m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (8m) 71s ago 8m 15.4M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (7m) 1s ago 7m 203M 1217M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (7m) 1s ago 6m 234M 1217M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (6m) 1s ago 6m 180M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (6m) 71s ago 6m 139M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (5m) 71s ago 5m 129M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (5m) 71s ago 5m 120M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:53:04.344 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (37s) 1s ago 8m 55.7M - 2.43.0 a07b618ecd1d 33197712ab29 2024-09-17T01:53:04.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f05bc06e480 msgr2=0x7f05bc070930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f05bc06e480 0x7f05bc070930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05c800b6f0 tx=0x7f05c8019040 comp rx=0 tx=0).stop 2024-09-17T01:53:04.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 msgr2=0x7f05d4195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 0x7f05d4195ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05c400eca0 tx=0x7f05c400c3d0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 shutdown_connections 2024-09-17T01:53:04.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f05bc06e480 0x7f05bc070930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05d40fe8c0 0x7f05d4195ab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 --2- 172.21.15.31:0/256954134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d40ffb60 0x7f05d4195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.346+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 >> 172.21.15.31:0/256954134 conn(0x7f05d40f9f10 msgr2=0x7f05d40fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.347+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 shutdown_connections 2024-09-17T01:53:04.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.347+0000 7f05d9235700 1 -- 172.21.15.31:0/256954134 wait complete. 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 -- 172.21.15.31:0/1787899345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63201014e0 msgr2=0x7f6320101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 --2- 172.21.15.31:0/1787899345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63201014e0 0x7f6320101950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6314009910 tx=0x7f6314009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 -- 172.21.15.31:0/1787899345 shutdown_connections 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 --2- 172.21.15.31:0/1787899345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63201014e0 0x7f6320101950 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 --2- 172.21.15.31:0/1787899345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6320100240 0x7f6320100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 -- 172.21.15.31:0/1787899345 >> 172.21.15.31:0/1787899345 conn(0x7f63200fb890 msgr2=0x7f63200fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 -- 172.21.15.31:0/1787899345 shutdown_connections 2024-09-17T01:53:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.463+0000 7f63251e4700 1 -- 172.21.15.31:0/1787899345 wait complete. 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.464+0000 7f63251e4700 1 Processor -- start 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.464+0000 7f63251e4700 1 -- start start 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f63251e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 0x7f6320074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f63251e4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63201014e0 0x7f6320073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f63251e4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320073680 con 0x7f6320100240 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f63251e4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200737c0 con 0x7f63201014e0 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 0x7f6320074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 0x7f6320074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60448/0 (socket says 172.21.15.31:60448) 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63201014e0 0x7f6320073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631ed9d700 1 -- 172.21.15.31:0/4179512643 learned_addr learned my addr 172.21.15.31:0/4179512643 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631e59c700 1 -- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 msgr2=0x7f6320074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631e59c700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 0x7f6320074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631e59c700 1 -- 172.21.15.31:0/4179512643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140095f0 con 0x7f63201014e0 2024-09-17T01:53:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631ed9d700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 0x7f6320074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:53:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.465+0000 7f631e59c700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63201014e0 0x7f6320073140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6314009910 tx=0x7f631400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.466+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631401d070 con 0x7f63201014e0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.466+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320073a40 con 0x7f63201014e0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.466+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f631400f460 con 0x7f63201014e0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.466+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6314021640 con 0x7f63201014e0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.466+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6320073f30 con 0x7f63201014e0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.467+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320108d20 con 0x7f63201014e0 2024-09-17T01:53:04.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.467+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f631400f9d0 con 0x7f63201014e0 2024-09-17T01:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.468+0000 7f6307fff700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f630806e440 0x7f63080708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.468+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f631408f480 con 0x7f63201014e0 2024-09-17T01:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.468+0000 7f631ed9d700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f630806e440 0x7f63080708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.468+0000 7f631ed9d700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f630806e440 0x7f63080708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63100104e0 tx=0x7f6310007480 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.476+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f631405c4b0 con 0x7f63201014e0 2024-09-17T01:53:04.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:04 smithi092 ceph-mon[33552]: pgmap v7: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-09-17T01:53:04.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:04 smithi092 ceph-mon[33552]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:04.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:04 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:04.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:04 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:04 smithi031 ceph-mon[27673]: pgmap v7: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-09-17T01:53:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:04 smithi031 ceph-mon[27673]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:04 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:04 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:04.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.841+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f632019df10 con 0x7f63201014e0 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:04.842 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:53:04.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.843+0000 7f6307fff700 1 -- 172.21.15.31:0/4179512643 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f631405c040 con 0x7f63201014e0 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f630806e440 msgr2=0x7f63080708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f630806e440 0x7f63080708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63100104e0 tx=0x7f6310007480 comp rx=0 tx=0).stop 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63201014e0 msgr2=0x7f6320073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63201014e0 0x7f6320073140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6314009910 tx=0x7f631400bd70 comp rx=0 tx=0).stop 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 shutdown_connections 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f630806e440 0x7f63080708f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6320100240 0x7f6320074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 --2- 172.21.15.31:0/4179512643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63201014e0 0x7f6320073140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.848+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 >> 172.21.15.31:0/4179512643 conn(0x7f63200fb890 msgr2=0x7f6320104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.849+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 shutdown_connections 2024-09-17T01:53:04.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.849+0000 7f63251e4700 1 -- 172.21.15.31:0/4179512643 wait complete. 2024-09-17T01:53:04.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 -- 172.21.15.31:0/1637931107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 msgr2=0x7ff230100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 --2- 172.21.15.31:0/1637931107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff230100860 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009910 tx=0x7ff21c009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 -- 172.21.15.31:0/1637931107 shutdown_connections 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 --2- 172.21.15.31:0/1637931107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff230100860 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 --2- 172.21.15.31:0/1637931107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 0x7ff2300ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 -- 172.21.15.31:0/1637931107 >> 172.21.15.31:0/1637931107 conn(0x7ff2300fa7a0 msgr2=0x7ff2300fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 -- 172.21.15.31:0/1637931107 shutdown_connections 2024-09-17T01:53:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 -- 172.21.15.31:0/1637931107 wait complete. 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.993+0000 7ff236cfb700 1 Processor -- start 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff236cfb700 1 -- start start 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff236cfb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 0x7ff230197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff236cfb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff2301984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff236cfb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230198b10 con 0x7ff2301003f0 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff236cfb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230198c50 con 0x7ff2300ff150 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff2301984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff2301984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60454/0 (socket says 172.21.15.31:60454) 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 -- 172.21.15.31:0/653630701 learned_addr learned my addr 172.21.15.31:0/653630701 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff234a97700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 0x7ff230197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 -- 172.21.15.31:0/653630701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 msgr2=0x7ff230197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 0x7ff230197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 -- 172.21.15.31:0/653630701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0095f0 con 0x7ff2301003f0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff234a97700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 0x7ff230197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.994+0000 7ff22ffff700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff2301984f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.995+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff21c01d070 con 0x7ff2301003f0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.995+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff21c005dc0 con 0x7ff2301003f0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.995+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23019d6a0 con 0x7ff2301003f0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.995+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff21c0226a0 con 0x7ff2301003f0 2024-09-17T01:53:04.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.995+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23019db90 con 0x7ff2301003f0 2024-09-17T01:53:04.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.996+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230068ab0 con 0x7ff2301003f0 2024-09-17T01:53:04.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.997+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7ff21c0038f0 con 0x7ff2301003f0 2024-09-17T01:53:04.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.997+0000 7ff22dffb700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff22006e440 0x7ff2200708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.997+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff21c08f7a0 con 0x7ff2301003f0 2024-09-17T01:53:04.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.997+0000 7ff234a97700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff22006e440 0x7ff2200708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:04.998+0000 7ff234a97700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff22006e440 0x7ff2200708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff224011490 tx=0x7ff224009260 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:05.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.003+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff21c05c7d0 con 0x7ff2301003f0 2024-09-17T01:53:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.276+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff23019de70 con 0x7ff2301003f0 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.277+0000 7ff22dffb700 1 -- 172.21.15.31:0/653630701 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1880 (secure 0 0 0) 0x7ff21c003680 con 0x7ff2301003f0 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout:e17 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:53:05.276 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 17 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:53:05.277 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:53:05.278 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:53:05.279 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff22006e440 msgr2=0x7ff2200708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff22006e440 0x7ff2200708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff224011490 tx=0x7ff224009260 comp rx=0 tx=0).stop 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 msgr2=0x7ff2301984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff2301984f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff21c000c00 tx=0x7ff21c00f690 comp rx=0 tx=0).stop 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 shutdown_connections 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7ff22006e440 0x7ff2200708f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2300ff150 0x7ff230197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 --2- 172.21.15.31:0/653630701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2301003f0 0x7ff2301984f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 >> 172.21.15.31:0/653630701 conn(0x7ff2300fa7a0 msgr2=0x7ff230068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:05.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 shutdown_connections 2024-09-17T01:53:05.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.279+0000 7ff236cfb700 1 -- 172.21.15.31:0/653630701 wait complete. 2024-09-17T01:53:05.281 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T01:53:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.393+0000 7f235d6f5700 1 -- 172.21.15.31:0/2286319954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23580737b0 msgr2=0x7f2358073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.393+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2286319954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23580737b0 0x7f2358073c20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f234c009910 tx=0x7f234c009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.393+0000 7f235d6f5700 1 -- 172.21.15.31:0/2286319954 shutdown_connections 2024-09-17T01:53:05.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.393+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2286319954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23580737b0 0x7f2358073c20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.393+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2286319954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2358074d80 0x7f23580731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.394+0000 7f235d6f5700 1 -- 172.21.15.31:0/2286319954 >> 172.21.15.31:0/2286319954 conn(0x7f23580fb7f0 msgr2=0x7f23580fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:05.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.394+0000 7f235d6f5700 1 -- 172.21.15.31:0/2286319954 shutdown_connections 2024-09-17T01:53:05.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.394+0000 7f235d6f5700 1 -- 172.21.15.31:0/2286319954 wait complete. 2024-09-17T01:53:05.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.394+0000 7f235d6f5700 1 Processor -- start 2024-09-17T01:53:05.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f235d6f5700 1 -- start start 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f235d6f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23580737b0 0x7f235819c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f235d6f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 0x7f235819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f235d6f5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235819cc00 con 0x7f2358074d80 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f235d6f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235819cd40 con 0x7f23580737b0 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 0x7f235819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 0x7f235819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60476/0 (socket says 172.21.15.31:60476) 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 -- 172.21.15.31:0/2992343226 learned_addr learned my addr 172.21.15.31:0/2992343226 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f2356ffd700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23580737b0 0x7f235819c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 -- 172.21.15.31:0/2992343226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23580737b0 msgr2=0x7f235819c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23580737b0 0x7f235819c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 -- 172.21.15.31:0/2992343226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0095f0 con 0x7f2358074d80 2024-09-17T01:53:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.395+0000 7f23567fc700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 0x7f235819c5e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f234c000c00 tx=0x7f234c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.396+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234c01d070 con 0x7f2358074d80 2024-09-17T01:53:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.396+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f234c005dc0 con 0x7f2358074d80 2024-09-17T01:53:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.396+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23581a1790 con 0x7f2358074d80 2024-09-17T01:53:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.396+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234c0226a0 con 0x7f2358074d80 2024-09-17T01:53:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.396+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23581a1c80 con 0x7f2358074d80 2024-09-17T01:53:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.397+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235810f380 con 0x7f2358074d80 2024-09-17T01:53:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.397+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f234c00faf0 con 0x7f2358074d80 2024-09-17T01:53:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.398+0000 7f233ffff700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f234006e430 0x7f23400708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.398+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f234c08f800 con 0x7f2358074d80 2024-09-17T01:53:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.398+0000 7f2356ffd700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f234006e430 0x7f23400708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.398+0000 7f2356ffd700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f234006e430 0x7f23400708e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2348009c60 tx=0x7f2348009260 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.402+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f234c05c830 con 0x7f2358074d80 2024-09-17T01:53:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.661+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23581a22c0 con 0x7f234006e430 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.662+0000 7f233ffff700 1 -- 172.21.15.31:0/2992343226 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f23581a22c0 con 0x7f234006e430 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr" 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:53:05.661 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:53:05.662 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "", 2024-09-17T01:53:05.662 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:53:05.662 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:53:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f234006e430 msgr2=0x7f23400708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f234006e430 0x7f23400708e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2348009c60 tx=0x7f2348009260 comp rx=0 tx=0).stop 2024-09-17T01:53:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 msgr2=0x7f235819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 0x7f235819c5e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f234c000c00 tx=0x7f234c00f690 comp rx=0 tx=0).stop 2024-09-17T01:53:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 shutdown_connections 2024-09-17T01:53:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f234006e430 0x7f23400708e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23580737b0 0x7f235819c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 --2- 172.21.15.31:0/2992343226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2358074d80 0x7f235819c5e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 >> 172.21.15.31:0/2992343226 conn(0x7f23580fb7f0 msgr2=0x7f2358101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 shutdown_connections 2024-09-17T01:53:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.665+0000 7f235d6f5700 1 -- 172.21.15.31:0/2992343226 wait complete. 2024-09-17T01:53:05.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 -- 172.21.15.31:0/895847483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0100250 msgr2=0x7f59a0100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 --2- 172.21.15.31:0/895847483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0100250 0x7f59a0100660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5990009910 tx=0x7f5990009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 -- 172.21.15.31:0/895847483 shutdown_connections 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 --2- 172.21.15.31:0/895847483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0101450 0x7f59a01018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 --2- 172.21.15.31:0/895847483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0100250 0x7f59a0100660 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 -- 172.21.15.31:0/895847483 >> 172.21.15.31:0/895847483 conn(0x7f59a00fb7e0 msgr2=0x7f59a00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 -- 172.21.15.31:0/895847483 shutdown_connections 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.780+0000 7f59a4afc700 1 -- 172.21.15.31:0/895847483 wait complete. 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f59a4afc700 1 Processor -- start 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f59a4afc700 1 -- start start 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f59a4afc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0100250 0x7f59a0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f59a4afc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 0x7f59a0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f59a4afc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a0073680 con 0x7f59a0101450 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f59a4afc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00737c0 con 0x7f59a0100250 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f599dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 0x7f59a0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f599dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 0x7f59a0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60496/0 (socket says 172.21.15.31:60496) 2024-09-17T01:53:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f599dd9b700 1 -- 172.21.15.31:0/2591916916 learned_addr learned my addr 172.21.15.31:0/2591916916 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.781+0000 7f599e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0100250 0x7f59a0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f599dd9b700 1 -- 172.21.15.31:0/2591916916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0100250 msgr2=0x7f59a0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f599dd9b700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0100250 0x7f59a0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f599dd9b700 1 -- 172.21.15.31:0/2591916916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900095f0 con 0x7f59a0101450 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f599e59c700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0100250 0x7f59a0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f599dd9b700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 0x7f59a0073140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f599400e920 tx=0x7f599400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f599400c9d0 con 0x7f59a0101450 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a0073aa0 con 0x7f59a0101450 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5994010430 con 0x7f59a0101450 2024-09-17T01:53:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5994018650 con 0x7f59a0101450 2024-09-17T01:53:05.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.782+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a019db40 con 0x7f59a0101450 2024-09-17T01:53:05.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.784+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a0108da0 con 0x7f59a0101450 2024-09-17T01:53:05.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.784+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f59940105a0 con 0x7f59a0101450 2024-09-17T01:53:05.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.785+0000 7f598f7fe700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f598806e440 0x7f59880708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:05.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.785+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5994014070 con 0x7f59a0101450 2024-09-17T01:53:05.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.785+0000 7f599e59c700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f598806e440 0x7f59880708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:05.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.785+0000 7f599e59c700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f598806e440 0x7f59880708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f599000b6f0 tx=0x7f5990005940 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:05.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:05.790+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f59940539d0 con 0x7f59a0101450 2024-09-17T01:53:05.858 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:05 smithi031 ceph-mon[27673]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:05.858 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:05 smithi031 ceph-mon[27673]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:05.858 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:05 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/4179512643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:53:05.858 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:05 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/653630701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:53:05.859 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:05 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:05.859 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:05 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:05 smithi092 ceph-mon[33552]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:05 smithi092 ceph-mon[33552]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:05 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/4179512643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:53:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:05 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/653630701' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:53:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:05 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:05 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:06.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.204+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f59a019e300 con 0x7f59a0101450 2024-09-17T01:53:06.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.205+0000 7f598f7fe700 1 -- 172.21.15.31:0/2591916916 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f599405b610 con 0x7f59a0101450 2024-09-17T01:53:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f598806e440 msgr2=0x7f59880708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f598806e440 0x7f59880708f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f599000b6f0 tx=0x7f5990005940 comp rx=0 tx=0).stop 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 msgr2=0x7f59a0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 0x7f59a0073140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f599400e920 tx=0x7f599400ec30 comp rx=0 tx=0).stop 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 shutdown_connections 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f598806e440 0x7f59880708f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59a0100250 0x7f59a0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 --2- 172.21.15.31:0/2591916916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59a0101450 0x7f59a0073140 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 >> 172.21.15.31:0/2591916916 conn(0x7f59a00fb7e0 msgr2=0x7f59a0104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 shutdown_connections 2024-09-17T01:53:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:06.207+0000 7f59a4afc700 1 -- 172.21.15.31:0/2591916916 wait complete. 2024-09-17T01:53:06.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:06 smithi031 ceph-mon[27673]: pgmap v8: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 989 KiB/s rd, 946 KiB/s wr, 223 op/s 2024-09-17T01:53:06.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:06 smithi031 ceph-mon[27673]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:06 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:06 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:06.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:06 smithi031 ceph-mon[27673]: from='client.? 172.21.15.31:0/2591916916' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:53:06.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:06 smithi092 ceph-mon[33552]: pgmap v8: 65 pgs: 65 active+clean; 272 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 989 KiB/s rd, 946 KiB/s wr, 223 op/s 2024-09-17T01:53:06.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:06 smithi092 ceph-mon[33552]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:06.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:06 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:06.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:06 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:06.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:06 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/2591916916' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:53:08.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:08 smithi092 ceph-mon[33552]: pgmap v9: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 374 op/s 2024-09-17T01:53:08.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:08 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:08.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:08 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:08.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:08 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:08.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:08 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:53:09.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:08 smithi031 ceph-mon[27673]: pgmap v9: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 374 op/s 2024-09-17T01:53:09.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:08 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:09.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:08 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:09.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:08 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:09.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:08 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:53:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:53:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:53:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:09.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:53:09.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:09.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:09.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:09.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:09.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:09 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:53:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:53:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:10.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:09 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:10.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:10 smithi031 ceph-mon[27673]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:53:10.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:10 smithi031 ceph-mon[27673]: pgmap v10: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 339 op/s 2024-09-17T01:53:10.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:10 smithi031 ceph-mon[27673]: Reconfiguring prometheus.smithi031 (dependencies changed)... 2024-09-17T01:53:10.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:10 smithi031 ceph-mon[27673]: Reconfiguring daemon prometheus.smithi031 on smithi031 2024-09-17T01:53:10.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:10 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:53:10.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:10 smithi092 ceph-mon[33552]: pgmap v10: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 339 op/s 2024-09-17T01:53:10.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:10 smithi092 ceph-mon[33552]: Reconfiguring prometheus.smithi031 (dependencies changed)... 2024-09-17T01:53:10.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:10 smithi092 ceph-mon[33552]: Reconfiguring daemon prometheus.smithi031 on smithi031 2024-09-17T01:53:11.856 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:11 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:11 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:12 smithi092 ceph-mon[33552]: pgmap v11: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 339 op/s 2024-09-17T01:53:13.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:12 smithi031 ceph-mon[27673]: pgmap v11: 65 pgs: 65 active+clean; 270 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 339 op/s 2024-09-17T01:53:14.230 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:13 smithi092 ceph-mon[33552]: pgmap v12: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 469 op/s 2024-09-17T01:53:14.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:13 smithi031 ceph-mon[27673]: pgmap v12: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 469 op/s 2024-09-17T01:53:16.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:16 smithi092 ceph-mon[33552]: pgmap v13: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 303 op/s 2024-09-17T01:53:16.501 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:16 smithi031 ceph-mon[27673]: pgmap v13: 65 pgs: 65 active+clean; 274 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 303 op/s 2024-09-17T01:53:17.897 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:17 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:17.897 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:17 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:17.897 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:17 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:53:17.897 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:17 smithi092 ceph-mon[33552]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:53:17.897 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:17 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:17 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:17 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:17 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:53:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:17 smithi031 ceph-mon[27673]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:53:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:17 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:18.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:18 smithi092 ceph-mon[33552]: pgmap v14: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 428 op/s 2024-09-17T01:53:19.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:18 smithi031 ceph-mon[27673]: pgmap v14: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 428 op/s 2024-09-17T01:53:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:19 smithi092 ceph-mon[33552]: Upgrade: Updating mgr.smithi092.tjdpfw 2024-09-17T01:53:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:19 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:53:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:19 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:53:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:19 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:19 smithi092 ceph-mon[33552]: Deploying daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:53:20.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:19 smithi031 ceph-mon[27673]: Upgrade: Updating mgr.smithi092.tjdpfw 2024-09-17T01:53:20.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:19 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:53:20.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:19 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:53:20.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:19 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:20.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:19 smithi031 ceph-mon[27673]: Deploying daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:53:20.972 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:20 smithi092 ceph-mon[33552]: pgmap v15: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-17T01:53:21.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:20 smithi031 ceph-mon[27673]: pgmap v15: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-17T01:53:22.896 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:22 smithi092 ceph-mon[33552]: pgmap v16: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-17T01:53:23.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:22 smithi031 ceph-mon[27673]: pgmap v16: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-17T01:53:24.146 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:24 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.146 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:24 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.146 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:24 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:24.146 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:24 smithi092 ceph-mon[33552]: pgmap v17: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-17T01:53:24.146 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:24 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.146 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:24 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:24 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:24 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:24 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:24.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:24 smithi031 ceph-mon[27673]: pgmap v17: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-17T01:53:24.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:24 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:24.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:24 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:26 smithi092 ceph-mon[33552]: pgmap v18: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 978 KiB/s rd, 1.0 MiB/s wr, 269 op/s 2024-09-17T01:53:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:26 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:26 smithi031 ceph-mon[27673]: pgmap v18: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 978 KiB/s rd, 1.0 MiB/s wr, 269 op/s 2024-09-17T01:53:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:26 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:27.598 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:27 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.599 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:27 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.599 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:27 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.599 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:27 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:27 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:27 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:27 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:27 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:28.755 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:28 smithi092 ceph-mon[33552]: pgmap v19: 65 pgs: 65 active+clean; 271 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 410 op/s 2024-09-17T01:53:28.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:28 smithi031 ceph-mon[27673]: pgmap v19: 65 pgs: 65 active+clean; 271 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 410 op/s 2024-09-17T01:53:29.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:29 smithi031 ceph-mon[27673]: Standby manager daemon smithi092.tjdpfw restarted 2024-09-17T01:53:29.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:29 smithi031 ceph-mon[27673]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:53:29.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:29 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:53:29.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:29 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:53:29.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:29 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:53:29.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:29 smithi031 ceph-mon[27673]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:53:29.971 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:29 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw restarted 2024-09-17T01:53:29.971 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:29 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:53:29.971 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:29 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:53:29.971 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:29 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:53:29.972 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:29 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:53:29.972 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:29 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/3077765195' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:53:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:30 smithi092 ceph-mon[33552]: pgmap v20: 65 pgs: 65 active+clean; 271 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 986 KiB/s wr, 285 op/s 2024-09-17T01:53:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:30 smithi092 ceph-mon[33552]: mgrmap e31: smithi031.ealpiz(active, since 34s), standbys: smithi092.tjdpfw 2024-09-17T01:53:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:30 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:30 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:30.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:30 smithi031 ceph-mon[27673]: pgmap v20: 65 pgs: 65 active+clean; 271 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 986 KiB/s wr, 285 op/s 2024-09-17T01:53:30.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:30 smithi031 ceph-mon[27673]: mgrmap e31: smithi031.ealpiz(active, since 34s), standbys: smithi092.tjdpfw 2024-09-17T01:53:30.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:30 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:30.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:30 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:32.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:32 smithi031 ceph-mon[27673]: pgmap v21: 65 pgs: 65 active+clean; 271 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 986 KiB/s wr, 285 op/s 2024-09-17T01:53:32.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:32 smithi092 ceph-mon[33552]: pgmap v21: 65 pgs: 65 active+clean; 271 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 986 KiB/s wr, 285 op/s 2024-09-17T01:53:34.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:33 smithi092 ceph-mon[33552]: pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-09-17T01:53:34.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:33 smithi031 ceph-mon[27673]: pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: Upgrade: Setting container_image for all mgr 2024-09-17T01:53:35.359 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.360 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi031.ealpiz"}]: dispatch 2024-09-17T01:53:35.360 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi031.ealpiz"}]': finished 2024-09-17T01:53:35.360 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi092.tjdpfw"}]: dispatch 2024-09-17T01:53:35.360 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi092.tjdpfw"}]': finished 2024-09-17T01:53:35.360 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:35 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:53:35.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: Upgrade: Setting container_image for all mgr 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi031.ealpiz"}]: dispatch 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi031.ealpiz"}]': finished 2024-09-17T01:53:35.471 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi092.tjdpfw"}]: dispatch 2024-09-17T01:53:35.472 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi092.tjdpfw"}]': finished 2024-09-17T01:53:35.472 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:35 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:53:36.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:36 smithi031 ceph-mon[27673]: pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 982 KiB/s rd, 922 KiB/s wr, 268 op/s 2024-09-17T01:53:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:36 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:36 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:53:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:36 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:53:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:36 smithi031 ceph-mon[27673]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.366+0000 7f49bb3b4700 1 -- 172.21.15.31:0/1498303598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4100710 msgr2=0x7f49b4100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.366+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/1498303598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4100710 0x7f49b4100b20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009910 tx=0x7f49b0009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.366+0000 7f49bb3b4700 1 -- 172.21.15.31:0/1498303598 shutdown_connections 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.366+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/1498303598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4101060 0x7f49b40ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.366+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/1498303598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4100710 0x7f49b4100b20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.366+0000 7f49bb3b4700 1 -- 172.21.15.31:0/1498303598 >> 172.21.15.31:0/1498303598 conn(0x7f49b40f9f10 msgr2=0x7f49b40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.367+0000 7f49bb3b4700 1 -- 172.21.15.31:0/1498303598 shutdown_connections 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.367+0000 7f49bb3b4700 1 -- 172.21.15.31:0/1498303598 wait complete. 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.367+0000 7f49bb3b4700 1 Processor -- start 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.367+0000 7f49bb3b4700 1 -- start start 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49bb3b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 0x7f49b41938f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49bb3b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 0x7f49b4193e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49bb3b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4194450 con 0x7f49b4101060 2024-09-17T01:53:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49bb3b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4194590 con 0x7f49b4100710 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49b894f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 0x7f49b4193e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49b9150700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 0x7f49b41938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49b894f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 0x7f49b4193e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56138/0 (socket says 172.21.15.31:56138) 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49b9150700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 0x7f49b41938f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36116/0 (socket says 172.21.15.31:36116) 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.368+0000 7f49b894f700 1 -- 172.21.15.31:0/814187525 learned_addr learned my addr 172.21.15.31:0/814187525 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49b894f700 1 -- 172.21.15.31:0/814187525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 msgr2=0x7f49b41938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49b894f700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 0x7f49b41938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49b894f700 1 -- 172.21.15.31:0/814187525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00095f0 con 0x7f49b4101060 2024-09-17T01:53:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49b9150700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 0x7f49b41938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:53:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49b894f700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 0x7f49b4193e30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49a400e920 tx=0x7f49a400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a400c9d0 con 0x7f49b4101060 2024-09-17T01:53:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b4199040 con 0x7f49b4101060 2024-09-17T01:53:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.369+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b4199560 con 0x7f49b4101060 2024-09-17T01:53:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.370+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49a4010430 con 0x7f49b4101060 2024-09-17T01:53:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.370+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a4018650 con 0x7f49b4101060 2024-09-17T01:53:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.371+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4998005320 con 0x7f49b4101060 2024-09-17T01:53:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.371+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f49a40187b0 con 0x7f49b4101060 2024-09-17T01:53:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.372+0000 7f49aa7fc700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f49a0070630 0x7f49a0072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.372+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f49a4014070 con 0x7f49b4101060 2024-09-17T01:53:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.372+0000 7f49b9150700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f49a0070630 0x7f49a0072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:36.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.373+0000 7f49b9150700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f49a0070630 0x7f49a0072ae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b6f0 tx=0x7f49b0005940 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:36.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.378+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f49a40539d0 con 0x7f49b4101060 2024-09-17T01:53:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:36 smithi092 ceph-mon[33552]: pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 982 KiB/s rd, 922 KiB/s wr, 268 op/s 2024-09-17T01:53:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:36 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:36 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:53:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:36 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:53:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:36 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:36.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.669+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4998000bf0 con 0x7f49a0070630 2024-09-17T01:53:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.671+0000 7f49aa7fc700 1 -- 172.21.15.31:0/814187525 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4998000bf0 con 0x7f49a0070630 2024-09-17T01:53:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.673+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f49a0070630 msgr2=0x7f49a0072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.673+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f49a0070630 0x7f49a0072ae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b6f0 tx=0x7f49b0005940 comp rx=0 tx=0).stop 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.673+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 msgr2=0x7f49b4193e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.673+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 0x7f49b4193e30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49a400e920 tx=0x7f49a400ec30 comp rx=0 tx=0).stop 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.673+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 shutdown_connections 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.673+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f49a0070630 0x7f49a0072ae0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.674+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49b4100710 0x7f49b41938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.674+0000 7f49bb3b4700 1 --2- 172.21.15.31:0/814187525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49b4101060 0x7f49b4193e30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.674+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 >> 172.21.15.31:0/814187525 conn(0x7f49b40f9f10 msgr2=0x7f49b4103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.674+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 shutdown_connections 2024-09-17T01:53:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.674+0000 7f49bb3b4700 1 -- 172.21.15.31:0/814187525 wait complete. 2024-09-17T01:53:36.685 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:53:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.814+0000 7f5d7af02700 1 -- 172.21.15.31:0/3637709935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74069270 msgr2=0x7f5d741051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.814+0000 7f5d7af02700 1 --2- 172.21.15.31:0/3637709935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74069270 0x7f5d741051d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009870 tx=0x7f5d68009b80 comp rx=0 tx=0).stop 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.815+0000 7f5d7af02700 1 -- 172.21.15.31:0/3637709935 shutdown_connections 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.815+0000 7f5d7af02700 1 --2- 172.21.15.31:0/3637709935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74105710 0x7f5d74107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.815+0000 7f5d7af02700 1 --2- 172.21.15.31:0/3637709935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74069270 0x7f5d741051d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.815+0000 7f5d7af02700 1 -- 172.21.15.31:0/3637709935 >> 172.21.15.31:0/3637709935 conn(0x7f5d740fa780 msgr2=0x7f5d740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.815+0000 7f5d7af02700 1 -- 172.21.15.31:0/3637709935 shutdown_connections 2024-09-17T01:53:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.815+0000 7f5d7af02700 1 -- 172.21.15.31:0/3637709935 wait complete. 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d7af02700 1 Processor -- start 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d7af02700 1 -- start start 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d7af02700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 0x7f5d74197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d7af02700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74198230 0x7f5d7419d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d7af02700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741986a0 con 0x7f5d74198230 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d7af02700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d74198810 con 0x7f5d74105710 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d78c9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 0x7f5d74197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d78c9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 0x7f5d74197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36148/0 (socket says 172.21.15.31:36148) 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d78c9e700 1 -- 172.21.15.31:0/2000800127 learned_addr learned my addr 172.21.15.31:0/2000800127 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:36.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.816+0000 7f5d73fff700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74198230 0x7f5d7419d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d78c9e700 1 -- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74198230 msgr2=0x7f5d7419d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d78c9e700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74198230 0x7f5d7419d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d78c9e700 1 -- 172.21.15.31:0/2000800127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600095f0 con 0x7f5d74105710 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d73fff700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74198230 0x7f5d7419d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d78c9e700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 0x7f5d74197cf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009230 tx=0x7f5d6800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6801c070 con 0x7f5d74105710 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d6800fe10 con 0x7f5d74105710 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d680173f0 con 0x7f5d74105710 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.817+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d68009520 con 0x7f5d74105710 2024-09-17T01:53:36.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.818+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7419da10 con 0x7f5d74105710 2024-09-17T01:53:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.819+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d74191dd0 con 0x7f5d74105710 2024-09-17T01:53:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.819+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f5d68020070 con 0x7f5d74105710 2024-09-17T01:53:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.820+0000 7f5d71ffb700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f5d6406e440 0x7f5d640708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.820+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5d6808f5d0 con 0x7f5d74105710 2024-09-17T01:53:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.820+0000 7f5d73fff700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f5d6406e440 0x7f5d640708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.821+0000 7f5d73fff700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f5d6406e440 0x7f5d640708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d60005fd0 tx=0x7f5d60009310 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:36.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:36.827+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5d68058b50 con 0x7f5d74105710 2024-09-17T01:53:37.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.210+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d7402cfe0 con 0x7f5d6406e440 2024-09-17T01:53:37.209 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:37 smithi031 ceph-mon[27673]: Upgrade: Updating mon.smithi031 2024-09-17T01:53:37.209 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:37 smithi031 ceph-mon[27673]: Deploying daemon mon.smithi031 on smithi031 2024-09-17T01:53:37.209 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:37 smithi031 ceph-mon[27673]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:37.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.213+0000 7f5d71ffb700 1 -- 172.21.15.31:0/2000800127 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5d7402cfe0 con 0x7f5d6406e440 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.217+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f5d6406e440 msgr2=0x7f5d640708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.217+0000 7f5d7af02700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f5d6406e440 0x7f5d640708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d60005fd0 tx=0x7f5d60009310 comp rx=0 tx=0).stop 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.217+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 msgr2=0x7f5d74197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.217+0000 7f5d7af02700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 0x7f5d74197cf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009230 tx=0x7f5d6800f740 comp rx=0 tx=0).stop 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.218+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 shutdown_connections 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.218+0000 7f5d7af02700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f5d6406e440 0x7f5d640708f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.218+0000 7f5d7af02700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d74105710 0x7f5d74197cf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.218+0000 7f5d7af02700 1 --2- 172.21.15.31:0/2000800127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74198230 0x7f5d7419d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.218+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 >> 172.21.15.31:0/2000800127 conn(0x7f5d740fa780 msgr2=0x7f5d740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:37.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.219+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 shutdown_connections 2024-09-17T01:53:37.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.219+0000 7f5d7af02700 1 -- 172.21.15.31:0/2000800127 wait complete. 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.370+0000 7fa78f4dc700 1 -- 172.21.15.31:0/3560802394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 msgr2=0x7fa788103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.370+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/3560802394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa788103140 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa784009910 tx=0x7fa784009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.370+0000 7fa78f4dc700 1 -- 172.21.15.31:0/3560802394 shutdown_connections 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.370+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/3560802394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa788103680 0x7fa788105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.370+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/3560802394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa788103140 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.370+0000 7fa78f4dc700 1 -- 172.21.15.31:0/3560802394 >> 172.21.15.31:0/3560802394 conn(0x7fa7880fa780 msgr2=0x7fa7880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:37.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.371+0000 7fa78f4dc700 1 -- 172.21.15.31:0/3560802394 shutdown_connections 2024-09-17T01:53:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.371+0000 7fa78f4dc700 1 -- 172.21.15.31:0/3560802394 wait complete. 2024-09-17T01:53:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.371+0000 7fa78f4dc700 1 Processor -- start 2024-09-17T01:53:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.371+0000 7fa78f4dc700 1 -- start start 2024-09-17T01:53:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78f4dc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa7881006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:37.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78f4dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa788103680 0x7fa7880fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78f4dc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880ff250 con 0x7fa788100d60 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78f4dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880ff390 con 0x7fa788103680 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78d278700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa7881006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78d278700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa7881006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56182/0 (socket says 172.21.15.31:56182) 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78d278700 1 -- 172.21.15.31:0/1315851591 learned_addr learned my addr 172.21.15.31:0/1315851591 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78ca77700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa788103680 0x7fa7880fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78d278700 1 -- 172.21.15.31:0/1315851591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa788103680 msgr2=0x7fa7880fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78d278700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa788103680 0x7fa7880fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.372+0000 7fa78d278700 1 -- 172.21.15.31:0/1315851591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840095f0 con 0x7fa788100d60 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.373+0000 7fa78d278700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa7881006c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa784000c00 tx=0x7fa78400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.373+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa78401d070 con 0x7fa788100d60 2024-09-17T01:53:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.373+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa784005dc0 con 0x7fa788100d60 2024-09-17T01:53:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.373+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7880ff610 con 0x7fa788100d60 2024-09-17T01:53:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.373+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa784022470 con 0x7fa788100d60 2024-09-17T01:53:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.373+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7880ffb00 con 0x7fa788100d60 2024-09-17T01:53:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.374+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78818fbc0 con 0x7fa788100d60 2024-09-17T01:53:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.375+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fa784003810 con 0x7fa788100d60 2024-09-17T01:53:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.376+0000 7fa77e7fc700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fa77406e440 0x7fa7740708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.376+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa78408f720 con 0x7fa788100d60 2024-09-17T01:53:37.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.376+0000 7fa78ca77700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fa77406e440 0x7fa7740708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:37.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.377+0000 7fa78ca77700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fa77406e440 0x7fa7740708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa778009c60 tx=0x7fa778009260 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:37.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.381+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fa78405c7d0 con 0x7fa788100d60 2024-09-17T01:53:37.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:37 smithi092 ceph-mon[33552]: Upgrade: Updating mon.smithi031 2024-09-17T01:53:37.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:37 smithi092 ceph-mon[33552]: Deploying daemon mon.smithi031 on smithi031 2024-09-17T01:53:37.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:37 smithi092 ceph-mon[33552]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:37.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.653+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa788061190 con 0x7fa77406e440 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.667+0000 7fa77e7fc700 1 -- 172.21.15.31:0/1315851591 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa788061190 con 0x7fa77406e440 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (8m) 3s ago 9m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (10m) 3s ago 10m 7868k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (9m) 11s ago 9m 7776k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (9m) 3s ago 9m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (8m) 11s ago 8m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (8m) 3s ago 9m 87.5M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:53:37.665 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (4m) 3s ago 4m 63.7M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (4m) 3s ago 4m 137M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (4m) 11s ago 4m 81.1M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (4m) 11s ago 4m 124M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (64s) 3s ago 11m 490M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (15s) 11s ago 8m 68.0M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (11m) 3s ago 11m 53.4M 2048M 18.2.0 dc2bc1663786 ed23fac2b163 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (8m) 11s ago 8m 42.2M 2048M 18.2.0 dc2bc1663786 e7f223f792d2 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (9m) 3s ago 9m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (8m) 11s ago 8m 15.5M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (8m) 3s ago 8m 209M 1217M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (7m) 3s ago 7m 248M 1217M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:53:37.666 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (7m) 3s ago 7m 187M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:53:37.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (6m) 11s ago 6m 257M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:53:37.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (6m) 11s ago 6m 224M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:53:37.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (5m) 11s ago 5m 217M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:53:37.667 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (21s) 3s ago 9m 51.4M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fa77406e440 msgr2=0x7fa7740708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fa77406e440 0x7fa7740708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa778009c60 tx=0x7fa778009260 comp rx=0 tx=0).stop 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 msgr2=0x7fa7881006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa7881006c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa784000c00 tx=0x7fa78400f690 comp rx=0 tx=0).stop 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 shutdown_connections 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fa77406e440 0x7fa7740708f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa788100d60 0x7fa7881006c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 --2- 172.21.15.31:0/1315851591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa788103680 0x7fa7880fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 >> 172.21.15.31:0/1315851591 conn(0x7fa7880fa780 msgr2=0x7fa7880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 shutdown_connections 2024-09-17T01:53:37.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.670+0000 7fa78f4dc700 1 -- 172.21.15.31:0/1315851591 wait complete. 2024-09-17T01:53:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.805+0000 7f1e80c22700 1 -- 172.21.15.31:0/270029415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fe500 msgr2=0x7f1e7c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.805+0000 7f1e80c22700 1 --2- 172.21.15.31:0/270029415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c0fe910 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009910 tx=0x7f1e6c009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.806+0000 7f1e80c22700 1 -- 172.21.15.31:0/270029415 shutdown_connections 2024-09-17T01:53:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.806+0000 7f1e80c22700 1 --2- 172.21.15.31:0/270029415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.806+0000 7f1e80c22700 1 --2- 172.21.15.31:0/270029415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c0fe910 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.806+0000 7f1e80c22700 1 -- 172.21.15.31:0/270029415 >> 172.21.15.31:0/270029415 conn(0x7f1e7c0f9f10 msgr2=0x7f1e7c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.806+0000 7f1e80c22700 1 -- 172.21.15.31:0/270029415 shutdown_connections 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.806+0000 7f1e80c22700 1 -- 172.21.15.31:0/270029415 wait complete. 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e80c22700 1 Processor -- start 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e80c22700 1 -- start start 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e80c22700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e80c22700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e80c22700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c1988b0 con 0x7f1e7c0fee50 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e80c22700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c1989f0 con 0x7f1e7c0fe500 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e79d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e7a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e79d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56208/0 (socket says 172.21.15.31:56208) 2024-09-17T01:53:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.807+0000 7f1e79d9b700 1 -- 172.21.15.31:0/4275280989 learned_addr learned my addr 172.21.15.31:0/4275280989 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e7a59c700 1 -- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 msgr2=0x7f1e7c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e7a59c700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e7a59c700 1 -- 172.21.15.31:0/4275280989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0095f0 con 0x7f1e7c0fe500 2024-09-17T01:53:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e79d9b700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e7a59c700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c197d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c006010 tx=0x7f1e6c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c01d070 con 0x7f1e7c0fe500 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c19d440 con 0x7f1e7c0fe500 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.808+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c19d930 con 0x7f1e7c0fe500 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.809+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e6c005dc0 con 0x7f1e7c0fe500 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.809+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c0226a0 con 0x7f1e7c0fe500 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.810+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c105660 con 0x7f1e7c0fe500 2024-09-17T01:53:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.810+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f1e6c022800 con 0x7f1e7c0fe500 2024-09-17T01:53:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.811+0000 7f1e6b7fe700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1e6406e440 0x7f1e640708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.811+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1e6c08f690 con 0x7f1e7c0fe500 2024-09-17T01:53:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.811+0000 7f1e79d9b700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1e6406e440 0x7f1e640708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.812+0000 7f1e79d9b700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1e6406e440 0x7f1e640708f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1e70011550 tx=0x7f1e70009260 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:37.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:37.819+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1e6c05c740 con 0x7f1e7c0fe500 2024-09-17T01:53:38.136 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T01:53:38.136 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T01:53:38.217 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:37 smithi031 systemd[1]: Stopping Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:53:38.217 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:38 smithi031 ceph-mon[27673]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 383 op/s 2024-09-17T01:53:38.217 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:38 smithi031 ceph-mon[27673]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:38.217 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:38 smithi031 ceph-mon[27673]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:38.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.337+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e7c02cc30 con 0x7f1e7c0fe500 2024-09-17T01:53:38.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.338+0000 7f1e6b7fe700 1 -- 172.21.15.31:0/4275280989 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f1e6c05c2d0 con 0x7f1e7c0fe500 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:53:38.336 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:53:38.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:53:38.340 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:53:38.340 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-17T01:53:38.340 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:53:38.340 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:53:38.340 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:53:38.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1e6406e440 msgr2=0x7f1e640708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:38.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1e6406e440 0x7f1e640708f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1e70011550 tx=0x7f1e70009260 comp rx=0 tx=0).stop 2024-09-17T01:53:38.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fe500 msgr2=0x7f1e7c197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:38.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c197d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c006010 tx=0x7f1e6c00f690 comp rx=0 tx=0).stop 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 shutdown_connections 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1e6406e440 0x7f1e640708f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e7c0fe500 0x7f1e7c197d50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 --2- 172.21.15.31:0/4275280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7c0fee50 0x7f1e7c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 >> 172.21.15.31:0/4275280989 conn(0x7f1e7c0f9f10 msgr2=0x7f1e7c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 shutdown_connections 2024-09-17T01:53:38.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.341+0000 7f1e80c22700 1 -- 172.21.15.31:0/4275280989 wait complete. 2024-09-17T01:53:38.474 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[27669]: 2024-09-17T01:53:38.392+0000 7f06e73ca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi031 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:53:38.474 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[27669]: 2024-09-17T01:53:38.392+0000 7f06e73ca700 -1 mon.smithi031@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T01:53:38.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 -- 172.21.15.31:0/2759126374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc0ff130 msgr2=0x7f1ecc0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/2759126374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc0ff130 0x7f1ecc0ff540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009910 tx=0x7f1ebc009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 -- 172.21.15.31:0/2759126374 shutdown_connections 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/2759126374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/2759126374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc0ff130 0x7f1ecc0ff540 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 -- 172.21.15.31:0/2759126374 >> 172.21.15.31:0/2759126374 conn(0x7f1ecc0fa780 msgr2=0x7f1ecc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 -- 172.21.15.31:0/2759126374 shutdown_connections 2024-09-17T01:53:38.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.486+0000 7f1ed11c5700 1 -- 172.21.15.31:0/2759126374 wait complete. 2024-09-17T01:53:38.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ed11c5700 1 Processor -- start 2024-09-17T01:53:38.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ed11c5700 1 -- start start 2024-09-17T01:53:38.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ed11c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc0ff130 0x7f1ecc069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ed11c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ecad9d700 1 -- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc0ff130 msgr2=0x7f1ecc069100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:3300/0 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ed11c5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc19ae40 con 0x7f1ecc0ff130 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ecad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc0ff130 0x7f1ecc069100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.487+0000 7f1ed11c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc19af80 con 0x7f1ecc1003d0 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36324/0 (socket says 172.21.15.31:36324) 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 -- 172.21.15.31:0/482344668 learned_addr learned my addr 172.21.15.31:0/482344668 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 -- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc0ff130 msgr2=0x7f1ecc069100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc0ff130 0x7f1ecc069100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 -- 172.21.15.31:0/482344668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0095f0 con 0x7f1ecc1003d0 2024-09-17T01:53:38.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eca59c700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc19a820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b700 tx=0x7f1ec000bac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:38.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec0011800 con 0x7f1ecc1003d0 2024-09-17T01:53:38.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc19b260 con 0x7f1ecc1003d0 2024-09-17T01:53:38.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ec0011e10 con 0x7f1ecc1003d0 2024-09-17T01:53:38.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.488+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec000f2e0 con 0x7f1ecc1003d0 2024-09-17T01:53:38.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.489+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc19b7b0 con 0x7f1ecc1003d0 2024-09-17T01:53:38.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.490+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc107cb0 con 0x7f1ecc1003d0 2024-09-17T01:53:38.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.490+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f1ec0010380 con 0x7f1ecc1003d0 2024-09-17T01:53:38.488 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:38 smithi092 ceph-mon[33552]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 383 op/s 2024-09-17T01:53:38.488 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:38 smithi092 ceph-mon[33552]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:38 smithi092 ceph-mon[33552]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:38.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.491+0000 7f1eb3fff700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1eb406e380 0x7f1eb4070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:38.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.491+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1ec008dda0 con 0x7f1ecc1003d0 2024-09-17T01:53:38.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.492+0000 7f1ecad9d700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1eb406e380 0x7f1eb4070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:38.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.492+0000 7f1ecad9d700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1eb406e380 0x7f1eb4070830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005090 tx=0x7f1ebc009fd0 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:38.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.496+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1ec005af60 con 0x7f1ecc1003d0 2024-09-17T01:53:38.581 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:38 smithi031 podman[77009]: 2024-09-17 01:53:38.534440483 +0000 UTC m=+0.292543421 container died ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, ceph=True, org.label-schema.schema-version=1.0, RELEASE=HEAD) 2024-09-17T01:53:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.786+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ecc19bea0 con 0x7f1ecc1003d0 2024-09-17T01:53:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.787+0000 7f1eb3fff700 1 -- 172.21.15.31:0/482344668 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1880 (secure 0 0 0) 0x7f1ec0015770 con 0x7f1ecc1003d0 2024-09-17T01:53:38.784 INFO:teuthology.orchestra.run.smithi031.stdout:e17 2024-09-17T01:53:38.784 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:53:38.784 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:53:38.784 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:53:38.784 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 17 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:53:38.785 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:53:38.786 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:53:38.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:38.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:38.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:38.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:38.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:53:38.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1eb406e380 msgr2=0x7f1eb4070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1eb406e380 0x7f1eb4070830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc005090 tx=0x7f1ebc009fd0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 msgr2=0x7f1ecc19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc19a820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b700 tx=0x7f1ec000bac0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 shutdown_connections 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f1eb406e380 0x7f1eb4070830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ecc0ff130 0x7f1ecc069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 --2- 172.21.15.31:0/482344668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ecc1003d0 0x7f1ecc19a820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 >> 172.21.15.31:0/482344668 conn(0x7f1ecc0fa780 msgr2=0x7f1ecc103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 shutdown_connections 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.789+0000 7f1ed11c5700 1 -- 172.21.15.31:0/482344668 wait complete. 2024-09-17T01:53:38.788 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T01:53:38.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.910+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2951502508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 msgr2=0x7fe6b41051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.910+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2951502508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b41051f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009910 tx=0x7fe6b0009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.910+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2951502508 shutdown_connections 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.910+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2951502508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 0x7fe6b4107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.910+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2951502508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b41051f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.910+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2951502508 >> 172.21.15.31:0/2951502508 conn(0x7fe6b40fa780 msgr2=0x7fe6b40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2951502508 shutdown_connections 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2951502508 wait complete. 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 Processor -- start 2024-09-17T01:53:38.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 -- start start 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b4197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 0x7fe6b41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b41988f0 con 0x7fe6b4105730 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.911+0000 7fe6bb69e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b419d300 con 0x7fe6b4069250 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b8c39700 1 -- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 msgr2=0x7fe6b41982d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:3300/0 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b8c39700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 0x7fe6b41982d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:53:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b4197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b4197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36332/0 (socket says 172.21.15.31:36332) 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 -- 172.21.15.31:0/2159462297 learned_addr learned my addr 172.21.15.31:0/2159462297 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 -- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 msgr2=0x7fe6b41982d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 0x7fe6b41982d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 -- 172.21.15.31:0/2159462297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b00095f0 con 0x7fe6b4069250 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6b943a700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b4197d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0000c00 tx=0x7fe6b000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b001d070 con 0x7fe6b4069250 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6b000f460 con 0x7fe6b4069250 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b0021640 con 0x7fe6b4069250 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.912+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b419d4a0 con 0x7fe6b4069250 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.913+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b419d8a0 con 0x7fe6b4069250 2024-09-17T01:53:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.914+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b4191e70 con 0x7fe6b4069250 2024-09-17T01:53:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.914+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fe6b0003a60 con 0x7fe6b4069250 2024-09-17T01:53:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.915+0000 7fe6aa7fc700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fe6a006e3e0 0x7fe6a0070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.915+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe6b008f720 con 0x7fe6b4069250 2024-09-17T01:53:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.915+0000 7fe6b8c39700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fe6a006e3e0 0x7fe6a0070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:38.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.915+0000 7fe6b8c39700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fe6a006e3e0 0x7fe6a0070890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40010a0 tx=0x7fe6a4006df0 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:38.919+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fe6b0058c00 con 0x7fe6b4069250 2024-09-17T01:53:39.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.281+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 --> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6b4061190 con 0x7fe6a006e3e0 2024-09-17T01:53:39.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.282+0000 7fe6aa7fc700 1 -- 172.21.15.31:0/2159462297 <== mgr.14706 v2:172.21.15.31:6800/1543058923 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe6b4061190 con 0x7fe6a006e3e0 2024-09-17T01:53:39.280 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:53:39.280 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:53:39.281 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:53:39.281 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:53:39.281 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:53:39.281 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr" 2024-09-17T01:53:39.281 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:53:39.282 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:53:39.282 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:53:39.282 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:53:39.282 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:53:39.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.284+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fe6a006e3e0 msgr2=0x7fe6a0070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:39.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.284+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fe6a006e3e0 0x7fe6a0070890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40010a0 tx=0x7fe6a4006df0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 msgr2=0x7fe6b4197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:39.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b4197d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0000c00 tx=0x7fe6b000be20 comp rx=0 tx=0).stop 2024-09-17T01:53:39.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 shutdown_connections 2024-09-17T01:53:39.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7fe6a006e3e0 0x7fe6a0070890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6b4069250 0x7fe6b4197d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 --2- 172.21.15.31:0/2159462297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b4105730 0x7fe6b41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 >> 172.21.15.31:0/2159462297 conn(0x7fe6b40fa780 msgr2=0x7fe6b40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:39.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 shutdown_connections 2024-09-17T01:53:39.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.285+0000 7fe6bb69e700 1 -- 172.21.15.31:0/2159462297 wait complete. 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 -- 172.21.15.31:0/2012146748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 msgr2=0x7f70e40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 --2- 172.21.15.31:0/2012146748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40ff540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009910 tx=0x7f70e0009c20 comp rx=0 tx=0).stop 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 -- 172.21.15.31:0/2012146748 shutdown_connections 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 --2- 172.21.15.31:0/2012146748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 0x7f70e4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 --2- 172.21.15.31:0/2012146748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40ff540 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 -- 172.21.15.31:0/2012146748 >> 172.21.15.31:0/2012146748 conn(0x7f70e40fa780 msgr2=0x7f70e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 -- 172.21.15.31:0/2012146748 shutdown_connections 2024-09-17T01:53:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.400+0000 7f70eb53f700 1 -- 172.21.15.31:0/2012146748 wait complete. 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70eb53f700 1 Processor -- start 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70eb53f700 1 -- start start 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70eb53f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70eb53f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 0x7f70e419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70eb53f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41966d0 con 0x7f70e41003d0 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70eb53f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e419d1a0 con 0x7f70e40ff130 2024-09-17T01:53:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.401+0000 7f70e8ada700 1 -- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 msgr2=0x7f70e419cc60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:3300/0 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e8ada700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 0x7f70e419cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36352/0 (socket says 172.21.15.31:36352) 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 -- 172.21.15.31:0/447388860 learned_addr learned my addr 172.21.15.31:0/447388860 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 -- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 msgr2=0x7f70e419cc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 0x7f70e419cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 -- 172.21.15.31:0/447388860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00095f0 con 0x7f70e40ff130 2024-09-17T01:53:39.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70e92db700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40690c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f70e000bd70 tx=0x7f70e000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:39.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e001d070 con 0x7f70e40ff130 2024-09-17T01:53:39.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f70e0022470 con 0x7f70e40ff130 2024-09-17T01:53:39.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e419d420 con 0x7f70e40ff130 2024-09-17T01:53:39.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.402+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e000f690 con 0x7f70e40ff130 2024-09-17T01:53:39.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.403+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e419d910 con 0x7f70e40ff130 2024-09-17T01:53:39.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.404+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e4107cb0 con 0x7f70e40ff130 2024-09-17T01:53:39.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.404+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f70e00225e0 con 0x7f70e40ff130 2024-09-17T01:53:39.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.405+0000 7f70da7fc700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f70d006e380 0x7f70d0070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:39.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.405+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f70e008faf0 con 0x7f70e40ff130 2024-09-17T01:53:39.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.405+0000 7f70e8ada700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f70d006e380 0x7f70d0070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:39.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.405+0000 7f70e8ada700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f70d006e380 0x7f70d0070830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70d4000f20 tx=0x7f70d4006e30 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.409+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f70e005cba0 con 0x7f70e40ff130 2024-09-17T01:53:39.707 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-17T01:53:39.708 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-17T01:53:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.727+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f70e419df50 con 0x7f70e40ff130 2024-09-17T01:53:39.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.727+0000 7f70da7fc700 1 -- 172.21.15.31:0/447388860 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f70e0027020 con 0x7f70e40ff130 2024-09-17T01:53:39.726 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:53:39.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.729+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f70d006e380 msgr2=0x7f70d0070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:39.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.729+0000 7f70eb53f700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f70d006e380 0x7f70d0070830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70d4000f20 tx=0x7f70d4006e30 comp rx=0 tx=0).stop 2024-09-17T01:53:39.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.729+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 msgr2=0x7f70e40690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:39.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.729+0000 7f70eb53f700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40690c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f70e000bd70 tx=0x7f70e000be50 comp rx=0 tx=0).stop 2024-09-17T01:53:39.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 shutdown_connections 2024-09-17T01:53:39.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:6800/1543058923,v1:172.21.15.31:6801/1543058923] conn(0x7f70d006e380 0x7f70d0070830 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70e40ff130 0x7f70e40690c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 --2- 172.21.15.31:0/447388860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e41003d0 0x7f70e419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:39.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 >> 172.21.15.31:0/447388860 conn(0x7f70e40fa780 msgr2=0x7f70e4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:39.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 shutdown_connections 2024-09-17T01:53:39.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:53:39.730+0000 7f70eb53f700 1 -- 172.21.15.31:0/447388860 wait complete. 2024-09-17T01:53:40.009 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:40.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:53:40.081 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:53:40.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:53:40.112 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:53:40.112 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:41.087 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:40 smithi031 podman[77009]: 2024-09-17 01:53:40.796050675 +0000 UTC m=+2.554153640 container cleanup ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, RELEASE=HEAD) 2024-09-17T01:53:41.087 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:40 smithi031 bash[77009]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031 2024-09-17T01:53:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 podman[77057]: 2024-09-17 01:53:41.089387898 +0000 UTC m=+2.556795282 container remove ed23fac2b163eaedbadc804ae7cbc5107c1bc0f1e43052017cc772f56cdbf464 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True) 2024-09-17T01:53:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service: Deactivated successfully. 2024-09-17T01:53:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 systemd[1]: Stopped Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:53:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service: Consumed 13.302s CPU time. 2024-09-17T01:53:41.895 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 systemd[1]: Starting Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:53:41.896 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 podman[77255]: 2024-09-17 01:53:41.651854869 +0000 UTC m=+0.016428920 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:53:41.896 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:41 smithi031 podman[77255]: 2024-09-17 01:53:41.774468506 +0000 UTC m=+0.139042580 container create c2c9d962792c08fc2bea574d882277a41ecc0c6309b9bcc323eaccd8b259c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:53:42.166 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 podman[77255]: 2024-09-17 01:53:42.062929364 +0000 UTC m=+0.427503408 container init c2c9d962792c08fc2bea574d882277a41ecc0c6309b9bcc323eaccd8b259c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 podman[77255]: 2024-09-17 01:53:42.066676808 +0000 UTC m=+0.431250841 container start c2c9d962792c08fc2bea574d882277a41ecc0c6309b9bcc323eaccd8b259c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: pidfile_write: ignore empty --pid-file 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: load: jerasure load: lrc 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Git sha 0 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: DB SUMMARY 2024-09-17T01:53:42.167 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: DB Session ID: 9ZASHZX1AI7QFDJCRRCZ 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1510 Bytes 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi031/store.db dir, Total Num: 1, files: 000032.sst 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi031/store.db: 000030.log size: 1084066 ; 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:53:42.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.env: 0x562166e8a940 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.info_log: 0x5621691b98c0 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.statistics: (nil) 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.use_fsync: 0 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:53:42.169 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.db_log_dir: 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.wal_dir: 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:53:42.170 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.write_buffer_manager: 0x5621691c8dc0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.unordered_write: 0 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:53:42.171 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:53:42.172 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.row_cache: None 2024-09-17T01:53:42.172 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.wal_filter: None 2024-09-17T01:53:42.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:53:42.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:53:42.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:53:42.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:53:42.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.wal_compression: 0 2024-09-17T01:53:42.173 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:53:42.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_open_files: -1 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:53:42.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Compression algorithms supported: 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kZSTD supported: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:53:42.176 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi031/store.db/MANIFEST-000015 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.merge_operator: 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_filter: None 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5621691b9520) 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:53:42.177 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: index_type: 0 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: data_block_index_type: 0 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: index_shortening: 1 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: checksum: 4 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: no_block_cache: 0 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache: 0x5621691ad1f0 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache_options: 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: capacity : 536870912 2024-09-17T01:53:42.178 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: num_shard_bits : 4 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: strict_capacity_limit : 0 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_cache_compressed: (nil) 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: persistent_cache: (nil) 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_size: 4096 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_size_deviation: 10 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_restart_interval: 16 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: index_block_restart_interval: 1 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: metadata_block_size: 4096 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: partition_filters: 0 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: use_delta_encoding: 1 2024-09-17T01:53:42.179 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: filter_policy: bloomfilter 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: whole_key_filtering: 1 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: verify_compression: 0 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: format_version: 5 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: enable_index_compression: 1 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: block_align: 0 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: max_auto_readahead_size: 262144 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: prepopulate_block_cache: 0 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:53:42.180 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression: NoCompression 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.num_levels: 7 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:53:42.181 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:53:42.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:53:42.183 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:53:42.184 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:53:42.185 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.ttl: 2592000 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:53:42.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi031/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12108, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 33e40c68-552c-40ca-aa10-0d17c7dd0ada 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726538022094295, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726538022100619, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 949079, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12109, "largest_seqno": 12745, "table_properties": {"data_size": 945566, "index_size": 1769, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 6530, "raw_average_key_size": 23, "raw_value_size": 939504, "raw_average_value_size": 3404, "num_data_blocks": 80, "num_entries": 276, "num_filter_entries": 276, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726538022, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "33e40c68-552c-40ca-aa10-0d17c7dd0ada", "db_session_id": "9ZASHZX1AI7QFDJCRRCZ", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:53:42.187 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726538022100731, "job": 1, "event": "recovery_finished"} 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi031/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5621691dae00 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: DB pointer 0x5621692d6000 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** DB Stats ** 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:53:42.188 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** Compaction Stats [default] ** 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: L0 1/0 926.83 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 274.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: L6 1/0 5.76 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Sum 2/0 6.67 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 274.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 274.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.189 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** Compaction Stats [default] ** 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 274.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:53:42.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Cumulative compaction: 0.00 GB write, 100.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Interval compaction: 0.00 GB write, 100.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Block cache BinnedLRUCache@0x5621691ad1f0#2 capacity: 512.00 MB usage: 2.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: starting mon.smithi031 rank 0 at public addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] at bind addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi031 fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???) e2 preinit fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).mds e17 new map 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).mds e17 print_map 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: e17 2024-09-17T01:53:42.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: legacy client fscid: 1 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: fs_name cephfs 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: epoch 17 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: tableserver 0 2024-09-17T01:53:42.192 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: root 0 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: session_timeout 60 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: session_autoclose 300 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: max_file_size 1099511627776 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: max_xattr_size 65536 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: required_client_features {} 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: last_failure 0 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: last_failure_osd_epoch 0 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: max_mds 2 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: in 0,1 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: up {0=14464,1=24269} 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: failed 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: damaged 2024-09-17T01:53:42.193 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: stopped 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: data_pools [3] 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: metadata_pool 2 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: inline_data disabled 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: balancer 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: bal_rank_mask -1 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: standby_count_wanted 1 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: qdb_cluster leader: 0 members: 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: [mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: [mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: [mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: [mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:53:42.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 ceph-mon[77274]: mon.smithi031@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 bash[77255]: c2c9d962792c08fc2bea574d882277a41ecc0c6309b9bcc323eaccd8b259c663 2024-09-17T01:53:42.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:42 smithi031 systemd[1]: Started Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/482344668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 932 KiB/s rd, 976 KiB/s wr, 242 op/s 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='client.? 172.21.15.31:0/447388860' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: pgmap v26: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 932 KiB/s rd, 976 KiB/s wr, 242 op/s 2024-09-17T01:53:45.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 388 op/s 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: mon.smithi031 calling monitor election 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: mon.smithi031 is new leader, mons smithi031,smithi092 in quorum (ranks 0,1) 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: monmap epoch 2 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: last_changed 2024-09-17T01:44:51.483138+0000 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: created 2024-09-17T01:42:11.634074+0000 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: min_mon_release 18 (reef) 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: election_strategy: 1 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.smithi031 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: 1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.smithi092 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: mgrmap e31: smithi031.ealpiz(active, since 50s), standbys: smithi092.tjdpfw 2024-09-17T01:53:45.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: overall HEALTH_OK 2024-09-17T01:53:45.470 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: from='mgr.14706 ' entity='' 2024-09-17T01:53:45.470 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:45 smithi092 ceph-mon[33552]: mgrmap e32: smithi031.ealpiz(active, since 50s), standbys: smithi092.tjdpfw 2024-09-17T01:53:45.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:53:45.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:53:45.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/482344668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:53:45.511 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 932 KiB/s rd, 976 KiB/s wr, 242 op/s 2024-09-17T01:53:45.512 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='client.24563 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:53:45.512 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/447388860' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:53:45.513 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='mgr.14706 172.21.15.31:0/3901561520' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:45.513 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: pgmap v26: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 932 KiB/s rd, 976 KiB/s wr, 242 op/s 2024-09-17T01:53:45.513 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 388 op/s 2024-09-17T01:53:45.513 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: mon.smithi031 calling monitor election 2024-09-17T01:53:45.513 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: mon.smithi031 is new leader, mons smithi031,smithi092 in quorum (ranks 0,1) 2024-09-17T01:53:45.513 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: monmap epoch 2 2024-09-17T01:53:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:53:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: last_changed 2024-09-17T01:44:51.483138+0000 2024-09-17T01:53:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: created 2024-09-17T01:42:11.634074+0000 2024-09-17T01:53:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: min_mon_release 18 (reef) 2024-09-17T01:53:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: election_strategy: 1 2024-09-17T01:53:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.smithi031 2024-09-17T01:53:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: 1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.smithi092 2024-09-17T01:53:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:53:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:53:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: mgrmap e31: smithi031.ealpiz(active, since 50s), standbys: smithi092.tjdpfw 2024-09-17T01:53:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: overall HEALTH_OK 2024-09-17T01:53:45.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: from='mgr.14706 ' entity='' 2024-09-17T01:53:45.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:45 smithi031 ceph-mon[77274]: mgrmap e32: smithi031.ealpiz(active, since 50s), standbys: smithi092.tjdpfw 2024-09-17T01:53:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:49 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw restarted 2024-09-17T01:53:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:49 smithi092 ceph-mon[33552]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:53:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:49 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:53:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:49 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:53:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:49 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:53:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:49 smithi092 ceph-mon[33552]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:53:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:49 smithi031 ceph-mon[77274]: Standby manager daemon smithi092.tjdpfw restarted 2024-09-17T01:53:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:49 smithi031 ceph-mon[77274]: Standby manager daemon smithi092.tjdpfw started 2024-09-17T01:53:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:49 smithi031 ceph-mon[77274]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/crt"}]: dispatch 2024-09-17T01:53:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:49 smithi031 ceph-mon[77274]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:53:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:49 smithi031 ceph-mon[77274]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi092.tjdpfw/key"}]: dispatch 2024-09-17T01:53:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:49 smithi031 ceph-mon[77274]: from='mgr.? 172.21.15.92:0/4293073849' entity='mgr.smithi092.tjdpfw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:53:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: mgrmap e33: smithi031.ealpiz(active, since 54s), standbys: smithi092.tjdpfw 2024-09-17T01:53:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: Active manager daemon smithi031.ealpiz restarted 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: Activating manager daemon smithi031.ealpiz 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: mgrmap e34: smithi031.ealpiz(active, starting, since 0.0101304s), standbys: smithi092.tjdpfw 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:53:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:51.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:53:51.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:50 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:53:51.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: mgrmap e33: smithi031.ealpiz(active, since 54s), standbys: smithi092.tjdpfw 2024-09-17T01:53:51.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: Active manager daemon smithi031.ealpiz restarted 2024-09-17T01:53:51.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: Activating manager daemon smithi031.ealpiz 2024-09-17T01:53:51.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:53:51.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: mgrmap e34: smithi031.ealpiz(active, starting, since 0.0101304s), standbys: smithi092.tjdpfw 2024-09-17T01:53:51.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:53:51.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:53:51.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:53:51.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:53:51.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:53:51.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:53:51.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi031.ealpiz", "id": "smithi031.ealpiz"}]: dispatch 2024-09-17T01:53:51.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr metadata", "who": "smithi092.tjdpfw", "id": "smithi092.tjdpfw"}]: dispatch 2024-09-17T01:53:51.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:53:51.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:53:51.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:53:51.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:53:51.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:53:51.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:53:51.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:53:51.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:53:51.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:53:51.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: Manager daemon smithi031.ealpiz is now available 2024-09-17T01:53:51.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:51.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:53:51.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:53:51.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi031.ealpiz/trash_purge_schedule"}]: dispatch 2024-09-17T01:53:52.356 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:52 smithi031 ceph-mon[77274]: mgrmap e35: smithi031.ealpiz(active, since 1.01167s), standbys: smithi092.tjdpfw 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:52 smithi031 ceph-mon[77274]: [17/Sep/2024:01:53:51] ENGINE Bus STARTING 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:52 smithi031 ceph-mon[77274]: [17/Sep/2024:01:53:51] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:52 smithi031 ceph-mon[77274]: [17/Sep/2024:01:53:52] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:52 smithi031 ceph-mon[77274]: [17/Sep/2024:01:53:52] ENGINE Bus STARTED 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:52 smithi031 ceph-mon[77274]: [17/Sep/2024:01:53:52] ENGINE Error in HTTPServer.serve 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: Traceback (most recent call last): 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._run(expiration_interval) 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:53:52.357 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: s = self.context.wrap_socket( 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: return self.sslsocket_class._create( 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self.do_handshake() 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: self._sslobj.do_handshake() 2024-09-17T01:53:52.358 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:53:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:52 smithi092 ceph-mon[33552]: mgrmap e35: smithi031.ealpiz(active, since 1.01167s), standbys: smithi092.tjdpfw 2024-09-17T01:53:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:52 smithi092 ceph-mon[33552]: [17/Sep/2024:01:53:51] ENGINE Bus STARTING 2024-09-17T01:53:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:52 smithi092 ceph-mon[33552]: [17/Sep/2024:01:53:51] ENGINE Serving on http://172.21.15.31:8765 2024-09-17T01:53:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:52 smithi092 ceph-mon[33552]: [17/Sep/2024:01:53:52] ENGINE Serving on https://172.21.15.31:7150 2024-09-17T01:53:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:52 smithi092 ceph-mon[33552]: [17/Sep/2024:01:53:52] ENGINE Bus STARTED 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:52 smithi092 ceph-mon[33552]: [17/Sep/2024:01:53:52] ENGINE Error in HTTPServer.serve 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Traceback (most recent call last): 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._run(expiration_interval) 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: s = self.context.wrap_socket( 2024-09-17T01:53:52.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:53:52.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: return self.sslsocket_class._create( 2024-09-17T01:53:52.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:53:52.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self.do_handshake() 2024-09-17T01:53:52.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:53:52.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: self._sslobj.do_handshake() 2024-09-17T01:53:52.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:53:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:53 smithi092 ceph-mon[33552]: mgrmap e36: smithi031.ealpiz(active, since 2s), standbys: smithi092.tjdpfw 2024-09-17T01:53:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:53 smithi092 ceph-mon[33552]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:53.502 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:53 smithi031 ceph-mon[77274]: mgrmap e36: smithi031.ealpiz(active, since 2s), standbys: smithi092.tjdpfw 2024-09-17T01:53:53.502 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:53 smithi031 ceph-mon[77274]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:55.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:55 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:55 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:55 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:55 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.504 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.504 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.504 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:55.504 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:56.468 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:56 smithi092 ceph-mon[33552]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:56.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:56 smithi092 ceph-mon[33552]: mgrmap e37: smithi031.ealpiz(active, since 5s), standbys: smithi092.tjdpfw 2024-09-17T01:53:56.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:56 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:56.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:56 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:56 smithi031 ceph-mon[77274]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:53:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:56 smithi031 ceph-mon[77274]: mgrmap e37: smithi031.ealpiz(active, since 5s), standbys: smithi092.tjdpfw 2024-09-17T01:53:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:56 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:56 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:57 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:53:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-17T01:53:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:58.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:58.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:58.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:53:58.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:53:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:53:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:53:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:59.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:53:59.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:53:59.093 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.conf 2024-09-17T01:53:59.093 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:53:59.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:58 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:54:00.041 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:59 smithi092 ceph-mon[33552]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T01:54:00.041 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:59 smithi092 ceph-mon[33552]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:54:00.041 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:53:59 smithi092 ceph-mon[33552]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:54:00.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:59 smithi031 ceph-mon[77274]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T01:54:00.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:59 smithi031 ceph-mon[77274]: Updating smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:54:00.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:53:59 smithi031 ceph-mon[77274]: Updating smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:54:01.389 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-mon[33552]: Upgrade: Updating mon.smithi092 2024-09-17T01:54:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:54:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:54:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-mon[33552]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:01.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-mon[33552]: Deploying daemon mon.smithi092 on smithi092 2024-09-17T01:54:01.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:01 smithi031 ceph-mon[77274]: Upgrade: Updating mon.smithi092 2024-09-17T01:54:01.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:01.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:54:01.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:54:01.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:01.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:01 smithi031 ceph-mon[77274]: Deploying daemon mon.smithi092 on smithi092 2024-09-17T01:54:01.945 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 systemd[1]: Stopping Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:54:02.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092[33546]: 2024-09-17T01:54:01.946+0000 7f0d9251a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi092 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:54:02.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:01 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092[33546]: 2024-09-17T01:54:01.946+0000 7f0d9251a700 -1 mon.smithi092@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T01:54:02.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 podman[64335]: 2024-09-17 01:54:02.039065162 +0000 UTC m=+0.204239198 container died e7f223f792d2279ff30ac1ffb895008aa263d5558aa84673b4897f669e3fc211 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True) 2024-09-17T01:54:02.587 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 podman[64335]: 2024-09-17 01:54:02.371664665 +0000 UTC m=+0.536838703 container cleanup e7f223f792d2279ff30ac1ffb895008aa263d5558aa84673b4897f669e3fc211 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, ceph=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2) 2024-09-17T01:54:02.587 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 bash[64335]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092 2024-09-17T01:54:02.847 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 podman[64350]: 2024-09-17 01:54:02.589991886 +0000 UTC m=+0.552741815 container remove e7f223f792d2279ff30ac1ffb895008aa263d5558aa84673b4897f669e3fc211 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, io.buildah.version=1.29.1, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-17T01:54:02.847 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092.service: Deactivated successfully. 2024-09-17T01:54:02.847 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 systemd[1]: Stopped Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:54:02.847 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:02 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092.service: Consumed 6.586s CPU time. 2024-09-17T01:54:03.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 systemd[1]: Starting Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:54:03.532 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 podman[64476]: 2024-09-17 01:54:03.167550775 +0000 UTC m=+0.016224374 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:54:03.533 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 podman[64476]: 2024-09-17 01:54:03.317649291 +0000 UTC m=+0.166322935 container create 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T01:54:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 podman[64476]: 2024-09-17 01:54:03.535207621 +0000 UTC m=+0.383881219 container init 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97) 2024-09-17T01:54:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 podman[64476]: 2024-09-17 01:54:03.538538267 +0000 UTC m=+0.387211866 container start 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:54:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: pidfile_write: ignore empty --pid-file 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: load: jerasure load: lrc 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Git sha 0 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: DB SUMMARY 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: DB Session ID: B3JNQEANPPUOWHV3HC4E 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1404 Bytes 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi092/store.db dir, Total Num: 1, files: 000027.sst 2024-09-17T01:54:03.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi092/store.db: 000025.log size: 4507198 ; 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.env: 0x555cba699940 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.info_log: 0x555cbc8ef8c0 2024-09-17T01:54:03.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.statistics: (nil) 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.use_fsync: 0 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:54:03.993 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.db_log_dir: 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.wal_dir: 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:54:03.994 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.write_buffer_manager: 0x555cbc8fedc0 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:54:03.995 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.unordered_write: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.row_cache: None 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.wal_filter: None 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.wal_compression: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:54:03.996 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:54:03.997 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_open_files: -1 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:54:03.998 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Compression algorithms supported: 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kZSTD supported: 0 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi092/store.db/MANIFEST-000010 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:54:03.999 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.merge_operator: 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_filter: None 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555cbc8ef520) 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: index_type: 0 2024-09-17T01:54:04.000 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: data_block_index_type: 0 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: index_shortening: 1 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: checksum: 4 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: no_block_cache: 0 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_cache: 0x555cbc8e31f0 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_cache_options: 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: capacity : 536870912 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: num_shard_bits : 4 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: strict_capacity_limit : 0 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_cache_compressed: (nil) 2024-09-17T01:54:04.001 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: persistent_cache: (nil) 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_size: 4096 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_size_deviation: 10 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_restart_interval: 16 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: index_block_restart_interval: 1 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: metadata_block_size: 4096 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: partition_filters: 0 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: use_delta_encoding: 1 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: filter_policy: bloomfilter 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: whole_key_filtering: 1 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: verify_compression: 0 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: format_version: 5 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: enable_index_compression: 1 2024-09-17T01:54:04.002 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: block_align: 0 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: max_auto_readahead_size: 262144 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: prepopulate_block_cache: 0 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression: NoCompression 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.num_levels: 7 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:54:04.003 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:54:04.004 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:54:04.005 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:54:04.006 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:54:04.007 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.ttl: 2592000 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:54:04.008 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:54:04.009 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi092/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12190, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5958f3ef-4d74-4796-9450-ccd175855abb 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726538043565058, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-17T01:54:04.010 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-17T01:54:04.011 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726538043575042, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2762695, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12196, "largest_seqno": 13348, "table_properties": {"data_size": 2757371, "index_size": 3063, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1221, "raw_key_size": 11344, "raw_average_key_size": 23, "raw_value_size": 2747109, "raw_average_value_size": 5735, "num_data_blocks": 140, "num_entries": 479, "num_filter_entries": 479, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726538043, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5958f3ef-4d74-4796-9450-ccd175855abb", "db_session_id": "B3JNQEANPPUOWHV3HC4E", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:54:04.011 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726538043575162, "job": 1, "event": "recovery_finished"} 2024-09-17T01:54:04.011 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-17T01:54:04.011 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:54:04.011 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi092/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:54:04.011 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555cbc910e00 2024-09-17T01:54:04.012 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: DB pointer 0x555cbca0c000 2024-09-17T01:54:04.012 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:54:04.012 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:54:04.012 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ** DB Stats ** 2024-09-17T01:54:04.012 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:54:04.012 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:54:04.013 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:54:04.013 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:54:04.013 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:54:04.013 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:54:04.013 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:54:04.013 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.014 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-17T01:54:04.014 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:54:04.014 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:54:04.014 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: L0 1/0 2.63 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 685.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:54:04.014 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: L6 1/0 5.76 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:54:04.014 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Sum 2/0 8.40 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 685.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:54:04.015 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 685.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:54:04.015 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.015 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-17T01:54:04.015 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:54:04.015 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:54:04.015 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 685.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:54:04.016 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.016 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:54:04.016 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.016 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:54:04.016 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-17T01:54:04.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:54:04.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:54:04.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:54:04.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:54:04.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Cumulative compaction: 0.00 GB write, 181.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:54:04.017 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Interval compaction: 0.00 GB write, 181.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:54:04.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:54:04.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Block cache BinnedLRUCache@0x555cbc8e31f0#2 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-17T01:54:04.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-09-17T01:54:04.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:54:04.018 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: starting mon.smithi092 rank 1 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi092 fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:54:04.019 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???) e2 preinit fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:54:04.019 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).mds e17 new map 2024-09-17T01:54:04.019 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).mds e17 print_map 2024-09-17T01:54:04.019 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: e17 2024-09-17T01:54:04.019 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:54:04.019 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: legacy client fscid: 1 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: fs_name cephfs 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: epoch 17 2024-09-17T01:54:04.020 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:54:04.021 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:54:04.021 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:54:04.021 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: tableserver 0 2024-09-17T01:54:04.021 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: root 0 2024-09-17T01:54:04.021 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: session_timeout 60 2024-09-17T01:54:04.021 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: session_autoclose 300 2024-09-17T01:54:04.022 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: max_file_size 1099511627776 2024-09-17T01:54:04.022 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: max_xattr_size 65536 2024-09-17T01:54:04.022 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: required_client_features {} 2024-09-17T01:54:04.022 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: last_failure 0 2024-09-17T01:54:04.022 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: last_failure_osd_epoch 0 2024-09-17T01:54:04.023 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:54:04.023 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: max_mds 2 2024-09-17T01:54:04.023 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: in 0,1 2024-09-17T01:54:04.023 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: up {0=14464,1=24269} 2024-09-17T01:54:04.023 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: failed 2024-09-17T01:54:04.023 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: damaged 2024-09-17T01:54:04.024 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: stopped 2024-09-17T01:54:04.024 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: data_pools [3] 2024-09-17T01:54:04.024 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: metadata_pool 2 2024-09-17T01:54:04.024 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: inline_data disabled 2024-09-17T01:54:04.024 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: balancer 2024-09-17T01:54:04.024 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: bal_rank_mask -1 2024-09-17T01:54:04.025 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: standby_count_wanted 1 2024-09-17T01:54:04.025 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: qdb_cluster leader: 0 members: 2024-09-17T01:54:04.025 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: [mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:04.025 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: [mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:04.025 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: [mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:04.026 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: [mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:04.026 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.026 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout: 2024-09-17T01:54:04.026 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:54:04.026 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:54:04.026 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:54:04.027 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:54:04.027 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 ceph-mon[64495]: mon.smithi092@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-17T01:54:04.027 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 bash[64476]: 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 2024-09-17T01:54:04.027 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:03 smithi092 systemd[1]: Started Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:54:05.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:05 smithi092 ceph-mon[64495]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T01:54:05.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:05 smithi031 ceph-mon[77274]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T01:54:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: pgmap v10: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 170 B/s wr, 13 op/s 2024-09-17T01:54:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:54:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:54:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: mon.smithi031 calling monitor election 2024-09-17T01:54:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: mon.smithi092 calling monitor election 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: mon.smithi031 is new leader, mons smithi031,smithi092 in quorum (ranks 0,1) 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: monmap epoch 3 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: last_changed 2024-09-17T01:54:05.091882+0000 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: created 2024-09-17T01:42:11.634074+0000 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: min_mon_release 19 (squid) 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: election_strategy: 1 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.smithi031 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: 1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.smithi092 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: mgrmap e37: smithi031.ealpiz(active, since 14s), standbys: smithi092.tjdpfw 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: overall HEALTH_OK 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:06.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:06.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:06.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: pgmap v10: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 170 B/s wr, 13 op/s 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi031"}]: dispatch 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mon metadata", "id": "smithi092"}]: dispatch 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: mon.smithi031 calling monitor election 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: mon.smithi092 calling monitor election 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: mon.smithi031 is new leader, mons smithi031,smithi092 in quorum (ranks 0,1) 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: monmap epoch 3 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: fsid fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T01:54:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: last_changed 2024-09-17T01:54:05.091882+0000 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: created 2024-09-17T01:42:11.634074+0000 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: min_mon_release 19 (squid) 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: election_strategy: 1 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.smithi031 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: 1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.smithi092 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: osdmap e48: 6 total, 6 up, 6 in 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: mgrmap e37: smithi031.ealpiz(active, since 14s), standbys: smithi092.tjdpfw 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: overall HEALTH_OK 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:06.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:08 smithi092 ceph-mon[64495]: pgmap v11: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 170 B/s wr, 14 op/s 2024-09-17T01:54:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:08 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:08 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:08 smithi031 ceph-mon[77274]: pgmap v11: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 170 B/s wr, 14 op/s 2024-09-17T01:54:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:08 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:08 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:09.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:09 smithi031 ceph-mon[77274]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:54:09.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 -- 172.21.15.31:0/1557988554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e080ff140 msgr2=0x7f4e080ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 --2- 172.21.15.31:0/1557988554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e080ff140 0x7f4e080ff550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009910 tx=0x7f4e04009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:09.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 -- 172.21.15.31:0/1557988554 shutdown_connections 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 --2- 172.21.15.31:0/1557988554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e08100340 0x7f4e08100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 --2- 172.21.15.31:0/1557988554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e080ff140 0x7f4e080ff550 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 -- 172.21.15.31:0/1557988554 >> 172.21.15.31:0/1557988554 conn(0x7f4e080fa6d0 msgr2=0x7f4e080fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 -- 172.21.15.31:0/1557988554 shutdown_connections 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.853+0000 7f4e106af700 1 -- 172.21.15.31:0/1557988554 wait complete. 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.854+0000 7f4e106af700 1 Processor -- start 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.854+0000 7f4e106af700 1 -- start start 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.854+0000 7f4e106af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e080ff140 0x7f4e081030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.854+0000 7f4e106af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 0x7f4e08101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.854+0000 7f4e106af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08101c60 con 0x7f4e08100340 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.854+0000 7f4e106af700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08101da0 con 0x7f4e080ff140 2024-09-17T01:54:09.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 0x7f4e08101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 0x7f4e08101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54792/0 (socket says 172.21.15.31:54792) 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 -- 172.21.15.31:0/1739747984 learned_addr learned my addr 172.21.15.31:0/1739747984 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0e44b700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e080ff140 0x7f4e081030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 -- 172.21.15.31:0/1739747984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e080ff140 msgr2=0x7f4e081030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e080ff140 0x7f4e081030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 -- 172.21.15.31:0/1739747984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040095f0 con 0x7f4e08100340 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0e44b700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e080ff140 0x7f4e081030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e0dc4a700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 0x7f4e08101720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e920 tx=0x7f4df800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df8009790 con 0x7f4e08100340 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4df800cba0 con 0x7f4e08100340 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e08102080 con 0x7f4e08100340 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4df8018630 con 0x7f4e08100340 2024-09-17T01:54:09.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.855+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0819db20 con 0x7f4e08100340 2024-09-17T01:54:09.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.856+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e08107c90 con 0x7f4e08100340 2024-09-17T01:54:09.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.857+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4df800cd10 con 0x7f4e08100340 2024-09-17T01:54:09.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.857+0000 7f4dff7fe700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4df406e7c0 0x7f4df4070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:09.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.858+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4df8014070 con 0x7f4e08100340 2024-09-17T01:54:09.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.858+0000 7f4e0e44b700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4df406e7c0 0x7f4df4070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:09.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.858+0000 7f4e0e44b700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4df406e7c0 0x7f4df4070c70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e040059d0 tx=0x7f4e04005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:09.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:09.862+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4df80541b0 con 0x7f4e08100340 2024-09-17T01:54:09.976 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:09 smithi092 ceph-mon[64495]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:54:09.976 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:09.976 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:10.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.096+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e08069500 con 0x7f4df406e7c0 2024-09-17T01:54:10.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.098+0000 7f4dff7fe700 1 -- 172.21.15.31:0/1739747984 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4e08069500 con 0x7f4df406e7c0 2024-09-17T01:54:10.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4df406e7c0 msgr2=0x7f4df4070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4df406e7c0 0x7f4df4070c70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e040059d0 tx=0x7f4e04005940 comp rx=0 tx=0).stop 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 msgr2=0x7f4e08101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 0x7f4e08101720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e920 tx=0x7f4df800ece0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 shutdown_connections 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4df406e7c0 0x7f4df4070c70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e080ff140 0x7f4e081030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 --2- 172.21.15.31:0/1739747984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e08100340 0x7f4e08101720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 >> 172.21.15.31:0/1739747984 conn(0x7f4e080fa6d0 msgr2=0x7f4e08068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 shutdown_connections 2024-09-17T01:54:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.100+0000 7f4e106af700 1 -- 172.21.15.31:0/1739747984 wait complete. 2024-09-17T01:54:10.109 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:54:10.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 -- 172.21.15.31:0/107795826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c81003f0 msgr2=0x7fe1c8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/107795826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c81003f0 0x7fe1c8100860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009910 tx=0x7fe1b0009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 -- 172.21.15.31:0/107795826 shutdown_connections 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/107795826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c81003f0 0x7fe1c8100860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/107795826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c80ff150 0x7fe1c80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 -- 172.21.15.31:0/107795826 >> 172.21.15.31:0/107795826 conn(0x7fe1c80fa7a0 msgr2=0x7fe1c80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 -- 172.21.15.31:0/107795826 shutdown_connections 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.210+0000 7fe1cce0a700 1 -- 172.21.15.31:0/107795826 wait complete. 2024-09-17T01:54:10.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.211+0000 7fe1cce0a700 1 Processor -- start 2024-09-17T01:54:10.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.211+0000 7fe1cce0a700 1 -- start start 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.211+0000 7fe1cce0a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 0x7fe1c8195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.211+0000 7fe1cce0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c81003f0 0x7fe1c8196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.211+0000 7fe1cce0a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8196920 con 0x7fe1c80ff150 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.211+0000 7fe1cce0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8196a60 con 0x7fe1c81003f0 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 0x7fe1c8195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 0x7fe1c8195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54824/0 (socket says 172.21.15.31:54824) 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 -- 172.21.15.31:0/4058348212 learned_addr learned my addr 172.21.15.31:0/4058348212 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1bdd9b700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c81003f0 0x7fe1c8196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 -- 172.21.15.31:0/4058348212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c81003f0 msgr2=0x7fe1c8196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c81003f0 0x7fe1c8196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 -- 172.21.15.31:0/4058348212 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00095f0 con 0x7fe1c80ff150 2024-09-17T01:54:10.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1bdd9b700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c81003f0 0x7fe1c8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:54:10.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1c659c700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 0x7fe1c8195dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800e940 tx=0x7fe1b800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:10.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b800cba0 con 0x7fe1c80ff150 2024-09-17T01:54:10.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1b800ee90 con 0x7fe1c80ff150 2024-09-17T01:54:10.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b8005650 con 0x7fe1c80ff150 2024-09-17T01:54:10.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c819b510 con 0x7fe1c80ff150 2024-09-17T01:54:10.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.212+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c819ba60 con 0x7fe1c80ff150 2024-09-17T01:54:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.213+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c8068ab0 con 0x7fe1c80ff150 2024-09-17T01:54:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.214+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fe1b8004750 con 0x7fe1c80ff150 2024-09-17T01:54:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.215+0000 7fe1bffff700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe1b406e7b0 0x7fe1b4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.215+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe1b8014070 con 0x7fe1c80ff150 2024-09-17T01:54:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.215+0000 7fe1bdd9b700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe1b406e7b0 0x7fe1b4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.215+0000 7fe1bdd9b700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe1b406e7b0 0x7fe1b4070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b6f0 tx=0x7fe1b0005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:10.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.219+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe1b805b670 con 0x7fe1c80ff150 2024-09-17T01:54:10.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.457+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1c80694e0 con 0x7fe1b406e7b0 2024-09-17T01:54:10.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.459+0000 7fe1bffff700 1 -- 172.21.15.31:0/4058348212 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe1c80694e0 con 0x7fe1b406e7b0 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe1b406e7b0 msgr2=0x7fe1b4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe1b406e7b0 0x7fe1b4070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b6f0 tx=0x7fe1b0005a90 comp rx=0 tx=0).stop 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 msgr2=0x7fe1c8195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 0x7fe1c8195dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800e940 tx=0x7fe1b800ec50 comp rx=0 tx=0).stop 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 shutdown_connections 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe1b406e7b0 0x7fe1b4070c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1c80ff150 0x7fe1c8195dc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 --2- 172.21.15.31:0/4058348212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c81003f0 0x7fe1c8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 >> 172.21.15.31:0/4058348212 conn(0x7fe1c80fa7a0 msgr2=0x7fe1c8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 shutdown_connections 2024-09-17T01:54:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.461+0000 7fe1cce0a700 1 -- 172.21.15.31:0/4058348212 wait complete. 2024-09-17T01:54:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 -- 172.21.15.31:0/1806659938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9441003d0 msgr2=0x7fb944100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 --2- 172.21.15.31:0/1806659938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9441003d0 0x7fb944100840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb938009910 tx=0x7fb938009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 -- 172.21.15.31:0/1806659938 shutdown_connections 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 --2- 172.21.15.31:0/1806659938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9441003d0 0x7fb944100840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 --2- 172.21.15.31:0/1806659938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9440ff130 0x7fb9440ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 -- 172.21.15.31:0/1806659938 >> 172.21.15.31:0/1806659938 conn(0x7fb9440fa780 msgr2=0x7fb9440fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 -- 172.21.15.31:0/1806659938 shutdown_connections 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.570+0000 7fb94af54700 1 -- 172.21.15.31:0/1806659938 wait complete. 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb94af54700 1 Processor -- start 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb94af54700 1 -- start start 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb94af54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 0x7fb9440690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb94af54700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441003d0 0x7fb94419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb94af54700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944196630 con 0x7fb9440ff130 2024-09-17T01:54:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb94af54700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94419d100 con 0x7fb9441003d0 2024-09-17T01:54:10.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 0x7fb9440690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 0x7fb9440690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54838/0 (socket says 172.21.15.31:54838) 2024-09-17T01:54:10.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 -- 172.21.15.31:0/2754218202 learned_addr learned my addr 172.21.15.31:0/2754218202 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:10.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb943fff700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441003d0 0x7fb94419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 -- 172.21.15.31:0/2754218202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441003d0 msgr2=0x7fb94419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441003d0 0x7fb94419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 -- 172.21.15.31:0/2754218202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380095f0 con 0x7fb9440ff130 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.571+0000 7fb948cf0700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 0x7fb9440690a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb93400e950 tx=0x7fb93400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.572+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93400cba0 con 0x7fb9440ff130 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.572+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb93400eea0 con 0x7fb9440ff130 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.572+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94419d3b0 con 0x7fb9440ff130 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.572+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb934018650 con 0x7fb9440ff130 2024-09-17T01:54:10.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.572+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94419d8d0 con 0x7fb9440ff130 2024-09-17T01:54:10.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.573+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb944107c10 con 0x7fb9440ff130 2024-09-17T01:54:10.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.574+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb93400cd00 con 0x7fb9440ff130 2024-09-17T01:54:10.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.574+0000 7fb941ffb700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb92c06e7c0 0x7fb92c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.574+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb934014070 con 0x7fb9440ff130 2024-09-17T01:54:10.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.574+0000 7fb943fff700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb92c06e7c0 0x7fb92c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.575+0000 7fb943fff700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb92c06e7c0 0x7fb92c070c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb938009fd0 tx=0x7fb938005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.579+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb9340541b0 con 0x7fb9440ff130 2024-09-17T01:54:10.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:10 smithi092 ceph-mon[64495]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:10.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:10 smithi031 ceph-mon[77274]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:10.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.804+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb944104d20 con 0x7fb92c06e7c0 2024-09-17T01:54:10.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.814+0000 7fb941ffb700 1 -- 172.21.15.31:0/2754218202 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fb944104d20 con 0x7fb92c06e7c0 2024-09-17T01:54:10.812 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:54:10.812 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (8m) 14s ago 10m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (10m) 14s ago 10m 7906k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (9m) 2s ago 9m 7826k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (10m) 14s ago 10m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (9m) 2s ago 9m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (8m) 14s ago 10m 88.2M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (4m) 14s ago 4m 63.0M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (4m) 14s ago 4m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (4m) 2s ago 4m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (4m) 2s ago 4m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (97s) 14s ago 11m 472M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (48s) 2s ago 9m 438M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:54:10.813 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (29s) 14s ago 11m 29.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (7s) 2s ago 9m 21.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (10m) 14s ago 10m 17.0M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (9m) 2s ago 9m 15.0M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (8m) 14s ago 8m 219M 1217M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (8m) 14s ago 8m 255M 1217M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (7m) 14s ago 7m 193M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (7m) 2s ago 7m 264M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (6m) 2s ago 6m 235M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (6m) 2s ago 6m 220M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:54:10.814 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (54s) 14s ago 9m 64.1M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb92c06e7c0 msgr2=0x7fb92c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb92c06e7c0 0x7fb92c070c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb938009fd0 tx=0x7fb938005940 comp rx=0 tx=0).stop 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 msgr2=0x7fb9440690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 0x7fb9440690a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb93400e950 tx=0x7fb93400ec60 comp rx=0 tx=0).stop 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 shutdown_connections 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb92c06e7c0 0x7fb92c070c70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9440ff130 0x7fb9440690a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 --2- 172.21.15.31:0/2754218202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9441003d0 0x7fb94419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 >> 172.21.15.31:0/2754218202 conn(0x7fb9440fa780 msgr2=0x7fb944103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:10.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 shutdown_connections 2024-09-17T01:54:10.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.816+0000 7fb94af54700 1 -- 172.21.15.31:0/2754218202 wait complete. 2024-09-17T01:54:10.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.929+0000 7fa628136700 1 -- 172.21.15.31:0/442950986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 msgr2=0x7fa620100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.929+0000 7fa628136700 1 --2- 172.21.15.31:0/442950986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620100650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009910 tx=0x7fa61c009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:10.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- 172.21.15.31:0/442950986 shutdown_connections 2024-09-17T01:54:10.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 --2- 172.21.15.31:0/442950986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 0x7fa620101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 --2- 172.21.15.31:0/442950986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620100650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- 172.21.15.31:0/442950986 >> 172.21.15.31:0/442950986 conn(0x7fa6200fb7f0 msgr2=0x7fa6200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- 172.21.15.31:0/442950986 shutdown_connections 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- 172.21.15.31:0/442950986 wait complete. 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 Processor -- start 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- start start 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 0x7fa620198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620198850 con 0x7fa620100240 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.930+0000 7fa628136700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62019d260 con 0x7fa620101440 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54864/0 (socket says 172.21.15.31:54864) 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 -- 172.21.15.31:0/2012373496 learned_addr learned my addr 172.21.15.31:0/2012373496 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:10.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa6256d1700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 0x7fa620198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 -- 172.21.15.31:0/2012373496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 msgr2=0x7fa620198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:10.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 0x7fa620198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:10.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 -- 172.21.15.31:0/2012373496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0095f0 con 0x7fa620100240 2024-09-17T01:54:10.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa6256d1700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 0x7fa620198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa625ed2700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620197cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa61c000c00 tx=0x7fa61c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c01d070 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa61c005dc0 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62019d400 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c022470 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.931+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62019d8c0 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.932+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa620105520 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.933+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa61c003810 con 0x7fa620100240 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.933+0000 7fa616ffd700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa60c06e7c0 0x7fa60c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:10.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.933+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa61c08fcf0 con 0x7fa620100240 2024-09-17T01:54:10.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.934+0000 7fa6256d1700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa60c06e7c0 0x7fa60c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:10.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.934+0000 7fa6256d1700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa60c06e7c0 0x7fa60c070c70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa610011490 tx=0x7fa610009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:10.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:10.938+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa61c058d20 con 0x7fa620100240 2024-09-17T01:54:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.248+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa62002cc30 con 0x7fa620100240 2024-09-17T01:54:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.249+0000 7fa616ffd700 1 -- 172.21.15.31:0/2012373496 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7fa61c05c3e0 con 0x7fa620100240 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:54:11.248 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-17T01:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:54:11.249 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa60c06e7c0 msgr2=0x7fa60c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa60c06e7c0 0x7fa60c070c70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa610011490 tx=0x7fa610009260 comp rx=0 tx=0).stop 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 msgr2=0x7fa620197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620197cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa61c000c00 tx=0x7fa61c00f690 comp rx=0 tx=0).stop 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 shutdown_connections 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa60c06e7c0 0x7fa60c070c70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa620100240 0x7fa620197cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 --2- 172.21.15.31:0/2012373496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa620101440 0x7fa620198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 >> 172.21.15.31:0/2012373496 conn(0x7fa6200fb7f0 msgr2=0x7fa620102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 shutdown_connections 2024-09-17T01:54:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.251+0000 7fa628136700 1 -- 172.21.15.31:0/2012373496 wait complete. 2024-09-17T01:54:11.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 -- 172.21.15.31:0/401375041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44101440 msgr2=0x7fbe44101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 --2- 172.21.15.31:0/401375041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44101440 0x7fbe44101890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009910 tx=0x7fbe38009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:11.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 -- 172.21.15.31:0/401375041 shutdown_connections 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 --2- 172.21.15.31:0/401375041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44101440 0x7fbe44101890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 --2- 172.21.15.31:0/401375041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe44100240 0x7fbe44100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 -- 172.21.15.31:0/401375041 >> 172.21.15.31:0/401375041 conn(0x7fbe440fb7f0 msgr2=0x7fbe440fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 -- 172.21.15.31:0/401375041 shutdown_connections 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.359+0000 7fbe49eae700 1 -- 172.21.15.31:0/401375041 wait complete. 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe49eae700 1 Processor -- start 2024-09-17T01:54:11.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe49eae700 1 -- start start 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe49eae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 0x7fbe44074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe49eae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe44101440 0x7fbe44073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe49eae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe44073680 con 0x7fbe44100240 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe49eae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440737c0 con 0x7fbe44101440 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 0x7fbe44074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 0x7fbe44074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54872/0 (socket says 172.21.15.31:54872) 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.360+0000 7fbe437fe700 1 -- 172.21.15.31:0/1379152098 learned_addr learned my addr 172.21.15.31:0/1379152098 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe42ffd700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe44101440 0x7fbe44073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe437fe700 1 -- 172.21.15.31:0/1379152098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe44101440 msgr2=0x7fbe44073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe437fe700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe44101440 0x7fbe44073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe437fe700 1 -- 172.21.15.31:0/1379152098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380095f0 con 0x7fbe44100240 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe437fe700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 0x7fbe44074af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400b480 tx=0x7fbe3400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe340118c0 con 0x7fbe44100240 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe34010380 con 0x7fbe44100240 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe44073aa0 con 0x7fbe44100240 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe3400f4f0 con 0x7fbe44100240 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.361+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4419db70 con 0x7fbe44100240 2024-09-17T01:54:11.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.362+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe44108e30 con 0x7fbe44100240 2024-09-17T01:54:11.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.363+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fbe340104f0 con 0x7fbe44100240 2024-09-17T01:54:11.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.363+0000 7fbe40ff9700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbe2c06e7b0 0x7fbe2c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:11.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.363+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbe3408e2b0 con 0x7fbe44100240 2024-09-17T01:54:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.363+0000 7fbe42ffd700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbe2c06e7b0 0x7fbe2c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.364+0000 7fbe42ffd700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbe2c06e7b0 0x7fbe2c070c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006010 tx=0x7fbe3800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:11.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.368+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbe3405afa0 con 0x7fbe44100240 2024-09-17T01:54:11.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.638+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbe4419e120 con 0x7fbe44100240 2024-09-17T01:54:11.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.638+0000 7fbe40ff9700 1 -- 172.21.15.31:0/1379152098 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1971 (secure 0 0 0) 0x7fbe4419e120 con 0x7fbe44100240 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:e17 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 17 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:54:11.641 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:54:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:54:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:11.644 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:11.644 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:11.644 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:54:11.644 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbe2c06e7b0 msgr2=0x7fbe2c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbe2c06e7b0 0x7fbe2c070c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006010 tx=0x7fbe3800b540 comp rx=0 tx=0).stop 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 msgr2=0x7fbe44074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 0x7fbe44074af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400b480 tx=0x7fbe3400b840 comp rx=0 tx=0).stop 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 shutdown_connections 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbe2c06e7b0 0x7fbe2c070c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe44100240 0x7fbe44074af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 --2- 172.21.15.31:0/1379152098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe44101440 0x7fbe44073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 >> 172.21.15.31:0/1379152098 conn(0x7fbe440fb7f0 msgr2=0x7fbe44104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 shutdown_connections 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.641+0000 7fbe49eae700 1 -- 172.21.15.31:0/1379152098 wait complete. 2024-09-17T01:54:11.645 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T01:54:11.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 -- 172.21.15.31:0/158834507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 msgr2=0x7f4f0c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 --2- 172.21.15.31:0/158834507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c1018a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009910 tx=0x7f4f08009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:11.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 -- 172.21.15.31:0/158834507 shutdown_connections 2024-09-17T01:54:11.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 --2- 172.21.15.31:0/158834507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c1018a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 --2- 172.21.15.31:0/158834507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 0x7f4f0c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 -- 172.21.15.31:0/158834507 >> 172.21.15.31:0/158834507 conn(0x7f4f0c0fb7e0 msgr2=0x7f4f0c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:11.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 -- 172.21.15.31:0/158834507 shutdown_connections 2024-09-17T01:54:11.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.754+0000 7f4f1374b700 1 -- 172.21.15.31:0/158834507 wait complete. 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f1374b700 1 Processor -- start 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f1374b700 1 -- start start 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f1374b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 0x7f4f0c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f1374b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f1374b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c073680 con 0x7f4f0c101450 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f1374b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0737c0 con 0x7f4f0c100250 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f10ce6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f10ce6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54882/0 (socket says 172.21.15.31:54882) 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f10ce6700 1 -- 172.21.15.31:0/1795892624 learned_addr learned my addr 172.21.15.31:0/1795892624 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:11.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.755+0000 7f4f114e7700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 0x7f4f0c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f10ce6700 1 -- 172.21.15.31:0/1795892624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 msgr2=0x7f4f0c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f10ce6700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 0x7f4f0c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f10ce6700 1 -- 172.21.15.31:0/1795892624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080095f0 con 0x7f4f0c101450 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f114e7700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 0x7f4f0c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f10ce6700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c073140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f08006010 tx=0x7f4f0800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0801d070 con 0x7f4f0c101450 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c073a40 con 0x7f4f0c101450 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f0800f460 con 0x7f4f0c101450 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f08021640 con 0x7f4f0c101450 2024-09-17T01:54:11.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.756+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c073f30 con 0x7f4f0c101450 2024-09-17T01:54:11.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.757+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c108da0 con 0x7f4f0c101450 2024-09-17T01:54:11.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.759+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4f0800fab0 con 0x7f4f0c101450 2024-09-17T01:54:11.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.759+0000 7f4efe7fc700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4ef806e7c0 0x7f4ef8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:11.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.759+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4f0808fb00 con 0x7f4f0c101450 2024-09-17T01:54:11.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.759+0000 7f4f114e7700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4ef806e7c0 0x7f4ef8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:11.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.760+0000 7f4f114e7700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4ef806e7c0 0x7f4ef8070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c1012b0 tx=0x7f4f0000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:11.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:11.768+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f0805c660 con 0x7f4f0c101450 2024-09-17T01:54:11.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:11 smithi031 ceph-mon[77274]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:54:11.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:11 smithi031 ceph-mon[77274]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:11.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:11 smithi031 ceph-mon[77274]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:11.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:11 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2012373496' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:11 smithi092 ceph-mon[64495]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:54:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:11 smithi092 ceph-mon[64495]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:11 smithi092 ceph-mon[64495]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:11 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2012373496' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:12.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.025+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f0c19df80 con 0x7f4ef806e7c0 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.026+0000 7f4efe7fc700 1 -- 172.21.15.31:0/1795892624 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f4f0c19df80 con 0x7f4ef806e7c0 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:54:12.025 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:54:12.026 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "4/23 daemons upgraded", 2024-09-17T01:54:12.026 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:54:12.026 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:54:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:54:12.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4ef806e7c0 msgr2=0x7f4ef8070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:12.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4ef806e7c0 0x7f4ef8070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c1012b0 tx=0x7f4f0000b410 comp rx=0 tx=0).stop 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 msgr2=0x7f4f0c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c073140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f08006010 tx=0x7f4f0800bd70 comp rx=0 tx=0).stop 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 shutdown_connections 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4ef806e7c0 0x7f4ef8070c70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f0c100250 0x7f4f0c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 --2- 172.21.15.31:0/1795892624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f0c101450 0x7f4f0c073140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 >> 172.21.15.31:0/1795892624 conn(0x7f4f0c0fb7e0 msgr2=0x7f4f0c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 shutdown_connections 2024-09-17T01:54:12.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.029+0000 7f4f1374b700 1 -- 172.21.15.31:0/1795892624 wait complete. 2024-09-17T01:54:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 -- 172.21.15.31:0/3778951405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 msgr2=0x7f79d01059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3778951405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d01059d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009910 tx=0x7f79c0009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 -- 172.21.15.31:0/3778951405 shutdown_connections 2024-09-17T01:54:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3778951405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d01059d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3778951405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 0x7f79d01030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 -- 172.21.15.31:0/3778951405 >> 172.21.15.31:0/3778951405 conn(0x7f79d00fa6d0 msgr2=0x7f79d00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 -- 172.21.15.31:0/3778951405 shutdown_connections 2024-09-17T01:54:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.141+0000 7f79d76b4700 1 -- 172.21.15.31:0/3778951405 wait complete. 2024-09-17T01:54:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d76b4700 1 Processor -- start 2024-09-17T01:54:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d76b4700 1 -- start start 2024-09-17T01:54:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d76b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 0x7f79d0195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d76b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d0195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d76b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01965c0 con 0x7f79d01035f0 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d76b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0196700 con 0x7f79d0100cd0 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d4c4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d0195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d4c4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d0195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54906/0 (socket says 172.21.15.31:54906) 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d4c4f700 1 -- 172.21.15.31:0/3484807516 learned_addr learned my addr 172.21.15.31:0/3484807516 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d5450700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 0x7f79d0195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d4c4f700 1 -- 172.21.15.31:0/3484807516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 msgr2=0x7f79d0195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d4c4f700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 0x7f79d0195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d4c4f700 1 -- 172.21.15.31:0/3484807516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00095f0 con 0x7f79d01035f0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.142+0000 7f79d5450700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 0x7f79d0195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.143+0000 7f79d4c4f700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d0195fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f79c000b5c0 tx=0x7f79c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.143+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c001d070 con 0x7f79d01035f0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.143+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79c000f460 con 0x7f79d01035f0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.143+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d019b150 con 0x7f79d01035f0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.143+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c0021640 con 0x7f79d01035f0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.143+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d019b640 con 0x7f79d01035f0 2024-09-17T01:54:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.144+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d018fc60 con 0x7f79d01035f0 2024-09-17T01:54:12.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.144+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f79c000f5d0 con 0x7f79d01035f0 2024-09-17T01:54:12.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.145+0000 7f79c67fc700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79bc06e7b0 0x7f79bc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:12.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.145+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f79c008fbf0 con 0x7f79d01035f0 2024-09-17T01:54:12.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.145+0000 7f79d5450700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79bc06e7b0 0x7f79bc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:12.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.145+0000 7f79d5450700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79bc06e7b0 0x7f79bc070c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f79cc005fd0 tx=0x7f79cc005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:12.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.150+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f79c005c750 con 0x7f79d01035f0 2024-09-17T01:54:12.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.462+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f79d002cc30 con 0x7f79d01035f0 2024-09-17T01:54:12.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.463+0000 7f79c67fc700 1 -- 172.21.15.31:0/3484807516 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f79c005c2e0 con 0x7f79d01035f0 2024-09-17T01:54:12.462 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79bc06e7b0 msgr2=0x7f79bc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79bc06e7b0 0x7f79bc070c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f79cc005fd0 tx=0x7f79cc005ee0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 msgr2=0x7f79d0195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d0195fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f79c000b5c0 tx=0x7f79c000be20 comp rx=0 tx=0).stop 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 shutdown_connections 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79bc06e7b0 0x7f79bc070c60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d0100cd0 0x7f79d0195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 --2- 172.21.15.31:0/3484807516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d01035f0 0x7f79d0195fa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 >> 172.21.15.31:0/3484807516 conn(0x7f79d00fa6d0 msgr2=0x7f79d00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:12.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 shutdown_connections 2024-09-17T01:54:12.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:12.465+0000 7f79d76b4700 1 -- 172.21.15.31:0/3484807516 wait complete. 2024-09-17T01:54:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:54:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: Reconfiguring mon.smithi031 (monmap changed)... 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: Reconfiguring daemon mon.smithi031 on smithi031 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1379152098' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:12 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3484807516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:54:13.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: Reconfiguring mon.smithi031 (monmap changed)... 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: Reconfiguring daemon mon.smithi031 on smithi031 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1379152098' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:12 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3484807516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:54:13.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:13 smithi031 ceph-mon[77274]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T01:54:13.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:54:13.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:54:13.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:13 smithi092 ceph-mon[64495]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T01:54:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi031.ealpiz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:54:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:54:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:14.755 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:14 smithi031 ceph-mon[77274]: Reconfiguring mgr.smithi031.ealpiz (monmap changed)... 2024-09-17T01:54:14.755 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:14 smithi031 ceph-mon[77274]: Reconfiguring daemon mgr.smithi031.ealpiz on smithi031 2024-09-17T01:54:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:14 smithi092 ceph-mon[64495]: Reconfiguring mgr.smithi031.ealpiz (monmap changed)... 2024-09-17T01:54:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:14 smithi092 ceph-mon[64495]: Reconfiguring daemon mgr.smithi031.ealpiz on smithi031 2024-09-17T01:54:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: Reconfiguring ceph-exporter.smithi031 (monmap changed)... 2024-09-17T01:54:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:54:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: Unable to update caps for client.ceph-exporter.smithi031 2024-09-17T01:54:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi031"}]: dispatch 2024-09-17T01:54:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:16.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:15 smithi092 ceph-mon[64495]: Reconfiguring daemon ceph-exporter.smithi031 on smithi031 2024-09-17T01:54:16.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: Reconfiguring ceph-exporter.smithi031 (monmap changed)... 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: Unable to update caps for client.ceph-exporter.smithi031 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi031"}]: dispatch 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:16.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:15 smithi031 ceph-mon[77274]: Reconfiguring daemon ceph-exporter.smithi031 on smithi031 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: Reconfiguring crash.smithi031 (monmap changed)... 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:17 smithi092 ceph-mon[64495]: Reconfiguring daemon crash.smithi031 on smithi031 2024-09-17T01:54:17.744 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:17.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:17.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:17.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: Reconfiguring crash.smithi031 (monmap changed)... 2024-09-17T01:54:17.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:17.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:17.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:17 smithi031 ceph-mon[77274]: Reconfiguring daemon crash.smithi031 on smithi031 2024-09-17T01:54:19.224 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:19.224 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:19.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:18 smithi031 ceph-mon[77274]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:54:19.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:54:19.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:19.225 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:18 smithi031 ceph-mon[77274]: Reconfiguring daemon osd.0 on smithi031 2024-09-17T01:54:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:18 smithi092 ceph-mon[64495]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:54:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:54:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:18 smithi092 ceph-mon[64495]: Reconfiguring daemon osd.0 on smithi031 2024-09-17T01:54:20.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:19 smithi031 ceph-mon[77274]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:20.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:20.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:20.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:54:20.047 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:19 smithi092 ceph-mon[64495]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:54:20.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:21.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:20 smithi092 ceph-mon[64495]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:54:21.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:20 smithi092 ceph-mon[64495]: Reconfiguring daemon osd.1 on smithi031 2024-09-17T01:54:21.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:20 smithi031 ceph-mon[77274]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:54:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:20 smithi031 ceph-mon[77274]: Reconfiguring daemon osd.1 on smithi031 2024-09-17T01:54:21.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:21 smithi092 ceph-mon[64495]: Reconfiguring daemon osd.2 on smithi031 2024-09-17T01:54:22.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:22.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:22.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:22.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:54:22.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:54:22.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:22.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:21 smithi031 ceph-mon[77274]: Reconfiguring daemon osd.2 on smithi031 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: Reconfiguring mds.cephfs.smithi031.menvuk (monmap changed)... 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:23 smithi031 ceph-mon[77274]: Reconfiguring daemon mds.cephfs.smithi031.menvuk on smithi031 2024-09-17T01:54:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:23.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: Reconfiguring mds.cephfs.smithi031.menvuk (monmap changed)... 2024-09-17T01:54:23.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:23.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:23.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:23 smithi092 ceph-mon[64495]: Reconfiguring daemon mds.cephfs.smithi031.menvuk on smithi031 2024-09-17T01:54:25.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:25.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:25.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:25 smithi031 ceph-mon[77274]: Reconfiguring mds.cephfs.smithi031.gszbpe (monmap changed)... 2024-09-17T01:54:25.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:25.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:25.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:25 smithi031 ceph-mon[77274]: Reconfiguring daemon mds.cephfs.smithi031.gszbpe on smithi031 2024-09-17T01:54:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:25 smithi092 ceph-mon[64495]: Reconfiguring mds.cephfs.smithi031.gszbpe (monmap changed)... 2024-09-17T01:54:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:25 smithi092 ceph-mon[64495]: Reconfiguring daemon mds.cephfs.smithi031.gszbpe on smithi031 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi092"}]: dispatch 2024-09-17T01:54:26.163 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:26.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:26.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:26.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:26.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:26.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:54:26.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:54:26.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi092"}]: dispatch 2024-09-17T01:54:26.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:27.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:27 smithi031 ceph-mon[77274]: Reconfiguring ceph-exporter.smithi092 (monmap changed)... 2024-09-17T01:54:27.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:27 smithi031 ceph-mon[77274]: Unable to update caps for client.ceph-exporter.smithi092 2024-09-17T01:54:27.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:27 smithi031 ceph-mon[77274]: Reconfiguring daemon ceph-exporter.smithi092 on smithi092 2024-09-17T01:54:27.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:27 smithi092 ceph-mon[64495]: Reconfiguring ceph-exporter.smithi092 (monmap changed)... 2024-09-17T01:54:27.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:27 smithi092 ceph-mon[64495]: Unable to update caps for client.ceph-exporter.smithi092 2024-09-17T01:54:27.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:27 smithi092 ceph-mon[64495]: Reconfiguring daemon ceph-exporter.smithi092 on smithi092 2024-09-17T01:54:28.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:28 smithi092 ceph-mon[64495]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:28.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:28.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:28.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:28.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:28.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:28 smithi031 ceph-mon[77274]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:28.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:28.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:28.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:28.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:29.264 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: Reconfiguring crash.smithi092 (monmap changed)... 2024-09-17T01:54:29.264 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: Reconfiguring daemon crash.smithi092 on smithi092 2024-09-17T01:54:29.264 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:29.264 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:29.265 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:54:29.265 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:54:29.265 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:29.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: Reconfiguring crash.smithi092 (monmap changed)... 2024-09-17T01:54:29.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: Reconfiguring daemon crash.smithi092 on smithi092 2024-09-17T01:54:29.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:29.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:29.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi092.tjdpfw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:54:29.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:54:29.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: Reconfiguring mgr.smithi092.tjdpfw (monmap changed)... 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: Reconfiguring daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:54:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: Reconfiguring mgr.smithi092.tjdpfw (monmap changed)... 2024-09-17T01:54:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: Reconfiguring daemon mgr.smithi092.tjdpfw on smithi092 2024-09-17T01:54:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:54:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:54:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:31 smithi092 ceph-mon[64495]: Reconfiguring mon.smithi092 (monmap changed)... 2024-09-17T01:54:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:31 smithi092 ceph-mon[64495]: Reconfiguring daemon mon.smithi092 on smithi092 2024-09-17T01:54:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:31 smithi031 ceph-mon[77274]: Reconfiguring mon.smithi092 (monmap changed)... 2024-09-17T01:54:31.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:31 smithi031 ceph-mon[77274]: Reconfiguring daemon mon.smithi092 on smithi092 2024-09-17T01:54:32.368 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:32 smithi092 ceph-mon[64495]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:32.368 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:32 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:32.369 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:32 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:32.369 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:32 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:54:32.369 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:32 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:32.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:32 smithi031 ceph-mon[77274]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:32.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:32 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:32.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:32 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:32.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:32 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:54:32.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:32 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:33.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:33 smithi031 ceph-mon[77274]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:54:33.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:33 smithi031 ceph-mon[77274]: Reconfiguring daemon osd.3 on smithi092 2024-09-17T01:54:33.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:33 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:33.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:33 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:33.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:33 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:54:33.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:33 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:33.432 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:33 smithi092 ceph-mon[64495]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:54:33.432 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:33 smithi092 ceph-mon[64495]: Reconfiguring daemon osd.3 on smithi092 2024-09-17T01:54:33.433 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:33 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:33.433 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:33 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:33.433 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:33 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:54:33.433 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:33 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:34.436 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:34 smithi092 ceph-mon[64495]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:34.436 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:34 smithi092 ceph-mon[64495]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:54:34.436 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:34 smithi092 ceph-mon[64495]: Reconfiguring daemon osd.4 on smithi092 2024-09-17T01:54:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:34 smithi031 ceph-mon[77274]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:34 smithi031 ceph-mon[77274]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:54:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:34 smithi031 ceph-mon[77274]: Reconfiguring daemon osd.4 on smithi092 2024-09-17T01:54:35.728 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:35.760 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:35.761 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:35.761 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:54:35.761 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:54:35.761 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:35.761 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: Reconfiguring daemon osd.5 on smithi092 2024-09-17T01:54:35.762 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:35.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:54:35.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:54:35.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:35.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: Reconfiguring daemon osd.5 on smithi092 2024-09-17T01:54:35.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:37.202 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:37.202 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:37.202 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:36 smithi092 ceph-mon[64495]: Reconfiguring mds.cephfs.smithi092.xzgrcs (monmap changed)... 2024-09-17T01:54:37.203 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:37.203 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:37.203 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:36 smithi092 ceph-mon[64495]: Reconfiguring daemon mds.cephfs.smithi092.xzgrcs on smithi092 2024-09-17T01:54:37.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:37.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:37.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:36 smithi031 ceph-mon[77274]: Reconfiguring mds.cephfs.smithi092.xzgrcs (monmap changed)... 2024-09-17T01:54:37.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:37.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:37.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:36 smithi031 ceph-mon[77274]: Reconfiguring daemon mds.cephfs.smithi092.xzgrcs on smithi092 2024-09-17T01:54:37.923 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:37 smithi092 ceph-mon[64495]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:37.923 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:37 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:37.923 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:37 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:37.923 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:37 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:37.923 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:37 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:38.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:37 smithi031 ceph-mon[77274]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:38.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:37 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:38.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:37 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:38.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:37 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:54:38.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:37 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: Reconfiguring mds.cephfs.smithi092.hofoma (monmap changed)... 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: Reconfiguring daemon mds.cephfs.smithi092.hofoma on smithi092 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:38.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:38.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:38.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi031"}]: dispatch 2024-09-17T01:54:38.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi031"}]': finished 2024-09-17T01:54:38.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi092"}]: dispatch 2024-09-17T01:54:38.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi092"}]': finished 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: Reconfiguring mds.cephfs.smithi092.hofoma (monmap changed)... 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: Reconfiguring daemon mds.cephfs.smithi092.hofoma on smithi092 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:39.146 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi031"}]: dispatch 2024-09-17T01:54:39.147 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi031"}]': finished 2024-09-17T01:54:39.147 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi092"}]: dispatch 2024-09-17T01:54:39.147 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi092"}]': finished 2024-09-17T01:54:40.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:39 smithi031 ceph-mon[77274]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:40.191 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:39 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all mon 2024-09-17T01:54:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:39 smithi092 ceph-mon[64495]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:39 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all mon 2024-09-17T01:54:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:41 smithi092 ceph-mon[64495]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:41 smithi092 ceph-mon[64495]: Upgrade: Updating crash.smithi031 (1/2) 2024-09-17T01:54:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:41 smithi092 ceph-mon[64495]: Deploying daemon crash.smithi031 on smithi031 2024-09-17T01:54:41.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:41 smithi031 ceph-mon[77274]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:41.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:41 smithi031 ceph-mon[77274]: Upgrade: Updating crash.smithi031 (1/2) 2024-09-17T01:54:41.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:41.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi031", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:41.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:41.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:41 smithi031 ceph-mon[77274]: Deploying daemon crash.smithi031 on smithi031 2024-09-17T01:54:42.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 -- 172.21.15.31:0/1709714460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550100240 msgr2=0x7fb550100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:42.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 --2- 172.21.15.31:0/1709714460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550100240 0x7fb550100650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb540009910 tx=0x7fb540009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:42.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 -- 172.21.15.31:0/1709714460 shutdown_connections 2024-09-17T01:54:42.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 --2- 172.21.15.31:0/1709714460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550101440 0x7fb550101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 --2- 172.21.15.31:0/1709714460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550100240 0x7fb550100650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 -- 172.21.15.31:0/1709714460 >> 172.21.15.31:0/1709714460 conn(0x7fb5500fb7f0 msgr2=0x7fb5500fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 -- 172.21.15.31:0/1709714460 shutdown_connections 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.580+0000 7fb556946700 1 -- 172.21.15.31:0/1709714460 wait complete. 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb556946700 1 Processor -- start 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb556946700 1 -- start start 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb556946700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550100240 0x7fb550074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb556946700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 0x7fb550073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb556946700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550073680 con 0x7fb550101440 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb556946700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500737c0 con 0x7fb550100240 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb54f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 0x7fb550073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb54f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 0x7fb550073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33102/0 (socket says 172.21.15.31:33102) 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.581+0000 7fb54f7fe700 1 -- 172.21.15.31:0/3932757114 learned_addr learned my addr 172.21.15.31:0/3932757114 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54ffff700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550100240 0x7fb550074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54f7fe700 1 -- 172.21.15.31:0/3932757114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550100240 msgr2=0x7fb550074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54f7fe700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550100240 0x7fb550074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54f7fe700 1 -- 172.21.15.31:0/3932757114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400095f0 con 0x7fb550101440 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54ffff700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550100240 0x7fb550074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54f7fe700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 0x7fb550073140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d8d0 tx=0x7fb53800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb538009940 con 0x7fb550101440 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb538010460 con 0x7fb550101440 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53800f5f0 con 0x7fb550101440 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb550073aa0 con 0x7fb550101440 2024-09-17T01:54:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.582+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55019db30 con 0x7fb550101440 2024-09-17T01:54:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.584+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb550108d90 con 0x7fb550101440 2024-09-17T01:54:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.584+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb5380105d0 con 0x7fb550101440 2024-09-17T01:54:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.584+0000 7fb54d7fa700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb53c06e7b0 0x7fb53c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.584+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb53808e750 con 0x7fb550101440 2024-09-17T01:54:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.585+0000 7fb54ffff700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb53c06e7b0 0x7fb53c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:42.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.585+0000 7fb54ffff700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb53c06e7b0 0x7fb53c070c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb540006010 tx=0x7fb54000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:42.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.589+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb53805b330 con 0x7fb550101440 2024-09-17T01:54:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.832+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb55019e0e0 con 0x7fb53c06e7b0 2024-09-17T01:54:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.833+0000 7fb54d7fa700 1 -- 172.21.15.31:0/3932757114 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb55019e0e0 con 0x7fb53c06e7b0 2024-09-17T01:54:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb53c06e7b0 msgr2=0x7fb53c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb53c06e7b0 0x7fb53c070c60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb540006010 tx=0x7fb54000b540 comp rx=0 tx=0).stop 2024-09-17T01:54:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 msgr2=0x7fb550073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 0x7fb550073140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d8d0 tx=0x7fb53800dc90 comp rx=0 tx=0).stop 2024-09-17T01:54:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 shutdown_connections 2024-09-17T01:54:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb53c06e7b0 0x7fb53c070c60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb550100240 0x7fb550074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 --2- 172.21.15.31:0/3932757114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb550101440 0x7fb550073140 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.835+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 >> 172.21.15.31:0/3932757114 conn(0x7fb5500fb7f0 msgr2=0x7fb550104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:42.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.836+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 shutdown_connections 2024-09-17T01:54:42.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.836+0000 7fb556946700 1 -- 172.21.15.31:0/3932757114 wait complete. 2024-09-17T01:54:42.844 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:54:42.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 -- 172.21.15.31:0/3943901018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 msgr2=0x7fea74101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 --2- 172.21.15.31:0/3943901018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea74101580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009910 tx=0x7fea5c009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 -- 172.21.15.31:0/3943901018 shutdown_connections 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 --2- 172.21.15.31:0/3943901018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea74101580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 --2- 172.21.15.31:0/3943901018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 0x7fea740fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 -- 172.21.15.31:0/3943901018 >> 172.21.15.31:0/3943901018 conn(0x7fea740f9f10 msgr2=0x7fea740fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 -- 172.21.15.31:0/3943901018 shutdown_connections 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.946+0000 7fea7ad14700 1 -- 172.21.15.31:0/3943901018 wait complete. 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea7ad14700 1 Processor -- start 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea7ad14700 1 -- start start 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea7ad14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 0x7fea74100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea7ad14700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea740ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea7ad14700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea740ffa70 con 0x7fea740fee50 2024-09-17T01:54:42.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea7ad14700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea740ffbb0 con 0x7fea740fe500 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea740ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea740ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33112/0 (socket says 172.21.15.31:33112) 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 -- 172.21.15.31:0/2313118436 learned_addr learned my addr 172.21.15.31:0/2313118436 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea78ab0700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 0x7fea74100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 -- 172.21.15.31:0/2313118436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 msgr2=0x7fea74100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 0x7fea74100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 -- 172.21.15.31:0/2313118436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0095f0 con 0x7fea740fee50 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea78ab0700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 0x7fea74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:54:42.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.947+0000 7fea73fff700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea740ff530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea5c005850 tx=0x7fea5c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:42.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.948+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea5c01d070 con 0x7fea740fee50 2024-09-17T01:54:42.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.948+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea5c004bb0 con 0x7fea740fee50 2024-09-17T01:54:42.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.948+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea740ffe30 con 0x7fea740fee50 2024-09-17T01:54:42.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.948+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea5c0176c0 con 0x7fea740fee50 2024-09-17T01:54:42.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.948+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea74100320 con 0x7fea740fee50 2024-09-17T01:54:42.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.949+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea74108d10 con 0x7fea740fee50 2024-09-17T01:54:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.950+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fea5c004d20 con 0x7fea740fee50 2024-09-17T01:54:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.950+0000 7fea71ffb700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fea6006e7c0 0x7fea60070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.950+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fea5c08fe20 con 0x7fea740fee50 2024-09-17T01:54:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.950+0000 7fea78ab0700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fea6006e7c0 0x7fea60070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:42.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.951+0000 7fea78ab0700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fea6006e7c0 0x7fea60070c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea6400e300 tx=0x7fea64009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:42.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:42.955+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea5c05c980 con 0x7fea740fee50 2024-09-17T01:54:43.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.230+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea7419df90 con 0x7fea6006e7c0 2024-09-17T01:54:43.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.231+0000 7fea71ffb700 1 -- 172.21.15.31:0/2313118436 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fea7419df90 con 0x7fea6006e7c0 2024-09-17T01:54:43.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fea6006e7c0 msgr2=0x7fea60070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fea6006e7c0 0x7fea60070c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea6400e300 tx=0x7fea64009040 comp rx=0 tx=0).stop 2024-09-17T01:54:43.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 msgr2=0x7fea740ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea740ff530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea5c005850 tx=0x7fea5c00be20 comp rx=0 tx=0).stop 2024-09-17T01:54:43.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 shutdown_connections 2024-09-17T01:54:43.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fea6006e7c0 0x7fea60070c70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea740fe500 0x7fea74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 --2- 172.21.15.31:0/2313118436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea740fee50 0x7fea740ff530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 >> 172.21.15.31:0/2313118436 conn(0x7fea740f9f10 msgr2=0x7fea741047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:43.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.233+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 shutdown_connections 2024-09-17T01:54:43.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.234+0000 7fea7ad14700 1 -- 172.21.15.31:0/2313118436 wait complete. 2024-09-17T01:54:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 -- 172.21.15.31:0/1024959949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568100ce0 msgr2=0x7f45681030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 --2- 172.21.15.31:0/1024959949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568100ce0 0x7f45681030c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4564009910 tx=0x7f4564009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 -- 172.21.15.31:0/1024959949 shutdown_connections 2024-09-17T01:54:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 --2- 172.21.15.31:0/1024959949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4568103600 0x7f45681059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 --2- 172.21.15.31:0/1024959949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568100ce0 0x7f45681030c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 -- 172.21.15.31:0/1024959949 >> 172.21.15.31:0/1024959949 conn(0x7f45680fa700 msgr2=0x7f45680fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 -- 172.21.15.31:0/1024959949 shutdown_connections 2024-09-17T01:54:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.354+0000 7f456f3f8700 1 -- 172.21.15.31:0/1024959949 wait complete. 2024-09-17T01:54:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456f3f8700 1 Processor -- start 2024-09-17T01:54:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456f3f8700 1 -- start start 2024-09-17T01:54:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456f3f8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4568100ce0 0x7f4568100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456f3f8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 0x7f45680fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456f3f8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45680ff1d0 con 0x7f4568103600 2024-09-17T01:54:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456f3f8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45680ff310 con 0x7f4568100ce0 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.355+0000 7f456c993700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 0x7f45680fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456c993700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 0x7f45680fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33136/0 (socket says 172.21.15.31:33136) 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456c993700 1 -- 172.21.15.31:0/2650711783 learned_addr learned my addr 172.21.15.31:0/2650711783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456d194700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4568100ce0 0x7f4568100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456c993700 1 -- 172.21.15.31:0/2650711783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4568100ce0 msgr2=0x7f4568100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456c993700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4568100ce0 0x7f4568100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456c993700 1 -- 172.21.15.31:0/2650711783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45640095f0 con 0x7f4568103600 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456c993700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 0x7f45680fec90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f455800e920 tx=0x7f455800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f455800c9d0 con 0x7f4568103600 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4558010430 con 0x7f4568103600 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45680ff5f0 con 0x7f4568103600 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4558018650 con 0x7f4568103600 2024-09-17T01:54:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.356+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456819db10 con 0x7f4568103600 2024-09-17T01:54:43.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.357+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456818fc70 con 0x7f4568103600 2024-09-17T01:54:43.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.358+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f45580105a0 con 0x7f4568103600 2024-09-17T01:54:43.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.358+0000 7f455e7fc700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f455406e7c0 0x7f4554070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:43.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.359+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4558014070 con 0x7f4568103600 2024-09-17T01:54:43.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.359+0000 7f456d194700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f455406e7c0 0x7f4554070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:43.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.359+0000 7f456d194700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f455406e7c0 0x7f4554070c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4564009fd0 tx=0x7f4564005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:43.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.363+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f45580541b0 con 0x7f4568103600 2024-09-17T01:54:43.504 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:43 smithi031 ceph-mon[77274]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:43.504 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:43 smithi031 ceph-mon[77274]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:43.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.597+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4568061190 con 0x7f455406e7c0 2024-09-17T01:54:43.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.606+0000 7f455e7fc700 1 -- 172.21.15.31:0/2650711783 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f4568061190 con 0x7f455406e7c0 2024-09-17T01:54:43.605 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:54:43.605 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (9m) 47s ago 10m 24.7M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:54:43.606 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (11m) 47s ago 11m 7906k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:54:43.606 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (10m) 35s ago 10m 7826k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:54:43.606 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (11m) 47s ago 11m 6660k - 18.2.0 dc2bc1663786 e32c488036a8 2024-09-17T01:54:43.606 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (10m) 35s ago 10m 6660k - 18.2.0 dc2bc1663786 6b7032c40a7a 2024-09-17T01:54:43.606 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (9m) 47s ago 10m 88.2M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:54:43.607 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (5m) 47s ago 5m 63.0M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:54:43.607 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (5m) 47s ago 5m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:54:43.607 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (5m) 35s ago 5m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:54:43.607 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (5m) 35s ago 5m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:54:43.607 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (2m) 47s ago 12m 472M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:54:43.607 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (81s) 35s ago 9m 438M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (61s) 47s ago 12m 29.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (40s) 35s ago 9m 21.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (11m) 47s ago 11m 17.0M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (10m) 35s ago 10m 15.0M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (9m) 47s ago 9m 219M 1217M 18.2.0 dc2bc1663786 17905ba8df6c 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (8m) 47s ago 8m 255M 1217M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (8m) 47s ago 8m 193M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (7m) 35s ago 7m 264M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (7m) 35s ago 7m 235M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (6m) 35s ago 6m 220M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:54:43.608 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (87s) 47s ago 10m 64.1M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:54:43.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f455406e7c0 msgr2=0x7f4554070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f455406e7c0 0x7f4554070c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4564009fd0 tx=0x7f4564005940 comp rx=0 tx=0).stop 2024-09-17T01:54:43.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 msgr2=0x7f45680fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 0x7f45680fec90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f455800e920 tx=0x7f455800ec30 comp rx=0 tx=0).stop 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 shutdown_connections 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f455406e7c0 0x7f4554070c70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4568100ce0 0x7f4568100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 --2- 172.21.15.31:0/2650711783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4568103600 0x7f45680fec90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 >> 172.21.15.31:0/2650711783 conn(0x7f45680fa700 msgr2=0x7f45680fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 shutdown_connections 2024-09-17T01:54:43.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.609+0000 7f456f3f8700 1 -- 172.21.15.31:0/2650711783 wait complete. 2024-09-17T01:54:43.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 -- 172.21.15.31:0/2032879354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 msgr2=0x7f47d8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 --2- 172.21.15.31:0/2032879354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8101890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009910 tx=0x7f47c0009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:43.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 -- 172.21.15.31:0/2032879354 shutdown_connections 2024-09-17T01:54:43.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 --2- 172.21.15.31:0/2032879354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8101890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 --2- 172.21.15.31:0/2032879354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47d8100240 0x7f47d8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 -- 172.21.15.31:0/2032879354 >> 172.21.15.31:0/2032879354 conn(0x7f47d80fb7f0 msgr2=0x7f47d80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:43.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 -- 172.21.15.31:0/2032879354 shutdown_connections 2024-09-17T01:54:43.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.717+0000 7f47dded5700 1 -- 172.21.15.31:0/2032879354 wait complete. 2024-09-17T01:54:43.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47dded5700 1 Processor -- start 2024-09-17T01:54:43.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47dded5700 1 -- start start 2024-09-17T01:54:43.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47dded5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47d8100240 0x7f47d8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:43.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47dded5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:43.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47dded5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8196610 con 0x7f47d8101440 2024-09-17T01:54:43.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47dded5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8196750 con 0x7f47d8100240 2024-09-17T01:54:43.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47cffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:43.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47cffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60804/0 (socket says 172.21.15.31:60804) 2024-09-17T01:54:43.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.718+0000 7f47cffff700 1 -- 172.21.15.31:0/2090712246 learned_addr learned my addr 172.21.15.31:0/2090712246 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:43.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47d77fe700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47d8100240 0x7f47d8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:43.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47cffff700 1 -- 172.21.15.31:0/2090712246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47d8100240 msgr2=0x7f47d8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:43.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47cffff700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47d8100240 0x7f47d8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:43.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47cffff700 1 -- 172.21.15.31:0/2090712246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c00095f0 con 0x7f47d8101440 2024-09-17T01:54:43.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47cffff700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8195ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47c0000c00 tx=0x7f47c000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:43.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c001d070 con 0x7f47d8101440 2024-09-17T01:54:43.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47c0005dc0 con 0x7f47d8101440 2024-09-17T01:54:43.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d819b1a0 con 0x7f47d8101440 2024-09-17T01:54:43.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c00226a0 con 0x7f47d8101440 2024-09-17T01:54:43.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.719+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d819b690 con 0x7f47d8101440 2024-09-17T01:54:43.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.720+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d8108d90 con 0x7f47d8101440 2024-09-17T01:54:43.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.721+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f47c0003680 con 0x7f47d8101440 2024-09-17T01:54:43.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.721+0000 7f47d57fa700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f47c406e7c0 0x7f47c4070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:43.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.721+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f47c008fca0 con 0x7f47d8101440 2024-09-17T01:54:43.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.721+0000 7f47d77fe700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f47c406e7c0 0x7f47c4070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:43.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.722+0000 7f47d77fe700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f47c406e7c0 0x7f47c4070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47d81012a0 tx=0x7f47c8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:43.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:43.726+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47c0094070 con 0x7f47d8101440 2024-09-17T01:54:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:43 smithi092 ceph-mon[64495]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:43 smithi092 ceph-mon[64495]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:44.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.046+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47d8108f80 con 0x7f47d8101440 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.047+0000 7f47d57fa700 1 -- 172.21.15.31:0/2090712246 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f47c005c880 con 0x7f47d8101440 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:54:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:54:44.047 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f47c406e7c0 msgr2=0x7f47c4070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f47c406e7c0 0x7f47c4070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47d81012a0 tx=0x7f47c8009260 comp rx=0 tx=0).stop 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 msgr2=0x7f47d8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8195ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47c0000c00 tx=0x7f47c000f740 comp rx=0 tx=0).stop 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 shutdown_connections 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f47c406e7c0 0x7f47c4070c70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47d8100240 0x7f47d8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 --2- 172.21.15.31:0/2090712246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d8101440 0x7f47d8195ff0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 >> 172.21.15.31:0/2090712246 conn(0x7f47d80fb7f0 msgr2=0x7f47d8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.049+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 shutdown_connections 2024-09-17T01:54:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.050+0000 7f47dded5700 1 -- 172.21.15.31:0/2090712246 wait complete. 2024-09-17T01:54:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 -- 172.21.15.31:0/2400332938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a00ff150 msgr2=0x7fa4a00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 --2- 172.21.15.31:0/2400332938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a00ff150 0x7fa4a00ff560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa490009910 tx=0x7fa490009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 -- 172.21.15.31:0/2400332938 shutdown_connections 2024-09-17T01:54:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 --2- 172.21.15.31:0/2400332938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a0100350 0x7fa4a01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 --2- 172.21.15.31:0/2400332938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a00ff150 0x7fa4a00ff560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 -- 172.21.15.31:0/2400332938 >> 172.21.15.31:0/2400332938 conn(0x7fa4a00fa700 msgr2=0x7fa4a00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 -- 172.21.15.31:0/2400332938 shutdown_connections 2024-09-17T01:54:44.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.167+0000 7fa4a6837700 1 -- 172.21.15.31:0/2400332938 wait complete. 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.168+0000 7fa4a6837700 1 Processor -- start 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa4a6837700 1 -- start start 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa4a6837700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a00ff150 0x7fa4a0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa4a6837700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a0100350 0x7fa4a019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa4a6837700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a019ae10 con 0x7fa4a0100350 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa4a6837700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a019af50 con 0x7fa4a00ff150 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa497fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a0100350 0x7fa4a019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa49ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a00ff150 0x7fa4a0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa497fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a0100350 0x7fa4a019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60832/0 (socket says 172.21.15.31:60832) 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa497fff700 1 -- 172.21.15.31:0/3181776351 learned_addr learned my addr 172.21.15.31:0/3181776351 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa49ffff700 1 -- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a0100350 msgr2=0x7fa4a019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa49ffff700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a0100350 0x7fa4a019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.169+0000 7fa49ffff700 1 -- 172.21.15.31:0/3181776351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900095f0 con 0x7fa4a00ff150 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.170+0000 7fa49ffff700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a00ff150 0x7fa4a0069930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa490000c00 tx=0x7fa49000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.170+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49001d070 con 0x7fa4a00ff150 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.170+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa490005dc0 con 0x7fa4a00ff150 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.170+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a019b1d0 con 0x7fa4a00ff150 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.170+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa490021410 con 0x7fa4a00ff150 2024-09-17T01:54:44.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.170+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a019b660 con 0x7fa4a00ff150 2024-09-17T01:54:44.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.171+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0107ca0 con 0x7fa4a00ff150 2024-09-17T01:54:44.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.172+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa490003680 con 0x7fa4a00ff150 2024-09-17T01:54:44.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.172+0000 7fa49dffb700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa48c06e7b0 0x7fa48c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.172+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa49008f940 con 0x7fa4a00ff150 2024-09-17T01:54:44.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.172+0000 7fa497fff700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa48c06e7b0 0x7fa48c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.173+0000 7fa497fff700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa48c06e7b0 0x7fa48c070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0069eb0 tx=0x7fa488009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.177+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa49005c4a0 con 0x7fa4a00ff150 2024-09-17T01:54:44.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.443+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4a019bca0 con 0x7fa4a00ff150 2024-09-17T01:54:44.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:44 smithi031 ceph-mon[77274]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:44.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:44 smithi031 ceph-mon[77274]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:44.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:44 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2090712246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:44.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:44.443 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:44.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.444+0000 7fa49dffb700 1 -- 172.21.15.31:0/3181776351 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1971 (secure 0 0 0) 0x7fa49005c030 con 0x7fa4a00ff150 2024-09-17T01:54:44.443 INFO:teuthology.orchestra.run.smithi031.stdout:e17 2024-09-17T01:54:44.443 INFO:teuthology.orchestra.run.smithi031.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:54:44.443 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:54:44.443 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 17 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:54:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:54:44.445 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:54:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:54:44.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa48c06e7b0 msgr2=0x7fa48c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa48c06e7b0 0x7fa48c070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0069eb0 tx=0x7fa488009260 comp rx=0 tx=0).stop 2024-09-17T01:54:44.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a00ff150 msgr2=0x7fa4a0069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a00ff150 0x7fa4a0069930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa490000c00 tx=0x7fa49000fa00 comp rx=0 tx=0).stop 2024-09-17T01:54:44.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 shutdown_connections 2024-09-17T01:54:44.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa48c06e7b0 0x7fa48c070c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4a00ff150 0x7fa4a0069930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 --2- 172.21.15.31:0/3181776351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4a0100350 0x7fa4a019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 >> 172.21.15.31:0/3181776351 conn(0x7fa4a00fa700 msgr2=0x7fa4a0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:44.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 shutdown_connections 2024-09-17T01:54:44.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.447+0000 7fa4a6837700 1 -- 172.21.15.31:0/3181776351 wait complete. 2024-09-17T01:54:44.448 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2222056560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 msgr2=0x7fa4f0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2222056560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0100840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009910 tx=0x7fa4ec009c20 comp rx=0 tx=0).stop 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2222056560 shutdown_connections 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2222056560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0100840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2222056560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f00ff130 0x7fa4f00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2222056560 >> 172.21.15.31:0/2222056560 conn(0x7fa4f00fa780 msgr2=0x7fa4f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2222056560 shutdown_connections 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.557+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2222056560 wait complete. 2024-09-17T01:54:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f7d06700 1 Processor -- start 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f7d06700 1 -- start start 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f7d06700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f00ff130 0x7fa4f0195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f7d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f7d06700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01965c0 con 0x7fa4f01003d0 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f7d06700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0196700 con 0x7fa4f00ff130 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f52a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f52a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60852/0 (socket says 172.21.15.31:60852) 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f52a1700 1 -- 172.21.15.31:0/2395340590 learned_addr learned my addr 172.21.15.31:0/2395340590 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f5aa2700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f00ff130 0x7fa4f0195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f52a1700 1 -- 172.21.15.31:0/2395340590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f00ff130 msgr2=0x7fa4f0195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f52a1700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f00ff130 0x7fa4f0195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.558+0000 7fa4f52a1700 1 -- 172.21.15.31:0/2395340590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0095f0 con 0x7fa4f01003d0 2024-09-17T01:54:44.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.559+0000 7fa4f52a1700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0195fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec000c00 tx=0x7fa4ec00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:44.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.559+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4ec01d070 con 0x7fa4f01003d0 2024-09-17T01:54:44.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.559+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4ec005dc0 con 0x7fa4f01003d0 2024-09-17T01:54:44.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.559+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f019b150 con 0x7fa4f01003d0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.559+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4ec0226a0 con 0x7fa4f01003d0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.559+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f019b640 con 0x7fa4f01003d0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.560+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f0107c10 con 0x7fa4f01003d0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.560+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa4ec003680 con 0x7fa4f01003d0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.561+0000 7fa4e6ffd700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa4dc06e7c0 0x7fa4dc070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.561+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa4ec08fca0 con 0x7fa4f01003d0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.561+0000 7fa4f5aa2700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa4dc06e7c0 0x7fa4dc070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.561+0000 7fa4f5aa2700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa4dc06e7c0 0x7fa4dc070c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009bf0 tx=0x7fa4e0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:44.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.565+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4ec094070 con 0x7fa4f01003d0 2024-09-17T01:54:44.601 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:44 smithi092 ceph-mon[64495]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:44.601 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:44 smithi092 ceph-mon[64495]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:44.601 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:44 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2090712246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:44.601 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:44.601 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:44.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.801+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4f019bcd0 con 0x7fa4dc06e7c0 2024-09-17T01:54:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.803+0000 7fa4e6ffd700 1 -- 172.21.15.31:0/2395340590 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa4f019bcd0 con 0x7fa4dc06e7c0 2024-09-17T01:54:44.801 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:54:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:54:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:54:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "4/23 daemons upgraded", 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading crash daemons", 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:54:44.802 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa4dc06e7c0 msgr2=0x7fa4dc070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa4dc06e7c0 0x7fa4dc070c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009bf0 tx=0x7fa4e0009260 comp rx=0 tx=0).stop 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 msgr2=0x7fa4f0195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0195fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec000c00 tx=0x7fa4ec00f740 comp rx=0 tx=0).stop 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 shutdown_connections 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa4dc06e7c0 0x7fa4dc070c70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4f00ff130 0x7fa4f0195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 --2- 172.21.15.31:0/2395340590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4f01003d0 0x7fa4f0195fa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 >> 172.21.15.31:0/2395340590 conn(0x7fa4f00fa780 msgr2=0x7fa4f0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 shutdown_connections 2024-09-17T01:54:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.805+0000 7fa4f7d06700 1 -- 172.21.15.31:0/2395340590 wait complete. 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 -- 172.21.15.31:0/1338179176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0ff150 msgr2=0x7f961c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 --2- 172.21.15.31:0/1338179176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0ff150 0x7f961c0ff560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f961800b0a0 tx=0x7f961800b3b0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 -- 172.21.15.31:0/1338179176 shutdown_connections 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 --2- 172.21.15.31:0/1338179176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c100350 0x7f961c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 --2- 172.21.15.31:0/1338179176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c0ff150 0x7f961c0ff560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 -- 172.21.15.31:0/1338179176 >> 172.21.15.31:0/1338179176 conn(0x7f961c0fa700 msgr2=0x7f961c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 -- 172.21.15.31:0/1338179176 shutdown_connections 2024-09-17T01:54:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.914+0000 7f9623e57700 1 -- 172.21.15.31:0/1338179176 wait complete. 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9623e57700 1 Processor -- start 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9623e57700 1 -- start start 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9623e57700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c0ff150 0x7f961c069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9623e57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 0x7f961c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9623e57700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c19ae50 con 0x7f961c100350 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9623e57700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c19afc0 con 0x7f961c0ff150 2024-09-17T01:54:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f96213f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 0x7f961c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f96213f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 0x7f961c19a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60860/0 (socket says 172.21.15.31:60860) 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f96213f2700 1 -- 172.21.15.31:0/1986322382 learned_addr learned my addr 172.21.15.31:0/1986322382 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.915+0000 7f9621bf3700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c0ff150 0x7f961c069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f96213f2700 1 -- 172.21.15.31:0/1986322382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c0ff150 msgr2=0x7f961c069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f96213f2700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c0ff150 0x7f961c069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f96213f2700 1 -- 172.21.15.31:0/1986322382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618009d00 con 0x7f961c100350 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f96213f2700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 0x7f961c19a880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f960c00e920 tx=0x7f960c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c00c9d0 con 0x7f961c100350 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f960c010430 con 0x7f961c100350 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c19b2a0 con 0x7f961c100350 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c018650 con 0x7f961c100350 2024-09-17T01:54:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.916+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c19b7f0 con 0x7f961c100350 2024-09-17T01:54:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.917+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c107ca0 con 0x7f961c100350 2024-09-17T01:54:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.918+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f960c0105a0 con 0x7f961c100350 2024-09-17T01:54:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.918+0000 7f9612ffd700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f960806e7b0 0x7f9608070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:54:44.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.918+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f960c014070 con 0x7f961c100350 2024-09-17T01:54:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.918+0000 7f9621bf3700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f960806e7b0 0x7f9608070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:54:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.919+0000 7f9621bf3700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f960806e7b0 0x7f9608070c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9618009fd0 tx=0x7f9618006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:54:44.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:44.923+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f960c0541b0 con 0x7f961c100350 2024-09-17T01:54:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.223+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f961c107e90 con 0x7f961c100350 2024-09-17T01:54:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.223+0000 7f9612ffd700 1 -- 172.21.15.31:0/1986322382 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f960c05b5e0 con 0x7f961c100350 2024-09-17T01:54:45.222 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:54:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.225+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f960806e7b0 msgr2=0x7f9608070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.225+0000 7f9623e57700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f960806e7b0 0x7f9608070c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9618009fd0 tx=0x7f9618006000 comp rx=0 tx=0).stop 2024-09-17T01:54:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.225+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 msgr2=0x7f961c19a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.225+0000 7f9623e57700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 0x7f961c19a880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f960c00e920 tx=0x7f960c00ec30 comp rx=0 tx=0).stop 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 shutdown_connections 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f960806e7b0 0x7f9608070c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f961c0ff150 0x7f961c069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 --2- 172.21.15.31:0/1986322382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961c100350 0x7f961c19a880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 >> 172.21.15.31:0/1986322382 conn(0x7f961c0fa700 msgr2=0x7f961c103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 shutdown_connections 2024-09-17T01:54:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:54:45.226+0000 7f9623e57700 1 -- 172.21.15.31:0/1986322382 wait complete. 2024-09-17T01:54:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:45 smithi031 ceph-mon[77274]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3181776351' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:54:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:45 smithi031 ceph-mon[77274]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1986322382' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:54:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:45 smithi092 ceph-mon[64495]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:45 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3181776351' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:54:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:45 smithi092 ceph-mon[64495]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:54:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:45 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1986322382' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:54:46.722 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:46 smithi092 ceph-mon[64495]: Upgrade: Updating crash.smithi092 (2/2) 2024-09-17T01:54:46.722 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:46.722 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:46.723 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:46.723 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:46 smithi092 ceph-mon[64495]: Deploying daemon crash.smithi092 on smithi092 2024-09-17T01:54:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:46 smithi031 ceph-mon[77274]: Upgrade: Updating crash.smithi092 (2/2) 2024-09-17T01:54:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi092", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:54:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:46 smithi031 ceph-mon[77274]: Deploying daemon crash.smithi092 on smithi092 2024-09-17T01:54:47.613 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:47 smithi092 ceph-mon[64495]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:47 smithi031 ceph-mon[77274]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:49 smithi092 ceph-mon[64495]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:49 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:49 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:49 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:50.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:49 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:49 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:49 smithi031 ceph-mon[77274]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:50.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:49 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:49 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:49 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:49 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:49 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:51.237 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:54:52.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:51 smithi092 ceph-mon[64495]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:52.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:51 smithi031 ceph-mon[77274]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:53.229 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:52 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.229 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:52 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.229 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:52 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.229 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:52 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:52 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:52 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:52 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:53.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:52 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:54.192 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:53 smithi092 ceph-mon[64495]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:54.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:53 smithi031 ceph-mon[77274]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:55.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:55.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:56.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:55 smithi092 ceph-mon[64495]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:56.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:55 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:56.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:55 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:56.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:55 smithi031 ceph-mon[77274]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:56.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:56.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi031"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi031"}]': finished 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi092"}]: dispatch 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi092"}]': finished 2024-09-17T01:54:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:54:58.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:58.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.245 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi031"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi031"}]': finished 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi092"}]: dispatch 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi092"}]': finished 2024-09-17T01:54:58.246 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:54:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:58 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all crash 2024-09-17T01:54:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:58 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:54:59.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:54:58 smithi092 ceph-mon[64495]: Upgrade: osd.0 is safe to restart 2024-09-17T01:54:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:58 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all crash 2024-09-17T01:54:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:58 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:54:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:54:58 smithi031 ceph-mon[77274]: Upgrade: osd.0 is safe to restart 2024-09-17T01:55:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:00 smithi092 ceph-mon[64495]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:00 smithi092 ceph-mon[64495]: Upgrade: Updating osd.0 2024-09-17T01:55:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:00 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:00 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:55:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:00 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:00.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:00 smithi092 ceph-mon[64495]: Deploying daemon osd.0 on smithi031 2024-09-17T01:55:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:00 smithi031 ceph-mon[77274]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:00 smithi031 ceph-mon[77274]: Upgrade: Updating osd.0 2024-09-17T01:55:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:00 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:00 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:55:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:00 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:00.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:00 smithi031 ceph-mon[77274]: Deploying daemon osd.0 on smithi031 2024-09-17T01:55:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:02 smithi092 ceph-mon[64495]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:02.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:02 smithi031 ceph-mon[77274]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:02.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:02 smithi031 systemd[1]: Stopping Ceph osd.0 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:55:03.014 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:02 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[42705]: 2024-09-17T01:55:02.546+0000 7f50b4f52700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:55:03.015 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:02 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[42705]: 2024-09-17T01:55:02.546+0000 7f50b4f52700 -1 osd.0 48 *** Got signal Terminated *** 2024-09-17T01:55:03.015 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:02 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[42705]: 2024-09-17T01:55:02.546+0000 7f50b4f52700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:55:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:03 smithi092 ceph-mon[64495]: osd.0 marked itself down and dead 2024-09-17T01:55:03.503 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:03 smithi031 ceph-mon[77274]: osd.0 marked itself down and dead 2024-09-17T01:55:03.764 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:03 smithi031 podman[83074]: 2024-09-17 01:55:03.550070952 +0000 UTC m=+1.128570631 container died 17905ba8df6c2f9d8d43883af70cc0f0ff97d4365a804db882fe2e1abbbf8865 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:55:04.182 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 podman[83074]: 2024-09-17 01:55:04.038501663 +0000 UTC m=+1.617001334 container cleanup 17905ba8df6c2f9d8d43883af70cc0f0ff97d4365a804db882fe2e1abbbf8865 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-17T01:55:04.182 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 bash[83074]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:55:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:04 smithi092 ceph-mon[64495]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:04 smithi092 ceph-mon[64495]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:55:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:04 smithi092 ceph-mon[64495]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:55:04.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:04 smithi031 ceph-mon[77274]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:04.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:04 smithi031 ceph-mon[77274]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:55:04.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:04 smithi031 ceph-mon[77274]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:55:04.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 podman[83091]: 2024-09-17 01:55:04.323864362 +0000 UTC m=+0.767980033 container remove 17905ba8df6c2f9d8d43883af70cc0f0ff97d4365a804db882fe2e1abbbf8865 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=HEAD, ceph=True) 2024-09-17T01:55:04.950 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 podman[83177]: 2024-09-17 01:55:04.561975549 +0000 UTC m=+0.017442169 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:55:04.950 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 podman[83177]: 2024-09-17 01:55:04.666402746 +0000 UTC m=+0.121869342 container create 797ba5da84ef49e4e6dc4d2489a8c0f60e022b7dd7fa95d498ee032cb9d9949e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:55:05.238 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:05 smithi031 ceph-mon[77274]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:55:05.238 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 podman[83177]: 2024-09-17 01:55:04.952677984 +0000 UTC m=+0.408144587 container init 797ba5da84ef49e4e6dc4d2489a8c0f60e022b7dd7fa95d498ee032cb9d9949e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:55:05.238 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:04 smithi031 podman[83177]: 2024-09-17 01:55:04.956720318 +0000 UTC m=+0.412186914 container start 797ba5da84ef49e4e6dc4d2489a8c0f60e022b7dd7fa95d498ee032cb9d9949e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T01:55:05.238 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:05 smithi031 podman[83177]: 2024-09-17 01:55:05.027625759 +0000 UTC m=+0.483092360 container attach 797ba5da84ef49e4e6dc4d2489a8c0f60e022b7dd7fa95d498ee032cb9d9949e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-17T01:55:05.238 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:05 smithi031 podman[83177]: 2024-09-17 01:55:05.165175971 +0000 UTC m=+0.620642586 container died 797ba5da84ef49e4e6dc4d2489a8c0f60e022b7dd7fa95d498ee032cb9d9949e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:55:05.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:05 smithi092 ceph-mon[64495]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:55:06.201 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:05 smithi031 podman[83204]: 2024-09-17 01:55:05.881678302 +0000 UTC m=+0.709900862 container remove 797ba5da84ef49e4e6dc4d2489a8c0f60e022b7dd7fa95d498ee032cb9d9949e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:55:06.201 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:05 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:55:06.201 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:05 smithi031 systemd[1]: Stopped Ceph osd.0 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:55:06.201 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:05 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.0.service: Consumed 1min 4.113s CPU time. 2024-09-17T01:55:06.201 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 systemd[1]: Starting Ceph osd.0 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:55:06.480 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:06 smithi031 ceph-mon[77274]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:55:06.480 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:06.480 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:06.481 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 podman[83310]: 2024-09-17 01:55:06.238354771 +0000 UTC m=+0.017353287 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:55:06.481 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 podman[83310]: 2024-09-17 01:55:06.366700084 +0000 UTC m=+0.145698580 container create b2793556b135a87c050b06313b0f3ada6bab51705add1d4fefa387083c67cf31 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:55:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:06 smithi092 ceph-mon[64495]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:55:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:06.756 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 podman[83310]: 2024-09-17 01:55:06.619404923 +0000 UTC m=+0.398403439 container init b2793556b135a87c050b06313b0f3ada6bab51705add1d4fefa387083c67cf31 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T01:55:06.757 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 podman[83310]: 2024-09-17 01:55:06.622830351 +0000 UTC m=+0.401828848 container start b2793556b135a87c050b06313b0f3ada6bab51705add1d4fefa387083c67cf31 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T01:55:06.757 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 podman[83310]: 2024-09-17 01:55:06.702576719 +0000 UTC m=+0.481575227 container attach b2793556b135a87c050b06313b0f3ada6bab51705add1d4fefa387083c67cf31 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-17T01:55:07.014 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:07.014 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 bash[83310]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:07.015 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:07.015 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:06 smithi031 bash[83310]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:07.509 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-mon[77274]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:07.509 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-mon[77274]: Health check failed: Degraded data redundancy: 64/324 objects degraded (19.753%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:07.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:07 smithi092 ceph-mon[64495]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:07.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:07 smithi092 ceph-mon[64495]: Health check failed: Degraded data redundancy: 64/324 objects degraded (19.753%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:07.764 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:55:07.765 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:55:07.765 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:55:07.765 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:55:08.171 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate[83325]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:55:08.172 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 bash[83310]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:55:08.172 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:07 smithi031 podman[83310]: 2024-09-17 01:55:07.825991016 +0000 UTC m=+1.604989527 container died b2793556b135a87c050b06313b0f3ada6bab51705add1d4fefa387083c67cf31 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T01:55:08.891 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:08 smithi031 podman[83470]: 2024-09-17 01:55:08.540554336 +0000 UTC m=+0.707943453 container remove b2793556b135a87c050b06313b0f3ada6bab51705add1d4fefa387083c67cf31 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:55:08.892 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:08 smithi031 podman[83531]: 2024-09-17 01:55:08.659077036 +0000 UTC m=+0.017290397 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:55:08.892 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:08 smithi031 podman[83531]: 2024-09-17 01:55:08.783224928 +0000 UTC m=+0.141438279 container create e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:55:09.264 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:09 smithi031 podman[83531]: 2024-09-17 01:55:09.010737754 +0000 UTC m=+0.368951098 container init e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T01:55:09.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:09 smithi031 podman[83531]: 2024-09-17 01:55:09.014038114 +0000 UTC m=+0.372251458 container start e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:55:09.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:09 smithi031 ceph-osd[83550]: -- 172.21.15.31:0/2579850680 <== mon.0 v2:172.21.15.31:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c9da4c1e0 con 0x563c9d9e2000 2024-09-17T01:55:09.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:09 smithi031 bash[83531]: e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf 2024-09-17T01:55:09.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:09 smithi031 systemd[1]: Started Ceph osd.0 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:55:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:10 smithi092 ceph-mon[64495]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:10.498 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:10 smithi031 ceph-mon[77274]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:10.498 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:10.498 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:10.498 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:11.243 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:10 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T01:55:10.898+0000 7f9a1f4d8640 -1 Falling back to public interface 2024-09-17T01:55:12.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:12 smithi031 ceph-mon[77274]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 64/324 objects degraded (19.753%) 2024-09-17T01:55:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:12 smithi092 ceph-mon[64495]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 64/324 objects degraded (19.753%) 2024-09-17T01:55:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:14 smithi092 ceph-mon[64495]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:14.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:14 smithi031 ceph-mon[77274]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.341+0000 7fe551088700 1 -- 172.21.15.31:0/406560729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 msgr2=0x7fe54c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.341+0000 7fe551088700 1 --2- 172.21.15.31:0/406560729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c073c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe540009940 tx=0x7fe540009c50 comp rx=0 tx=0).stop 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 -- 172.21.15.31:0/406560729 shutdown_connections 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 --2- 172.21.15.31:0/406560729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c073c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 --2- 172.21.15.31:0/406560729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe54c074d80 0x7fe54c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 -- 172.21.15.31:0/406560729 >> 172.21.15.31:0/406560729 conn(0x7fe54c0fb7f0 msgr2=0x7fe54c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 -- 172.21.15.31:0/406560729 shutdown_connections 2024-09-17T01:55:15.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 -- 172.21.15.31:0/406560729 wait complete. 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.342+0000 7fe551088700 1 Processor -- start 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe551088700 1 -- start start 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe551088700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe551088700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe54c074d80 0x7fe54c1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe551088700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c1987c0 con 0x7fe54c0737b0 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe551088700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c198930 con 0x7fe54c074d80 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54598/0 (socket says 172.21.15.31:54598) 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54ad9d700 1 -- 172.21.15.31:0/2253608164 learned_addr learned my addr 172.21.15.31:0/2253608164 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54a59c700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe54c074d80 0x7fe54c1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54ad9d700 1 -- 172.21.15.31:0/2253608164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe54c074d80 msgr2=0x7fe54c1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54ad9d700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe54c074d80 0x7fe54c1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.343+0000 7fe54ad9d700 1 -- 172.21.15.31:0/2253608164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400095f0 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.344+0000 7fe54ad9d700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c197c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c8a0 tx=0x7fe53c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.344+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53c0078e0 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.344+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe53c00f450 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.344+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54c19d3c0 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.344+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53c00e5e0 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.344+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c19d8e0 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.345+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54c10af80 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.345+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fe53c00f5c0 con 0x7fe54c0737b0 2024-09-17T01:55:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.346+0000 7fe533fff700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe53406e7b0 0x7fe534070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:15.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.346+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe53c08e860 con 0x7fe54c0737b0 2024-09-17T01:55:15.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.346+0000 7fe54a59c700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe53406e7b0 0x7fe534070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:15.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.346+0000 7fe54a59c700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe53406e7b0 0x7fe534070c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe540005f50 tx=0x7fe540005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:15.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.350+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe53c057890 con 0x7fe54c0737b0 2024-09-17T01:55:15.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:15 smithi092 ceph-mon[64495]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:15.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.491 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.491 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:15 smithi031 ceph-mon[77274]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:15.491 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.491 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.491 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:15.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.596+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe54c107740 con 0x7fe53406e7b0 2024-09-17T01:55:15.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.597+0000 7fe533fff700 1 -- 172.21.15.31:0/2253608164 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe54c107740 con 0x7fe53406e7b0 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe53406e7b0 msgr2=0x7fe534070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe53406e7b0 0x7fe534070c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe540005f50 tx=0x7fe540005de0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 msgr2=0x7fe54c197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c197c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c8a0 tx=0x7fe53c00cbb0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 shutdown_connections 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe53406e7b0 0x7fe534070c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe54c0737b0 0x7fe54c197c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 --2- 172.21.15.31:0/2253608164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe54c074d80 0x7fe54c1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.599+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 >> 172.21.15.31:0/2253608164 conn(0x7fe54c0fb7f0 msgr2=0x7fe54c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.600+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 shutdown_connections 2024-09-17T01:55:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.600+0000 7fe551088700 1 -- 172.21.15.31:0/2253608164 wait complete. 2024-09-17T01:55:15.610 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:55:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 -- 172.21.15.31:0/2621173218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 msgr2=0x7f3ba00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 --2- 172.21.15.31:0/2621173218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba00ff540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009910 tx=0x7f3b90009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 -- 172.21.15.31:0/2621173218 shutdown_connections 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 --2- 172.21.15.31:0/2621173218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ba01003d0 0x7f3ba0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 --2- 172.21.15.31:0/2621173218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba00ff540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 -- 172.21.15.31:0/2621173218 >> 172.21.15.31:0/2621173218 conn(0x7f3ba00fa780 msgr2=0x7f3ba00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 -- 172.21.15.31:0/2621173218 shutdown_connections 2024-09-17T01:55:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.727+0000 7f3ba514f700 1 -- 172.21.15.31:0/2621173218 wait complete. 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3ba514f700 1 Processor -- start 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3ba514f700 1 -- start start 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3ba514f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba0195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3ba514f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ba01003d0 0x7f3ba0195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3ba514f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0196600 con 0x7f3ba00ff130 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3ba514f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0196740 con 0x7f3ba01003d0 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3b9ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba0195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3b9ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba0195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54620/0 (socket says 172.21.15.31:54620) 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3b9ed9d700 1 -- 172.21.15.31:0/1297560150 learned_addr learned my addr 172.21.15.31:0/1297560150 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.728+0000 7f3b9e59c700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ba01003d0 0x7f3ba0195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:15.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b9ed9d700 1 -- 172.21.15.31:0/1297560150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ba01003d0 msgr2=0x7f3ba0195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b9ed9d700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ba01003d0 0x7f3ba0195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b9ed9d700 1 -- 172.21.15.31:0/1297560150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900095f0 con 0x7f3ba00ff130 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b9ed9d700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba0195aa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006010 tx=0x7f3b9000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9001d070 con 0x7f3ba00ff130 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b9000f460 con 0x7f3ba00ff130 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba019b190 con 0x7f3ba00ff130 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b90021640 con 0x7f3ba00ff130 2024-09-17T01:55:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.729+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba019b680 con 0x7f3ba00ff130 2024-09-17T01:55:15.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.730+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba0107c10 con 0x7f3ba00ff130 2024-09-17T01:55:15.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.731+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3b9000fab0 con 0x7f3ba00ff130 2024-09-17T01:55:15.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.731+0000 7f3b87fff700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8806e7c0 0x7f3b88070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:15.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.731+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3b9008faf0 con 0x7f3ba00ff130 2024-09-17T01:55:15.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.731+0000 7f3b9e59c700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8806e7c0 0x7f3b88070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:15.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.732+0000 7f3b9e59c700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8806e7c0 0x7f3b88070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b94005950 tx=0x7f3b9400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:15.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.736+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3b9005c650 con 0x7f3ba00ff130 2024-09-17T01:55:15.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.983+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba019bd80 con 0x7f3b8806e7c0 2024-09-17T01:55:15.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.984+0000 7f3b87fff700 1 -- 172.21.15.31:0/1297560150 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3ba019bd80 con 0x7f3b8806e7c0 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8806e7c0 msgr2=0x7f3b88070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8806e7c0 0x7f3b88070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b94005950 tx=0x7f3b9400b410 comp rx=0 tx=0).stop 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 msgr2=0x7f3ba0195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba0195aa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006010 tx=0x7f3b9000bd70 comp rx=0 tx=0).stop 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 shutdown_connections 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8806e7c0 0x7f3b88070c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ba00ff130 0x7f3ba0195aa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 --2- 172.21.15.31:0/1297560150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ba01003d0 0x7f3ba0195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:15.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 >> 172.21.15.31:0/1297560150 conn(0x7f3ba00fa780 msgr2=0x7f3ba0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:15.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 shutdown_connections 2024-09-17T01:55:15.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:15.986+0000 7f3ba514f700 1 -- 172.21.15.31:0/1297560150 wait complete. 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 -- 172.21.15.31:0/2962167995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 msgr2=0x7f1580100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 --2- 172.21.15.31:0/2962167995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580100660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1570009910 tx=0x7f1570009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 -- 172.21.15.31:0/2962167995 shutdown_connections 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 --2- 172.21.15.31:0/2962167995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 0x7f15801018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 --2- 172.21.15.31:0/2962167995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580100660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 -- 172.21.15.31:0/2962167995 >> 172.21.15.31:0/2962167995 conn(0x7f15800fb7e0 msgr2=0x7f15800fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 -- 172.21.15.31:0/2962167995 shutdown_connections 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.099+0000 7f15853ce700 1 -- 172.21.15.31:0/2962167995 wait complete. 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f15853ce700 1 Processor -- start 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f15853ce700 1 -- start start 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f15853ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f15853ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 0x7f1580196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f15853ce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580196640 con 0x7f1580100250 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f15853ce700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580196780 con 0x7f1580101450 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f157effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f157effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54628/0 (socket says 172.21.15.31:54628) 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.100+0000 7f157effd700 1 -- 172.21.15.31:0/2079952422 learned_addr learned my addr 172.21.15.31:0/2079952422 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f15767fc700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 0x7f1580196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157effd700 1 -- 172.21.15.31:0/2079952422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 msgr2=0x7f1580196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157effd700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 0x7f1580196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157effd700 1 -- 172.21.15.31:0/2079952422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700095f0 con 0x7f1580100250 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f15767fc700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 0x7f1580196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157effd700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580195ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f157000bda0 tx=0x7f157000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157001d070 con 0x7f1580100250 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158019b1d0 con 0x7f1580100250 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f157000f460 con 0x7f1580100250 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1570021640 con 0x7f1580100250 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.101+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158019b6c0 con 0x7f1580100250 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.102+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580108da0 con 0x7f1580100250 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.103+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f1570003a60 con 0x7f1580100250 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.103+0000 7f157cff9700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f156c06e7c0 0x7f156c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.103+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f157008fbe0 con 0x7f1580100250 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.103+0000 7f15767fc700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f156c06e7c0 0x7f156c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.104+0000 7f15767fc700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f156c06e7c0 0x7f156c070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1568005d90 tx=0x7f1568005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.108+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f157005c740 con 0x7f1580100250 2024-09-17T01:55:16.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.366+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1580105da0 con 0x7f156c06e7c0 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.384+0000 7f157cff9700 1 -- 172.21.15.31:0/2079952422 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1580105da0 con 0x7f156c06e7c0 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (10m) 2s ago 11m 24.8M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (11m) 2s ago 11m 8006k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (10m) 24s ago 10m 7889k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (32s) 2s ago 11m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (27s) 24s ago 10m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:55:16.383 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (9m) 2s ago 11m 85.9M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (5m) 2s ago 5m 62.5M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (5m) 2s ago 5m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (5m) 24s ago 5m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (5m) 24s ago 5m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (2m) 2s ago 12m 495M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (113s) 24s ago 10m 439M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (94s) 2s ago 13m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (73s) 24s ago 10m 34.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (11m) 2s ago 11m 16.8M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (10m) 24s ago 10m 15.2M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (7s) 2s ago 9m 14.4M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:55:16.384 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (9m) 2s ago 9m 256M 1217M 18.2.0 dc2bc1663786 cbbd6e9c2c1e 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (8m) 2s ago 8m 194M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (8m) 24s ago 8m 263M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (7m) 24s ago 7m 236M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (7m) 24s ago 7m 221M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (2m) 2s ago 10m 68.8M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f156c06e7c0 msgr2=0x7f156c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f156c06e7c0 0x7f156c070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1568005d90 tx=0x7f1568005d00 comp rx=0 tx=0).stop 2024-09-17T01:55:16.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 msgr2=0x7f1580195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580195ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f157000bda0 tx=0x7f157000be80 comp rx=0 tx=0).stop 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 shutdown_connections 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f156c06e7c0 0x7f156c070c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1580100250 0x7f1580195ae0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f157000bda0 tx=0x7f157000be80 comp rx=0 tx=0).stop 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 --2- 172.21.15.31:0/2079952422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1580101450 0x7f1580196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.386+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 >> 172.21.15.31:0/2079952422 conn(0x7f15800fb7e0 msgr2=0x7f1580104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.387+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 shutdown_connections 2024-09-17T01:55:16.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.387+0000 7f15853ce700 1 -- 172.21.15.31:0/2079952422 wait complete. 2024-09-17T01:55:16.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 -- 172.21.15.31:0/2305977083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 msgr2=0x7f3bb80731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/2305977083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb80731e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009940 tx=0x7f3bb4009c50 comp rx=0 tx=0).stop 2024-09-17T01:55:16.509 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:16 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T01:55:16.441+0000 7f9a1f4d8640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-17T01:55:16.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:16 smithi031 ceph-mon[77274]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:16.510 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:16 smithi031 ceph-mon[77274]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 -- 172.21.15.31:0/2305977083 shutdown_connections 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/2305977083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bb80737b0 0x7f3bb8073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/2305977083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb80731e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 -- 172.21.15.31:0/2305977083 >> 172.21.15.31:0/2305977083 conn(0x7f3bb80fb7f0 msgr2=0x7f3bb80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 -- 172.21.15.31:0/2305977083 shutdown_connections 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.510+0000 7f3bbfde1700 1 -- 172.21.15.31:0/2305977083 wait complete. 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbfde1700 1 Processor -- start 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbfde1700 1 -- start start 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbfde1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bb80737b0 0x7f3bb8197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:16.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbfde1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb81981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbfde1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8198730 con 0x7f3bb8074d80 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbfde1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81988a0 con 0x7f3bb80737b0 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb81981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb81981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54646/0 (socket says 172.21.15.31:54646) 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 -- 172.21.15.31:0/994111710 learned_addr learned my addr 172.21.15.31:0/994111710 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbdb7d700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bb80737b0 0x7f3bb8197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 -- 172.21.15.31:0/994111710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bb80737b0 msgr2=0x7f3bb8197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bb80737b0 0x7f3bb8197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 -- 172.21.15.31:0/994111710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40095f0 con 0x7f3bb8074d80 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3bbd37c700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb81981c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800c930 tx=0x7f3ba800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.512+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba8007ad0 con 0x7f3bb8074d80 2024-09-17T01:55:16.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.513+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ba800ce80 con 0x7f3bb8074d80 2024-09-17T01:55:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.513+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba8018630 con 0x7f3bb8074d80 2024-09-17T01:55:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.513+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb819d340 con 0x7f3bb8074d80 2024-09-17T01:55:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.513+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb819d890 con 0x7f3bb8074d80 2024-09-17T01:55:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.514+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb810af80 con 0x7f3bb8074d80 2024-09-17T01:55:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.515+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3ba8007c30 con 0x7f3bb8074d80 2024-09-17T01:55:16.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.516+0000 7f3baeffd700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3ba406e7c0 0x7f3ba4070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:16.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.516+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3ba808e6f0 con 0x7f3bb8074d80 2024-09-17T01:55:16.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.516+0000 7f3bbdb7d700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3ba406e7c0 0x7f3ba4070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:16.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.516+0000 7f3bbdb7d700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3ba406e7c0 0x7f3ba4070c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4006010 tx=0x7f3bb400ba60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:16.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.524+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ba80577a0 con 0x7f3bb8074d80 2024-09-17T01:55:16.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:16 smithi092 ceph-mon[64495]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:16.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:16 smithi092 ceph-mon[64495]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:16.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.967+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3bb810b140 con 0x7f3bb8074d80 2024-09-17T01:55:16.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.968+0000 7f3baeffd700 1 -- 172.21.15.31:0/994111710 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+693 (secure 0 0 0) 0x7f3ba805ae60 con 0x7f3bb8074d80 2024-09-17T01:55:16.965 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:16.966 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:55:16.967 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-09-17T01:55:16.967 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:55:16.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:55:16.967 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:55:16.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3ba406e7c0 msgr2=0x7f3ba4070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3ba406e7c0 0x7f3ba4070c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4006010 tx=0x7f3bb400ba60 comp rx=0 tx=0).stop 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 msgr2=0x7f3bb81981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb81981c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800c930 tx=0x7f3ba800cc40 comp rx=0 tx=0).stop 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 shutdown_connections 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3ba406e7c0 0x7f3ba4070c70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bb80737b0 0x7f3bb8197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 --2- 172.21.15.31:0/994111710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bb8074d80 0x7f3bb81981c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 >> 172.21.15.31:0/994111710 conn(0x7f3bb80fb7f0 msgr2=0x7f3bb8106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 shutdown_connections 2024-09-17T01:55:16.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:16.970+0000 7f3bbfde1700 1 -- 172.21.15.31:0/994111710 wait complete. 2024-09-17T01:55:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.081+0000 7f53fcbbc700 1 -- 172.21.15.31:0/3125185475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 msgr2=0x7f53f8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.081+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/3125185475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f8100840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009910 tx=0x7f53ec009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 -- 172.21.15.31:0/3125185475 shutdown_connections 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/3125185475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f8100840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/3125185475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53f80ff130 0x7f53f80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 -- 172.21.15.31:0/3125185475 >> 172.21.15.31:0/3125185475 conn(0x7f53f80fa780 msgr2=0x7f53f80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 -- 172.21.15.31:0/3125185475 shutdown_connections 2024-09-17T01:55:17.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 -- 172.21.15.31:0/3125185475 wait complete. 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 Processor -- start 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.082+0000 7f53fcbbc700 1 -- start start 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53fcbbc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53f80ff130 0x7f53f80690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53fcbbc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53fcbbc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8196630 con 0x7f53f81003d0 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53fcbbc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f819d100 con 0x7f53f80ff130 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54684/0 (socket says 172.21.15.31:54684) 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 -- 172.21.15.31:0/1051831036 learned_addr learned my addr 172.21.15.31:0/1051831036 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:17.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f659c700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53f80ff130 0x7f53f80690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 -- 172.21.15.31:0/1051831036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53f80ff130 msgr2=0x7f53f80690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53f80ff130 0x7f53f80690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 -- 172.21.15.31:0/1051831036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0095f0 con 0x7f53f81003d0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.083+0000 7f53f5d9b700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f819cbc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00f690 tx=0x7f53ec00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.084+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec01d070 con 0x7f53f81003d0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.084+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f53ec005dc0 con 0x7f53f81003d0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.084+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f819d350 con 0x7f53f81003d0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.084+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53ec0226a0 con 0x7f53f81003d0 2024-09-17T01:55:17.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.084+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f819d840 con 0x7f53f81003d0 2024-09-17T01:55:17.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.085+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f8107c10 con 0x7f53f81003d0 2024-09-17T01:55:17.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.085+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f53ec0038f0 con 0x7f53f81003d0 2024-09-17T01:55:17.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.086+0000 7f53e77fe700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f53e006e7c0 0x7f53e0070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.086+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f53ec08fcb0 con 0x7f53f81003d0 2024-09-17T01:55:17.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.086+0000 7f53f659c700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f53e006e7c0 0x7f53e0070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.086+0000 7f53f659c700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f53e006e7c0 0x7f53e0070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009c60 tx=0x7f53e8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:17.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.090+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f53ec05c810 con 0x7f53f81003d0 2024-09-17T01:55:17.088 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:16 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T01:55:16.839+0000 7f9a1f4d8640 -1 osd.0 48 log_to_monitors true 2024-09-17T01:55:17.362 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 01:55:17 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T01:55:17.328+0000 7f9a17272640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:55:17.362 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:17 smithi031 ceph-mon[77274]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:17.362 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:17 smithi031 ceph-mon[77274]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:17.362 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:17 smithi031 ceph-mon[77274]: from='osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:55:17.362 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:17 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/994111710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.363+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f53f8107e00 con 0x7f53f81003d0 2024-09-17T01:55:17.363 INFO:teuthology.orchestra.run.smithi031.stdout:e17 2024-09-17T01:55:17.363 INFO:teuthology.orchestra.run.smithi031.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:55:17.363 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:55:17.363 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:55:17.363 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 17 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:55:17.364 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:55:17.365 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:55:17.366 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.364+0000 7f53e77fe700 1 -- 172.21.15.31:0/1051831036 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1971 (secure 0 0 0) 0x7f53ec003680 con 0x7f53f81003d0 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f53e006e7c0 msgr2=0x7f53e0070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f53e006e7c0 0x7f53e0070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009c60 tx=0x7f53e8009260 comp rx=0 tx=0).stop 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 msgr2=0x7f53f819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f819cbc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00f690 tx=0x7f53ec00f6c0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 shutdown_connections 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f53e006e7c0 0x7f53e0070c70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53f80ff130 0x7f53f80690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 --2- 172.21.15.31:0/1051831036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53f81003d0 0x7f53f819cbc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.367+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 >> 172.21.15.31:0/1051831036 conn(0x7f53f80fa780 msgr2=0x7f53f8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.368+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 shutdown_connections 2024-09-17T01:55:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.368+0000 7f53fcbbc700 1 -- 172.21.15.31:0/1051831036 wait complete. 2024-09-17T01:55:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 -- 172.21.15.31:0/3553883561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 msgr2=0x7fa140105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 --2- 172.21.15.31:0/3553883561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140105790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa130009910 tx=0x7fa130009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 -- 172.21.15.31:0/3553883561 shutdown_connections 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 --2- 172.21.15.31:0/3553883561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140105790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 --2- 172.21.15.31:0/3553883561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140069270 0x7fa140102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 -- 172.21.15.31:0/3553883561 >> 172.21.15.31:0/3553883561 conn(0x7fa1400fa780 msgr2=0x7fa1400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 -- 172.21.15.31:0/3553883561 shutdown_connections 2024-09-17T01:55:17.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 -- 172.21.15.31:0/3553883561 wait complete. 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.485+0000 7fa14815c700 1 Processor -- start 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa14815c700 1 -- start start 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa14815c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa14815c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140196010 0x7fa14019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa14815c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140196510 con 0x7fa140103310 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa14815c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140196680 con 0x7fa140196010 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54700/0 (socket says 172.21.15.31:54700) 2024-09-17T01:55:17.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 -- 172.21.15.31:0/2283530747 learned_addr learned my addr 172.21.15.31:0/2283530747 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa1456f7700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140196010 0x7fa14019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 -- 172.21.15.31:0/2283530747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140196010 msgr2=0x7fa14019b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140196010 0x7fa14019b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 -- 172.21.15.31:0/2283530747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300095f0 con 0x7fa140103310 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa1456f7700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140196010 0x7fa14019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.486+0000 7fa145ef8700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140195ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00d8d0 tx=0x7fa13c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.487+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13c0041f0 con 0x7fa140103310 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.487+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa13c007620 con 0x7fa140103310 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.487+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14019b620 con 0x7fa140103310 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.487+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13c003be0 con 0x7fa140103310 2024-09-17T01:55:17.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.487+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14019bb40 con 0x7fa140103310 2024-09-17T01:55:17.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.488+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14018fbf0 con 0x7fa140103310 2024-09-17T01:55:17.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.488+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa13c004350 con 0x7fa140103310 2024-09-17T01:55:17.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.489+0000 7fa136ffd700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa12c06e7c0 0x7fa12c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.489+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa13c08e3e0 con 0x7fa140103310 2024-09-17T01:55:17.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.489+0000 7fa1456f7700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa12c06e7c0 0x7fa12c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.490+0000 7fa1456f7700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa12c06e7c0 0x7fa12c070c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa130005b40 tx=0x7fa130005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:17.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.493+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa13c05af40 con 0x7fa140103310 2024-09-17T01:55:17.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.737+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa14002ce80 con 0x7fa12c06e7c0 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.738+0000 7fa136ffd700 1 -- 172.21.15.31:0/2283530747 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa14002ce80 con 0x7fa12c06e7c0 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:55:17.736 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "7/23 daemons upgraded", 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:55:17.737 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:55:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:17 smithi092 ceph-mon[64495]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:17 smithi092 ceph-mon[64495]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:17 smithi092 ceph-mon[64495]: from='osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:55:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:17 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/994111710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa12c06e7c0 msgr2=0x7fa12c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa12c06e7c0 0x7fa12c070c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa130005b40 tx=0x7fa130005ab0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 msgr2=0x7fa140195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140195ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00d8d0 tx=0x7fa13c00dc90 comp rx=0 tx=0).stop 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 shutdown_connections 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa12c06e7c0 0x7fa12c070c70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa140103310 0x7fa140195ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 --2- 172.21.15.31:0/2283530747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa140196010 0x7fa14019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 >> 172.21.15.31:0/2283530747 conn(0x7fa1400fa780 msgr2=0x7fa1400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 shutdown_connections 2024-09-17T01:55:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.741+0000 7fa14815c700 1 -- 172.21.15.31:0/2283530747 wait complete. 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 -- 172.21.15.31:0/2996468966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8100250 msgr2=0x7fc3e8100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/2996468966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8100250 0x7fc3e8100660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009910 tx=0x7fc3dc009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 -- 172.21.15.31:0/2996468966 shutdown_connections 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/2996468966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e8101450 0x7fc3e81018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/2996468966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8100250 0x7fc3e8100660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 -- 172.21.15.31:0/2996468966 >> 172.21.15.31:0/2996468966 conn(0x7fc3e80fb7e0 msgr2=0x7fc3e80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 -- 172.21.15.31:0/2996468966 shutdown_connections 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.856+0000 7fc3eeffc700 1 -- 172.21.15.31:0/2996468966 wait complete. 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3eeffc700 1 Processor -- start 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3eeffc700 1 -- start start 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3eeffc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e8100250 0x7fc3e8195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3eeffc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 0x7fc3e8196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3eeffc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8196640 con 0x7fc3e8101450 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3eeffc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8196780 con 0x7fc3e8100250 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 0x7fc3e8196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 0x7fc3e8196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54716/0 (socket says 172.21.15.31:54716) 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3e7fff700 1 -- 172.21.15.31:0/408428895 learned_addr learned my addr 172.21.15.31:0/408428895 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3ecd98700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e8100250 0x7fc3e8195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3e7fff700 1 -- 172.21.15.31:0/408428895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e8100250 msgr2=0x7fc3e8195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3e7fff700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e8100250 0x7fc3e8195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.857+0000 7fc3e7fff700 1 -- 172.21.15.31:0/408428895 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0095f0 con 0x7fc3e8101450 2024-09-17T01:55:17.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.858+0000 7fc3e7fff700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 0x7fc3e8196020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400d900 tx=0x7fc3d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:17.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.858+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d40041f0 con 0x7fc3e8101450 2024-09-17T01:55:17.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.858+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc3d4004ce0 con 0x7fc3e8101450 2024-09-17T01:55:17.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.858+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d400b750 con 0x7fc3e8101450 2024-09-17T01:55:17.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.859+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e819b230 con 0x7fc3e8101450 2024-09-17T01:55:17.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.859+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e819b6c0 con 0x7fc3e8101450 2024-09-17T01:55:17.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.860+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8108da0 con 0x7fc3e8101450 2024-09-17T01:55:17.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.861+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fc3d4004350 con 0x7fc3e8101450 2024-09-17T01:55:17.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.862+0000 7fc3e5ffb700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc3d806e7b0 0x7fc3d8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:17.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.862+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc3d408e670 con 0x7fc3e8101450 2024-09-17T01:55:17.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.862+0000 7fc3ecd98700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc3d806e7b0 0x7fc3d8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:17.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.863+0000 7fc3ecd98700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc3d806e7b0 0x7fc3d8070c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc006010 tx=0x7fc3dc00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:17.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:17.867+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc3d405b250 con 0x7fc3e8101450 2024-09-17T01:55:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.173+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc3e819bde0 con 0x7fc3e8101450 2024-09-17T01:55:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.173+0000 7fc3e5ffb700 1 -- 172.21.15.31:0/408428895 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7fc3d4016540 con 0x7fc3e8101450 2024-09-17T01:55:18.171 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 64/324 objects degraded (19.753%), 19 pgs degraded 2024-09-17T01:55:18.171 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:55:18.171 INFO:teuthology.orchestra.run.smithi031.stdout: osd.0 (root=default,host=smithi031) is down 2024-09-17T01:55:18.171 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 64/324 objects degraded (19.753%), 19 pgs degraded 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-17T01:55:18.172 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-17T01:55:18.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc3d806e7b0 msgr2=0x7fc3d8070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc3d806e7b0 0x7fc3d8070c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc006010 tx=0x7fc3dc00b540 comp rx=0 tx=0).stop 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 msgr2=0x7fc3e8196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 0x7fc3e8196020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400d900 tx=0x7fc3d400dcc0 comp rx=0 tx=0).stop 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 shutdown_connections 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc3d806e7b0 0x7fc3d8070c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e8100250 0x7fc3e8195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 --2- 172.21.15.31:0/408428895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3e8101450 0x7fc3e8196020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 >> 172.21.15.31:0/408428895 conn(0x7fc3e80fb7e0 msgr2=0x7fc3e8104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 shutdown_connections 2024-09-17T01:55:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:18.176+0000 7fc3eeffc700 1 -- 172.21.15.31:0/408428895 wait complete. 2024-09-17T01:55:18.425 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:55:18.425 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: osdmap e51: 6 total, 5 up, 6 in 2024-09-17T01:55:18.425 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:55:18.425 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1051831036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/408428895' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:55:18.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:18 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:18.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:55:18.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: osdmap e51: 6 total, 5 up, 6 in 2024-09-17T01:55:18.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:55:18.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1051831036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/408428895' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:55:18.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:18 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138] boot 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:55:19.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:19 smithi092 ceph-mon[64495]: osdmap e53: 6 total, 6 up, 6 in 2024-09-17T01:55:19.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:19.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:55:19.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: osd.0 [v2:172.21.15.31:6802/2120078138,v1:172.21.15.31:6803/2120078138] boot 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:55:19.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:19 smithi031 ceph-mon[77274]: osdmap e53: 6 total, 6 up, 6 in 2024-09-17T01:55:21.592 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:21 smithi031 ceph-mon[77274]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:21.592 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:21.592 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:21 smithi092 ceph-mon[64495]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 64/324 objects degraded (19.753%) 2024-09-17T01:55:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:22.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:22 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 11/324 objects degraded (3.395%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:22.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:22 smithi092 ceph-mon[64495]: mgrmap e38: smithi031.ealpiz(active, since 92s), standbys: smithi092.tjdpfw 2024-09-17T01:55:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:22 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 11/324 objects degraded (3.395%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:22 smithi031 ceph-mon[77274]: mgrmap e38: smithi031.ealpiz(active, since 92s), standbys: smithi092.tjdpfw 2024-09-17T01:55:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:23 smithi092 ceph-mon[64495]: pgmap v54: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 11/324 objects degraded (3.395%) 2024-09-17T01:55:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:23 smithi031 ceph-mon[77274]: pgmap v54: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 11/324 objects degraded (3.395%) 2024-09-17T01:55:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:24 smithi092 ceph-mon[64495]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/324 objects degraded (3.395%), 3 pgs degraded) 2024-09-17T01:55:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:24 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:55:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:24 smithi031 ceph-mon[77274]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/324 objects degraded (3.395%), 3 pgs degraded) 2024-09-17T01:55:24.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:24 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:55:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:25 smithi092 ceph-mon[64495]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 884 B/s wr, 3 op/s 2024-09-17T01:55:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:25 smithi031 ceph-mon[77274]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 884 B/s wr, 3 op/s 2024-09-17T01:55:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:27 smithi092 ceph-mon[64495]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-17T01:55:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:27 smithi031 ceph-mon[77274]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-17T01:55:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:29 smithi092 ceph-mon[64495]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 618 B/s wr, 4 op/s 2024-09-17T01:55:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:29 smithi031 ceph-mon[77274]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 618 B/s wr, 4 op/s 2024-09-17T01:55:31.577 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:31 smithi092 ceph-mon[64495]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 561 B/s wr, 4 op/s 2024-09-17T01:55:31.577 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:31.704 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:31 smithi031 ceph-mon[77274]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 561 B/s wr, 4 op/s 2024-09-17T01:55:31.704 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:33 smithi092 ceph-mon[64495]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:55:33.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:33 smithi031 ceph-mon[77274]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:55:34.731 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:34 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:34.731 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:34 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:34.731 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:34 smithi031 ceph-mon[77274]: Upgrade: osd.1 is safe to restart 2024-09-17T01:55:34.738 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:34 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:34 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:55:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:34 smithi092 ceph-mon[64495]: Upgrade: osd.1 is safe to restart 2024-09-17T01:55:36.194 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: Upgrade: Updating osd.1 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: Deploying daemon osd.1 on smithi031 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:36.195 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:36.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:36.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: Upgrade: Updating osd.1 2024-09-17T01:55:36.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:36.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:55:36.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:36.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: Deploying daemon osd.1 on smithi031 2024-09-17T01:55:36.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:36.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:38.118 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:37 smithi031 ceph-mon[77274]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:38.119 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:37 smithi031 systemd[1]: Stopping Ceph osd.1 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:55:38.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:37 smithi092 ceph-mon[64495]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:38.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[48238]: 2024-09-17T01:55:38.119+0000 7f91a2245700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:55:38.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[48238]: 2024-09-17T01:55:38.119+0000 7f91a2245700 -1 osd.1 53 *** Got signal Terminated *** 2024-09-17T01:55:38.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:38 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[48238]: 2024-09-17T01:55:38.119+0000 7f91a2245700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:55:39.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:38 smithi031 ceph-mon[77274]: osd.1 marked itself down and dead 2024-09-17T01:55:39.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:38 smithi092 ceph-mon[64495]: osd.1 marked itself down and dead 2024-09-17T01:55:39.477 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:39 smithi031 podman[86386]: 2024-09-17 01:55:39.185268429 +0000 UTC m=+1.145905274 container died cbbd6e9c2c1e24a12a686f8bc6ee6b7967d8b34cdd2aa253b977686fa83130a9 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-17T01:55:39.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:39 smithi031 podman[86386]: 2024-09-17 01:55:39.5790567 +0000 UTC m=+1.539693552 container cleanup cbbd6e9c2c1e24a12a686f8bc6ee6b7967d8b34cdd2aa253b977686fa83130a9 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-17T01:55:39.765 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:39 smithi031 bash[86386]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:55:40.154 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:39 smithi031 ceph-mon[77274]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:40.154 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:39 smithi031 ceph-mon[77274]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:55:40.154 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:39 smithi031 ceph-mon[77274]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:55:40.154 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:39 smithi031 podman[86404]: 2024-09-17 01:55:39.813163046 +0000 UTC m=+0.623990828 container remove cbbd6e9c2c1e24a12a686f8bc6ee6b7967d8b34cdd2aa253b977686fa83130a9 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.29.1, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:55:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:39 smithi092 ceph-mon[64495]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:39 smithi092 ceph-mon[64495]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:55:40.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:39 smithi092 ceph-mon[64495]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:55:40.407 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:40 smithi031 podman[86492]: 2024-09-17 01:55:40.059432577 +0000 UTC m=+0.016394133 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:55:40.407 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:40 smithi031 podman[86492]: 2024-09-17 01:55:40.189841841 +0000 UTC m=+0.146803427 container create caf6c9c7cf677e450ec8c7ab94a665669967d7fb83df1bd152b44950f1604b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97) 2024-09-17T01:55:40.407 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:40 smithi031 podman[86492]: 2024-09-17 01:55:40.40940321 +0000 UTC m=+0.366364781 container init caf6c9c7cf677e450ec8c7ab94a665669967d7fb83df1bd152b44950f1604b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T01:55:40.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:40 smithi031 podman[86492]: 2024-09-17 01:55:40.413133771 +0000 UTC m=+0.370095323 container start caf6c9c7cf677e450ec8c7ab94a665669967d7fb83df1bd152b44950f1604b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:55:40.765 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:40 smithi031 podman[86492]: 2024-09-17 01:55:40.500623446 +0000 UTC m=+0.457584999 container attach caf6c9c7cf677e450ec8c7ab94a665669967d7fb83df1bd152b44950f1604b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-c2ddf97, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T01:55:40.765 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:40 smithi031 podman[86492]: 2024-09-17 01:55:40.604059571 +0000 UTC m=+0.561021129 container died caf6c9c7cf677e450ec8c7ab94a665669967d7fb83df1bd152b44950f1604b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:55:41.201 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:40 smithi031 ceph-mon[77274]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:55:41.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:40 smithi092 ceph-mon[64495]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:55:41.460 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 podman[86516]: 2024-09-17 01:55:41.204378717 +0000 UTC m=+0.590895110 container remove caf6c9c7cf677e450ec8c7ab94a665669967d7fb83df1bd152b44950f1604b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:55:41.460 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T01:55:41.460 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 systemd[1]: Stopped Ceph osd.1 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:55:41.460 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 14.136s CPU time. 2024-09-17T01:55:41.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 systemd[1]: Starting Ceph osd.1 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:55:41.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 podman[86617]: 2024-09-17 01:55:41.578619918 +0000 UTC m=+0.016202955 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:55:41.764 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 podman[86617]: 2024-09-17 01:55:41.681105036 +0000 UTC m=+0.118688090 container create 94f32095cf12d3a4e6cedec79bb8c23e0dc165e80e9f75e2fccc01399a7d53df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T01:55:41.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:41 smithi092 ceph-mon[64495]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:55:42.061 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:41 smithi031 ceph-mon[77274]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:55:42.062 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 podman[86617]: 2024-09-17 01:55:41.925599099 +0000 UTC m=+0.363182119 container init 94f32095cf12d3a4e6cedec79bb8c23e0dc165e80e9f75e2fccc01399a7d53df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:55:42.062 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:41 smithi031 podman[86617]: 2024-09-17 01:55:41.92905777 +0000 UTC m=+0.366640779 container start 94f32095cf12d3a4e6cedec79bb8c23e0dc165e80e9f75e2fccc01399a7d53df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:55:42.062 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 podman[86617]: 2024-09-17 01:55:42.008632929 +0000 UTC m=+0.446215956 container attach 94f32095cf12d3a4e6cedec79bb8c23e0dc165e80e9f75e2fccc01399a7d53df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97) 2024-09-17T01:55:42.514 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:42.514 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 bash[86617]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:42.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:42.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 bash[86617]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:55:43.091 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:42 smithi031 ceph-mon[77274]: Health check failed: Degraded data redundancy: 46/324 objects degraded (14.198%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:43.091 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:55:43.092 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 bash[86617]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:55:43.092 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:55:43.092 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:42 smithi031 bash[86617]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:55:43.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:42 smithi092 ceph-mon[64495]: Health check failed: Degraded data redundancy: 46/324 objects degraded (14.198%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:43.435 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:55:43.435 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 bash[86617]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:55:43.435 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:55:43.435 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 bash[86617]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:55:43.435 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:55:43.436 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 bash[86617]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:55:43.436 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:55:43.436 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 bash[86617]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:55:43.436 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate[86632]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:55:43.436 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 bash[86617]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:55:43.436 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 podman[86617]: 2024-09-17 01:55:43.124136858 +0000 UTC m=+1.561719876 container died 94f32095cf12d3a4e6cedec79bb8c23e0dc165e80e9f75e2fccc01399a7d53df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97) 2024-09-17T01:55:44.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:43 smithi031 ceph-mon[77274]: pgmap v66: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 46/324 objects degraded (14.198%) 2024-09-17T01:55:44.015 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 podman[86784]: 2024-09-17 01:55:43.712448853 +0000 UTC m=+0.581462355 container remove 94f32095cf12d3a4e6cedec79bb8c23e0dc165e80e9f75e2fccc01399a7d53df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:55:44.015 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 podman[86844]: 2024-09-17 01:55:43.82746072 +0000 UTC m=+0.016917749 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:55:44.015 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:43 smithi031 podman[86844]: 2024-09-17 01:55:43.946833878 +0000 UTC m=+0.136290906 container create f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:55:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:43 smithi092 ceph-mon[64495]: pgmap v66: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 46/324 objects degraded (14.198%) 2024-09-17T01:55:44.514 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:44 smithi031 podman[86844]: 2024-09-17 01:55:44.199505663 +0000 UTC m=+0.388962692 container init f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:55:44.514 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:44 smithi031 podman[86844]: 2024-09-17 01:55:44.202961617 +0000 UTC m=+0.392418646 container start f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD) 2024-09-17T01:55:44.514 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:44 smithi031 ceph-osd[86863]: -- 172.21.15.31:0/264693540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564bf40161e0 con 0x564bf320bc00 2024-09-17T01:55:44.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:44 smithi031 bash[86844]: f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c 2024-09-17T01:55:44.515 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:44 smithi031 systemd[1]: Started Ceph osd.1 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:55:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:45 smithi092 ceph-mon[64495]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:45 smithi031 ceph-mon[77274]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:46.264 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:46 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T01:55:46.088+0000 7f0463f5a640 -1 Falling back to public interface 2024-09-17T01:55:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:47 smithi092 ceph-mon[64495]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:47 smithi031 ceph-mon[77274]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:48.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 -- 172.21.15.31:0/3721282192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 msgr2=0x7f6fa00ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 --2- 172.21.15.31:0/3721282192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa00ff450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009910 tx=0x7f6f9c009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 -- 172.21.15.31:0/3721282192 shutdown_connections 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 --2- 172.21.15.31:0/3721282192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa0100240 0x7f6fa0100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 --2- 172.21.15.31:0/3721282192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa00ff450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 -- 172.21.15.31:0/3721282192 >> 172.21.15.31:0/3721282192 conn(0x7f6fa00fa610 msgr2=0x7f6fa00fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 -- 172.21.15.31:0/3721282192 shutdown_connections 2024-09-17T01:55:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.288+0000 7f6fa8409700 1 -- 172.21.15.31:0/3721282192 wait complete. 2024-09-17T01:55:48.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.289+0000 7f6fa8409700 1 Processor -- start 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.289+0000 7f6fa8409700 1 -- start start 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.289+0000 7f6fa8409700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa0195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.289+0000 7f6fa8409700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa0100240 0x7f6fa0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.289+0000 7f6fa8409700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0196490 con 0x7f6fa00ff040 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.289+0000 7f6fa8409700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01965d0 con 0x7f6fa0100240 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa0195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa0195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53396/0 (socket says 172.21.15.31:53396) 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 -- 172.21.15.31:0/2477313216 learned_addr learned my addr 172.21.15.31:0/2477313216 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:48.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa59a4700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa0100240 0x7f6fa0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 -- 172.21.15.31:0/2477313216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa0100240 msgr2=0x7f6fa0195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa0100240 0x7f6fa0195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 -- 172.21.15.31:0/2477313216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0095f0 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6fa61a5700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa0195930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00bda0 tx=0x7f6f9c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c01d070 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f9c004c50 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.290+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c00f690 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.291+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa019b020 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.291+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa019b510 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.291+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa0107b90 con 0x7f6fa00ff040 2024-09-17T01:55:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.292+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6f9c0229b0 con 0x7f6fa00ff040 2024-09-17T01:55:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.292+0000 7f6f977fe700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6f8c06e680 0x7f6f8c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.293+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6f9c08fd00 con 0x7f6fa00ff040 2024-09-17T01:55:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.293+0000 7f6fa59a4700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6f8c06e680 0x7f6f8c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.293+0000 7f6fa59a4700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6f8c06e680 0x7f6f8c070b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f90005fd0 tx=0x7f6f9000a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.297+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6f9c093030 con 0x7f6fa00ff040 2024-09-17T01:55:48.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.537+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa00694e0 con 0x7f6f8c06e680 2024-09-17T01:55:48.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.538+0000 7f6f977fe700 1 -- 172.21.15.31:0/2477313216 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6fa00694e0 con 0x7f6f8c06e680 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6f8c06e680 msgr2=0x7f6f8c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6f8c06e680 0x7f6f8c070b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f90005fd0 tx=0x7f6f9000a560 comp rx=0 tx=0).stop 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 msgr2=0x7f6fa0195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa0195930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00bda0 tx=0x7f6f9c00be80 comp rx=0 tx=0).stop 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 shutdown_connections 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6f8c06e680 0x7f6f8c070b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00ff040 0x7f6fa0195930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 --2- 172.21.15.31:0/2477313216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa0100240 0x7f6fa0195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 >> 172.21.15.31:0/2477313216 conn(0x7f6fa00fa610 msgr2=0x7f6fa0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:48.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 shutdown_connections 2024-09-17T01:55:48.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.540+0000 7f6fa8409700 1 -- 172.21.15.31:0/2477313216 wait complete. 2024-09-17T01:55:48.551 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 -- 172.21.15.31:0/2540371379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c1003f0 msgr2=0x7f938c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 --2- 172.21.15.31:0/2540371379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c1003f0 0x7f938c100860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9378009910 tx=0x7f9378009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 -- 172.21.15.31:0/2540371379 shutdown_connections 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 --2- 172.21.15.31:0/2540371379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c1003f0 0x7f938c100860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 --2- 172.21.15.31:0/2540371379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c0ff150 0x7f938c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 -- 172.21.15.31:0/2540371379 >> 172.21.15.31:0/2540371379 conn(0x7f938c0fa7a0 msgr2=0x7f938c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 -- 172.21.15.31:0/2540371379 shutdown_connections 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 -- 172.21.15.31:0/2540371379 wait complete. 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 Processor -- start 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.653+0000 7f9392f55700 1 -- start start 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9392f55700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 0x7f938c195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9392f55700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1003f0 0x7f938c196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9392f55700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c196920 con 0x7f938c0ff150 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9392f55700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c196a60 con 0x7f938c1003f0 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 0x7f938c195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 0x7f938c195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53406/0 (socket says 172.21.15.31:53406) 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 -- 172.21.15.31:0/1746173131 learned_addr learned my addr 172.21.15.31:0/1746173131 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f938bfff700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1003f0 0x7f938c196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 -- 172.21.15.31:0/1746173131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1003f0 msgr2=0x7f938c196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1003f0 0x7f938c196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 -- 172.21.15.31:0/1746173131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93780095f0 con 0x7f938c0ff150 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9390cf1700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 0x7f938c195dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f938000e920 tx=0x7f938000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9380009790 con 0x7f938c0ff150 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.654+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f938000cba0 con 0x7f938c0ff150 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.655+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c19b510 con 0x7f938c0ff150 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.655+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9380018630 con 0x7f938c0ff150 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.655+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c19ba60 con 0x7f938c0ff150 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.656+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c068ab0 con 0x7f938c0ff150 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.656+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f938000cd10 con 0x7f938c0ff150 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.657+0000 7f9389ffb700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f937c06e680 0x7f937c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.657+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9380014070 con 0x7f938c0ff150 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.657+0000 7f938bfff700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f937c06e680 0x7f937c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.658+0000 7f938bfff700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f937c06e680 0x7f937c070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93780059d0 tx=0x7f9378005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.661+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f93800541b0 con 0x7f938c0ff150 2024-09-17T01:55:48.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.902+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f938c0694e0 con 0x7f937c06e680 2024-09-17T01:55:48.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.903+0000 7f9389ffb700 1 -- 172.21.15.31:0/1746173131 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f938c0694e0 con 0x7f937c06e680 2024-09-17T01:55:48.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f937c06e680 msgr2=0x7f937c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f937c06e680 0x7f937c070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f93780059d0 tx=0x7f9378005940 comp rx=0 tx=0).stop 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 msgr2=0x7f938c195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 0x7f938c195dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f938000e920 tx=0x7f938000ece0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 shutdown_connections 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f937c06e680 0x7f937c070b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938c0ff150 0x7f938c195dc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 --2- 172.21.15.31:0/1746173131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f938c1003f0 0x7f938c196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 >> 172.21.15.31:0/1746173131 conn(0x7f938c0fa7a0 msgr2=0x7f938c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 shutdown_connections 2024-09-17T01:55:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:48.906+0000 7f9392f55700 1 -- 172.21.15.31:0/1746173131 wait complete. 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.015+0000 7f9b46755700 1 -- 172.21.15.31:0/1485076372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 msgr2=0x7f9b400ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.015+0000 7f9b46755700 1 --2- 172.21.15.31:0/1485076372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b400ff560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009910 tx=0x7f9b30009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.015+0000 7f9b46755700 1 -- 172.21.15.31:0/1485076372 shutdown_connections 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 --2- 172.21.15.31:0/1485076372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b401003f0 0x7f9b40100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 --2- 172.21.15.31:0/1485076372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b400ff560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 -- 172.21.15.31:0/1485076372 >> 172.21.15.31:0/1485076372 conn(0x7f9b400fa7a0 msgr2=0x7f9b400fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 -- 172.21.15.31:0/1485076372 shutdown_connections 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 -- 172.21.15.31:0/1485076372 wait complete. 2024-09-17T01:55:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 Processor -- start 2024-09-17T01:55:49.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.016+0000 7f9b46755700 1 -- start start 2024-09-17T01:55:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b46755700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b40195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b46755700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b401003f0 0x7f9b40196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b46755700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40196970 con 0x7f9b400ff150 2024-09-17T01:55:49.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b46755700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b40196ab0 con 0x7f9b401003f0 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b40195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b40195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53428/0 (socket says 172.21.15.31:53428) 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 -- 172.21.15.31:0/2084812591 learned_addr learned my addr 172.21.15.31:0/2084812591 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3f7fe700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b401003f0 0x7f9b40196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 -- 172.21.15.31:0/2084812591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b401003f0 msgr2=0x7f9b40196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b401003f0 0x7f9b40196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 -- 172.21.15.31:0/2084812591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300095f0 con 0x7f9b400ff150 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3ffff700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b40195e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000bd70 tx=0x7f9b3000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b3001d070 con 0x7f9b400ff150 2024-09-17T01:55:49.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b30005dc0 con 0x7f9b400ff150 2024-09-17T01:55:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4019b500 con 0x7f9b400ff150 2024-09-17T01:55:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b30021410 con 0x7f9b400ff150 2024-09-17T01:55:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.017+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4019b9f0 con 0x7f9b400ff150 2024-09-17T01:55:49.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.018+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b40068ab0 con 0x7f9b400ff150 2024-09-17T01:55:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.019+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9b3000f7d0 con 0x7f9b400ff150 2024-09-17T01:55:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.020+0000 7f9b3d7fa700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9b2806e680 0x7f9b28070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.020+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9b3008f7e0 con 0x7f9b400ff150 2024-09-17T01:55:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.020+0000 7f9b3f7fe700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9b2806e680 0x7f9b28070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.021+0000 7f9b3f7fe700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9b2806e680 0x7f9b28070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b34005950 tx=0x7f9b3400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:49.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.025+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9b3005c560 con 0x7f9b400ff150 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.258+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b400694e0 con 0x7f9b2806e680 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.270+0000 7f9b3d7fa700 1 -- 172.21.15.31:0/2084812591 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9b400694e0 con 0x7f9b2806e680 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (10m) 35s ago 11m 24.8M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (12m) 35s ago 12m 8006k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (11m) 57s ago 11m 7889k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (65s) 35s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (60s) 57s ago 11m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (10m) 35s ago 11m 85.9M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (6m) 35s ago 6m 62.5M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (6m) 35s ago 6m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (6m) 57s ago 6m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (6m) 57s ago 6m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (3m) 35s ago 13m 495M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (2m) 57s ago 11m 439M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (2m) 35s ago 13m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (106s) 57s ago 10m 34.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (12m) 35s ago 12m 16.8M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (11m) 57s ago 11m 15.2M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (40s) 35s ago 10m 14.4M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 starting - - - 1217M 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (9m) 35s ago 9m 194M 1217M 18.2.0 dc2bc1663786 b51cb1c26bc6 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (8m) 57s ago 8m 263M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (8m) 57s ago 8m 236M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (8m) 57s ago 8m 221M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (2m) 35s ago 11m 68.8M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9b2806e680 msgr2=0x7f9b28070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9b2806e680 0x7f9b28070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b34005950 tx=0x7f9b3400b410 comp rx=0 tx=0).stop 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 msgr2=0x7f9b40195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b40195e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000bd70 tx=0x7f9b3000bda0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 shutdown_connections 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9b2806e680 0x7f9b28070b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b400ff150 0x7f9b40195e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 --2- 172.21.15.31:0/2084812591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b401003f0 0x7f9b40196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 >> 172.21.15.31:0/2084812591 conn(0x7f9b400fa7a0 msgr2=0x7f9b40068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 shutdown_connections 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.272+0000 7f9b46755700 1 -- 172.21.15.31:0/2084812591 wait complete. 2024-09-17T01:55:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.397+0000 7f094df60700 1 -- 172.21.15.31:0/15293552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09480ff130 msgr2=0x7f09480ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.397+0000 7f094df60700 1 --2- 172.21.15.31:0/15293552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09480ff130 0x7f09480ff540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0938009910 tx=0x7f0938009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:49.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 -- 172.21.15.31:0/15293552 shutdown_connections 2024-09-17T01:55:49.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 --2- 172.21.15.31:0/15293552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09481003d0 0x7f0948100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 --2- 172.21.15.31:0/15293552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09480ff130 0x7f09480ff540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 -- 172.21.15.31:0/15293552 >> 172.21.15.31:0/15293552 conn(0x7f09480fa780 msgr2=0x7f09480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:49.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 -- 172.21.15.31:0/15293552 shutdown_connections 2024-09-17T01:55:49.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 -- 172.21.15.31:0/15293552 wait complete. 2024-09-17T01:55:49.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 Processor -- start 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.398+0000 7f094df60700 1 -- start start 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f094df60700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09480ff130 0x7f0948103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f094df60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 0x7f09481017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f094df60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948101cf0 con 0x7f09481003d0 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f094df60700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948101e30 con 0x7f09480ff130 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 0x7f09481017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 0x7f09481017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53442/0 (socket says 172.21.15.31:53442) 2024-09-17T01:55:49.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 -- 172.21.15.31:0/1405214994 learned_addr learned my addr 172.21.15.31:0/1405214994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f09477fe700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09480ff130 0x7f0948103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 -- 172.21.15.31:0/1405214994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09480ff130 msgr2=0x7f0948103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09480ff130 0x7f0948103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 -- 172.21.15.31:0/1405214994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380095f0 con 0x7f09481003d0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.399+0000 7f0946ffd700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 0x7f09481017b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d8d0 tx=0x7f093c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.400+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c009940 con 0x7f09481003d0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.400+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f093c010460 con 0x7f09481003d0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.400+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948102110 con 0x7f09481003d0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.400+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c00f5f0 con 0x7f09481003d0 2024-09-17T01:55:49.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.400+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094819db00 con 0x7f09481003d0 2024-09-17T01:55:49.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.401+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948107c10 con 0x7f09481003d0 2024-09-17T01:55:49.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.402+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f093c0105d0 con 0x7f09481003d0 2024-09-17T01:55:49.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.403+0000 7f0944ff9700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f093006e680 0x7f0930070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.403+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f093c08e500 con 0x7f09481003d0 2024-09-17T01:55:49.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.403+0000 7f09477fe700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f093006e680 0x7f0930070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.404+0000 7f09477fe700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f093006e680 0x7f0930070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f093800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:49.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.408+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f093c05b450 con 0x7f09481003d0 2024-09-17T01:55:49.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:49 smithi031 ceph-mon[77274]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:49.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:49 smithi031 ceph-mon[77274]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:49.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:49 smithi031 ceph-mon[77274]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:49 smithi092 ceph-mon[64495]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:49 smithi092 ceph-mon[64495]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:49 smithi092 ceph-mon[64495]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:49.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.766+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0948107e30 con 0x7f09481003d0 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.767+0000 7f0944ff9700 1 -- 172.21.15.31:0/1405214994 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f093c05afe0 con 0x7f09481003d0 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:55:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:55:49.770 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f093006e680 msgr2=0x7f0930070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f093006e680 0x7f0930070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f093800b540 comp rx=0 tx=0).stop 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 msgr2=0x7f09481017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 0x7f09481017b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d8d0 tx=0x7f093c00dc90 comp rx=0 tx=0).stop 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 shutdown_connections 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f093006e680 0x7f0930070b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09480ff130 0x7f0948103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 --2- 172.21.15.31:0/1405214994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09481003d0 0x7f09481017b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.769+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 >> 172.21.15.31:0/1405214994 conn(0x7f09480fa780 msgr2=0x7f0948068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.770+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 shutdown_connections 2024-09-17T01:55:49.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.770+0000 7f094df60700 1 -- 172.21.15.31:0/1405214994 wait complete. 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 -- 172.21.15.31:0/862324311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc103600 msgr2=0x7f88bc1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 --2- 172.21.15.31:0/862324311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc103600 0x7f88bc1059e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009910 tx=0x7f88b0009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 -- 172.21.15.31:0/862324311 shutdown_connections 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 --2- 172.21.15.31:0/862324311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc103600 0x7f88bc1059e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 --2- 172.21.15.31:0/862324311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88bc100ce0 0x7f88bc1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 -- 172.21.15.31:0/862324311 >> 172.21.15.31:0/862324311 conn(0x7f88bc0fa700 msgr2=0x7f88bc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 -- 172.21.15.31:0/862324311 shutdown_connections 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.889+0000 7f88c173c700 1 -- 172.21.15.31:0/862324311 wait complete. 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.890+0000 7f88c173c700 1 Processor -- start 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.890+0000 7f88c173c700 1 -- start start 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.890+0000 7f88c173c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 0x7f88bc195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.890+0000 7f88c173c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88bc103600 0x7f88bc196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.890+0000 7f88c173c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc196620 con 0x7f88bc100ce0 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.890+0000 7f88c173c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc196760 con 0x7f88bc103600 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 0x7f88bc195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 0x7f88bc195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53462/0 (socket says 172.21.15.31:53462) 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 -- 172.21.15.31:0/3351207891 learned_addr learned my addr 172.21.15.31:0/3351207891 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 -- 172.21.15.31:0/3351207891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88bc103600 msgr2=0x7f88bc196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88bc103600 0x7f88bc196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 -- 172.21.15.31:0/3351207891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00095f0 con 0x7f88bc100ce0 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88baffd700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 0x7f88bc195ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00d8d0 tx=0x7f88ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ac009940 con 0x7f88bc100ce0 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.891+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f88ac010460 con 0x7f88bc100ce0 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.892+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc19b1c0 con 0x7f88bc100ce0 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.892+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ac00f5f0 con 0x7f88bc100ce0 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.892+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc19b710 con 0x7f88bc100ce0 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.893+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc18fc70 con 0x7f88bc100ce0 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.893+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f88ac0105d0 con 0x7f88bc100ce0 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.894+0000 7f88a3fff700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f88a406e680 0x7f88a4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.894+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f88ac08e5c0 con 0x7f88bc100ce0 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.894+0000 7f88ba7fc700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f88a406e680 0x7f88a4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.894+0000 7f88ba7fc700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f88a406e680 0x7f88a4070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88b000b5c0 tx=0x7f88b0005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:49.902+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f88ac05b340 con 0x7f88bc100ce0 2024-09-17T01:55:50.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.175+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f88bc061990 con 0x7f88bc100ce0 2024-09-17T01:55:50.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.175+0000 7f88a3fff700 1 -- 172.21.15.31:0/3351207891 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1971 (secure 0 0 0) 0x7f88ac05aed0 con 0x7f88bc100ce0 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:e17 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 17 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:55:50.177 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:52:36.074925+0000 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:55:50.178 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:50.179 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:55:50.180 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:55:50.180 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:55:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f88a406e680 msgr2=0x7f88a4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f88a406e680 0x7f88a4070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88b000b5c0 tx=0x7f88b0005960 comp rx=0 tx=0).stop 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 msgr2=0x7f88bc195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 0x7f88bc195ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00d8d0 tx=0x7f88ac00dc90 comp rx=0 tx=0).stop 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 shutdown_connections 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f88a406e680 0x7f88a4070b30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88bc100ce0 0x7f88bc195ac0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 --2- 172.21.15.31:0/3351207891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88bc103600 0x7f88bc196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 >> 172.21.15.31:0/3351207891 conn(0x7f88bc0fa700 msgr2=0x7f88bc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 shutdown_connections 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.179+0000 7f88c173c700 1 -- 172.21.15.31:0/3351207891 wait complete. 2024-09-17T01:55:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 -- 172.21.15.31:0/2902437363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc100350 msgr2=0x7fbfdc1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/2902437363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc100350 0x7fbfdc1007a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009910 tx=0x7fbfc4009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 -- 172.21.15.31:0/2902437363 shutdown_connections 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/2902437363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc100350 0x7fbfdc1007a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/2902437363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 -- 172.21.15.31:0/2902437363 >> 172.21.15.31:0/2902437363 conn(0x7fbfdc0fa700 msgr2=0x7fbfdc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 -- 172.21.15.31:0/2902437363 shutdown_connections 2024-09-17T01:55:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.316+0000 7fbfe1e19700 1 -- 172.21.15.31:0/2902437363 wait complete. 2024-09-17T01:55:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfe1e19700 1 Processor -- start 2024-09-17T01:55:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfe1e19700 1 -- start start 2024-09-17T01:55:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfe1e19700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc1949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfe1e19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfdc100350 0x7fbfdc194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfe1e19700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc195500 con 0x7fbfdc0ff150 2024-09-17T01:55:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfe1e19700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc195640 con 0x7fbfdc100350 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfdb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc1949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.317+0000 7fbfdb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc1949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53478/0 (socket says 172.21.15.31:53478) 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfdb7fe700 1 -- 172.21.15.31:0/1189065233 learned_addr learned my addr 172.21.15.31:0/1189065233 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfd2ffd700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfdc100350 0x7fbfdc194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfdb7fe700 1 -- 172.21.15.31:0/1189065233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfdc100350 msgr2=0x7fbfdc194ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfdb7fe700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfdc100350 0x7fbfdc194ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfdb7fe700 1 -- 172.21.15.31:0/1189065233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40095f0 con 0x7fbfdc0ff150 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfdb7fe700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc1949a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc007e90 tx=0x7fbfcc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfcc017070 con 0x7fbfdc0ff150 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbfcc00f040 con 0x7fbfdc0ff150 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc19a0f0 con 0x7fbfdc0ff150 2024-09-17T01:55:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.318+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfcc004820 con 0x7fbfdc0ff150 2024-09-17T01:55:50.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.319+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc19a640 con 0x7fbfdc0ff150 2024-09-17T01:55:50.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.320+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc107ca0 con 0x7fbfdc0ff150 2024-09-17T01:55:50.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.321+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbfcc003a00 con 0x7fbfdc0ff150 2024-09-17T01:55:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.321+0000 7fbfd97fa700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbfc806e680 0x7fbfc8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.321+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbfcc08ded0 con 0x7fbfdc0ff150 2024-09-17T01:55:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.321+0000 7fbfd2ffd700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbfc806e680 0x7fbfc8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.322+0000 7fbfd2ffd700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbfc806e680 0x7fbfc8070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4006010 tx=0x7fbfc400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.326+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbfcc05ac50 con 0x7fbfdc0ff150 2024-09-17T01:55:50.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.581+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfdc104ca0 con 0x7fbfc806e680 2024-09-17T01:55:50.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.583+0000 7fbfd97fa700 1 -- 172.21.15.31:0/1189065233 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbfdc104ca0 con 0x7fbfc806e680 2024-09-17T01:55:50.581 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:55:50.581 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:55:50.581 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:55:50.581 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:55:50.582 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:55:50.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbfc806e680 msgr2=0x7fbfc8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbfc806e680 0x7fbfc8070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4006010 tx=0x7fbfc400b540 comp rx=0 tx=0).stop 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 msgr2=0x7fbfdc1949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc1949a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc007e90 tx=0x7fbfcc00d3b0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 shutdown_connections 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbfc806e680 0x7fbfc8070b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfdc0ff150 0x7fbfdc1949a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 --2- 172.21.15.31:0/1189065233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfdc100350 0x7fbfdc194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 >> 172.21.15.31:0/1189065233 conn(0x7fbfdc0fa700 msgr2=0x7fbfdc103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 shutdown_connections 2024-09-17T01:55:50.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.585+0000 7fbfe1e19700 1 -- 172.21.15.31:0/1189065233 wait complete. 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 -- 172.21.15.31:0/1746568257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc069aa0 msgr2=0x7f44dc102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1746568257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc069aa0 0x7f44dc102e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009910 tx=0x7f44cc009c20 comp rx=0 tx=0).stop 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 -- 172.21.15.31:0/1746568257 shutdown_connections 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1746568257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44dc103390 0x7f44dc1057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1746568257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc069aa0 0x7f44dc102e50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 -- 172.21.15.31:0/1746568257 >> 172.21.15.31:0/1746568257 conn(0x7f44dc0fa7a0 msgr2=0x7f44dc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 -- 172.21.15.31:0/1746568257 shutdown_connections 2024-09-17T01:55:50.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.695+0000 7f44e08f1700 1 -- 172.21.15.31:0/1746568257 wait complete. 2024-09-17T01:55:50.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44e08f1700 1 Processor -- start 2024-09-17T01:55:50.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44e08f1700 1 -- start start 2024-09-17T01:55:50.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44e08f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44dc069aa0 0x7f44dc1007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44e08f1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 0x7f44dc0fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44e08f1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0ff330 con 0x7f44dc103390 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44e08f1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0ff470 con 0x7f44dc069aa0 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44d9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 0x7f44dc0fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44d9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 0x7f44dc0fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53484/0 (socket says 172.21.15.31:53484) 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44d9d9b700 1 -- 172.21.15.31:0/1740529652 learned_addr learned my addr 172.21.15.31:0/1740529652 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44da59c700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44dc069aa0 0x7f44dc1007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44d9d9b700 1 -- 172.21.15.31:0/1740529652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44dc069aa0 msgr2=0x7f44dc1007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44d9d9b700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44dc069aa0 0x7f44dc1007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.696+0000 7f44d9d9b700 1 -- 172.21.15.31:0/1740529652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0095f0 con 0x7f44dc103390 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.697+0000 7f44d9d9b700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 0x7f44dc0fedf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44d000e920 tx=0x7f44d000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:50.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.697+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d000c9d0 con 0x7f44dc103390 2024-09-17T01:55:50.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.697+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44d0010430 con 0x7f44dc103390 2024-09-17T01:55:50.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.697+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc0ff750 con 0x7f44dc103390 2024-09-17T01:55:50.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.697+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d0018650 con 0x7f44dc103390 2024-09-17T01:55:50.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.697+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc19ddd0 con 0x7f44dc103390 2024-09-17T01:55:50.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.698+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc18fbf0 con 0x7f44dc103390 2024-09-17T01:55:50.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.698+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f44d00105a0 con 0x7f44dc103390 2024-09-17T01:55:50.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.699+0000 7f44cb7fe700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f44c406e680 0x7f44c4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:55:50.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.699+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f44d0014070 con 0x7f44dc103390 2024-09-17T01:55:50.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.699+0000 7f44da59c700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f44c406e680 0x7f44c4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:55:50.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.699+0000 7f44da59c700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f44c406e680 0x7f44c4070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00b6f0 tx=0x7f44cc005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:55:50.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:50.703+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f44d00541b0 con 0x7f44dc103390 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1405214994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3351207891' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:50.745 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1405214994' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3351207891' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:50.746 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.035+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f44dc02cea0 con 0x7f44dc103390 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.035+0000 7f44cb7fe700 1 -- 172.21.15.31:0/1740529652 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7f44d005b640 con 0x7f44dc103390 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 52/324 objects degraded (16.049%), 16 pgs degraded 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stdout: osd.1 (root=default,host=smithi031) is down 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/324 objects degraded (16.049%), 16 pgs degraded 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:55:51.034 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-17T01:55:51.035 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-17T01:55:51.036 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-17T01:55:51.036 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-17T01:55:51.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f44c406e680 msgr2=0x7f44c4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f44c406e680 0x7f44c4070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00b6f0 tx=0x7f44cc005940 comp rx=0 tx=0).stop 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 msgr2=0x7f44dc0fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 0x7f44dc0fedf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44d000e920 tx=0x7f44d000ec30 comp rx=0 tx=0).stop 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 shutdown_connections 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f44c406e680 0x7f44c4070b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44dc069aa0 0x7f44dc1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 --2- 172.21.15.31:0/1740529652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44dc103390 0x7f44dc0fedf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 >> 172.21.15.31:0/1740529652 conn(0x7f44dc0fa7a0 msgr2=0x7f44dc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 shutdown_connections 2024-09-17T01:55:51.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:55:51.038+0000 7f44e08f1700 1 -- 172.21.15.31:0/1740529652 wait complete. 2024-09-17T01:55:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:51 smithi092 ceph-mon[64495]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:51 smithi092 ceph-mon[64495]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:51 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1740529652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:55:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:51 smithi031 ceph-mon[77274]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 52/324 objects degraded (16.049%) 2024-09-17T01:55:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:51 smithi031 ceph-mon[77274]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:55:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:51 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1740529652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:55:51.765 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:51 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T01:55:51.671+0000 7f0463f5a640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-17T01:55:52.455 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:52 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T01:55:52.182+0000 7f0463f5a640 -1 osd.1 53 log_to_monitors true 2024-09-17T01:55:52.708 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:52 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 52/324 objects degraded (16.049%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:52.708 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:52 smithi031 ceph-mon[77274]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:55:52.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:52 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 52/324 objects degraded (16.049%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:52.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:52 smithi092 ceph-mon[64495]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:55:53.640 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T01:55:53.406+0000 7f0457cec640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:55:53.640 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: pgmap v71: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/324 objects degraded (16.049%) 2024-09-17T01:55:53.640 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:55:53.640 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: osdmap e56: 6 total, 5 up, 6 in 2024-09-17T01:55:53.640 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:55:53.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:53.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:53.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:53.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:55:53.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:53.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:53 smithi031 ceph-mon[77274]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: pgmap v71: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 52/324 objects degraded (16.049%) 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: osdmap e56: 6 total, 5 up, 6 in 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:55:53.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:55:53.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:55:53.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:53 smithi092 ceph-mon[64495]: from='osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156]' entity='osd.1' 2024-09-17T01:55:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156] boot 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:55:54.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:55:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:55:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:54.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: osd.1 [v2:172.21.15.31:6810/4286741156,v1:172.21.15.31:6811/4286741156] boot 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:55:54.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:55:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:55 smithi031 ceph-mon[77274]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/324 objects degraded (16.049%) 2024-09-17T01:55:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:55 smithi031 ceph-mon[77274]: osdmap e58: 6 total, 6 up, 6 in 2024-09-17T01:55:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:55 smithi092 ceph-mon[64495]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 52/324 objects degraded (16.049%) 2024-09-17T01:55:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:55 smithi092 ceph-mon[64495]: osdmap e58: 6 total, 6 up, 6 in 2024-09-17T01:55:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:57 smithi031 ceph-mon[77274]: pgmap v76: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s; 22/324 objects degraded (6.790%) 2024-09-17T01:55:57.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:57 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 22/324 objects degraded (6.790%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:57 smithi092 ceph-mon[64495]: pgmap v76: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s; 22/324 objects degraded (6.790%) 2024-09-17T01:55:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:57 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 22/324 objects degraded (6.790%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:55:58.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:58 smithi092 ceph-mon[64495]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/324 objects degraded (6.790%), 7 pgs degraded) 2024-09-17T01:55:58.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:58 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:55:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:58 smithi031 ceph-mon[77274]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/324 objects degraded (6.790%), 7 pgs degraded) 2024-09-17T01:55:59.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:58 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:55:59.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:55:59 smithi092 ceph-mon[64495]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:56:00.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:55:59 smithi031 ceph-mon[77274]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:56:01.893 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:01 smithi092 ceph-mon[64495]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 790 B/s rd, 1 op/s 2024-09-17T01:56:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:01 smithi031 ceph-mon[77274]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 790 B/s rd, 1 op/s 2024-09-17T01:56:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:03 smithi092 ceph-mon[64495]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:04.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:03 smithi031 ceph-mon[77274]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:05 smithi092 ceph-mon[64495]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:56:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:05 smithi031 ceph-mon[77274]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:56:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:07 smithi092 ceph-mon[64495]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:56:08.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:07 smithi031 ceph-mon[77274]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:56:08.917 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:08 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:56:08.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:08 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:56:09.853 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:09 smithi031 ceph-mon[77274]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:09.853 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:09 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:56:09.853 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:09 smithi031 ceph-mon[77274]: Upgrade: osd.2 is safe to restart 2024-09-17T01:56:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:09 smithi092 ceph-mon[64495]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:09 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:56:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:09 smithi092 ceph-mon[64495]: Upgrade: osd.2 is safe to restart 2024-09-17T01:56:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:10 smithi092 ceph-mon[64495]: Upgrade: Updating osd.2 2024-09-17T01:56:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:56:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:56:11.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:10 smithi092 ceph-mon[64495]: Deploying daemon osd.2 on smithi031 2024-09-17T01:56:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:10 smithi031 ceph-mon[77274]: Upgrade: Updating osd.2 2024-09-17T01:56:11.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:11.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:56:11.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:56:11.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:10 smithi031 ceph-mon[77274]: Deploying daemon osd.2 on smithi031 2024-09-17T01:56:12.158 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:11 smithi031 ceph-mon[77274]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:11 smithi092 ceph-mon[64495]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:13.263 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:13 smithi031 systemd[1]: Stopping Ceph osd.2 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:56:13.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:13 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[53713]: 2024-09-17T01:56:13.263+0000 7f439a675700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:56:13.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:13 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[53713]: 2024-09-17T01:56:13.263+0000 7f439a675700 -1 osd.2 58 *** Got signal Terminated *** 2024-09-17T01:56:13.515 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:13 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[53713]: 2024-09-17T01:56:13.263+0000 7f439a675700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:56:14.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:13 smithi092 ceph-mon[64495]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:56:14.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:13 smithi092 ceph-mon[64495]: osd.2 marked itself down and dead 2024-09-17T01:56:14.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:13 smithi031 ceph-mon[77274]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:56:14.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:13 smithi031 ceph-mon[77274]: osd.2 marked itself down and dead 2024-09-17T01:56:14.690 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:14 smithi031 podman[89735]: 2024-09-17 01:56:14.399496918 +0000 UTC m=+1.244046637 container died b51cb1c26bc646a7db0bf92cf4b8174f3a5cd977386269c2350f5f02b8f00af1 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0) 2024-09-17T01:56:15.014 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:14 smithi031 podman[89735]: 2024-09-17 01:56:14.79812832 +0000 UTC m=+1.642677992 container cleanup b51cb1c26bc646a7db0bf92cf4b8174f3a5cd977386269c2350f5f02b8f00af1 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20231212) 2024-09-17T01:56:15.015 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:14 smithi031 bash[89735]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:56:15.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:14 smithi031 ceph-mon[77274]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:56:15.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:14 smithi031 ceph-mon[77274]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:56:15.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:14 smithi031 ceph-mon[77274]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:56:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:14 smithi092 ceph-mon[64495]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:56:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:14 smithi092 ceph-mon[64495]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:56:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:14 smithi092 ceph-mon[64495]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:56:15.384 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89750]: 2024-09-17 01:56:15.049516809 +0000 UTC m=+0.645966147 container remove b51cb1c26bc646a7db0bf92cf4b8174f3a5cd977386269c2350f5f02b8f00af1 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T01:56:15.650 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89841]: 2024-09-17 01:56:15.289421 +0000 UTC m=+0.016379492 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:56:15.650 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89841]: 2024-09-17 01:56:15.425661509 +0000 UTC m=+0.152620027 container create 8b0f667fbaf03683bf6fb96d19e0fdd88bc854e46284a13fa9f37c636c4c6b33 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-17T01:56:15.651 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89841]: 2024-09-17 01:56:15.653131884 +0000 UTC m=+0.380090369 container init 8b0f667fbaf03683bf6fb96d19e0fdd88bc854e46284a13fa9f37c636c4c6b33 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T01:56:15.918 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89841]: 2024-09-17 01:56:15.656976089 +0000 UTC m=+0.383934572 container start 8b0f667fbaf03683bf6fb96d19e0fdd88bc854e46284a13fa9f37c636c4c6b33 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:56:15.918 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89841]: 2024-09-17 01:56:15.744271362 +0000 UTC m=+0.471229839 container attach 8b0f667fbaf03683bf6fb96d19e0fdd88bc854e46284a13fa9f37c636c4c6b33 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-17T01:56:15.918 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:15 smithi031 podman[89841]: 2024-09-17 01:56:15.85745757 +0000 UTC m=+0.584416058 container died 8b0f667fbaf03683bf6fb96d19e0fdd88bc854e46284a13fa9f37c636c4c6b33 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:56:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:15 smithi092 ceph-mon[64495]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:16.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:15 smithi031 ceph-mon[77274]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:16.966 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:16 smithi031 podman[89865]: 2024-09-17 01:56:16.714624132 +0000 UTC m=+0.850791291 container remove 8b0f667fbaf03683bf6fb96d19e0fdd88bc854e46284a13fa9f37c636c4c6b33 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:56:16.966 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:16 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T01:56:16.966 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:16 smithi031 systemd[1]: Stopped Ceph osd.2 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:56:16.966 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:16 smithi031 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.2.service: Consumed 59.862s CPU time. 2024-09-17T01:56:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:16 smithi092 ceph-mon[64495]: Health check failed: Degraded data redundancy: 14/324 objects degraded (4.321%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:17.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:16 smithi031 ceph-mon[77274]: Health check failed: Degraded data redundancy: 14/324 objects degraded (4.321%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:17.265 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:16 smithi031 systemd[1]: Starting Ceph osd.2 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:56:17.265 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 podman[89962]: 2024-09-17 01:56:17.084393789 +0000 UTC m=+0.016575429 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:56:17.265 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 podman[89962]: 2024-09-17 01:56:17.199451459 +0000 UTC m=+0.131633092 container create 1cf5b38407d497ac91dba329b985e2086a0e8c1eeaa6682f2e5623cf96cb5b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:56:17.595 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 podman[89962]: 2024-09-17 01:56:17.46019854 +0000 UTC m=+0.392380181 container init 1cf5b38407d497ac91dba329b985e2086a0e8c1eeaa6682f2e5623cf96cb5b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-17T01:56:17.595 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 podman[89962]: 2024-09-17 01:56:17.464978781 +0000 UTC m=+0.397160412 container start 1cf5b38407d497ac91dba329b985e2086a0e8c1eeaa6682f2e5623cf96cb5b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T01:56:17.595 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 podman[89962]: 2024-09-17 01:56:17.526778166 +0000 UTC m=+0.458959799 container attach 1cf5b38407d497ac91dba329b985e2086a0e8c1eeaa6682f2e5623cf96cb5b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:56:17.971 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:17.971 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 bash[89962]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:17.971 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:17.971 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:17 smithi031 bash[89962]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:18.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:17 smithi092 ceph-mon[64495]: pgmap v88: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 14/324 objects degraded (4.321%) 2024-09-17T01:56:18.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:17 smithi031 ceph-mon[77274]: pgmap v88: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 14/324 objects degraded (4.321%) 2024-09-17T01:56:18.633 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:56:18.634 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:56:18.634 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:56:18.634 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:56:19.016 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate[89978]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 bash[89962]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:56:19.017 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:18 smithi031 podman[89962]: 2024-09-17 01:56:18.665999096 +0000 UTC m=+1.598180728 container died 1cf5b38407d497ac91dba329b985e2086a0e8c1eeaa6682f2e5623cf96cb5b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:56:19.640 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 podman[90114]: 2024-09-17 01:56:19.330466701 +0000 UTC m=+0.657975463 container remove 1cf5b38407d497ac91dba329b985e2086a0e8c1eeaa6682f2e5623cf96cb5b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-c2ddf97) 2024-09-17T01:56:19.640 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 podman[90175]: 2024-09-17 01:56:19.450730615 +0000 UTC m=+0.016890880 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:56:19.640 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 podman[90175]: 2024-09-17 01:56:19.548121491 +0000 UTC m=+0.114281778 container create 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:56:20.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:19 smithi031 ceph-mon[77274]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:20.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:20.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:20.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:56:20.015 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 podman[90175]: 2024-09-17 01:56:19.741995184 +0000 UTC m=+0.308155442 container init 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T01:56:20.015 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 podman[90175]: 2024-09-17 01:56:19.74545856 +0000 UTC m=+0.311618806 container start 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:56:20.015 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 ceph-osd[90194]: -- 172.21.15.31:0/1078583319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e4a6b81e0 con 0x560e498cdc00 2024-09-17T01:56:20.015 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 bash[90175]: 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 2024-09-17T01:56:20.015 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:19 smithi031 systemd[1]: Started Ceph osd.2 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:56:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:19 smithi092 ceph-mon[64495]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:20.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 -- 172.21.15.31:0/3004508066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 msgr2=0x7ff2d4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/3004508066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4100860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009910 tx=0x7ff2c4009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 -- 172.21.15.31:0/3004508066 shutdown_connections 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/3004508066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4100860 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/3004508066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d40ff150 0x7ff2d40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 -- 172.21.15.31:0/3004508066 >> 172.21.15.31:0/3004508066 conn(0x7ff2d40fa7a0 msgr2=0x7ff2d40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:21.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 -- 172.21.15.31:0/3004508066 shutdown_connections 2024-09-17T01:56:21.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 -- 172.21.15.31:0/3004508066 wait complete. 2024-09-17T01:56:21.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 Processor -- start 2024-09-17T01:56:21.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.157+0000 7ff2dc50c700 1 -- start start 2024-09-17T01:56:21.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2dc50c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d40ff150 0x7ff2d4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2dc50c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2dc50c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4196920 con 0x7ff2d41003f0 2024-09-17T01:56:21.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2dc50c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4196a60 con 0x7ff2d40ff150 2024-09-17T01:56:21.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39032/0 (socket says 172.21.15.31:39032) 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2da2a8700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d40ff150 0x7ff2d4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 -- 172.21.15.31:0/2106016147 learned_addr learned my addr 172.21.15.31:0/2106016147 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 -- 172.21.15.31:0/2106016147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d40ff150 msgr2=0x7ff2d4195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d40ff150 0x7ff2d4195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 -- 172.21.15.31:0/2106016147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40095f0 con 0x7ff2d41003f0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.158+0000 7ff2d9aa7700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4196300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b5c0 tx=0x7ff2c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.159+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c401d070 con 0x7ff2d41003f0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.159+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2c400f460 con 0x7ff2d41003f0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.159+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d419b4b0 con 0x7ff2d41003f0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.159+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c4021640 con 0x7ff2d41003f0 2024-09-17T01:56:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.159+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d419b9a0 con 0x7ff2d41003f0 2024-09-17T01:56:21.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.160+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4068ab0 con 0x7ff2d41003f0 2024-09-17T01:56:21.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.160+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff2c400fa60 con 0x7ff2d41003f0 2024-09-17T01:56:21.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.161+0000 7ff2cb7fe700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2c006e680 0x7ff2c0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.161+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff2c408f820 con 0x7ff2d41003f0 2024-09-17T01:56:21.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.161+0000 7ff2da2a8700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2c006e680 0x7ff2c0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.161+0000 7ff2da2a8700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2c006e680 0x7ff2c0070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0005950 tx=0x7ff2d000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:21.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.165+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff2c405c5a0 con 0x7ff2d41003f0 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.408+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d40694e0 con 0x7ff2c006e680 2024-09-17T01:56:21.406 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:21 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T01:56:21.392+0000 7f3cb3a9c640 -1 Falling back to public interface 2024-09-17T01:56:21.406 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:21 smithi031 ceph-mon[77274]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:21.406 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:21.406 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.409+0000 7ff2cb7fe700 1 -- 172.21.15.31:0/2106016147 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff2d40694e0 con 0x7ff2c006e680 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2c006e680 msgr2=0x7ff2c0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2c006e680 0x7ff2c0070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0005950 tx=0x7ff2d000b410 comp rx=0 tx=0).stop 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 msgr2=0x7ff2d4196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4196300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b5c0 tx=0x7ff2c400bd70 comp rx=0 tx=0).stop 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 shutdown_connections 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2c006e680 0x7ff2c0070b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d40ff150 0x7ff2d4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 --2- 172.21.15.31:0/2106016147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d41003f0 0x7ff2d4196300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 >> 172.21.15.31:0/2106016147 conn(0x7ff2d40fa7a0 msgr2=0x7ff2d4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 shutdown_connections 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.412+0000 7ff2dc50c700 1 -- 172.21.15.31:0/2106016147 wait complete. 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:56:21.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 -- 172.21.15.31:0/2790849699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 msgr2=0x7f10bc100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/2790849699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc100660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00b0a0 tx=0x7f10ac00b3b0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 -- 172.21.15.31:0/2790849699 shutdown_connections 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/2790849699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 0x7f10bc1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/2790849699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc100660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 -- 172.21.15.31:0/2790849699 >> 172.21.15.31:0/2790849699 conn(0x7f10bc0fb7e0 msgr2=0x7f10bc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 -- 172.21.15.31:0/2790849699 shutdown_connections 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.523+0000 7f10c2ffd700 1 -- 172.21.15.31:0/2790849699 wait complete. 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c2ffd700 1 Processor -- start 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c2ffd700 1 -- start start 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 0x7f10bc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c2ffd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc073680 con 0x7f10bc100250 2024-09-17T01:56:21.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c2ffd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0737c0 con 0x7f10bc101450 2024-09-17T01:56:21.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c0d99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c0d99700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39046/0 (socket says 172.21.15.31:39046) 2024-09-17T01:56:21.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c0d99700 1 -- 172.21.15.31:0/3745191156 learned_addr learned my addr 172.21.15.31:0/3745191156 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10bbfff700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 0x7f10bc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c0d99700 1 -- 172.21.15.31:0/3745191156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 msgr2=0x7f10bc073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c0d99700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 0x7f10bc073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10c0d99700 1 -- 172.21.15.31:0/3745191156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009d00 con 0x7f10bc100250 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.524+0000 7f10bbfff700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 0x7f10bc073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.525+0000 7f10c0d99700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc074af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0077b0 tx=0x7f10ac009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.525+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ac00e040 con 0x7f10bc100250 2024-09-17T01:56:21.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.525+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10ac0044f0 con 0x7f10bc100250 2024-09-17T01:56:21.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.525+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ac01d9e0 con 0x7f10bc100250 2024-09-17T01:56:21.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.525+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc073a40 con 0x7f10bc100250 2024-09-17T01:56:21.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.525+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc073f30 con 0x7f10bc100250 2024-09-17T01:56:21.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.526+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc108da0 con 0x7f10bc100250 2024-09-17T01:56:21.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.526+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f10ac004040 con 0x7f10bc100250 2024-09-17T01:56:21.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.527+0000 7f10b9ffb700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f10a806e680 0x7f10a8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.527+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f10ac090060 con 0x7f10bc100250 2024-09-17T01:56:21.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.527+0000 7f10bbfff700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f10a806e680 0x7f10a8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.527+0000 7f10bbfff700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f10a806e680 0x7f10a8070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10a4005d90 tx=0x7f10a4005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:21.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.531+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f10ac05cd80 con 0x7f10bc100250 2024-09-17T01:56:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:21 smithi092 ceph-mon[64495]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:21.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.798+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10bc19dfc0 con 0x7f10a806e680 2024-09-17T01:56:21.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.799+0000 7f10b9ffb700 1 -- 172.21.15.31:0/3745191156 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f10bc19dfc0 con 0x7f10a806e680 2024-09-17T01:56:21.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f10a806e680 msgr2=0x7f10a8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f10a806e680 0x7f10a8070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10a4005d90 tx=0x7f10a4005d00 comp rx=0 tx=0).stop 2024-09-17T01:56:21.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 msgr2=0x7f10bc074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc074af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0077b0 tx=0x7f10ac009810 comp rx=0 tx=0).stop 2024-09-17T01:56:21.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 shutdown_connections 2024-09-17T01:56:21.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f10a806e680 0x7f10a8070b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10bc100250 0x7f10bc074af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 --2- 172.21.15.31:0/3745191156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10bc101450 0x7f10bc073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.801+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 >> 172.21.15.31:0/3745191156 conn(0x7f10bc0fb7e0 msgr2=0x7f10bc104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:21.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.802+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 shutdown_connections 2024-09-17T01:56:21.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.802+0000 7f10c2ffd700 1 -- 172.21.15.31:0/3745191156 wait complete. 2024-09-17T01:56:21.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.910+0000 7f1de8c30700 1 -- 172.21.15.31:0/1091196707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 msgr2=0x7f1de40ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.910+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1091196707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de40ff550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009910 tx=0x7f1dd4009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:21.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 -- 172.21.15.31:0/1091196707 shutdown_connections 2024-09-17T01:56:21.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1091196707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 0x7f1de4100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1091196707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de40ff550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 -- 172.21.15.31:0/1091196707 >> 172.21.15.31:0/1091196707 conn(0x7f1de40fa6d0 msgr2=0x7f1de40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:21.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 -- 172.21.15.31:0/1091196707 shutdown_connections 2024-09-17T01:56:21.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 -- 172.21.15.31:0/1091196707 wait complete. 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 Processor -- start 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.911+0000 7f1de8c30700 1 -- start start 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de8c30700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de4195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de8c30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 0x7f1de4196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de8c30700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de41966b0 con 0x7f1de40ff140 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de8c30700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de41967f0 con 0x7f1de4100340 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de4195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de4195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39070/0 (socket says 172.21.15.31:39070) 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 -- 172.21.15.31:0/1701708488 learned_addr learned my addr 172.21.15.31:0/1701708488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de1d9b700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 0x7f1de4196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 -- 172.21.15.31:0/1701708488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 msgr2=0x7f1de4196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 0x7f1de4196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 -- 172.21.15.31:0/1701708488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40095f0 con 0x7f1de40ff140 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de1d9b700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 0x7f1de4196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1de259c700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de4195b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400bd70 tx=0x7f1dd400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.912+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd401d070 con 0x7f1de40ff140 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.913+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de419b240 con 0x7f1de40ff140 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.913+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1dd400f460 con 0x7f1de40ff140 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.913+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd4021640 con 0x7f1de40ff140 2024-09-17T01:56:21.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.913+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de419b730 con 0x7f1de40ff140 2024-09-17T01:56:21.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.914+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de4107d10 con 0x7f1de40ff140 2024-09-17T01:56:21.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.914+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1dd400fab0 con 0x7f1de40ff140 2024-09-17T01:56:21.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.915+0000 7f1dd37fe700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1dcc06e680 0x7f1dcc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:21.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.915+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1dd408fa70 con 0x7f1de40ff140 2024-09-17T01:56:21.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.915+0000 7f1de1d9b700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1dcc06e680 0x7f1dcc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:21.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.915+0000 7f1de1d9b700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1dcc06e680 0x7f1dcc070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8007900 tx=0x7f1dd8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:21.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:21.919+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1dd405c7f0 con 0x7f1de40ff140 2024-09-17T01:56:22.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.151+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1de419bd70 con 0x7f1dcc06e680 2024-09-17T01:56:22.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.161+0000 7f1dd37fe700 1 -- 172.21.15.31:0/1701708488 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f1de419bd70 con 0x7f1dcc06e680 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (11m) 32s ago 12m 24.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (12m) 32s ago 12m 8250k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (11m) 90s ago 11m 7889k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (98s) 32s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (93s) 90s ago 11m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:56:22.159 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (10m) 32s ago 12m 87.0M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (6m) 32s ago 6m 62.9M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (7m) 32s ago 7m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (6m) 90s ago 6m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (7m) 90s ago 7m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (3m) 32s ago 13m 499M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (2m) 90s ago 11m 439M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (2m) 32s ago 14m 45.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (2m) 90s ago 11m 34.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (12m) 32s ago 12m 17.2M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (11m) 90s ago 11m 15.2M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (73s) 32s ago 10m 89.3M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (38s) 32s ago 10m 12.0M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:56:22.160 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 starting - - - 1217M 2024-09-17T01:56:22.161 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (9m) 90s ago 9m 263M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:56:22.161 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (8m) 90s ago 8m 236M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:56:22.161 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (8m) 90s ago 8m 221M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:56:22.161 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (3m) 32s ago 12m 69.3M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:56:22.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1dcc06e680 msgr2=0x7f1dcc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1dcc06e680 0x7f1dcc070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8007900 tx=0x7f1dd8008040 comp rx=0 tx=0).stop 2024-09-17T01:56:22.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 msgr2=0x7f1de4195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de4195b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400bd70 tx=0x7f1dd400be50 comp rx=0 tx=0).stop 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 shutdown_connections 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1dcc06e680 0x7f1dcc070b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1de40ff140 0x7f1de4195b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 --2- 172.21.15.31:0/1701708488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1de4100340 0x7f1de4196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 >> 172.21.15.31:0/1701708488 conn(0x7f1de40fa6d0 msgr2=0x7f1de4068e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 shutdown_connections 2024-09-17T01:56:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.163+0000 7f1de8c30700 1 -- 172.21.15.31:0/1701708488 wait complete. 2024-09-17T01:56:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 -- 172.21.15.31:0/818119927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5458100060 msgr2=0x7f54581004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 --2- 172.21.15.31:0/818119927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5458100060 0x7f54581004d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f544c009910 tx=0x7f544c009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 -- 172.21.15.31:0/818119927 shutdown_connections 2024-09-17T01:56:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 --2- 172.21.15.31:0/818119927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5458100060 0x7f54581004d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 --2- 172.21.15.31:0/818119927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54580ff710 0x7f54580ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 -- 172.21.15.31:0/818119927 >> 172.21.15.31:0/818119927 conn(0x7f54580f9f10 msgr2=0x7f54580fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:22.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 -- 172.21.15.31:0/818119927 shutdown_connections 2024-09-17T01:56:22.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 -- 172.21.15.31:0/818119927 wait complete. 2024-09-17T01:56:22.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 Processor -- start 2024-09-17T01:56:22.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.275+0000 7f545e89d700 1 -- start start 2024-09-17T01:56:22.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f545e89d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 0x7f5458103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:22.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f545e89d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5458100060 0x7f54581018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f545e89d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458101de0 con 0x7f54580ff710 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f545e89d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458101f20 con 0x7f5458100060 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f5457fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 0x7f5458103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f5457fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 0x7f5458103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39080/0 (socket says 172.21.15.31:39080) 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f5457fff700 1 -- 172.21.15.31:0/3272338637 learned_addr learned my addr 172.21.15.31:0/3272338637 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f54577fe700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5458100060 0x7f54581018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f5457fff700 1 -- 172.21.15.31:0/3272338637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5458100060 msgr2=0x7f54581018a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f5457fff700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5458100060 0x7f54581018a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f5457fff700 1 -- 172.21.15.31:0/3272338637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0095f0 con 0x7f54580ff710 2024-09-17T01:56:22.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.276+0000 7f54577fe700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5458100060 0x7f54581018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:56:22.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.277+0000 7f5457fff700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 0x7f5458103250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f544800d8d0 tx=0x7f544800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:22.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.277+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5448009940 con 0x7f54580ff710 2024-09-17T01:56:22.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.277+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5448010460 con 0x7f54580ff710 2024-09-17T01:56:22.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.277+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544800f5f0 con 0x7f54580ff710 2024-09-17T01:56:22.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.278+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5458102200 con 0x7f54580ff710 2024-09-17T01:56:22.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.278+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545819dae0 con 0x7f54580ff710 2024-09-17T01:56:22.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.279+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5458107c10 con 0x7f54580ff710 2024-09-17T01:56:22.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.279+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f54480105d0 con 0x7f54580ff710 2024-09-17T01:56:22.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.280+0000 7f54557fa700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f544006e680 0x7f5440070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:22.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.280+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f544808e4d0 con 0x7f54580ff710 2024-09-17T01:56:22.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.280+0000 7f54577fe700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f544006e680 0x7f5440070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:22.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.280+0000 7f54577fe700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f544006e680 0x7f5440070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f544c00b5c0 tx=0x7f544c005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:22.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.284+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f544805b2d0 con 0x7f54580ff710 2024-09-17T01:56:22.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.603+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f545819e090 con 0x7f54580ff710 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.604+0000 7f54557fa700 1 -- 172.21.15.31:0/3272338637 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f544805ae60 con 0x7f54580ff710 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:22.602 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:56:22.603 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:56:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.606+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f544006e680 msgr2=0x7f5440070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.606+0000 7f545e89d700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f544006e680 0x7f5440070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f544c00b5c0 tx=0x7f544c005e20 comp rx=0 tx=0).stop 2024-09-17T01:56:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.606+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 msgr2=0x7f5458103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.606+0000 7f545e89d700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 0x7f5458103250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f544800d8d0 tx=0x7f544800dc90 comp rx=0 tx=0).stop 2024-09-17T01:56:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 shutdown_connections 2024-09-17T01:56:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f544006e680 0x7f5440070b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54580ff710 0x7f5458103250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 --2- 172.21.15.31:0/3272338637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5458100060 0x7f54581018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 >> 172.21.15.31:0/3272338637 conn(0x7f54580f9f10 msgr2=0x7f54580fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 shutdown_connections 2024-09-17T01:56:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.607+0000 7f545e89d700 1 -- 172.21.15.31:0/3272338637 wait complete. 2024-09-17T01:56:22.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.715+0000 7f07c6bcb700 1 -- 172.21.15.31:0/4155991869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0103370 msgr2=0x7f07c01057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.715+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/4155991869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0103370 0x7f07c01057b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009910 tx=0x7f07ac009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- 172.21.15.31:0/4155991869 shutdown_connections 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/4155991869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0103370 0x7f07c01057b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/4155991869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07c0069ac0 0x7f07c0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- 172.21.15.31:0/4155991869 >> 172.21.15.31:0/4155991869 conn(0x7f07c00fa7a0 msgr2=0x7f07c00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- 172.21.15.31:0/4155991869 shutdown_connections 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- 172.21.15.31:0/4155991869 wait complete. 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 Processor -- start 2024-09-17T01:56:22.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- start start 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 0x7f07c0195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07c0103370 0x7f07c0196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0196950 con 0x7f07c0069ac0 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.716+0000 7f07c6bcb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0196a90 con 0x7f07c0103370 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 0x7f07c0195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 0x7f07c0195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39092/0 (socket says 172.21.15.31:39092) 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 -- 172.21.15.31:0/3515879161 learned_addr learned my addr 172.21.15.31:0/3515879161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07bffff700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07c0103370 0x7f07c0196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 -- 172.21.15.31:0/3515879161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07c0103370 msgr2=0x7f07c0196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07c0103370 0x7f07c0196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 -- 172.21.15.31:0/3515879161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac0095f0 con 0x7f07c0069ac0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c4967700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 0x7f07c0195df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c8f0 tx=0x7f07b400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b40041f0 con 0x7f07c0069ac0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07b4004350 con 0x7f07c0069ac0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c019b540 con 0x7f07c0069ac0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.717+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07b4003c30 con 0x7f07c0069ac0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.718+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c019ba90 con 0x7f07c0069ac0 2024-09-17T01:56:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.718+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c018fc10 con 0x7f07c0069ac0 2024-09-17T01:56:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.719+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f07b40076d0 con 0x7f07c0069ac0 2024-09-17T01:56:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.719+0000 7f07bdffb700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f07b006e680 0x7f07b0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.719+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f07b408dd80 con 0x7f07c0069ac0 2024-09-17T01:56:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.719+0000 7f07bffff700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f07b006e680 0x7f07b0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.720+0000 7f07bffff700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f07b006e680 0x7f07b0070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07ac006010 tx=0x7f07ac00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:22.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.724+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07b405ab80 con 0x7f07c0069ac0 2024-09-17T01:56:22.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.994+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f07c0061960 con 0x7f07c0069ac0 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.995+0000 7f07bdffb700 1 -- 172.21.15.31:0/3515879161 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1969 (secure 0 0 0) 0x7f07b401d070 con 0x7f07c0069ac0 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:e18 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:56:21:979504+0000 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:56:22.993 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 18 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:56:21.979501+0000 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:56:22.994 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:56:22.995 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 14464 members: 14464,24269 2024-09-17T01:56:22.996 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:22.996 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:22.996 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:22.996 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:22.996 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:56:22.996 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.997+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f07b006e680 msgr2=0x7f07b0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.997+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f07b006e680 0x7f07b0070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07ac006010 tx=0x7f07ac00b540 comp rx=0 tx=0).stop 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.997+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 msgr2=0x7f07c0195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.997+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 0x7f07c0195df0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c8f0 tx=0x7f07b400cc00 comp rx=0 tx=0).stop 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 shutdown_connections 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f07b006e680 0x7f07b0070b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07c0069ac0 0x7f07c0195df0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 --2- 172.21.15.31:0/3515879161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07c0103370 0x7f07c0196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 >> 172.21.15.31:0/3515879161 conn(0x7f07c00fa7a0 msgr2=0x7f07c00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 shutdown_connections 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:22.998+0000 7f07c6bcb700 1 -- 172.21.15.31:0/3515879161 wait complete. 2024-09-17T01:56:22.997 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-09-17T01:56:23.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 -- 172.21.15.31:0/929852104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c069270 msgr2=0x7fa00c102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 --2- 172.21.15.31:0/929852104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c069270 0x7fa00c102dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009910 tx=0x7f9ffc009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 -- 172.21.15.31:0/929852104 shutdown_connections 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 --2- 172.21.15.31:0/929852104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa00c103310 0x7fa00c105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 --2- 172.21.15.31:0/929852104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c069270 0x7fa00c102dd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 -- 172.21.15.31:0/929852104 >> 172.21.15.31:0/929852104 conn(0x7fa00c0fa780 msgr2=0x7fa00c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 -- 172.21.15.31:0/929852104 shutdown_connections 2024-09-17T01:56:23.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 -- 172.21.15.31:0/929852104 wait complete. 2024-09-17T01:56:23.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.110+0000 7fa0121c5700 1 Processor -- start 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa0121c5700 1 -- start start 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa0121c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa00c103310 0x7fa00c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa0121c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 0x7fa00c19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa0121c5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c196500 con 0x7fa00c196000 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa0121c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c196670 con 0x7fa00c103310 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 0x7fa00c19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 0x7fa00c19b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39102/0 (socket says 172.21.15.31:39102) 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00affd700 1 -- 172.21.15.31:0/124929935 learned_addr learned my addr 172.21.15.31:0/124929935 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00b7fe700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa00c103310 0x7fa00c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00affd700 1 -- 172.21.15.31:0/124929935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa00c103310 msgr2=0x7fa00c195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00affd700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa00c103310 0x7fa00c195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.111+0000 7fa00affd700 1 -- 172.21.15.31:0/124929935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc0095f0 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.112+0000 7fa00affd700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 0x7fa00c19b070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e920 tx=0x7fa00000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.112+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00000c9d0 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.112+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c19b610 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.112+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa000010430 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.112+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa000018650 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.112+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c19bb30 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.113+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c18fbd0 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.113+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa0000105a0 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.114+0000 7fa008ff9700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ff406e680 0x7f9ff4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.114+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa000014070 con 0x7fa00c196000 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.114+0000 7fa00b7fe700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ff406e680 0x7f9ff4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:23.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.114+0000 7fa00b7fe700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ff406e680 0x7f9ff4070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00b6f0 tx=0x7f9ffc005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:23.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.118+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa0000541b0 con 0x7fa00c196000 2024-09-17T01:56:23.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:22 smithi092 ceph-mon[64495]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:23.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:22 smithi092 ceph-mon[64495]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:23.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:22 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:56:23.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:22 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 38/324 objects degraded (11.728%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:23.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:22 smithi092 ceph-mon[64495]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:23.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:22 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3272338637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:23.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:22 smithi031 ceph-mon[77274]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:23.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:22 smithi031 ceph-mon[77274]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:23.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:22 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:56:23.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:22 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 38/324 objects degraded (11.728%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:23.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:22 smithi031 ceph-mon[77274]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:23.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:22 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3272338637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:23.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.369+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa00c02ce70 con 0x7f9ff406e680 2024-09-17T01:56:23.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.370+0000 7fa008ff9700 1 -- 172.21.15.31:0/124929935 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa00c02ce70 con 0x7f9ff406e680 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:56:23.368 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:56:23.369 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:56:23.369 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:56:23.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ff406e680 msgr2=0x7f9ff4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ff406e680 0x7f9ff4070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00b6f0 tx=0x7f9ffc005940 comp rx=0 tx=0).stop 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 msgr2=0x7fa00c19b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 0x7fa00c19b070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa00000e920 tx=0x7fa00000ec30 comp rx=0 tx=0).stop 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 shutdown_connections 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ff406e680 0x7f9ff4070b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa00c103310 0x7fa00c195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 --2- 172.21.15.31:0/124929935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa00c196000 0x7fa00c19b070 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.372+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 >> 172.21.15.31:0/124929935 conn(0x7fa00c0fa780 msgr2=0x7fa00c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.373+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 shutdown_connections 2024-09-17T01:56:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.373+0000 7fa0121c5700 1 -- 172.21.15.31:0/124929935 wait complete. 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.481+0000 7fd6f44f6700 1 -- 172.21.15.31:0/4257241962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 msgr2=0x7fd6ec100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.481+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/4257241962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec100790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009910 tx=0x7fd6dc009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 -- 172.21.15.31:0/4257241962 shutdown_connections 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/4257241962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec100790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/4257241962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ff140 0x7fd6ec0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 -- 172.21.15.31:0/4257241962 >> 172.21.15.31:0/4257241962 conn(0x7fd6ec0fa6d0 msgr2=0x7fd6ec0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 -- 172.21.15.31:0/4257241962 shutdown_connections 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 -- 172.21.15.31:0/4257241962 wait complete. 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 Processor -- start 2024-09-17T01:56:23.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 -- start start 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.482+0000 7fd6f44f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ff140 0x7fd6ec195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f44f6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f44f6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1965a0 con 0x7fd6ec100340 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f44f6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1966e0 con 0x7fd6ec0ff140 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56118/0 (socket says 172.21.15.31:56118) 2024-09-17T01:56:23.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 -- 172.21.15.31:0/198447766 learned_addr learned my addr 172.21.15.31:0/198447766 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f2292700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ff140 0x7fd6ec195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 -- 172.21.15.31:0/198447766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ff140 msgr2=0x7fd6ec195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ff140 0x7fd6ec195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 -- 172.21.15.31:0/198447766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0095f0 con 0x7fd6ec100340 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f1a91700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec196010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc005b40 tx=0x7fd6dc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc01d070 con 0x7fd6ec100340 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6dc022470 con 0x7fd6ec100340 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec19b140 con 0x7fd6ec100340 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.483+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc00f690 con 0x7fd6ec100340 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.484+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec19b600 con 0x7fd6ec100340 2024-09-17T01:56:23.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.485+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec108d90 con 0x7fd6ec100340 2024-09-17T01:56:23.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.485+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd6dc022a10 con 0x7fd6ec100340 2024-09-17T01:56:23.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.485+0000 7fd6e37fe700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd6d806e680 0x7fd6d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:23.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.486+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd6dc08fac0 con 0x7fd6ec100340 2024-09-17T01:56:23.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.486+0000 7fd6f2292700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd6d806e680 0x7fd6d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:23.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.486+0000 7fd6f2292700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd6d806e680 0x7fd6d8070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec1001a0 tx=0x7fd6e800a3b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.490+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd6dc05c970 con 0x7fd6ec100340 2024-09-17T01:56:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.810+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd6ec108f50 con 0x7fd6ec100340 2024-09-17T01:56:23.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.810+0000 7fd6e37fe700 1 -- 172.21.15.31:0/198447766 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+941 (secure 0 0 0) 0x7fd6dc027090 con 0x7fd6ec100340 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 38/324 objects degraded (11.728%), 12 pgs degraded 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: osd.2 (root=default,host=smithi031) is down 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/324 objects degraded (11.728%), 12 pgs degraded 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-17T01:56:23.809 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-17T01:56:23.810 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-17T01:56:23.810 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-17T01:56:23.810 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-17T01:56:23.810 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-17T01:56:23.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd6d806e680 msgr2=0x7fd6d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd6d806e680 0x7fd6d8070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec1001a0 tx=0x7fd6e800a3b0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 msgr2=0x7fd6ec196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec196010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc005b40 tx=0x7fd6dc00bd70 comp rx=0 tx=0).stop 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 shutdown_connections 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd6d806e680 0x7fd6d8070b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6ec0ff140 0x7fd6ec195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 --2- 172.21.15.31:0/198447766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6ec100340 0x7fd6ec196010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 >> 172.21.15.31:0/198447766 conn(0x7fd6ec0fa6d0 msgr2=0x7fd6ec103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 shutdown_connections 2024-09-17T01:56:23.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:23.813+0000 7fd6f44f6700 1 -- 172.21.15.31:0/198447766 wait complete. 2024-09-17T01:56:24.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:23 smithi092 ceph-mon[64495]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:24.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:23 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3515879161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:56:24.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:23 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/198447766' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:56:24.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:23 smithi031 ceph-mon[77274]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:24.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:23 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3515879161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:56:24.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:23 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/198447766' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:56:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:24 smithi031 ceph-mon[77274]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:25.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:24 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:56:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:25 smithi092 ceph-mon[64495]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:25.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:25 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby-replay 2024-09-17T01:56:26.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:26 smithi031 ceph-mon[77274]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:26.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:26 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:26 smithi092 ceph-mon[64495]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:26 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:27.207 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:26 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T01:56:26.909+0000 7f3cb3a9c640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-17T01:56:27.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:27 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T01:56:27.308+0000 7f3cb3a9c640 -1 osd.2 58 log_to_monitors true 2024-09-17T01:56:28.385 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 01:56:28 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T01:56:28.077+0000 7f3cab836640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:56:28.386 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:28 smithi031 ceph-mon[77274]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 38/324 objects degraded (11.728%) 2024-09-17T01:56:28.386 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:28 smithi031 ceph-mon[77274]: from='osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:56:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:28 smithi092 ceph-mon[64495]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 38/324 objects degraded (11.728%) 2024-09-17T01:56:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:28 smithi092 ceph-mon[64495]: from='osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:56:29.425 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:56:29.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: osdmap e61: 6 total, 5 up, 6 in 2024-09-17T01:56:29.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:56:29.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:29.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:29.426 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:56:29.427 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:56:29.427 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:29.427 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:56:29.427 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:29.427 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:29.428 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:29.428 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:29 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: osdmap e61: 6 total, 5 up, 6 in 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:56:29.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:56:29.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:29.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:56:29.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:29.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:29.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:29.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:29 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 38/324 objects degraded (11.728%) 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912] boot 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:56:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:56:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 38/324 objects degraded (11.728%) 2024-09-17T01:56:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:56:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:56:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: osd.2 [v2:172.21.15.31:6818/538281912,v1:172.21.15.31:6819/538281912] boot 2024-09-17T01:56:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:56:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:56:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:31 smithi092 ceph-mon[64495]: osdmap e63: 6 total, 6 up, 6 in 2024-09-17T01:56:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:31 smithi031 ceph-mon[77274]: osdmap e63: 6 total, 6 up, 6 in 2024-09-17T01:56:32.368 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:32 smithi031 ceph-mon[77274]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 38/324 objects degraded (11.728%) 2024-09-17T01:56:32.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:32 smithi092 ceph-mon[64495]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 38/324 objects degraded (11.728%) 2024-09-17T01:56:33.389 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:33 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 24/324 objects degraded (7.407%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:33.503 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:33 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 24/324 objects degraded (7.407%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:34 smithi092 ceph-mon[64495]: pgmap v99: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 24/324 objects degraded (7.407%) 2024-09-17T01:56:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:34 smithi031 ceph-mon[77274]: pgmap v99: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 24/324 objects degraded (7.407%) 2024-09-17T01:56:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:35 smithi092 ceph-mon[64495]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/324 objects degraded (7.407%), 7 pgs degraded) 2024-09-17T01:56:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:35 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:56:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:35 smithi031 ceph-mon[77274]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/324 objects degraded (7.407%), 7 pgs degraded) 2024-09-17T01:56:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:35 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:56:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:36 smithi092 ceph-mon[64495]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-17T01:56:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:36 smithi031 ceph-mon[77274]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-17T01:56:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:38 smithi092 ceph-mon[64495]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:56:38.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:38 smithi031 ceph-mon[77274]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:56:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:40 smithi092 ceph-mon[64495]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:40.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:40 smithi031 ceph-mon[77274]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:41.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:41 smithi092 ceph-mon[64495]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:56:41.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:41.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:41 smithi031 ceph-mon[77274]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:56:41.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:43 smithi092 ceph-mon[64495]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:56:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:43 smithi031 ceph-mon[77274]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:56:44.613 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:44.613 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:44 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:44.613 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:44 smithi092 ceph-mon[64495]: Upgrade: osd.3 is safe to restart 2024-09-17T01:56:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:44 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:56:44.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:44 smithi031 ceph-mon[77274]: Upgrade: osd.3 is safe to restart 2024-09-17T01:56:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:45 smithi092 ceph-mon[64495]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:45 smithi031 ceph-mon[77274]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:46.660 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:46 smithi092 ceph-mon[64495]: Upgrade: Updating osd.3 2024-09-17T01:56:46.660 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:46.660 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:56:46.660 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:56:46.660 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:46 smithi092 ceph-mon[64495]: Deploying daemon osd.3 on smithi092 2024-09-17T01:56:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:46 smithi031 ceph-mon[77274]: Upgrade: Updating osd.3 2024-09-17T01:56:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:56:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:56:46.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:46 smithi031 ceph-mon[77274]: Deploying daemon osd.3 on smithi092 2024-09-17T01:56:47.482 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:47 smithi092 ceph-mon[64495]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:56:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:47 smithi031 ceph-mon[77274]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:56:48.499 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:48 smithi092 systemd[1]: Stopping Ceph osd.3 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:56:48.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:48 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[39504]: 2024-09-17T01:56:48.525+0000 7f1afb20a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:56:48.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:48 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[39504]: 2024-09-17T01:56:48.525+0000 7f1afb20a700 -1 osd.3 63 *** Got signal Terminated *** 2024-09-17T01:56:48.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:48 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[39504]: 2024-09-17T01:56:48.525+0000 7f1afb20a700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:56:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:49 smithi092 ceph-mon[64495]: pgmap v107: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:49 smithi092 ceph-mon[64495]: osd.3 marked itself down and dead 2024-09-17T01:56:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:49 smithi031 ceph-mon[77274]: pgmap v107: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:49 smithi031 ceph-mon[77274]: osd.3 marked itself down and dead 2024-09-17T01:56:50.074 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:49 smithi092 podman[69198]: 2024-09-17 01:56:49.801545564 +0000 UTC m=+1.384111435 container died 55e9e7da68152a09cfd0d1681cceacc593b92dd0ba992b1245ccb15d2608ecd7 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-17T01:56:50.431 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:50 smithi092 podman[69198]: 2024-09-17 01:56:50.167419429 +0000 UTC m=+1.749985298 container cleanup 55e9e7da68152a09cfd0d1681cceacc593b92dd0ba992b1245ccb15d2608ecd7 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2024-09-17T01:56:50.431 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:50 smithi092 bash[69198]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:56:50.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.8", "id": [1, 3]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]: dispatch 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:50.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:50.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-09-17T01:56:50.739 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:50 smithi092 podman[69216]: 2024-09-17 01:56:50.43562491 +0000 UTC m=+0.627956100 container remove 55e9e7da68152a09cfd0d1681cceacc593b92dd0ba992b1245ccb15d2608ecd7 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:56:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:56:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:56:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.8", "id": [1, 3]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:56:50.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 2]}]': finished 2024-09-17T01:56:51.053 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:50 smithi092 podman[69305]: 2024-09-17 01:56:50.688351437 +0000 UTC m=+0.016114565 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:56:51.054 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:50 smithi092 podman[69305]: 2024-09-17 01:56:50.794914915 +0000 UTC m=+0.122678087 container create 5915fdbb4d6962f86afedf71ea7026c7daf7ec39be2b9ed120c796509b4fddf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:56:51.054 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 podman[69305]: 2024-09-17 01:56:51.056225043 +0000 UTC m=+0.383988170 container init 5915fdbb4d6962f86afedf71ea7026c7daf7ec39be2b9ed120c796509b4fddf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T01:56:51.432 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 podman[69305]: 2024-09-17 01:56:51.059521607 +0000 UTC m=+0.387284735 container start 5915fdbb4d6962f86afedf71ea7026c7daf7ec39be2b9ed120c796509b4fddf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_CLEAN=True) 2024-09-17T01:56:51.432 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 podman[69305]: 2024-09-17 01:56:51.156408748 +0000 UTC m=+0.484171878 container attach 5915fdbb4d6962f86afedf71ea7026c7daf7ec39be2b9ed120c796509b4fddf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-17T01:56:51.432 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 podman[69305]: 2024-09-17 01:56:51.243080625 +0000 UTC m=+0.570843755 container died 5915fdbb4d6962f86afedf71ea7026c7daf7ec39be2b9ed120c796509b4fddf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]': finished 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]': finished 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]': finished 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.8", "id": [1, 3]}]': finished 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]': finished 2024-09-17T01:56:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:56:51.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:51 smithi092 ceph-mon[64495]: osdmap e66: 6 total, 5 up, 6 in 2024-09-17T01:56:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: pgmap v109: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 3]}]': finished 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 2]}]': finished 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 2]}]': finished 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 3]}]': finished 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.8", "id": [1, 3]}]': finished 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]': finished 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:56:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:51 smithi031 ceph-mon[77274]: osdmap e66: 6 total, 5 up, 6 in 2024-09-17T01:56:52.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 podman[69329]: 2024-09-17 01:56:51.818876541 +0000 UTC m=+0.566844770 container remove 5915fdbb4d6962f86afedf71ea7026c7daf7ec39be2b9ed120c796509b4fddf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:56:52.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T01:56:52.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 systemd[1]: Stopped Ceph osd.3 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:56:52.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:51 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 15.048s CPU time. 2024-09-17T01:56:52.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 systemd[1]: Starting Ceph osd.3 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:56:52.536 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 podman[69428]: 2024-09-17 01:56:52.151042292 +0000 UTC m=+0.015370861 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:56:52.536 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 podman[69428]: 2024-09-17 01:56:52.303311148 +0000 UTC m=+0.167639699 container create 830114189a0cd7054b9c88711cde117b2fa54d9d56207edefd259edc0a97cf1e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T01:56:52.537 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 podman[69428]: 2024-09-17 01:56:52.539248582 +0000 UTC m=+0.403577151 container init 830114189a0cd7054b9c88711cde117b2fa54d9d56207edefd259edc0a97cf1e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:56:52.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 podman[69428]: 2024-09-17 01:56:52.542662676 +0000 UTC m=+0.406991227 container start 830114189a0cd7054b9c88711cde117b2fa54d9d56207edefd259edc0a97cf1e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T01:56:52.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 podman[69428]: 2024-09-17 01:56:52.630850131 +0000 UTC m=+0.495178699 container attach 830114189a0cd7054b9c88711cde117b2fa54d9d56207edefd259edc0a97cf1e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T01:56:52.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:52.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 bash[69428]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:52.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:52.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:52 smithi092 bash[69428]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:56:53.691 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-mon[64495]: pgmap v112: 65 pgs: 1 unknown, 7 active+undersized, 6 stale+active+clean, 9 active+undersized+degraded, 42 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:53.692 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-mon[64495]: osdmap e67: 6 total, 5 up, 6 in 2024-09-17T01:56:53.692 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-mon[64495]: Health check failed: Degraded data redundancy: 38/324 objects degraded (11.728%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:53.692 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:56:53.692 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:56:53.692 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:56:53.692 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:56:53.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:53 smithi031 ceph-mon[77274]: pgmap v112: 65 pgs: 1 unknown, 7 active+undersized, 6 stale+active+clean, 9 active+undersized+degraded, 42 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 38/324 objects degraded (11.728%) 2024-09-17T01:56:53.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:53 smithi031 ceph-mon[77274]: osdmap e67: 6 total, 5 up, 6 in 2024-09-17T01:56:53.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:53 smithi031 ceph-mon[77274]: Health check failed: Degraded data redundancy: 38/324 objects degraded (11.728%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 -- 172.21.15.31:0/3090856600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c100240 msgr2=0x7f012c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 --2- 172.21.15.31:0/3090856600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c100240 0x7f012c100650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f011c009910 tx=0x7f011c009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 -- 172.21.15.31:0/3090856600 shutdown_connections 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 --2- 172.21.15.31:0/3090856600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f012c101440 0x7f012c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 --2- 172.21.15.31:0/3090856600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c100240 0x7f012c100650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 -- 172.21.15.31:0/3090856600 >> 172.21.15.31:0/3090856600 conn(0x7f012c0fb7f0 msgr2=0x7f012c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 -- 172.21.15.31:0/3090856600 shutdown_connections 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.929+0000 7f0132467700 1 -- 172.21.15.31:0/3090856600 wait complete. 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f0132467700 1 Processor -- start 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f0132467700 1 -- start start 2024-09-17T01:56:53.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f0132467700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f012c100240 0x7f012c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f0132467700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 0x7f012c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f0132467700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c196610 con 0x7f012c101440 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f0132467700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c196750 con 0x7f012c100240 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f012b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 0x7f012c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f012b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 0x7f012c195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35926/0 (socket says 172.21.15.31:35926) 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f012b7fe700 1 -- 172.21.15.31:0/1203511753 learned_addr learned my addr 172.21.15.31:0/1203511753 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.930+0000 7f012bfff700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f012c100240 0x7f012c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f012b7fe700 1 -- 172.21.15.31:0/1203511753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f012c100240 msgr2=0x7f012c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f012b7fe700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f012c100240 0x7f012c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f012b7fe700 1 -- 172.21.15.31:0/1203511753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0095f0 con 0x7f012c101440 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f012b7fe700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 0x7f012c195ff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f012000e920 tx=0x7f012000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012000c9d0 con 0x7f012c101440 2024-09-17T01:56:53.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0120010430 con 0x7f012c101440 2024-09-17T01:56:53.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c19b200 con 0x7f012c101440 2024-09-17T01:56:53.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0120018650 con 0x7f012c101440 2024-09-17T01:56:53.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.931+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c19b750 con 0x7f012c101440 2024-09-17T01:56:53.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.932+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c108d90 con 0x7f012c101440 2024-09-17T01:56:53.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.932+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f01200105a0 con 0x7f012c101440 2024-09-17T01:56:53.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.933+0000 7f01297fa700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f011406e680 0x7f0114070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:53.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.933+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0120014070 con 0x7f012c101440 2024-09-17T01:56:53.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.933+0000 7f012bfff700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f011406e680 0x7f0114070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:53.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.933+0000 7f012bfff700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f011406e680 0x7f0114070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f011c009fd0 tx=0x7f011c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:53.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:53.937+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f01200541b0 con 0x7f012c101440 2024-09-17T01:56:53.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:56:53.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:56:53.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:56:53.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate[69443]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 bash[69428]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:56:53.990 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:53 smithi092 podman[69428]: 2024-09-17 01:56:53.721363536 +0000 UTC m=+1.585692098 container died 830114189a0cd7054b9c88711cde117b2fa54d9d56207edefd259edc0a97cf1e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-17T01:56:54.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.182+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f012c105d90 con 0x7f011406e680 2024-09-17T01:56:54.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.183+0000 7f01297fa700 1 -- 172.21.15.31:0/1203511753 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f012c105d90 con 0x7f011406e680 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f011406e680 msgr2=0x7f0114070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f011406e680 0x7f0114070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f011c009fd0 tx=0x7f011c005a90 comp rx=0 tx=0).stop 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 msgr2=0x7f012c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 0x7f012c195ff0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f012000e920 tx=0x7f012000ec30 comp rx=0 tx=0).stop 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 shutdown_connections 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f011406e680 0x7f0114070b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f012c100240 0x7f012c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 --2- 172.21.15.31:0/1203511753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012c101440 0x7f012c195ff0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.185+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 >> 172.21.15.31:0/1203511753 conn(0x7f012c0fb7f0 msgr2=0x7f012c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:54.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.186+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 shutdown_connections 2024-09-17T01:56:54.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.186+0000 7f0132467700 1 -- 172.21.15.31:0/1203511753 wait complete. 2024-09-17T01:56:54.195 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:56:54.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.310+0000 7f8f372e6700 1 -- 172.21.15.31:0/3089031192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f300ff130 msgr2=0x7f8f300ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.310+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3089031192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f300ff130 0x7f8f300ff540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009910 tx=0x7f8f2c009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 -- 172.21.15.31:0/3089031192 shutdown_connections 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3089031192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f301003d0 0x7f8f30100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3089031192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f300ff130 0x7f8f300ff540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 -- 172.21.15.31:0/3089031192 >> 172.21.15.31:0/3089031192 conn(0x7f8f300fa780 msgr2=0x7f8f300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 -- 172.21.15.31:0/3089031192 shutdown_connections 2024-09-17T01:56:54.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 -- 172.21.15.31:0/3089031192 wait complete. 2024-09-17T01:56:54.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 Processor -- start 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.311+0000 7f8f372e6700 1 -- start start 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f372e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f300ff130 0x7f8f300690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f372e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 0x7f8f3019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f372e6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3019ade0 con 0x7f8f301003d0 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f372e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3019af20 con 0x7f8f300ff130 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 0x7f8f3019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 0x7f8f3019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35942/0 (socket says 172.21.15.31:35942) 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f35082700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f300ff130 0x7f8f300690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 -- 172.21.15.31:0/3844015075 learned_addr learned my addr 172.21.15.31:0/3844015075 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:54.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 -- 172.21.15.31:0/3844015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f300ff130 msgr2=0x7f8f300690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f300ff130 0x7f8f300690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 -- 172.21.15.31:0/3844015075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0095f0 con 0x7f8f301003d0 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f35082700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f300ff130 0x7f8f300690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f34881700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 0x7f8f3019a810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000e920 tx=0x7f8f2000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.312+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2000c9d0 con 0x7f8f301003d0 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.313+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f20010430 con 0x7f8f301003d0 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.313+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3019b200 con 0x7f8f301003d0 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.313+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f20018650 con 0x7f8f301003d0 2024-09-17T01:56:54.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.313+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3019b750 con 0x7f8f301003d0 2024-09-17T01:56:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.314+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f30107c10 con 0x7f8f301003d0 2024-09-17T01:56:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.315+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8f200105a0 con 0x7f8f301003d0 2024-09-17T01:56:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.315+0000 7f8f267fc700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f1c06e680 0x7f8f1c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.315+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8f20014070 con 0x7f8f301003d0 2024-09-17T01:56:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.315+0000 7f8f35082700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f1c06e680 0x7f8f1c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.316+0000 7f8f35082700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f1c06e680 0x7f8f1c070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009fd0 tx=0x7f8f2c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:54.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.319+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f2005c2d0 con 0x7f8f301003d0 2024-09-17T01:56:54.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.599+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f30104d20 con 0x7f8f1c06e680 2024-09-17T01:56:54.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.601+0000 7f8f267fc700 1 -- 172.21.15.31:0/3844015075 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8f30104d20 con 0x7f8f1c06e680 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f1c06e680 msgr2=0x7f8f1c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f1c06e680 0x7f8f1c070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009fd0 tx=0x7f8f2c005940 comp rx=0 tx=0).stop 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 msgr2=0x7f8f3019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 0x7f8f3019a810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000e920 tx=0x7f8f2000ec30 comp rx=0 tx=0).stop 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 shutdown_connections 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f1c06e680 0x7f8f1c070b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f300ff130 0x7f8f300690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 --2- 172.21.15.31:0/3844015075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f301003d0 0x7f8f3019a810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 >> 172.21.15.31:0/3844015075 conn(0x7f8f300fa780 msgr2=0x7f8f30103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 shutdown_connections 2024-09-17T01:56:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.603+0000 7f8f372e6700 1 -- 172.21.15.31:0/3844015075 wait complete. 2024-09-17T01:56:54.690 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:54 smithi092 ceph-mon[64495]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:56:54.690 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:54 smithi092 ceph-mon[64495]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:54.691 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 podman[69591]: 2024-09-17 01:56:54.326484564 +0000 UTC m=+0.598359887 container remove 830114189a0cd7054b9c88711cde117b2fa54d9d56207edefd259edc0a97cf1e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:56:54.691 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 podman[69653]: 2024-09-17 01:56:54.442786312 +0000 UTC m=+0.018090152 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:56:54.691 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 podman[69653]: 2024-09-17 01:56:54.569141813 +0000 UTC m=+0.144445632 container create 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:56:54.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.724+0000 7f29f5c11700 1 -- 172.21.15.31:0/2152020658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f01003d0 msgr2=0x7f29f0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 --2- 172.21.15.31:0/2152020658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f01003d0 0x7f29f0100840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009910 tx=0x7f29e4009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:54.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 -- 172.21.15.31:0/2152020658 shutdown_connections 2024-09-17T01:56:54.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 --2- 172.21.15.31:0/2152020658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f01003d0 0x7f29f0100840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.724 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:54 smithi031 ceph-mon[77274]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:56:54.724 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:54 smithi031 ceph-mon[77274]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 --2- 172.21.15.31:0/2152020658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f00ff130 0x7f29f00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 -- 172.21.15.31:0/2152020658 >> 172.21.15.31:0/2152020658 conn(0x7f29f00fa780 msgr2=0x7f29f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 -- 172.21.15.31:0/2152020658 shutdown_connections 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.725+0000 7f29f5c11700 1 -- 172.21.15.31:0/2152020658 wait complete. 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29f5c11700 1 Processor -- start 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29f5c11700 1 -- start start 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29f5c11700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f00ff130 0x7f29f0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29f5c11700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f01003d0 0x7f29f01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29f5c11700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01987b0 con 0x7f29f00ff130 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29f5c11700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0198920 con 0x7f29f01003d0 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f01003d0 0x7f29f01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29ef7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f00ff130 0x7f29f0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f01003d0 0x7f29f01981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:60372/0 (socket says 172.21.15.31:60372) 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.726+0000 7f29eeffd700 1 -- 172.21.15.31:0/268060675 learned_addr learned my addr 172.21.15.31:0/268060675 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ef7fe700 1 -- 172.21.15.31:0/268060675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f01003d0 msgr2=0x7f29f01981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ef7fe700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f01003d0 0x7f29f01981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ef7fe700 1 -- 172.21.15.31:0/268060675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40095f0 con 0x7f29f00ff130 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ef7fe700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f00ff130 0x7f29f0197c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29e000e970 tx=0x7f29e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e000c9d0 con 0x7f29f00ff130 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29e0010430 con 0x7f29f00ff130 2024-09-17T01:56:54.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f019d3b0 con 0x7f29f00ff130 2024-09-17T01:56:54.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e0018650 con 0x7f29f00ff130 2024-09-17T01:56:54.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.727+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f019d900 con 0x7f29f00ff130 2024-09-17T01:56:54.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.729+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0107c10 con 0x7f29f00ff130 2024-09-17T01:56:54.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.729+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f29e00105a0 con 0x7f29f00ff130 2024-09-17T01:56:54.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.729+0000 7f29ecff9700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f29d806e680 0x7f29d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:54.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.730+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f29e0014070 con 0x7f29f00ff130 2024-09-17T01:56:54.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.730+0000 7f29eeffd700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f29d806e680 0x7f29d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:54.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.730+0000 7f29eeffd700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f29d806e680 0x7f29d8070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29f0199180 tx=0x7f29e4005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:54.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.734+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29e00541b0 con 0x7f29f00ff130 2024-09-17T01:56:54.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.961+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f29f019e050 con 0x7f29d806e680 2024-09-17T01:56:54.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.970+0000 7f29ecff9700 1 -- 172.21.15.31:0/268060675 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f29f019e050 con 0x7f29d806e680 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (11m) 29s ago 13m 24.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (13m) 29s ago 13m 8480k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (12m) 2m ago 12m 7889k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (2m) 29s ago 13m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (2m) 2m ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (11m) 29s ago 12m 87.1M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:56:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (7m) 29s ago 7m 62.9M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (7m) 29s ago 7m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (7m) 2m ago 7m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (7m) 2m ago 7m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (4m) 29s ago 14m 500M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (3m) 2m ago 12m 439M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (3m) 29s ago 14m 47.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (2m) 2m ago 12m 34.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (13m) 29s ago 13m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (12m) 2m ago 12m 15.2M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (106s) 29s ago 11m 89.7M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (71s) 29s ago 10m 103M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:56:54.970 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (35s) 29s ago 10m 11.2M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T01:56:54.971 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (9m) 2m ago 9m 263M 2240M 18.2.0 dc2bc1663786 55e9e7da6815 2024-09-17T01:56:54.971 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (9m) 2m ago 9m 236M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:56:54.971 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (9m) 2m ago 9m 221M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:56:54.971 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (3m) 29s ago 12m 75.0M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:56:54.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f29d806e680 msgr2=0x7f29d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f29d806e680 0x7f29d8070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29f0199180 tx=0x7f29e4005940 comp rx=0 tx=0).stop 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f00ff130 msgr2=0x7f29f0197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f00ff130 0x7f29f0197c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29e000e970 tx=0x7f29e000ec80 comp rx=0 tx=0).stop 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 shutdown_connections 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f29d806e680 0x7f29d8070b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29f00ff130 0x7f29f0197c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 --2- 172.21.15.31:0/268060675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29f01003d0 0x7f29f01981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 >> 172.21.15.31:0/268060675 conn(0x7f29f00fa780 msgr2=0x7f29f0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 shutdown_connections 2024-09-17T01:56:54.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:54.973+0000 7f29f5c11700 1 -- 172.21.15.31:0/268060675 wait complete. 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 -- 172.21.15.31:0/2020931166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4103350 msgr2=0x7f45e4105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 --2- 172.21.15.31:0/2020931166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4103350 0x7f45e4105790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009910 tx=0x7f45d8009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 -- 172.21.15.31:0/2020931166 shutdown_connections 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 --2- 172.21.15.31:0/2020931166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4103350 0x7f45e4105790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 --2- 172.21.15.31:0/2020931166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4069230 0x7f45e4102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 -- 172.21.15.31:0/2020931166 >> 172.21.15.31:0/2020931166 conn(0x7f45e40fa780 msgr2=0x7f45e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 -- 172.21.15.31:0/2020931166 shutdown_connections 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 -- 172.21.15.31:0/2020931166 wait complete. 2024-09-17T01:56:55.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.083+0000 7f45e95b0700 1 Processor -- start 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e95b0700 1 -- start start 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e95b0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4069230 0x7f45e4100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e95b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4103350 0x7f45e40fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e95b0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40ff2f0 con 0x7f45e4069230 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e95b0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40ff430 con 0x7f45e4103350 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4069230 0x7f45e4100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4069230 0x7f45e4100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35974/0 (socket says 172.21.15.31:35974) 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e2ffd700 1 -- 172.21.15.31:0/3189731230 learned_addr learned my addr 172.21.15.31:0/3189731230 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:55.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e27fc700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4103350 0x7f45e40fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e27fc700 1 -- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4069230 msgr2=0x7f45e4100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e27fc700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4069230 0x7f45e4100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.084+0000 7f45e27fc700 1 -- 172.21.15.31:0/3189731230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80095f0 con 0x7f45e4103350 2024-09-17T01:56:55.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.085+0000 7f45e27fc700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4103350 0x7f45e40fedb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45d8005b40 tx=0x7f45d800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.085+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d801d070 con 0x7f45e4103350 2024-09-17T01:56:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.085+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45d8005dc0 con 0x7f45e4103350 2024-09-17T01:56:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.085+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d8022470 con 0x7f45e4103350 2024-09-17T01:56:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.085+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e40ff6b0 con 0x7f45e4103350 2024-09-17T01:56:55.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.085+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e40ffba0 con 0x7f45e4103350 2024-09-17T01:56:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.086+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e418fbf0 con 0x7f45e4103350 2024-09-17T01:56:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.086+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f45d8005160 con 0x7f45e4103350 2024-09-17T01:56:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.087+0000 7f45cbfff700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f45cc06e680 0x7f45cc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.087+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f45d808fb40 con 0x7f45e4103350 2024-09-17T01:56:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.087+0000 7f45e2ffd700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f45cc06e680 0x7f45cc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.087+0000 7f45e2ffd700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f45cc06e680 0x7f45cc070b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009fd0 tx=0x7f45d400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:55.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.092+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f45d805c730 con 0x7f45e4103350 2024-09-17T01:56:55.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 podman[69653]: 2024-09-17 01:56:54.80510446 +0000 UTC m=+0.380408279 container init 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-17T01:56:55.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 podman[69653]: 2024-09-17 01:56:54.808689934 +0000 UTC m=+0.383993761 container start 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:56:55.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 ceph-osd[69671]: -- 172.21.15.92:0/670630577 <== mon.1 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d10f0ba1e0 con 0x55d10f0b8000 2024-09-17T01:56:55.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 bash[69653]: 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 2024-09-17T01:56:55.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:54 smithi092 systemd[1]: Started Ceph osd.3 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:56:55.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.395+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45e402cc30 con 0x7f45e4103350 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.395+0000 7f45cbfff700 1 -- 172.21.15.31:0/3189731230 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f45d805c2c0 con 0x7f45e4103350 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:56:55.394 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:56:55.395 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.398+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f45cc06e680 msgr2=0x7f45cc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.398+0000 7f45e95b0700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f45cc06e680 0x7f45cc070b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009fd0 tx=0x7f45d400b040 comp rx=0 tx=0).stop 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.398+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4103350 msgr2=0x7f45e40fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.398+0000 7f45e95b0700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4103350 0x7f45e40fedb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45d8005b40 tx=0x7f45d800fa00 comp rx=0 tx=0).stop 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 shutdown_connections 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f45cc06e680 0x7f45cc070b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45e4069230 0x7f45e4100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 --2- 172.21.15.31:0/3189731230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e4103350 0x7f45e40fedb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 >> 172.21.15.31:0/3189731230 conn(0x7f45e40fa780 msgr2=0x7f45e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 shutdown_connections 2024-09-17T01:56:55.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.399+0000 7f45e95b0700 1 -- 172.21.15.31:0/3189731230 wait complete. 2024-09-17T01:56:55.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 -- 172.21.15.31:0/1021433188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0ff150 msgr2=0x7f2f4c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 --2- 172.21.15.31:0/1021433188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0ff150 0x7f2f4c0ff560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009910 tx=0x7f2f3c009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 -- 172.21.15.31:0/1021433188 shutdown_connections 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 --2- 172.21.15.31:0/1021433188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 --2- 172.21.15.31:0/1021433188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c0ff150 0x7f2f4c0ff560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 -- 172.21.15.31:0/1021433188 >> 172.21.15.31:0/1021433188 conn(0x7f2f4c0fa7a0 msgr2=0x7f2f4c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 -- 172.21.15.31:0/1021433188 shutdown_connections 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.513+0000 7f2f5134a700 1 -- 172.21.15.31:0/1021433188 wait complete. 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f5134a700 1 Processor -- start 2024-09-17T01:56:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f5134a700 1 -- start start 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f5134a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f4c0ff150 0x7f2f4c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f5134a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f5134a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c198b30 con 0x7f2f4c1003f0 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f5134a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c198c70 con 0x7f2f4c0ff150 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f4a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f4a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35990/0 (socket says 172.21.15.31:35990) 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.514+0000 7f2f4a7fc700 1 -- 172.21.15.31:0/2520207715 learned_addr learned my addr 172.21.15.31:0/2520207715 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f4affd700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f4c0ff150 0x7f2f4c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f4a7fc700 1 -- 172.21.15.31:0/2520207715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f4c0ff150 msgr2=0x7f2f4c197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f4a7fc700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f4c0ff150 0x7f2f4c197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f4a7fc700 1 -- 172.21.15.31:0/2520207715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0095f0 con 0x7f2f4c1003f0 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f4a7fc700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c198510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000d900 tx=0x7f2f4000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f40004a00 con 0x7f2f4c1003f0 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c19d720 con 0x7f2f4c1003f0 2024-09-17T01:56:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f400054d0 con 0x7f2f4c1003f0 2024-09-17T01:56:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f40009d00 con 0x7f2f4c1003f0 2024-09-17T01:56:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.515+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c19dc70 con 0x7f2f4c1003f0 2024-09-17T01:56:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.516+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c068ab0 con 0x7f2f4c1003f0 2024-09-17T01:56:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.517+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2f40005020 con 0x7f2f4c1003f0 2024-09-17T01:56:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.517+0000 7f2f33fff700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f2f3406e680 0x7f2f34070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.517+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6590+0+0 (secure 0 0 0) 0x7f2f4008e710 con 0x7f2f4c1003f0 2024-09-17T01:56:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.518+0000 7f2f4affd700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f2f3406e680 0x7f2f34070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.518+0000 7f2f4affd700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f2f3406e680 0x7f2f34070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c006010 tx=0x7f2f3c00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:55.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.522+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f4005b2e0 con 0x7f2f4c1003f0 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: pgmap v115: 65 pgs: 2 active+clean+remapped, 4 remapped+peering, 1 active+recovering+undersized+degraded+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/324 objects degraded (19.753%); 7/324 objects misplaced (2.160%); 2.0 MiB/s, 0 objects/s recovering 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:56:55.716 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:55 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3189731230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: pgmap v115: 65 pgs: 2 active+clean+remapped, 4 remapped+peering, 1 active+recovering+undersized+degraded+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 64/324 objects degraded (19.753%); 7/324 objects misplaced (2.160%); 2.0 MiB/s, 0 objects/s recovering 2024-09-17T01:56:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:56:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:55 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3189731230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:56:55.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.780+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f4c19de90 con 0x7f2f4c1003f0 2024-09-17T01:56:55.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.780+0000 7f2f33fff700 1 -- 172.21.15.31:0/2520207715 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1952 (secure 0 0 0) 0x7f2f40017070 con 0x7f2f4c1003f0 2024-09-17T01:56:55.779 INFO:teuthology.orchestra.run.smithi031.stdout:e19 2024-09-17T01:56:55.779 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:56:23:987796+0000 2024-09-17T01:56:55.779 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:56:55.779 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 19 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:56:23.845837+0000 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:56:55.780 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:56:55.781 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:56:55.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:56:55.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.782+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f2f3406e680 msgr2=0x7f2f34070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.782+0000 7f2f5134a700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f2f3406e680 0x7f2f34070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c006010 tx=0x7f2f3c00b560 comp rx=0 tx=0).stop 2024-09-17T01:56:55.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.782+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 msgr2=0x7f2f4c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.782+0000 7f2f5134a700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c198510 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000d900 tx=0x7f2f4000dc10 comp rx=0 tx=0).stop 2024-09-17T01:56:55.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 shutdown_connections 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f2f3406e680 0x7f2f34070b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f4c0ff150 0x7f2f4c197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 --2- 172.21.15.31:0/2520207715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f4c1003f0 0x7f2f4c198510 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 >> 172.21.15.31:0/2520207715 conn(0x7f2f4c0fa7a0 msgr2=0x7f2f4c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 shutdown_connections 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.783+0000 7f2f5134a700 1 -- 172.21.15.31:0/2520207715 wait complete. 2024-09-17T01:56:55.784 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 -- 172.21.15.31:0/229266635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 msgr2=0x7fd7f81007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 --2- 172.21.15.31:0/229266635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81007a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009910 tx=0x7fd7ec009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 -- 172.21.15.31:0/229266635 shutdown_connections 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 --2- 172.21.15.31:0/229266635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81007a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 --2- 172.21.15.31:0/229266635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f80ff150 0x7fd7f80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 -- 172.21.15.31:0/229266635 >> 172.21.15.31:0/229266635 conn(0x7fd7f80fa700 msgr2=0x7fd7f80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 -- 172.21.15.31:0/229266635 shutdown_connections 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.893+0000 7fd7fe649700 1 -- 172.21.15.31:0/229266635 wait complete. 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7fe649700 1 Processor -- start 2024-09-17T01:56:55.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7fe649700 1 -- start start 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7fe649700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f80ff150 0x7fd7f8197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7fe649700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7fe649700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8198750 con 0x7fd7f8100350 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7fe649700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f81988c0 con 0x7fd7f80ff150 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7f77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35998/0 (socket says 172.21.15.31:35998) 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7f77fe700 1 -- 172.21.15.31:0/1733659658 learned_addr learned my addr 172.21.15.31:0/1733659658 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7f7fff700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f80ff150 0x7fd7f8197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7f77fe700 1 -- 172.21.15.31:0/1733659658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f80ff150 msgr2=0x7fd7f8197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.894+0000 7fd7f77fe700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f80ff150 0x7fd7f8197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7f77fe700 1 -- 172.21.15.31:0/1733659658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0095f0 con 0x7fd7f8100350 2024-09-17T01:56:55.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7f77fe700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81981e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec005b40 tx=0x7fd7ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ec01d070 con 0x7fd7f8100350 2024-09-17T01:56:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f819d300 con 0x7fd7f8100350 2024-09-17T01:56:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd7ec022470 con 0x7fd7f8100350 2024-09-17T01:56:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ec00f690 con 0x7fd7f8100350 2024-09-17T01:56:55.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.895+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f819d7f0 con 0x7fd7f8100350 2024-09-17T01:56:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.896+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f810afa0 con 0x7fd7f8100350 2024-09-17T01:56:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.897+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd7ec022a10 con 0x7fd7f8100350 2024-09-17T01:56:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.897+0000 7fd7f57fa700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd7e006e6a0 0x7fd7e0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.897+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fd7ec08fd50 con 0x7fd7f8100350 2024-09-17T01:56:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.897+0000 7fd7f7fff700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd7e006e6a0 0x7fd7e0070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:55.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.898+0000 7fd7f7fff700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd7e006e6a0 0x7fd7e0070b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8198b80 tx=0x7fd7e800a3b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:55.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:55.901+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd7ec058ea0 con 0x7fd7f8100350 2024-09-17T01:56:56.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.136+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f8104ca0 con 0x7fd7e006e6a0 2024-09-17T01:56:56.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.138+0000 7fd7f57fa700 1 -- 172.21.15.31:0/1733659658 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd7f8104ca0 con 0x7fd7e006e6a0 2024-09-17T01:56:56.136 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:56:56.136 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "9/23 daemons upgraded", 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:56:56.137 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:56:56.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.140+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd7e006e6a0 msgr2=0x7fd7e0070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:56.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.140+0000 7fd7fe649700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd7e006e6a0 0x7fd7e0070b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8198b80 tx=0x7fd7e800a3b0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.140+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 msgr2=0x7fd7f81981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.140+0000 7fd7fe649700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81981e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec005b40 tx=0x7fd7ec00bd70 comp rx=0 tx=0).stop 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 shutdown_connections 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd7e006e6a0 0x7fd7e0070b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f80ff150 0x7fd7f8197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 --2- 172.21.15.31:0/1733659658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f8100350 0x7fd7f81981e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 >> 172.21.15.31:0/1733659658 conn(0x7fd7f80fa700 msgr2=0x7fd7f8103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 shutdown_connections 2024-09-17T01:56:56.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.141+0000 7fd7fe649700 1 -- 172.21.15.31:0/1733659658 wait complete. 2024-09-17T01:56:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 -- 172.21.15.31:0/2343539031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 msgr2=0x7fec18101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 --2- 172.21.15.31:0/2343539031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18101950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009910 tx=0x7fec0c009c20 comp rx=0 tx=0).stop 2024-09-17T01:56:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 -- 172.21.15.31:0/2343539031 shutdown_connections 2024-09-17T01:56:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 --2- 172.21.15.31:0/2343539031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18101950 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 --2- 172.21.15.31:0/2343539031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 0x7fec18100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 -- 172.21.15.31:0/2343539031 >> 172.21.15.31:0/2343539031 conn(0x7fec180fb890 msgr2=0x7fec180fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 -- 172.21.15.31:0/2343539031 shutdown_connections 2024-09-17T01:56:56.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.253+0000 7fec1fece700 1 -- 172.21.15.31:0/2343539031 wait complete. 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1fece700 1 Processor -- start 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1fece700 1 -- start start 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1fece700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 0x7fec18195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1fece700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1fece700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181965f0 con 0x7fec181014e0 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1fece700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18196730 con 0x7fec18100240 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1d469700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1d469700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36008/0 (socket says 172.21.15.31:36008) 2024-09-17T01:56:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1d469700 1 -- 172.21.15.31:0/2708645038 learned_addr learned my addr 172.21.15.31:0/2708645038 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1dc6a700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 0x7fec18195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1d469700 1 -- 172.21.15.31:0/2708645038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 msgr2=0x7fec18195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1d469700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 0x7fec18195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1d469700 1 -- 172.21.15.31:0/2708645038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0095f0 con 0x7fec181014e0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.254+0000 7fec1dc6a700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 0x7fec18195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.255+0000 7fec1d469700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18195fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec0c000c00 tx=0x7fec0c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.255+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec0c01d070 con 0x7fec181014e0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.255+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fec0c005dc0 con 0x7fec181014e0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.255+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1819b180 con 0x7fec181014e0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.255+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec0c0226a0 con 0x7fec181014e0 2024-09-17T01:56:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.255+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1819b670 con 0x7fec181014e0 2024-09-17T01:56:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.256+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec18108d20 con 0x7fec181014e0 2024-09-17T01:56:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.256+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fec0c003680 con 0x7fec181014e0 2024-09-17T01:56:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.257+0000 7fec16ffd700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fec0006e680 0x7fec00070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:56:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.257+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6590+0+0 (secure 0 0 0) 0x7fec0c08fda0 con 0x7fec181014e0 2024-09-17T01:56:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.257+0000 7fec1dc6a700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fec0006e680 0x7fec00070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:56:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.257+0000 7fec1dc6a700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fec0006e680 0x7fec00070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fd0 tx=0x7fec0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:56:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.261+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fec0c05c8d0 con 0x7fec181014e0 2024-09-17T01:56:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.573+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fec18108f10 con 0x7fec181014e0 2024-09-17T01:56:56.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.573+0000 7fec16ffd700 1 -- 172.21.15.31:0/2708645038 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1573 (secure 0 0 0) 0x7fec0c003930 con 0x7fec181014e0 2024-09-17T01:56:56.572 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 2 pgs peering; Degraded data redundancy: 64/324 objects degraded (19.753%), 18 pgs degraded 2024-09-17T01:56:56.572 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:56:56.572 INFO:teuthology.orchestra.run.smithi031.stdout: osd.3 (root=default,host=smithi092) is down 2024-09-17T01:56:56.572 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 2 pgs peering 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 3.3 is stuck peering for 3m, current state remapped+peering, last acting [0,4] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 3.11 is stuck peering for 3m, current state remapped+peering, last acting [5,0,4] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 64/324 objects degraded (19.753%), 18 pgs degraded 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.0 is active+recovering+undersized+degraded+remapped, acting [1,0] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-17T01:56:56.573 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-17T01:56:56.574 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fec0006e680 msgr2=0x7fec00070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fec0006e680 0x7fec00070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fd0 tx=0x7fec0800b040 comp rx=0 tx=0).stop 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 msgr2=0x7fec18195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18195fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec0c000c00 tx=0x7fec0c00f740 comp rx=0 tx=0).stop 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 shutdown_connections 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fec0006e680 0x7fec00070b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec18100240 0x7fec18195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 --2- 172.21.15.31:0/2708645038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec181014e0 0x7fec18195fd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.575+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 >> 172.21.15.31:0/2708645038 conn(0x7fec180fb890 msgr2=0x7fec18104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.576+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 shutdown_connections 2024-09-17T01:56:56.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:56:56.576+0000 7fec1fece700 1 -- 172.21.15.31:0/2708645038 wait complete. 2024-09-17T01:56:56.739 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:56:56 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T01:56:56.460+0000 7fd8370fb640 -1 Falling back to public interface 2024-09-17T01:56:56.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:56 smithi092 ceph-mon[64495]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:56:56.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:56 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2520207715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:56:56.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:56 smithi092 ceph-mon[64495]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:56.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:56 smithi031 ceph-mon[77274]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:56:56.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:56 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2520207715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:56:56.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:56 smithi031 ceph-mon[77274]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:56:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:57 smithi092 ceph-mon[64495]: pgmap v118: 65 pgs: 2 active+clean+remapped, 4 remapped+peering, 1 active+recovering+undersized+degraded+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 53 MiB/s wr, 393 op/s; 64/324 objects degraded (19.753%); 7/324 objects misplaced (2.160%); 2.0 MiB/s, 0 objects/s recovering 2024-09-17T01:56:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:57 smithi092 ceph-mon[64495]: osdmap e71: 6 total, 5 up, 6 in 2024-09-17T01:56:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:57 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2708645038' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:56:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:57 smithi031 ceph-mon[77274]: pgmap v118: 65 pgs: 2 active+clean+remapped, 4 remapped+peering, 1 active+recovering+undersized+degraded+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 53 MiB/s wr, 393 op/s; 64/324 objects degraded (19.753%); 7/324 objects misplaced (2.160%); 2.0 MiB/s, 0 objects/s recovering 2024-09-17T01:56:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:57 smithi031 ceph-mon[77274]: osdmap e71: 6 total, 5 up, 6 in 2024-09-17T01:56:57.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:57 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2708645038' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:56:59.150 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.151 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.151 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.151 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:56:59.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:00.179 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:59 smithi092 ceph-mon[64495]: pgmap v120: 65 pgs: 6 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 3.5 MiB/s, 148 objects/s recovering 2024-09-17T01:57:00.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:56:59 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 58/324 objects degraded (17.901%), 17 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:00.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:59 smithi031 ceph-mon[77274]: pgmap v120: 65 pgs: 6 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 3.5 MiB/s, 148 objects/s recovering 2024-09-17T01:57:00.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:56:59 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 58/324 objects degraded (17.901%), 17 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: pgmap v121: 65 pgs: 6 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 2.8 MiB/s, 119 objects/s recovering 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:02.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:01 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:02.094 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: pgmap v121: 65 pgs: 6 active+clean+remapped, 1 remapped+peering, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 2.8 MiB/s, 119 objects/s recovering 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:02.095 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:01 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:02.489 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T01:57:02.095+0000 7fd8370fb640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-17T01:57:02.839 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T01:57:02.561+0000 7fd8370fb640 -1 osd.3 63 log_to_monitors true 2024-09-17T01:57:03.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:02 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:03.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:02 smithi031 ceph-mon[77274]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-17T01:57:03.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:02 smithi031 ceph-mon[77274]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:57:03.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:02 smithi031 ceph-mon[77274]: from='osd.3 [v2:172.21.15.92:6800/1488770623,v1:172.21.15.92:6801/1488770623]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:57:03.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:02 smithi031 ceph-mon[77274]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:57:03.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T01:57:02.858+0000 7fd82ee95640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:57:03.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:03.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-mon[64495]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-17T01:57:03.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-mon[64495]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:57:03.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-mon[64495]: from='osd.3 [v2:172.21.15.92:6800/1488770623,v1:172.21.15.92:6801/1488770623]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:57:03.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:02 smithi092 ceph-mon[64495]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:57:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:03 smithi092 ceph-mon[64495]: pgmap v122: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 2.2 MiB/s, 186 objects/s recovering 2024-09-17T01:57:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:03 smithi092 ceph-mon[64495]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T01:57:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:03 smithi092 ceph-mon[64495]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:57:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:03 smithi092 ceph-mon[64495]: osdmap e72: 6 total, 5 up, 6 in 2024-09-17T01:57:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:03 smithi092 ceph-mon[64495]: from='osd.3 [v2:172.21.15.92:6800/1488770623,v1:172.21.15.92:6801/1488770623]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:03 smithi092 ceph-mon[64495]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:03 smithi031 ceph-mon[77274]: pgmap v122: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 2.2 MiB/s, 186 objects/s recovering 2024-09-17T01:57:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:03 smithi031 ceph-mon[77274]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T01:57:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:03 smithi031 ceph-mon[77274]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:57:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:03 smithi031 ceph-mon[77274]: osdmap e72: 6 total, 5 up, 6 in 2024-09-17T01:57:04.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:03 smithi031 ceph-mon[77274]: from='osd.3 [v2:172.21.15.92:6800/1488770623,v1:172.21.15.92:6801/1488770623]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:04.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:03 smithi031 ceph-mon[77274]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:05.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:04 smithi092 ceph-mon[64495]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:57:05.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:04 smithi092 ceph-mon[64495]: osd.3 [v2:172.21.15.92:6800/1488770623,v1:172.21.15.92:6801/1488770623] boot 2024-09-17T01:57:05.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:04 smithi092 ceph-mon[64495]: osdmap e73: 6 total, 6 up, 6 in 2024-09-17T01:57:05.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:04 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:57:05.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:04 smithi092 ceph-mon[64495]: osdmap e74: 6 total, 6 up, 6 in 2024-09-17T01:57:05.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:04 smithi031 ceph-mon[77274]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:57:05.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:04 smithi031 ceph-mon[77274]: osd.3 [v2:172.21.15.92:6800/1488770623,v1:172.21.15.92:6801/1488770623] boot 2024-09-17T01:57:05.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:04 smithi031 ceph-mon[77274]: osdmap e73: 6 total, 6 up, 6 in 2024-09-17T01:57:05.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:04 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:57:05.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:04 smithi031 ceph-mon[77274]: osdmap e74: 6 total, 6 up, 6 in 2024-09-17T01:57:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:05 smithi092 ceph-mon[64495]: pgmap v125: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 2.2 MiB/s, 187 objects/s recovering 2024-09-17T01:57:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:05 smithi092 ceph-mon[64495]: osdmap e75: 6 total, 6 up, 6 in 2024-09-17T01:57:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:05 smithi031 ceph-mon[77274]: pgmap v125: 65 pgs: 7 active+clean+remapped, 17 active+undersized, 17 active+undersized+degraded, 24 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 58/324 objects degraded (17.901%); 12/324 objects misplaced (3.704%); 2.2 MiB/s, 187 objects/s recovering 2024-09-17T01:57:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:06.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:05 smithi031 ceph-mon[77274]: osdmap e75: 6 total, 6 up, 6 in 2024-09-17T01:57:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:06 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 50/324 objects degraded (15.432%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:06 smithi092 ceph-mon[64495]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T01:57:07.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:06 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 50/324 objects degraded (15.432%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:07.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:06 smithi031 ceph-mon[77274]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T01:57:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:08 smithi092 ceph-mon[64495]: pgmap v128: 65 pgs: 7 active+clean+remapped, 13 active+undersized, 14 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 50/324 objects degraded (15.432%); 12/324 objects misplaced (3.704%) 2024-09-17T01:57:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:08 smithi092 ceph-mon[64495]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:57:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:08 smithi031 ceph-mon[77274]: pgmap v128: 65 pgs: 7 active+clean+remapped, 13 active+undersized, 14 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 50/324 objects degraded (15.432%); 12/324 objects misplaced (3.704%) 2024-09-17T01:57:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:08 smithi031 ceph-mon[77274]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:57:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:09 smithi092 ceph-mon[64495]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:57:09.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:09 smithi031 ceph-mon[77274]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:57:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:10 smithi092 ceph-mon[64495]: pgmap v132: 65 pgs: 1 active+undersized+remapped, 1 peering, 63 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 430 objects/s recovering 2024-09-17T01:57:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:10 smithi092 ceph-mon[64495]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/324 objects degraded (15.432%), 14 pgs degraded) 2024-09-17T01:57:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:10 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:57:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:10 smithi092 ceph-mon[64495]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:57:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:10 smithi031 ceph-mon[77274]: pgmap v132: 65 pgs: 1 active+undersized+remapped, 1 peering, 63 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 430 objects/s recovering 2024-09-17T01:57:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:10 smithi031 ceph-mon[77274]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/324 objects degraded (15.432%), 14 pgs degraded) 2024-09-17T01:57:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:10 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:57:10.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:10 smithi031 ceph-mon[77274]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:57:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:12 smithi092 ceph-mon[64495]: pgmap v134: 65 pgs: 1 active+undersized+remapped, 1 peering, 63 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 368 objects/s recovering 2024-09-17T01:57:12.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:12 smithi031 ceph-mon[77274]: pgmap v134: 65 pgs: 1 active+undersized+remapped, 1 peering, 63 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 368 objects/s recovering 2024-09-17T01:57:14.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:14 smithi092 ceph-mon[64495]: pgmap v135: 65 pgs: 1 active+undersized+remapped, 1 peering, 63 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 272 objects/s recovering 2024-09-17T01:57:14.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:14 smithi031 ceph-mon[77274]: pgmap v135: 65 pgs: 1 active+undersized+remapped, 1 peering, 63 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 272 objects/s recovering 2024-09-17T01:57:16.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:16 smithi092 ceph-mon[64495]: pgmap v136: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1 op/s; 0 B/s, 206 objects/s recovering 2024-09-17T01:57:16.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:16 smithi031 ceph-mon[77274]: pgmap v136: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1 op/s; 0 B/s, 206 objects/s recovering 2024-09-17T01:57:17.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:17.469 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:18 smithi092 ceph-mon[64495]: pgmap v137: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:57:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:18 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:18 smithi092 ceph-mon[64495]: Upgrade: osd.4 is safe to restart 2024-09-17T01:57:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:18 smithi031 ceph-mon[77274]: pgmap v137: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:57:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:18 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:57:18.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:18 smithi031 ceph-mon[77274]: Upgrade: osd.4 is safe to restart 2024-09-17T01:57:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:19 smithi092 ceph-mon[64495]: Upgrade: Updating osd.4 2024-09-17T01:57:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:57:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:19.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:19 smithi031 ceph-mon[77274]: Upgrade: Updating osd.4 2024-09-17T01:57:19.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:19.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:57:19.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:20.423 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:20 smithi092 ceph-mon[64495]: Deploying daemon osd.4 on smithi092 2024-09-17T01:57:20.423 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:20 smithi092 ceph-mon[64495]: pgmap v138: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:57:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:20 smithi031 ceph-mon[77274]: Deploying daemon osd.4 on smithi092 2024-09-17T01:57:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:20 smithi031 ceph-mon[77274]: pgmap v138: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:57:21.450 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:21 smithi092 systemd[1]: Stopping Ceph osd.4 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:57:21.451 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-mon[64495]: pgmap v139: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:57:21.451 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:21.451 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:21.451 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:21.739 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[44136]: 2024-09-17T01:57:21.481+0000 7f127b58d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:57:21.739 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[44136]: 2024-09-17T01:57:21.481+0000 7f127b58d700 -1 osd.4 79 *** Got signal Terminated *** 2024-09-17T01:57:21.739 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:21 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[44136]: 2024-09-17T01:57:21.481+0000 7f127b58d700 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:57:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:21 smithi031 ceph-mon[77274]: pgmap v139: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:57:21.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:21.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:21.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:22.738 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:22 smithi092 ceph-mon[64495]: osd.4 marked itself down and dead 2024-09-17T01:57:22.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:22 smithi031 ceph-mon[77274]: osd.4 marked itself down and dead 2024-09-17T01:57:22.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:22 smithi092 podman[72149]: 2024-09-17 01:57:22.769499786 +0000 UTC m=+1.392997534 container died e65965d937a2d5ea02723021652df83607c95c33e15858507072d1f3419278c1 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD) 2024-09-17T01:57:23.298 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 podman[72149]: 2024-09-17 01:57:23.156903685 +0000 UTC m=+1.780401422 container cleanup e65965d937a2d5ea02723021652df83607c95c33e15858507072d1f3419278c1 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True) 2024-09-17T01:57:23.298 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 bash[72149]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:57:23.730 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 podman[72168]: 2024-09-17 01:57:23.416719916 +0000 UTC m=+0.643059909 container remove e65965d937a2d5ea02723021652df83607c95c33e15858507072d1f3419278c1 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T01:57:23.730 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:23 smithi092 ceph-mon[64495]: pgmap v140: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:23.730 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:23 smithi092 ceph-mon[64495]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:57:23.730 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:23 smithi092 ceph-mon[64495]: osdmap e80: 6 total, 5 up, 6 in 2024-09-17T01:57:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:23 smithi031 ceph-mon[77274]: pgmap v140: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:23 smithi031 ceph-mon[77274]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:57:23.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:23 smithi031 ceph-mon[77274]: osdmap e80: 6 total, 5 up, 6 in 2024-09-17T01:57:23.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 podman[72253]: 2024-09-17 01:57:23.635117048 +0000 UTC m=+0.015732549 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:57:23.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 podman[72253]: 2024-09-17 01:57:23.742413294 +0000 UTC m=+0.123028838 container create 17f2e0e107d978b81d9d03f689082515ee9db2646fffc935adebdf259bbbd770 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:57:23.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 podman[72253]: 2024-09-17 01:57:23.978205856 +0000 UTC m=+0.358821371 container init 17f2e0e107d978b81d9d03f689082515ee9db2646fffc935adebdf259bbbd770 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-17T01:57:23.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:23 smithi092 podman[72253]: 2024-09-17 01:57:23.981613674 +0000 UTC m=+0.362229182 container start 17f2e0e107d978b81d9d03f689082515ee9db2646fffc935adebdf259bbbd770 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:57:24.462 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:24 smithi092 ceph-mon[64495]: osdmap e81: 6 total, 5 up, 6 in 2024-09-17T01:57:24.462 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 podman[72253]: 2024-09-17 01:57:24.078034211 +0000 UTC m=+0.458649716 container attach 17f2e0e107d978b81d9d03f689082515ee9db2646fffc935adebdf259bbbd770 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:57:24.463 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 podman[72253]: 2024-09-17 01:57:24.175399118 +0000 UTC m=+0.556014620 container died 17f2e0e107d978b81d9d03f689082515ee9db2646fffc935adebdf259bbbd770 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:57:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:24 smithi031 ceph-mon[77274]: osdmap e81: 6 total, 5 up, 6 in 2024-09-17T01:57:25.189 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 podman[72276]: 2024-09-17 01:57:24.756856791 +0000 UTC m=+0.575710087 container remove 17f2e0e107d978b81d9d03f689082515ee9db2646fffc935adebdf259bbbd770 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:57:25.189 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T01:57:25.189 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 systemd[1]: Stopped Ceph osd.4 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:57:25.189 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 4.289s CPU time. 2024-09-17T01:57:25.189 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:24 smithi092 systemd[1]: Starting Ceph osd.4 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:57:25.466 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:25 smithi092 ceph-mon[64495]: pgmap v143: 65 pgs: 27 peering, 1 stale+active+clean, 37 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-17T01:57:25.467 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:25 smithi092 ceph-mon[64495]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T01:57:25.467 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 podman[72375]: 2024-09-17 01:57:25.094449075 +0000 UTC m=+0.015827507 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:57:25.467 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 podman[72375]: 2024-09-17 01:57:25.232924099 +0000 UTC m=+0.154302568 container create b4735eeb048cd4a37a84f9384bf89aa611f7714a87997f0aaeda868031367efb (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:57:25.467 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 podman[72375]: 2024-09-17 01:57:25.468780457 +0000 UTC m=+0.390158888 container init b4735eeb048cd4a37a84f9384bf89aa611f7714a87997f0aaeda868031367efb (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T01:57:25.739 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 podman[72375]: 2024-09-17 01:57:25.472249316 +0000 UTC m=+0.393627744 container start b4735eeb048cd4a37a84f9384bf89aa611f7714a87997f0aaeda868031367efb (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0) 2024-09-17T01:57:25.739 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 podman[72375]: 2024-09-17 01:57:25.568641056 +0000 UTC m=+0.490019484 container attach b4735eeb048cd4a37a84f9384bf89aa611f7714a87997f0aaeda868031367efb (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:57:25.739 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:25.740 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 bash[72375]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:25.740 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:25.740 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:25 smithi092 bash[72375]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:25 smithi031 ceph-mon[77274]: pgmap v143: 65 pgs: 27 peering, 1 stale+active+clean, 37 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-17T01:57:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:25 smithi031 ceph-mon[77274]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-17T01:57:26.617 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-mon[64495]: Health check failed: Degraded data redundancy: 5/324 objects degraded (1.543%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:26.617 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:57:26.617 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:57:26.617 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:57:26.617 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:57:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 -- 172.21.15.31:0/2799574609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c1003d0 msgr2=0x7f4b6c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 --2- 172.21.15.31:0/2799574609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c1003d0 0x7f4b6c100840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009910 tx=0x7f4b60009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 -- 172.21.15.31:0/2799574609 shutdown_connections 2024-09-17T01:57:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 --2- 172.21.15.31:0/2799574609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c1003d0 0x7f4b6c100840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 --2- 172.21.15.31:0/2799574609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 -- 172.21.15.31:0/2799574609 >> 172.21.15.31:0/2799574609 conn(0x7f4b6c0fa780 msgr2=0x7f4b6c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:26.699 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:26 smithi031 ceph-mon[77274]: Health check failed: Degraded data redundancy: 5/324 objects degraded (1.543%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:26.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 -- 172.21.15.31:0/2799574609 shutdown_connections 2024-09-17T01:57:26.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.700+0000 7f4b73937700 1 -- 172.21.15.31:0/2799574609 wait complete. 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b73937700 1 Processor -- start 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b73937700 1 -- start start 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b73937700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b73937700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b6c1003d0 0x7f4b6c195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b73937700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c1965c0 con 0x7f4b6c0ff130 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b73937700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c196700 con 0x7f4b6c1003d0 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b716d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b716d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38230/0 (socket says 172.21.15.31:38230) 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b716d3700 1 -- 172.21.15.31:0/1367545853 learned_addr learned my addr 172.21.15.31:0/1367545853 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.701+0000 7f4b70ed2700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b6c1003d0 0x7f4b6c195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b716d3700 1 -- 172.21.15.31:0/1367545853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b6c1003d0 msgr2=0x7f4b6c195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:26.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b716d3700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b6c1003d0 0x7f4b6c195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b716d3700 1 -- 172.21.15.31:0/1367545853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b600095f0 con 0x7f4b6c0ff130 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b716d3700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c195a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800d8d0 tx=0x7f4b6800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b680098a0 con 0x7f4b6c0ff130 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b68010460 con 0x7f4b6c0ff130 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6800f5f0 con 0x7f4b6c0ff130 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c19b1b0 con 0x7f4b6c0ff130 2024-09-17T01:57:26.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.702+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c19b700 con 0x7f4b6c0ff130 2024-09-17T01:57:26.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.703+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c107c10 con 0x7f4b6c0ff130 2024-09-17T01:57:26.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.704+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4b68009a00 con 0x7f4b6c0ff130 2024-09-17T01:57:26.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.705+0000 7f4b5e7fc700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4b5806e680 0x7f4b58070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:26.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.705+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f4b6808e510 con 0x7f4b6c0ff130 2024-09-17T01:57:26.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.705+0000 7f4b70ed2700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4b5806e680 0x7f4b58070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:26.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.705+0000 7f4b70ed2700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4b5806e680 0x7f4b58070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b60006010 tx=0x7f4b6000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:26.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.709+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b6805b1a0 con 0x7f4b6c0ff130 2024-09-17T01:57:26.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.944+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b6c068c50 con 0x7f4b5806e680 2024-09-17T01:57:26.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.945+0000 7f4b5e7fc700 1 -- 172.21.15.31:0/1367545853 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4b6c068c50 con 0x7f4b5806e680 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4b5806e680 msgr2=0x7f4b58070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4b5806e680 0x7f4b58070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b60006010 tx=0x7f4b6000b560 comp rx=0 tx=0).stop 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 msgr2=0x7f4b6c195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c195a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800d8d0 tx=0x7f4b6800dbe0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 shutdown_connections 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4b5806e680 0x7f4b58070b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b6c0ff130 0x7f4b6c195a60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 --2- 172.21.15.31:0/1367545853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b6c1003d0 0x7f4b6c195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 >> 172.21.15.31:0/1367545853 conn(0x7f4b6c0fa780 msgr2=0x7f4b6c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:26.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 shutdown_connections 2024-09-17T01:57:26.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:26.947+0000 7f4b73937700 1 -- 172.21.15.31:0/1367545853 wait complete. 2024-09-17T01:57:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:57:26.969 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:57:26.969 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:57:26.969 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:57:26.969 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:57:26.969 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:57:26.970 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:57:26.970 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:57:26.970 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:57:26.970 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate[72390]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:57:26.970 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 bash[72375]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:57:26.970 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:26 smithi092 podman[72375]: 2024-09-17 01:57:26.656939206 +0000 UTC m=+1.578317645 container died b4735eeb048cd4a37a84f9384bf89aa611f7714a87997f0aaeda868031367efb (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:57:27.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.057+0000 7fab848c5700 1 -- 172.21.15.31:0/2791915083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80100240 msgr2=0x7fab80100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.057+0000 7fab848c5700 1 --2- 172.21.15.31:0/2791915083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80100240 0x7fab80100650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab70009910 tx=0x7fab70009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 -- 172.21.15.31:0/2791915083 shutdown_connections 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 --2- 172.21.15.31:0/2791915083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab80101440 0x7fab80101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 --2- 172.21.15.31:0/2791915083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80100240 0x7fab80100650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 -- 172.21.15.31:0/2791915083 >> 172.21.15.31:0/2791915083 conn(0x7fab800fb7f0 msgr2=0x7fab800fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 -- 172.21.15.31:0/2791915083 shutdown_connections 2024-09-17T01:57:27.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 -- 172.21.15.31:0/2791915083 wait complete. 2024-09-17T01:57:27.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 Processor -- start 2024-09-17T01:57:27.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.058+0000 7fab848c5700 1 -- start start 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab848c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab80100240 0x7fab80074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab848c5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 0x7fab80073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab848c5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80073680 con 0x7fab80101440 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab848c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800737c0 con 0x7fab80100240 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 0x7fab80073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 0x7fab80073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38242/0 (socket says 172.21.15.31:38242) 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 -- 172.21.15.31:0/3359892731 learned_addr learned my addr 172.21.15.31:0/3359892731 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7e59c700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab80100240 0x7fab80074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 -- 172.21.15.31:0/3359892731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab80100240 msgr2=0x7fab80074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab80100240 0x7fab80074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 -- 172.21.15.31:0/3359892731 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700095f0 con 0x7fab80101440 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab7dd9b700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 0x7fab80073140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab7400b4b0 tx=0x7fab7400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab74011800 con 0x7fab80101440 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.059+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab74011e10 con 0x7fab80101440 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.060+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab80073aa0 con 0x7fab80101440 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.060+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7400f2e0 con 0x7fab80101440 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.060+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8019dbc0 con 0x7fab80101440 2024-09-17T01:57:27.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.061+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab80108e10 con 0x7fab80101440 2024-09-17T01:57:27.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.061+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fab74010380 con 0x7fab80101440 2024-09-17T01:57:27.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.062+0000 7fab6f7fe700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fab6806e680 0x7fab68070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.062+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fab7408e170 con 0x7fab80101440 2024-09-17T01:57:27.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.062+0000 7fab7e59c700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fab6806e680 0x7fab68070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.062+0000 7fab7e59c700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fab6806e680 0x7fab68070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab70006010 tx=0x7fab7000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:27.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.066+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fab7405aea0 con 0x7fab80101440 2024-09-17T01:57:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.300+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab80105d90 con 0x7fab6806e680 2024-09-17T01:57:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.301+0000 7fab6f7fe700 1 -- 172.21.15.31:0/3359892731 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fab80105d90 con 0x7fab6806e680 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fab6806e680 msgr2=0x7fab68070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fab6806e680 0x7fab68070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab70006010 tx=0x7fab7000b560 comp rx=0 tx=0).stop 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 msgr2=0x7fab80073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 0x7fab80073140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab7400b4b0 tx=0x7fab7400b7c0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 shutdown_connections 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fab6806e680 0x7fab68070b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab80100240 0x7fab80074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 --2- 172.21.15.31:0/3359892731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab80101440 0x7fab80073140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 >> 172.21.15.31:0/3359892731 conn(0x7fab800fb7f0 msgr2=0x7fab80104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 shutdown_connections 2024-09-17T01:57:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.303+0000 7fab848c5700 1 -- 172.21.15.31:0/3359892731 wait complete. 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 -- 172.21.15.31:0/1837770735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0069230 msgr2=0x7f62f0102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/1837770735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0069230 0x7f62f0102e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009910 tx=0x7f62e0009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 -- 172.21.15.31:0/1837770735 shutdown_connections 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/1837770735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0103350 0x7f62f0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/1837770735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0069230 0x7f62f0102e10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 -- 172.21.15.31:0/1837770735 >> 172.21.15.31:0/1837770735 conn(0x7f62f00fa780 msgr2=0x7f62f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 -- 172.21.15.31:0/1837770735 shutdown_connections 2024-09-17T01:57:27.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.412+0000 7f62f5ad6700 1 -- 172.21.15.31:0/1837770735 wait complete. 2024-09-17T01:57:27.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62f5ad6700 1 Processor -- start 2024-09-17T01:57:27.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62f5ad6700 1 -- start start 2024-09-17T01:57:27.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62f5ad6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0069230 0x7f62f0197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62f5ad6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 0x7f62f01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62f5ad6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01987f0 con 0x7f62f0103350 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62f5ad6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0198960 con 0x7f62f0069230 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 0x7f62f01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 0x7f62f01981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38260/0 (socket says 172.21.15.31:38260) 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62eeffd700 1 -- 172.21.15.31:0/2199324770 learned_addr learned my addr 172.21.15.31:0/2199324770 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62ef7fe700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0069230 0x7f62f0197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62eeffd700 1 -- 172.21.15.31:0/2199324770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0069230 msgr2=0x7f62f0197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62eeffd700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0069230 0x7f62f0197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.413+0000 7f62eeffd700 1 -- 172.21.15.31:0/2199324770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00095f0 con 0x7f62f0103350 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62ef7fe700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0069230 0x7f62f0197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62eeffd700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 0x7f62f01981f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62d800e920 tx=0x7f62d800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8009790 con 0x7f62f0103350 2024-09-17T01:57:27.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62d800cba0 con 0x7f62f0103350 2024-09-17T01:57:27.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f019d3f0 con 0x7f62f0103350 2024-09-17T01:57:27.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8018630 con 0x7f62f0103350 2024-09-17T01:57:27.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.414+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f019d940 con 0x7f62f0103350 2024-09-17T01:57:27.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.415+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0108cf0 con 0x7f62f0103350 2024-09-17T01:57:27.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.415+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f62d800cd10 con 0x7f62f0103350 2024-09-17T01:57:27.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.416+0000 7f62ecff9700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f62dc06e680 0x7f62dc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.416+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f62d8014070 con 0x7f62f0103350 2024-09-17T01:57:27.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.416+0000 7f62ef7fe700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f62dc06e680 0x7f62dc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.416+0000 7f62ef7fe700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f62dc06e680 0x7f62dc070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62f0198b90 tx=0x7f62e0005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:27.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.420+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f62d80541b0 con 0x7f62f0103350 2024-09-17T01:57:27.577 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:27 smithi092 ceph-mon[64495]: pgmap v144: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5/324 objects degraded (1.543%) 2024-09-17T01:57:27.578 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:27 smithi092 ceph-mon[64495]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:27.578 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 podman[72530]: 2024-09-17 01:57:27.264451229 +0000 UTC m=+0.601714741 container remove b4735eeb048cd4a37a84f9384bf89aa611f7714a87997f0aaeda868031367efb (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-17T01:57:27.578 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 podman[72590]: 2024-09-17 01:57:27.373933478 +0000 UTC m=+0.016181740 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:57:27.578 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 podman[72590]: 2024-09-17 01:57:27.481791365 +0000 UTC m=+0.124039605 container create 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:57:27.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.643+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f62f00ff2e0 con 0x7f62dc06e680 2024-09-17T01:57:27.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:27 smithi031 ceph-mon[77274]: pgmap v144: 65 pgs: 3 active+undersized, 27 peering, 2 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5/324 objects degraded (1.543%) 2024-09-17T01:57:27.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:27 smithi031 ceph-mon[77274]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:27.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.653+0000 7f62ecff9700 1 -- 172.21.15.31:0/2199324770 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f62f00ff2e0 con 0x7f62dc06e680 2024-09-17T01:57:27.652 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:57:27.652 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (12m) 62s ago 13m 24.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (13m) 62s ago 13m 8480k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (12m) 29s ago 12m 8061k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (2m) 62s ago 13m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (2m) 29s ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (12m) 62s ago 13m 87.1M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (8m) 62s ago 8m 62.9M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (8m) 62s ago 8m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (8m) 29s ago 8m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (8m) 29s ago 8m 118M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (4m) 62s ago 15m 500M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (4m) 29s ago 12m 441M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:57:27.653 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (3m) 62s ago 15m 47.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (3m) 29s ago 12m 40.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (13m) 62s ago 13m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (12m) 29s ago 12m 15.0M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (2m) 62s ago 11m 89.7M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (103s) 62s ago 11m 103M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (68s) 62s ago 10m 11.2M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (33s) 29s ago 10m 11.2M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (10m) 29s ago 10m 236M 2240M 18.2.0 dc2bc1663786 e65965d937a2 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (9m) 29s ago 9m 229M 2240M 18.2.0 dc2bc1663786 1a0f2a9fe02b 2024-09-17T01:57:27.654 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (4m) 62s ago 13m 75.0M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:57:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f62dc06e680 msgr2=0x7f62dc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f62dc06e680 0x7f62dc070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62f0198b90 tx=0x7f62e0005a90 comp rx=0 tx=0).stop 2024-09-17T01:57:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 msgr2=0x7f62f01981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 0x7f62f01981f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62d800e920 tx=0x7f62d800ece0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 shutdown_connections 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f62dc06e680 0x7f62dc070b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62f0069230 0x7f62f0197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 --2- 172.21.15.31:0/2199324770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62f0103350 0x7f62f01981f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 >> 172.21.15.31:0/2199324770 conn(0x7f62f00fa780 msgr2=0x7f62f00febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 shutdown_connections 2024-09-17T01:57:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.655+0000 7f62f5ad6700 1 -- 172.21.15.31:0/2199324770 wait complete. 2024-09-17T01:57:27.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 -- 172.21.15.31:0/4104593286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c100d60 msgr2=0x7f5e7c103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 --2- 172.21.15.31:0/4104593286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c100d60 0x7f5e7c103140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009910 tx=0x7f5e78009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 -- 172.21.15.31:0/4104593286 shutdown_connections 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 --2- 172.21.15.31:0/4104593286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7c103680 0x7f5e7c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 --2- 172.21.15.31:0/4104593286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c100d60 0x7f5e7c103140 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 -- 172.21.15.31:0/4104593286 >> 172.21.15.31:0/4104593286 conn(0x7f5e7c0fa780 msgr2=0x7f5e7c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 -- 172.21.15.31:0/4104593286 shutdown_connections 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.762+0000 7f5e845e7700 1 -- 172.21.15.31:0/4104593286 wait complete. 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e845e7700 1 Processor -- start 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e845e7700 1 -- start start 2024-09-17T01:57:27.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e845e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7c100d60 0x7f5e7c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e845e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 0x7f5e7c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e845e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c198760 con 0x7f5e7c103680 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e845e7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1988d0 con 0x7f5e7c100d60 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e81b82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 0x7f5e7c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e81b82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 0x7f5e7c1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38272/0 (socket says 172.21.15.31:38272) 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e81b82700 1 -- 172.21.15.31:0/650166986 learned_addr learned my addr 172.21.15.31:0/650166986 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e82383700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7c100d60 0x7f5e7c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e81b82700 1 -- 172.21.15.31:0/650166986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7c100d60 msgr2=0x7f5e7c197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e81b82700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7c100d60 0x7f5e7c197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.763+0000 7f5e81b82700 1 -- 172.21.15.31:0/650166986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780095f0 con 0x7f5e7c103680 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.764+0000 7f5e81b82700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 0x7f5e7c1981f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c930 tx=0x7f5e6c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:27.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.764+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c007ad0 con 0x7f5e7c103680 2024-09-17T01:57:27.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.764+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e6c007c30 con 0x7f5e7c103680 2024-09-17T01:57:27.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.764+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c19d370 con 0x7f5e7c103680 2024-09-17T01:57:27.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.764+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c018630 con 0x7f5e7c103680 2024-09-17T01:57:27.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.764+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c19d8c0 con 0x7f5e7c103680 2024-09-17T01:57:27.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.765+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c0fc340 con 0x7f5e7c103680 2024-09-17T01:57:27.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.765+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5e6c00f450 con 0x7f5e7c103680 2024-09-17T01:57:27.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.766+0000 7f5e737fe700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5e6806e680 0x7f5e68070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:27.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.766+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f5e6c08e770 con 0x7f5e7c103680 2024-09-17T01:57:27.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.766+0000 7f5e82383700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5e6806e680 0x7f5e68070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:27.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.766+0000 7f5e82383700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5e6806e680 0x7f5e68070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005090 tx=0x7f5e7800b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:27.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:27.770+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e6c057970 con 0x7f5e7c103680 2024-09-17T01:57:27.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 podman[72590]: 2024-09-17 01:57:27.700962797 +0000 UTC m=+0.343211056 container init 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:57:27.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 podman[72590]: 2024-09-17 01:57:27.704099907 +0000 UTC m=+0.346348152 container start 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:57:27.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 ceph-osd[72609]: -- 172.21.15.92:0/273035828 <== mon.1 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558878a301e0 con 0x558877c45c00 2024-09-17T01:57:27.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 bash[72590]: 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d 2024-09-17T01:57:27.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:27 smithi092 systemd[1]: Started Ceph osd.4 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:57:28.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.090+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e7c02cc30 con 0x7f5e7c103680 2024-09-17T01:57:28.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.090+0000 7f5e737fe700 1 -- 172.21.15.31:0/650166986 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f5e6c05b030 con 0x7f5e7c103680 2024-09-17T01:57:28.088 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:57:28.088 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:57:28.088 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:57:28.089 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:57:28.090 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-17T01:57:28.090 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:57:28.090 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:57:28.090 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:57:28.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5e6806e680 msgr2=0x7f5e68070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5e6806e680 0x7f5e68070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005090 tx=0x7f5e7800b560 comp rx=0 tx=0).stop 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 msgr2=0x7f5e7c1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 0x7f5e7c1981f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c930 tx=0x7f5e6c00ccf0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 shutdown_connections 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5e6806e680 0x7f5e68070b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e7c100d60 0x7f5e7c197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 --2- 172.21.15.31:0/650166986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7c103680 0x7f5e7c1981f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 >> 172.21.15.31:0/650166986 conn(0x7f5e7c0fa780 msgr2=0x7f5e7c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 shutdown_connections 2024-09-17T01:57:28.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.093+0000 7f5e845e7700 1 -- 172.21.15.31:0/650166986 wait complete. 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 -- 172.21.15.31:0/3039564323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 msgr2=0x7f585c100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 --2- 172.21.15.31:0/3039564323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c100660 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5858009910 tx=0x7f5858009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 -- 172.21.15.31:0/3039564323 shutdown_connections 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 --2- 172.21.15.31:0/3039564323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c101450 0x7f585c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 --2- 172.21.15.31:0/3039564323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c100660 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 -- 172.21.15.31:0/3039564323 >> 172.21.15.31:0/3039564323 conn(0x7f585c0fb7e0 msgr2=0x7f585c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 -- 172.21.15.31:0/3039564323 shutdown_connections 2024-09-17T01:57:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.205+0000 7f58646d9700 1 -- 172.21.15.31:0/3039564323 wait complete. 2024-09-17T01:57:28.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f58646d9700 1 Processor -- start 2024-09-17T01:57:28.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f58646d9700 1 -- start start 2024-09-17T01:57:28.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f58646d9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f58646d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c101450 0x7f585c196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f58646d9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c196640 con 0x7f585c100250 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f58646d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c196780 con 0x7f585c101450 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5862475700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5862475700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38298/0 (socket says 172.21.15.31:38298) 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5862475700 1 -- 172.21.15.31:0/3657161860 learned_addr learned my addr 172.21.15.31:0/3657161860 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5861c74700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c101450 0x7f585c196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5862475700 1 -- 172.21.15.31:0/3657161860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c101450 msgr2=0x7f585c196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5862475700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c101450 0x7f585c196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.206+0000 7f5862475700 1 -- 172.21.15.31:0/3657161860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580095f0 con 0x7f585c100250 2024-09-17T01:57:28.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.207+0000 7f5862475700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c195ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5858000c00 tx=0x7f585800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:28.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.207+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585801d070 con 0x7f585c100250 2024-09-17T01:57:28.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.207+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c19b1d0 con 0x7f585c100250 2024-09-17T01:57:28.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.207+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5858005dc0 con 0x7f585c100250 2024-09-17T01:57:28.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.207+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5858022470 con 0x7f585c100250 2024-09-17T01:57:28.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.207+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c19b6c0 con 0x7f585c100250 2024-09-17T01:57:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.208+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c108da0 con 0x7f585c100250 2024-09-17T01:57:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.209+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5858017400 con 0x7f585c100250 2024-09-17T01:57:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.209+0000 7f58537fe700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f584806e680 0x7f5848070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.209+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f585808fbb0 con 0x7f585c100250 2024-09-17T01:57:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.209+0000 7f5861c74700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f584806e680 0x7f5848070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.210+0000 7f5861c74700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f584806e680 0x7f5848070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f584c009c60 tx=0x7f584c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.214+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5858096080 con 0x7f585c100250 2024-09-17T01:57:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.474+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f585c19c180 con 0x7f585c100250 2024-09-17T01:57:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.475+0000 7f58537fe700 1 -- 172.21.15.31:0/3657161860 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1952 (secure 0 0 0) 0x7f585805c860 con 0x7f585c100250 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:e19 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:56:23:987796+0000 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:57:28.476 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 19 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:56:23.845837+0000 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:57:28.477 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:57:28.478 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:57:28.479 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f584806e680 msgr2=0x7f5848070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f584806e680 0x7f5848070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f584c009c60 tx=0x7f584c009260 comp rx=0 tx=0).stop 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 msgr2=0x7f585c195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c195ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5858000c00 tx=0x7f585800f690 comp rx=0 tx=0).stop 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 shutdown_connections 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f584806e680 0x7f5848070b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f585c100250 0x7f585c195ae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 --2- 172.21.15.31:0/3657161860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c101450 0x7f585c196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.477+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 >> 172.21.15.31:0/3657161860 conn(0x7f585c0fb7e0 msgr2=0x7f585c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:28.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.478+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 shutdown_connections 2024-09-17T01:57:28.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.478+0000 7f58646d9700 1 -- 172.21.15.31:0/3657161860 wait complete. 2024-09-17T01:57:28.481 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-09-17T01:57:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 -- 172.21.15.31:0/3787269971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c1003f0 msgr2=0x7f923c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 --2- 172.21.15.31:0/3787269971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c1003f0 0x7f923c100860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9230009910 tx=0x7f9230009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 -- 172.21.15.31:0/3787269971 shutdown_connections 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 --2- 172.21.15.31:0/3787269971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c1003f0 0x7f923c100860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 --2- 172.21.15.31:0/3787269971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c0ff150 0x7f923c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 -- 172.21.15.31:0/3787269971 >> 172.21.15.31:0/3787269971 conn(0x7f923c0fa7a0 msgr2=0x7f923c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 -- 172.21.15.31:0/3787269971 shutdown_connections 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.588+0000 7f9242a13700 1 -- 172.21.15.31:0/3787269971 wait complete. 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f9242a13700 1 Processor -- start 2024-09-17T01:57:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f9242a13700 1 -- start start 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f9242a13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 0x7f923c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f9242a13700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c1003f0 0x7f923c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f9242a13700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c19b0e0 con 0x7f923c0ff150 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f9242a13700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c19b220 con 0x7f923c1003f0 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f923bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 0x7f923c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f923bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 0x7f923c069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38324/0 (socket says 172.21.15.31:38324) 2024-09-17T01:57:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f923b7fe700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c1003f0 0x7f923c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.589+0000 7f923bfff700 1 -- 172.21.15.31:0/2980260404 learned_addr learned my addr 172.21.15.31:0/2980260404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f923bfff700 1 -- 172.21.15.31:0/2980260404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c1003f0 msgr2=0x7f923c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f923bfff700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c1003f0 0x7f923c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f923bfff700 1 -- 172.21.15.31:0/2980260404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300095f0 con 0x7f923c0ff150 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f923b7fe700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c1003f0 0x7f923c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f923bfff700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 0x7f923c069930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f922c00d900 tx=0x7f922c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922c0041f0 con 0x7f923c0ff150 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f922c004ce0 con 0x7f923c0ff150 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c19b500 con 0x7f923c0ff150 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f922c00b750 con 0x7f923c0ff150 2024-09-17T01:57:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.590+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c19ba50 con 0x7f923c0ff150 2024-09-17T01:57:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.591+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c068ab0 con 0x7f923c0ff150 2024-09-17T01:57:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.591+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f922c004750 con 0x7f923c0ff150 2024-09-17T01:57:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.592+0000 7f92397fa700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f922406e680 0x7f9224070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.592+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f922c08e540 con 0x7f923c0ff150 2024-09-17T01:57:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.592+0000 7f923b7fe700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f922406e680 0x7f9224070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.592+0000 7f923b7fe700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f922406e680 0x7f9224070b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f923c069eb0 tx=0x7f923000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:28.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.596+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f922c05b1f0 con 0x7f923c0ff150 2024-09-17T01:57:28.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.827+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f923c104e40 con 0x7f922406e680 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.828+0000 7f92397fa700 1 -- 172.21.15.31:0/2980260404 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f923c104e40 con 0x7f922406e680 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:57:28.826 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:57:28.827 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:57:28.827 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:57:28.827 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "10/23 daemons upgraded", 2024-09-17T01:57:28.827 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:57:28.827 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:57:28.827 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:57:28.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f922406e680 msgr2=0x7f9224070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f922406e680 0x7f9224070b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f923c069eb0 tx=0x7f923000b540 comp rx=0 tx=0).stop 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 msgr2=0x7f923c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 0x7f923c069930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f922c00d900 tx=0x7f922c00dc10 comp rx=0 tx=0).stop 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 shutdown_connections 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f922406e680 0x7f9224070b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f923c0ff150 0x7f923c069930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 --2- 172.21.15.31:0/2980260404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c1003f0 0x7f923c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 >> 172.21.15.31:0/2980260404 conn(0x7f923c0fa7a0 msgr2=0x7f923c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 shutdown_connections 2024-09-17T01:57:28.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.831+0000 7f9242a13700 1 -- 172.21.15.31:0/2980260404 wait complete. 2024-09-17T01:57:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.941+0000 7f1510694700 1 -- 172.21.15.31:0/541567832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15081003f0 msgr2=0x7f1508100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.941+0000 7f1510694700 1 --2- 172.21.15.31:0/541567832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15081003f0 0x7f1508100860 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009910 tx=0x7f14fc009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- 172.21.15.31:0/541567832 shutdown_connections 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 --2- 172.21.15.31:0/541567832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15081003f0 0x7f1508100860 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 --2- 172.21.15.31:0/541567832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15080ff150 0x7f15080ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- 172.21.15.31:0/541567832 >> 172.21.15.31:0/541567832 conn(0x7f15080fa7a0 msgr2=0x7f15080fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- 172.21.15.31:0/541567832 shutdown_connections 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- 172.21.15.31:0/541567832 wait complete. 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 Processor -- start 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- start start 2024-09-17T01:57:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 0x7f1508197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15081003f0 0x7f15081984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508198b10 con 0x7f15080ff150 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.942+0000 7f1510694700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508198c50 con 0x7f15081003f0 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 0x7f1508197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 0x7f1508197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38336/0 (socket says 172.21.15.31:38336) 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 -- 172.21.15.31:0/785885474 learned_addr learned my addr 172.21.15.31:0/785885474 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150dc2f700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15081003f0 0x7f15081984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 -- 172.21.15.31:0/785885474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15081003f0 msgr2=0x7f15081984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15081003f0 0x7f15081984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 -- 172.21.15.31:0/785885474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0095f0 con 0x7f15080ff150 2024-09-17T01:57:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f150e430700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 0x7f1508197fb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f150400d900 tx=0x7f150400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15040041f0 con 0x7f15080ff150 2024-09-17T01:57:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1504004ce0 con 0x7f15080ff150 2024-09-17T01:57:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150819d700 con 0x7f15080ff150 2024-09-17T01:57:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150400b750 con 0x7f15080ff150 2024-09-17T01:57:28.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.943+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150819dc50 con 0x7f15080ff150 2024-09-17T01:57:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.944+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1508068ab0 con 0x7f15080ff150 2024-09-17T01:57:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.945+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1504004e50 con 0x7f15080ff150 2024-09-17T01:57:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.945+0000 7f14fb7fe700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f14f406e680 0x7f14f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.946+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f150408e660 con 0x7f15080ff150 2024-09-17T01:57:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.946+0000 7f150dc2f700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f14f406e680 0x7f14f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.946+0000 7f150dc2f700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f14f406e680 0x7f14f4070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006010 tx=0x7f14fc00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:28.950+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f150405b270 con 0x7f15080ff150 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/650166986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:29.154 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:28 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3657161860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:57:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.261+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f150819df60 con 0x7f15080ff150 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/650166986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:29.260 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:28 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3657161860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.262+0000 7f14fb7fe700 1 -- 172.21.15.31:0/785885474 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1162 (secure 0 0 0) 0x7f150405ae00 con 0x7f15080ff150 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 54/324 objects degraded (16.667%), 16 pgs degraded 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: osd.4 (root=default,host=smithi092) is down 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/324 objects degraded (16.667%), 16 pgs degraded 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-17T01:57:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-17T01:57:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1f is active+undersized+degraded, acting [2,3] 2024-09-17T01:57:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f14f406e680 msgr2=0x7f14f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f14f406e680 0x7f14f4070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006010 tx=0x7f14fc00b540 comp rx=0 tx=0).stop 2024-09-17T01:57:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 msgr2=0x7f1508197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 0x7f1508197fb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f150400d900 tx=0x7f150400dc10 comp rx=0 tx=0).stop 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 shutdown_connections 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f14f406e680 0x7f14f4070b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15080ff150 0x7f1508197fb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 --2- 172.21.15.31:0/785885474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15081003f0 0x7f15081984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 >> 172.21.15.31:0/785885474 conn(0x7f15080fa7a0 msgr2=0x7f1508068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 shutdown_connections 2024-09-17T01:57:29.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:29.265+0000 7f1510694700 1 -- 172.21.15.31:0/785885474 wait complete. 2024-09-17T01:57:29.845 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T01:57:29.592+0000 7fdb2d88e640 -1 Falling back to public interface 2024-09-17T01:57:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:29 smithi092 ceph-mon[64495]: pgmap v145: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:29 smithi092 ceph-mon[64495]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:29 smithi092 ceph-mon[64495]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-17T01:57:30.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:29 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/785885474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:57:30.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:29 smithi031 ceph-mon[77274]: pgmap v145: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:30.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:29 smithi031 ceph-mon[77274]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:57:30.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:29 smithi031 ceph-mon[77274]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-17T01:57:30.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:29 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/785885474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:57:31.800 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:31 smithi092 ceph-mon[64495]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/324 objects degraded (16.667%) 2024-09-17T01:57:31.800 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:31.800 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:31.800 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:31.801 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:31 smithi031 ceph-mon[77274]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/324 objects degraded (16.667%) 2024-09-17T01:57:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:32.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:32.821 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:32 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 54/324 objects degraded (16.667%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:33.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:32 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 54/324 objects degraded (16.667%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:33.792 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:33 smithi031 ceph-mon[77274]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:33.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:33 smithi092 ceph-mon[64495]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:35.489 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T01:57:35.207+0000 7fdb2d88e640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-17T01:57:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:57:35.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:35.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-mon[64495]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:57:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:35 smithi031 ceph-mon[77274]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:57:35.989 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:35 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T01:57:35.616+0000 7fdb2d88e640 -1 osd.4 79 log_to_monitors true 2024-09-17T01:57:36.489 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 01:57:36 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T01:57:36.303+0000 7fdb25628640 -1 osd.4 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:57:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:36 smithi092 ceph-mon[64495]: pgmap v148: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:36.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:36.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:36 smithi092 ceph-mon[64495]: from='osd.4 [v2:172.21.15.92:6808/2295087807,v1:172.21.15.92:6809/2295087807]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:57:36.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:36 smithi092 ceph-mon[64495]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:57:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:36 smithi031 ceph-mon[77274]: pgmap v148: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:36 smithi031 ceph-mon[77274]: from='osd.4 [v2:172.21.15.92:6808/2295087807,v1:172.21.15.92:6809/2295087807]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:57:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:36 smithi031 ceph-mon[77274]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:57:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:37 smithi092 ceph-mon[64495]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:37 smithi092 ceph-mon[64495]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:57:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:37 smithi092 ceph-mon[64495]: from='osd.4 [v2:172.21.15.92:6808/2295087807,v1:172.21.15.92:6809/2295087807]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:37 smithi092 ceph-mon[64495]: osdmap e82: 6 total, 5 up, 6 in 2024-09-17T01:57:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:37 smithi092 ceph-mon[64495]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:37 smithi031 ceph-mon[77274]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 54/324 objects degraded (16.667%) 2024-09-17T01:57:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:37 smithi031 ceph-mon[77274]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:57:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:37 smithi031 ceph-mon[77274]: from='osd.4 [v2:172.21.15.92:6808/2295087807,v1:172.21.15.92:6809/2295087807]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:37.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:37 smithi031 ceph-mon[77274]: osdmap e82: 6 total, 5 up, 6 in 2024-09-17T01:57:37.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:37 smithi031 ceph-mon[77274]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:57:38.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:38 smithi031 ceph-mon[77274]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:57:38.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:38 smithi031 ceph-mon[77274]: osd.4 [v2:172.21.15.92:6808/2295087807,v1:172.21.15.92:6809/2295087807] boot 2024-09-17T01:57:38.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:38 smithi031 ceph-mon[77274]: osdmap e83: 6 total, 6 up, 6 in 2024-09-17T01:57:38.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:57:38.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:38 smithi031 ceph-mon[77274]: osdmap e84: 6 total, 6 up, 6 in 2024-09-17T01:57:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:38 smithi092 ceph-mon[64495]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:57:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:38 smithi092 ceph-mon[64495]: osd.4 [v2:172.21.15.92:6808/2295087807,v1:172.21.15.92:6809/2295087807] boot 2024-09-17T01:57:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:38 smithi092 ceph-mon[64495]: osdmap e83: 6 total, 6 up, 6 in 2024-09-17T01:57:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:57:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:38 smithi092 ceph-mon[64495]: osdmap e84: 6 total, 6 up, 6 in 2024-09-17T01:57:39.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:39 smithi092 ceph-mon[64495]: pgmap v152: 65 pgs: 23 peering, 5 active+undersized, 4 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 9/324 objects degraded (2.778%) 2024-09-17T01:57:39.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:39 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 9/324 objects degraded (2.778%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:39.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:39 smithi031 ceph-mon[77274]: pgmap v152: 65 pgs: 23 peering, 5 active+undersized, 4 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 9/324 objects degraded (2.778%) 2024-09-17T01:57:39.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:39 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 9/324 objects degraded (2.778%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:41.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:41 smithi092 ceph-mon[64495]: pgmap v154: 65 pgs: 23 peering, 5 active+undersized, 4 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 9/324 objects degraded (2.778%) 2024-09-17T01:57:41.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:41 smithi031 ceph-mon[77274]: pgmap v154: 65 pgs: 23 peering, 5 active+undersized, 4 active+undersized+degraded, 33 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 9/324 objects degraded (2.778%) 2024-09-17T01:57:42.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:42 smithi092 ceph-mon[64495]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/324 objects degraded (2.778%), 4 pgs degraded) 2024-09-17T01:57:42.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:42 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:57:42.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:42 smithi031 ceph-mon[77274]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/324 objects degraded (2.778%), 4 pgs degraded) 2024-09-17T01:57:42.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:42 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:57:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:43 smithi031 ceph-mon[77274]: pgmap v155: 65 pgs: 23 peering, 42 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:57:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:43 smithi092 ceph-mon[64495]: pgmap v155: 65 pgs: 23 peering, 42 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:57:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:45 smithi092 ceph-mon[64495]: pgmap v156: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:57:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:45 smithi031 ceph-mon[77274]: pgmap v156: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:57:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:47 smithi092 ceph-mon[64495]: pgmap v157: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:57:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:47 smithi031 ceph-mon[77274]: pgmap v157: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:57:49.631 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:49 smithi092 ceph-mon[64495]: pgmap v158: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:57:49.631 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:49 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:49.632 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:49 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:49.632 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:49 smithi092 ceph-mon[64495]: Upgrade: osd.5 is safe to restart 2024-09-17T01:57:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:49 smithi031 ceph-mon[77274]: pgmap v158: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:57:49.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:49 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:49.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:49 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:57:49.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:49 smithi031 ceph-mon[77274]: Upgrade: osd.5 is safe to restart 2024-09-17T01:57:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: pgmap v159: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:57:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: Upgrade: Updating osd.5 2024-09-17T01:57:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:57:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:51 smithi092 ceph-mon[64495]: Deploying daemon osd.5 on smithi092 2024-09-17T01:57:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: pgmap v159: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: Upgrade: Updating osd.5 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:57:51.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:51 smithi031 ceph-mon[77274]: Deploying daemon osd.5 on smithi092 2024-09-17T01:57:53.398 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:53 smithi092 ceph-mon[64495]: pgmap v160: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:57:53.681 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:53 smithi092 systemd[1]: Stopping Ceph osd.5 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:57:53.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:53 smithi031 ceph-mon[77274]: pgmap v160: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:57:53.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[48809]: 2024-09-17T01:57:53.683+0000 7fed44a66700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:57:53.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[48809]: 2024-09-17T01:57:53.683+0000 7fed44a66700 -1 osd.5 84 *** Got signal Terminated *** 2024-09-17T01:57:53.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:53 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[48809]: 2024-09-17T01:57:53.683+0000 7fed44a66700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:57:54.609 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:54 smithi092 ceph-mon[64495]: osd.5 marked itself down and dead 2024-09-17T01:57:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:54 smithi031 ceph-mon[77274]: osd.5 marked itself down and dead 2024-09-17T01:57:54.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:54 smithi092 podman[75105]: 2024-09-17 01:57:54.781321809 +0000 UTC m=+1.229551953 container died 1a0f2a9fe02bd7fd6df097c379408f12ecdd3bd1645775586cbd2dd4537187ed (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0) 2024-09-17T01:57:55.448 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 podman[75105]: 2024-09-17 01:57:55.165988875 +0000 UTC m=+1.614219018 container cleanup 1a0f2a9fe02bd7fd6df097c379408f12ecdd3bd1645775586cbd2dd4537187ed (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.license=GPLv2) 2024-09-17T01:57:55.449 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 bash[75105]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:57:55.449 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:55 smithi092 ceph-mon[64495]: pgmap v161: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:55.449 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:55 smithi092 ceph-mon[64495]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:57:55.449 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:55 smithi092 ceph-mon[64495]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:57:55.449 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:55 smithi092 ceph-mon[64495]: osdmap e85: 6 total, 5 up, 6 in 2024-09-17T01:57:55.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 podman[75131]: 2024-09-17 01:57:55.451071222 +0000 UTC m=+0.667075168 container remove 1a0f2a9fe02bd7fd6df097c379408f12ecdd3bd1645775586cbd2dd4537187ed (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, ceph=True, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0) 2024-09-17T01:57:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:55 smithi031 ceph-mon[77274]: pgmap v161: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:55 smithi031 ceph-mon[77274]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:57:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:55 smithi031 ceph-mon[77274]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:57:55.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:55 smithi031 ceph-mon[77274]: osdmap e85: 6 total, 5 up, 6 in 2024-09-17T01:57:56.093 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 podman[75221]: 2024-09-17 01:57:55.667191379 +0000 UTC m=+0.016618735 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:57:56.093 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 podman[75221]: 2024-09-17 01:57:55.776723926 +0000 UTC m=+0.126151265 container create 2b87499fad5049699e122018a4e991f725d2ee963eac934f4140d9298e55cde8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-17T01:57:56.093 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 podman[75221]: 2024-09-17 01:57:55.995731977 +0000 UTC m=+0.345159333 container init 2b87499fad5049699e122018a4e991f725d2ee963eac934f4140d9298e55cde8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-17T01:57:56.093 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:55 smithi092 podman[75221]: 2024-09-17 01:57:55.999168442 +0000 UTC m=+0.348595781 container start 2b87499fad5049699e122018a4e991f725d2ee963eac934f4140d9298e55cde8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:57:56.093 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:56 smithi092 podman[75221]: 2024-09-17 01:57:56.095628313 +0000 UTC m=+0.445055654 container attach 2b87499fad5049699e122018a4e991f725d2ee963eac934f4140d9298e55cde8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2) 2024-09-17T01:57:56.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:56 smithi092 ceph-mon[64495]: osdmap e86: 6 total, 5 up, 6 in 2024-09-17T01:57:56.490 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:56 smithi092 podman[75221]: 2024-09-17 01:57:56.185158513 +0000 UTC m=+0.534585862 container died 2b87499fad5049699e122018a4e991f725d2ee963eac934f4140d9298e55cde8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T01:57:56.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:56 smithi031 ceph-mon[77274]: osdmap e86: 6 total, 5 up, 6 in 2024-09-17T01:57:57.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:56 smithi092 podman[75244]: 2024-09-17 01:57:56.832984894 +0000 UTC m=+0.638463919 container remove 2b87499fad5049699e122018a4e991f725d2ee963eac934f4140d9298e55cde8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:57:57.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:56 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T01:57:57.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:56 smithi092 systemd[1]: Stopped Ceph osd.5 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:57:57.240 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:56 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 5.914s CPU time. 2024-09-17T01:57:57.240 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 systemd[1]: Starting Ceph osd.5 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T01:57:57.553 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:57 smithi092 ceph-mon[64495]: pgmap v164: 65 pgs: 13 stale+active+clean, 52 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:57:57.553 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 podman[75344]: 2024-09-17 01:57:57.17932747 +0000 UTC m=+0.016275321 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:57:57.553 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 podman[75344]: 2024-09-17 01:57:57.317053973 +0000 UTC m=+0.154001817 container create 7071eb2dd0573b754d0c3d5a64008f34b7c4bb19e376cba3efaad4de02845969 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T01:57:57.553 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 podman[75344]: 2024-09-17 01:57:57.552847921 +0000 UTC m=+0.389795775 container init 7071eb2dd0573b754d0c3d5a64008f34b7c4bb19e376cba3efaad4de02845969 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T01:57:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:57 smithi031 ceph-mon[77274]: pgmap v164: 65 pgs: 13 stale+active+clean, 52 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:57:57.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 podman[75344]: 2024-09-17 01:57:57.556159995 +0000 UTC m=+0.393107840 container start 7071eb2dd0573b754d0c3d5a64008f34b7c4bb19e376cba3efaad4de02845969 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:57:57.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 podman[75344]: 2024-09-17 01:57:57.627862159 +0000 UTC m=+0.464810021 container attach 7071eb2dd0573b754d0c3d5a64008f34b7c4bb19e376cba3efaad4de02845969 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-17T01:57:57.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:57.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 bash[75344]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:57.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:57.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:57 smithi092 bash[75344]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:57:58.414 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-mon[64495]: Health check failed: Degraded data redundancy: 49/324 objects degraded (15.123%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:58.703 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:57:58.703 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:57:58.703 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:57:58.703 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:57:58.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:58 smithi031 ceph-mon[77274]: Health check failed: Degraded data redundancy: 49/324 objects degraded (15.123%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:57:58.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:57:58.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:57:58.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:57:58.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:57:58.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:57:58.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:57:58.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:57:58.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:57:58.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate[75359]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:57:58.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 bash[75344]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:57:58.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:58 smithi092 podman[75489]: 2024-09-17 01:57:58.756180468 +0000 UTC m=+0.016601113 container died 7071eb2dd0573b754d0c3d5a64008f34b7c4bb19e376cba3efaad4de02845969 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:57:59.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.390+0000 7fb7aac36700 1 -- 172.21.15.31:0/100780032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 msgr2=0x7fb7a4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.390+0000 7fb7aac36700 1 --2- 172.21.15.31:0/100780032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4100650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb798009910 tx=0x7fb798009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 -- 172.21.15.31:0/100780032 shutdown_connections 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 --2- 172.21.15.31:0/100780032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 0x7fb7a4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 --2- 172.21.15.31:0/100780032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4100650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 -- 172.21.15.31:0/100780032 >> 172.21.15.31:0/100780032 conn(0x7fb7a40fb7f0 msgr2=0x7fb7a40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 -- 172.21.15.31:0/100780032 shutdown_connections 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 -- 172.21.15.31:0/100780032 wait complete. 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 Processor -- start 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.391+0000 7fb7aac36700 1 -- start start 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7aac36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7aac36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 0x7fb7a4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7aac36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4196630 con 0x7fb7a4100240 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7aac36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4196770 con 0x7fb7a4101440 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a89d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a89d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36988/0 (socket says 172.21.15.31:36988) 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a89d2700 1 -- 172.21.15.31:0/83698427 learned_addr learned my addr 172.21.15.31:0/83698427 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a3fff700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 0x7fb7a4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a3fff700 1 -- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 msgr2=0x7fb7a4195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a3fff700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a3fff700 1 -- 172.21.15.31:0/83698427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7980095f0 con 0x7fb7a4101440 2024-09-17T01:57:59.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a89d2700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a3fff700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 0x7fb7a4196010 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e970 tx=0x7fb79000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb79000c9d0 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.392+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb790010430 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.393+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a419b220 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.393+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb790018650 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.393+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a419b770 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.394+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a4108d90 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.394+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb7900105a0 con 0x7fb7a4101440 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.395+0000 7fb7a1ffb700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb79406e680 0x7fb794070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.395+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fb790014070 con 0x7fb7a4101440 2024-09-17T01:57:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.395+0000 7fb7a89d2700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb79406e680 0x7fb794070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.395+0000 7fb7a89d2700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb79406e680 0x7fb794070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb798009fd0 tx=0x7fb798005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:59.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.400+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb7900541b0 con 0x7fb7a4101440 2024-09-17T01:57:59.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.635+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7a4105d90 con 0x7fb79406e680 2024-09-17T01:57:59.634 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:57:59 smithi031 ceph-mon[77274]: pgmap v165: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:57:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.637+0000 7fb7a1ffb700 1 -- 172.21.15.31:0/83698427 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb7a4105d90 con 0x7fb79406e680 2024-09-17T01:57:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb79406e680 msgr2=0x7fb794070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb79406e680 0x7fb794070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb798009fd0 tx=0x7fb798005940 comp rx=0 tx=0).stop 2024-09-17T01:57:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 msgr2=0x7fb7a4196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 0x7fb7a4196010 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb79000e970 tx=0x7fb79000ec80 comp rx=0 tx=0).stop 2024-09-17T01:57:59.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 shutdown_connections 2024-09-17T01:57:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb79406e680 0x7fb794070b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a4100240 0x7fb7a4195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 --2- 172.21.15.31:0/83698427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7a4101440 0x7fb7a4196010 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.639+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 >> 172.21.15.31:0/83698427 conn(0x7fb7a40fb7f0 msgr2=0x7fb7a4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.640+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 shutdown_connections 2024-09-17T01:57:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.640+0000 7fb7aac36700 1 -- 172.21.15.31:0/83698427 wait complete. 2024-09-17T01:57:59.644 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:57:59 smithi092 ceph-mon[64495]: pgmap v165: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:57:59.645 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 podman[75489]: 2024-09-17 01:57:59.339768045 +0000 UTC m=+0.600188683 container remove 7071eb2dd0573b754d0c3d5a64008f34b7c4bb19e376cba3efaad4de02845969 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-17T01:57:59.645 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 podman[75552]: 2024-09-17 01:57:59.449199057 +0000 UTC m=+0.015841856 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:57:59.645 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 podman[75552]: 2024-09-17 01:57:59.549422358 +0000 UTC m=+0.116065190 container create dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T01:57:59.648 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:57:59.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.749+0000 7faea3e78700 1 -- 172.21.15.31:0/3122055474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c100240 msgr2=0x7fae9c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:59.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.749+0000 7faea3e78700 1 --2- 172.21.15.31:0/3122055474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c100240 0x7fae9c100650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae98009910 tx=0x7fae98009c20 comp rx=0 tx=0).stop 2024-09-17T01:57:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.749+0000 7faea3e78700 1 -- 172.21.15.31:0/3122055474 shutdown_connections 2024-09-17T01:57:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.749+0000 7faea3e78700 1 --2- 172.21.15.31:0/3122055474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c101440 0x7fae9c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.750+0000 7faea3e78700 1 --2- 172.21.15.31:0/3122055474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c100240 0x7fae9c100650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.750+0000 7faea3e78700 1 -- 172.21.15.31:0/3122055474 >> 172.21.15.31:0/3122055474 conn(0x7fae9c0fb7f0 msgr2=0x7fae9c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:57:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.750+0000 7faea3e78700 1 -- 172.21.15.31:0/3122055474 shutdown_connections 2024-09-17T01:57:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.750+0000 7faea3e78700 1 -- 172.21.15.31:0/3122055474 wait complete. 2024-09-17T01:57:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.750+0000 7faea3e78700 1 Processor -- start 2024-09-17T01:57:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.750+0000 7faea3e78700 1 -- start start 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea3e78700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 0x7fae9c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea3e78700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c101440 0x7fae9c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea3e78700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c196630 con 0x7fae9c101440 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea3e78700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c196770 con 0x7fae9c100240 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1413700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c101440 0x7fae9c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 0x7fae9c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 0x7fae9c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:40770/0 (socket says 172.21.15.31:40770) 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 -- 172.21.15.31:0/2261944375 learned_addr learned my addr 172.21.15.31:0/2261944375 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 -- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c101440 msgr2=0x7fae9c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c101440 0x7fae9c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 -- 172.21.15.31:0/2261944375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980095f0 con 0x7fae9c100240 2024-09-17T01:57:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1413700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c101440 0x7fae9c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:57:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7faea1c14700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 0x7fae9c195ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae98000c00 tx=0x7fae9800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.751+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9801d070 con 0x7fae9c100240 2024-09-17T01:57:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.752+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fae98005dc0 con 0x7fae9c100240 2024-09-17T01:57:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.752+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c19b1c0 con 0x7fae9c100240 2024-09-17T01:57:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.752+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae98022470 con 0x7fae9c100240 2024-09-17T01:57:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.752+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c19b6b0 con 0x7fae9c100240 2024-09-17T01:57:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.753+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c108d90 con 0x7fae9c100240 2024-09-17T01:57:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.753+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fae98003810 con 0x7fae9c100240 2024-09-17T01:57:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.753+0000 7fae92ffd700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fae8806e680 0x7fae88070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:57:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.754+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fae9808fb60 con 0x7fae9c100240 2024-09-17T01:57:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.754+0000 7faea1413700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fae8806e680 0x7fae88070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:57:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.754+0000 7faea1413700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fae8806e680 0x7fae88070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae8c011490 tx=0x7fae8c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:57:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.758+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae9805c7f0 con 0x7fae9c100240 2024-09-17T01:57:59.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 podman[75552]: 2024-09-17 01:57:59.743095609 +0000 UTC m=+0.309738400 container init dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T01:57:59.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 podman[75552]: 2024-09-17 01:57:59.746193162 +0000 UTC m=+0.312835949 container start dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:57:59.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 ceph-osd[75571]: -- 172.21.15.92:0/3983161611 <== mon.1 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d588ca1e0 con 0x556d57a73c00 2024-09-17T01:57:59.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 bash[75552]: dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 2024-09-17T01:57:59.990 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:57:59 smithi092 systemd[1]: Started Ceph osd.5 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T01:57:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.998+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae9c19bd40 con 0x7fae8806e680 2024-09-17T01:57:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:57:59.999+0000 7fae92ffd700 1 -- 172.21.15.31:0/2261944375 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fae9c19bd40 con 0x7fae8806e680 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fae8806e680 msgr2=0x7fae88070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fae8806e680 0x7fae88070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae8c011490 tx=0x7fae8c009260 comp rx=0 tx=0).stop 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 msgr2=0x7fae9c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 0x7fae9c195ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae98000c00 tx=0x7fae9800f690 comp rx=0 tx=0).stop 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 shutdown_connections 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fae8806e680 0x7fae88070b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae9c100240 0x7fae9c195ad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 --2- 172.21.15.31:0/2261944375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae9c101440 0x7fae9c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 >> 172.21.15.31:0/2261944375 conn(0x7fae9c0fb7f0 msgr2=0x7fae9c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 shutdown_connections 2024-09-17T01:58:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.002+0000 7faea3e78700 1 -- 172.21.15.31:0/2261944375 wait complete. 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 -- 172.21.15.31:0/3834670599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0481003f0 msgr2=0x7ff048100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 --2- 172.21.15.31:0/3834670599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0481003f0 0x7ff048100860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff038009910 tx=0x7ff038009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 -- 172.21.15.31:0/3834670599 shutdown_connections 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 --2- 172.21.15.31:0/3834670599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0481003f0 0x7ff048100860 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 --2- 172.21.15.31:0/3834670599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0480ff150 0x7ff0480ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 -- 172.21.15.31:0/3834670599 >> 172.21.15.31:0/3834670599 conn(0x7ff0480fa7a0 msgr2=0x7ff0480fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 -- 172.21.15.31:0/3834670599 shutdown_connections 2024-09-17T01:58:00.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.111+0000 7ff04f664700 1 -- 172.21.15.31:0/3834670599 wait complete. 2024-09-17T01:58:00.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04f664700 1 Processor -- start 2024-09-17T01:58:00.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04f664700 1 -- start start 2024-09-17T01:58:00.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04f664700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 0x7ff048195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04f664700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0481003f0 0x7ff048196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04f664700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048196920 con 0x7ff0480ff150 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04f664700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048196a60 con 0x7ff0481003f0 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 0x7ff048195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 0x7ff048195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37014/0 (socket says 172.21.15.31:37014) 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 -- 172.21.15.31:0/911335125 learned_addr learned my addr 172.21.15.31:0/911335125 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04cbff700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0481003f0 0x7ff048196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 -- 172.21.15.31:0/911335125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0481003f0 msgr2=0x7ff048196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0481003f0 0x7ff048196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 -- 172.21.15.31:0/911335125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0380095f0 con 0x7ff0480ff150 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.112+0000 7ff04d400700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 0x7ff048195dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff04400e920 tx=0x7ff04400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:00.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.113+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04400c9d0 con 0x7ff0480ff150 2024-09-17T01:58:00.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.113+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff044010430 con 0x7ff0480ff150 2024-09-17T01:58:00.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.113+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04819b510 con 0x7ff0480ff150 2024-09-17T01:58:00.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.113+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff044018650 con 0x7ff0480ff150 2024-09-17T01:58:00.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.113+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04819ba60 con 0x7ff0480ff150 2024-09-17T01:58:00.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.114+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff048068ab0 con 0x7ff0480ff150 2024-09-17T01:58:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.114+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff0440105a0 con 0x7ff0480ff150 2024-09-17T01:58:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.115+0000 7ff03e7fc700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff03406e680 0x7ff034070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.115+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7ff044014070 con 0x7ff0480ff150 2024-09-17T01:58:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.115+0000 7ff04cbff700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff03406e680 0x7ff034070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.115+0000 7ff04cbff700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff03406e680 0x7ff034070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b6f0 tx=0x7ff038005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:00.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.119+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff0440541b0 con 0x7ff0480ff150 2024-09-17T01:58:00.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.348+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0480694e0 con 0x7ff03406e680 2024-09-17T01:58:00.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.357+0000 7ff03e7fc700 1 -- 172.21.15.31:0/911335125 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff0480694e0 con 0x7ff03406e680 2024-09-17T01:58:00.356 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:58:00.356 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (12m) 95s ago 14m 24.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:58:00.356 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (14m) 95s ago 14m 8480k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (13m) 29s ago 13m 8288k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (3m) 95s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (3m) 29s ago 13m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (12m) 95s ago 13m 87.1M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (8m) 95s ago 8m 62.9M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (8m) 95s ago 8m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (8m) 29s ago 8m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (8m) 29s ago 8m 119M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (5m) 95s ago 15m 500M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (4m) 29s ago 13m 442M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:58:00.357 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (4m) 95s ago 15m 47.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (3m) 29s ago 13m 36.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (14m) 95s ago 14m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (13m) 29s ago 13m 15.3M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (2m) 95s ago 12m 89.7M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (2m) 95s ago 11m 103M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (100s) 95s ago 11m 11.2M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (65s) 29s ago 11m 134M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (32s) 29s ago 10m 12.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 starting - - - 2240M 2024-09-17T01:58:00.358 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (4m) 95s ago 13m 75.0M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:58:00.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff03406e680 msgr2=0x7ff034070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff03406e680 0x7ff034070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b6f0 tx=0x7ff038005a90 comp rx=0 tx=0).stop 2024-09-17T01:58:00.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 msgr2=0x7ff048195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 0x7ff048195dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff04400e920 tx=0x7ff04400ec30 comp rx=0 tx=0).stop 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 shutdown_connections 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff03406e680 0x7ff034070b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0480ff150 0x7ff048195dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 --2- 172.21.15.31:0/911335125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0481003f0 0x7ff048196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 >> 172.21.15.31:0/911335125 conn(0x7ff0480fa7a0 msgr2=0x7ff048068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 shutdown_connections 2024-09-17T01:58:00.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.360+0000 7ff04f664700 1 -- 172.21.15.31:0/911335125 wait complete. 2024-09-17T01:58:00.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 -- 172.21.15.31:0/2541268768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 msgr2=0x7f8d68100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 --2- 172.21.15.31:0/2541268768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d68100790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009910 tx=0x7f8d5c009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 -- 172.21.15.31:0/2541268768 shutdown_connections 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 --2- 172.21.15.31:0/2541268768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d68100790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 --2- 172.21.15.31:0/2541268768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d680ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 -- 172.21.15.31:0/2541268768 >> 172.21.15.31:0/2541268768 conn(0x7f8d680fa6d0 msgr2=0x7f8d680fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 -- 172.21.15.31:0/2541268768 shutdown_connections 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.467+0000 7f8d6da25700 1 -- 172.21.15.31:0/2541268768 wait complete. 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d6da25700 1 Processor -- start 2024-09-17T01:58:00.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d6da25700 1 -- start start 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d6da25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d68069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d6da25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d6819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d6da25700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6819ade0 con 0x7f8d68100340 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d6da25700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6819af20 con 0x7f8d680ff140 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.468+0000 7f8d667fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d6819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d68069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d66ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d68069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:40800/0 (socket says 172.21.15.31:40800) 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d667fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d6819a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37036/0 (socket says 172.21.15.31:37036) 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d66ffd700 1 -- 172.21.15.31:0/1396595888 learned_addr learned my addr 172.21.15.31:0/1396595888 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d667fc700 1 -- 172.21.15.31:0/1396595888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 msgr2=0x7f8d68069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d667fc700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d68069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d667fc700 1 -- 172.21.15.31:0/1396595888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0095f0 con 0x7f8d68100340 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d66ffd700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d68069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d667fc700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d6819a810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c005b40 tx=0x7f8d5c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5c01d070 con 0x7f8d68100340 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8d5c005dc0 con 0x7f8d68100340 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5c022470 con 0x7f8d68100340 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6819b1a0 con 0x7f8d68100340 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.469+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6819b690 con 0x7f8d68100340 2024-09-17T01:58:00.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.470+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68107c90 con 0x7f8d68100340 2024-09-17T01:58:00.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.471+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8d5c0050d0 con 0x7f8d68100340 2024-09-17T01:58:00.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.471+0000 7f8d6ca23700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8d5006e680 0x7f8d50070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.471+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f8d5c08fa60 con 0x7f8d68100340 2024-09-17T01:58:00.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.471+0000 7f8d66ffd700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8d5006e680 0x7f8d50070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.472+0000 7f8d66ffd700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8d5006e680 0x7f8d50070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005950 tx=0x7f8d58009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:00.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.476+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8d5c05c790 con 0x7f8d68100340 2024-09-17T01:58:00.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.775+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d6819bde0 con 0x7f8d68100340 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.776+0000 7f8d6ca23700 1 -- 172.21.15.31:0/1396595888 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+708 (secure 0 0 0) 0x7f8d5c05c320 con 0x7f8d68100340 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:58:00.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:58:00.776 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:58:00.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8d5006e680 msgr2=0x7f8d50070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8d5006e680 0x7f8d50070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005950 tx=0x7f8d58009260 comp rx=0 tx=0).stop 2024-09-17T01:58:00.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 msgr2=0x7f8d6819a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d6819a810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c005b40 tx=0x7f8d5c00fa00 comp rx=0 tx=0).stop 2024-09-17T01:58:00.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 shutdown_connections 2024-09-17T01:58:00.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8d5006e680 0x7f8d50070b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d680ff140 0x7f8d68069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 --2- 172.21.15.31:0/1396595888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d68100340 0x7f8d6819a810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 >> 172.21.15.31:0/1396595888 conn(0x7f8d680fa6d0 msgr2=0x7f8d68103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:00.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 shutdown_connections 2024-09-17T01:58:00.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.778+0000 7f8d6da25700 1 -- 172.21.15.31:0/1396595888 wait complete. 2024-09-17T01:58:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 -- 172.21.15.31:0/353077853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 msgr2=0x7f6b1c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 --2- 172.21.15.31:0/353077853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0ff540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009910 tx=0x7f6b0c009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 -- 172.21.15.31:0/353077853 shutdown_connections 2024-09-17T01:58:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 --2- 172.21.15.31:0/353077853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b1c1003d0 0x7f6b1c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 --2- 172.21.15.31:0/353077853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0ff540 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 -- 172.21.15.31:0/353077853 >> 172.21.15.31:0/353077853 conn(0x7f6b1c0fa780 msgr2=0x7f6b1c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:00.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 -- 172.21.15.31:0/353077853 shutdown_connections 2024-09-17T01:58:00.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.888+0000 7f6b2157f700 1 -- 172.21.15.31:0/353077853 wait complete. 2024-09-17T01:58:00.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b2157f700 1 Processor -- start 2024-09-17T01:58:00.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b2157f700 1 -- start start 2024-09-17T01:58:00.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b2157f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b2157f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b1c1003d0 0x7f6b1c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b2157f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c19ade0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b2157f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c19af20 con 0x7f6b1c1003d0 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b1affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b1affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37052/0 (socket says 172.21.15.31:37052) 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b1affd700 1 -- 172.21.15.31:0/687070990 learned_addr learned my addr 172.21.15.31:0/687070990 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.889+0000 7f6b1a7fc700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b1c1003d0 0x7f6b1c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b1affd700 1 -- 172.21.15.31:0/687070990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b1c1003d0 msgr2=0x7f6b1c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b1affd700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b1c1003d0 0x7f6b1c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b1affd700 1 -- 172.21.15.31:0/687070990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c0095f0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b1affd700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0690a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c000c00 tx=0x7f6b0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0c01d070 con 0x7f6b1c0ff130 2024-09-17T01:58:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b0c005dc0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c19b1a0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0c0226a0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.890+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c19b690 con 0x7f6b1c0ff130 2024-09-17T01:58:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.891+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c107c10 con 0x7f6b1c0ff130 2024-09-17T01:58:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.892+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6b0c00faf0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.893+0000 7f6b03fff700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6b0406e680 0x7f6b04070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.893+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f6b0c08faa0 con 0x7f6b1c0ff130 2024-09-17T01:58:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.893+0000 7f6b1a7fc700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6b0406e680 0x7f6b04070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.893+0000 7f6b1a7fc700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6b0406e680 0x7f6b04070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c069620 tx=0x7f6b10009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:00.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:00.897+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6b0c05c7d0 con 0x7f6b1c0ff130 2024-09-17T01:58:01.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.156+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6b1c19bd20 con 0x7f6b1c0ff130 2024-09-17T01:58:01.155 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:00 smithi031 ceph-mon[77274]: from='client.44275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:01.155 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:00 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:01.155 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:00 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:01.155 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:00 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:01.155 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:00 smithi031 ceph-mon[77274]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:01.155 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:00 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1396595888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:01.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.156+0000 7f6b03fff700 1 -- 172.21.15.31:0/687070990 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1952 (secure 0 0 0) 0x7f6b0c05c360 con 0x7f6b1c0ff130 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:e19 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:56:23:987796+0000 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 19 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:58:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:56:23.845837+0000 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:58:01.157 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{0:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.92:6826/2865546968,v1:172.21.15.92:6827/2865546968] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:14478} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.31:6828/1620553537,v1:172.21.15.31:6829/1620553537] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:01.158 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:01.159 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:01.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6b0406e680 msgr2=0x7f6b04070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6b0406e680 0x7f6b04070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c069620 tx=0x7f6b10009260 comp rx=0 tx=0).stop 2024-09-17T01:58:01.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 msgr2=0x7f6b1c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0690a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c000c00 tx=0x7f6b0c00f690 comp rx=0 tx=0).stop 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 shutdown_connections 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6b0406e680 0x7f6b04070b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0ff130 0x7f6b1c0690a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 --2- 172.21.15.31:0/687070990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b1c1003d0 0x7f6b1c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.158+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 >> 172.21.15.31:0/687070990 conn(0x7f6b1c0fa780 msgr2=0x7f6b1c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.159+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 shutdown_connections 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.159+0000 7f6b2157f700 1 -- 172.21.15.31:0/687070990 wait complete. 2024-09-17T01:58:01.160 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-09-17T01:58:01.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:00 smithi092 ceph-mon[64495]: from='client.44275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:01.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:00 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:01.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:00 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:01.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:00 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:01.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:00 smithi092 ceph-mon[64495]: from='client.44279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:01.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:00 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1396595888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:01.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.268+0000 7fbd75d44700 1 -- 172.21.15.31:0/1780210078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70100ce0 msgr2=0x7fbd701030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.268+0000 7fbd75d44700 1 --2- 172.21.15.31:0/1780210078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70100ce0 0x7fbd701030c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009910 tx=0x7fbd60009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 -- 172.21.15.31:0/1780210078 shutdown_connections 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 --2- 172.21.15.31:0/1780210078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd70103600 0x7fbd701059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 --2- 172.21.15.31:0/1780210078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70100ce0 0x7fbd701030c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 -- 172.21.15.31:0/1780210078 >> 172.21.15.31:0/1780210078 conn(0x7fbd700fa700 msgr2=0x7fbd700fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 -- 172.21.15.31:0/1780210078 shutdown_connections 2024-09-17T01:58:01.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 -- 172.21.15.31:0/1780210078 wait complete. 2024-09-17T01:58:01.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.269+0000 7fbd75d44700 1 Processor -- start 2024-09-17T01:58:01.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd75d44700 1 -- start start 2024-09-17T01:58:01.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd75d44700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd70100ce0 0x7fbd70195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:01.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd75d44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 0x7fbd70195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:01.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd75d44700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70196590 con 0x7fbd70103600 2024-09-17T01:58:01.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd75d44700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd701966d0 con 0x7fbd70100ce0 2024-09-17T01:58:01.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 0x7fbd70195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:01.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 0x7fbd70195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37070/0 (socket says 172.21.15.31:37070) 2024-09-17T01:58:01.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 -- 172.21.15.31:0/2970355654 learned_addr learned my addr 172.21.15.31:0/2970355654 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:01.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6f7fe700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd70100ce0 0x7fbd70195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:01.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 -- 172.21.15.31:0/2970355654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd70100ce0 msgr2=0x7fbd70195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd70100ce0 0x7fbd70195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 -- 172.21.15.31:0/2970355654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600095f0 con 0x7fbd70103600 2024-09-17T01:58:01.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.270+0000 7fbd6effd700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 0x7fbd70195f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c8a0 tx=0x7fbd5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:01.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.271+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5800cea0 con 0x7fbd70103600 2024-09-17T01:58:01.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.271+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd58004830 con 0x7fbd70103600 2024-09-17T01:58:01.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.271+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd580055b0 con 0x7fbd70103600 2024-09-17T01:58:01.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.271+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7019b180 con 0x7fbd70103600 2024-09-17T01:58:01.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.271+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7019b680 con 0x7fbd70103600 2024-09-17T01:58:01.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.272+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7018fc70 con 0x7fbd70103600 2024-09-17T01:58:01.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.272+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbd58007ad0 con 0x7fbd70103600 2024-09-17T01:58:01.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.273+0000 7fbd6cff9700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbd5c06e680 0x7fbd5c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:01.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.273+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fbd5808e3e0 con 0x7fbd70103600 2024-09-17T01:58:01.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.273+0000 7fbd6f7fe700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbd5c06e680 0x7fbd5c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:01.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.273+0000 7fbd6f7fe700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbd5c06e680 0x7fbd5c070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd600059d0 tx=0x7fbd60005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:01.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.277+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbd5805b090 con 0x7fbd70103600 2024-09-17T01:58:01.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.514+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd70061190 con 0x7fbd5c06e680 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.515+0000 7fbd6cff9700 1 -- 172.21.15.31:0/2970355654 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbd70061190 con 0x7fbd5c06e680 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:58:01.514 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "11/23 daemons upgraded", 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:58:01.515 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:58:01.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbd5c06e680 msgr2=0x7fbd5c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbd5c06e680 0x7fbd5c070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd600059d0 tx=0x7fbd60005920 comp rx=0 tx=0).stop 2024-09-17T01:58:01.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 msgr2=0x7fbd70195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 0x7fbd70195f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800c8a0 tx=0x7fbd5800cc60 comp rx=0 tx=0).stop 2024-09-17T01:58:01.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 shutdown_connections 2024-09-17T01:58:01.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fbd5c06e680 0x7fbd5c070b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd70100ce0 0x7fbd70195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 --2- 172.21.15.31:0/2970355654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd70103600 0x7fbd70195f70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 >> 172.21.15.31:0/2970355654 conn(0x7fbd700fa700 msgr2=0x7fbd700fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 shutdown_connections 2024-09-17T01:58:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.518+0000 7fbd75d44700 1 -- 172.21.15.31:0/2970355654 wait complete. 2024-09-17T01:58:01.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 -- 172.21.15.31:0/2883303794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed240ff130 msgr2=0x7fed240ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/2883303794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed240ff130 0x7fed240ff540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed14009910 tx=0x7fed14009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:01.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 -- 172.21.15.31:0/2883303794 shutdown_connections 2024-09-17T01:58:01.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/2883303794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed241003d0 0x7fed24100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/2883303794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed240ff130 0x7fed240ff540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 -- 172.21.15.31:0/2883303794 >> 172.21.15.31:0/2883303794 conn(0x7fed240fa780 msgr2=0x7fed240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:01.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 -- 172.21.15.31:0/2883303794 shutdown_connections 2024-09-17T01:58:01.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.627+0000 7fed2a7f9700 1 -- 172.21.15.31:0/2883303794 wait complete. 2024-09-17T01:58:01.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed2a7f9700 1 Processor -- start 2024-09-17T01:58:01.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed2a7f9700 1 -- start start 2024-09-17T01:58:01.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed2a7f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed240ff130 0x7fed24103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:01.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed2a7f9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 0x7fed241017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:01.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed2a7f9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed24101cf0 con 0x7fed241003d0 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed2a7f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed24101e30 con 0x7fed240ff130 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 0x7fed241017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed23fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed240ff130 0x7fed24103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 0x7fed241017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37086/0 (socket says 172.21.15.31:37086) 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed237fe700 1 -- 172.21.15.31:0/1445379339 learned_addr learned my addr 172.21.15.31:0/1445379339 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed23fff700 1 -- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 msgr2=0x7fed241017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed23fff700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 0x7fed241017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed23fff700 1 -- 172.21.15.31:0/1445379339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140095f0 con 0x7fed240ff130 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.628+0000 7fed237fe700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 0x7fed241017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.629+0000 7fed23fff700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed240ff130 0x7fed24103160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed14005b40 tx=0x7fed1400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.629+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1401d070 con 0x7fed240ff130 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.629+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed14005dc0 con 0x7fed240ff130 2024-09-17T01:58:01.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.629+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed241020b0 con 0x7fed240ff130 2024-09-17T01:58:01.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.629+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed14022470 con 0x7fed240ff130 2024-09-17T01:58:01.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.629+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed241025a0 con 0x7fed240ff130 2024-09-17T01:58:01.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.630+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24107c10 con 0x7fed240ff130 2024-09-17T01:58:01.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.630+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fed14005160 con 0x7fed240ff130 2024-09-17T01:58:01.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.631+0000 7fed217fa700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fed1006e680 0x7fed10070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:01.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.631+0000 7fed237fe700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fed1006e680 0x7fed10070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:01.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.631+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fed1408fb60 con 0x7fed240ff130 2024-09-17T01:58:01.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.631+0000 7fed237fe700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fed1006e680 0x7fed10070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed0c011550 tx=0x7fed0c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:01.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.636+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed1405c770 con 0x7fed240ff130 2024-09-17T01:58:01.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:58:01 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T01:58:01.398+0000 7f5573ae3640 -1 Falling back to public interface 2024-09-17T01:58:01.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.944+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed24107e00 con 0x7fed240ff130 2024-09-17T01:58:01.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.944+0000 7fed217fa700 1 -- 172.21.15.31:0/1445379339 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1290 (secure 0 0 0) 0x7fed1405c300 con 0x7fed240ff130 2024-09-17T01:58:01.943 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 49/324 objects degraded (15.123%), 14 pgs degraded 2024-09-17T01:58:01.943 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:58:01.943 INFO:teuthology.orchestra.run.smithi031.stdout: osd.5 (root=default,host=smithi092) is down 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/324 objects degraded (15.123%), 14 pgs degraded 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-17T01:58:01.944 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-17T01:58:01.945 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-17T01:58:01.945 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-17T01:58:01.945 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-17T01:58:01.945 INFO:teuthology.orchestra.run.smithi031.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fed1006e680 msgr2=0x7fed10070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fed1006e680 0x7fed10070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed0c011550 tx=0x7fed0c009260 comp rx=0 tx=0).stop 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed240ff130 msgr2=0x7fed24103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed240ff130 0x7fed24103160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed14005b40 tx=0x7fed1400fa00 comp rx=0 tx=0).stop 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 shutdown_connections 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fed1006e680 0x7fed10070b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed240ff130 0x7fed24103160 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.947+0000 7fed2a7f9700 1 --2- 172.21.15.31:0/1445379339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed241003d0 0x7fed241017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.948+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 >> 172.21.15.31:0/1445379339 conn(0x7fed240fa780 msgr2=0x7fed24068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.948+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 shutdown_connections 2024-09-17T01:58:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:01.948+0000 7fed2a7f9700 1 -- 172.21.15.31:0/1445379339 wait complete. 2024-09-17T01:58:02.100 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:01 smithi092 ceph-mon[64495]: pgmap v166: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:02.100 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:01 smithi092 ceph-mon[64495]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:02.100 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:01 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/687070990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:58:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:01 smithi031 ceph-mon[77274]: pgmap v166: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:02.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:01 smithi031 ceph-mon[77274]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:02.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:01 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/687070990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:58:03.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:02 smithi031 ceph-mon[77274]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:03.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:02 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1445379339' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:58:03.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:02 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:03.168 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:02 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:03.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:02 smithi092 ceph-mon[64495]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:03.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:02 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1445379339' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:58:03.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:02 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:03.180 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:02 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:03.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:03 smithi092 ceph-mon[64495]: pgmap v167: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:03.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:03.988 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:03 smithi031 ceph-mon[77274]: pgmap v167: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:04.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:06.224 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:05 smithi092 ceph-mon[64495]: pgmap v168: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:06.224 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:06.224 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:05 smithi031 ceph-mon[77274]: pgmap v168: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:06.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:07.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:58:06 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T01:58:06.926+0000 7f5573ae3640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: pgmap v169: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all osd 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:58:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:58:07.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:58:07.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T01:58:07.314+0000 7f5573ae3640 -1 osd.5 84 log_to_monitors true 2024-09-17T01:58:07.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T01:58:07.451+0000 7f556b87d640 -1 osd.5 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:58:07.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: pgmap v169: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/324 objects degraded (15.123%) 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all osd 2024-09-17T01:58:07.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:58:07.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:58:07.742 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:58:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='osd.5 [v2:172.21.15.92:6816/836874443,v1:172.21.15.92:6817/836874443]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:58:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:58:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:58:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: osdmap e87: 6 total, 5 up, 6 in 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='osd.5 [v2:172.21.15.92:6816/836874443,v1:172.21.15.92:6817/836874443]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:08.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:08 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='osd.5 [v2:172.21.15.92:6816/836874443,v1:172.21.15.92:6817/836874443]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: osdmap e87: 6 total, 5 up, 6 in 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='osd.5 [v2:172.21.15.92:6816/836874443,v1:172.21.15.92:6817/836874443]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:08.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:08 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T01:58:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: osdmap e88: 6 total, 5 up, 6 in 2024-09-17T01:58:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: pgmap v172: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 49/324 objects degraded (15.123%) 2024-09-17T01:58:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:58:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:58:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: Upgrade: Scaling down filesystem cephfs 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:09.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T01:58:09.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: osdmap e88: 6 total, 5 up, 6 in 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: pgmap v172: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 49/324 objects degraded (15.123%) 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:09.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: Upgrade: Scaling down filesystem cephfs 2024-09-17T01:58:09.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:09.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T01:58:10.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:58:10.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: osd.5 [v2:172.21.15.92:6816/836874443,v1:172.21.15.92:6817/836874443] boot 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: osdmap e89: 6 total, 6 up, 6 in 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.92:6826/1658276078,v1:172.21.15.92:6827/1658276078] up:boot 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:boot 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: stopping daemon mds.cephfs.smithi092.xzgrcs 2024-09-17T01:58:10.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:stopping} 2 up:standby 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.741 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:10 smithi092 ceph-mon[64495]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:10.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:58:10.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: osd.5 [v2:172.21.15.92:6816/836874443,v1:172.21.15.92:6817/836874443] boot 2024-09-17T01:58:10.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: osdmap e89: 6 total, 6 up, 6 in 2024-09-17T01:58:10.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:58:10.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.92:6826/1658276078,v1:172.21.15.92:6827/1658276078] up:boot 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:boot 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: stopping daemon mds.cephfs.smithi092.xzgrcs 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:active} 2 up:standby 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:stopping} 2 up:standby 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:10.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:10.767 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:10 smithi031 ceph-mon[77274]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:11.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:11 smithi092 ceph-mon[64495]: pgmap v174: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 49/324 objects degraded (15.123%) 2024-09-17T01:58:11.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:11 smithi092 ceph-mon[64495]: osdmap e90: 6 total, 6 up, 6 in 2024-09-17T01:58:11.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:11 smithi031 ceph-mon[77274]: pgmap v174: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 49/324 objects degraded (15.123%) 2024-09-17T01:58:11.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:11 smithi031 ceph-mon[77274]: osdmap e90: 6 total, 6 up, 6 in 2024-09-17T01:58:12.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:12 smithi092 ceph-mon[64495]: Health check update: Degraded data redundancy: 45/324 objects degraded (13.889%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:58:12.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:12 smithi031 ceph-mon[77274]: Health check update: Degraded data redundancy: 45/324 objects degraded (13.889%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:58:13.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:13 smithi092 ceph-mon[64495]: pgmap v176: 65 pgs: 14 active+undersized, 12 active+undersized+degraded, 39 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 45/324 objects degraded (13.889%) 2024-09-17T01:58:13.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:13 smithi031 ceph-mon[77274]: pgmap v176: 65 pgs: 14 active+undersized, 12 active+undersized+degraded, 39 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s; 45/324 objects degraded (13.889%) 2024-09-17T01:58:14.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:14 smithi092 ceph-mon[64495]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/324 objects degraded (13.889%), 12 pgs degraded) 2024-09-17T01:58:14.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:14 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:58:14.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:14 smithi031 ceph-mon[77274]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/324 objects degraded (13.889%), 12 pgs degraded) 2024-09-17T01:58:14.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:14 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:58:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:15 smithi092 ceph-mon[64495]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s wr, 9 op/s 2024-09-17T01:58:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:15 smithi031 ceph-mon[77274]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s wr, 9 op/s 2024-09-17T01:58:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:17 smithi092 ceph-mon[64495]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s wr, 7 op/s 2024-09-17T01:58:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:17 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:stopping} 2 up:standby 2024-09-17T01:58:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:17 smithi031 ceph-mon[77274]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s wr, 7 op/s 2024-09-17T01:58:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:17 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi092.xzgrcs=up:stopping} 2 up:standby 2024-09-17T01:58:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:19 smithi092 ceph-mon[64495]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s wr, 12 op/s 2024-09-17T01:58:19.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:19 smithi031 ceph-mon[77274]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s wr, 12 op/s 2024-09-17T01:58:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:20.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:20.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:21 smithi092 ceph-mon[64495]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s wr, 11 op/s 2024-09-17T01:58:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:21 smithi031 ceph-mon[77274]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s wr, 11 op/s 2024-09-17T01:58:24.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:24 smithi092 ceph-mon[64495]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s wr, 9 op/s 2024-09-17T01:58:24.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:24 smithi031 ceph-mon[77274]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s wr, 9 op/s 2024-09-17T01:58:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:26 smithi092 ceph-mon[64495]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s wr, 9 op/s 2024-09-17T01:58:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:26 smithi031 ceph-mon[77274]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s wr, 9 op/s 2024-09-17T01:58:28.459 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:28 smithi092 ceph-mon[64495]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 8.8 KiB/s wr, 5 op/s 2024-09-17T01:58:28.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:28 smithi031 ceph-mon[77274]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 8.8 KiB/s wr, 5 op/s 2024-09-17T01:58:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:30 smithi092 ceph-mon[64495]: pgmap v184: 65 pgs: 65 active+clean; 227 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 9.6 KiB/s wr, 11 op/s 2024-09-17T01:58:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:30 smithi031 ceph-mon[77274]: pgmap v184: 65 pgs: 65 active+clean; 227 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 9.6 KiB/s wr, 11 op/s 2024-09-17T01:58:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:30.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:31.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 -- 172.21.15.31:0/4197291036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 msgr2=0x7f406c103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 --2- 172.21.15.31:0/4197291036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c103160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f405c009910 tx=0x7f405c009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 -- 172.21.15.31:0/4197291036 shutdown_connections 2024-09-17T01:58:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 --2- 172.21.15.31:0/4197291036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f406c1036a0 0x7f406c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 --2- 172.21.15.31:0/4197291036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c103160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 -- 172.21.15.31:0/4197291036 >> 172.21.15.31:0/4197291036 conn(0x7f406c0fa7a0 msgr2=0x7f406c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 -- 172.21.15.31:0/4197291036 shutdown_connections 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.073+0000 7f407130c700 1 -- 172.21.15.31:0/4197291036 wait complete. 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f407130c700 1 Processor -- start 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f407130c700 1 -- start start 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f407130c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f407130c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f406c1036a0 0x7f406c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f407130c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c196950 con 0x7f406c100d80 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f407130c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c196a90 con 0x7f406c1036a0 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f406affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f406affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39854/0 (socket says 172.21.15.31:39854) 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f406affd700 1 -- 172.21.15.31:0/1150709670 learned_addr learned my addr 172.21.15.31:0/1150709670 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.074+0000 7f406a7fc700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f406c1036a0 0x7f406c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f406affd700 1 -- 172.21.15.31:0/1150709670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f406c1036a0 msgr2=0x7f406c196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f406affd700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f406c1036a0 0x7f406c196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f406affd700 1 -- 172.21.15.31:0/1150709670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0095f0 con 0x7f406c100d80 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f406affd700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c195df0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f405c00bda0 tx=0x7f405c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c01d070 con 0x7f406c100d80 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f405c004c50 con 0x7f406c100d80 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c19b4e0 con 0x7f406c100d80 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c00f690 con 0x7f406c100d80 2024-09-17T01:58:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.075+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c19b9d0 con 0x7f406c100d80 2024-09-17T01:58:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.076+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c18fbe0 con 0x7f406c100d80 2024-09-17T01:58:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.077+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f405c0229b0 con 0x7f406c100d80 2024-09-17T01:58:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.077+0000 7f4063fff700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f405806e680 0x7f4058070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.077+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f405c08fd50 con 0x7f406c100d80 2024-09-17T01:58:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.077+0000 7f406a7fc700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f405806e680 0x7f4058070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.078+0000 7f406a7fc700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f405806e680 0x7f4058070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4054005950 tx=0x7f4054005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:32.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.082+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f405c05cab0 con 0x7f406c100d80 2024-09-17T01:58:32.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.319+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f406c061190 con 0x7f405806e680 2024-09-17T01:58:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.321+0000 7f4063fff700 1 -- 172.21.15.31:0/1150709670 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f406c061190 con 0x7f405806e680 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f405806e680 msgr2=0x7f4058070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f405806e680 0x7f4058070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4054005950 tx=0x7f4054005cf0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 msgr2=0x7f406c195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c195df0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f405c00bda0 tx=0x7f405c00be80 comp rx=0 tx=0).stop 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 shutdown_connections 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f405806e680 0x7f4058070b30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f406c100d80 0x7f406c195df0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 --2- 172.21.15.31:0/1150709670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f406c1036a0 0x7f406c196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 >> 172.21.15.31:0/1150709670 conn(0x7f406c0fa7a0 msgr2=0x7f406c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:32.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 shutdown_connections 2024-09-17T01:58:32.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.323+0000 7f407130c700 1 -- 172.21.15.31:0/1150709670 wait complete. 2024-09-17T01:58:32.322 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:32 smithi031 ceph-mon[77274]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:32.322 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:32 smithi031 ceph-mon[77274]: pgmap v185: 65 pgs: 65 active+clean; 227 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-17T01:58:32.332 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:58:32.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 -- 172.21.15.31:0/812849611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c0ff150 msgr2=0x7fa33c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 --2- 172.21.15.31:0/812849611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c0ff150 0x7fa33c0ff560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa338009910 tx=0x7fa338009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:32.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 -- 172.21.15.31:0/812849611 shutdown_connections 2024-09-17T01:58:32.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 --2- 172.21.15.31:0/812849611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c1003f0 0x7fa33c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 --2- 172.21.15.31:0/812849611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c0ff150 0x7fa33c0ff560 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 -- 172.21.15.31:0/812849611 >> 172.21.15.31:0/812849611 conn(0x7fa33c0fa7a0 msgr2=0x7fa33c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:32.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 -- 172.21.15.31:0/812849611 shutdown_connections 2024-09-17T01:58:32.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.433+0000 7fa343e06700 1 -- 172.21.15.31:0/812849611 wait complete. 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa343e06700 1 Processor -- start 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa343e06700 1 -- start start 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa343e06700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c0ff150 0x7fa33c195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa343e06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 0x7fa33c196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa343e06700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c196970 con 0x7fa33c1003f0 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa343e06700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c196ab0 con 0x7fa33c0ff150 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa3413a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 0x7fa33c196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa3413a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 0x7fa33c196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39864/0 (socket says 172.21.15.31:39864) 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.434+0000 7fa3413a1700 1 -- 172.21.15.31:0/765264443 learned_addr learned my addr 172.21.15.31:0/765264443 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:32.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa341ba2700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c0ff150 0x7fa33c195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa3413a1700 1 -- 172.21.15.31:0/765264443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c0ff150 msgr2=0x7fa33c195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa3413a1700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c0ff150 0x7fa33c195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa3413a1700 1 -- 172.21.15.31:0/765264443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380095f0 con 0x7fa33c1003f0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa3413a1700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 0x7fa33c196350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c8a0 tx=0x7fa32c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa32c0078e0 con 0x7fa33c1003f0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa32c00f450 con 0x7fa33c1003f0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa32c00e5e0 con 0x7fa33c1003f0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c19b560 con 0x7fa33c1003f0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.435+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c19bab0 con 0x7fa33c1003f0 2024-09-17T01:58:32.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.436+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c068ab0 con 0x7fa33c1003f0 2024-09-17T01:58:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.437+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa32c00f5c0 con 0x7fa33c1003f0 2024-09-17T01:58:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.437+0000 7fa332ffd700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa32806e680 0x7fa328070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.438+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fa32c08e5e0 con 0x7fa33c1003f0 2024-09-17T01:58:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.438+0000 7fa341ba2700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa32806e680 0x7fa328070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.438+0000 7fa341ba2700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa32806e680 0x7fa328070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa338006010 tx=0x7fa33800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.442+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa32c05b270 con 0x7fa33c1003f0 2024-09-17T01:58:32.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:32 smithi092 ceph-mon[64495]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:32.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:32 smithi092 ceph-mon[64495]: pgmap v185: 65 pgs: 65 active+clean; 227 MiB data, 988 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-17T01:58:32.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.675+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa33c0694e0 con 0x7fa32806e680 2024-09-17T01:58:32.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.676+0000 7fa332ffd700 1 -- 172.21.15.31:0/765264443 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa33c0694e0 con 0x7fa32806e680 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa32806e680 msgr2=0x7fa328070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa32806e680 0x7fa328070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa338006010 tx=0x7fa33800b540 comp rx=0 tx=0).stop 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 msgr2=0x7fa33c196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 0x7fa33c196350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c8a0 tx=0x7fa32c00cbb0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 shutdown_connections 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa32806e680 0x7fa328070b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c0ff150 0x7fa33c195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 --2- 172.21.15.31:0/765264443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa33c1003f0 0x7fa33c196350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 >> 172.21.15.31:0/765264443 conn(0x7fa33c0fa7a0 msgr2=0x7fa33c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.678+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 shutdown_connections 2024-09-17T01:58:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.679+0000 7fa343e06700 1 -- 172.21.15.31:0/765264443 wait complete. 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 -- 172.21.15.31:0/1472961922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 msgr2=0x7f6a80101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 --2- 172.21.15.31:0/1472961922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80101890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009910 tx=0x7f6a70009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 -- 172.21.15.31:0/1472961922 shutdown_connections 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 --2- 172.21.15.31:0/1472961922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80101890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 --2- 172.21.15.31:0/1472961922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a80100240 0x7f6a80100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 -- 172.21.15.31:0/1472961922 >> 172.21.15.31:0/1472961922 conn(0x7f6a800fb7f0 msgr2=0x7f6a800fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 -- 172.21.15.31:0/1472961922 shutdown_connections 2024-09-17T01:58:32.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.787+0000 7f6a8870d700 1 -- 172.21.15.31:0/1472961922 wait complete. 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a8870d700 1 Processor -- start 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a8870d700 1 -- start start 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a8870d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a80100240 0x7f6a80195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a8870d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a8870d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80196560 con 0x7f6a80101440 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a8870d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a801966a0 con 0x7f6a80100240 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a85ca8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a85ca8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39884/0 (socket says 172.21.15.31:39884) 2024-09-17T01:58:32.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a85ca8700 1 -- 172.21.15.31:0/209964162 learned_addr learned my addr 172.21.15.31:0/209964162 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a864a9700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a80100240 0x7f6a80195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a85ca8700 1 -- 172.21.15.31:0/209964162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a80100240 msgr2=0x7f6a80195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a85ca8700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a80100240 0x7f6a80195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.788+0000 7f6a85ca8700 1 -- 172.21.15.31:0/209964162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700095f0 con 0x7f6a80101440 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.789+0000 7f6a85ca8700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80195fd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000bd70 tx=0x7f6a7000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.789+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7001d070 con 0x7f6a80101440 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.789+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8019b100 con 0x7f6a80101440 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.789+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6a70005940 con 0x7f6a80101440 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.789+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a70021430 con 0x7f6a80101440 2024-09-17T01:58:32.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.789+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8019b5c0 con 0x7f6a80101440 2024-09-17T01:58:32.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.790+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a80108d90 con 0x7f6a80101440 2024-09-17T01:58:32.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.790+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6a7000f860 con 0x7f6a80101440 2024-09-17T01:58:32.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.791+0000 7f6a777fe700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6a6c06e680 0x7f6a6c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:32.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.791+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f6a7008fa40 con 0x7f6a80101440 2024-09-17T01:58:32.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.791+0000 7f6a864a9700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6a6c06e680 0x7f6a6c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:32.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.791+0000 7f6a864a9700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6a6c06e680 0x7f6a6c070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a801012a0 tx=0x7f6a7c00a3b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:32.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:32.795+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6a7005c6f0 con 0x7f6a80101440 2024-09-17T01:58:33.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.026+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a80105d90 con 0x7f6a6c06e680 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.035+0000 7f6a777fe700 1 -- 172.21.15.31:0/209964162 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f6a80105d90 con 0x7f6a6c06e680 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (13m) 2m ago 14m 24.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (14m) 2m ago 14m 8480k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (13m) 30s ago 13m 8535k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (3m) 2m ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:58:33.034 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (3m) 30s ago 13m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (13m) 2m ago 14m 87.1M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (9m) 2m ago 9m 62.9M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (9m) 2m ago 9m 125M - 18.2.0 dc2bc1663786 2e9c605c7118 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (9m) 30s ago 9m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (9m) 30s ago 9m 119M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (5m) 2m ago 16m 500M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (5m) 30s ago 13m 442M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (4m) 2m ago 16m 47.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (4m) 30s ago 13m 39.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (14m) 2m ago 14m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (13m) 30s ago 13m 15.4M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (3m) 2m ago 12m 89.7M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:58:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (2m) 2m ago 12m 103M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:58:33.036 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (2m) 2m ago 11m 11.2M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T01:58:33.036 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (98s) 30s ago 11m 133M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T01:58:33.036 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (65s) 30s ago 11m 89.5M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T01:58:33.036 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (33s) 30s ago 10m 11.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T01:58:33.036 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (5m) 2m ago 14m 75.0M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6a6c06e680 msgr2=0x7f6a6c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6a6c06e680 0x7f6a6c070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a801012a0 tx=0x7f6a7c00a3b0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 msgr2=0x7f6a80195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80195fd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000bd70 tx=0x7f6a7000bda0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 shutdown_connections 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6a6c06e680 0x7f6a6c070b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a80100240 0x7f6a80195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 --2- 172.21.15.31:0/209964162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a80101440 0x7f6a80195fd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 >> 172.21.15.31:0/209964162 conn(0x7f6a800fb7f0 msgr2=0x7f6a80104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 shutdown_connections 2024-09-17T01:58:33.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.038+0000 7f6a8870d700 1 -- 172.21.15.31:0/209964162 wait complete. 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 -- 172.21.15.31:0/456868609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524100240 msgr2=0x7f0524100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 --2- 172.21.15.31:0/456868609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524100240 0x7f0524100650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0514009910 tx=0x7f0514009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 -- 172.21.15.31:0/456868609 shutdown_connections 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 --2- 172.21.15.31:0/456868609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0524101440 0x7f0524101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 --2- 172.21.15.31:0/456868609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524100240 0x7f0524100650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 -- 172.21.15.31:0/456868609 >> 172.21.15.31:0/456868609 conn(0x7f05240fb7f0 msgr2=0x7f05240fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 -- 172.21.15.31:0/456868609 shutdown_connections 2024-09-17T01:58:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.145+0000 7f0529235700 1 -- 172.21.15.31:0/456868609 wait complete. 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0529235700 1 Processor -- start 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0529235700 1 -- start start 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0529235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0524100240 0x7f0524074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0529235700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 0x7f0524073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0529235700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524073680 con 0x7f0524101440 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0529235700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240737c0 con 0x7f0524100240 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f052259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 0x7f0524073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f052259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 0x7f0524073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39902/0 (socket says 172.21.15.31:39902) 2024-09-17T01:58:33.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f052259c700 1 -- 172.21.15.31:0/461718451 learned_addr learned my addr 172.21.15.31:0/461718451 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.146+0000 7f0522d9d700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0524100240 0x7f0524074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f052259c700 1 -- 172.21.15.31:0/461718451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0524100240 msgr2=0x7f0524074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f052259c700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0524100240 0x7f0524074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f052259c700 1 -- 172.21.15.31:0/461718451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140095f0 con 0x7f0524101440 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f052259c700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 0x7f0524073140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f051800c930 tx=0x7f051800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0518007ad0 con 0x7f0524101440 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f051800ce80 con 0x7f0524101440 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0524073aa0 con 0x7f0524101440 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0518018630 con 0x7f0524101440 2024-09-17T01:58:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.147+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052419db30 con 0x7f0524101440 2024-09-17T01:58:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.148+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0524108d90 con 0x7f0524101440 2024-09-17T01:58:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.149+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0518007c30 con 0x7f0524101440 2024-09-17T01:58:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.149+0000 7f050bfff700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f050c06e680 0x7f050c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.149+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f051808e680 con 0x7f0524101440 2024-09-17T01:58:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.149+0000 7f0522d9d700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f050c06e680 0x7f050c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.150+0000 7f0522d9d700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f050c06e680 0x7f050c070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0514006010 tx=0x7f051400b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:33.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.154+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f051805b330 con 0x7f0524101440 2024-09-17T01:58:33.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.455+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0524108f50 con 0x7f0524101440 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.456+0000 7f050bfff700 1 -- 172.21.15.31:0/461718451 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+709 (secure 0 0 0) 0x7f051805aec0 con 0x7f0524101440 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:58:33.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 10 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:58:33.456 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:58:33.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f050c06e680 msgr2=0x7f050c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f050c06e680 0x7f050c070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0514006010 tx=0x7f051400b560 comp rx=0 tx=0).stop 2024-09-17T01:58:33.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 msgr2=0x7f0524073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 0x7f0524073140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f051800c930 tx=0x7f051800cc40 comp rx=0 tx=0).stop 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 shutdown_connections 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f050c06e680 0x7f050c070b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0524100240 0x7f0524074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 --2- 172.21.15.31:0/461718451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0524101440 0x7f0524073140 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.458+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 >> 172.21.15.31:0/461718451 conn(0x7f05240fb7f0 msgr2=0x7f0524104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.459+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 shutdown_connections 2024-09-17T01:58:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.459+0000 7f0529235700 1 -- 172.21.15.31:0/461718451 wait complete. 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 -- 172.21.15.31:0/2939152190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 msgr2=0x7f7f90101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 --2- 172.21.15.31:0/2939152190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f90101890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009910 tx=0x7f7f78009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 -- 172.21.15.31:0/2939152190 shutdown_connections 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 --2- 172.21.15.31:0/2939152190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f90101890 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 --2- 172.21.15.31:0/2939152190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 0x7f7f90100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 -- 172.21.15.31:0/2939152190 >> 172.21.15.31:0/2939152190 conn(0x7f7f900fb7f0 msgr2=0x7f7f900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 -- 172.21.15.31:0/2939152190 shutdown_connections 2024-09-17T01:58:33.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.568+0000 7f7f96319700 1 -- 172.21.15.31:0/2939152190 wait complete. 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f96319700 1 Processor -- start 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f96319700 1 -- start start 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f96319700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 0x7f7f90197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f96319700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f901981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f96319700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f901987d0 con 0x7f7f90101440 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f96319700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90198940 con 0x7f7f90100240 2024-09-17T01:58:33.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f8f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f901981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f8f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f901981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34852/0 (socket says 172.21.15.31:34852) 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.569+0000 7f7f8f7fe700 1 -- 172.21.15.31:0/2611233310 learned_addr learned my addr 172.21.15.31:0/2611233310 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8ffff700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 0x7f7f90197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8f7fe700 1 -- 172.21.15.31:0/2611233310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 msgr2=0x7f7f90197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8f7fe700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 0x7f7f90197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8f7fe700 1 -- 172.21.15.31:0/2611233310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780095f0 con 0x7f7f90101440 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8ffff700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 0x7f7f90197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8f7fe700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f901981d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800b5c0 tx=0x7f7f7800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f7801d070 con 0x7f7f90101440 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f7800f460 con 0x7f7f90101440 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9019d370 con 0x7f7f90101440 2024-09-17T01:58:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f78021640 con 0x7f7f90101440 2024-09-17T01:58:33.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.570+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9019d860 con 0x7f7f90101440 2024-09-17T01:58:33.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.571+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f90105520 con 0x7f7f90101440 2024-09-17T01:58:33.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.572+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7f7800f5d0 con 0x7f7f90101440 2024-09-17T01:58:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.572+0000 7f7f8d7fa700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7f7c06e680 0x7f7f7c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.572+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f7f7808f970 con 0x7f7f90101440 2024-09-17T01:58:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.572+0000 7f7f8ffff700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7f7c06e680 0x7f7f7c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.573+0000 7f7f8ffff700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7f7c06e680 0x7f7f7c070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005fd0 tx=0x7f7f80005f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:33.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.577+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f78058b70 con 0x7f7f90101440 2024-09-17T01:58:33.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.837+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7f9002cc30 con 0x7f7f90101440 2024-09-17T01:58:33.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.838+0000 7f7f8d7fa700 1 -- 172.21.15.31:0/2611233310 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1951 (secure 0 0 0) 0x7f7f7805c230 con 0x7f7f90101440 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:e23 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:58:16:396354+0000 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 23 2024-09-17T01:58:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:58:16.081654+0000 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:58:33.838 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 1 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=14464,1=24269} 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:58:33.839 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 14464 members: 14464 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.31:6826/3872851712,v1:172.21.15.31:6827/3872851712] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{1:24269} state up:stopping seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:Standby daemons: 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:33.840 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/1658276078,v1:172.21.15.92:6827/1658276078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:58:33.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7f7c06e680 msgr2=0x7f7f7c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7f7c06e680 0x7f7f7c070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005fd0 tx=0x7f7f80005f20 comp rx=0 tx=0).stop 2024-09-17T01:58:33.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 msgr2=0x7f7f901981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f901981d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800b5c0 tx=0x7f7f7800be20 comp rx=0 tx=0).stop 2024-09-17T01:58:33.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 shutdown_connections 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7f7c06e680 0x7f7f7c070b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f90100240 0x7f7f90197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 --2- 172.21.15.31:0/2611233310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f90101440 0x7f7f901981d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 >> 172.21.15.31:0/2611233310 conn(0x7f7f900fb7f0 msgr2=0x7f7f90102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 shutdown_connections 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.841+0000 7f7f96319700 1 -- 172.21.15.31:0/2611233310 wait complete. 2024-09-17T01:58:33.842 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 23 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 -- 172.21.15.31:0/1847149401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 msgr2=0x7f1ac00ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/1847149401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac00ff910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009910 tx=0x7f1ab0009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 -- 172.21.15.31:0/1847149401 shutdown_connections 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/1847149401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac00ff910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/1847149401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac00feb50 0x7f1ac00fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 -- 172.21.15.31:0/1847149401 >> 172.21.15.31:0/1847149401 conn(0x7f1ac00fa780 msgr2=0x7f1ac00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:33.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 -- 172.21.15.31:0/1847149401 shutdown_connections 2024-09-17T01:58:33.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.951+0000 7f1ac81e3700 1 -- 172.21.15.31:0/1847149401 wait complete. 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac81e3700 1 Processor -- start 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac81e3700 1 -- start start 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac81e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac00feb50 0x7f1ac0197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac81e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac0198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac81e3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac0198870 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac81e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac019d280 con 0x7f1ac00feb50 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac577e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac0198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac577e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac0198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34868/0 (socket says 172.21.15.31:34868) 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac577e700 1 -- 172.21.15.31:0/4189499647 learned_addr learned my addr 172.21.15.31:0/4189499647 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:33.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac5f7f700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac00feb50 0x7f1ac0197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac577e700 1 -- 172.21.15.31:0/4189499647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac00feb50 msgr2=0x7f1ac0197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac577e700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac00feb50 0x7f1ac0197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.952+0000 7f1ac577e700 1 -- 172.21.15.31:0/4189499647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00095f0 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.953+0000 7f1ac577e700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac0198250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0006010 tx=0x7f1ab000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.953+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab001d070 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.953+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ab000f460 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.953+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac019d420 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.953+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab0017630 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.953+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac019d8e0 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.954+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac010af10 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.955+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1ab000f5d0 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.955+0000 7f1ab6ffd700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1aac06e680 0x7f1aac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:33.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.955+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f1ab008fb30 con 0x7f1ac00ff4a0 2024-09-17T01:58:33.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.955+0000 7f1ac5f7f700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1aac06e680 0x7f1aac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:33.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.956+0000 7f1ac5f7f700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1aac06e680 0x7f1aac070b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1abc005950 tx=0x7f1abc0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:33.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:33.960+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1ab0058cb0 con 0x7f1ac00ff4a0 2024-09-17T01:58:34.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.194+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ac019def0 con 0x7f1aac06e680 2024-09-17T01:58:34.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.195+0000 7f1ab6ffd700 1 -- 172.21.15.31:0/4189499647 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1ac019def0 con 0x7f1aac06e680 2024-09-17T01:58:34.194 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:58:34.194 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:58:34.194 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "osd", 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "12/23 daemons upgraded", 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:58:34.195 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:58:34.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.197+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1aac06e680 msgr2=0x7f1aac070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:34.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.197+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1aac06e680 0x7f1aac070b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1abc005950 tx=0x7f1abc0058e0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.197+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 msgr2=0x7f1ac0198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.197+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac0198250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0006010 tx=0x7f1ab000be20 comp rx=0 tx=0).stop 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 shutdown_connections 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1aac06e680 0x7f1aac070b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ac00feb50 0x7f1ac0197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 --2- 172.21.15.31:0/4189499647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ac00ff4a0 0x7f1ac0198250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 >> 172.21.15.31:0/4189499647 conn(0x7f1ac00fa780 msgr2=0x7f1ac0107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 shutdown_connections 2024-09-17T01:58:34.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.198+0000 7f1ac81e3700 1 -- 172.21.15.31:0/4189499647 wait complete. 2024-09-17T01:58:34.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.308+0000 7f59d564b700 1 -- 172.21.15.31:0/2033197349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0101450 msgr2=0x7f59d01018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:34.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.308+0000 7f59d564b700 1 --2- 172.21.15.31:0/2033197349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0101450 0x7f59d01018a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009910 tx=0x7f59b8009c20 comp rx=0 tx=0).stop 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.308+0000 7f59d564b700 1 -- 172.21.15.31:0/2033197349 shutdown_connections 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.308+0000 7f59d564b700 1 --2- 172.21.15.31:0/2033197349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0101450 0x7f59d01018a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.308+0000 7f59d564b700 1 --2- 172.21.15.31:0/2033197349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d0100250 0x7f59d0100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.308+0000 7f59d564b700 1 -- 172.21.15.31:0/2033197349 >> 172.21.15.31:0/2033197349 conn(0x7f59d00fb7e0 msgr2=0x7f59d00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.309+0000 7f59d564b700 1 -- 172.21.15.31:0/2033197349 shutdown_connections 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.309+0000 7f59d564b700 1 -- 172.21.15.31:0/2033197349 wait complete. 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.309+0000 7f59d564b700 1 Processor -- start 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.309+0000 7f59d564b700 1 -- start start 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59d564b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 0x7f59d0197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59d564b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d0101450 0x7f59d01981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59d564b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d01987c0 con 0x7f59d0100250 2024-09-17T01:58:34.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59d564b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d0198930 con 0x7f59d0101450 2024-09-17T01:58:34.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 0x7f59d0197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:34.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 0x7f59d0197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34884/0 (socket says 172.21.15.31:34884) 2024-09-17T01:58:34.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 -- 172.21.15.31:0/3673091375 learned_addr learned my addr 172.21.15.31:0/3673091375 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:58:34.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59c7fff700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d0101450 0x7f59d01981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:34.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 -- 172.21.15.31:0/3673091375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d0101450 msgr2=0x7f59d01981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:34.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d0101450 0x7f59d01981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 -- 172.21.15.31:0/3673091375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80095f0 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.310+0000 7f59ceffd700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 0x7f59d0197c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59c000d900 tx=0x7f59c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.311+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59c000b920 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.311+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d019d3c0 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.311+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59c0010460 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.311+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59c000f590 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.311+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d019d910 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.312+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d0105530 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.312+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f59c00105d0 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.313+0000 7f59ccff9700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f59bc06e680 0x7f59bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.313+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f59c008e2b0 con 0x7f59d0100250 2024-09-17T01:58:34.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.313+0000 7f59c7fff700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f59bc06e680 0x7f59bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:58:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.313+0000 7f59c7fff700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f59bc06e680 0x7f59bc070b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59d0199190 tx=0x7f59b800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:58:34.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.317+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f59c0057430 con 0x7f59d0100250 2024-09-17T01:58:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:34 smithi092 ceph-mon[64495]: pgmap v186: 65 pgs: 65 active+clean; 223 MiB data, 972 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-17T01:58:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:34 smithi092 ceph-mon[64495]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:34 smithi092 ceph-mon[64495]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:34 smithi092 ceph-mon[64495]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:34 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/461718451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:34.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:34 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2611233310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:58:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:34 smithi031 ceph-mon[77274]: pgmap v186: 65 pgs: 65 active+clean; 223 MiB data, 972 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-17T01:58:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:34 smithi031 ceph-mon[77274]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:34 smithi031 ceph-mon[77274]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:34 smithi031 ceph-mon[77274]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:34 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/461718451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:34.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:34 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2611233310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:58:34.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.627+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f59d002cc30 con 0x7f59d0100250 2024-09-17T01:58:34.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.627+0000 7f59ccff9700 1 -- 172.21.15.31:0/3673091375 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f59c005aaf0 con 0x7f59d0100250 2024-09-17T01:58:34.626 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:58:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f59bc06e680 msgr2=0x7f59bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f59bc06e680 0x7f59bc070b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59d0199190 tx=0x7f59b800b540 comp rx=0 tx=0).stop 2024-09-17T01:58:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 msgr2=0x7f59d0197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:58:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 0x7f59d0197c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59c000d900 tx=0x7f59c000dc10 comp rx=0 tx=0).stop 2024-09-17T01:58:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 shutdown_connections 2024-09-17T01:58:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f59bc06e680 0x7f59bc070b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59d0100250 0x7f59d0197c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 --2- 172.21.15.31:0/3673091375 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d0101450 0x7f59d01981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:58:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 >> 172.21.15.31:0/3673091375 conn(0x7f59d00fb7e0 msgr2=0x7f59d0102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:58:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 shutdown_connections 2024-09-17T01:58:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:58:34.629+0000 7f59d564b700 1 -- 172.21.15.31:0/3673091375 wait complete. 2024-09-17T01:58:35.465 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:35 smithi092 ceph-mon[64495]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:35.466 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:35 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3673091375' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:58:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:35 smithi031 ceph-mon[77274]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:58:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:35 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3673091375' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:58:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:36 smithi092 ceph-mon[64495]: pgmap v187: 65 pgs: 65 active+clean; 151 MiB data, 756 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-17T01:58:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:36 smithi031 ceph-mon[77274]: pgmap v187: 65 pgs: 65 active+clean; 151 MiB data, 756 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-17T01:58:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:38 smithi092 ceph-mon[64495]: pgmap v188: 65 pgs: 65 active+clean; 151 MiB data, 756 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-09-17T01:58:38.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:38 smithi031 ceph-mon[77274]: pgmap v188: 65 pgs: 65 active+clean; 151 MiB data, 756 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-09-17T01:58:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:40 smithi092 ceph-mon[64495]: pgmap v189: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-17T01:58:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:40 smithi031 ceph-mon[77274]: pgmap v189: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-17T01:58:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:41.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.491 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:41 smithi092 ceph-mon[64495]: daemon mds.cephfs.smithi092.xzgrcs finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-17T01:58:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:41.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:41.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:41 smithi031 ceph-mon[77274]: daemon mds.cephfs.smithi092.xzgrcs finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-17T01:58:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:42 smithi092 ceph-mon[64495]: pgmap v190: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-17T01:58:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:42 smithi092 ceph-mon[64495]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:42 smithi092 ceph-mon[64495]: mds.1 [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] down:stopped 2024-09-17T01:58:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:42 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T01:58:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:42 smithi031 ceph-mon[77274]: pgmap v190: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-17T01:58:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:42 smithi031 ceph-mon[77274]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:58:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:42 smithi031 ceph-mon[77274]: mds.1 [v2:172.21.15.92:6824/1268254194,v1:172.21.15.92:6825/1268254194] down:stopped 2024-09-17T01:58:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:42 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T01:58:43.622 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:43 smithi092 ceph-mon[64495]: pgmap v191: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-17T01:58:43.622 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:43 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.92:6824/3556360183,v1:172.21.15.92:6825/3556360183] up:boot 2024-09-17T01:58:43.622 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:43 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T01:58:43.623 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:58:43.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:43 smithi031 ceph-mon[77274]: pgmap v191: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-17T01:58:43.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:43 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.92:6824/3556360183,v1:172.21.15.92:6825/3556360183] up:boot 2024-09-17T01:58:43.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:43 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T01:58:43.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:58:45.720 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:45 smithi092 ceph-mon[64495]: pgmap v192: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-17T01:58:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:45 smithi031 ceph-mon[77274]: pgmap v192: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 1 op/s 2024-09-17T01:58:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:47 smithi092 ceph-mon[64495]: pgmap v193: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:58:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:47 smithi031 ceph-mon[77274]: pgmap v193: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:58:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:49 smithi092 ceph-mon[64495]: pgmap v194: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:58:49.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:49 smithi031 ceph-mon[77274]: pgmap v194: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:58:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:50.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:58:51.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: pgmap v195: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:51.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:51.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:51.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:51.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:51.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:51.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi031.menvuk"]}]: dispatch 2024-09-17T01:58:51.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:51 smithi031 ceph-mon[77274]: Upgrade: It appears safe to stop mds.cephfs.smithi031.menvuk 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: pgmap v195: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:58:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:58:51.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi031.menvuk"]}]: dispatch 2024-09-17T01:58:51.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:51 smithi092 ceph-mon[64495]: Upgrade: It appears safe to stop mds.cephfs.smithi031.menvuk 2024-09-17T01:58:53.322 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:53 smithi031 ceph-mon[77274]: Upgrade: Updating mds.cephfs.smithi031.menvuk 2024-09-17T01:58:53.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:53.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:58:53.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:53 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:53.323 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:53 smithi031 ceph-mon[77274]: Deploying daemon mds.cephfs.smithi031.menvuk on smithi031 2024-09-17T01:58:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:53 smithi092 ceph-mon[64495]: Upgrade: Updating mds.cephfs.smithi031.menvuk 2024-09-17T01:58:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:58:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.menvuk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:58:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:53 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:58:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:53 smithi092 ceph-mon[64495]: Deploying daemon mds.cephfs.smithi031.menvuk on smithi031 2024-09-17T01:58:54.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:53 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[77270]: 2024-09-17T01:58:53.895+0000 7fe1b8d51640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: pgmap v196: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: osdmap e91: 6 total, 6 up, 6 in 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: Standby daemon mds.cephfs.smithi031.gszbpe assigned to filesystem cephfs as rank 0 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:58:54.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:54 smithi031 ceph-mon[77274]: fsmap cephfs:1/1 {0=cephfs.smithi031.gszbpe=up:replay} 2 up:standby 2024-09-17T01:58:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: pgmap v196: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:58:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:58:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: osdmap e91: 6 total, 6 up, 6 in 2024-09-17T01:58:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: Standby daemon mds.cephfs.smithi031.gszbpe assigned to filesystem cephfs as rank 0 2024-09-17T01:58:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:58:54.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:58:54.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:54 smithi092 ceph-mon[64495]: fsmap cephfs:1/1 {0=cephfs.smithi031.gszbpe=up:replay} 2 up:standby 2024-09-17T01:58:56.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:56 smithi092 ceph-mon[64495]: pgmap v198: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:56 smithi031 ceph-mon[77274]: pgmap v198: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:58:58 smithi092 ceph-mon[64495]: pgmap v199: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:58:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:58:58 smithi031 ceph-mon[77274]: pgmap v199: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:00 smithi092 ceph-mon[64495]: pgmap v200: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:59:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:00 smithi031 ceph-mon[77274]: pgmap v200: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: pgmap v201: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: reconnect by client.14510 192.168.0.1:0/168739930 after 0 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: reconnect by client.24309 192.168.0.1:0/4037238033 after 0.000999983 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:reconnect 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: fsmap cephfs:1/1 {0=cephfs.smithi031.gszbpe=up:reconnect} 2 up:standby 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:02.470 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:02 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: pgmap v201: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: reconnect by client.14510 192.168.0.1:0/168739930 after 0 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: reconnect by client.24309 192.168.0.1:0/4037238033 after 0.000999983 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:reconnect 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: fsmap cephfs:1/1 {0=cephfs.smithi031.gszbpe=up:reconnect} 2 up:standby 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:02 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:03.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:03 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:rejoin 2024-09-17T01:59:03.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:03 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:boot 2024-09-17T01:59:03.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:03 smithi031 ceph-mon[77274]: fsmap cephfs:1/1 {0=cephfs.smithi031.gszbpe=up:rejoin} 3 up:standby 2024-09-17T01:59:03.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:59:03.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:03 smithi031 ceph-mon[77274]: daemon mds.cephfs.smithi031.gszbpe is now active in filesystem cephfs as rank 0 2024-09-17T01:59:03.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:03 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:rejoin 2024-09-17T01:59:03.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:03 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:boot 2024-09-17T01:59:03.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:03 smithi092 ceph-mon[64495]: fsmap cephfs:1/1 {0=cephfs.smithi031.gszbpe=up:rejoin} 3 up:standby 2024-09-17T01:59:03.390 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T01:59:03.391 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:03 smithi092 ceph-mon[64495]: daemon mds.cephfs.smithi031.gszbpe is now active in filesystem cephfs as rank 0 2024-09-17T01:59:04.458 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:04 smithi031 ceph-mon[77274]: pgmap v202: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:59:04.458 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:04 smithi031 ceph-mon[77274]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:59:04.458 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:04 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:59:04.458 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:04 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:active 2024-09-17T01:59:04.458 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:04 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.gszbpe=up:active} 3 up:standby 2024-09-17T01:59:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:04 smithi092 ceph-mon[64495]: pgmap v202: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-17T01:59:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:04 smithi092 ceph-mon[64495]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:59:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:04 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:59:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:04 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] up:active 2024-09-17T01:59:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:04 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.gszbpe=up:active} 3 up:standby 2024-09-17T01:59:04.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 -- 172.21.15.31:0/3283221179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 msgr2=0x7fe69c101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 --2- 172.21.15.31:0/3283221179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c101950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe690009910 tx=0x7fe690009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 -- 172.21.15.31:0/3283221179 shutdown_connections 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 --2- 172.21.15.31:0/3283221179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c101950 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 --2- 172.21.15.31:0/3283221179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 0x7fe69c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 -- 172.21.15.31:0/3283221179 >> 172.21.15.31:0/3283221179 conn(0x7fe69c0fb890 msgr2=0x7fe69c0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 -- 172.21.15.31:0/3283221179 shutdown_connections 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.743+0000 7fe6a478b700 1 -- 172.21.15.31:0/3283221179 wait complete. 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a478b700 1 Processor -- start 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a478b700 1 -- start start 2024-09-17T01:59:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a478b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 0x7fe69c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a478b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a478b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1965f0 con 0x7fe69c1014e0 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a478b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c196730 con 0x7fe69c100240 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a1d26700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a1d26700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36078/0 (socket says 172.21.15.31:36078) 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a1d26700 1 -- 172.21.15.31:0/563113014 learned_addr learned my addr 172.21.15.31:0/563113014 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a2527700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 0x7fe69c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a1d26700 1 -- 172.21.15.31:0/563113014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 msgr2=0x7fe69c195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a1d26700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 0x7fe69c195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a1d26700 1 -- 172.21.15.31:0/563113014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900095f0 con 0x7fe69c1014e0 2024-09-17T01:59:04.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.744+0000 7fe6a2527700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 0x7fe69c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:59:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.745+0000 7fe6a1d26700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c195fd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe690006010 tx=0x7fe69000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.745+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69001d070 con 0x7fe69c1014e0 2024-09-17T01:59:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.745+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c19b180 con 0x7fe69c1014e0 2024-09-17T01:59:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.745+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe69000f460 con 0x7fe69c1014e0 2024-09-17T01:59:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.745+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe690021640 con 0x7fe69c1014e0 2024-09-17T01:59:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.745+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c19b670 con 0x7fe69c1014e0 2024-09-17T01:59:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.746+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c108d20 con 0x7fe69c1014e0 2024-09-17T01:59:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.746+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe69000fab0 con 0x7fe69c1014e0 2024-09-17T01:59:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.747+0000 7fe68f7fe700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe68806e680 0x7fe688070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.747+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fe69008fb40 con 0x7fe69c1014e0 2024-09-17T01:59:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.747+0000 7fe6a2527700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe68806e680 0x7fe688070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.747+0000 7fe6a2527700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe68806e680 0x7fe688070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe698005950 tx=0x7fe698005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:04.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.752+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe69005c7a0 con 0x7fe69c1014e0 2024-09-17T01:59:04.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.989+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe69c105e30 con 0x7fe68806e680 2024-09-17T01:59:04.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.991+0000 7fe68f7fe700 1 -- 172.21.15.31:0/563113014 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe69c105e30 con 0x7fe68806e680 2024-09-17T01:59:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe68806e680 msgr2=0x7fe688070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe68806e680 0x7fe688070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe698005950 tx=0x7fe698005f50 comp rx=0 tx=0).stop 2024-09-17T01:59:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 msgr2=0x7fe69c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c195fd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe690006010 tx=0x7fe69000be20 comp rx=0 tx=0).stop 2024-09-17T01:59:04.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 shutdown_connections 2024-09-17T01:59:04.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe68806e680 0x7fe688070b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:04.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe69c100240 0x7fe69c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:04.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 --2- 172.21.15.31:0/563113014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe69c1014e0 0x7fe69c195fd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:04.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 >> 172.21.15.31:0/563113014 conn(0x7fe69c0fb890 msgr2=0x7fe69c104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:04.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 shutdown_connections 2024-09-17T01:59:04.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:04.993+0000 7fe6a478b700 1 -- 172.21.15.31:0/563113014 wait complete. 2024-09-17T01:59:05.002 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 -- 172.21.15.31:0/1655188685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc1003f0 msgr2=0x7f9fbc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/1655188685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc1003f0 0x7f9fbc100860 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009910 tx=0x7f9fb0009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 -- 172.21.15.31:0/1655188685 shutdown_connections 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/1655188685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc1003f0 0x7f9fbc100860 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/1655188685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 -- 172.21.15.31:0/1655188685 >> 172.21.15.31:0/1655188685 conn(0x7f9fbc0fa7a0 msgr2=0x7f9fbc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 -- 172.21.15.31:0/1655188685 shutdown_connections 2024-09-17T01:59:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.103+0000 7f9fc23a1700 1 -- 172.21.15.31:0/1655188685 wait complete. 2024-09-17T01:59:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fc23a1700 1 Processor -- start 2024-09-17T01:59:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fc23a1700 1 -- start start 2024-09-17T01:59:05.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fc23a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fc23a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc1003f0 0x7f9fbc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fc23a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc19b160 con 0x7f9fbc0ff150 2024-09-17T01:59:05.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fc23a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc19b2a0 con 0x7f9fbc1003f0 2024-09-17T01:59:05.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fbbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.104+0000 7f9fbbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36100/0 (socket says 172.21.15.31:36100) 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fbbfff700 1 -- 172.21.15.31:0/2912379516 learned_addr learned my addr 172.21.15.31:0/2912379516 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fbb7fe700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc1003f0 0x7f9fbc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fbbfff700 1 -- 172.21.15.31:0/2912379516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc1003f0 msgr2=0x7f9fbc19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fbbfff700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc1003f0 0x7f9fbc19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fbbfff700 1 -- 172.21.15.31:0/2912379516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00095f0 con 0x7f9fbc0ff150 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fbbfff700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc069930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00b4b0 tx=0x7f9fac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac011800 con 0x7f9fbc0ff150 2024-09-17T01:59:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc19b580 con 0x7f9fbc0ff150 2024-09-17T01:59:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9fac011e10 con 0x7f9fbc0ff150 2024-09-17T01:59:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac00f2e0 con 0x7f9fbc0ff150 2024-09-17T01:59:05.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.105+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc19bad0 con 0x7f9fbc0ff150 2024-09-17T01:59:05.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.106+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc068ab0 con 0x7f9fbc0ff150 2024-09-17T01:59:05.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.107+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9fac010380 con 0x7f9fbc0ff150 2024-09-17T01:59:05.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.107+0000 7f9fb97fa700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9fa406e680 0x7f9fa4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.107+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f9fac08e3a0 con 0x7f9fbc0ff150 2024-09-17T01:59:05.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.107+0000 7f9fbb7fe700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9fa406e680 0x7f9fa4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.108+0000 7f9fbb7fe700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9fa406e680 0x7f9fa4070b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc069eb0 tx=0x7f9fb000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.112+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9fac05af60 con 0x7f9fbc0ff150 2024-09-17T01:59:05.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.351+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fbc104de0 con 0x7f9fa406e680 2024-09-17T01:59:05.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.352+0000 7f9fb97fa700 1 -- 172.21.15.31:0/2912379516 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9fbc104de0 con 0x7f9fa406e680 2024-09-17T01:59:05.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9fa406e680 msgr2=0x7f9fa4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9fa406e680 0x7f9fa4070b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc069eb0 tx=0x7f9fb000b540 comp rx=0 tx=0).stop 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 msgr2=0x7f9fbc069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc069930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00b4b0 tx=0x7f9fac00b870 comp rx=0 tx=0).stop 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 shutdown_connections 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9fa406e680 0x7f9fa4070b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fbc0ff150 0x7f9fbc069930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 --2- 172.21.15.31:0/2912379516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc1003f0 0x7f9fbc19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 >> 172.21.15.31:0/2912379516 conn(0x7f9fbc0fa7a0 msgr2=0x7f9fbc103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 shutdown_connections 2024-09-17T01:59:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.355+0000 7f9fc23a1700 1 -- 172.21.15.31:0/2912379516 wait complete. 2024-09-17T01:59:05.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 -- 172.21.15.31:0/396872047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 msgr2=0x7f55bc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 --2- 172.21.15.31:0/396872047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc100860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009910 tx=0x7f55b0009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:05.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 -- 172.21.15.31:0/396872047 shutdown_connections 2024-09-17T01:59:05.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 --2- 172.21.15.31:0/396872047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc100860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 --2- 172.21.15.31:0/396872047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 0x7f55bc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 -- 172.21.15.31:0/396872047 >> 172.21.15.31:0/396872047 conn(0x7f55bc0fa7a0 msgr2=0x7f55bc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 -- 172.21.15.31:0/396872047 shutdown_connections 2024-09-17T01:59:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.464+0000 7f55c420d700 1 -- 172.21.15.31:0/396872047 wait complete. 2024-09-17T01:59:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c420d700 1 Processor -- start 2024-09-17T01:59:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c420d700 1 -- start start 2024-09-17T01:59:05.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c420d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 0x7f55bc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c420d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c420d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc19b0e0 con 0x7f55bc1003f0 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c420d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc19b220 con 0x7f55bc0ff150 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c17a8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c17a8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36108/0 (socket says 172.21.15.31:36108) 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c17a8700 1 -- 172.21.15.31:0/2979814271 learned_addr learned my addr 172.21.15.31:0/2979814271 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c1fa9700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 0x7f55bc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c17a8700 1 -- 172.21.15.31:0/2979814271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 msgr2=0x7f55bc069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c17a8700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 0x7f55bc069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c17a8700 1 -- 172.21.15.31:0/2979814271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00095f0 con 0x7f55bc1003f0 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.465+0000 7f55c1fa9700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 0x7f55bc069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.466+0000 7f55c17a8700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc19ab10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006010 tx=0x7f55b000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.466+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b001d070 con 0x7f55bc1003f0 2024-09-17T01:59:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.466+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55b000f460 con 0x7f55bc1003f0 2024-09-17T01:59:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.466+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc19b4a0 con 0x7f55bc1003f0 2024-09-17T01:59:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.466+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b0021640 con 0x7f55bc1003f0 2024-09-17T01:59:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.466+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc19b990 con 0x7f55bc1003f0 2024-09-17T01:59:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.467+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc068ab0 con 0x7f55bc1003f0 2024-09-17T01:59:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.468+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f55b0004b20 con 0x7f55bc1003f0 2024-09-17T01:59:05.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.468+0000 7f55aeffd700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f55a806e680 0x7f55a8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.468+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f55b008fb90 con 0x7f55bc1003f0 2024-09-17T01:59:05.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.468+0000 7f55c1fa9700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f55a806e680 0x7f55a8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.468+0000 7f55c1fa9700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f55a806e680 0x7f55a8070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f55b8005950 tx=0x7f55b8005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:05.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.472+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f55b005c7f0 con 0x7f55bc1003f0 2024-09-17T01:59:05.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.699+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f55bc104e40 con 0x7f55a806e680 2024-09-17T01:59:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.708+0000 7f55aeffd700 1 -- 172.21.15.31:0/2979814271 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f55bc104e40 con 0x7f55a806e680 2024-09-17T01:59:05.707 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:59:05.707 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (13m) 2m ago 15m 24.9M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (15m) 2m ago 15m 8480k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (14m) 63s ago 14m 8535k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (4m) 2m ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (4m) 63s ago 14m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (13m) 2m ago 14m 87.1M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (9m) 2m ago 9m 62.9M - 18.2.0 dc2bc1663786 41d206e2b981 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 starting - - - - 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (9m) 63s ago 9m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (9m) 63s ago 9m 119M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:59:05.708 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (6m) 2m ago 16m 500M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (5m) 63s ago 14m 442M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (5m) 2m ago 16m 47.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (5m) 63s ago 14m 39.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (15m) 2m ago 15m 16.7M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (14m) 63s ago 14m 15.4M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (3m) 2m ago 13m 89.7M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (3m) 2m ago 13m 103M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (2m) 2m ago 12m 11.2M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (2m) 63s ago 12m 133M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (98s) 63s ago 11m 89.5M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (66s) 63s ago 11m 11.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T01:59:05.709 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (5m) 2m ago 14m 75.0M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:59:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f55a806e680 msgr2=0x7f55a8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f55a806e680 0x7f55a8070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f55b8005950 tx=0x7f55b8005f50 comp rx=0 tx=0).stop 2024-09-17T01:59:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 msgr2=0x7f55bc19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc19ab10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006010 tx=0x7f55b000be20 comp rx=0 tx=0).stop 2024-09-17T01:59:05.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 shutdown_connections 2024-09-17T01:59:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f55a806e680 0x7f55a8070b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55bc0ff150 0x7f55bc069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 --2- 172.21.15.31:0/2979814271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55bc1003f0 0x7f55bc19ab10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 >> 172.21.15.31:0/2979814271 conn(0x7f55bc0fa7a0 msgr2=0x7f55bc103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 shutdown_connections 2024-09-17T01:59:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.711+0000 7f55c420d700 1 -- 172.21.15.31:0/2979814271 wait complete. 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 -- 172.21.15.31:0/2023048207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 msgr2=0x7f5e14100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 --2- 172.21.15.31:0/2023048207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e14100840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009910 tx=0x7f5e08009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 -- 172.21.15.31:0/2023048207 shutdown_connections 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 --2- 172.21.15.31:0/2023048207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e14100840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 --2- 172.21.15.31:0/2023048207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 0x7f5e140ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 -- 172.21.15.31:0/2023048207 >> 172.21.15.31:0/2023048207 conn(0x7f5e140fa780 msgr2=0x7f5e140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 -- 172.21.15.31:0/2023048207 shutdown_connections 2024-09-17T01:59:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.819+0000 7f5e19f69700 1 -- 172.21.15.31:0/2023048207 wait complete. 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e19f69700 1 Processor -- start 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e19f69700 1 -- start start 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e19f69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 0x7f5e14197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e19f69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e141981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e19f69700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141987b0 con 0x7f5e141003d0 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e19f69700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14198920 con 0x7f5e140ff130 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e12ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e141981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e12ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e141981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36122/0 (socket says 172.21.15.31:36122) 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.820+0000 7f5e12ffd700 1 -- 172.21.15.31:0/4149452610 learned_addr learned my addr 172.21.15.31:0/4149452610 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e137fe700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 0x7f5e14197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e12ffd700 1 -- 172.21.15.31:0/4149452610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 msgr2=0x7f5e14197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e12ffd700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 0x7f5e14197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e12ffd700 1 -- 172.21.15.31:0/4149452610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080095f0 con 0x7f5e141003d0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e137fe700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 0x7f5e14197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e12ffd700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e141981b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e08006010 tx=0x7f5e0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0801d070 con 0x7f5e141003d0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e0800f460 con 0x7f5e141003d0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1419d350 con 0x7f5e141003d0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e08021640 con 0x7f5e141003d0 2024-09-17T01:59:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.821+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1419d840 con 0x7f5e141003d0 2024-09-17T01:59:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.822+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e14107c10 con 0x7f5e141003d0 2024-09-17T01:59:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.823+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5e0800fab0 con 0x7f5e141003d0 2024-09-17T01:59:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.823+0000 7f5e10ff9700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5dfc06e680 0x7f5dfc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.823+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f5e0808fb40 con 0x7f5e141003d0 2024-09-17T01:59:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.823+0000 7f5e137fe700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5dfc06e680 0x7f5dfc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:05.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.824+0000 7f5e137fe700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5dfc06e680 0x7f5dfc070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005fd0 tx=0x7f5e04005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:05.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:05.828+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e08058c70 con 0x7f5e141003d0 2024-09-17T01:59:06.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.131+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e1419df40 con 0x7f5e141003d0 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.131+0000 7f5e10ff9700 1 -- 172.21.15.31:0/4149452610 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f5e0805c330 con 0x7f5e141003d0 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:59:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:59:06.131 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5dfc06e680 msgr2=0x7f5dfc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5dfc06e680 0x7f5dfc070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005fd0 tx=0x7f5e04005de0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 msgr2=0x7f5e141981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e141981b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e08006010 tx=0x7f5e0800be20 comp rx=0 tx=0).stop 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 shutdown_connections 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5dfc06e680 0x7f5dfc070b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140ff130 0x7f5e14197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 --2- 172.21.15.31:0/4149452610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e141003d0 0x7f5e141981b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 >> 172.21.15.31:0/4149452610 conn(0x7f5e140fa780 msgr2=0x7f5e14068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 shutdown_connections 2024-09-17T01:59:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.134+0000 7f5e19f69700 1 -- 172.21.15.31:0/4149452610 wait complete. 2024-09-17T01:59:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 -- 172.21.15.31:0/2867204311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b0103310 msgr2=0x7f51b0105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 --2- 172.21.15.31:0/2867204311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b0103310 0x7f51b0105790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009910 tx=0x7f51a0009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 -- 172.21.15.31:0/2867204311 shutdown_connections 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 --2- 172.21.15.31:0/2867204311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b0103310 0x7f51b0105790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 --2- 172.21.15.31:0/2867204311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b0069270 0x7f51b0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 -- 172.21.15.31:0/2867204311 >> 172.21.15.31:0/2867204311 conn(0x7f51b00fa780 msgr2=0x7f51b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 -- 172.21.15.31:0/2867204311 shutdown_connections 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.243+0000 7f51b8577700 1 -- 172.21.15.31:0/2867204311 wait complete. 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b8577700 1 Processor -- start 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b8577700 1 -- start start 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b8577700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b0103310 0x7f51b0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b8577700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 0x7f51b00ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b8577700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00ff720 con 0x7f51b00fed70 2024-09-17T01:59:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b8577700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00ff890 con 0x7f51b0103310 2024-09-17T01:59:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 0x7f51b00ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 0x7f51b00ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36144/0 (socket says 172.21.15.31:36144) 2024-09-17T01:59:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 -- 172.21.15.31:0/2038110083 learned_addr learned my addr 172.21.15.31:0/2038110083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b6313700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b0103310 0x7f51b0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 -- 172.21.15.31:0/2038110083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b0103310 msgr2=0x7f51b0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b0103310 0x7f51b0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 -- 172.21.15.31:0/2038110083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00095f0 con 0x7f51b00fed70 2024-09-17T01:59:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.244+0000 7f51b5b12700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 0x7f51b00ff1e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b5c0 tx=0x7f51a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.245+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a001d070 con 0x7f51b00fed70 2024-09-17T01:59:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.245+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f51a0022470 con 0x7f51b00fed70 2024-09-17T01:59:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.245+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b00ffb10 con 0x7f51b00fed70 2024-09-17T01:59:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.245+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a000f690 con 0x7f51b00fed70 2024-09-17T01:59:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.245+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b019dd00 con 0x7f51b00fed70 2024-09-17T01:59:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.246+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b018fbf0 con 0x7f51b00fed70 2024-09-17T01:59:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.246+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f51a00225e0 con 0x7f51b00fed70 2024-09-17T01:59:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.247+0000 7f51a77fe700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f519c06e680 0x7f519c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.247+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f51a008fdc0 con 0x7f51b00fed70 2024-09-17T01:59:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.247+0000 7f51b6313700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f519c06e680 0x7f519c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.247+0000 7f51b6313700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f519c06e680 0x7f519c070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51ac005950 tx=0x7f51ac00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:06.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.251+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f51a005caa0 con 0x7f51b00fed70 2024-09-17T01:59:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:06 smithi092 ceph-mon[64495]: pgmap v203: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 196 B/s wr, 4 op/s 2024-09-17T01:59:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:06 smithi092 ceph-mon[64495]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:06 smithi031 ceph-mon[77274]: pgmap v203: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 196 B/s wr, 4 op/s 2024-09-17T01:59:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:06 smithi031 ceph-mon[77274]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:06.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.520+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f51b0069270 con 0x7f51b00fed70 2024-09-17T01:59:06.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.520+0000 7f51a77fe700 1 -- 172.21.15.31:0/2038110083 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1928 (secure 0 0 0) 0x7f51a00277a0 con 0x7f51b00fed70 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:e30 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:59:03:090655+0000 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 30 2024-09-17T01:59:06.519 INFO:teuthology.orchestra.run.smithi031.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:59:03.090653+0000 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 91 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:59:06.520 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 1 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:in 0 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=34380} 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 1 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:59:06.521 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 34380 members: 34380 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{0:34380} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.31:6828/2388806534,v1:172.21.15.31:6829/2388806534] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout:Standby daemons: 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{-1:34416} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/1658276078,v1:172.21.15.92:6827/1658276078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:59:06.522 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6824/3556360183,v1:172.21.15.92:6825/3556360183] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f519c06e680 msgr2=0x7f519c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f519c06e680 0x7f519c070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51ac005950 tx=0x7f51ac00a300 comp rx=0 tx=0).stop 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 msgr2=0x7f51b00ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 0x7f51b00ff1e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b5c0 tx=0x7f51a000bd70 comp rx=0 tx=0).stop 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 shutdown_connections 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f519c06e680 0x7f519c070b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b0103310 0x7f51b0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 --2- 172.21.15.31:0/2038110083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b00fed70 0x7f51b00ff1e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.522+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 >> 172.21.15.31:0/2038110083 conn(0x7f51b00fa780 msgr2=0x7f51b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.523+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 shutdown_connections 2024-09-17T01:59:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.523+0000 7f51b8577700 1 -- 172.21.15.31:0/2038110083 wait complete. 2024-09-17T01:59:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 30 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 -- 172.21.15.31:0/557030213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 msgr2=0x7fb2800ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 --2- 172.21.15.31:0/557030213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800ff540 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb274009910 tx=0x7fb274009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 -- 172.21.15.31:0/557030213 shutdown_connections 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 --2- 172.21.15.31:0/557030213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2801003d0 0x7fb280100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 --2- 172.21.15.31:0/557030213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800ff540 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 -- 172.21.15.31:0/557030213 >> 172.21.15.31:0/557030213 conn(0x7fb2800fa780 msgr2=0x7fb2800fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 -- 172.21.15.31:0/557030213 shutdown_connections 2024-09-17T01:59:06.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.634+0000 7fb287050700 1 -- 172.21.15.31:0/557030213 wait complete. 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb287050700 1 Processor -- start 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb287050700 1 -- start start 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb287050700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb287050700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2801003d0 0x7fb28019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb287050700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28019ade0 con 0x7fb2800ff130 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb287050700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28019af20 con 0x7fb2801003d0 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb284dec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb284dec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36158/0 (socket says 172.21.15.31:36158) 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb284dec700 1 -- 172.21.15.31:0/70010237 learned_addr learned my addr 172.21.15.31:0/70010237 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb27ffff700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2801003d0 0x7fb28019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb284dec700 1 -- 172.21.15.31:0/70010237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2801003d0 msgr2=0x7fb28019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb284dec700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2801003d0 0x7fb28019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.635+0000 7fb284dec700 1 -- 172.21.15.31:0/70010237 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740095f0 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.636+0000 7fb284dec700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800690a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb27400bd70 tx=0x7fb27400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.636+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27401d070 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.636+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb274005dc0 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.636+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28019b1a0 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.636+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb274021410 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.636+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28019b690 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.637+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb280107c10 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.638+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb27400f7d0 con 0x7fb2800ff130 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.638+0000 7fb27dffb700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb27006e680 0x7fb270070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.638+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7fb27408f960 con 0x7fb2800ff130 2024-09-17T01:59:06.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.638+0000 7fb27ffff700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb27006e680 0x7fb270070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.639+0000 7fb27ffff700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb27006e680 0x7fb270070b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb280069620 tx=0x7fb26c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:06.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.643+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb27405c5c0 con 0x7fb2800ff130 2024-09-17T01:59:06.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.878+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb280104d20 con 0x7fb27006e680 2024-09-17T01:59:06.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.879+0000 7fb27dffb700 1 -- 172.21.15.31:0/70010237 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb280104d20 con 0x7fb27006e680 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "osd", 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "12/23 daemons upgraded", 2024-09-17T01:59:06.878 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:59:06.879 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:59:06.879 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:59:06.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb27006e680 msgr2=0x7fb270070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb27006e680 0x7fb270070b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb280069620 tx=0x7fb26c00b410 comp rx=0 tx=0).stop 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 msgr2=0x7fb2800690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800690a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb27400bd70 tx=0x7fb27400bda0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 shutdown_connections 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb27006e680 0x7fb270070b30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2800ff130 0x7fb2800690a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 --2- 172.21.15.31:0/70010237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2801003d0 0x7fb28019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 >> 172.21.15.31:0/70010237 conn(0x7fb2800fa780 msgr2=0x7fb280103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.881+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 shutdown_connections 2024-09-17T01:59:06.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.882+0000 7fb287050700 1 -- 172.21.15.31:0/70010237 wait complete. 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 -- 172.21.15.31:0/147936453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8101440 msgr2=0x7f4bc8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/147936453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8101440 0x7f4bc8101890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009910 tx=0x7f4bb8009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 -- 172.21.15.31:0/147936453 shutdown_connections 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/147936453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8101440 0x7f4bc8101890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/147936453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc8100240 0x7f4bc8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 -- 172.21.15.31:0/147936453 >> 172.21.15.31:0/147936453 conn(0x7f4bc80fb7f0 msgr2=0x7f4bc80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 -- 172.21.15.31:0/147936453 shutdown_connections 2024-09-17T01:59:06.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 -- 172.21.15.31:0/147936453 wait complete. 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.990+0000 7f4bd01cd700 1 Processor -- start 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bd01cd700 1 -- start start 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bd01cd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 0x7f4bc8195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bd01cd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc8101440 0x7f4bc8195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bd01cd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc81965f0 con 0x7f4bc8100240 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bd01cd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc8196730 con 0x7f4bc8101440 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 0x7f4bc8195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 0x7f4bc8195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36172/0 (socket says 172.21.15.31:36172) 2024-09-17T01:59:06.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 -- 172.21.15.31:0/978025869 learned_addr learned my addr 172.21.15.31:0/978025869 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcd768700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc8101440 0x7f4bc8195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 -- 172.21.15.31:0/978025869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc8101440 msgr2=0x7f4bc8195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc8101440 0x7f4bc8195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 -- 172.21.15.31:0/978025869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80095f0 con 0x7f4bc8100240 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.991+0000 7f4bcdf69700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 0x7f4bc8195a90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4007e90 tx=0x7f4bc400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.992+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bc4017070 con 0x7f4bc8100240 2024-09-17T01:59:06.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.992+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bc400f040 con 0x7f4bc8100240 2024-09-17T01:59:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.992+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc819b1e0 con 0x7f4bc8100240 2024-09-17T01:59:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.992+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bc4004820 con 0x7f4bc8100240 2024-09-17T01:59:06.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.992+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc819b730 con 0x7f4bc8100240 2024-09-17T01:59:06.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.992+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc8108d90 con 0x7f4bc8100240 2024-09-17T01:59:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.993+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4bc4003a00 con 0x7f4bc8100240 2024-09-17T01:59:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.994+0000 7f4bbeffd700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4bb406e680 0x7f4bb4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.994+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6445+0+0 (secure 0 0 0) 0x7f4bc408dfd0 con 0x7f4bc8100240 2024-09-17T01:59:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.994+0000 7f4bcd768700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4bb406e680 0x7f4bb4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:06.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.994+0000 7f4bcd768700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4bb406e680 0x7f4bb4070b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006010 tx=0x7f4bb800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:06.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:06.998+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4bc405acb0 con 0x7f4bc8100240 2024-09-17T01:59:07.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:07 smithi031 ceph-mon[77274]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:07.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:07 smithi031 ceph-mon[77274]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:07.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:07 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/4149452610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:07 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2038110083' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:59:07.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.304+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4bc8108f80 con 0x7f4bc8100240 2024-09-17T01:59:07.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.304+0000 7f4bbeffd700 1 -- 172.21.15.31:0/978025869 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4bc405a840 con 0x7f4bc8100240 2024-09-17T01:59:07.303 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:59:07.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4bb406e680 msgr2=0x7f4bb4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:07.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4bb406e680 0x7f4bb4070b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006010 tx=0x7f4bb800b540 comp rx=0 tx=0).stop 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 msgr2=0x7f4bc8195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 0x7f4bc8195a90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4007e90 tx=0x7f4bc400d3b0 comp rx=0 tx=0).stop 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 shutdown_connections 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4bb406e680 0x7f4bb4070b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bc8100240 0x7f4bc8195a90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 --2- 172.21.15.31:0/978025869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bc8101440 0x7f4bc8195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 >> 172.21.15.31:0/978025869 conn(0x7f4bc80fb7f0 msgr2=0x7f4bc8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 shutdown_connections 2024-09-17T01:59:07.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:07.307+0000 7f4bd01cd700 1 -- 172.21.15.31:0/978025869 wait complete. 2024-09-17T01:59:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:07 smithi092 ceph-mon[64495]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:07 smithi092 ceph-mon[64495]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:07 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/4149452610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:07 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2038110083' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:59:08.482 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:08 smithi031 ceph-mon[77274]: pgmap v204: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:59:08.482 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:08 smithi031 ceph-mon[77274]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:08.482 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:08 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/978025869' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:59:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:08 smithi092 ceph-mon[64495]: pgmap v204: 65 pgs: 65 active+clean; 151 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:59:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:08 smithi092 ceph-mon[64495]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:08 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/978025869' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:59:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:10 smithi092 ceph-mon[64495]: pgmap v205: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 6.9 KiB/s wr, 10 op/s 2024-09-17T01:59:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:10 smithi031 ceph-mon[77274]: pgmap v205: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 6.9 KiB/s wr, 10 op/s 2024-09-17T01:59:11.892 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:11 smithi031 ceph-mon[77274]: pgmap v206: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2024-09-17T01:59:11.892 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:11 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.892 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:11 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.892 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:11 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.892 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:11 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:11 smithi092 ceph-mon[64495]: pgmap v206: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2024-09-17T01:59:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:11 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:11 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:11 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:11 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:13.856 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:13 smithi031 ceph-mon[77274]: pgmap v207: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2024-09-17T01:59:13.930 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:13 smithi092 ceph-mon[64495]: pgmap v207: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: pgmap v208: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: Detected new or changed devices on smithi031 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:59:15.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi031.gszbpe"]}]: dispatch 2024-09-17T01:59:15.766 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:15 smithi031 ceph-mon[77274]: Upgrade: It appears safe to stop mds.cephfs.smithi031.gszbpe 2024-09-17T01:59:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: pgmap v208: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2024-09-17T01:59:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: Detected new or changed devices on smithi031 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi031.gszbpe"]}]: dispatch 2024-09-17T01:59:15.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:15 smithi092 ceph-mon[64495]: Upgrade: It appears safe to stop mds.cephfs.smithi031.gszbpe 2024-09-17T01:59:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:17 smithi092 ceph-mon[64495]: Upgrade: Updating mds.cephfs.smithi031.gszbpe 2024-09-17T01:59:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:59:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:17 smithi092 ceph-mon[64495]: Deploying daemon mds.cephfs.smithi031.gszbpe on smithi031 2024-09-17T01:59:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:17 smithi031 ceph-mon[77274]: Upgrade: Updating mds.cephfs.smithi031.gszbpe 2024-09-17T01:59:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi031.gszbpe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:59:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:17 smithi031 ceph-mon[77274]: Deploying daemon mds.cephfs.smithi031.gszbpe on smithi031 2024-09-17T01:59:18.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:18 smithi031 ceph-mon[77274]: pgmap v209: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-09-17T01:59:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:18 smithi092 ceph-mon[64495]: pgmap v209: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-09-17T01:59:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:18 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[77270]: 2024-09-17T01:59:18.184+0000 7fe1b8d51640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:59:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:59:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:59:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: osdmap e92: 6 total, 6 up, 6 in 2024-09-17T01:59:19.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: Standby daemon mds.cephfs.smithi031.menvuk assigned to filesystem cephfs as rank 0 2024-09-17T01:59:19.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:59:19.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:59:19.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:19 smithi092 ceph-mon[64495]: fsmap cephfs:1/1 {0=cephfs.smithi031.menvuk=up:replay} 2 up:standby 2024-09-17T01:59:19.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:59:19.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:59:19.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: osdmap e92: 6 total, 6 up, 6 in 2024-09-17T01:59:19.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: Standby daemon mds.cephfs.smithi031.menvuk assigned to filesystem cephfs as rank 0 2024-09-17T01:59:19.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:59:19.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:59:19.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:19 smithi031 ceph-mon[77274]: fsmap cephfs:1/1 {0=cephfs.smithi031.menvuk=up:replay} 2 up:standby 2024-09-17T01:59:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:20 smithi092 ceph-mon[64495]: pgmap v211: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:59:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:20 smithi031 ceph-mon[77274]: pgmap v211: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:59:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:21 smithi092 ceph-mon[64495]: pgmap v212: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:21 smithi031 ceph-mon[77274]: pgmap v212: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:23 smithi092 ceph-mon[64495]: pgmap v213: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-17T01:59:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:23 smithi031 ceph-mon[77274]: pgmap v213: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-17T01:59:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:25 smithi092 ceph-mon[64495]: pgmap v214: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-17T01:59:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:25 smithi092 ceph-mon[64495]: reconnect by client.14510 192.168.0.1:0/168739930 after 0.000999983 2024-09-17T01:59:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:25 smithi092 ceph-mon[64495]: reconnect by client.24309 192.168.0.1:0/4037238033 after 0.000999983 2024-09-17T01:59:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:25 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:reconnect 2024-09-17T01:59:25.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:25 smithi092 ceph-mon[64495]: fsmap cephfs:1/1 {0=cephfs.smithi031.menvuk=up:reconnect} 2 up:standby 2024-09-17T01:59:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:25 smithi031 ceph-mon[77274]: pgmap v214: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-17T01:59:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:25 smithi031 ceph-mon[77274]: reconnect by client.14510 192.168.0.1:0/168739930 after 0.000999983 2024-09-17T01:59:25.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:25 smithi031 ceph-mon[77274]: reconnect by client.24309 192.168.0.1:0/4037238033 after 0.000999983 2024-09-17T01:59:25.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:25 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:reconnect 2024-09-17T01:59:25.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:25 smithi031 ceph-mon[77274]: fsmap cephfs:1/1 {0=cephfs.smithi031.menvuk=up:reconnect} 2 up:standby 2024-09-17T01:59:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:26 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:rejoin 2024-09-17T01:59:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:26 smithi092 ceph-mon[64495]: fsmap cephfs:1/1 {0=cephfs.smithi031.menvuk=up:rejoin} 2 up:standby 2024-09-17T01:59:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:26 smithi092 ceph-mon[64495]: daemon mds.cephfs.smithi031.menvuk is now active in filesystem cephfs as rank 0 2024-09-17T01:59:26.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:26 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:rejoin 2024-09-17T01:59:26.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:26 smithi031 ceph-mon[77274]: fsmap cephfs:1/1 {0=cephfs.smithi031.menvuk=up:rejoin} 2 up:standby 2024-09-17T01:59:26.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:26 smithi031 ceph-mon[77274]: daemon mds.cephfs.smithi031.menvuk is now active in filesystem cephfs as rank 0 2024-09-17T01:59:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:27 smithi092 ceph-mon[64495]: pgmap v215: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-17T01:59:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:27 smithi092 ceph-mon[64495]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:59:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:27 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T01:59:27.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:27 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:active 2024-09-17T01:59:27.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:27 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T01:59:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:27 smithi031 ceph-mon[77274]: pgmap v215: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-17T01:59:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:27 smithi031 ceph-mon[77274]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:59:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:27 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T01:59:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:27 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] up:active 2024-09-17T01:59:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:27 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T01:59:29.641 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:29 smithi031 ceph-mon[77274]: pgmap v216: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 5.0 KiB/s wr, 10 op/s 2024-09-17T01:59:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:29 smithi092 ceph-mon[64495]: pgmap v216: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 5.0 KiB/s wr, 10 op/s 2024-09-17T01:59:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:31.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:30 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] up:boot 2024-09-17T01:59:31.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:30 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T01:59:31.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:59:31.257 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:31.257 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:31.257 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:31.257 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:30 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] up:boot 2024-09-17T01:59:31.258 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:30 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T01:59:31.258 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T01:59:32.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:31 smithi092 ceph-mon[64495]: pgmap v217: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:59:32.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:31 smithi031 ceph-mon[77274]: pgmap v217: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:59:34.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:33 smithi092 ceph-mon[64495]: pgmap v218: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:59:34.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:33 smithi031 ceph-mon[77274]: pgmap v218: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:59:36.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:35 smithi031 ceph-mon[77274]: pgmap v219: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:59:36.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:36.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:36.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:35 smithi092 ceph-mon[64495]: pgmap v219: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:59:36.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:36.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:37.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 -- 172.21.15.31:0/298751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 msgr2=0x7fb8d01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/298751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d01030c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009910 tx=0x7fb8c0009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 -- 172.21.15.31:0/298751026 shutdown_connections 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/298751026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d0103600 0x7fb8d01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/298751026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d01030c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 -- 172.21.15.31:0/298751026 >> 172.21.15.31:0/298751026 conn(0x7fb8d00fa700 msgr2=0x7fb8d00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 -- 172.21.15.31:0/298751026 shutdown_connections 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.422+0000 7fb8d59ab700 1 -- 172.21.15.31:0/298751026 wait complete. 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8d59ab700 1 Processor -- start 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8d59ab700 1 -- start start 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8d59ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d0100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8d59ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d0103600 0x7fb8d00fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8d59ab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00ff1d0 con 0x7fb8d0100ce0 2024-09-17T01:59:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8d59ab700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00ff310 con 0x7fb8d0103600 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8ceffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d0100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8ceffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d0100640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37176/0 (socket says 172.21.15.31:37176) 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.423+0000 7fb8ceffd700 1 -- 172.21.15.31:0/3652383351 learned_addr learned my addr 172.21.15.31:0/3652383351 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8ce7fc700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d0103600 0x7fb8d00fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8ceffd700 1 -- 172.21.15.31:0/3652383351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d0103600 msgr2=0x7fb8d00fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8ceffd700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d0103600 0x7fb8d00fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8ceffd700 1 -- 172.21.15.31:0/3652383351 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00095f0 con 0x7fb8d0100ce0 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8ceffd700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d0100640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0006010 tx=0x7fb8c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c001d070 con 0x7fb8d0100ce0 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d00ff590 con 0x7fb8d0100ce0 2024-09-17T01:59:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8c000f460 con 0x7fb8d0100ce0 2024-09-17T01:59:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c0021640 con 0x7fb8d0100ce0 2024-09-17T01:59:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.424+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00ffa80 con 0x7fb8d0100ce0 2024-09-17T01:59:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.425+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d018fc70 con 0x7fb8d0100ce0 2024-09-17T01:59:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.426+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb8c0004b20 con 0x7fb8d0100ce0 2024-09-17T01:59:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.427+0000 7fb8d49a9700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8b806e680 0x7fb8b8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.427+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb8c008fc00 con 0x7fb8d0100ce0 2024-09-17T01:59:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.427+0000 7fb8ce7fc700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8b806e680 0x7fb8b8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.427+0000 7fb8ce7fc700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8b806e680 0x7fb8b8070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005fd0 tx=0x7fb8c400a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.431+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb8c005c760 con 0x7fb8d0100ce0 2024-09-17T01:59:37.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.680+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8d0061190 con 0x7fb8b806e680 2024-09-17T01:59:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.682+0000 7fb8d49a9700 1 -- 172.21.15.31:0/3652383351 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb8d0061190 con 0x7fb8b806e680 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8b806e680 msgr2=0x7fb8b8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8b806e680 0x7fb8b8070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005fd0 tx=0x7fb8c400a560 comp rx=0 tx=0).stop 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 msgr2=0x7fb8d0100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d0100640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0006010 tx=0x7fb8c000be20 comp rx=0 tx=0).stop 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 shutdown_connections 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8b806e680 0x7fb8b8070b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d0100ce0 0x7fb8d0100640 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 --2- 172.21.15.31:0/3652383351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8d0103600 0x7fb8d00fec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 >> 172.21.15.31:0/3652383351 conn(0x7fb8d00fa700 msgr2=0x7fb8d00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 shutdown_connections 2024-09-17T01:59:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.684+0000 7fb8d59ab700 1 -- 172.21.15.31:0/3652383351 wait complete. 2024-09-17T01:59:37.694 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T01:59:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 -- 172.21.15.31:0/2796300873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 msgr2=0x7fb3300fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:37.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 --2- 172.21.15.31:0/2796300873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb3300fffd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb32400aa20 tx=0x7fb32400ad30 comp rx=0 tx=0).stop 2024-09-17T01:59:37.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 -- 172.21.15.31:0/2796300873 shutdown_connections 2024-09-17T01:59:37.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 --2- 172.21.15.31:0/2796300873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb3300fffd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 --2- 172.21.15.31:0/2796300873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3300fe8c0 0x7fb3300fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 -- 172.21.15.31:0/2796300873 >> 172.21.15.31:0/2796300873 conn(0x7fb3300f9f10 msgr2=0x7fb3300fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:37.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 -- 172.21.15.31:0/2796300873 shutdown_connections 2024-09-17T01:59:37.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.801+0000 7fb334cbe700 1 -- 172.21.15.31:0/2796300873 wait complete. 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb334cbe700 1 Processor -- start 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb334cbe700 1 -- start start 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb334cbe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3300fe8c0 0x7fb3301938d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb334cbe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb330193e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb334cbe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330194430 con 0x7fb3300ffb60 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb334cbe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330194570 con 0x7fb3300fe8c0 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb32dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb330193e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb32dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb330193e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37184/0 (socket says 172.21.15.31:37184) 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb32dd9b700 1 -- 172.21.15.31:0/3358204347 learned_addr learned my addr 172.21.15.31:0/3358204347 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.802+0000 7fb32e59c700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3300fe8c0 0x7fb3301938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb32dd9b700 1 -- 172.21.15.31:0/3358204347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3300fe8c0 msgr2=0x7fb3301938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb32dd9b700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3300fe8c0 0x7fb3301938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb32dd9b700 1 -- 172.21.15.31:0/3358204347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32400a700 con 0x7fb3300ffb60 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb32dd9b700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb330193e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb32400fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb324005070 con 0x7fb3300ffb60 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb330196fb0 con 0x7fb3300ffb60 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb3240051d0 con 0x7fb3300ffb60 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3240168c0 con 0x7fb3300ffb60 2024-09-17T01:59:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.803+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3301974a0 con 0x7fb3300ffb60 2024-09-17T01:59:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.804+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb330106b00 con 0x7fb3300ffb60 2024-09-17T01:59:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.805+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb324016ab0 con 0x7fb3300ffb60 2024-09-17T01:59:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.805+0000 7fb31f7fe700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb31806e680 0x7fb318070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.805+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb324012070 con 0x7fb3300ffb60 2024-09-17T01:59:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.805+0000 7fb32e59c700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb31806e680 0x7fb318070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.806+0000 7fb32e59c700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb31806e680 0x7fb318070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb320005950 tx=0x7fb32000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:37.810+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb32405d080 con 0x7fb3300ffb60 2024-09-17T01:59:38.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.053+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3301044b0 con 0x7fb31806e680 2024-09-17T01:59:38.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.055+0000 7fb31f7fe700 1 -- 172.21.15.31:0/3358204347 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb3301044b0 con 0x7fb31806e680 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb31806e680 msgr2=0x7fb318070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb31806e680 0x7fb318070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb320005950 tx=0x7fb32000b410 comp rx=0 tx=0).stop 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 msgr2=0x7fb330193e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb330193e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb32400fd90 comp rx=0 tx=0).stop 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 shutdown_connections 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb31806e680 0x7fb318070b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3300fe8c0 0x7fb3301938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 --2- 172.21.15.31:0/3358204347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3300ffb60 0x7fb330193e10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 >> 172.21.15.31:0/3358204347 conn(0x7fb3300f9f10 msgr2=0x7fb330102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:38.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 shutdown_connections 2024-09-17T01:59:38.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.057+0000 7fb334cbe700 1 -- 172.21.15.31:0/3358204347 wait complete. 2024-09-17T01:59:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 -- 172.21.15.31:0/1082383282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 msgr2=0x7fc450100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 --2- 172.21.15.31:0/1082383282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc450100860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc444009910 tx=0x7fc444009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 -- 172.21.15.31:0/1082383282 shutdown_connections 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 --2- 172.21.15.31:0/1082383282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc450100860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 --2- 172.21.15.31:0/1082383282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4500ff150 0x7fc4500ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 -- 172.21.15.31:0/1082383282 >> 172.21.15.31:0/1082383282 conn(0x7fc4500fa7a0 msgr2=0x7fc4500fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 -- 172.21.15.31:0/1082383282 shutdown_connections 2024-09-17T01:59:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.175+0000 7fc454c51700 1 -- 172.21.15.31:0/1082383282 wait complete. 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc454c51700 1 Processor -- start 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc454c51700 1 -- start start 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc454c51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4500ff150 0x7fc450069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc454c51700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc45019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc454c51700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45019b160 con 0x7fc4501003f0 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc454c51700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45019b2a0 con 0x7fc4500ff150 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc45019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc45019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37198/0 (socket says 172.21.15.31:37198) 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 -- 172.21.15.31:0/2100398539 learned_addr learned my addr 172.21.15.31:0/2100398539 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44e59c700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4500ff150 0x7fc450069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 -- 172.21.15.31:0/2100398539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4500ff150 msgr2=0x7fc450069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4500ff150 0x7fc450069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 -- 172.21.15.31:0/2100398539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440095f0 con 0x7fc4501003f0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.176+0000 7fc44dd9b700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc45019ab90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc444006010 tx=0x7fc44400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.177+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44401d070 con 0x7fc4501003f0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.177+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc44400f460 con 0x7fc4501003f0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.177+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45019b520 con 0x7fc4501003f0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.177+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc444021640 con 0x7fc4501003f0 2024-09-17T01:59:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.177+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45019ba10 con 0x7fc4501003f0 2024-09-17T01:59:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.178+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc450068ab0 con 0x7fc4501003f0 2024-09-17T01:59:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.178+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc444003a60 con 0x7fc4501003f0 2024-09-17T01:59:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.179+0000 7fc43f7fe700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc43806e680 0x7fc438070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.179+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc44408fac0 con 0x7fc4501003f0 2024-09-17T01:59:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.179+0000 7fc44e59c700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc43806e680 0x7fc438070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.179+0000 7fc44e59c700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc43806e680 0x7fc438070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc440009a10 tx=0x7fc440009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.183+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc44405c6c0 con 0x7fc4501003f0 2024-09-17T01:59:38.370 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:38 smithi031 ceph-mon[77274]: pgmap v220: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:59:38.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.371 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:38 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.421+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc450104de0 con 0x7fc43806e680 2024-09-17T01:59:38.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.431+0000 7fc43f7fe700 1 -- 172.21.15.31:0/2100398539 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fc450104de0 con 0x7fc43806e680 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (14m) 1s ago 15m 25.6M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (16m) 1s ago 16m 8958k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (15m) 95s ago 15m 8535k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (4m) 1s ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (4m) 95s ago 14m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (14m) 1s ago 15m 87.0M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T01:59:38.430 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (8s) 1s ago 10m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 120ddd893c49 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (37s) 1s ago 10m 65.2M - 19.1.1-330-gc2ddf972 ebb0615149de b293c28b6b80 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (10m) 95s ago 10m 67.5M - 18.2.0 dc2bc1663786 2bc7f1027351 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (10m) 95s ago 10m 119M - 18.2.0 dc2bc1663786 4206141921e5 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (7m) 1s ago 17m 506M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (6m) 95s ago 14m 442M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (5m) 1s ago 17m 52.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (5m) 95s ago 14m 39.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (15m) 1s ago 15m 16.8M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (14m) 95s ago 14m 15.4M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (4m) 1s ago 14m 195M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (3m) 1s ago 13m 119M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T01:59:38.431 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (3m) 1s ago 13m 139M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T01:59:38.432 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (2m) 95s ago 12m 133M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T01:59:38.432 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (2m) 95s ago 12m 89.5M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T01:59:38.432 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (98s) 95s ago 11m 11.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T01:59:38.432 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (6m) 1s ago 15m 83.8M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc43806e680 msgr2=0x7fc438070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc43806e680 0x7fc438070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc440009a10 tx=0x7fc440009190 comp rx=0 tx=0).stop 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 msgr2=0x7fc45019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc45019ab90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc444006010 tx=0x7fc44400bd70 comp rx=0 tx=0).stop 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 shutdown_connections 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc43806e680 0x7fc438070b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc4500ff150 0x7fc450069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 --2- 172.21.15.31:0/2100398539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4501003f0 0x7fc45019ab90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 >> 172.21.15.31:0/2100398539 conn(0x7fc4500fa7a0 msgr2=0x7fc450103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:38.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 shutdown_connections 2024-09-17T01:59:38.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.433+0000 7fc454c51700 1 -- 172.21.15.31:0/2100398539 wait complete. 2024-09-17T01:59:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:38 smithi092 ceph-mon[64495]: pgmap v220: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:59:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:38 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:38.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 -- 172.21.15.31:0/1323589919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 msgr2=0x7f29980fe930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 --2- 172.21.15.31:0/1323589919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f29980fe930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2988009910 tx=0x7f2988009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 -- 172.21.15.31:0/1323589919 shutdown_connections 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 --2- 172.21.15.31:0/1323589919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29981015a0 0x7f29981019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 --2- 172.21.15.31:0/1323589919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f29980fe930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 -- 172.21.15.31:0/1323589919 >> 172.21.15.31:0/1323589919 conn(0x7f29980f9e70 msgr2=0x7f29980fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 -- 172.21.15.31:0/1323589919 shutdown_connections 2024-09-17T01:59:38.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 -- 172.21.15.31:0/1323589919 wait complete. 2024-09-17T01:59:38.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 Processor -- start 2024-09-17T01:59:38.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.545+0000 7f299e70c700 1 -- start start 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f299e70c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f2998195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f299e70c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29981015a0 0x7f29981960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f299e70c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981966c0 con 0x7f29980fe520 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f299e70c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998196800 con 0x7f29981015a0 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f2998195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f2998195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37210/0 (socket says 172.21.15.31:37210) 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 -- 172.21.15.31:0/1479363460 learned_addr learned my addr 172.21.15.31:0/1479363460 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 -- 172.21.15.31:0/1479363460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29981015a0 msgr2=0x7f29981960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29981015a0 0x7f29981960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 -- 172.21.15.31:0/1479363460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880095f0 con 0x7f29980fe520 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.546+0000 7f2997fff700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f2998195b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29880092e0 tx=0x7f298800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.547+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f298801d070 con 0x7f29980fe520 2024-09-17T01:59:38.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.547+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299819b250 con 0x7f29980fe520 2024-09-17T01:59:38.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.547+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f298800f460 con 0x7f29980fe520 2024-09-17T01:59:38.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.547+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299819b740 con 0x7f29980fe520 2024-09-17T01:59:38.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.547+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2988017610 con 0x7f29980fe520 2024-09-17T01:59:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.548+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2998108db0 con 0x7f29980fe520 2024-09-17T01:59:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.548+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2988003a60 con 0x7f29980fe520 2024-09-17T01:59:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.549+0000 7f29957fa700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f298006e680 0x7f2980070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.549+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f298808fc30 con 0x7f29980fe520 2024-09-17T01:59:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.549+0000 7f29977fe700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f298006e680 0x7f2980070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.549+0000 7f29977fe700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f298006e680 0x7f2980070b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f298c005950 tx=0x7f298c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:38.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.553+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f298805c830 con 0x7f29980fe520 2024-09-17T01:59:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.866+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f299819be90 con 0x7f29980fe520 2024-09-17T01:59:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.866+0000 7f29957fa700 1 -- 172.21.15.31:0/1479363460 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f299819be90 con 0x7f29980fe520 2024-09-17T01:59:38.865 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:59:38.865 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T01:59:38.865 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:59:38.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T01:59:38.866 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:59:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f298006e680 msgr2=0x7f2980070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f298006e680 0x7f2980070b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f298c005950 tx=0x7f298c0058e0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 msgr2=0x7f2998195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f2998195b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f29880092e0 tx=0x7f298800be20 comp rx=0 tx=0).stop 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 shutdown_connections 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f298006e680 0x7f2980070b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29980fe520 0x7f2998195b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 --2- 172.21.15.31:0/1479363460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29981015a0 0x7f29981960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 >> 172.21.15.31:0/1479363460 conn(0x7f29980f9e70 msgr2=0x7f29981047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 shutdown_connections 2024-09-17T01:59:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.869+0000 7f299e70c700 1 -- 172.21.15.31:0/1479363460 wait complete. 2024-09-17T01:59:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 -- 172.21.15.31:0/407187575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec1036a0 msgr2=0x7f6bec105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 --2- 172.21.15.31:0/407187575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec1036a0 0x7f6bec105a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009910 tx=0x7f6bdc009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 -- 172.21.15.31:0/407187575 shutdown_connections 2024-09-17T01:59:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 --2- 172.21.15.31:0/407187575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec1036a0 0x7f6bec105a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 --2- 172.21.15.31:0/407187575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec100d80 0x7f6bec103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 -- 172.21.15.31:0/407187575 >> 172.21.15.31:0/407187575 conn(0x7f6bec0fa7a0 msgr2=0x7f6bec0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 -- 172.21.15.31:0/407187575 shutdown_connections 2024-09-17T01:59:38.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 -- 172.21.15.31:0/407187575 wait complete. 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 Processor -- start 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.978+0000 7f6bf351a700 1 -- start start 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf351a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 0x7f6bec195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf351a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec1036a0 0x7f6bec196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf351a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec196890 con 0x7f6bec100d80 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf351a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec1969d0 con 0x7f6bec1036a0 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 0x7f6bec195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 0x7f6bec195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37218/0 (socket says 172.21.15.31:37218) 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 -- 172.21.15.31:0/2102000097 learned_addr learned my addr 172.21.15.31:0/2102000097 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf0ab5700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec1036a0 0x7f6bec196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 -- 172.21.15.31:0/2102000097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec1036a0 msgr2=0x7f6bec196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec1036a0 0x7f6bec196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 -- 172.21.15.31:0/2102000097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0095f0 con 0x7f6bec100d80 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf0ab5700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec1036a0 0x7f6bec196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.979+0000 7f6bf12b6700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 0x7f6bec195dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c960 tx=0x7f6be800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.980+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be8007a70 con 0x7f6bec100d80 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.980+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6be8007bd0 con 0x7f6bec100d80 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.980+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec19b490 con 0x7f6bec100d80 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.980+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be8018630 con 0x7f6bec100d80 2024-09-17T01:59:38.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.980+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec19b9b0 con 0x7f6bec100d80 2024-09-17T01:59:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.981+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec18fc00 con 0x7f6bec100d80 2024-09-17T01:59:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.981+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6be800fa90 con 0x7f6bec100d80 2024-09-17T01:59:38.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.982+0000 7f6be27fc700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6bd806e680 0x7f6bd8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.982+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f6be808e630 con 0x7f6bec100d80 2024-09-17T01:59:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.982+0000 7f6bf0ab5700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6bd806e680 0x7f6bd8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:38.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.982+0000 7f6bf0ab5700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6bd806e680 0x7f6bd8070b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc006010 tx=0x7f6bdc00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:38.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:38.986+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6be805b020 con 0x7f6bec100d80 2024-09-17T01:59:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.251+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6bec068ab0 con 0x7f6bec100d80 2024-09-17T01:59:39.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.252+0000 7f6be27fc700 1 -- 172.21.15.31:0/2102000097 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1972 (secure 0 0 0) 0x7f6be805ae40 con 0x7f6bec100d80 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:e36 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T01:59:30:377227+0000 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 35 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:59:26.368371+0000 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T01:59:39.251 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 92 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 1 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:in 0 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=34416} 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T01:59:39.252 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 1 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 34416 members: 34416 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:Standby daemons: 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T01:59:39.253 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{-1:34448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/1658276078,v1:172.21.15.92:6827/1658276078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6824/3556360183,v1:172.21.15.92:6825/3556360183] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.254+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6bd806e680 msgr2=0x7f6bd8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.254+0000 7f6bf351a700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6bd806e680 0x7f6bd8070b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc006010 tx=0x7f6bdc00b560 comp rx=0 tx=0).stop 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.254+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 msgr2=0x7f6bec195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.254+0000 7f6bf351a700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 0x7f6bec195dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c960 tx=0x7f6be800cd20 comp rx=0 tx=0).stop 2024-09-17T01:59:39.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 shutdown_connections 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6bd806e680 0x7f6bd8070b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec100d80 0x7f6bec195dc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 --2- 172.21.15.31:0/2102000097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bec1036a0 0x7f6bec196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 >> 172.21.15.31:0/2102000097 conn(0x7f6bec0fa7a0 msgr2=0x7f6bec0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 shutdown_connections 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.255+0000 7f6bf351a700 1 -- 172.21.15.31:0/2102000097 wait complete. 2024-09-17T01:59:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 36 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 -- 172.21.15.31:0/2184794433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 msgr2=0x7f9c340ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/2184794433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c340ff560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009910 tx=0x7f9c28009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 -- 172.21.15.31:0/2184794433 shutdown_connections 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/2184794433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34100350 0x7f9c341007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/2184794433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c340ff560 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 -- 172.21.15.31:0/2184794433 >> 172.21.15.31:0/2184794433 conn(0x7f9c340fa700 msgr2=0x7f9c340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 -- 172.21.15.31:0/2184794433 shutdown_connections 2024-09-17T01:59:39.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.366+0000 7f9c3b13d700 1 -- 172.21.15.31:0/2184794433 wait complete. 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c3b13d700 1 Processor -- start 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c3b13d700 1 -- start start 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c3b13d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c34195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c3b13d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34100350 0x7f9c34196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c3b13d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34196590 con 0x7f9c340ff150 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c3b13d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c341966d0 con 0x7f9c34100350 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c38ed9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c34195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:39.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c38ed9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c34195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37232/0 (socket says 172.21.15.31:37232) 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c38ed9700 1 -- 172.21.15.31:0/1977460319 learned_addr learned my addr 172.21.15.31:0/1977460319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c33fff700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34100350 0x7f9c34196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c38ed9700 1 -- 172.21.15.31:0/1977460319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34100350 msgr2=0x7f9c34196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c38ed9700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34100350 0x7f9c34196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.367+0000 7f9c38ed9700 1 -- 172.21.15.31:0/1977460319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280095f0 con 0x7f9c340ff150 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.368+0000 7f9c38ed9700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c34195ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800bda0 tx=0x7f9c2800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.368+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c2801d070 con 0x7f9c340ff150 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.368+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9c28004c50 con 0x7f9c340ff150 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.368+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3419b130 con 0x7f9c340ff150 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.368+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c2800f690 con 0x7f9c340ff150 2024-09-17T01:59:39.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.368+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3419b5f0 con 0x7f9c340ff150 2024-09-17T01:59:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.369+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34107ca0 con 0x7f9c340ff150 2024-09-17T01:59:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.370+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9c28022a20 con 0x7f9c340ff150 2024-09-17T01:59:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.370+0000 7f9c31ffb700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9c2406e680 0x7f9c24070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.370+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f9c2808fd10 con 0x7f9c340ff150 2024-09-17T01:59:39.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.371+0000 7f9c33fff700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9c2406e680 0x7f9c24070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:39.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.371+0000 7f9c33fff700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9c2406e680 0x7f9c24070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c20005ea0 tx=0x7f9c20005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:39.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.375+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c2805ca40 con 0x7f9c340ff150 2024-09-17T01:59:39.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:39 smithi092 ceph-mon[64495]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:39.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:39 smithi092 ceph-mon[64495]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:39.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:39 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1479363460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:39.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:39 smithi031 ceph-mon[77274]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:39.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:39 smithi031 ceph-mon[77274]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:39.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:39 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1479363460' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:39.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.630+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3419bd40 con 0x7f9c2406e680 2024-09-17T01:59:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.631+0000 7f9c31ffb700 1 -- 172.21.15.31:0/1977460319 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9c3419bd40 con 0x7f9c2406e680 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "osd", 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T01:59:39.630 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "14/23 daemons upgraded", 2024-09-17T01:59:39.631 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:59:39.631 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T01:59:39.631 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T01:59:39.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9c2406e680 msgr2=0x7f9c24070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9c2406e680 0x7f9c24070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c20005ea0 tx=0x7f9c20005e30 comp rx=0 tx=0).stop 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 msgr2=0x7f9c34195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c34195ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800bda0 tx=0x7f9c2800be80 comp rx=0 tx=0).stop 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 shutdown_connections 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9c2406e680 0x7f9c24070b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c340ff150 0x7f9c34195ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 --2- 172.21.15.31:0/1977460319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34100350 0x7f9c34196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.633+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 >> 172.21.15.31:0/1977460319 conn(0x7f9c340fa700 msgr2=0x7f9c34068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.634+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 shutdown_connections 2024-09-17T01:59:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.634+0000 7f9c3b13d700 1 -- 172.21.15.31:0/1977460319 wait complete. 2024-09-17T01:59:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 -- 172.21.15.31:0/1135936101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84100240 msgr2=0x7fba84100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1135936101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84100240 0x7fba84100650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba74009910 tx=0x7fba74009c20 comp rx=0 tx=0).stop 2024-09-17T01:59:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 -- 172.21.15.31:0/1135936101 shutdown_connections 2024-09-17T01:59:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1135936101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba84101440 0x7fba84101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1135936101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84100240 0x7fba84100650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 -- 172.21.15.31:0/1135936101 >> 172.21.15.31:0/1135936101 conn(0x7fba840fb7f0 msgr2=0x7fba840fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.745+0000 7fba88ce7700 1 -- 172.21.15.31:0/1135936101 shutdown_connections 2024-09-17T01:59:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 -- 172.21.15.31:0/1135936101 wait complete. 2024-09-17T01:59:39.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 Processor -- start 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 -- start start 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba84100240 0x7fba84074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 0x7fba84073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba84073680 con 0x7fba84101440 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.746+0000 7fba88ce7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba840737c0 con 0x7fba84100240 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 0x7fba84073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 0x7fba84073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37256/0 (socket says 172.21.15.31:37256) 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 -- 172.21.15.31:0/1789862095 learned_addr learned my addr 172.21.15.31:0/1789862095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba8259c700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba84100240 0x7fba84074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 -- 172.21.15.31:0/1789862095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba84100240 msgr2=0x7fba84074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba84100240 0x7fba84074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:39.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 -- 172.21.15.31:0/1789862095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740095f0 con 0x7fba84101440 2024-09-17T01:59:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba81d9b700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 0x7fba84073140 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba7800d8d0 tx=0x7fba7800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba780098a0 con 0x7fba84101440 2024-09-17T01:59:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba78010460 con 0x7fba84101440 2024-09-17T01:59:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba84073aa0 con 0x7fba84101440 2024-09-17T01:59:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba7800f5f0 con 0x7fba84101440 2024-09-17T01:59:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.747+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8419db30 con 0x7fba84101440 2024-09-17T01:59:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.748+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba84108d90 con 0x7fba84101440 2024-09-17T01:59:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.749+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fba78009a00 con 0x7fba84101440 2024-09-17T01:59:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.750+0000 7fba737fe700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fba6c06e680 0x7fba6c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:59:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.750+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fba7808e5c0 con 0x7fba84101440 2024-09-17T01:59:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.750+0000 7fba8259c700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fba6c06e680 0x7fba6c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:59:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.750+0000 7fba8259c700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fba6c06e680 0x7fba6c070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fba74006010 tx=0x7fba74005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:59:39.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:39.754+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fba7805b1a0 con 0x7fba84101440 2024-09-17T01:59:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.063+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fba8419e350 con 0x7fba84101440 2024-09-17T01:59:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.064+0000 7fba737fe700 1 -- 172.21.15.31:0/1789862095 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fba7805ad30 con 0x7fba84101440 2024-09-17T01:59:40.063 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fba6c06e680 msgr2=0x7fba6c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fba6c06e680 0x7fba6c070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fba74006010 tx=0x7fba74005ec0 comp rx=0 tx=0).stop 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 msgr2=0x7fba84073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 0x7fba84073140 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba7800d8d0 tx=0x7fba7800dbe0 comp rx=0 tx=0).stop 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 shutdown_connections 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fba6c06e680 0x7fba6c070b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba84100240 0x7fba84074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 --2- 172.21.15.31:0/1789862095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba84101440 0x7fba84073140 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 >> 172.21.15.31:0/1789862095 conn(0x7fba840fb7f0 msgr2=0x7fba84104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 shutdown_connections 2024-09-17T01:59:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T01:59:40.066+0000 7fba88ce7700 1 -- 172.21.15.31:0/1789862095 wait complete. 2024-09-17T01:59:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:40 smithi092 ceph-mon[64495]: pgmap v221: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:59:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:40 smithi092 ceph-mon[64495]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:40 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2102000097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:59:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:40 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1789862095' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:59:40.499 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:40 smithi031 ceph-mon[77274]: pgmap v221: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:59:40.499 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:40 smithi031 ceph-mon[77274]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:40.499 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:40 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2102000097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:59:40.499 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:40 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1789862095' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:59:41.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:41 smithi092 ceph-mon[64495]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:41.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:41 smithi031 ceph-mon[77274]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:59:42.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: pgmap v222: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T01:59:42.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:42.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:42.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:42 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi092.xzgrcs"]}]: dispatch 2024-09-17T01:59:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: pgmap v222: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T01:59:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:42.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:42 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi092.xzgrcs"]}]: dispatch 2024-09-17T01:59:43.374 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:43 smithi092 ceph-mon[64495]: Upgrade: It appears safe to stop mds.cephfs.smithi092.xzgrcs 2024-09-17T01:59:43.374 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:43.374 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:59:43.374 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:43 smithi031 ceph-mon[77274]: Upgrade: It appears safe to stop mds.cephfs.smithi092.xzgrcs 2024-09-17T01:59:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.xzgrcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:59:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:44.393 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:44 smithi092 ceph-mon[64495]: pgmap v223: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T01:59:44.393 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:44 smithi092 ceph-mon[64495]: Upgrade: Updating mds.cephfs.smithi092.xzgrcs 2024-09-17T01:59:44.393 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:44 smithi092 ceph-mon[64495]: Deploying daemon mds.cephfs.smithi092.xzgrcs on smithi092 2024-09-17T01:59:44.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:44 smithi031 ceph-mon[77274]: pgmap v223: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-09-17T01:59:44.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:44 smithi031 ceph-mon[77274]: Upgrade: Updating mds.cephfs.smithi092.xzgrcs 2024-09-17T01:59:44.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:44 smithi031 ceph-mon[77274]: Deploying daemon mds.cephfs.smithi092.xzgrcs on smithi092 2024-09-17T01:59:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:46 smithi092 ceph-mon[64495]: pgmap v224: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:46 smithi092 ceph-mon[64495]: osdmap e93: 6 total, 6 up, 6 in 2024-09-17T01:59:46.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:46 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T01:59:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:46 smithi031 ceph-mon[77274]: pgmap v224: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:46 smithi031 ceph-mon[77274]: osdmap e93: 6 total, 6 up, 6 in 2024-09-17T01:59:46.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:46 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T01:59:48.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:48 smithi092 ceph-mon[64495]: pgmap v226: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:48.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:59:48.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:48 smithi031 ceph-mon[77274]: pgmap v226: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:48.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:59:50.290 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:50 smithi092 ceph-mon[64495]: pgmap v227: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:50.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:50 smithi031 ceph-mon[77274]: pgmap v227: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:51.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:51.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:59:51.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:51.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:51.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:52 smithi092 ceph-mon[64495]: pgmap v228: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:52 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.92:6824/186400038,v1:172.21.15.92:6825/186400038] up:boot 2024-09-17T01:59:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:52 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T01:59:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:52 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:59:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:52 smithi031 ceph-mon[77274]: pgmap v228: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:52 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.92:6824/186400038,v1:172.21.15.92:6825/186400038] up:boot 2024-09-17T01:59:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:52 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T01:59:52.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:52 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T01:59:54.459 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:54 smithi092 ceph-mon[64495]: pgmap v229: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:54.459 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.459 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.459 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.459 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:54 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:54 smithi031 ceph-mon[77274]: pgmap v229: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:54.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:54 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:56.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:56 smithi092 ceph-mon[64495]: pgmap v230: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:56 smithi031 ceph-mon[77274]: pgmap v230: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: pgmap v231: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: Detected new or changed devices on smithi092 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi092.hofoma"]}]: dispatch 2024-09-17T01:59:58.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:58 smithi092 ceph-mon[64495]: Upgrade: It appears safe to stop mds.cephfs.smithi092.hofoma 2024-09-17T01:59:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: pgmap v231: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: Detected new or changed devices on smithi092 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:59:58.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi092.hofoma"]}]: dispatch 2024-09-17T01:59:58.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:58 smithi031 ceph-mon[77274]: Upgrade: It appears safe to stop mds.cephfs.smithi092.hofoma 2024-09-17T01:59:59.797 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:59 smithi031 ceph-mon[77274]: pgmap v232: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:59.797 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:59 smithi031 ceph-mon[77274]: Upgrade: Updating mds.cephfs.smithi092.hofoma 2024-09-17T01:59:59.797 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:59 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:59.797 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:59 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:59:59.798 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:59 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:59.798 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 01:59:59 smithi031 ceph-mon[77274]: Deploying daemon mds.cephfs.smithi092.hofoma on smithi092 2024-09-17T01:59:59.864 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:59 smithi092 ceph-mon[64495]: pgmap v232: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:59:59.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:59 smithi092 ceph-mon[64495]: Upgrade: Updating mds.cephfs.smithi092.hofoma 2024-09-17T01:59:59.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:59 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T01:59:59.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:59 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi092.hofoma", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:59:59.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:59 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:59:59.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 01:59:59 smithi092 ceph-mon[64495]: Deploying daemon mds.cephfs.smithi092.hofoma on smithi092 2024-09-17T02:00:00.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:00 smithi092 ceph-mon[64495]: overall HEALTH_OK 2024-09-17T02:00:01.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:00 smithi031 ceph-mon[77274]: overall HEALTH_OK 2024-09-17T02:00:01.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:01 smithi092 ceph-mon[64495]: pgmap v233: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:01.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:01 smithi092 ceph-mon[64495]: osdmap e94: 6 total, 6 up, 6 in 2024-09-17T02:00:01.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:01 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T02:00:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:01 smithi031 ceph-mon[77274]: pgmap v233: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:01 smithi031 ceph-mon[77274]: osdmap e94: 6 total, 6 up, 6 in 2024-09-17T02:00:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:01 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 2 up:standby 2024-09-17T02:00:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:03 smithi092 ceph-mon[64495]: pgmap v235: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:04.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:03 smithi031 ceph-mon[77274]: pgmap v235: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:05.693 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:05 smithi092 ceph-mon[64495]: pgmap v236: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:05.694 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:05 smithi031 ceph-mon[77274]: pgmap v236: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:06 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.92:6826/3092379292,v1:172.21.15.92:6827/3092379292] up:boot 2024-09-17T02:00:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:06 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T02:00:07.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T02:00:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:06 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.92:6826/3092379292,v1:172.21.15.92:6827/3092379292] up:boot 2024-09-17T02:00:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:06 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T02:00:07.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T02:00:08.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:07 smithi092 ceph-mon[64495]: pgmap v237: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:08.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:07 smithi031 ceph-mon[77274]: pgmap v237: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:09 smithi092 ceph-mon[64495]: pgmap v238: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:09 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.910 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:09 smithi031 ceph-mon[77274]: pgmap v238: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:09.910 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.911 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.911 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:09.911 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:09 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:10.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 -- 172.21.15.31:0/3125550580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f80ff150 msgr2=0x7f19f80ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 --2- 172.21.15.31:0/3125550580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f80ff150 0x7f19f80ff560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009910 tx=0x7f19e8009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:10.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 -- 172.21.15.31:0/3125550580 shutdown_connections 2024-09-17T02:00:10.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 --2- 172.21.15.31:0/3125550580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f81003f0 0x7f19f8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 --2- 172.21.15.31:0/3125550580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f80ff150 0x7f19f80ff560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 -- 172.21.15.31:0/3125550580 >> 172.21.15.31:0/3125550580 conn(0x7f19f80fa7a0 msgr2=0x7f19f80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:10.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 -- 172.21.15.31:0/3125550580 shutdown_connections 2024-09-17T02:00:10.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.189+0000 7f19fea2d700 1 -- 172.21.15.31:0/3125550580 wait complete. 2024-09-17T02:00:10.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19fea2d700 1 Processor -- start 2024-09-17T02:00:10.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19fea2d700 1 -- start start 2024-09-17T02:00:10.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19fea2d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80ff150 0x7f19f8198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19fea2d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 0x7f19f8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19fea2d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8198b60 con 0x7f19f81003f0 2024-09-17T02:00:10.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19fea2d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8198ca0 con 0x7f19f80ff150 2024-09-17T02:00:10.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19f77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 0x7f19f8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19f77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 0x7f19f8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52912/0 (socket says 172.21.15.31:52912) 2024-09-17T02:00:10.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19f77fe700 1 -- 172.21.15.31:0/2036003094 learned_addr learned my addr 172.21.15.31:0/2036003094 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:10.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.190+0000 7f19f7fff700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80ff150 0x7f19f8198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f77fe700 1 -- 172.21.15.31:0/2036003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80ff150 msgr2=0x7f19f8198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f77fe700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80ff150 0x7f19f8198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f77fe700 1 -- 172.21.15.31:0/2036003094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80095f0 con 0x7f19f81003f0 2024-09-17T02:00:10.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f77fe700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 0x7f19f8198540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00e920 tx=0x7f19ec00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:10.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec00c9d0 con 0x7f19f81003f0 2024-09-17T02:00:10.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19ec010430 con 0x7f19f81003f0 2024-09-17T02:00:10.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f819d750 con 0x7f19f81003f0 2024-09-17T02:00:10.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec018650 con 0x7f19f81003f0 2024-09-17T02:00:10.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.191+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f819dca0 con 0x7f19f81003f0 2024-09-17T02:00:10.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.192+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f8068ab0 con 0x7f19f81003f0 2024-09-17T02:00:10.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.193+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f19ec00cb30 con 0x7f19f81003f0 2024-09-17T02:00:10.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.193+0000 7f19f57fa700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f19e006e680 0x7f19e0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.193+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f19ec014070 con 0x7f19f81003f0 2024-09-17T02:00:10.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.193+0000 7f19f7fff700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f19e006e680 0x7f19e0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.194+0000 7f19f7fff700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f19e006e680 0x7f19e0070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fd0 tx=0x7f19e8005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:10.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.198+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f19ec0541b0 con 0x7f19f81003f0 2024-09-17T02:00:10.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.437+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f8069580 con 0x7f19e006e680 2024-09-17T02:00:10.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.439+0000 7f19f57fa700 1 -- 172.21.15.31:0/2036003094 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f19f8069580 con 0x7f19e006e680 2024-09-17T02:00:10.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f19e006e680 msgr2=0x7f19e0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f19e006e680 0x7f19e0070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009fd0 tx=0x7f19e8005940 comp rx=0 tx=0).stop 2024-09-17T02:00:10.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 msgr2=0x7f19f8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 0x7f19f8198540 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00e920 tx=0x7f19ec00ec30 comp rx=0 tx=0).stop 2024-09-17T02:00:10.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 shutdown_connections 2024-09-17T02:00:10.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f19e006e680 0x7f19e0070b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80ff150 0x7f19f8198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 --2- 172.21.15.31:0/2036003094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f81003f0 0x7f19f8198540 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 >> 172.21.15.31:0/2036003094 conn(0x7f19f80fa7a0 msgr2=0x7f19f8068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:10.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 shutdown_connections 2024-09-17T02:00:10.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.441+0000 7f19fea2d700 1 -- 172.21.15.31:0/2036003094 wait complete. 2024-09-17T02:00:10.451 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 -- 172.21.15.31:0/3342064941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e8100240 msgr2=0x7f61e8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 --2- 172.21.15.31:0/3342064941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e8100240 0x7f61e8100650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61d800b0a0 tx=0x7f61d800b3b0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 -- 172.21.15.31:0/3342064941 shutdown_connections 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 --2- 172.21.15.31:0/3342064941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e81014e0 0x7f61e8101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 --2- 172.21.15.31:0/3342064941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e8100240 0x7f61e8100650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 -- 172.21.15.31:0/3342064941 >> 172.21.15.31:0/3342064941 conn(0x7f61e80fb890 msgr2=0x7f61e80fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 -- 172.21.15.31:0/3342064941 shutdown_connections 2024-09-17T02:00:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.551+0000 7f61efaa1700 1 -- 172.21.15.31:0/3342064941 wait complete. 2024-09-17T02:00:10.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61efaa1700 1 Processor -- start 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61efaa1700 1 -- start start 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61efaa1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e8100240 0x7f61e8197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61efaa1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 0x7f61e8198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61efaa1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8198860 con 0x7f61e81014e0 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61efaa1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e819d270 con 0x7f61e8100240 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed03c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 0x7f61e8198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed03c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 0x7f61e8198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52940/0 (socket says 172.21.15.31:52940) 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed03c700 1 -- 172.21.15.31:0/1017404421 learned_addr learned my addr 172.21.15.31:0/1017404421 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed83d700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e8100240 0x7f61e8197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed03c700 1 -- 172.21.15.31:0/1017404421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e8100240 msgr2=0x7f61e8197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed03c700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e8100240 0x7f61e8197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.552+0000 7f61ed03c700 1 -- 172.21.15.31:0/1017404421 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8009d00 con 0x7f61e81014e0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.553+0000 7f61ed03c700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 0x7f61e8198240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00d8d0 tx=0x7f61dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.553+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61dc0098a0 con 0x7f61e81014e0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.553+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f61dc010460 con 0x7f61e81014e0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.553+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e819d470 con 0x7f61e81014e0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.553+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61dc00f5f0 con 0x7f61e81014e0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.553+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e819d990 con 0x7f61e81014e0 2024-09-17T02:00:10.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.554+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e81055c0 con 0x7f61e81014e0 2024-09-17T02:00:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.554+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f61dc009a00 con 0x7f61e81014e0 2024-09-17T02:00:10.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.555+0000 7f61e6ffd700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f61d006e680 0x7f61d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.555+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f61dc08e520 con 0x7f61e81014e0 2024-09-17T02:00:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.555+0000 7f61ed83d700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f61d006e680 0x7f61d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.555+0000 7f61ed83d700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f61d006e680 0x7f61d0070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61d800b830 tx=0x7f61d8000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.559+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f61dc057670 con 0x7f61e81014e0 2024-09-17T02:00:10.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.794+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f61e8061190 con 0x7f61d006e680 2024-09-17T02:00:10.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.795+0000 7f61e6ffd700 1 -- 172.21.15.31:0/1017404421 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f61e8061190 con 0x7f61d006e680 2024-09-17T02:00:10.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f61d006e680 msgr2=0x7f61d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f61d006e680 0x7f61d0070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f61d800b830 tx=0x7f61d8000f40 comp rx=0 tx=0).stop 2024-09-17T02:00:10.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 msgr2=0x7f61e8198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 0x7f61e8198240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00d8d0 tx=0x7f61dc00dbe0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 shutdown_connections 2024-09-17T02:00:10.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f61d006e680 0x7f61d0070b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e8100240 0x7f61e8197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 --2- 172.21.15.31:0/1017404421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61e81014e0 0x7f61e8198240 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 >> 172.21.15.31:0/1017404421 conn(0x7f61e80fb890 msgr2=0x7f61e8102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:10.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 shutdown_connections 2024-09-17T02:00:10.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.798+0000 7f61efaa1700 1 -- 172.21.15.31:0/1017404421 wait complete. 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 -- 172.21.15.31:0/1170272508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 msgr2=0x7fc284100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 --2- 172.21.15.31:0/1170272508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc284100860 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc278009910 tx=0x7fc278009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 -- 172.21.15.31:0/1170272508 shutdown_connections 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 --2- 172.21.15.31:0/1170272508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc284100860 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 --2- 172.21.15.31:0/1170272508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2840ff150 0x7fc2840ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 -- 172.21.15.31:0/1170272508 >> 172.21.15.31:0/1170272508 conn(0x7fc2840fa7a0 msgr2=0x7fc2840fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 -- 172.21.15.31:0/1170272508 shutdown_connections 2024-09-17T02:00:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.907+0000 7fc28a553700 1 -- 172.21.15.31:0/1170272508 wait complete. 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc28a553700 1 Processor -- start 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc28a553700 1 -- start start 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc28a553700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2840ff150 0x7fc284069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc28a553700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc28419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc28a553700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419b0c0 con 0x7fc2841003f0 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc28a553700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419b230 con 0x7fc2840ff150 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc2837fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc28419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc2837fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc28419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52958/0 (socket says 172.21.15.31:52958) 2024-09-17T02:00:10.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.908+0000 7fc2837fe700 1 -- 172.21.15.31:0/2044659901 learned_addr learned my addr 172.21.15.31:0/2044659901 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2837fe700 1 -- 172.21.15.31:0/2044659901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2840ff150 msgr2=0x7fc284069950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2837fe700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2840ff150 0x7fc284069950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2837fe700 1 -- 172.21.15.31:0/2044659901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780095f0 con 0x7fc2841003f0 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2837fe700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc28419aaf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc278000c00 tx=0x7fc27800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27801d070 con 0x7fc2841003f0 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28419b4b0 con 0x7fc2841003f0 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc278005dc0 con 0x7fc2841003f0 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2780226a0 con 0x7fc2841003f0 2024-09-17T02:00:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.909+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28419b9a0 con 0x7fc2841003f0 2024-09-17T02:00:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.910+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284068ab0 con 0x7fc2841003f0 2024-09-17T02:00:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.911+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc278003680 con 0x7fc2841003f0 2024-09-17T02:00:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.911+0000 7fc2817fa700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc26c06e680 0x7fc26c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.911+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc27808fcd0 con 0x7fc2841003f0 2024-09-17T02:00:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.911+0000 7fc283fff700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc26c06e680 0x7fc26c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.912+0000 7fc283fff700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc26c06e680 0x7fc26c070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc274009af0 tx=0x7fc274009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:10.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:10.915+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc27805c8d0 con 0x7fc2841003f0 2024-09-17T02:00:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.137+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc284104e40 con 0x7fc26c06e680 2024-09-17T02:00:11.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.149+0000 7fc2817fa700 1 -- 172.21.15.31:0/2044659901 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fc284104e40 con 0x7fc26c06e680 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (14m) 34s ago 16m 25.6M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (16m) 34s ago 16m 8958k - 18.2.0 dc2bc1663786 6ca18041581b 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (15m) 2s ago 15m 8854k - 18.2.0 dc2bc1663786 c1c82b10f44b 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (5m) 34s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (5m) 2s ago 15m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (14m) 34s ago 16m 87.0M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (41s) 34s ago 10m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 120ddd893c49 2024-09-17T02:00:11.148 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (69s) 34s ago 10m 65.2M - 19.1.1-330-gc2ddf972 ebb0615149de b293c28b6b80 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (5s) 2s ago 10m 11.7M - 19.1.1-330-gc2ddf972 ebb0615149de c50cee007787 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (21s) 2s ago 10m 15.4M - 19.1.1-330-gc2ddf972 ebb0615149de bd12a6058776 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (7m) 34s ago 17m 506M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (6m) 2s ago 15m 443M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (6m) 34s ago 17m 52.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (6m) 2s ago 15m 43.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (16m) 34s ago 16m 16.8M - 1.5.0 0da6a335fe13 6b7ae1ccbecd 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (15m) 2s ago 15m 15.7M - 1.5.0 0da6a335fe13 fc4590430220 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (5m) 34s ago 14m 195M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (4m) 34s ago 14m 119M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (3m) 34s ago 13m 139M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T02:00:11.149 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (3m) 2s ago 13m 136M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T02:00:11.150 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (2m) 2s ago 12m 96.9M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T02:00:11.150 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (2m) 2s ago 12m 96.3M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T02:00:11.150 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (6m) 34s ago 15m 83.8M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T02:00:11.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc26c06e680 msgr2=0x7fc26c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc26c06e680 0x7fc26c070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc274009af0 tx=0x7fc274009260 comp rx=0 tx=0).stop 2024-09-17T02:00:11.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 msgr2=0x7fc28419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc28419aaf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc278000c00 tx=0x7fc27800f740 comp rx=0 tx=0).stop 2024-09-17T02:00:11.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 shutdown_connections 2024-09-17T02:00:11.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc26c06e680 0x7fc26c070b30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2840ff150 0x7fc284069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 --2- 172.21.15.31:0/2044659901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2841003f0 0x7fc28419aaf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 >> 172.21.15.31:0/2044659901 conn(0x7fc2840fa7a0 msgr2=0x7fc284103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:11.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 shutdown_connections 2024-09-17T02:00:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.151+0000 7fc28a553700 1 -- 172.21.15.31:0/2044659901 wait complete. 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 -- 172.21.15.31:0/732318247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c069230 msgr2=0x7f5d9c102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 --2- 172.21.15.31:0/732318247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c069230 0x7f5d9c102e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00b0a0 tx=0x7f5d8c00b3b0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 -- 172.21.15.31:0/732318247 shutdown_connections 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 --2- 172.21.15.31:0/732318247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c103350 0x7f5d9c105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 --2- 172.21.15.31:0/732318247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c069230 0x7f5d9c102e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 -- 172.21.15.31:0/732318247 >> 172.21.15.31:0/732318247 conn(0x7f5d9c0fa780 msgr2=0x7f5d9c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 -- 172.21.15.31:0/732318247 shutdown_connections 2024-09-17T02:00:11.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.259+0000 7f5da1b18700 1 -- 172.21.15.31:0/732318247 wait complete. 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5da1b18700 1 Processor -- start 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5da1b18700 1 -- start start 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5da1b18700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c069230 0x7f5d9c100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5da1b18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 0x7f5d9c0fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5da1b18700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0ff2f0 con 0x7f5d9c103350 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5da1b18700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0ff430 con 0x7f5d9c069230 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5d9affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 0x7f5d9c0fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5d9affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 0x7f5d9c0fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52980/0 (socket says 172.21.15.31:52980) 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5d9affd700 1 -- 172.21.15.31:0/974052872 learned_addr learned my addr 172.21.15.31:0/974052872 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.260+0000 7f5d9b7fe700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c069230 0x7f5d9c100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d9affd700 1 -- 172.21.15.31:0/974052872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c069230 msgr2=0x7f5d9c100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d9affd700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c069230 0x7f5d9c100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d9affd700 1 -- 172.21.15.31:0/974052872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009d00 con 0x7f5d9c103350 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d9affd700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 0x7f5d9c0fedb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400d8d0 tx=0x7f5d8400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d840098a0 con 0x7f5d9c103350 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c0ff710 con 0x7f5d9c103350 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d84010460 con 0x7f5d9c103350 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8400f5f0 con 0x7f5d9c103350 2024-09-17T02:00:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.261+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c19dae0 con 0x7f5d9c103350 2024-09-17T02:00:11.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.262+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c108cf0 con 0x7f5d9c103350 2024-09-17T02:00:11.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.263+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5d84009a00 con 0x7f5d9c103350 2024-09-17T02:00:11.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.263+0000 7f5d98ff9700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5d8806e680 0x7f5d88070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:11.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.263+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f5d8408e620 con 0x7f5d9c103350 2024-09-17T02:00:11.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.263+0000 7f5d9b7fe700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5d8806e680 0x7f5d88070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:11.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.264+0000 7f5d9b7fe700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5d8806e680 0x7f5d88070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006130 tx=0x7f5d8c0060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:11.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.268+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5d8405b220 con 0x7f5d9c103350 2024-09-17T02:00:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.576+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5d9c108eb0 con 0x7f5d9c103350 2024-09-17T02:00:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.577+0000 7f5d98ff9700 1 -- 172.21.15.31:0/974052872 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f5d8405adb0 con 0x7f5d9c103350 2024-09-17T02:00:11.575 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:00:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T02:00:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T02:00:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T02:00:11.577 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5d8806e680 msgr2=0x7f5d88070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5d8806e680 0x7f5d88070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006130 tx=0x7f5d8c0060c0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 msgr2=0x7f5d9c0fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 0x7f5d9c0fedb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400d8d0 tx=0x7f5d8400dbe0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 shutdown_connections 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f5d8806e680 0x7f5d88070b30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c069230 0x7f5d9c100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 --2- 172.21.15.31:0/974052872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9c103350 0x7f5d9c0fedb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 >> 172.21.15.31:0/974052872 conn(0x7f5d9c0fa780 msgr2=0x7f5d9c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:11.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 shutdown_connections 2024-09-17T02:00:11.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.579+0000 7f5da1b18700 1 -- 172.21.15.31:0/974052872 wait complete. 2024-09-17T02:00:11.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 -- 172.21.15.31:0/348802052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8100d60 msgr2=0x7f79d8103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/348802052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8100d60 0x7f79d8103140 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b0a0 tx=0x7f79c800b3b0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 -- 172.21.15.31:0/348802052 shutdown_connections 2024-09-17T02:00:11.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/348802052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d8103680 0x7f79d8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/348802052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8100d60 0x7f79d8103140 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 -- 172.21.15.31:0/348802052 >> 172.21.15.31:0/348802052 conn(0x7f79d80fa780 msgr2=0x7f79d80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:11.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 -- 172.21.15.31:0/348802052 shutdown_connections 2024-09-17T02:00:11.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.688+0000 7f79dcfb6700 1 -- 172.21.15.31:0/348802052 wait complete. 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79dcfb6700 1 Processor -- start 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79dcfb6700 1 -- start start 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79dcfb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d8100d60 0x7f79d8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79dcfb6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 0x7f79d8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79dcfb6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8196610 con 0x7f79d8103680 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79dcfb6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8196750 con 0x7f79d8100d60 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 0x7f79d8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79d5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 0x7f79d8195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53002/0 (socket says 172.21.15.31:53002) 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79d5d9b700 1 -- 172.21.15.31:0/1276703680 learned_addr learned my addr 172.21.15.31:0/1276703680 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.689+0000 7f79d659c700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d8100d60 0x7f79d8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:11.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79d5d9b700 1 -- 172.21.15.31:0/1276703680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d8100d60 msgr2=0x7f79d8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79d5d9b700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d8100d60 0x7f79d8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79d5d9b700 1 -- 172.21.15.31:0/1276703680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009d00 con 0x7f79d8103680 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79d5d9b700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 0x7f79d8195ff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e920 tx=0x7f79cc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc00c9d0 con 0x7f79d8103680 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d819b200 con 0x7f79d8103680 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79cc010430 con 0x7f79d8103680 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc018650 con 0x7f79d8103680 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.690+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d819b750 con 0x7f79d8103680 2024-09-17T02:00:11.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.691+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d818fbc0 con 0x7f79d8103680 2024-09-17T02:00:11.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.692+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f79cc0105a0 con 0x7f79d8103680 2024-09-17T02:00:11.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.692+0000 7f79c77fe700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79c006e680 0x7f79c0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:11.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.692+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f79cc014070 con 0x7f79d8103680 2024-09-17T02:00:11.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.692+0000 7f79d659c700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79c006e680 0x7f79c0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:11.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.693+0000 7f79d659c700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79c006e680 0x7f79c0070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b780 tx=0x7f79c80060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:11.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.696+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f79cc0541b0 con 0x7f79d8103680 2024-09-17T02:00:11.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.959+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f79d802cc30 con 0x7f79d8103680 2024-09-17T02:00:11.958 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:11 smithi031 ceph-mon[77274]: pgmap v239: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:11.958 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:11 smithi031 ceph-mon[77274]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:11.958 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:11 smithi031 ceph-mon[77274]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:11.958 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:11 smithi031 ceph-mon[77274]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:11.958 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:11 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/974052872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:11.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.959+0000 7f79c77fe700 1 -- 172.21.15.31:0/1276703680 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 40 v40) v1 ==== 76+0+1972 (secure 0 0 0) 0x7f79cc05b640 con 0x7f79d8103680 2024-09-17T02:00:11.959 INFO:teuthology.orchestra.run.smithi031.stdout:e40 2024-09-17T02:00:11.959 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T02:00:06:552184+0000 2024-09-17T02:00:11.959 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T02:00:11.959 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T02:00:11.959 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 35 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T01:59:26.368371+0000 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T02:00:11.960 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 92 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 1 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:in 0 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=34416} 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 1 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T02:00:11.961 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 34416 members: 34416 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:Standby daemons: 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{-1:34448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{-1:44373} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6824/186400038,v1:172.21.15.92:6825/186400038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{-1:44377} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/3092379292,v1:172.21.15.92:6827/3092379292] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:11.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.962+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79c006e680 msgr2=0x7f79c0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.962+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79c006e680 0x7f79c0070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79c800b780 tx=0x7f79c80060c0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 msgr2=0x7f79d8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:11.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 0x7f79d8195ff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e920 tx=0x7f79cc00ec30 comp rx=0 tx=0).stop 2024-09-17T02:00:11.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 shutdown_connections 2024-09-17T02:00:11.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f79c006e680 0x7f79c0070b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79d8100d60 0x7f79d8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 --2- 172.21.15.31:0/1276703680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d8103680 0x7f79d8195ff0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 >> 172.21.15.31:0/1276703680 conn(0x7f79d80fa780 msgr2=0x7f79d80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 shutdown_connections 2024-09-17T02:00:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:11.963+0000 7f79dcfb6700 1 -- 172.21.15.31:0/1276703680 wait complete. 2024-09-17T02:00:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-17T02:00:11.979 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:11 smithi092 ceph-mon[64495]: pgmap v239: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:11.979 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:11 smithi092 ceph-mon[64495]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:11.980 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:11 smithi092 ceph-mon[64495]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:11.980 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:11 smithi092 ceph-mon[64495]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:11.980 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:11 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/974052872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/4111554306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 msgr2=0x7fdbc8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/4111554306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8101890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009910 tx=0x7fdbb0009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/4111554306 shutdown_connections 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/4111554306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8101890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/4111554306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbc8100240 0x7fdbc8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/4111554306 >> 172.21.15.31:0/4111554306 conn(0x7fdbc80fb7f0 msgr2=0x7fdbc80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/4111554306 shutdown_connections 2024-09-17T02:00:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.073+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/4111554306 wait complete. 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbcdbf4700 1 Processor -- start 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbcdbf4700 1 -- start start 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbcdbf4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbc8100240 0x7fdbc8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbcdbf4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbcdbf4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc8073680 con 0x7fdbc8101440 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbcdbf4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80737c0 con 0x7fdbc8100240 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbbeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbbeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53022/0 (socket says 172.21.15.31:53022) 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbbeffd700 1 -- 172.21.15.31:0/2330202196 learned_addr learned my addr 172.21.15.31:0/2330202196 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:12.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbc77fe700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbc8100240 0x7fdbc8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbbeffd700 1 -- 172.21.15.31:0/2330202196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbc8100240 msgr2=0x7fdbc8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbbeffd700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbc8100240 0x7fdbc8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.074+0000 7fdbbeffd700 1 -- 172.21.15.31:0/2330202196 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00095f0 con 0x7fdbc8101440 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.075+0000 7fdbbeffd700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8073140 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000bd70 tx=0x7fdbb000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.075+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb001d070 con 0x7fdbc8101440 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.075+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc8073a40 con 0x7fdbc8101440 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.075+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdbb0005dc0 con 0x7fdbc8101440 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.075+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb0021410 con 0x7fdbc8101440 2024-09-17T02:00:12.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.075+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc8073f30 con 0x7fdbc8101440 2024-09-17T02:00:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.076+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc8108d90 con 0x7fdbc8101440 2024-09-17T02:00:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.077+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdbb000f7d0 con 0x7fdbc8101440 2024-09-17T02:00:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.077+0000 7fdbc57fa700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fdbb406e680 0x7fdbb4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.077+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fdbb008fa30 con 0x7fdbc8101440 2024-09-17T02:00:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.077+0000 7fdbc77fe700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fdbb406e680 0x7fdbb4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.078+0000 7fdbc77fe700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fdbb406e680 0x7fdbb4070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009550 tx=0x7fdbb80091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:12.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.082+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbb005c630 con 0x7fdbc8101440 2024-09-17T02:00:12.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.322+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbc8105d90 con 0x7fdbb406e680 2024-09-17T02:00:12.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.324+0000 7fdbc57fa700 1 -- 172.21.15.31:0/2330202196 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fdbc8105d90 con 0x7fdbb406e680 2024-09-17T02:00:12.322 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:00:12.322 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T02:00:12.322 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T02:00:12.322 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "osd", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mon", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mds" 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "16/23 daemons upgraded", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T02:00:12.323 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:00:12.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.326+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fdbb406e680 msgr2=0x7fdbb4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.326+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fdbb406e680 0x7fdbb4070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009550 tx=0x7fdbb80091b0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.326+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 msgr2=0x7fdbc8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.326+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8073140 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000bd70 tx=0x7fdbb000bda0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 shutdown_connections 2024-09-17T02:00:12.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fdbb406e680 0x7fdbb4070b30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbc8100240 0x7fdbc8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 --2- 172.21.15.31:0/2330202196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc8101440 0x7fdbc8073140 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 >> 172.21.15.31:0/2330202196 conn(0x7fdbc80fb7f0 msgr2=0x7fdbc8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:12.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 shutdown_connections 2024-09-17T02:00:12.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.327+0000 7fdbcdbf4700 1 -- 172.21.15.31:0/2330202196 wait complete. 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 -- 172.21.15.31:0/3689384289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 msgr2=0x7f1d70100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 --2- 172.21.15.31:0/3689384289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70100650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009910 tx=0x7f1d6c009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 -- 172.21.15.31:0/3689384289 shutdown_connections 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 --2- 172.21.15.31:0/3689384289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d70101440 0x7f1d70101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 --2- 172.21.15.31:0/3689384289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70100650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 -- 172.21.15.31:0/3689384289 >> 172.21.15.31:0/3689384289 conn(0x7f1d700fb7f0 msgr2=0x7f1d700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 -- 172.21.15.31:0/3689384289 shutdown_connections 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 -- 172.21.15.31:0/3689384289 wait complete. 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.440+0000 7f1d782ef700 1 Processor -- start 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d782ef700 1 -- start start 2024-09-17T02:00:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d782ef700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d782ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d70101440 0x7f1d70195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d782ef700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70196610 con 0x7f1d70100240 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d782ef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70196750 con 0x7f1d70101440 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53048/0 (socket says 172.21.15.31:53048) 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 -- 172.21.15.31:0/1745182806 learned_addr learned my addr 172.21.15.31:0/1745182806 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7588a700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d70101440 0x7f1d70195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 -- 172.21.15.31:0/1745182806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d70101440 msgr2=0x7f1d70195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d70101440 0x7f1d70195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 -- 172.21.15.31:0/1745182806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0095f0 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.441+0000 7f1d7608b700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70195ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00bda0 tx=0x7f1d6c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.442+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6c01d070 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.442+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d6c00f460 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.442+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7019b1a0 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.442+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6c021620 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.442+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7019b690 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.443+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d70108d90 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.443+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1d6c00f5d0 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.444+0000 7f1d637fe700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1d5c06e680 0x7f1d5c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.444+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f1d6c08faf0 con 0x7f1d70100240 2024-09-17T02:00:12.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.444+0000 7f1d7588a700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1d5c06e680 0x7f1d5c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.445+0000 7f1d7588a700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1d5c06e680 0x7f1d5c070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005950 tx=0x7f1d640058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:12.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.448+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1d6c05c6f0 con 0x7f1d70100240 2024-09-17T02:00:12.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.766+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1d70108f80 con 0x7f1d70100240 2024-09-17T02:00:12.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.767+0000 7f1d637fe700 1 -- 172.21.15.31:0/1745182806 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1d6c061e60 con 0x7f1d70100240 2024-09-17T02:00:12.765 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T02:00:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1d5c06e680 msgr2=0x7f1d5c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1d5c06e680 0x7f1d5c070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005950 tx=0x7f1d640058e0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 msgr2=0x7f1d70195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70195ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00bda0 tx=0x7f1d6c00be80 comp rx=0 tx=0).stop 2024-09-17T02:00:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 shutdown_connections 2024-09-17T02:00:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f1d5c06e680 0x7f1d5c070b30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d70100240 0x7f1d70195ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 --2- 172.21.15.31:0/1745182806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d70101440 0x7f1d70195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:12.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 >> 172.21.15.31:0/1745182806 conn(0x7f1d700fb7f0 msgr2=0x7f1d70104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:12.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 shutdown_connections 2024-09-17T02:00:12.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:12.769+0000 7f1d782ef700 1 -- 172.21.15.31:0/1745182806 wait complete. 2024-09-17T02:00:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1276703680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:00:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:12.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T02:00:12.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.gszbpe"}]': finished 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.menvuk"}]': finished 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.hofoma"}]': finished 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.xzgrcs"}]': finished 2024-09-17T02:00:12.991 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:12 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T02:00:13.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1276703680' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:13.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.gszbpe"}]: dispatch 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.gszbpe"}]': finished 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.menvuk"}]: dispatch 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi031.menvuk"}]': finished 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.hofoma"}]: dispatch 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.hofoma"}]': finished 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.xzgrcs"}]: dispatch 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi092.xzgrcs"}]': finished 2024-09-17T02:00:13.016 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:12 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T02:00:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: pgmap v240: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all mds 2024-09-17T02:00:13.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1745182806' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: daemon mds.cephfs.smithi031.gszbpe assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: Cluster is now healthy 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi031.gszbpe=up:starting} 2 up:standby 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T02:00:13.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:13 smithi092 ceph-mon[64495]: daemon mds.cephfs.smithi031.gszbpe is now active in filesystem cephfs as rank 1 2024-09-17T02:00:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: pgmap v240: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all mds 2024-09-17T02:00:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1745182806' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: daemon mds.cephfs.smithi031.gszbpe assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: Cluster is now healthy 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: fsmap cephfs:1 {0=cephfs.smithi031.menvuk=up:active} 3 up:standby 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi031.gszbpe=up:starting} 2 up:standby 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T02:00:14.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:13 smithi031 ceph-mon[77274]: daemon mds.cephfs.smithi031.gszbpe is now active in filesystem cephfs as rank 1 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: mds.? [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] up:active 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi031.gszbpe=up:active} 2 up:standby 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi031.gszbpe=up:active} 2 up:standby-replay 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.926 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:14.927 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.927 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:14.927 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.927 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T02:00:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T02:00:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: mds.? [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] up:active 2024-09-17T02:00:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi031.gszbpe=up:active} 2 up:standby 2024-09-17T02:00:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: fsmap cephfs:2 {0=cephfs.smithi031.menvuk=up:active,1=cephfs.smithi031.gszbpe=up:active} 2 up:standby-replay 2024-09-17T02:00:14.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:14.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:14.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:14.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:15.972 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:15 smithi031 ceph-mon[77274]: pgmap v241: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:15.972 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:15 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all rgw 2024-09-17T02:00:15.972 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:15 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T02:00:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:15 smithi092 ceph-mon[64495]: pgmap v241: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail 2024-09-17T02:00:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:15 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all rgw 2024-09-17T02:00:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:15 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T02:00:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:17 smithi092 ceph-mon[64495]: Upgrade: Updating ceph-exporter.smithi031 (1/2) 2024-09-17T02:00:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T02:00:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:17 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:17.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:17 smithi092 ceph-mon[64495]: Deploying daemon ceph-exporter.smithi031 on smithi031 2024-09-17T02:00:17.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:17 smithi031 ceph-mon[77274]: Upgrade: Updating ceph-exporter.smithi031 (1/2) 2024-09-17T02:00:17.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:17.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi031", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T02:00:17.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:17 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:17.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:17 smithi031 ceph-mon[77274]: Deploying daemon ceph-exporter.smithi031 on smithi031 2024-09-17T02:00:18.253 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:18 smithi031 ceph-mon[77274]: pgmap v242: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 0 op/s 2024-09-17T02:00:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:18 smithi092 ceph-mon[64495]: pgmap v242: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 0 op/s 2024-09-17T02:00:20.272 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:20 smithi092 ceph-mon[64495]: pgmap v243: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T02:00:20.272 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:20.272 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:20 smithi031 ceph-mon[77274]: pgmap v243: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T02:00:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:21.219 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:21.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:22 smithi031 ceph-mon[77274]: pgmap v244: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T02:00:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:22 smithi031 ceph-mon[77274]: Upgrade: Updating ceph-exporter.smithi092 (2/2) 2024-09-17T02:00:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T02:00:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:22 smithi031 ceph-mon[77274]: Deploying daemon ceph-exporter.smithi092 on smithi092 2024-09-17T02:00:22.648 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:22 smithi092 ceph-mon[64495]: pgmap v244: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T02:00:22.649 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:22 smithi092 ceph-mon[64495]: Upgrade: Updating ceph-exporter.smithi092 (2/2) 2024-09-17T02:00:22.649 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:22.649 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi092", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T02:00:22.649 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:22.649 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:22 smithi092 ceph-mon[64495]: Deploying daemon ceph-exporter.smithi092 on smithi092 2024-09-17T02:00:24.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:24 smithi031 ceph-mon[77274]: pgmap v245: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T02:00:24.595 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:24 smithi092 ceph-mon[64495]: pgmap v245: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T02:00:26.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:25 smithi031 ceph-mon[77274]: pgmap v246: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T02:00:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:26.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:25 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:26.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:25 smithi092 ceph-mon[64495]: pgmap v246: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T02:00:26.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:26.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:26.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:25 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:27 smithi031 ceph-mon[77274]: pgmap v247: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T02:00:28.168 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:27 smithi092 ceph-mon[64495]: pgmap v247: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T02:00:30.241 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:30 smithi031 ceph-mon[77274]: pgmap v248: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-17T02:00:30.241 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.241 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.241 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.241 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:30 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:30 smithi092 ceph-mon[64495]: pgmap v248: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-17T02:00:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:30 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:31 smithi031 ceph-mon[77274]: pgmap v249: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 784 KiB/s rd, 3 op/s 2024-09-17T02:00:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:31 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.616 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:31 smithi092 ceph-mon[64495]: pgmap v249: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 784 KiB/s rd, 3 op/s 2024-09-17T02:00:31.616 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.616 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.616 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:31.616 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:31 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:34.078 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:33 smithi092 ceph-mon[64495]: pgmap v250: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 784 KiB/s rd, 3 op/s 2024-09-17T02:00:34.078 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:33 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:34.078 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:33 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:34.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:33 smithi031 ceph-mon[77274]: pgmap v250: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 784 KiB/s rd, 3 op/s 2024-09-17T02:00:34.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:33 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:34.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:33 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.210 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.211 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi031"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi031"}]': finished 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi092"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi092"}]': finished 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.212 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.213 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.213 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi031"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi031"}]': finished 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi092"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi092"}]': finished 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:35.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:35.517 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:36 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all iscsi 2024-09-17T02:00:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:36 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all nfs 2024-09-17T02:00:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:36 smithi092 ceph-mon[64495]: Upgrade: Setting container_image for all nvmeof 2024-09-17T02:00:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:36 smithi092 ceph-mon[64495]: pgmap v251: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 785 KiB/s rd, 4 op/s 2024-09-17T02:00:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:36 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all iscsi 2024-09-17T02:00:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:36 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all nfs 2024-09-17T02:00:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:36 smithi031 ceph-mon[77274]: Upgrade: Setting container_image for all nvmeof 2024-09-17T02:00:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:36 smithi031 ceph-mon[77274]: pgmap v251: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 785 KiB/s rd, 4 op/s 2024-09-17T02:00:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:37.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:37 smithi031 ceph-mon[77274]: Upgrade: Updating node-exporter.smithi031 (1/2) 2024-09-17T02:00:37.369 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:37 smithi031 ceph-mon[77274]: Deploying daemon node-exporter.smithi031 on smithi031 2024-09-17T02:00:37.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:37 smithi092 ceph-mon[64495]: Upgrade: Updating node-exporter.smithi031 (1/2) 2024-09-17T02:00:37.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:37 smithi092 ceph-mon[64495]: Deploying daemon node-exporter.smithi031 on smithi031 2024-09-17T02:00:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:38 smithi092 ceph-mon[64495]: pgmap v252: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:38.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:38 smithi031 ceph-mon[77274]: pgmap v252: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:39.642 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:39 smithi092 ceph-mon[64495]: pgmap v253: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:39.642 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:39 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:39.642 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:39 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:39.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:39 smithi031 ceph-mon[77274]: pgmap v253: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:39.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:39 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:39.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:39 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:40 smithi031 ceph-mon[77274]: Upgrade: Updating node-exporter.smithi092 (2/2) 2024-09-17T02:00:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:40 smithi031 ceph-mon[77274]: Deploying daemon node-exporter.smithi092 on smithi092 2024-09-17T02:00:40.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:40 smithi092 ceph-mon[64495]: Upgrade: Updating node-exporter.smithi092 (2/2) 2024-09-17T02:00:40.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:40 smithi092 ceph-mon[64495]: Deploying daemon node-exporter.smithi092 on smithi092 2024-09-17T02:00:41.669 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:41 smithi092 ceph-mon[64495]: pgmap v254: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:41.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:41 smithi031 ceph-mon[77274]: pgmap v254: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 -- 172.21.15.31:0/3039962284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 msgr2=0x7f6c70100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3039962284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c70100860 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009910 tx=0x7f6c5c009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 -- 172.21.15.31:0/3039962284 shutdown_connections 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3039962284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c70100860 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3039962284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c700ff150 0x7f6c700ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 -- 172.21.15.31:0/3039962284 >> 172.21.15.31:0/3039962284 conn(0x7f6c700fa7a0 msgr2=0x7f6c700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 -- 172.21.15.31:0/3039962284 shutdown_connections 2024-09-17T02:00:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.882+0000 7f6c770ea700 1 -- 172.21.15.31:0/3039962284 wait complete. 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c770ea700 1 Processor -- start 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c770ea700 1 -- start start 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c770ea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c700ff150 0x7f6c70194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c770ea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c701951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c770ea700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c701957f0 con 0x7f6c701003f0 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c770ea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70195960 con 0x7f6c700ff150 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c6ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c701951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c6ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c701951f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47574/0 (socket says 172.21.15.31:47574) 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c6ffff700 1 -- 172.21.15.31:0/3764107726 learned_addr learned my addr 172.21.15.31:0/3764107726 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.883+0000 7f6c74e86700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c700ff150 0x7f6c70194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6ffff700 1 -- 172.21.15.31:0/3764107726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c700ff150 msgr2=0x7f6c70194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6ffff700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c700ff150 0x7f6c70194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6ffff700 1 -- 172.21.15.31:0/3764107726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c0095f0 con 0x7f6c701003f0 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6ffff700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c701951f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b5c0 tx=0x7f6c5c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c5c01d070 con 0x7f6c701003f0 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c5c00f460 con 0x7f6c701003f0 2024-09-17T02:00:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c5c021640 con 0x7f6c701003f0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7019a390 con 0x7f6c701003f0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.884+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7019a880 con 0x7f6c701003f0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.885+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c70068ab0 con 0x7f6c701003f0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.886+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6c5c00fa60 con 0x7f6c701003f0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.886+0000 7f6c6dffb700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6c6006e680 0x7f6c60070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.887+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f6c5c08f9b0 con 0x7f6c701003f0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.887+0000 7f6c74e86700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6c6006e680 0x7f6c60070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:42.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.887+0000 7f6c74e86700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6c6006e680 0x7f6c60070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c70195b90 tx=0x7f6c6400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:42.891+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6c5c058a80 con 0x7f6c701003f0 2024-09-17T02:00:43.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.132+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c70104e40 con 0x7f6c6006e680 2024-09-17T02:00:43.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.134+0000 7f6c6dffb700 1 -- 172.21.15.31:0/3764107726 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f6c70104e40 con 0x7f6c6006e680 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6c6006e680 msgr2=0x7f6c60070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6c6006e680 0x7f6c60070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c70195b90 tx=0x7f6c6400b410 comp rx=0 tx=0).stop 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 msgr2=0x7f6c701951f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c701951f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b5c0 tx=0x7f6c5c00bd70 comp rx=0 tx=0).stop 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 shutdown_connections 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f6c6006e680 0x7f6c60070b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c700ff150 0x7f6c70194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 --2- 172.21.15.31:0/3764107726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c701003f0 0x7f6c701951f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 >> 172.21.15.31:0/3764107726 conn(0x7f6c700fa7a0 msgr2=0x7f6c70103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:43.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 shutdown_connections 2024-09-17T02:00:43.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.136+0000 7f6c770ea700 1 -- 172.21.15.31:0/3764107726 wait complete. 2024-09-17T02:00:43.146 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T02:00:43.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 -- 172.21.15.31:0/2301886374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 msgr2=0x7f338c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 --2- 172.21.15.31:0/2301886374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0ff540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f337c009910 tx=0x7f337c009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:43.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 -- 172.21.15.31:0/2301886374 shutdown_connections 2024-09-17T02:00:43.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 --2- 172.21.15.31:0/2301886374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 0x7f338c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 --2- 172.21.15.31:0/2301886374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0ff540 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 -- 172.21.15.31:0/2301886374 >> 172.21.15.31:0/2301886374 conn(0x7f338c0fa780 msgr2=0x7f338c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:43.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 -- 172.21.15.31:0/2301886374 shutdown_connections 2024-09-17T02:00:43.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.272+0000 7f3391fc3700 1 -- 172.21.15.31:0/2301886374 wait complete. 2024-09-17T02:00:43.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f3391fc3700 1 Processor -- start 2024-09-17T02:00:43.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f3391fc3700 1 -- start start 2024-09-17T02:00:43.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f3391fc3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:43.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f3391fc3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 0x7f338c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:43.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f3391fc3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c19adc0 con 0x7f338c0ff130 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f3391fc3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c19af30 con 0x7f338c1003d0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.273+0000 7f338b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47590/0 (socket says 172.21.15.31:47590) 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 0x7f338c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338b7fe700 1 -- 172.21.15.31:0/3804087147 learned_addr learned my addr 172.21.15.31:0/3804087147 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338affd700 1 -- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 msgr2=0x7f338c0690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338affd700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338affd700 1 -- 172.21.15.31:0/3804087147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0095f0 con 0x7f338c1003d0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338b7fe700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f338affd700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 0x7f338c19a7f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f338000e970 tx=0x7f338000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338000c9d0 con 0x7f338c1003d0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c19b210 con 0x7f338c1003d0 2024-09-17T02:00:43.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3380010430 con 0x7f338c1003d0 2024-09-17T02:00:43.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3380018650 con 0x7f338c1003d0 2024-09-17T02:00:43.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.274+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c19b760 con 0x7f338c1003d0 2024-09-17T02:00:43.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.276+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c107c10 con 0x7f338c1003d0 2024-09-17T02:00:43.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.276+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f338000cb30 con 0x7f338c1003d0 2024-09-17T02:00:43.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.277+0000 7f3388ff9700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f337406e680 0x7f3374070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:43.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.277+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3380014070 con 0x7f338c1003d0 2024-09-17T02:00:43.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.277+0000 7f338b7fe700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f337406e680 0x7f3374070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:43.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.277+0000 7f338b7fe700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f337406e680 0x7f3374070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f337c009fd0 tx=0x7f337c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:43.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.281+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f33800541b0 con 0x7f338c1003d0 2024-09-17T02:00:43.382 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:43.382 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:43.382 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:43.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.525+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f338c104d20 con 0x7f337406e680 2024-09-17T02:00:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.526+0000 7f3388ff9700 1 -- 172.21.15.31:0/3804087147 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f338c104d20 con 0x7f337406e680 2024-09-17T02:00:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f337406e680 msgr2=0x7f3374070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f337406e680 0x7f3374070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f337c009fd0 tx=0x7f337c005940 comp rx=0 tx=0).stop 2024-09-17T02:00:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 msgr2=0x7f338c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 0x7f338c19a7f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f338000e970 tx=0x7f338000ec80 comp rx=0 tx=0).stop 2024-09-17T02:00:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 shutdown_connections 2024-09-17T02:00:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f337406e680 0x7f3374070b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c0ff130 0x7f338c0690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 --2- 172.21.15.31:0/3804087147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f338c1003d0 0x7f338c19a7f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.528+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 >> 172.21.15.31:0/3804087147 conn(0x7f338c0fa780 msgr2=0x7f338c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:43.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.529+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 shutdown_connections 2024-09-17T02:00:43.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.529+0000 7f3391fc3700 1 -- 172.21.15.31:0/3804087147 wait complete. 2024-09-17T02:00:43.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 -- 172.21.15.31:0/2698616023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 msgr2=0x7fb9201018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 --2- 172.21.15.31:0/2698616023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb9201018a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb908009910 tx=0x7fb908009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 -- 172.21.15.31:0/2698616023 shutdown_connections 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 --2- 172.21.15.31:0/2698616023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb9201018a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 --2- 172.21.15.31:0/2698616023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb920100250 0x7fb920100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 -- 172.21.15.31:0/2698616023 >> 172.21.15.31:0/2698616023 conn(0x7fb9200fb7e0 msgr2=0x7fb9200fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 -- 172.21.15.31:0/2698616023 shutdown_connections 2024-09-17T02:00:43.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.643+0000 7fb9271c7700 1 -- 172.21.15.31:0/2698616023 wait complete. 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb9271c7700 1 Processor -- start 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb9271c7700 1 -- start start 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb9271c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb920100250 0x7fb920074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb9271c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb920073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb9271c7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb920073680 con 0x7fb920101450 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb9271c7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200737c0 con 0x7fb920100250 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb920073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:43.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb920073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58470/0 (socket says 172.21.15.31:58470) 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb91ffff700 1 -- 172.21.15.31:0/585786797 learned_addr learned my addr 172.21.15.31:0/585786797 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb924f63700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb920100250 0x7fb920074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb91ffff700 1 -- 172.21.15.31:0/585786797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb920100250 msgr2=0x7fb920074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb91ffff700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb920100250 0x7fb920074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.644+0000 7fb91ffff700 1 -- 172.21.15.31:0/585786797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9080095f0 con 0x7fb920101450 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.645+0000 7fb91ffff700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb920073140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb90800b5c0 tx=0x7fb90800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.645+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90801d070 con 0x7fb920101450 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.645+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb908022470 con 0x7fb920101450 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.645+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb920073a40 con 0x7fb920101450 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.645+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90800f690 con 0x7fb920101450 2024-09-17T02:00:43.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.645+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb920073ee0 con 0x7fb920101450 2024-09-17T02:00:43.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.646+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb920108da0 con 0x7fb920101450 2024-09-17T02:00:43.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.646+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb9080225e0 con 0x7fb920101450 2024-09-17T02:00:43.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.647+0000 7fb91dffb700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb90c06e680 0x7fb90c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:43.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.647+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb90808fe50 con 0x7fb920101450 2024-09-17T02:00:43.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.647+0000 7fb924f63700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb90c06e680 0x7fb90c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:43.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.647+0000 7fb924f63700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb90c06e680 0x7fb90c070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9201012b0 tx=0x7fb91000c040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:43.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.651+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb90805ca50 con 0x7fb920101450 2024-09-17T02:00:43.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.878+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb92019df20 con 0x7fb90c06e680 2024-09-17T02:00:43.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.887+0000 7fb91dffb700 1 -- 172.21.15.31:0/585786797 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb92019df20 con 0x7fb90c06e680 2024-09-17T02:00:43.886 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T02:00:43.886 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (15m) 14s ago 16m 25.6M - 0.25.0 c8568f914cd2 8133e3476042 2024-09-17T02:00:43.886 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (24s) 14s ago 17m 8182k - 19.1.1-330-gc2ddf972 ebb0615149de ca48e79b4a53 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (19s) 13s ago 16m 7444k - 19.1.1-330-gc2ddf972 ebb0615149de b1f07ae64ced 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (6m) 14s ago 17m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (5m) 13s ago 16m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (15m) 14s ago 16m 87.0M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (74s) 14s ago 11m 17.2M - 19.1.1-330-gc2ddf972 ebb0615149de 120ddd893c49 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (102s) 14s ago 11m 65.3M - 19.1.1-330-gc2ddf972 ebb0615149de b293c28b6b80 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (38s) 13s ago 11m 15.7M - 19.1.1-330-gc2ddf972 ebb0615149de c50cee007787 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (53s) 13s ago 11m 67.0M - 19.1.1-330-gc2ddf972 ebb0615149de bd12a6058776 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (8m) 14s ago 18m 508M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (7m) 13s ago 15m 443M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (7m) 14s ago 18m 55.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (6m) 13s ago 15m 43.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T02:00:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 starting - - - - 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 starting - - - - 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (5m) 14s ago 15m 195M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (5m) 14s ago 14m 119M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (4m) 14s ago 14m 140M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (3m) 13s ago 13m 138M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (3m) 13s ago 13m 99.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (2m) 13s ago 12m 98.4M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T02:00:43.888 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (7m) 14s ago 16m 86.1M - 2.43.0 a07b618ecd1d 4af2ab46bb1f 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb90c06e680 msgr2=0x7fb90c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb90c06e680 0x7fb90c070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb9201012b0 tx=0x7fb91000c040 comp rx=0 tx=0).stop 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 msgr2=0x7fb920073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb920073140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb90800b5c0 tx=0x7fb90800bd70 comp rx=0 tx=0).stop 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 shutdown_connections 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb90c06e680 0x7fb90c070b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb920100250 0x7fb920074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 --2- 172.21.15.31:0/585786797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb920101450 0x7fb920073140 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:43.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.889+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 >> 172.21.15.31:0/585786797 conn(0x7fb9200fb7e0 msgr2=0x7fb920104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:43.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.890+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 shutdown_connections 2024-09-17T02:00:43.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:43.890+0000 7fb9271c7700 1 -- 172.21.15.31:0/585786797 wait complete. 2024-09-17T02:00:44.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.001+0000 7f4179ad7700 1 -- 172.21.15.31:0/3914934509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 msgr2=0x7f41741018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.001+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3914934509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f41741018a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4168009910 tx=0x7f4168009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.001+0000 7f4179ad7700 1 -- 172.21.15.31:0/3914934509 shutdown_connections 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.001+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3914934509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f41741018a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.001+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3914934509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 0x7f4174100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.001+0000 7f4179ad7700 1 -- 172.21.15.31:0/3914934509 >> 172.21.15.31:0/3914934509 conn(0x7f41740fb7e0 msgr2=0x7f41740fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.002+0000 7f4179ad7700 1 -- 172.21.15.31:0/3914934509 shutdown_connections 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.002+0000 7f4179ad7700 1 -- 172.21.15.31:0/3914934509 wait complete. 2024-09-17T02:00:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.002+0000 7f4179ad7700 1 Processor -- start 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.002+0000 7f4179ad7700 1 -- start start 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4179ad7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 0x7f4174074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4179ad7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f4174073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4179ad7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174073680 con 0x7f4174101450 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4179ad7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41740737c0 con 0x7f4174100250 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4172ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f4174073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4172ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f4174073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58490/0 (socket says 172.21.15.31:58490) 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f4172ffd700 1 -- 172.21.15.31:0/3819478445 learned_addr learned my addr 172.21.15.31:0/3819478445 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f41737fe700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 0x7f4174074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f41737fe700 1 -- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 msgr2=0x7f4174073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f41737fe700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f4174073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f41737fe700 1 -- 172.21.15.31:0/3819478445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680095f0 con 0x7f4174100250 2024-09-17T02:00:44.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.003+0000 7f41737fe700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 0x7f4174074af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f416400e940 tx=0x7f416400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:44.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.004+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41640041f0 con 0x7f4174100250 2024-09-17T02:00:44.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.004+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4164004350 con 0x7f4174100250 2024-09-17T02:00:44.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.004+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4174073aa0 con 0x7f4174100250 2024-09-17T02:00:44.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.004+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4164003c80 con 0x7f4174100250 2024-09-17T02:00:44.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.004+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417419db00 con 0x7f4174100250 2024-09-17T02:00:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.005+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4174108da0 con 0x7f4174100250 2024-09-17T02:00:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.006+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f416400c7c0 con 0x7f4174100250 2024-09-17T02:00:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.006+0000 7f4170ff9700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f415c06e6d0 0x7f415c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.006+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f4164014070 con 0x7f4174100250 2024-09-17T02:00:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.006+0000 7f4172ffd700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f415c06e6d0 0x7f415c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.007+0000 7f4172ffd700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f415c06e6d0 0x7f415c070b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4168009fd0 tx=0x7f4168005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:44.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.011+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f416405b680 con 0x7f4174100250 2024-09-17T02:00:44.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.325+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f417419e0b0 con 0x7f4174100250 2024-09-17T02:00:44.325 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:44 smithi031 ceph-mon[77274]: pgmap v255: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:44.325 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:44 smithi031 ceph-mon[77274]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:44.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.326+0000 7f4170ff9700 1 -- 172.21.15.31:0/3819478445 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f416400ca70 con 0x7f4174100250 2024-09-17T02:00:44.325 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:00:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T02:00:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:00:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T02:00:44.326 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f415c06e6d0 msgr2=0x7f415c070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f415c06e6d0 0x7f415c070b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4168009fd0 tx=0x7f4168005a90 comp rx=0 tx=0).stop 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 msgr2=0x7f4174074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 0x7f4174074af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f416400e940 tx=0x7f416400ec50 comp rx=0 tx=0).stop 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 shutdown_connections 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f415c06e6d0 0x7f415c070b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4174100250 0x7f4174074af0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 --2- 172.21.15.31:0/3819478445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4174101450 0x7f4174073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 >> 172.21.15.31:0/3819478445 conn(0x7f41740fb7e0 msgr2=0x7f4174104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:44.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 shutdown_connections 2024-09-17T02:00:44.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.328+0000 7f4179ad7700 1 -- 172.21.15.31:0/3819478445 wait complete. 2024-09-17T02:00:44.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.437+0000 7fca3bb3c700 1 -- 172.21.15.31:0/1861271943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca341003f0 msgr2=0x7fca34100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.437+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/1861271943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca341003f0 0x7fca34100860 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fca24009910 tx=0x7fca24009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:44.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.437+0000 7fca3bb3c700 1 -- 172.21.15.31:0/1861271943 shutdown_connections 2024-09-17T02:00:44.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.437+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/1861271943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca341003f0 0x7fca34100860 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.437+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/1861271943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca340ff150 0x7fca340ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.437+0000 7fca3bb3c700 1 -- 172.21.15.31:0/1861271943 >> 172.21.15.31:0/1861271943 conn(0x7fca340fa7a0 msgr2=0x7fca340fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:44.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 -- 172.21.15.31:0/1861271943 shutdown_connections 2024-09-17T02:00:44.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 -- 172.21.15.31:0/1861271943 wait complete. 2024-09-17T02:00:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 Processor -- start 2024-09-17T02:00:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 -- start start 2024-09-17T02:00:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 0x7fca34195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341003f0 0x7fca34196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca34196920 con 0x7fca340ff150 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.438+0000 7fca3bb3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca34196a60 con 0x7fca341003f0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca398d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 0x7fca34195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca398d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 0x7fca34195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58502/0 (socket says 172.21.15.31:58502) 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca390d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341003f0 0x7fca34196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca398d8700 1 -- 172.21.15.31:0/3970720217 learned_addr learned my addr 172.21.15.31:0/3970720217 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca390d7700 1 -- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 msgr2=0x7fca34195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca390d7700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 0x7fca34195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca390d7700 1 -- 172.21.15.31:0/3970720217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240095f0 con 0x7fca341003f0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca398d8700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 0x7fca34195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca390d7700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341003f0 0x7fca34196300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca2400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca2401d070 con 0x7fca341003f0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3419b4b0 con 0x7fca341003f0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.439+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca24005dc0 con 0x7fca341003f0 2024-09-17T02:00:44.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.440+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca24017400 con 0x7fca341003f0 2024-09-17T02:00:44.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.440+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3419b9a0 con 0x7fca341003f0 2024-09-17T02:00:44.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.441+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca34068ab0 con 0x7fca341003f0 2024-09-17T02:00:44.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.441+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fca24003810 con 0x7fca341003f0 2024-09-17T02:00:44.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.442+0000 7fca2affd700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca2006e680 0x7fca20070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.442+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fca2408fb70 con 0x7fca341003f0 2024-09-17T02:00:44.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.442+0000 7fca398d8700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca2006e680 0x7fca20070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.442+0000 7fca398d8700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca2006e680 0x7fca20070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca30011550 tx=0x7fca30009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:44.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.446+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca2405c710 con 0x7fca341003f0 2024-09-17T02:00:44.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:44 smithi092 ceph-mon[64495]: pgmap v255: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:44.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:44 smithi092 ceph-mon[64495]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.712+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fca3419bc80 con 0x7fca341003f0 2024-09-17T02:00:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.713+0000 7fca2affd700 1 -- 172.21.15.31:0/3970720217 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+2000 (secure 0 0 0) 0x7fca2405c2a0 con 0x7fca341003f0 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:e44 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T02:00:14:511713+0000 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 44 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T02:00:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T02:00:14.511701+0000 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 92 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T02:00:44.713 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=34416,1=34448} 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{0:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.92:6824/186400038,v1:172.21.15.92:6825/186400038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:44.714 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:34448} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:44.715 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{1:44377} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/3092379292,v1:172.21.15.92:6827/3092379292] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:00:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca2006e680 msgr2=0x7fca20070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca2006e680 0x7fca20070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca30011550 tx=0x7fca30009260 comp rx=0 tx=0).stop 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341003f0 msgr2=0x7fca34196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341003f0 0x7fca34196300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca2400f690 comp rx=0 tx=0).stop 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 shutdown_connections 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca2006e680 0x7fca20070b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca340ff150 0x7fca34195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 --2- 172.21.15.31:0/3970720217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca341003f0 0x7fca34196300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 >> 172.21.15.31:0/3970720217 conn(0x7fca340fa7a0 msgr2=0x7fca34068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.716+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 shutdown_connections 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.717+0000 7fca3bb3c700 1 -- 172.21.15.31:0/3970720217 wait complete. 2024-09-17T02:00:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 44 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.835+0000 7fa8c7a83700 1 -- 172.21.15.31:0/2434113770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 msgr2=0x7fa8c0073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.835+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/2434113770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0073ba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009910 tx=0x7fa8b0009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 -- 172.21.15.31:0/2434113770 shutdown_connections 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/2434113770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0073ba0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/2434113770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c0073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 -- 172.21.15.31:0/2434113770 >> 172.21.15.31:0/2434113770 conn(0x7fa8c00fb7f0 msgr2=0x7fa8c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 -- 172.21.15.31:0/2434113770 shutdown_connections 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 -- 172.21.15.31:0/2434113770 wait complete. 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 Processor -- start 2024-09-17T02:00:44.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.836+0000 7fa8c7a83700 1 -- start start 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c7a83700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c7a83700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c7a83700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c01987b0 con 0x7fa8c0073730 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c7a83700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c0198920 con 0x7fa8c0074d00 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c581f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c501e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c581f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58516/0 (socket says 172.21.15.31:58516) 2024-09-17T02:00:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c501e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c01981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:38496/0 (socket says 172.21.15.31:38496) 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c581f700 1 -- 172.21.15.31:0/1898727265 learned_addr learned my addr 172.21.15.31:0/1898727265 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c501e700 1 -- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 msgr2=0x7fa8c0197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c501e700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c501e700 1 -- 172.21.15.31:0/1898727265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00095f0 con 0x7fa8c0074d00 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c581f700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.837+0000 7fa8c501e700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c01981b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0000c00 tx=0x7fa8b000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.838+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b001d070 con 0x7fa8c0074d00 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.838+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8b0005dc0 con 0x7fa8c0074d00 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.838+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b0017400 con 0x7fa8c0074d00 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.838+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c019d350 con 0x7fa8c0074d00 2024-09-17T02:00:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.838+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c019d840 con 0x7fa8c0074d00 2024-09-17T02:00:44.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.839+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c010af70 con 0x7fa8c0074d00 2024-09-17T02:00:44.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.839+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa8b0003810 con 0x7fa8c0074d00 2024-09-17T02:00:44.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.840+0000 7fa8b6ffd700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa8ac06e680 0x7fa8ac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:44.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.840+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa8b008faa0 con 0x7fa8c0074d00 2024-09-17T02:00:44.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.840+0000 7fa8c581f700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa8ac06e680 0x7fa8ac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:44.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.840+0000 7fa8c581f700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa8ac06e680 0x7fa8ac070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0198b50 tx=0x7fa8bc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:44.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:44.844+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8b0058b90 con 0x7fa8c0074d00 2024-09-17T02:00:45.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.089+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8c01077c0 con 0x7fa8ac06e680 2024-09-17T02:00:45.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.091+0000 7fa8b6ffd700 1 -- 172.21.15.31:0/1898727265 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fa8c01077c0 con 0x7fa8ac06e680 2024-09-17T02:00:45.089 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "osd", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph-exporter", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "mds", 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T02:00:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T02:00:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-17T02:00:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T02:00:45.091 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:00:45.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa8ac06e680 msgr2=0x7fa8ac070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:45.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa8ac06e680 0x7fa8ac070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0198b50 tx=0x7fa8bc009260 comp rx=0 tx=0).stop 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 msgr2=0x7fa8c01981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c01981b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0000c00 tx=0x7fa8b000f690 comp rx=0 tx=0).stop 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 shutdown_connections 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa8ac06e680 0x7fa8ac070b30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8c0073730 0x7fa8c0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 --2- 172.21.15.31:0/1898727265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8c0074d00 0x7fa8c01981b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.093+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 >> 172.21.15.31:0/1898727265 conn(0x7fa8c00fb7f0 msgr2=0x7fa8c01060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.094+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 shutdown_connections 2024-09-17T02:00:45.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.094+0000 7fa8c7a83700 1 -- 172.21.15.31:0/1898727265 wait complete. 2024-09-17T02:00:45.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.206+0000 7fe423fb6700 1 -- 172.21.15.31:0/1565306455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c0737b0 msgr2=0x7fe41c073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:45.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.206+0000 7fe423fb6700 1 --2- 172.21.15.31:0/1565306455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c0737b0 0x7fe41c073c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009910 tx=0x7fe40c009c20 comp rx=0 tx=0).stop 2024-09-17T02:00:45.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 -- 172.21.15.31:0/1565306455 shutdown_connections 2024-09-17T02:00:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 --2- 172.21.15.31:0/1565306455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c0737b0 0x7fe41c073c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 --2- 172.21.15.31:0/1565306455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c074d80 0x7fe41c0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 -- 172.21.15.31:0/1565306455 >> 172.21.15.31:0/1565306455 conn(0x7fe41c0fb7f0 msgr2=0x7fe41c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 -- 172.21.15.31:0/1565306455 shutdown_connections 2024-09-17T02:00:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 -- 172.21.15.31:0/1565306455 wait complete. 2024-09-17T02:00:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 Processor -- start 2024-09-17T02:00:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 -- start start 2024-09-17T02:00:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c0737b0 0x7fe41c19c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 0x7fe41c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.207+0000 7fe423fb6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c19cc00 con 0x7fe41c074d80 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe423fb6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c19cd40 con 0x7fe41c0737b0 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421551700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 0x7fe41c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421d52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c0737b0 0x7fe41c19c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421551700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 0x7fe41c19c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58528/0 (socket says 172.21.15.31:58528) 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421551700 1 -- 172.21.15.31:0/947837207 learned_addr learned my addr 172.21.15.31:0/947837207 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421d52700 1 -- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 msgr2=0x7fe41c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421d52700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 0x7fe41c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421d52700 1 -- 172.21.15.31:0/947837207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0095f0 con 0x7fe41c0737b0 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421551700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 0x7fe41c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe421d52700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c0737b0 0x7fe41c19c0a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e970 tx=0x7fe41800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41800c9d0 con 0x7fe41c0737b0 2024-09-17T02:00:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe418010430 con 0x7fe41c0737b0 2024-09-17T02:00:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c1a17f0 con 0x7fe41c0737b0 2024-09-17T02:00:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe418018650 con 0x7fe41c0737b0 2024-09-17T02:00:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.208+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c1a1d40 con 0x7fe41c0737b0 2024-09-17T02:00:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.209+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c10f380 con 0x7fe41c0737b0 2024-09-17T02:00:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.210+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe4180105a0 con 0x7fe41c0737b0 2024-09-17T02:00:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.210+0000 7fe412ffd700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe40806e680 0x7fe408070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:00:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.210+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe418014070 con 0x7fe41c0737b0 2024-09-17T02:00:45.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.210+0000 7fe421551700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe40806e680 0x7fe408070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:00:45.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.211+0000 7fe421551700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe40806e680 0x7fe408070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006010 tx=0x7fe40c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:00:45.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.218+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe4180541b0 con 0x7fe41c0737b0 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='client.44415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3819478445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3970720217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:00:45.437 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.438 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='client.44415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:45.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3819478445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3970720217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:00:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:45.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.532+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe41c10f540 con 0x7fe41c0737b0 2024-09-17T02:00:45.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.532+0000 7fe412ffd700 1 -- 172.21.15.31:0/947837207 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe41805b5a0 con 0x7fe41c0737b0 2024-09-17T02:00:45.531 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe40806e680 msgr2=0x7fe408070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe40806e680 0x7fe408070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006010 tx=0x7fe40c005940 comp rx=0 tx=0).stop 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c0737b0 msgr2=0x7fe41c19c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c0737b0 0x7fe41c19c0a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e970 tx=0x7fe41800ec80 comp rx=0 tx=0).stop 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 shutdown_connections 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe40806e680 0x7fe408070b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c0737b0 0x7fe41c19c0a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 --2- 172.21.15.31:0/947837207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41c074d80 0x7fe41c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:00:45.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 >> 172.21.15.31:0/947837207 conn(0x7fe41c0fb7f0 msgr2=0x7fe41c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:00:45.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 shutdown_connections 2024-09-17T02:00:45.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:00:45.534+0000 7fe423fb6700 1 -- 172.21.15.31:0/947837207 wait complete. 2024-09-17T02:00:46.455 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:46 smithi092 ceph-mon[64495]: pgmap v256: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:46.456 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:46 smithi092 ceph-mon[64495]: from='client.44429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:46.456 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:46 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/947837207' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:00:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:46 smithi031 ceph-mon[77274]: pgmap v256: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:46 smithi031 ceph-mon[77274]: from='client.44429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:00:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:46 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/947837207' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:00:47.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:47 smithi092 ceph-mon[64495]: pgmap v257: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:47.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.718 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:47 smithi031 ceph-mon[77274]: pgmap v257: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:47.718 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.718 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.718 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:47.718 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:49.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:49.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:49.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:50.238 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:49 smithi092 ceph-mon[64495]: pgmap v258: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:50.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:49 smithi031 ceph-mon[77274]: pgmap v258: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:51.174 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.175 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:00:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:51.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:00:52.186 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:51 smithi031 ceph-mon[77274]: pgmap v259: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:52.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:51 smithi092 ceph-mon[64495]: pgmap v259: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:53.141 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:52 smithi031 ceph-mon[77274]: Upgrade: Updating prometheus.smithi031 2024-09-17T02:00:53.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:52 smithi092 ceph-mon[64495]: Upgrade: Updating prometheus.smithi031 2024-09-17T02:00:54.161 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:53 smithi031 ceph-mon[77274]: pgmap v260: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:54.161 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:53 smithi031 ceph-mon[77274]: Deploying daemon prometheus.smithi031 on smithi031 2024-09-17T02:00:54.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:53 smithi092 ceph-mon[64495]: pgmap v260: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:54.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:53 smithi092 ceph-mon[64495]: Deploying daemon prometheus.smithi031 on smithi031 2024-09-17T02:00:56.149 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:55 smithi031 ceph-mon[77274]: pgmap v261: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:56.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:55 smithi092 ceph-mon[64495]: pgmap v261: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:00:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:57 smithi092 ceph-mon[64495]: pgmap v262: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:57 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:00:58.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:57 smithi031 ceph-mon[77274]: pgmap v262: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:00:58.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:58.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:00:58.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:57 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:00.229 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:00:59 smithi031 ceph-mon[77274]: pgmap v263: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T02:01:00.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:00:59 smithi092 ceph-mon[64495]: pgmap v263: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T02:01:02.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:01 smithi092 ceph-mon[64495]: pgmap v264: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T02:01:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:01 smithi031 ceph-mon[77274]: pgmap v264: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T02:01:03.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.465 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.466 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.466 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:03 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:03.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:03 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:04.344 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:04 smithi031 ceph-mon[77274]: pgmap v265: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T02:01:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:04 smithi092 ceph-mon[64495]: pgmap v265: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T02:01:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: pgmap v266: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T02:01:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:06.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:06.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: pgmap v266: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T02:01:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:06.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T02:01:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T02:01:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:07 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:07.516 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:07 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:08.444 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:08 smithi031 ceph-mon[77274]: pgmap v267: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T02:01:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:08 smithi092 ceph-mon[64495]: pgmap v267: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T02:01:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:09 smithi092 ceph-mon[64495]: Upgrade: Updating alertmanager.smithi031 2024-09-17T02:01:09.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:09 smithi092 ceph-mon[64495]: Deploying daemon alertmanager.smithi031 on smithi031 2024-09-17T02:01:09.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:09 smithi031 ceph-mon[77274]: Upgrade: Updating alertmanager.smithi031 2024-09-17T02:01:09.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:09 smithi031 ceph-mon[77274]: Deploying daemon alertmanager.smithi031 on smithi031 2024-09-17T02:01:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:10 smithi092 ceph-mon[64495]: pgmap v268: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T02:01:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:10 smithi031 ceph-mon[77274]: pgmap v268: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T02:01:12.448 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:12 smithi031 ceph-mon[77274]: pgmap v269: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:12 smithi092 ceph-mon[64495]: pgmap v269: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:14 smithi092 ceph-mon[64495]: pgmap v270: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:14 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:14.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:14 smithi031 ceph-mon[77274]: pgmap v270: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:14.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:14.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:14.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:14 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:15.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 -- 172.21.15.31:0/2344133275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c100240 msgr2=0x7f801c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:15.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2344133275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c100240 0x7f801c100650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8010009910 tx=0x7f8010009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:15.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 -- 172.21.15.31:0/2344133275 shutdown_connections 2024-09-17T02:01:15.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2344133275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f801c101440 0x7f801c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2344133275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c100240 0x7f801c100650 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 -- 172.21.15.31:0/2344133275 >> 172.21.15.31:0/2344133275 conn(0x7f801c0fb7f0 msgr2=0x7f801c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:15.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 -- 172.21.15.31:0/2344133275 shutdown_connections 2024-09-17T02:01:15.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.650+0000 7f8022dc0700 1 -- 172.21.15.31:0/2344133275 wait complete. 2024-09-17T02:01:15.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.651+0000 7f8022dc0700 1 Processor -- start 2024-09-17T02:01:15.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.651+0000 7f8022dc0700 1 -- start start 2024-09-17T02:01:15.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.651+0000 7f8022dc0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f801c100240 0x7f801c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:15.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.651+0000 7f8022dc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 0x7f801c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:15.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.651+0000 7f8022dc0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c196630 con 0x7f801c101440 2024-09-17T02:01:15.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.651+0000 7f8022dc0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c196770 con 0x7f801c100240 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 0x7f801c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 0x7f801c196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41656/0 (socket says 172.21.15.31:41656) 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f8020b5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f801c100240 0x7f801c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 -- 172.21.15.31:0/2652649487 learned_addr learned my addr 172.21.15.31:0/2652649487 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 -- 172.21.15.31:0/2652649487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f801c100240 msgr2=0x7f801c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f801c100240 0x7f801c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 -- 172.21.15.31:0/2652649487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100095f0 con 0x7f801c101440 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f801bfff700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 0x7f801c196010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f800800d8d0 tx=0x7f800800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80080098a0 con 0x7f801c101440 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8008010460 con 0x7f801c101440 2024-09-17T02:01:15.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c19b220 con 0x7f801c101440 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.652+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f800800f5f0 con 0x7f801c101440 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.653+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c19b770 con 0x7f801c101440 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.654+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c108d90 con 0x7f801c101440 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.655+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8008009a00 con 0x7f801c101440 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.655+0000 7f8019ffb700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f800c06e680 0x7f800c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.655+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f800808e620 con 0x7f801c101440 2024-09-17T02:01:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.655+0000 7f8020b5c700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f800c06e680 0x7f800c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:15.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.656+0000 7f8020b5c700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f800c06e680 0x7f800c070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8010006010 tx=0x7f801000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:15.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.661+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f800805b220 con 0x7f801c101440 2024-09-17T02:01:15.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.933+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f801c105d90 con 0x7f800c06e680 2024-09-17T02:01:15.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.935+0000 7f8019ffb700 1 -- 172.21.15.31:0/2652649487 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f801c105d90 con 0x7f800c06e680 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f800c06e680 msgr2=0x7f800c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f800c06e680 0x7f800c070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8010006010 tx=0x7f801000b540 comp rx=0 tx=0).stop 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 msgr2=0x7f801c196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 0x7f801c196010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f800800d8d0 tx=0x7f800800dbe0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 shutdown_connections 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f800c06e680 0x7f800c070b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f801c100240 0x7f801c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 --2- 172.21.15.31:0/2652649487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f801c101440 0x7f801c196010 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:15.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 >> 172.21.15.31:0/2652649487 conn(0x7f801c0fb7f0 msgr2=0x7f801c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:15.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 shutdown_connections 2024-09-17T02:01:15.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:15.937+0000 7f8022dc0700 1 -- 172.21.15.31:0/2652649487 wait complete. 2024-09-17T02:01:15.946 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T02:01:16.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 -- 172.21.15.31:0/2458241992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 msgr2=0x7f815c1030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 --2- 172.21.15.31:0/2458241992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c1030c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f814c009910 tx=0x7f814c009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:16.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 -- 172.21.15.31:0/2458241992 shutdown_connections 2024-09-17T02:01:16.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 --2- 172.21.15.31:0/2458241992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f815c103600 0x7f815c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 --2- 172.21.15.31:0/2458241992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c1030c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 -- 172.21.15.31:0/2458241992 >> 172.21.15.31:0/2458241992 conn(0x7f815c0fa700 msgr2=0x7f815c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:16.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 -- 172.21.15.31:0/2458241992 shutdown_connections 2024-09-17T02:01:16.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.057+0000 7f8161064700 1 -- 172.21.15.31:0/2458241992 wait complete. 2024-09-17T02:01:16.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.058+0000 7f8161064700 1 Processor -- start 2024-09-17T02:01:16.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.058+0000 7f8161064700 1 -- start start 2024-09-17T02:01:16.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.058+0000 7f8161064700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.058+0000 7f8161064700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f815c103600 0x7f815c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.058+0000 7f8161064700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c196610 con 0x7f815c100ce0 2024-09-17T02:01:16.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.058+0000 7f8161064700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c196750 con 0x7f815c103600 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41666/0 (socket says 172.21.15.31:41666) 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 -- 172.21.15.31:0/1809184269 learned_addr learned my addr 172.21.15.31:0/1809184269 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815a59c700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f815c103600 0x7f815c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 -- 172.21.15.31:0/1809184269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f815c103600 msgr2=0x7f815c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f815c103600 0x7f815c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 -- 172.21.15.31:0/1809184269 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0095f0 con 0x7f815c100ce0 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f815ad9d700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c195ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f814c00b5c0 tx=0x7f814c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c01d070 con 0x7f815c100ce0 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f814c00f460 con 0x7f815c100ce0 2024-09-17T02:01:16.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c19b1a0 con 0x7f815c100ce0 2024-09-17T02:01:16.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814c021640 con 0x7f815c100ce0 2024-09-17T02:01:16.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.059+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c19b690 con 0x7f815c100ce0 2024-09-17T02:01:16.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.061+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c18fc70 con 0x7f815c100ce0 2024-09-17T02:01:16.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.061+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f814c00fa60 con 0x7f815c100ce0 2024-09-17T02:01:16.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.062+0000 7f8143fff700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f814406e680 0x7f8144070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.062+0000 7f815a59c700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f814406e680 0x7f8144070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.062+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f814c08f9a0 con 0x7f815c100ce0 2024-09-17T02:01:16.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.062+0000 7f815a59c700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f814406e680 0x7f8144070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8150005950 tx=0x7f815000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:16.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.066+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f814c05c5a0 con 0x7f815c100ce0 2024-09-17T02:01:16.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.304+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f815c061190 con 0x7f814406e680 2024-09-17T02:01:16.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.305+0000 7f8143fff700 1 -- 172.21.15.31:0/1809184269 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f815c061190 con 0x7f814406e680 2024-09-17T02:01:16.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.307+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f814406e680 msgr2=0x7f8144070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.307+0000 7f8161064700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f814406e680 0x7f8144070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8150005950 tx=0x7f815000b410 comp rx=0 tx=0).stop 2024-09-17T02:01:16.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.307+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 msgr2=0x7f815c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.307+0000 7f8161064700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c195ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f814c00b5c0 tx=0x7f814c00bd70 comp rx=0 tx=0).stop 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 shutdown_connections 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f814406e680 0x7f8144070b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f815c100ce0 0x7f815c195ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 --2- 172.21.15.31:0/1809184269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f815c103600 0x7f815c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 >> 172.21.15.31:0/1809184269 conn(0x7f815c0fa700 msgr2=0x7f815c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 shutdown_connections 2024-09-17T02:01:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.308+0000 7f8161064700 1 -- 172.21.15.31:0/1809184269 wait complete. 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3223202344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d540ff150 msgr2=0x7f0d540ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3223202344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d540ff150 0x7f0d540ff560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400b0a0 tx=0x7f0d4400b3b0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3223202344 shutdown_connections 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3223202344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d54100350 0x7f0d541007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3223202344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d540ff150 0x7f0d540ff560 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3223202344 >> 172.21.15.31:0/3223202344 conn(0x7f0d540fa700 msgr2=0x7f0d540fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3223202344 shutdown_connections 2024-09-17T02:01:16.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.417+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3223202344 wait complete. 2024-09-17T02:01:16.416 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:16 smithi031 ceph-mon[77274]: pgmap v271: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d5aa9b700 1 Processor -- start 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d5aa9b700 1 -- start start 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d5aa9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d540ff150 0x7f0d54197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d5aa9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 0x7f0d54198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d5aa9b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54198880 con 0x7f0d54100350 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d5aa9b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5419d290 con 0x7f0d540ff150 2024-09-17T02:01:16.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d53fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 0x7f0d54198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d53fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 0x7f0d54198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41674/0 (socket says 172.21.15.31:41674) 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d53fff700 1 -- 172.21.15.31:0/3324779650 learned_addr learned my addr 172.21.15.31:0/3324779650 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d58837700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d540ff150 0x7f0d54197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d53fff700 1 -- 172.21.15.31:0/3324779650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d540ff150 msgr2=0x7f0d54197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d53fff700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d540ff150 0x7f0d54197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.418+0000 7f0d53fff700 1 -- 172.21.15.31:0/3324779650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009d00 con 0x7f0d54100350 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.419+0000 7f0d53fff700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 0x7f0d54198260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00d8d0 tx=0x7f0d3c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.419+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3c0098a0 con 0x7f0d54100350 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.419+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5419d490 con 0x7f0d54100350 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.419+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d3c010460 con 0x7f0d54100350 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.419+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3c00f5f0 con 0x7f0d54100350 2024-09-17T02:01:16.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.419+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5419d9b0 con 0x7f0d54100350 2024-09-17T02:01:16.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.420+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54107ca0 con 0x7f0d54100350 2024-09-17T02:01:16.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.421+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0d3c009a00 con 0x7f0d54100350 2024-09-17T02:01:16.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.421+0000 7f0d51ffb700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f0d4006e680 0x7f0d40070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.421+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f0d3c08e580 con 0x7f0d54100350 2024-09-17T02:01:16.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.421+0000 7f0d58837700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f0d4006e680 0x7f0d40070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.422+0000 7f0d58837700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f0d4006e680 0x7f0d40070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009fd0 tx=0x7f0d44000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:16.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.426+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0d3c057670 con 0x7f0d54100350 2024-09-17T02:01:16.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:16 smithi092 ceph-mon[64495]: pgmap v271: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:16.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.658+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d540694e0 con 0x7f0d4006e680 2024-09-17T02:01:16.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.668+0000 7f0d51ffb700 1 -- 172.21.15.31:0/3324779650 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0d540694e0 con 0x7f0d4006e680 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 starting - - - - 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (57s) 14s ago 17m 8321k - 19.1.1-330-gc2ddf972 ebb0615149de ca48e79b4a53 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (52s) 32s ago 16m 8224k - 19.1.1-330-gc2ddf972 ebb0615149de b1f07ae64ced 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (6m) 14s ago 17m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (6m) 32s ago 16m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (15m) 14s ago 17m 86.0M - 9.4.7 954c08fa6188 ff84e9a398b4 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (107s) 14s ago 11m 18.2M - 19.1.1-330-gc2ddf972 ebb0615149de 120ddd893c49 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (2m) 14s ago 11m 65.0M - 19.1.1-330-gc2ddf972 ebb0615149de b293c28b6b80 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (71s) 32s ago 11m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de c50cee007787 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (86s) 32s ago 11m 66.7M - 19.1.1-330-gc2ddf972 ebb0615149de bd12a6058776 2024-09-17T02:01:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (8m) 14s ago 18m 511M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (7m) 32s ago 16m 443M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (7m) 14s ago 19m 56.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (7m) 32s ago 16m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (38s) 14s ago 17m 7931k - 1.5.0 0da6a335fe13 994ab5e8eb32 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (35s) 32s ago 16m 5448k - 1.5.0 0da6a335fe13 ba8df1958320 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (6m) 14s ago 15m 194M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (5m) 14s ago 15m 118M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (4m) 14s ago 14m 139M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (4m) 32s ago 14m 138M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (3m) 32s ago 13m 98.2M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (3m) 32s ago 13m 96.8M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T02:01:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (19s) 14s ago 17m 53.5M - 2.43.0 a07b618ecd1d 2a4829e86aff 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f0d4006e680 msgr2=0x7f0d40070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f0d4006e680 0x7f0d40070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009fd0 tx=0x7f0d44000f40 comp rx=0 tx=0).stop 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 msgr2=0x7f0d54198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 0x7f0d54198260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00d8d0 tx=0x7f0d3c00dbe0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 shutdown_connections 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f0d4006e680 0x7f0d40070b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d540ff150 0x7f0d54197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 --2- 172.21.15.31:0/3324779650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54100350 0x7f0d54198260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 >> 172.21.15.31:0/3324779650 conn(0x7f0d540fa700 msgr2=0x7f0d54068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:16.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 shutdown_connections 2024-09-17T02:01:16.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.670+0000 7f0d5aa9b700 1 -- 172.21.15.31:0/3324779650 wait complete. 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/2077658965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 msgr2=0x7f8d04100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/2077658965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d04100840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009910 tx=0x7f8cf4009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/2077658965 shutdown_connections 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/2077658965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d04100840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/2077658965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d040ff130 0x7f8d040ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/2077658965 >> 172.21.15.31:0/2077658965 conn(0x7f8d040fa780 msgr2=0x7f8d040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/2077658965 shutdown_connections 2024-09-17T02:01:16.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.780+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/2077658965 wait complete. 2024-09-17T02:01:16.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0bdc0700 1 Processor -- start 2024-09-17T02:01:16.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0bdc0700 1 -- start start 2024-09-17T02:01:16.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0bdc0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d040ff130 0x7f8d04103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0bdc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d041017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0bdc0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04101cf0 con 0x7f8d041003d0 2024-09-17T02:01:16.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0bdc0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04101e30 con 0x7f8d040ff130 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0935b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d041017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0935b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d041017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41690/0 (socket says 172.21.15.31:41690) 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0935b700 1 -- 172.21.15.31:0/320004323 learned_addr learned my addr 172.21.15.31:0/320004323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d09b5c700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d040ff130 0x7f8d04103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0935b700 1 -- 172.21.15.31:0/320004323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d040ff130 msgr2=0x7f8d04103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.781+0000 7f8d0935b700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d040ff130 0x7f8d04103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.782+0000 7f8d0935b700 1 -- 172.21.15.31:0/320004323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40095f0 con 0x7f8d041003d0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.782+0000 7f8d0935b700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d041017b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4000c00 tx=0x7f8cf400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.782+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cf401d070 con 0x7f8d041003d0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.782+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8cf4005dc0 con 0x7f8d041003d0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.782+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cf40226a0 con 0x7f8d041003d0 2024-09-17T02:01:16.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.783+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d041020b0 con 0x7f8d041003d0 2024-09-17T02:01:16.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.783+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d04102550 con 0x7f8d041003d0 2024-09-17T02:01:16.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.784+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d04107c10 con 0x7f8d041003d0 2024-09-17T02:01:16.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.784+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8cf40038f0 con 0x7f8d041003d0 2024-09-17T02:01:16.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.785+0000 7f8cfaffd700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8cf006e6d0 0x7f8cf0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:16.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.785+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f8cf408fd00 con 0x7f8d041003d0 2024-09-17T02:01:16.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.785+0000 7f8d09b5c700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8cf006e6d0 0x7f8cf0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:16.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.786+0000 7f8d09b5c700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8cf006e6d0 0x7f8cf0070b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009c60 tx=0x7f8d00009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:16.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:16.790+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8cf405c860 con 0x7f8d041003d0 2024-09-17T02:01:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.140+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d0419def0 con 0x7f8d041003d0 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.141+0000 7f8cfaffd700 1 -- 172.21.15.31:0/320004323 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f8cf4003680 con 0x7f8d041003d0 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T02:01:17.139 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T02:01:17.140 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8cf006e6d0 msgr2=0x7f8cf0070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8cf006e6d0 0x7f8cf0070b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009c60 tx=0x7f8d00009260 comp rx=0 tx=0).stop 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 msgr2=0x7f8d041017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d041017b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4000c00 tx=0x7f8cf400f690 comp rx=0 tx=0).stop 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 shutdown_connections 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8cf006e6d0 0x7f8cf0070b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d040ff130 0x7f8d04103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 --2- 172.21.15.31:0/320004323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d041003d0 0x7f8d041017b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 >> 172.21.15.31:0/320004323 conn(0x7f8d040fa780 msgr2=0x7f8d04068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 shutdown_connections 2024-09-17T02:01:17.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.143+0000 7f8d0bdc0700 1 -- 172.21.15.31:0/320004323 wait complete. 2024-09-17T02:01:17.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.262+0000 7fb425ea4700 1 -- 172.21.15.31:0/2852049011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420103350 msgr2=0x7fb420105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.262+0000 7fb425ea4700 1 --2- 172.21.15.31:0/2852049011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420103350 0x7fb420105790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb414009910 tx=0x7fb414009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.262+0000 7fb425ea4700 1 -- 172.21.15.31:0/2852049011 shutdown_connections 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.262+0000 7fb425ea4700 1 --2- 172.21.15.31:0/2852049011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420103350 0x7fb420105790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.262+0000 7fb425ea4700 1 --2- 172.21.15.31:0/2852049011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb420069230 0x7fb420102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.262+0000 7fb425ea4700 1 -- 172.21.15.31:0/2852049011 >> 172.21.15.31:0/2852049011 conn(0x7fb4200fa780 msgr2=0x7fb4200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.263+0000 7fb425ea4700 1 -- 172.21.15.31:0/2852049011 shutdown_connections 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.263+0000 7fb425ea4700 1 -- 172.21.15.31:0/2852049011 wait complete. 2024-09-17T02:01:17.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.263+0000 7fb425ea4700 1 Processor -- start 2024-09-17T02:01:17.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb425ea4700 1 -- start start 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb425ea4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 0x7fb420100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb425ea4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb420103350 0x7fb4200fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb425ea4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200ff2f0 con 0x7fb420069230 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb425ea4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200ff430 con 0x7fb420103350 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 0x7fb420100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 0x7fb420100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41708/0 (socket says 172.21.15.31:41708) 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 -- 172.21.15.31:0/1156636913 learned_addr learned my addr 172.21.15.31:0/1156636913 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41effd700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb420103350 0x7fb4200fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 -- 172.21.15.31:0/1156636913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb420103350 msgr2=0x7fb4200fedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb420103350 0x7fb4200fedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 -- 172.21.15.31:0/1156636913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140095f0 con 0x7fb420069230 2024-09-17T02:01:17.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.264+0000 7fb41f7fe700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 0x7fb420100760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb41000e8c0 tx=0x7fb41000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:17.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.265+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4100041f0 con 0x7fb420069230 2024-09-17T02:01:17.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.265+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb41000cc90 con 0x7fb420069230 2024-09-17T02:01:17.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.265+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb410003d60 con 0x7fb420069230 2024-09-17T02:01:17.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.265+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4200ff710 con 0x7fb420069230 2024-09-17T02:01:17.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.265+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42019db30 con 0x7fb420069230 2024-09-17T02:01:17.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.266+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42018fbf0 con 0x7fb420069230 2024-09-17T02:01:17.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.267+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb41000c7e0 con 0x7fb420069230 2024-09-17T02:01:17.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.267+0000 7fb41cff9700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb40806e680 0x7fb408070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:17.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.267+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb410014070 con 0x7fb420069230 2024-09-17T02:01:17.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.267+0000 7fb41effd700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb40806e680 0x7fb408070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:17.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.268+0000 7fb41effd700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb40806e680 0x7fb408070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb414009fd0 tx=0x7fb414005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:17.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.273+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb41005b6a0 con 0x7fb420069230 2024-09-17T02:01:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:17 smithi092 ceph-mon[64495]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:17.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:17 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/320004323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:17 smithi031 ceph-mon[77274]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:17 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/320004323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:17.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.540+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb420061960 con 0x7fb420069230 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.540+0000 7fb41cff9700 1 -- 172.21.15.31:0/1156636913 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+2000 (secure 0 0 0) 0x7fb41005b230 con 0x7fb420069230 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:e44 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T02:00:14:511713+0000 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T02:01:17.538 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 44 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T02:00:14.511701+0000 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T02:01:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 92 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=34416,1=34448} 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T02:01:17.540 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{0:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.92:6824/186400038,v1:172.21.15.92:6825/186400038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:34448} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{1:44377} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/3092379292,v1:172.21.15.92:6827/3092379292] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:01:17.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:01:17.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb40806e680 msgr2=0x7fb408070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb40806e680 0x7fb408070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb414009fd0 tx=0x7fb414005fd0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 msgr2=0x7fb420100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 0x7fb420100760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb41000e8c0 tx=0x7fb41000ebd0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 shutdown_connections 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb40806e680 0x7fb408070b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb420069230 0x7fb420100760 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 --2- 172.21.15.31:0/1156636913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb420103350 0x7fb4200fedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.542+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 >> 172.21.15.31:0/1156636913 conn(0x7fb4200fa780 msgr2=0x7fb4200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.543+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 shutdown_connections 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.543+0000 7fb425ea4700 1 -- 172.21.15.31:0/1156636913 wait complete. 2024-09-17T02:01:17.543 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 44 2024-09-17T02:01:17.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.676+0000 7fd02219e700 1 -- 172.21.15.31:0/3383194540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 msgr2=0x7fd01c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.676+0000 7fd02219e700 1 --2- 172.21.15.31:0/3383194540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c101890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd010009910 tx=0x7fd010009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:17.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.676+0000 7fd02219e700 1 -- 172.21.15.31:0/3383194540 shutdown_connections 2024-09-17T02:01:17.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.676+0000 7fd02219e700 1 --2- 172.21.15.31:0/3383194540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c101890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.676+0000 7fd02219e700 1 --2- 172.21.15.31:0/3383194540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd01c100240 0x7fd01c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.676+0000 7fd02219e700 1 -- 172.21.15.31:0/3383194540 >> 172.21.15.31:0/3383194540 conn(0x7fd01c0fb7f0 msgr2=0x7fd01c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:17.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.677+0000 7fd02219e700 1 -- 172.21.15.31:0/3383194540 shutdown_connections 2024-09-17T02:01:17.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.677+0000 7fd02219e700 1 -- 172.21.15.31:0/3383194540 wait complete. 2024-09-17T02:01:17.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.677+0000 7fd02219e700 1 Processor -- start 2024-09-17T02:01:17.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd02219e700 1 -- start start 2024-09-17T02:01:17.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd02219e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd01c100240 0x7fd01c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd02219e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd02219e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1965f0 con 0x7fd01c101440 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd02219e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c196730 con 0x7fd01c100240 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41732/0 (socket says 172.21.15.31:41732) 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 -- 172.21.15.31:0/763413418 learned_addr learned my addr 172.21.15.31:0/763413418 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01b7fe700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd01c100240 0x7fd01c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 -- 172.21.15.31:0/763413418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd01c100240 msgr2=0x7fd01c195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd01c100240 0x7fd01c195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 -- 172.21.15.31:0/763413418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0100095f0 con 0x7fd01c101440 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.678+0000 7fd01affd700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c195fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd010005b40 tx=0x7fd01000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.679+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01001d070 con 0x7fd01c101440 2024-09-17T02:01:17.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.679+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd01000f460 con 0x7fd01c101440 2024-09-17T02:01:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.679+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c19b180 con 0x7fd01c101440 2024-09-17T02:01:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.679+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd010021620 con 0x7fd01c101440 2024-09-17T02:01:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.679+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c19b670 con 0x7fd01c101440 2024-09-17T02:01:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.680+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c108d90 con 0x7fd01c101440 2024-09-17T02:01:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.680+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd01000fa40 con 0x7fd01c101440 2024-09-17T02:01:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.681+0000 7fd018ff9700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd00406e680 0x7fd004070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.681+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd01008f9f0 con 0x7fd01c101440 2024-09-17T02:01:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.681+0000 7fd01b7fe700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd00406e680 0x7fd004070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.681+0000 7fd01b7fe700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd00406e680 0x7fd004070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd01c1012a0 tx=0x7fd00c007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:17.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.685+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd010091e60 con 0x7fd01c101440 2024-09-17T02:01:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.922+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd01c105d90 con 0x7fd00406e680 2024-09-17T02:01:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.924+0000 7fd018ff9700 1 -- 172.21.15.31:0/763413418 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fd01c105d90 con 0x7fd00406e680 2024-09-17T02:01:17.921 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:01:17.921 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T02:01:17.921 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": true, 2024-09-17T02:01:17.921 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T02:01:17.921 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [ 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "osd", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph-exporter", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "mds", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "mon" 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T02:01:17.922 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd00406e680 msgr2=0x7fd004070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd00406e680 0x7fd004070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd01c1012a0 tx=0x7fd00c007400 comp rx=0 tx=0).stop 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 msgr2=0x7fd01c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c195fd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd010005b40 tx=0x7fd01000bd70 comp rx=0 tx=0).stop 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 shutdown_connections 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd00406e680 0x7fd004070b30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd01c100240 0x7fd01c195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 --2- 172.21.15.31:0/763413418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd01c101440 0x7fd01c195fd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 >> 172.21.15.31:0/763413418 conn(0x7fd01c0fb7f0 msgr2=0x7fd01c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 shutdown_connections 2024-09-17T02:01:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:17.926+0000 7fd02219e700 1 -- 172.21.15.31:0/763413418 wait complete. 2024-09-17T02:01:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.040+0000 7f236f5d4700 1 -- 172.21.15.31:0/1244374747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 msgr2=0x7f23681018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.040+0000 7f236f5d4700 1 --2- 172.21.15.31:0/1244374747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f23681018a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2358009910 tx=0x7f2358009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.040+0000 7f236f5d4700 1 -- 172.21.15.31:0/1244374747 shutdown_connections 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.040+0000 7f236f5d4700 1 --2- 172.21.15.31:0/1244374747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f23681018a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.040+0000 7f236f5d4700 1 --2- 172.21.15.31:0/1244374747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2368100250 0x7f2368100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.040+0000 7f236f5d4700 1 -- 172.21.15.31:0/1244374747 >> 172.21.15.31:0/1244374747 conn(0x7f23680fb7e0 msgr2=0x7f23680fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.041+0000 7f236f5d4700 1 -- 172.21.15.31:0/1244374747 shutdown_connections 2024-09-17T02:01:18.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.041+0000 7f236f5d4700 1 -- 172.21.15.31:0/1244374747 wait complete. 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.041+0000 7f236f5d4700 1 Processor -- start 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.041+0000 7f236f5d4700 1 -- start start 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236f5d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2368100250 0x7f2368074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236f5d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f2368073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236f5d4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368073680 con 0x7f2368101450 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236f5d4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680737c0 con 0x7f2368100250 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236cb6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f2368073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236cb6f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f2368073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41748/0 (socket says 172.21.15.31:41748) 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236cb6f700 1 -- 172.21.15.31:0/2324102873 learned_addr learned my addr 172.21.15.31:0/2324102873 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236d370700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2368100250 0x7f2368074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236cb6f700 1 -- 172.21.15.31:0/2324102873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2368100250 msgr2=0x7f2368074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236cb6f700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2368100250 0x7f2368074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.042+0000 7f236cb6f700 1 -- 172.21.15.31:0/2324102873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580095f0 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.043+0000 7f236cb6f700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f2368073140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2358000c00 tx=0x7f235800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.043+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f235801d070 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.043+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2358005dc0 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.043+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2368073a40 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.043+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23580226a0 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.043+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2368073f30 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.044+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2368108da0 con 0x7f2368101450 2024-09-17T02:01:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.044+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2358003680 con 0x7f2368101450 2024-09-17T02:01:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.045+0000 7f235e7fc700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f235406e680 0x7f2354070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.045+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f235808fcd0 con 0x7f2368101450 2024-09-17T02:01:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.045+0000 7f236d370700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f235406e680 0x7f2354070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.046+0000 7f236d370700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f235406e680 0x7f2354070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f23681012b0 tx=0x7f2364009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:18.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.050+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f235805c8d0 con 0x7f2368101450 2024-09-17T02:01:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.389+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2368108f60 con 0x7f2368101450 2024-09-17T02:01:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.390+0000 7f235e7fc700 1 -- 172.21.15.31:0/2324102873 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2358003930 con 0x7f2368101450 2024-09-17T02:01:18.388 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T02:01:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f235406e680 msgr2=0x7f2354070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f235406e680 0x7f2354070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f23681012b0 tx=0x7f2364009260 comp rx=0 tx=0).stop 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 msgr2=0x7f2368073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f2368073140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2358000c00 tx=0x7f235800f740 comp rx=0 tx=0).stop 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 shutdown_connections 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f235406e680 0x7f2354070b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2368100250 0x7f2368074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 --2- 172.21.15.31:0/2324102873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2368101450 0x7f2368073140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 >> 172.21.15.31:0/2324102873 conn(0x7f23680fb7e0 msgr2=0x7f2368104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 shutdown_connections 2024-09-17T02:01:18.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:18.392+0000 7f236f5d4700 1 -- 172.21.15.31:0/2324102873 wait complete. 2024-09-17T02:01:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:18 smithi092 ceph-mon[64495]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:18 smithi092 ceph-mon[64495]: pgmap v272: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:18 smithi092 ceph-mon[64495]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:18 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1156636913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:01:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:18 smithi031 ceph-mon[77274]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:18 smithi031 ceph-mon[77274]: pgmap v272: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:18 smithi031 ceph-mon[77274]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:18 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1156636913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:01:19.483 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:19 smithi031 ceph-mon[77274]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:19.483 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.483 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.483 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:19 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2324102873' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:01:19.483 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.484 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:19 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:19 smithi092 ceph-mon[64495]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:19 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2324102873' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:01:19.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:19.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:19 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:20 smithi092 ceph-mon[64495]: pgmap v273: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:20 smithi031 ceph-mon[77274]: pgmap v273: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:21.508 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:22 smithi031 ceph-mon[77274]: pgmap v274: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:22.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:22 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:22.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:22 smithi092 ceph-mon[64495]: pgmap v274: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:22.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:22.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:22.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:22.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:22.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:22 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:23.439 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T02:01:23.439 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:23.440 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.440 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.440 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.440 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.440 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.441 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.441 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.441 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.441 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.441 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.442 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:23 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T02:01:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:23.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:23 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:24.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:24 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T02:01:24.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:24 smithi031 ceph-mon[77274]: pgmap v275: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:24 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T02:01:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:24 smithi092 ceph-mon[64495]: pgmap v275: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:25.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:25 smithi031 ceph-mon[77274]: Upgrade: Updating grafana.smithi031 2024-09-17T02:01:25.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:25 smithi031 ceph-mon[77274]: Deploying daemon grafana.smithi031 on smithi031 2024-09-17T02:01:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:25 smithi092 ceph-mon[64495]: Upgrade: Updating grafana.smithi031 2024-09-17T02:01:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:25 smithi092 ceph-mon[64495]: Deploying daemon grafana.smithi031 on smithi031 2024-09-17T02:01:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:26 smithi031 ceph-mon[77274]: pgmap v276: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:26 smithi092 ceph-mon[64495]: pgmap v276: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:28.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:28 smithi092 ceph-mon[64495]: pgmap v277: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:28.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:28 smithi031 ceph-mon[77274]: pgmap v277: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:30.585 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:30 smithi031 ceph-mon[77274]: pgmap v278: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:30 smithi092 ceph-mon[64495]: pgmap v278: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:32.599 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:32 smithi031 ceph-mon[77274]: pgmap v279: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:32 smithi092 ceph-mon[64495]: pgmap v279: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:33.464 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:33 smithi031 ceph-mon[77274]: pgmap v280: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:33.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:33 smithi092 ceph-mon[64495]: pgmap v280: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:36.084 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:35 smithi092 ceph-mon[64495]: pgmap v281: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:36.084 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:36.084 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:36.084 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:36.084 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:35 smithi031 ceph-mon[77274]: pgmap v281: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:36.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:38.134 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:37 smithi031 ceph-mon[77274]: pgmap v282: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:38.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:37 smithi092 ceph-mon[64495]: pgmap v282: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:40 smithi092 ceph-mon[64495]: pgmap v283: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:40 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:40 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:40 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.490 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:40 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.501 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:40 smithi031 ceph-mon[77274]: pgmap v283: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:40.501 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:40 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.501 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:40 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.501 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:40 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:40.502 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:40 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:42 smithi092 ceph-mon[64495]: pgmap v284: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:42 smithi031 ceph-mon[77274]: pgmap v284: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: pgmap v285: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T02:01:44.240 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.242 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: Upgrade: Finalizing container_image settings 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T02:01:44.243 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T02:01:44.244 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: Upgrade: Complete! 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T02:01:44.245 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:44.246 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:43 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: pgmap v285: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:44.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.265 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.266 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: Upgrade: Finalizing container_image settings 2024-09-17T02:01:44.267 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T02:01:44.268 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T02:01:44.269 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: Upgrade: Complete! 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T02:01:44.270 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:01:44.271 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:43 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:46.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:45 smithi092 ceph-mon[64495]: pgmap v286: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:46.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:46.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:45 smithi031 ceph-mon[77274]: pgmap v286: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:46.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:01:48.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:47 smithi092 ceph-mon[64495]: pgmap v287: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:48.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:47 smithi031 ceph-mon[77274]: pgmap v287: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 -- 172.21.15.31:0/1793172684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac1003f0 msgr2=0x7fcaac100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/1793172684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac1003f0 0x7fcaac100860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009910 tx=0x7fcaa0009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 -- 172.21.15.31:0/1793172684 shutdown_connections 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/1793172684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac1003f0 0x7fcaac100860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/1793172684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac0ff150 0x7fcaac0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 -- 172.21.15.31:0/1793172684 >> 172.21.15.31:0/1793172684 conn(0x7fcaac0fa7a0 msgr2=0x7fcaac0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 -- 172.21.15.31:0/1793172684 shutdown_connections 2024-09-17T02:01:48.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.516+0000 7fcab0e3c700 1 -- 172.21.15.31:0/1793172684 wait complete. 2024-09-17T02:01:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcab0e3c700 1 Processor -- start 2024-09-17T02:01:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcab0e3c700 1 -- start start 2024-09-17T02:01:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcab0e3c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 0x7fcaac069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcab0e3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac1003f0 0x7fcaac19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcab0e3c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac19b1d0 con 0x7fcaac0ff150 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcab0e3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac19b310 con 0x7fcaac1003f0 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcaaa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 0x7fcaac069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcaaa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 0x7fcaac069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51538/0 (socket says 172.21.15.31:51538) 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.517+0000 7fcaaa59c700 1 -- 172.21.15.31:0/2959955183 learned_addr learned my addr 172.21.15.31:0/2959955183 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcaa9d9b700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac1003f0 0x7fcaac19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcaaa59c700 1 -- 172.21.15.31:0/2959955183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac1003f0 msgr2=0x7fcaac19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcaaa59c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac1003f0 0x7fcaac19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcaaa59c700 1 -- 172.21.15.31:0/2959955183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00095f0 con 0x7fcaac0ff150 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcaa9d9b700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac1003f0 0x7fcaac19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:01:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcaaa59c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 0x7fcaac069930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b4b0 tx=0x7fca9c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c011800 con 0x7fcaac0ff150 2024-09-17T02:01:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac19b5f0 con 0x7fcaac0ff150 2024-09-17T02:01:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca9c011e20 con 0x7fcaac0ff150 2024-09-17T02:01:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9c00f2e0 con 0x7fcaac0ff150 2024-09-17T02:01:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.518+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac19bb40 con 0x7fcaac0ff150 2024-09-17T02:01:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.519+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac068ab0 con 0x7fcaac0ff150 2024-09-17T02:01:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.520+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fca9c010380 con 0x7fcaac0ff150 2024-09-17T02:01:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.520+0000 7fca9b7fe700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca9406e680 0x7fca94070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.520+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fca9c08e320 con 0x7fcaac0ff150 2024-09-17T02:01:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.520+0000 7fcaa9d9b700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca9406e680 0x7fca94070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.521+0000 7fcaa9d9b700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca9406e680 0x7fca94070b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcaac069eb0 tx=0x7fcaa0005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:48.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.525+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca9c05af20 con 0x7fcaac0ff150 2024-09-17T02:01:48.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.764+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaac104e60 con 0x7fca9406e680 2024-09-17T02:01:48.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.765+0000 7fca9b7fe700 1 -- 172.21.15.31:0/2959955183 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fcaac104e60 con 0x7fca9406e680 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca9406e680 msgr2=0x7fca94070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca9406e680 0x7fca94070b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcaac069eb0 tx=0x7fcaa0005ab0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 msgr2=0x7fcaac069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 0x7fcaac069930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00b4b0 tx=0x7fca9c00b870 comp rx=0 tx=0).stop 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 shutdown_connections 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fca9406e680 0x7fca94070b30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaac0ff150 0x7fcaac069930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 --2- 172.21.15.31:0/2959955183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcaac1003f0 0x7fcaac19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 >> 172.21.15.31:0/2959955183 conn(0x7fcaac0fa7a0 msgr2=0x7fcaac103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:48.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 shutdown_connections 2024-09-17T02:01:48.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:48.768+0000 7fcab0e3c700 1 -- 172.21.15.31:0/2959955183 wait complete. 2024-09-17T02:01:49.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T02:01:49.644 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:01:50.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:49 smithi031 ceph-mon[77274]: pgmap v288: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:50.037 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:49 smithi031 ceph-mon[77274]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:49 smithi092 ceph-mon[64495]: pgmap v288: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:50.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:49 smithi092 ceph-mon[64495]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:51.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:51.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 -- 172.21.15.31:0/4207062796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101300 msgr2=0x7f4aa41016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/4207062796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101300 0x7f4aa41016d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009910 tx=0x7f4a98009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 -- 172.21.15.31:0/4207062796 shutdown_connections 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/4207062796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aa4101c10 0x7f4aa410a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/4207062796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101300 0x7f4aa41016d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 -- 172.21.15.31:0/4207062796 >> 172.21.15.31:0/4207062796 conn(0x7f4aa40fac90 msgr2=0x7f4aa40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 -- 172.21.15.31:0/4207062796 shutdown_connections 2024-09-17T02:01:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.543+0000 7f4aab0b5700 1 -- 172.21.15.31:0/4207062796 wait complete. 2024-09-17T02:01:51.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aab0b5700 1 Processor -- start 2024-09-17T02:01:51.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aab0b5700 1 -- start start 2024-09-17T02:01:51.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aab0b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aa4101300 0x7f4aa4195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:51.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aab0b5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 0x7f4aa4196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aab0b5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4196af0 con 0x7f4aa4101c10 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aab0b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa419a880 con 0x7f4aa4101300 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aa3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 0x7f4aa4196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aa3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 0x7f4aa4196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51550/0 (socket says 172.21.15.31:51550) 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aa3fff700 1 -- 172.21.15.31:0/332127257 learned_addr learned my addr 172.21.15.31:0/332127257 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.544+0000 7f4aa8e51700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aa4101300 0x7f4aa4195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa3fff700 1 -- 172.21.15.31:0/332127257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aa4101300 msgr2=0x7f4aa4195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa3fff700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aa4101300 0x7f4aa4195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa3fff700 1 -- 172.21.15.31:0/332127257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980095f0 con 0x7f4aa4101c10 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa3fff700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 0x7f4aa4196410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000d8d0 tx=0x7f4a9000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a900098a0 con 0x7f4aa4101c10 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a90010460 con 0x7f4aa4101c10 2024-09-17T02:01:51.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa419ab60 con 0x7f4aa4101c10 2024-09-17T02:01:51.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9000f5f0 con 0x7f4aa4101c10 2024-09-17T02:01:51.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.545+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa419b0b0 con 0x7f4aa4101c10 2024-09-17T02:01:51.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.546+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa41079e0 con 0x7f4aa4101c10 2024-09-17T02:01:51.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.547+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4a90009a00 con 0x7f4aa4101c10 2024-09-17T02:01:51.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.547+0000 7f4aa1ffb700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4a9406e680 0x7f4a94070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:51.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.548+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f4a9008e620 con 0x7f4aa4101c10 2024-09-17T02:01:51.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.548+0000 7f4aa8e51700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4a9406e680 0x7f4a94070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:51.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.548+0000 7f4aa8e51700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4a9406e680 0x7f4a94070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a98006010 tx=0x7f4a98005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:51.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.552+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4a900576f0 con 0x7f4aa4101c10 2024-09-17T02:01:51.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.778+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa419b340 con 0x7f4a9406e680 2024-09-17T02:01:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.787+0000 7f4aa1ffb700 1 -- 172.21.15.31:0/332127257 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4aa419b340 con 0x7f4a9406e680 2024-09-17T02:01:51.786 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T02:01:51.786 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (38s) 12s ago 17m 14.8M - 0.25.0 c8568f914cd2 3508837d17f4 2024-09-17T02:01:51.786 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (92s) 12s ago 18m 8544k - 19.1.1-330-gc2ddf972 ebb0615149de ca48e79b4a53 2024-09-17T02:01:51.786 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (87s) 67s ago 17m 8224k - 19.1.1-330-gc2ddf972 ebb0615149de b1f07ae64ced 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (7m) 12s ago 18m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (7m) 67s ago 17m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (17s) 12s ago 17m 45.3M - 9.4.12 2bacad6d85d8 3ad861fda685 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (2m) 12s ago 12m 18.9M - 19.1.1-330-gc2ddf972 ebb0615149de 120ddd893c49 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (2m) 12s ago 12m 65.0M - 19.1.1-330-gc2ddf972 ebb0615149de b293c28b6b80 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (106s) 67s ago 12m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de c50cee007787 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (2m) 67s ago 12m 66.7M - 19.1.1-330-gc2ddf972 ebb0615149de bd12a6058776 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (9m) 12s ago 19m 518M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (8m) 67s ago 17m 443M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (8m) 12s ago 19m 58.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T02:01:51.787 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (7m) 67s ago 17m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (73s) 12s ago 18m 8032k - 1.5.0 0da6a335fe13 994ab5e8eb32 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (70s) 67s ago 17m 5448k - 1.5.0 0da6a335fe13 ba8df1958320 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (6m) 12s ago 16m 194M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (6m) 12s ago 15m 118M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (5m) 12s ago 15m 140M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (4m) 67s ago 14m 138M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (4m) 67s ago 14m 98.2M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (3m) 67s ago 14m 96.8M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T02:01:51.788 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (54s) 12s ago 17m 65.8M - 2.43.0 a07b618ecd1d 2a4829e86aff 2024-09-17T02:01:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4a9406e680 msgr2=0x7f4a94070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4a9406e680 0x7f4a94070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a98006010 tx=0x7f4a98005a90 comp rx=0 tx=0).stop 2024-09-17T02:01:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 msgr2=0x7f4aa4196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 0x7f4aa4196410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000d8d0 tx=0x7f4a9000dbe0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 shutdown_connections 2024-09-17T02:01:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4a9406e680 0x7f4a94070b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4aa4101300 0x7f4aa4195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 --2- 172.21.15.31:0/332127257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa4101c10 0x7f4aa4196410 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 >> 172.21.15.31:0/332127257 conn(0x7f4aa40fac90 msgr2=0x7f4aa4104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 shutdown_connections 2024-09-17T02:01:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:51.790+0000 7f4aab0b5700 1 -- 172.21.15.31:0/332127257 wait complete. 2024-09-17T02:01:52.159 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:51 smithi031 ceph-mon[77274]: pgmap v289: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:52.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:51 smithi092 ceph-mon[64495]: pgmap v289: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:52.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade status' 2024-09-17T02:01:52.707 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:01:53.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:52 smithi031 ceph-mon[77274]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:53.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:52 smithi092 ceph-mon[64495]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:54.190 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:53 smithi031 ceph-mon[77274]: pgmap v290: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:54.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 -- 172.21.15.31:0/1504683238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f8104130 msgr2=0x7f40f8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/1504683238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f8104130 0x7f40f8104500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009910 tx=0x7f40f4009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 -- 172.21.15.31:0/1504683238 shutdown_connections 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/1504683238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/1504683238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f8104130 0x7f40f8104500 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 -- 172.21.15.31:0/1504683238 >> 172.21.15.31:0/1504683238 conn(0x7f40f8075130 msgr2=0x7f40f8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 -- 172.21.15.31:0/1504683238 shutdown_connections 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.463+0000 7f40ff9d0700 1 -- 172.21.15.31:0/1504683238 wait complete. 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40ff9d0700 1 Processor -- start 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40ff9d0700 1 -- start start 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40ff9d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:54.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40ff9d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f8104130 0x7f40f8101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:54.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40ff9d0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81018b0 con 0x7f40f80ffbd0 2024-09-17T02:01:54.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40ff9d0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81019f0 con 0x7f40f8104130 2024-09-17T02:01:54.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40fd76c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40fd76c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40346/0 (socket says 172.21.15.31:40346) 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.464+0000 7f40fd76c700 1 -- 172.21.15.31:0/632224872 learned_addr learned my addr 172.21.15.31:0/632224872 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40fcf6b700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f8104130 0x7f40f8101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40fd76c700 1 -- 172.21.15.31:0/632224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f8104130 msgr2=0x7f40f8101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40fd76c700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f8104130 0x7f40f8101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40fd76c700 1 -- 172.21.15.31:0/632224872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40095f0 con 0x7f40f80ffbd0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40fd76c700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100e30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40f400bd70 tx=0x7f40f400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f401d070 con 0x7f40f80ffbd0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40f400f460 con 0x7f40f80ffbd0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f8101c70 con 0x7f40f80ffbd0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f4017630 con 0x7f40f80ffbd0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.465+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f81a2400 con 0x7f40f80ffbd0 2024-09-17T02:01:54.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.466+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f81086a0 con 0x7f40f80ffbd0 2024-09-17T02:01:54.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.467+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f40f400f5d0 con 0x7f40f80ffbd0 2024-09-17T02:01:54.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.467+0000 7f40ee7fc700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f40e406e680 0x7f40e4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:54.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.467+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f40f408fd80 con 0x7f40f80ffbd0 2024-09-17T02:01:54.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.467+0000 7f40fcf6b700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f40e406e680 0x7f40e4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:54.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.468+0000 7f40fcf6b700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f40e406e680 0x7f40e4070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f40e8005fd0 tx=0x7f40e800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:54.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.472+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f40f4058e50 con 0x7f40f80ffbd0 2024-09-17T02:01:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:53 smithi092 ceph-mon[64495]: pgmap v290: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:54.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.708+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40f8061190 con 0x7f40e406e680 2024-09-17T02:01:54.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.709+0000 7f40ee7fc700 1 -- 172.21.15.31:0/632224872 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f40f8061190 con 0x7f40e406e680 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "target_image": null, 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "in_progress": false, 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "which": "", 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "services_complete": [], 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "progress": null, 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "message": "", 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "is_paused": false 2024-09-17T02:01:54.708 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:01:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f40e406e680 msgr2=0x7f40e4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:54.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f40e406e680 0x7f40e4070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f40e8005fd0 tx=0x7f40e800a560 comp rx=0 tx=0).stop 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 msgr2=0x7f40f8100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100e30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40f400bd70 tx=0x7f40f400be50 comp rx=0 tx=0).stop 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 shutdown_connections 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f40e406e680 0x7f40e4070b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40f80ffbd0 0x7f40f8100e30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 --2- 172.21.15.31:0/632224872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40f8104130 0x7f40f8101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 >> 172.21.15.31:0/632224872 conn(0x7f40f8075130 msgr2=0x7f40f80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 shutdown_connections 2024-09-17T02:01:54.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:54.712+0000 7f40ff9d0700 1 -- 172.21.15.31:0/632224872 wait complete. 2024-09-17T02:01:55.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph health detail' 2024-09-17T02:01:55.546 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:01:56.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:56 smithi031 ceph-mon[77274]: pgmap v291: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:56.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:56 smithi031 ceph-mon[77274]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:56.462 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:56 smithi092 ceph-mon[64495]: pgmap v291: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:01:56.462 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:56 smithi092 ceph-mon[64495]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.227+0000 7f7ecc9be700 1 -- 172.21.15.31:0/3651476233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 msgr2=0x7f7ec80ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.227+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/3651476233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec80ff790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009910 tx=0x7f7eb8009c20 comp rx=0 tx=0).stop 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.228+0000 7f7ecc9be700 1 -- 172.21.15.31:0/3651476233 shutdown_connections 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.228+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/3651476233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec80ffd60 0x7f7ec8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.228+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/3651476233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec80ff790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.228+0000 7f7ecc9be700 1 -- 172.21.15.31:0/3651476233 >> 172.21.15.31:0/3651476233 conn(0x7f7ec80fac80 msgr2=0x7f7ec80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:57.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.228+0000 7f7ecc9be700 1 -- 172.21.15.31:0/3651476233 shutdown_connections 2024-09-17T02:01:57.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.228+0000 7f7ecc9be700 1 -- 172.21.15.31:0/3651476233 wait complete. 2024-09-17T02:01:57.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ecc9be700 1 Processor -- start 2024-09-17T02:01:57.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ecc9be700 1 -- start start 2024-09-17T02:01:57.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ecc9be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec8195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ecc9be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec80ffd60 0x7f7ec81964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ecc9be700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8196b80 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ecc9be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec819a910 con 0x7f7ec80ffd60 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec8195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec8195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40358/0 (socket says 172.21.15.31:40358) 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec659c700 1 -- 172.21.15.31:0/26329398 learned_addr learned my addr 172.21.15.31:0/26329398 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec5d9b700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec80ffd60 0x7f7ec81964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec659c700 1 -- 172.21.15.31:0/26329398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec80ffd60 msgr2=0x7f7ec81964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec659c700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec80ffd60 0x7f7ec81964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.229+0000 7f7ec659c700 1 -- 172.21.15.31:0/26329398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80095f0 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.230+0000 7f7ec659c700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec8195f60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8006010 tx=0x7f7eb800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:57.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.230+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb801d070 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.230+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec819ab90 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.230+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7eb800f460 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.230+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb8017630 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.230+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec819b080 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.231+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec81086e0 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.232+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7eb800f5d0 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.232+0000 7f7ebf7fe700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7eb406e680 0x7f7eb4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:01:57.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.232+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f7eb808fb80 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.232+0000 7f7ec5d9b700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7eb406e680 0x7f7eb4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:01:57.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.233+0000 7f7ec5d9b700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7eb406e680 0x7f7eb4070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8197580 tx=0x7f7eb0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:01:57.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.237+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7eb8058cd0 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.542+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ec81080c0 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.542+0000 7f7ebf7fe700 1 -- 172.21.15.31:0/26329398 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7eb805c390 con 0x7f7ec80ff3c0 2024-09-17T02:01:57.541 INFO:teuthology.orchestra.run.smithi031.stdout:HEALTH_OK 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7eb406e680 msgr2=0x7f7eb4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7eb406e680 0x7f7eb4070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8197580 tx=0x7f7eb0009190 comp rx=0 tx=0).stop 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 msgr2=0x7f7ec8195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec8195f60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8006010 tx=0x7f7eb800bd70 comp rx=0 tx=0).stop 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 shutdown_connections 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f7eb406e680 0x7f7eb4070b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ec80ff3c0 0x7f7ec8195f60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 --2- 172.21.15.31:0/26329398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ec80ffd60 0x7f7ec81964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:01:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 >> 172.21.15.31:0/26329398 conn(0x7f7ec80fac80 msgr2=0x7f7ec8069190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:01:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 shutdown_connections 2024-09-17T02:01:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:01:57.544+0000 7f7ecc9be700 1 -- 172.21.15.31:0/26329398 wait complete. 2024-09-17T02:01:58.172 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:58 smithi031 ceph-mon[77274]: pgmap v292: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:58.172 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:01:58 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/26329398' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:01:58.196 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T02:01:58.408 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:01:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:58 smithi092 ceph-mon[64495]: pgmap v292: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:01:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:01:58 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/26329398' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T02:02:00.182 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:00 smithi031 ceph-mon[77274]: pgmap v293: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:00.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 -- 172.21.15.31:0/2737412243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 msgr2=0x7f2490103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 --2- 172.21.15.31:0/2737412243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490103c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f248400aa20 tx=0x7f248400ad30 comp rx=0 tx=0).stop 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 -- 172.21.15.31:0/2737412243 shutdown_connections 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 --2- 172.21.15.31:0/2737412243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24900ff3d0 0x7f24900ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 --2- 172.21.15.31:0/2737412243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490103c90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 -- 172.21.15.31:0/2737412243 >> 172.21.15.31:0/2737412243 conn(0x7f2490074930 msgr2=0x7f2490074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 -- 172.21.15.31:0/2737412243 shutdown_connections 2024-09-17T02:02:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 -- 172.21.15.31:0/2737412243 wait complete. 2024-09-17T02:02:00.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 Processor -- start 2024-09-17T02:02:00.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.212+0000 7f249869e700 1 -- start start 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f249869e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24900ff3d0 0x7f2490195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f249869e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f249869e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2490196b40 con 0x7f24901038c0 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f249869e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249019a8d0 con 0x7f24900ff3d0 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40382/0 (socket says 172.21.15.31:40382) 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 -- 172.21.15.31:0/3261090850 learned_addr learned my addr 172.21.15.31:0/3261090850 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f249643a700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24900ff3d0 0x7f2490195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 -- 172.21.15.31:0/3261090850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24900ff3d0 msgr2=0x7f2490195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24900ff3d0 0x7f2490195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 -- 172.21.15.31:0/3261090850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248400a700 con 0x7f24901038c0 2024-09-17T02:02:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f2495c39700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490196460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f248c00b4b0 tx=0x7f248c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:02:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.213+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248c011800 con 0x7f24901038c0 2024-09-17T02:02:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.214+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f248c011e20 con 0x7f24901038c0 2024-09-17T02:02:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.214+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249019abb0 con 0x7f24901038c0 2024-09-17T02:02:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.214+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248c00f2e0 con 0x7f24901038c0 2024-09-17T02:02:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.214+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249019b100 con 0x7f24901038c0 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.215+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2490108ea0 con 0x7f24901038c0 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.215+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f248c010380 con 0x7f24901038c0 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.215+0000 7f24837fe700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f247c06e680 0x7f247c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.216+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f248c08e320 con 0x7f24901038c0 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.216+0000 7f249643a700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f247c06e680 0x7f247c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.216+0000 7f249643a700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f247c06e680 0x7f247c070b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2484000c00 tx=0x7f2484005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:02:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.220+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f248c057350 con 0x7f24901038c0 2024-09-17T02:02:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:00 smithi092 ceph-mon[64495]: pgmap v293: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.527+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f249004f2a0 con 0x7f24901038c0 2024-09-17T02:02:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.528+0000 7f24837fe700 1 -- 172.21.15.31:0/3261090850 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f248c05aa10 con 0x7f24901038c0 2024-09-17T02:02:00.526 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:02:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T02:02:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:02:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T02:02:00.527 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f247c06e680 msgr2=0x7f247c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f247c06e680 0x7f247c070b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2484000c00 tx=0x7f2484005de0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 msgr2=0x7f2490196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490196460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f248c00b4b0 tx=0x7f248c00b7c0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 shutdown_connections 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f247c06e680 0x7f247c070b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24900ff3d0 0x7f2490195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 --2- 172.21.15.31:0/3261090850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24901038c0 0x7f2490196460 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 >> 172.21.15.31:0/3261090850 conn(0x7f2490074930 msgr2=0x7f24900fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:02:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 shutdown_connections 2024-09-17T02:02:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:02:00.530+0000 7f249869e700 1 -- 172.21.15.31:0/3261090850 wait complete. 2024-09-17T02:02:01.111 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:01 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3261090850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:02:01.134 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T02:02:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:02:01.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:01 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3261090850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:02:02.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:02 smithi031 ceph-mon[77274]: pgmap v294: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:02 smithi092 ceph-mon[64495]: pgmap v294: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:03.005 INFO:teuthology.orchestra.run.smithi031.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T02:02:03.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'sleep 60' 2024-09-17T02:02:03.960 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:02:04.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:04 smithi031 ceph-mon[77274]: pgmap v295: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:04 smithi092 ceph-mon[64495]: pgmap v295: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:06.291 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:06 smithi092 ceph-mon[64495]: pgmap v296: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:06.291 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:06 smithi031 ceph-mon[77274]: pgmap v296: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:08 smithi092 ceph-mon[64495]: pgmap v297: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:08 smithi031 ceph-mon[77274]: pgmap v297: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:10 smithi092 ceph-mon[64495]: pgmap v298: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:10 smithi031 ceph-mon[77274]: pgmap v298: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:12.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:12 smithi031 ceph-mon[77274]: pgmap v299: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:12 smithi092 ceph-mon[64495]: pgmap v299: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:14 smithi092 ceph-mon[64495]: pgmap v300: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:14.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:14 smithi031 ceph-mon[77274]: pgmap v300: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:16.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:16 smithi092 ceph-mon[64495]: pgmap v301: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:16.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:16 smithi031 ceph-mon[77274]: pgmap v301: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:18 smithi092 ceph-mon[64495]: pgmap v302: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:18 smithi031 ceph-mon[77274]: pgmap v302: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:20 smithi092 ceph-mon[64495]: pgmap v303: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:20 smithi031 ceph-mon[77274]: pgmap v303: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:21.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:22.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:22 smithi092 ceph-mon[64495]: pgmap v304: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:22 smithi031 ceph-mon[77274]: pgmap v304: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:24.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:24 smithi092 ceph-mon[64495]: pgmap v305: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:24.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:24 smithi031 ceph-mon[77274]: pgmap v305: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:26.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:26 smithi092 ceph-mon[64495]: pgmap v306: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:26 smithi031 ceph-mon[77274]: pgmap v306: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:28.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:28 smithi092 ceph-mon[64495]: pgmap v307: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:28.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:28 smithi031 ceph-mon[77274]: pgmap v307: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:30.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:30 smithi092 ceph-mon[64495]: pgmap v308: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:30 smithi031 ceph-mon[77274]: pgmap v308: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:32.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:32 smithi092 ceph-mon[64495]: pgmap v309: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:32.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:32 smithi031 ceph-mon[77274]: pgmap v309: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:34.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:34 smithi092 ceph-mon[64495]: pgmap v310: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:34.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:34 smithi031 ceph-mon[77274]: pgmap v310: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:36 smithi092 ceph-mon[64495]: pgmap v311: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:36.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:36.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:36 smithi031 ceph-mon[77274]: pgmap v311: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:38.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:38 smithi092 ceph-mon[64495]: pgmap v312: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:38.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:38 smithi031 ceph-mon[77274]: pgmap v312: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:40.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:40 smithi092 ceph-mon[64495]: pgmap v313: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:40.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:40 smithi031 ceph-mon[77274]: pgmap v313: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:42.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:42 smithi092 ceph-mon[64495]: pgmap v314: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:42 smithi031 ceph-mon[77274]: pgmap v314: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:44.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:44 smithi031 ceph-mon[77274]: pgmap v315: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:44.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:02:44.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:02:44.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:02:44.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:02:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:44 smithi092 ceph-mon[64495]: pgmap v315: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:02:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:02:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:02:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:02:46.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:46 smithi031 ceph-mon[77274]: pgmap v316: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:46 smithi092 ceph-mon[64495]: pgmap v316: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:48.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:48 smithi031 ceph-mon[77274]: pgmap v317: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:48.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:48 smithi092 ceph-mon[64495]: pgmap v317: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:50.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:50 smithi031 ceph-mon[77274]: pgmap v318: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:50 smithi092 ceph-mon[64495]: pgmap v318: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:51.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:02:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:52 smithi031 ceph-mon[77274]: pgmap v319: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:52.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:52 smithi092 ceph-mon[64495]: pgmap v319: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:54 smithi031 ceph-mon[77274]: pgmap v320: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:54 smithi092 ceph-mon[64495]: pgmap v320: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:56.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:56 smithi092 ceph-mon[64495]: pgmap v321: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:56.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:56 smithi031 ceph-mon[77274]: pgmap v321: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:02:58.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:02:58 smithi092 ceph-mon[64495]: pgmap v322: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:02:58.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:02:58 smithi031 ceph-mon[77274]: pgmap v322: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:00.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:00 smithi092 ceph-mon[64495]: pgmap v323: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:00.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:00 smithi031 ceph-mon[77274]: pgmap v323: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:02.669 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:02 smithi092 ceph-mon[64495]: pgmap v324: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:02.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:02 smithi031 ceph-mon[77274]: pgmap v324: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:04.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:04 smithi092 ceph-mon[64495]: pgmap v325: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:04 smithi031 ceph-mon[77274]: pgmap v325: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:06.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T02:03:06.399 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:06 smithi031 ceph-mon[77274]: pgmap v326: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:06.540 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:06 smithi092 ceph-mon[64495]: pgmap v326: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:06.541 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 -- 172.21.15.31:0/4274754042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100ed0 msgr2=0x7f5210104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 --2- 172.21.15.31:0/4274754042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100ed0 0x7f5210104ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5204009910 tx=0x7f5204009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 -- 172.21.15.31:0/4274754042 shutdown_connections 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 --2- 172.21.15.31:0/4274754042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100ed0 0x7f5210104ea0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 --2- 172.21.15.31:0/4274754042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5210100530 0x7f5210100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 -- 172.21.15.31:0/4274754042 >> 172.21.15.31:0/4274754042 conn(0x7f52100fbe10 msgr2=0x7f52100fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 -- 172.21.15.31:0/4274754042 shutdown_connections 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.212+0000 7f5214dfa700 1 -- 172.21.15.31:0/4274754042 wait complete. 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f5214dfa700 1 Processor -- start 2024-09-17T02:03:08.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f5214dfa700 1 -- start start 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f5214dfa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 0x7f5210073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f5214dfa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5210100ed0 0x7f5210073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f5214dfa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210073ad0 con 0x7f5210100530 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f5214dfa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210073c10 con 0x7f5210100ed0 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 0x7f5210073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 0x7f5210073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42924/0 (socket says 172.21.15.31:42924) 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520e59c700 1 -- 172.21.15.31:0/1977173908 learned_addr learned my addr 172.21.15.31:0/1977173908 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520dd9b700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5210100ed0 0x7f5210073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520e59c700 1 -- 172.21.15.31:0/1977173908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5210100ed0 msgr2=0x7f5210073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520e59c700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5210100ed0 0x7f5210073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.213+0000 7f520e59c700 1 -- 172.21.15.31:0/1977173908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040095f0 con 0x7f5210100530 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.214+0000 7f520e59c700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 0x7f5210073050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f520000c8f0 tx=0x7f520000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:08.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.214+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5200004a00 con 0x7f5210100530 2024-09-17T02:03:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.214+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52000054e0 con 0x7f5210100530 2024-09-17T02:03:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.214+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52101a2040 con 0x7f5210100530 2024-09-17T02:03:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.214+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101a2450 con 0x7f5210100530 2024-09-17T02:03:08.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.214+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5200007cf0 con 0x7f5210100530 2024-09-17T02:03:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.215+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52101087b0 con 0x7f5210100530 2024-09-17T02:03:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.215+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5200005020 con 0x7f5210100530 2024-09-17T02:03:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.216+0000 7f51ff7fe700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f51f806e680 0x7f51f8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.216+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f5200013070 con 0x7f5210100530 2024-09-17T02:03:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.216+0000 7f520dd9b700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f51f806e680 0x7f51f8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:08.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.217+0000 7f520dd9b700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f51f806e680 0x7f51f8070b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5210074840 tx=0x7f520401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:08.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.221+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5200057620 con 0x7f5210100530 2024-09-17T02:03:08.373 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:08 smithi031 ceph-mon[77274]: pgmap v327: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:08.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.447+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 --> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5210061190 con 0x7f51f806e680 2024-09-17T02:03:08.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.457+0000 7f51ff7fe700 1 -- 172.21.15.31:0/1977173908 <== mgr.34104 v2:172.21.15.31:6800/1457430176 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5210061190 con 0x7f51f806e680 2024-09-17T02:03:08.456 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T02:03:08.456 INFO:teuthology.orchestra.run.smithi031.stdout:alertmanager.smithi031 smithi031 *:9093,9094 running (115s) 89s ago 19m 14.8M - 0.25.0 c8568f914cd2 3508837d17f4 2024-09-17T02:03:08.456 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi031 smithi031 running (2m) 89s ago 19m 8544k - 19.1.1-330-gc2ddf972 ebb0615149de ca48e79b4a53 2024-09-17T02:03:08.456 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-exporter.smithi092 smithi092 running (2m) 2m ago 18m 8224k - 19.1.1-330-gc2ddf972 ebb0615149de b1f07ae64ced 2024-09-17T02:03:08.456 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi031 smithi031 running (8m) 89s ago 19m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de 2be115a36967 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:crash.smithi092 smithi092 running (8m) 2m ago 18m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 133124a55057 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:grafana.smithi031 smithi031 *:3000 running (94s) 89s ago 19m 45.3M - 9.4.12 2bacad6d85d8 3ad861fda685 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.gszbpe smithi031 running (3m) 89s ago 13m 18.9M - 19.1.1-330-gc2ddf972 ebb0615149de 120ddd893c49 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi031.menvuk smithi031 running (4m) 89s ago 13m 65.0M - 19.1.1-330-gc2ddf972 ebb0615149de b293c28b6b80 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.hofoma smithi092 running (3m) 2m ago 13m 16.2M - 19.1.1-330-gc2ddf972 ebb0615149de c50cee007787 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mds.cephfs.smithi092.xzgrcs smithi092 running (3m) 2m ago 13m 66.7M - 19.1.1-330-gc2ddf972 ebb0615149de bd12a6058776 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi031.ealpiz smithi031 *:8443,9283,8765 running (10m) 89s ago 20m 518M - 19.1.1-330-gc2ddf972 ebb0615149de b796d6274265 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.smithi092.tjdpfw smithi092 *:8443,9283,8765 running (9m) 2m ago 18m 443M - 19.1.1-330-gc2ddf972 ebb0615149de f524b6905605 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi031 smithi031 running (9m) 89s ago 20m 58.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de c2c9d962792c 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:mon.smithi092 smithi092 running (9m) 2m ago 18m 44.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 1a8741897f02 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi031 smithi031 *:9100 running (2m) 89s ago 19m 8032k - 1.5.0 0da6a335fe13 994ab5e8eb32 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:node-exporter.smithi092 smithi092 *:9100 running (2m) 2m ago 18m 5448k - 1.5.0 0da6a335fe13 ba8df1958320 2024-09-17T02:03:08.457 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (7m) 89s ago 17m 194M 1217M 19.1.1-330-gc2ddf972 ebb0615149de e6f4c3911071 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi031 running (7m) 89s ago 17m 118M 1217M 19.1.1-330-gc2ddf972 ebb0615149de f8d67cd4936a 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi031 running (6m) 89s ago 16m 140M 1217M 19.1.1-330-gc2ddf972 ebb0615149de 50c8861efc46 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi092 running (6m) 2m ago 16m 138M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 4354e58e99a9 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi092 running (5m) 2m ago 15m 98.2M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 8cb531405f04 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi092 running (5m) 2m ago 15m 96.8M 2240M 19.1.1-330-gc2ddf972 ebb0615149de dde987d776d6 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stdout:prometheus.smithi031 smithi031 *:9095 running (2m) 89s ago 18m 65.8M - 2.43.0 a07b618ecd1d 2a4829e86aff 2024-09-17T02:03:08.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.459+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f51f806e680 msgr2=0x7f51f8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.459+0000 7f5214dfa700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f51f806e680 0x7f51f8070b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5210074840 tx=0x7f520401a040 comp rx=0 tx=0).stop 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.459+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 msgr2=0x7f5210073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.459+0000 7f5214dfa700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 0x7f5210073050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f520000c8f0 tx=0x7f520000cc00 comp rx=0 tx=0).stop 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 shutdown_connections 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f51f806e680 0x7f51f8070b30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5210100530 0x7f5210073050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 --2- 172.21.15.31:0/1977173908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5210100ed0 0x7f5210073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 >> 172.21.15.31:0/1977173908 conn(0x7f52100fbe10 msgr2=0x7f5210104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 shutdown_connections 2024-09-17T02:03:08.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:08.461+0000 7f5214dfa700 1 -- 172.21.15.31:0/1977173908 wait complete. 2024-09-17T02:03:08.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:08 smithi092 ceph-mon[64495]: pgmap v327: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:09.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T02:03:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:10 smithi031 ceph-mon[77274]: pgmap v328: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:10 smithi031 ceph-mon[77274]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:03:10.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:10 smithi092 ceph-mon[64495]: pgmap v328: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:10.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:10 smithi092 ceph-mon[64495]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T02:03:11.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.020+0000 7fc50ae4e700 1 -- 172.21.15.31:0/3516755748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 msgr2=0x7fc5040ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.020+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/3516755748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc5040ff720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009910 tx=0x7fc4ec009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 -- 172.21.15.31:0/3516755748 shutdown_connections 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/3516755748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040ffc60 0x7fc50410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/3516755748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc5040ff720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 -- 172.21.15.31:0/3516755748 >> 172.21.15.31:0/3516755748 conn(0x7fc5040748b0 msgr2=0x7fc504074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 -- 172.21.15.31:0/3516755748 shutdown_connections 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 -- 172.21.15.31:0/3516755748 wait complete. 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 Processor -- start 2024-09-17T02:03:11.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 -- start start 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.021+0000 7fc50ae4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc504100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc50ae4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040ffc60 0x7fc504100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc50ae4e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504100fb0 con 0x7fc5040ff350 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc50ae4e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5041010f0 con 0x7fc5040ffc60 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc504100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc504100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42944/0 (socket says 172.21.15.31:42944) 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 -- 172.21.15.31:0/1154410834 learned_addr learned my addr 172.21.15.31:0/1154410834 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc503fff700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040ffc60 0x7fc504100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:11.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 -- 172.21.15.31:0/1154410834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040ffc60 msgr2=0x7fc504100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040ffc60 0x7fc504100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 -- 172.21.15.31:0/1154410834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0095f0 con 0x7fc5040ff350 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc508bea700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc504100530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00bda0 tx=0x7fc4ec00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec01d070 con 0x7fc5040ff350 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4ec00f460 con 0x7fc5040ff350 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc504101370 con 0x7fc5040ff350 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.022+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec017630 con 0x7fc5040ff350 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.023+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5041a23b0 con 0x7fc5040ff350 2024-09-17T02:03:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.023+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc504107dd0 con 0x7fc5040ff350 2024-09-17T02:03:11.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.024+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc4ec00fa40 con 0x7fc5040ff350 2024-09-17T02:03:11.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.025+0000 7fc501ffb700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc4f006e680 0x7fc4f0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:11.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.025+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc4ec08fba0 con 0x7fc5040ff350 2024-09-17T02:03:11.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.025+0000 7fc503fff700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc4f006e680 0x7fc4f0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:11.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.025+0000 7fc503fff700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc4f006e680 0x7fc4f0070b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009550 tx=0x7fc4f4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:11.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.029+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc4ec058c70 con 0x7fc5040ff350 2024-09-17T02:03:11.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.331+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc50404f2a0 con 0x7fc5040ff350 2024-09-17T02:03:11.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.332+0000 7fc501ffb700 1 -- 172.21.15.31:0/1154410834 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc4ec05c330 con 0x7fc5040ff350 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T02:03:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T02:03:11.331 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc4f006e680 msgr2=0x7fc4f0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc4f006e680 0x7fc4f0070b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009550 tx=0x7fc4f4009040 comp rx=0 tx=0).stop 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 msgr2=0x7fc504100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc504100530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00bda0 tx=0x7fc4ec00be80 comp rx=0 tx=0).stop 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 shutdown_connections 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc4f006e680 0x7fc4f0070b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5040ff350 0x7fc504100530 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 --2- 172.21.15.31:0/1154410834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040ffc60 0x7fc504100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 >> 172.21.15.31:0/1154410834 conn(0x7fc5040748b0 msgr2=0x7fc504104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 shutdown_connections 2024-09-17T02:03:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:11.334+0000 7fc50ae4e700 1 -- 172.21.15.31:0/1154410834 wait complete. 2024-09-17T02:03:11.702 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:11 smithi031 ceph-mon[77274]: pgmap v329: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:11.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:11 smithi092 ceph-mon[64495]: pgmap v329: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:12.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T02:03:12.248 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:12.662 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:12 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1154410834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:03:12.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:12 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1154410834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:03:13.406 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:13 smithi031 ceph-mon[77274]: pgmap v330: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:13.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:13 smithi092 ceph-mon[64495]: pgmap v330: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 -- 172.21.15.31:0/3525306697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b4100e80 msgr2=0x7fb4b4104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3525306697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b4100e80 0x7fb4b4104e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009910 tx=0x7fb4a8009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 -- 172.21.15.31:0/3525306697 shutdown_connections 2024-09-17T02:03:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3525306697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b4100e80 0x7fb4b4104e50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3525306697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b41004e0 0x7fb4b41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 -- 172.21.15.31:0/3525306697 >> 172.21.15.31:0/3525306697 conn(0x7fb4b40fbda0 msgr2=0x7fb4b40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 -- 172.21.15.31:0/3525306697 shutdown_connections 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.927+0000 7fb4bb037700 1 -- 172.21.15.31:0/3525306697 wait complete. 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.928+0000 7fb4bb037700 1 Processor -- start 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.928+0000 7fb4bb037700 1 -- start start 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.928+0000 7fb4bb037700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 0x7fb4b4195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4bb037700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b4100e80 0x7fb4b4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4bb037700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4196b30 con 0x7fb4b41004e0 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4bb037700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b419a8c0 con 0x7fb4b4100e80 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 0x7fb4b4195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 0x7fb4b4195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47810/0 (socket says 172.21.15.31:47810) 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 -- 172.21.15.31:0/3150430045 learned_addr learned my addr 172.21.15.31:0/3150430045 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b3fff700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b4100e80 0x7fb4b4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 -- 172.21.15.31:0/3150430045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b4100e80 msgr2=0x7fb4b4196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b4100e80 0x7fb4b4196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 -- 172.21.15.31:0/3150430045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a80095f0 con 0x7fb4b41004e0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b3fff700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b4100e80 0x7fb4b4196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b8dd3700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 0x7fb4b4195f10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400d900 tx=0x7fb4a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a40041f0 con 0x7fb4b41004e0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4a4004cf0 con 0x7fb4b41004e0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b419aba0 con 0x7fb4b41004e0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.929+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a400b750 con 0x7fb4b41004e0 2024-09-17T02:03:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.930+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b419b0f0 con 0x7fb4b41004e0 2024-09-17T02:03:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.930+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b4108850 con 0x7fb4b41004e0 2024-09-17T02:03:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.931+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb4a4004350 con 0x7fb4b41004e0 2024-09-17T02:03:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.932+0000 7fb4b1ffb700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb49c06e680 0x7fb49c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.932+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb4a408e860 con 0x7fb4b41004e0 2024-09-17T02:03:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.932+0000 7fb4b3fff700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb49c06e680 0x7fb49c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:13.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.932+0000 7fb4b3fff700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb49c06e680 0x7fb49c070b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800b5c0 tx=0x7fb4a80053a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:13.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:13.936+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4a4057910 con 0x7fb4b41004e0 2024-09-17T02:03:14.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.247+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4b419b360 con 0x7fb4b41004e0 2024-09-17T02:03:14.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.248+0000 7fb4b1ffb700 1 -- 172.21.15.31:0/3150430045 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb4a405afd0 con 0x7fb4b41004e0 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb49c06e680 msgr2=0x7fb49c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb49c06e680 0x7fb49c070b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800b5c0 tx=0x7fb4a80053a0 comp rx=0 tx=0).stop 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 msgr2=0x7fb4b4195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 0x7fb4b4195f10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400d900 tx=0x7fb4a400dcc0 comp rx=0 tx=0).stop 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 shutdown_connections 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb49c06e680 0x7fb49c070b30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4b41004e0 0x7fb4b4195f10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 --2- 172.21.15.31:0/3150430045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b4100e80 0x7fb4b4196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:14.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 >> 172.21.15.31:0/3150430045 conn(0x7fb4b40fbda0 msgr2=0x7fb4b40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:14.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 shutdown_connections 2024-09-17T02:03:14.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:14.250+0000 7fb4bb037700 1 -- 172.21.15.31:0/3150430045 wait complete. 2024-09-17T02:03:14.259 INFO:teuthology.orchestra.run.smithi031.stdout:true 2024-09-17T02:03:14.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:14 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3150430045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:03:14.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:14 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3150430045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:03:15.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T02:03:15.259 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:15.635 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:15 smithi031 ceph-mon[77274]: pgmap v331: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:15 smithi092 ceph-mon[64495]: pgmap v331: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/4233616952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc073a00 msgr2=0x7fb8bc10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/4233616952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc073a00 0x7fb8bc10c580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009910 tx=0x7fb8ac009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/4233616952 shutdown_connections 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/4233616952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc073a00 0x7fb8bc10c580 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/4233616952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc0734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/4233616952 >> 172.21.15.31:0/4233616952 conn(0x7fb8bc0fbda0 msgr2=0x7fb8bc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/4233616952 shutdown_connections 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/4233616952 wait complete. 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.925+0000 7fb8c3fb8700 1 Processor -- start 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c3fb8700 1 -- start start 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c3fb8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c3fb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc073a00 0x7fb8bc1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c3fb8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19c930 con 0x7fb8bc0730f0 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c3fb8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19caa0 con 0x7fb8bc073a00 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47820/0 (socket says 172.21.15.31:47820) 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 -- 172.21.15.31:0/94259999 learned_addr learned my addr 172.21.15.31:0/94259999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1553700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc073a00 0x7fb8bc1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 -- 172.21.15.31:0/94259999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc073a00 msgr2=0x7fb8bc1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc073a00 0x7fb8bc1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 -- 172.21.15.31:0/94259999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0095f0 con 0x7fb8bc0730f0 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1553700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc073a00 0x7fb8bc1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.926+0000 7fb8c1d54700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc197f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800d8d0 tx=0x7fb8b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.927+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b8009940 con 0x7fb8bc0730f0 2024-09-17T02:03:16.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.927+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8b8010460 con 0x7fb8bc0730f0 2024-09-17T02:03:16.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.927+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc19cd80 con 0x7fb8bc0730f0 2024-09-17T02:03:16.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.927+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b800f5f0 con 0x7fb8bc0730f0 2024-09-17T02:03:16.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.927+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc19d2d0 con 0x7fb8bc0730f0 2024-09-17T02:03:16.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.928+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc109c80 con 0x7fb8bc0730f0 2024-09-17T02:03:16.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.928+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb8b80105d0 con 0x7fb8bc0730f0 2024-09-17T02:03:16.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.929+0000 7fb8b2ffd700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8a806e680 0x7fb8a8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:16.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.929+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb8b808e640 con 0x7fb8bc0730f0 2024-09-17T02:03:16.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.929+0000 7fb8c1553700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8a806e680 0x7fb8a8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:16.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.929+0000 7fb8c1553700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8a806e680 0x7fb8a8070b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac005b40 tx=0x7fb8ac01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:16.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:16.933+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb8b8057790 con 0x7fb8bc0730f0 2024-09-17T02:03:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.239+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8bc1992e0 con 0x7fb8bc0730f0 2024-09-17T02:03:17.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.240+0000 7fb8b2ffd700 1 -- 172.21.15.31:0/94259999 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb8b805ae50 con 0x7fb8bc0730f0 2024-09-17T02:03:17.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8a806e680 msgr2=0x7fb8a8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8a806e680 0x7fb8a8070b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac005b40 tx=0x7fb8ac01a040 comp rx=0 tx=0).stop 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 msgr2=0x7fb8bc197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc197f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800d8d0 tx=0x7fb8b800dc90 comp rx=0 tx=0).stop 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 shutdown_connections 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb8a806e680 0x7fb8a8070b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8bc0730f0 0x7fb8bc197f80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:17.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 --2- 172.21.15.31:0/94259999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc073a00 0x7fb8bc1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:17.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 >> 172.21.15.31:0/94259999 conn(0x7fb8bc0fbda0 msgr2=0x7fb8bc106dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:17.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 shutdown_connections 2024-09-17T02:03:17.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:17.242+0000 7fb8c3fb8700 1 -- 172.21.15.31:0/94259999 wait complete. 2024-09-17T02:03:17.250 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)" 2024-09-17T02:03:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:17 smithi031 ceph-mon[77274]: pgmap v332: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:17.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:17 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/94259999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:03:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:17 smithi092 ceph-mon[64495]: pgmap v332: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:17 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/94259999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T02:03:17.833 DEBUG:teuthology.parallel:result is None 2024-09-17T02:03:17.833 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T02:03:17.847 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T02:03:17.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T02:03:18.054 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:19.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:19 smithi031 ceph-mon[77274]: pgmap v333: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:19 smithi092 ceph-mon[64495]: pgmap v333: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/2019408540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c102e30 msgr2=0x7f3b9c103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/2019408540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c102e30 0x7f3b9c103200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009910 tx=0x7f3b8c009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/2019408540 shutdown_connections 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/2019408540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c0ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/2019408540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c102e30 0x7f3b9c103200 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/2019408540 >> 172.21.15.31:0/2019408540 conn(0x7f3b9c074fa0 msgr2=0x7f3b9c0753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/2019408540 shutdown_connections 2024-09-17T02:03:19.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.764+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/2019408540 wait complete. 2024-09-17T02:03:19.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.765+0000 7f3ba0d9e700 1 Processor -- start 2024-09-17T02:03:19.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3ba0d9e700 1 -- start start 2024-09-17T02:03:19.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3ba0d9e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:19.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3ba0d9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c102e30 0x7f3b9c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:19.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3ba0d9e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c197560 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3ba0d9e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1976a0 con 0x7f3b9c102e30 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47840/0 (socket says 172.21.15.31:47840) 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 -- 172.21.15.31:0/1572119177 learned_addr learned my addr 172.21.15.31:0/1572119177 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9affd700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c102e30 0x7f3b9c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 -- 172.21.15.31:0/1572119177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c102e30 msgr2=0x7f3b9c196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c102e30 0x7f3b9c196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 -- 172.21.15.31:0/1572119177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c0095f0 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.766+0000 7f3b9b7fe700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c196a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006010 tx=0x7f3b8c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.767+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c01d070 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.767+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c19fa70 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.767+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b8c00f460 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.767+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c017630 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.767+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c19ff00 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.768+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c107530 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.768+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3b8c00f5d0 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.769+0000 7f3b98ff9700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8406e680 0x7f3b84070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.769+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3b8c08fbd0 con 0x7f3b9c0ff9e0 2024-09-17T02:03:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.769+0000 7f3b9affd700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8406e680 0x7f3b84070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:19.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.769+0000 7f3b9affd700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8406e680 0x7f3b84070b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005950 tx=0x7f3b900058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:19.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:19.774+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3b8c058ca0 con 0x7f3b9c0ff9e0 2024-09-17T02:03:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.038+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b9c02cc30 con 0x7f3b9c0ff9e0 2024-09-17T02:03:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.039+0000 7f3b98ff9700 1 -- 172.21.15.31:0/1572119177 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+2000 (secure 0 0 0) 0x7f3b8c05c360 con 0x7f3b9c0ff9e0 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:e44 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:btime 2024-09-17T02:00:14:511713+0000 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-09-17T02:03:20.037 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 44 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T01:49:14.942770+0000 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-09-17T02:00:14.511701+0000 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 60 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-09-17T02:03:20.038 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 92 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 2 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=34416,1=34448} 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-09-17T02:03:20.039 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3] 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 1 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.menvuk{0:34416} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.31:6826/2082480478,v1:172.21.15.31:6827/2082480478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.xzgrcs{0:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.92:6824/186400038,v1:172.21.15.92:6825/186400038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi031.gszbpe{1:34448} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.31:6828/1969572226,v1:172.21.15.31:6829/1969572226] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.cephfs.smithi092.hofoma{1:44377} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.92:6826/3092379292,v1:172.21.15.92:6827/3092379292] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T02:03:20.040 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:20.041 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8406e680 msgr2=0x7f3b84070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8406e680 0x7f3b84070b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005950 tx=0x7f3b900058e0 comp rx=0 tx=0).stop 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 msgr2=0x7f3b9c196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c196a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006010 tx=0x7f3b8c00be20 comp rx=0 tx=0).stop 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 shutdown_connections 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b8406e680 0x7f3b84070b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b9c0ff9e0 0x7f3b9c196a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:20.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 --2- 172.21.15.31:0/1572119177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b9c102e30 0x7f3b9c196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:20.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 >> 172.21.15.31:0/1572119177 conn(0x7f3b9c074fa0 msgr2=0x7f3b9c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:20.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 shutdown_connections 2024-09-17T02:03:20.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:20.041+0000 7f3ba0d9e700 1 -- 172.21.15.31:0/1572119177 wait complete. 2024-09-17T02:03:20.043 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 44 2024-09-17T02:03:20.726 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:20 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1572119177' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:03:20.726 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:20 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1572119177' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T02:03:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:20.749 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-17T02:03:20.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T02:03:20.974 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:21 smithi092 ceph-mon[64495]: pgmap v334: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:21 smithi031 ceph-mon[77274]: pgmap v334: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 -- 172.21.15.31:0/191288829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 msgr2=0x7fa0bc104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 --2- 172.21.15.31:0/191288829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc104500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009910 tx=0x7fa0ac009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 -- 172.21.15.31:0/191288829 shutdown_connections 2024-09-17T02:03:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 --2- 172.21.15.31:0/191288829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 0x7fa0bc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 --2- 172.21.15.31:0/191288829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc104500 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 -- 172.21.15.31:0/191288829 >> 172.21.15.31:0/191288829 conn(0x7fa0bc075130 msgr2=0x7fa0bc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 -- 172.21.15.31:0/191288829 shutdown_connections 2024-09-17T02:03:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.638+0000 7fa0c0902700 1 -- 172.21.15.31:0/191288829 wait complete. 2024-09-17T02:03:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.639+0000 7fa0c0902700 1 Processor -- start 2024-09-17T02:03:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.639+0000 7fa0c0902700 1 -- start start 2024-09-17T02:03:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.639+0000 7fa0c0902700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 0x7fa0bc195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.639+0000 7fa0c0902700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.639+0000 7fa0c0902700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc196a70 con 0x7fa0bc104130 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.639+0000 7fa0c0902700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc19a800 con 0x7fa0bc0ffbd0 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47866/0 (socket says 172.21.15.31:47866) 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 -- 172.21.15.31:0/1482582148 learned_addr learned my addr 172.21.15.31:0/1482582148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0ba59c700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 0x7fa0bc195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 -- 172.21.15.31:0/1482582148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 msgr2=0x7fa0bc195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 0x7fa0bc195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 -- 172.21.15.31:0/1482582148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0095f0 con 0x7fa0bc104130 2024-09-17T02:03:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0ba59c700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 0x7fa0bc195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:03:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0b9d9b700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc196390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000d8d0 tx=0x7fa0b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b0009940 con 0x7fa0bc104130 2024-09-17T02:03:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0b0010460 con 0x7fa0bc104130 2024-09-17T02:03:22.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc19aae0 con 0x7fa0bc104130 2024-09-17T02:03:22.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b000f5f0 con 0x7fa0bc104130 2024-09-17T02:03:22.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.640+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc19b030 con 0x7fa0bc104130 2024-09-17T02:03:22.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.641+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc1086a0 con 0x7fa0bc104130 2024-09-17T02:03:22.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.642+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa0b00105d0 con 0x7fa0bc104130 2024-09-17T02:03:22.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.642+0000 7fa0ab7fe700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa0a406e680 0x7fa0a4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:22.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.642+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fa0b008e750 con 0x7fa0bc104130 2024-09-17T02:03:22.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.642+0000 7fa0ba59c700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa0a406e680 0x7fa0a4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:22.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.643+0000 7fa0ba59c700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa0a406e680 0x7fa0a4070b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac006010 tx=0x7fa0ac00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:22.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.647+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa0b0057820 con 0x7fa0bc104130 2024-09-17T02:03:22.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.907+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0bc19b250 con 0x7fa0bc104130 2024-09-17T02:03:22.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.907+0000 7fa0ab7fe700 1 -- 172.21.15.31:0/1482582148 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5284 (secure 0 0 0) 0x7fa0b005aee0 con 0x7fa0bc104130 2024-09-17T02:03:22.905 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:22.905 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"btime":"2024-09-17T02:00:14:511713+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T02:00:14.511701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":42,"state":"up:active","state_seq":12,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44373":{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44377":{"gid":44377,"name":"cephfs.smithi092.hofoma","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6827/3092379292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3092379292},{"type":"v1","addr":"172.21.15.92:6827","nonce":3092379292}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34448,34416]},"id":1}]} 2024-09-17T02:03:22.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa0a406e680 msgr2=0x7fa0a4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:22.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa0a406e680 0x7fa0a4070b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac006010 tx=0x7fa0ac00b540 comp rx=0 tx=0).stop 2024-09-17T02:03:22.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 msgr2=0x7fa0bc196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:22.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc196390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000d8d0 tx=0x7fa0b000dc90 comp rx=0 tx=0).stop 2024-09-17T02:03:22.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 shutdown_connections 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fa0a406e680 0x7fa0a4070b30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0bc0ffbd0 0x7fa0bc195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 --2- 172.21.15.31:0/1482582148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0bc104130 0x7fa0bc196390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 >> 172.21.15.31:0/1482582148 conn(0x7fa0bc075130 msgr2=0x7fa0bc0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 shutdown_connections 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:22.910+0000 7fa0c0902700 1 -- 172.21.15.31:0/1482582148 wait complete. 2024-09-17T02:03:22.908 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 44 2024-09-17T02:03:23.573 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:23 smithi031 ceph-mon[77274]: pgmap v335: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:23.573 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:23 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1482582148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T02:03:23.594 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2024-09-17T02:03:23.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-17T02:03:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:23 smithi092 ceph-mon[64495]: pgmap v335: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:23 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1482582148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T02:03:23.805 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:25.483 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:25 smithi031 ceph-mon[77274]: pgmap v336: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 -- 172.21.15.31:0/3732271960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f501004e0 msgr2=0x7f8f501008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 --2- 172.21.15.31:0/3732271960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f501004e0 0x7f8f501008b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009910 tx=0x7f8f4c009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 -- 172.21.15.31:0/3732271960 shutdown_connections 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 --2- 172.21.15.31:0/3732271960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f50100e80 0x7f8f50104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 --2- 172.21.15.31:0/3732271960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f501004e0 0x7f8f501008b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 -- 172.21.15.31:0/3732271960 >> 172.21.15.31:0/3732271960 conn(0x7f8f500fbda0 msgr2=0x7f8f500fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 -- 172.21.15.31:0/3732271960 shutdown_connections 2024-09-17T02:03:25.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.496+0000 7f8f5803b700 1 -- 172.21.15.31:0/3732271960 wait complete. 2024-09-17T02:03:25.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f5803b700 1 Processor -- start 2024-09-17T02:03:25.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f5803b700 1 -- start start 2024-09-17T02:03:25.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f5803b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f501004e0 0x7f8f50195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f5803b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 0x7f8f50196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f5803b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50196b10 con 0x7f8f50100e80 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f5803b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5019a8a0 con 0x7f8f501004e0 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f555d6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 0x7f8f50196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f555d6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 0x7f8f50196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50962/0 (socket says 172.21.15.31:50962) 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f555d6700 1 -- 172.21.15.31:0/1167435727 learned_addr learned my addr 172.21.15.31:0/1167435727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f55dd7700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f501004e0 0x7f8f50195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f555d6700 1 -- 172.21.15.31:0/1167435727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f501004e0 msgr2=0x7f8f50195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f555d6700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f501004e0 0x7f8f50195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.497+0000 7f8f555d6700 1 -- 172.21.15.31:0/1167435727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0095f0 con 0x7f8f50100e80 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.498+0000 7f8f555d6700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 0x7f8f50196430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c8f0 tx=0x7f8f4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.498+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f40007a50 con 0x7f8f50100e80 2024-09-17T02:03:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.498+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f40007bb0 con 0x7f8f50100e80 2024-09-17T02:03:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.498+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5019ab80 con 0x7f8f50100e80 2024-09-17T02:03:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.498+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f40018630 con 0x7f8f50100e80 2024-09-17T02:03:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.498+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5019b0d0 con 0x7f8f50100e80 2024-09-17T02:03:25.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.499+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f501087f0 con 0x7f8f50100e80 2024-09-17T02:03:25.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.499+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8f40007d20 con 0x7f8f50100e80 2024-09-17T02:03:25.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.500+0000 7f8f46ffd700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f3c06e680 0x7f8f3c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:25.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.500+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f8f4008e720 con 0x7f8f50100e80 2024-09-17T02:03:25.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.500+0000 7f8f55dd7700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f3c06e680 0x7f8f3c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:25.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.501+0000 7f8f55dd7700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f3c06e680 0x7f8f3c070b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c006010 tx=0x7f8f4c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:25.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.504+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f400577f0 con 0x7f8f50100e80 2024-09-17T02:03:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:25 smithi092 ceph-mon[64495]: pgmap v336: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:25.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.766+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f8f501972f0 con 0x7f8f50100e80 2024-09-17T02:03:25.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.766+0000 7f8f46ffd700 1 -- 172.21.15.31:0/1167435727 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v44) v1 ==== 107+0+4929 (secure 0 0 0) 0x7f8f4005aeb0 con 0x7f8f50100e80 2024-09-17T02:03:25.764 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:25.764 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:51:19.622148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.31:6829/1620553537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1620553537},{"type":"v1","addr":"172.21.15.31:6829","nonce":1620553537}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi092.hofoma","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.92:6827/2865546968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2865546968},{"type":"v1","addr":"172.21.15.92:6827","nonce":2865546968}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:03:25.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f3c06e680 msgr2=0x7f8f3c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:25.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f3c06e680 0x7f8f3c070b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c006010 tx=0x7f8f4c01a040 comp rx=0 tx=0).stop 2024-09-17T02:03:25.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 msgr2=0x7f8f50196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 0x7f8f50196430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c8f0 tx=0x7f8f4000ccb0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 shutdown_connections 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f8f3c06e680 0x7f8f3c070b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f501004e0 0x7f8f50195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 --2- 172.21.15.31:0/1167435727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f50100e80 0x7f8f50196430 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 >> 172.21.15.31:0/1167435727 conn(0x7f8f500fbda0 msgr2=0x7f8f500fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 shutdown_connections 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:25.770+0000 7f8f5803b700 1 -- 172.21.15.31:0/1167435727 wait complete. 2024-09-17T02:03:25.768 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 16 2024-09-17T02:03:26.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-17T02:03:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:26.719 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:26 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1167435727' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-17T02:03:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:26 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1167435727' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-17T02:03:27.644 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:27 smithi031 ceph-mon[77274]: pgmap v337: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:27.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:27 smithi092 ceph-mon[64495]: pgmap v337: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 -- 172.21.15.31:0/1122605406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 msgr2=0x7f72ec10c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 --2- 172.21.15.31:0/1122605406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec10c610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009910 tx=0x7f72e0009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 -- 172.21.15.31:0/1122605406 shutdown_connections 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 --2- 172.21.15.31:0/1122605406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec10c610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 --2- 172.21.15.31:0/1122605406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72ec0fefa0 0x7f72ec0ff370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 -- 172.21.15.31:0/1122605406 >> 172.21.15.31:0/1122605406 conn(0x7f72ec0fac90 msgr2=0x7f72ec0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 -- 172.21.15.31:0/1122605406 shutdown_connections 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 -- 172.21.15.31:0/1122605406 wait complete. 2024-09-17T02:03:28.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 Processor -- start 2024-09-17T02:03:28.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.172+0000 7f72f4101700 1 -- start start 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f4101700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72ec0fefa0 0x7f72ec198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f4101700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f4101700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec198c80 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f4101700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec19ca10 con 0x7f72ec0fefa0 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50974/0 (socket says 172.21.15.31:50974) 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 -- 172.21.15.31:0/4219556592 learned_addr learned my addr 172.21.15.31:0/4219556592 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:28.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f1e9d700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72ec0fefa0 0x7f72ec198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 -- 172.21.15.31:0/4219556592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72ec0fefa0 msgr2=0x7f72ec198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72ec0fefa0 0x7f72ec198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 -- 172.21.15.31:0/4219556592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00095f0 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.173+0000 7f72f169c700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec1985a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f72e000f690 tx=0x7f72e000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.174+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e001d070 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.174+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72e00050d0 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.174+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec19cc90 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.174+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e0022470 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.174+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec19d1e0 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.175+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec109d80 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.175+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f72e0003780 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.176+0000 7f72deffd700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f72d806e680 0x7f72d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:28.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.176+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f72e008fb10 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.176+0000 7f72f1e9d700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f72d806e680 0x7f72d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:28.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.176+0000 7f72f1e9d700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f72d806e680 0x7f72d8070b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009c60 tx=0x7f72e8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:28.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.180+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f72e0058d10 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.440+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f72ec19d450 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.441+0000 7f72deffd700 1 -- 172.21.15.31:0/4219556592 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v44) v1 ==== 107+0+4930 (secure 0 0 0) 0x7f72e005c3d0 con 0x7f72ec0ff8b0 2024-09-17T02:03:28.440 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:28.440 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:52:36.074925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.31:6829/1620553537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1620553537},{"type":"v1","addr":"172.21.15.31:6829","nonce":1620553537}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi092.hofoma","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.92:6827/2865546968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2865546968},{"type":"v1","addr":"172.21.15.92:6827","nonce":2865546968}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f72d806e680 msgr2=0x7f72d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f72d806e680 0x7f72d8070b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009c60 tx=0x7f72e8009260 comp rx=0 tx=0).stop 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 msgr2=0x7f72ec1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec1985a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f72e000f690 tx=0x7f72e000f6c0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 shutdown_connections 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f72d806e680 0x7f72d8070b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72ec0fefa0 0x7f72ec198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 --2- 172.21.15.31:0/4219556592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ec0ff8b0 0x7f72ec1985a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 >> 172.21.15.31:0/4219556592 conn(0x7f72ec0fac90 msgr2=0x7f72ec0fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 shutdown_connections 2024-09-17T02:03:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:28.443+0000 7f72f4101700 1 -- 172.21.15.31:0/4219556592 wait complete. 2024-09-17T02:03:28.443 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T02:03:29.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-17T02:03:29.332 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:29.687 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:29 smithi031 ceph-mon[77274]: pgmap v338: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:29.687 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:29 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/4219556592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-17T02:03:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:29 smithi092 ceph-mon[64495]: pgmap v338: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:29 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/4219556592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-17T02:03:31.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.010+0000 7fde3031c700 1 -- 172.21.15.31:0/1395797063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde281004e0 msgr2=0x7fde281008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:31.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.010+0000 7fde3031c700 1 --2- 172.21.15.31:0/1395797063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde281004e0 0x7fde281008b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde24009910 tx=0x7fde24009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:31.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 -- 172.21.15.31:0/1395797063 shutdown_connections 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 --2- 172.21.15.31:0/1395797063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde28100e80 0x7fde28104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 --2- 172.21.15.31:0/1395797063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde281004e0 0x7fde281008b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 -- 172.21.15.31:0/1395797063 >> 172.21.15.31:0/1395797063 conn(0x7fde280fbda0 msgr2=0x7fde280fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 -- 172.21.15.31:0/1395797063 shutdown_connections 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 -- 172.21.15.31:0/1395797063 wait complete. 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.011+0000 7fde3031c700 1 Processor -- start 2024-09-17T02:03:31.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde3031c700 1 -- start start 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde3031c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde281004e0 0x7fde28198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde3031c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 0x7fde28198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde3031c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2819e7f0 con 0x7fde28100e80 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde3031c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2819e960 con 0x7fde281004e0 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 0x7fde28198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 0x7fde28198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50988/0 (socket says 172.21.15.31:50988) 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 -- 172.21.15.31:0/2566967846 learned_addr learned my addr 172.21.15.31:0/2566967846 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2e0b8700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde281004e0 0x7fde28198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 -- 172.21.15.31:0/2566967846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde281004e0 msgr2=0x7fde28198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde281004e0 0x7fde28198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:31.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 -- 172.21.15.31:0/2566967846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240095f0 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.012+0000 7fde2d8b7700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 0x7fde28198fc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde1800d900 tx=0x7fde1800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.013+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde18009900 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.013+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2819ec40 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.013+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde18010460 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.013+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1800f5f0 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.013+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2819f190 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.014+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2804f2a0 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.014+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fde180105d0 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.015+0000 7fde1f7fe700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fde1406e680 0x7fde14070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.015+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fde1808e310 con 0x7fde28100e80 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.015+0000 7fde2e0b8700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fde1406e680 0x7fde14070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:31.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.015+0000 7fde2e0b8700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fde1406e680 0x7fde14070b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde2400b5c0 tx=0x7fde2401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:31.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.019+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fde180573e0 con 0x7fde28100e80 2024-09-17T02:03:31.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.279+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fde2819f3b0 con 0x7fde28100e80 2024-09-17T02:03:31.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.279+0000 7fde1f7fe700 1 -- 172.21.15.31:0/2566967846 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v44) v1 ==== 107+0+4944 (secure 0 0 0) 0x7fde1805aaa0 con 0x7fde28100e80 2024-09-17T02:03:31.278 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:31.278 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"btime":"2024-09-17T01:56:21:979504+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:56:21.979501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.31:6829/1620553537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1620553537},{"type":"v1","addr":"172.21.15.31:6829","nonce":1620553537}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi092.hofoma","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.92:6827/2865546968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2865546968},{"type":"v1","addr":"172.21.15.92:6827","nonce":2865546968}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24269]},"id":1}]} 2024-09-17T02:03:31.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fde1406e680 msgr2=0x7fde14070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fde1406e680 0x7fde14070b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde2400b5c0 tx=0x7fde2401a040 comp rx=0 tx=0).stop 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 msgr2=0x7fde28198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 0x7fde28198fc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde1800d900 tx=0x7fde1800dc10 comp rx=0 tx=0).stop 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 shutdown_connections 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fde1406e680 0x7fde14070b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde281004e0 0x7fde28198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 --2- 172.21.15.31:0/2566967846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde28100e80 0x7fde28198fc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 >> 172.21.15.31:0/2566967846 conn(0x7fde280fbda0 msgr2=0x7fde280fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 shutdown_connections 2024-09-17T02:03:31.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:31.282+0000 7fde3031c700 1 -- 172.21.15.31:0/2566967846 wait complete. 2024-09-17T02:03:31.282 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-09-17T02:03:31.606 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:31 smithi031 ceph-mon[77274]: pgmap v339: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:31.606 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:31 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2566967846' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-17T02:03:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:31 smithi092 ceph-mon[64495]: pgmap v339: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:31.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:31 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2566967846' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-17T02:03:31.923 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-17T02:03:32.135 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:33.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:33 smithi092 ceph-mon[64495]: pgmap v340: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:33.501 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:33 smithi031 ceph-mon[77274]: pgmap v340: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3068200992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 msgr2=0x7fd3b4104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3068200992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4104e30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009910 tx=0x7fd3a4009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3068200992 shutdown_connections 2024-09-17T02:03:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3068200992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4104e30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3068200992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3b41004c0 0x7fd3b4100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3068200992 >> 172.21.15.31:0/3068200992 conn(0x7fd3b40fbd80 msgr2=0x7fd3b40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3068200992 shutdown_connections 2024-09-17T02:03:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.798+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3068200992 wait complete. 2024-09-17T02:03:33.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.799+0000 7fd3b88a1700 1 Processor -- start 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.799+0000 7fd3b88a1700 1 -- start start 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.799+0000 7fd3b88a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3b41004c0 0x7fd3b4195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.799+0000 7fd3b88a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.799+0000 7fd3b88a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4196b70 con 0x7fd3b4100e60 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.799+0000 7fd3b88a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b419a900 con 0x7fd3b41004c0 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40856/0 (socket says 172.21.15.31:40856) 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 -- 172.21.15.31:0/3929988092 learned_addr learned my addr 172.21.15.31:0/3929988092 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b259c700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3b41004c0 0x7fd3b4195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 -- 172.21.15.31:0/3929988092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3b41004c0 msgr2=0x7fd3b4195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3b41004c0 0x7fd3b4195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 -- 172.21.15.31:0/3929988092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40095f0 con 0x7fd3b4100e60 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b1d9b700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4196490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400bda0 tx=0x7fd3a400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a401d070 con 0x7fd3b4100e60 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3a4005dc0 con 0x7fd3b4100e60 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b419ab80 con 0x7fd3b4100e60 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a4017400 con 0x7fd3b4100e60 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.800+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b419b070 con 0x7fd3b4100e60 2024-09-17T02:03:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.801+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b4108830 con 0x7fd3b4100e60 2024-09-17T02:03:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.802+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd3a400f6f0 con 0x7fd3b4100e60 2024-09-17T02:03:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.802+0000 7fd3ab7fe700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd3a006e680 0x7fd3a0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.802+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd3a408fa10 con 0x7fd3b4100e60 2024-09-17T02:03:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.802+0000 7fd3b259c700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd3a006e680 0x7fd3a0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.803+0000 7fd3b259c700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd3a006e680 0x7fd3a0070b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd39c005950 tx=0x7fd39c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:33.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:33.807+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd3a4058b60 con 0x7fd3b4100e60 2024-09-17T02:03:34.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.071+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fd3b41972b0 con 0x7fd3b4100e60 2024-09-17T02:03:34.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.071+0000 7fd3ab7fe700 1 -- 172.21.15.31:0/3929988092 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v44) v1 ==== 107+0+4943 (secure 0 0 0) 0x7fd3a405c220 con 0x7fd3b4100e60 2024-09-17T02:03:34.070 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:34.070 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"btime":"2024-09-17T01:56:23:987796+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:56:23.845837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14478":{"gid":14478,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.31:6829/1620553537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1620553537},{"type":"v1","addr":"172.21.15.31:6829","nonce":1620553537}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi092.hofoma","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.92:6827/2865546968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":2865546968},{"type":"v1","addr":"172.21.15.92:6827","nonce":2865546968}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24269,14464]},"id":1}]} 2024-09-17T02:03:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd3a006e680 msgr2=0x7fd3a0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd3a006e680 0x7fd3a0070b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd39c005950 tx=0x7fd39c00b410 comp rx=0 tx=0).stop 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 msgr2=0x7fd3b4196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4196490 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400bda0 tx=0x7fd3a400bdd0 comp rx=0 tx=0).stop 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 shutdown_connections 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd3a006e680 0x7fd3a0070b30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3b41004c0 0x7fd3b4195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 --2- 172.21.15.31:0/3929988092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b4100e60 0x7fd3b4196490 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 >> 172.21.15.31:0/3929988092 conn(0x7fd3b40fbd80 msgr2=0x7fd3b40fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 shutdown_connections 2024-09-17T02:03:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:34.074+0000 7fd3b88a1700 1 -- 172.21.15.31:0/3929988092 wait complete. 2024-09-17T02:03:34.074 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-09-17T02:03:34.686 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:34 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3929988092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-17T02:03:34.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-17T02:03:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:34 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3929988092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-17T02:03:34.924 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:35.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:35 smithi092 ceph-mon[64495]: pgmap v341: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:35.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:35 smithi031 ceph-mon[77274]: pgmap v341: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:35.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 -- 172.21.15.31:0/3415845147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7281004e0 msgr2=0x7fd7281008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3415845147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7281004e0 0x7fd7281008b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009910 tx=0x7fd71c009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 -- 172.21.15.31:0/3415845147 shutdown_connections 2024-09-17T02:03:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3415845147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd728100e80 0x7fd728104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3415845147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7281004e0 0x7fd7281008b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 -- 172.21.15.31:0/3415845147 >> 172.21.15.31:0/3415845147 conn(0x7fd7280fbda0 msgr2=0x7fd7280fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 -- 172.21.15.31:0/3415845147 shutdown_connections 2024-09-17T02:03:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.638+0000 7fd72eef7700 1 -- 172.21.15.31:0/3415845147 wait complete. 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.639+0000 7fd72eef7700 1 Processor -- start 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.639+0000 7fd72eef7700 1 -- start start 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd72eef7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7281004e0 0x7fd728198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd72eef7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 0x7fd728198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd72eef7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72819e7f0 con 0x7fd728100e80 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd72eef7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72819e960 con 0x7fd7281004e0 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 0x7fd728198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 0x7fd728198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40874/0 (socket says 172.21.15.31:40874) 2024-09-17T02:03:36.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 -- 172.21.15.31:0/3961794558 learned_addr learned my addr 172.21.15.31:0/3961794558 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd72cc93700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7281004e0 0x7fd728198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 -- 172.21.15.31:0/3961794558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7281004e0 msgr2=0x7fd728198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7281004e0 0x7fd728198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 -- 172.21.15.31:0/3961794558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0095f0 con 0x7fd728100e80 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd727fff700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 0x7fd728198fc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd71400e8f0 tx=0x7fd71400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.640+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd714009790 con 0x7fd728100e80 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.641+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72819ec40 con 0x7fd728100e80 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.641+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd71400c810 con 0x7fd728100e80 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.641+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd714005580 con 0x7fd728100e80 2024-09-17T02:03:36.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.641+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72819f190 con 0x7fd728100e80 2024-09-17T02:03:36.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.642+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72804f2a0 con 0x7fd728100e80 2024-09-17T02:03:36.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.642+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd71400c980 con 0x7fd728100e80 2024-09-17T02:03:36.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.643+0000 7fd725ffb700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd71806e680 0x7fd718070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:36.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.643+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fd714014070 con 0x7fd728100e80 2024-09-17T02:03:36.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.643+0000 7fd72cc93700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd71806e680 0x7fd718070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:36.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.643+0000 7fd72cc93700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd71806e680 0x7fd718070b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0059d0 tx=0x7fd71c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:36.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.647+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd714057ab0 con 0x7fd728100e80 2024-09-17T02:03:36.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.907+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fd72819f410 con 0x7fd728100e80 2024-09-17T02:03:36.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.907+0000 7fd725ffb700 1 -- 172.21.15.31:0/3961794558 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v44) v1 ==== 107+0+3372 (secure 0 0 0) 0x7fd71405b170 con 0x7fd728100e80 2024-09-17T02:03:36.913 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:36.914 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"btime":"2024-09-17T01:58:08:436430+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:07.439518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24269]},"id":1}]} 2024-09-17T02:03:36.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.909+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd71806e680 msgr2=0x7fd718070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:36.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.909+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd71806e680 0x7fd718070b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0059d0 tx=0x7fd71c005940 comp rx=0 tx=0).stop 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.909+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 msgr2=0x7fd728198fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.909+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 0x7fd728198fc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd71400e8f0 tx=0x7fd71400ec00 comp rx=0 tx=0).stop 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 shutdown_connections 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fd71806e680 0x7fd718070b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7281004e0 0x7fd728198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 --2- 172.21.15.31:0/3961794558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd728100e80 0x7fd728198fc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 >> 172.21.15.31:0/3961794558 conn(0x7fd7280fbda0 msgr2=0x7fd7280fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 shutdown_connections 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:36.910+0000 7fd72eef7700 1 -- 172.21.15.31:0/3961794558 wait complete. 2024-09-17T02:03:36.915 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 20 2024-09-17T02:03:37.541 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:37 smithi031 ceph-mon[77274]: pgmap v342: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:37.541 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:37 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3961794558' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-17T02:03:37.564 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-17T02:03:37.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-17T02:03:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:37 smithi092 ceph-mon[64495]: pgmap v342: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:37.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:37 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3961794558' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-17T02:03:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 -- 172.21.15.31:0/2756221341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 msgr2=0x7f4b041008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 --2- 172.21.15.31:0/2756221341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041008b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009910 tx=0x7f4af4009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:39.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 -- 172.21.15.31:0/2756221341 shutdown_connections 2024-09-17T02:03:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 --2- 172.21.15.31:0/2756221341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b04100e80 0x7f4b04104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 --2- 172.21.15.31:0/2756221341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041008b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 -- 172.21.15.31:0/2756221341 >> 172.21.15.31:0/2756221341 conn(0x7f4b040fbda0 msgr2=0x7f4b040fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.395+0000 7f4b09500700 1 -- 172.21.15.31:0/2756221341 shutdown_connections 2024-09-17T02:03:39.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.396+0000 7f4b09500700 1 -- 172.21.15.31:0/2756221341 wait complete. 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.396+0000 7f4b09500700 1 Processor -- start 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.396+0000 7f4b09500700 1 -- start start 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b09500700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b09500700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b04100e80 0x7f4b041985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b09500700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04198cc0 con 0x7f4b041004e0 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b09500700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0419ca50 con 0x7f4b04100e80 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40896/0 (socket says 172.21.15.31:40896) 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 -- 172.21.15.31:0/2448809065 learned_addr learned my addr 172.21.15.31:0/2448809065 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b027fc700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b04100e80 0x7f4b041985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 -- 172.21.15.31:0/2448809065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b04100e80 msgr2=0x7f4b041985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b04100e80 0x7f4b041985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 -- 172.21.15.31:0/2448809065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40095f0 con 0x7f4b041004e0 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.397+0000 7f4b02ffd700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041980a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4af4006010 tx=0x7f4af400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.398+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af401d070 con 0x7f4b041004e0 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.398+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4af400f460 con 0x7f4b041004e0 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.398+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0419ccd0 con 0x7f4b041004e0 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.398+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af4017610 con 0x7f4b041004e0 2024-09-17T02:03:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.398+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0419d1c0 con 0x7f4b041004e0 2024-09-17T02:03:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.399+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b041045d0 con 0x7f4b041004e0 2024-09-17T02:03:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.399+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4af400f5d0 con 0x7f4b041004e0 2024-09-17T02:03:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.400+0000 7f4aebfff700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4aec06e680 0x7f4aec070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.400+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f4af408fc00 con 0x7f4b041004e0 2024-09-17T02:03:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.400+0000 7f4b027fc700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4aec06e680 0x7f4aec070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:39.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.400+0000 7f4b027fc700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4aec06e680 0x7f4aec070b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4af8005950 tx=0x7f4af80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:39.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.404+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4af4095020 con 0x7f4b041004e0 2024-09-17T02:03:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.664+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f4b0404f2a0 con 0x7f4b041004e0 2024-09-17T02:03:39.664 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:39 smithi031 ceph-mon[77274]: pgmap v343: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.665+0000 7f4aebfff700 1 -- 172.21.15.31:0/2448809065 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v44) v1 ==== 107+0+4929 (secure 0 0 0) 0x7f4af4058d90 con 0x7f4b041004e0 2024-09-17T02:03:39.664 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:39.664 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"btime":"2024-09-17T01:58:09:449003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:08.581780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24269,14464]},"id":1}]} 2024-09-17T02:03:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4aec06e680 msgr2=0x7f4aec070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4aec06e680 0x7f4aec070b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4af8005950 tx=0x7f4af80058e0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 msgr2=0x7f4b041980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041980a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4af4006010 tx=0x7f4af400be20 comp rx=0 tx=0).stop 2024-09-17T02:03:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 shutdown_connections 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f4aec06e680 0x7f4aec070b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b041004e0 0x7f4b041980a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.667+0000 7f4b09500700 1 --2- 172.21.15.31:0/2448809065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b04100e80 0x7f4b041985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.668+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 >> 172.21.15.31:0/2448809065 conn(0x7f4b040fbda0 msgr2=0x7f4b040fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.668+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 shutdown_connections 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:39.668+0000 7f4b09500700 1 -- 172.21.15.31:0/2448809065 wait complete. 2024-09-17T02:03:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 21 2024-09-17T02:03:39.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:39 smithi092 ceph-mon[64495]: pgmap v343: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:40.273 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-09-17T02:03:40.273 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-17T02:03:40.273 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-17T02:03:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:40 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2448809065' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-17T02:03:40.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:40 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2448809065' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-17T02:03:41.687 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:41 smithi031 ceph-mon[77274]: pgmap v344: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:41.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:41 smithi092 ceph-mon[64495]: pgmap v344: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.282+0000 7f1412275700 1 -- 172.21.15.31:0/1232286467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c0ffbd0 msgr2=0x7f140c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.282+0000 7f1412275700 1 --2- 172.21.15.31:0/1232286467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c0ffbd0 0x7f140c100040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1400009910 tx=0x7f1400009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 -- 172.21.15.31:0/1232286467 shutdown_connections 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 --2- 172.21.15.31:0/1232286467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c0ffbd0 0x7f140c100040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 --2- 172.21.15.31:0/1232286467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c104130 0x7f140c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 -- 172.21.15.31:0/1232286467 >> 172.21.15.31:0/1232286467 conn(0x7f140c075130 msgr2=0x7f140c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 -- 172.21.15.31:0/1232286467 shutdown_connections 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 -- 172.21.15.31:0/1232286467 wait complete. 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 Processor -- start 2024-09-17T02:03:42.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.283+0000 7f1412275700 1 -- start start 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f1412275700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0ffbd0 0x7f140c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f1412275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 0x7f140c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f1412275700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1977e0 con 0x7f140c104130 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f1412275700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c197950 con 0x7f140c0ffbd0 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 0x7f140c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 0x7f140c1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40904/0 (socket says 172.21.15.31:40904) 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 -- 172.21.15.31:0/2998574075 learned_addr learned my addr 172.21.15.31:0/2998574075 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140bfff700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0ffbd0 0x7f140c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 -- 172.21.15.31:0/2998574075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0ffbd0 msgr2=0x7f140c196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0ffbd0 0x7f140c196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:42.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 -- 172.21.15.31:0/2998574075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14000095f0 con 0x7f140c104130 2024-09-17T02:03:42.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.284+0000 7f140b7fe700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 0x7f140c1971c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f140000b7d0 tx=0x7f140000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:42.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.285+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140001d070 con 0x7f140c104130 2024-09-17T02:03:42.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.285+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14000052a0 con 0x7f140c104130 2024-09-17T02:03:42.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.285+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c19fcf0 con 0x7f140c104130 2024-09-17T02:03:42.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.285+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1400022470 con 0x7f140c104130 2024-09-17T02:03:42.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.285+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c1a0160 con 0x7f140c104130 2024-09-17T02:03:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.286+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c04f2a0 con 0x7f140c104130 2024-09-17T02:03:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.286+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f140000f850 con 0x7f140c104130 2024-09-17T02:03:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.287+0000 7f14097fa700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f13f406e680 0x7f13f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.287+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f140008fcd0 con 0x7f140c104130 2024-09-17T02:03:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.287+0000 7f140bfff700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f13f406e680 0x7f13f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:42.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.287+0000 7f140bfff700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f13f406e680 0x7f13f4070b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009c60 tx=0x7f13fc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:42.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.292+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1400058d00 con 0x7f140c104130 2024-09-17T02:03:42.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.554+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f140c068b50 con 0x7f140c104130 2024-09-17T02:03:42.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.555+0000 7f14097fa700 1 -- 172.21.15.31:0/2998574075 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v44) v1 ==== 107+0+4925 (secure 0 0 0) 0x7f140005c3c0 con 0x7f140c104130 2024-09-17T02:03:42.554 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:42.554 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":22,"btime":"2024-09-17T01:58:09:453881+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:09.453879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:stopping","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-17T02:03:42.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.557+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f13f406e680 msgr2=0x7f13f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:42.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.557+0000 7f1412275700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f13f406e680 0x7f13f4070b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009c60 tx=0x7f13fc009260 comp rx=0 tx=0).stop 2024-09-17T02:03:42.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.557+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 msgr2=0x7f140c1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:42.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.557+0000 7f1412275700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 0x7f140c1971c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f140000b7d0 tx=0x7f140000bf90 comp rx=0 tx=0).stop 2024-09-17T02:03:42.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 shutdown_connections 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f13f406e680 0x7f13f4070b30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f140c0ffbd0 0x7f140c196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 --2- 172.21.15.31:0/2998574075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f140c104130 0x7f140c1971c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 >> 172.21.15.31:0/2998574075 conn(0x7f140c075130 msgr2=0x7f140c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 shutdown_connections 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:42.558+0000 7f1412275700 1 -- 172.21.15.31:0/2998574075 wait complete. 2024-09-17T02:03:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 22 2024-09-17T02:03:43.255 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-09-17T02:03:43.255 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-17T02:03:43.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-17T02:03:43.475 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:43 smithi031 ceph-mon[77274]: pgmap v345: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:43.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:43 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2998574075' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T02:03:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:43 smithi092 ceph-mon[64495]: pgmap v345: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:43 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2998574075' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T02:03:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:44 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:03:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:44 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 -- 172.21.15.31:0/2789571508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c0ffbd0 msgr2=0x7fce2c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 --2- 172.21.15.31:0/2789571508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c0ffbd0 0x7fce2c100040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce20009910 tx=0x7fce20009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 -- 172.21.15.31:0/2789571508 shutdown_connections 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 --2- 172.21.15.31:0/2789571508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c0ffbd0 0x7fce2c100040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 --2- 172.21.15.31:0/2789571508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce2c104130 0x7fce2c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 -- 172.21.15.31:0/2789571508 >> 172.21.15.31:0/2789571508 conn(0x7fce2c075130 msgr2=0x7fce2c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:45.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 -- 172.21.15.31:0/2789571508 shutdown_connections 2024-09-17T02:03:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 -- 172.21.15.31:0/2789571508 wait complete. 2024-09-17T02:03:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.207+0000 7fce31c62700 1 Processor -- start 2024-09-17T02:03:45.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce31c62700 1 -- start start 2024-09-17T02:03:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce31c62700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce2c0ffbd0 0x7fce2c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce31c62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 0x7fce2c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce31c62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c197800 con 0x7fce2c104130 2024-09-17T02:03:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce31c62700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c197940 con 0x7fce2c0ffbd0 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 0x7fce2c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 0x7fce2c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42344/0 (socket says 172.21.15.31:42344) 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2affd700 1 -- 172.21.15.31:0/3767426944 learned_addr learned my addr 172.21.15.31:0/3767426944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2b7fe700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce2c0ffbd0 0x7fce2c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2affd700 1 -- 172.21.15.31:0/3767426944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce2c0ffbd0 msgr2=0x7fce2c196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2affd700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce2c0ffbd0 0x7fce2c196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.208+0000 7fce2affd700 1 -- 172.21.15.31:0/3767426944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200095f0 con 0x7fce2c104130 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.209+0000 7fce2affd700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 0x7fce2c1971e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fce2000b7d0 tx=0x7fce2000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.209+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2001d070 con 0x7fce2c104130 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.209+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c19fd10 con 0x7fce2c104130 2024-09-17T02:03:45.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.209+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce200052a0 con 0x7fce2c104130 2024-09-17T02:03:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.209+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce20022470 con 0x7fce2c104130 2024-09-17T02:03:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.209+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c1a0120 con 0x7fce2c104130 2024-09-17T02:03:45.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.210+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c04f2a0 con 0x7fce2c104130 2024-09-17T02:03:45.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.211+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fce2000f850 con 0x7fce2c104130 2024-09-17T02:03:45.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.211+0000 7fce28ff9700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fce1406e680 0x7fce14070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:45.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.211+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fce2008fbd0 con 0x7fce2c104130 2024-09-17T02:03:45.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.211+0000 7fce2b7fe700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fce1406e680 0x7fce14070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:45.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.212+0000 7fce2b7fe700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fce1406e680 0x7fce14070b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009c60 tx=0x7fce1c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:45.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.216+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce20058ca0 con 0x7fce2c104130 2024-09-17T02:03:45.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.482+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fce2c068b30 con 0x7fce2c104130 2024-09-17T02:03:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.483+0000 7fce28ff9700 1 -- 172.21.15.31:0/3767426944 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v44) v1 ==== 107+0+4926 (secure 0 0 0) 0x7fce2005c360 con 0x7fce2c104130 2024-09-17T02:03:45.566 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:45.566 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"btime":"2024-09-17T01:58:16:396354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:16.081654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi092.xzgrcs","rank":1,"incarnation":8,"state":"up:stopping","state_seq":3,"addr":"172.21.15.92:6825/1268254194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1268254194},{"type":"v1","addr":"172.21.15.92:6825","nonce":1268254194}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-17T02:03:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.485+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fce1406e680 msgr2=0x7fce14070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.485+0000 7fce31c62700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fce1406e680 0x7fce14070b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009c60 tx=0x7fce1c009260 comp rx=0 tx=0).stop 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.485+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 msgr2=0x7fce2c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.485+0000 7fce31c62700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 0x7fce2c1971e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fce2000b7d0 tx=0x7fce2000bf90 comp rx=0 tx=0).stop 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 shutdown_connections 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fce1406e680 0x7fce14070b30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce2c0ffbd0 0x7fce2c196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 --2- 172.21.15.31:0/3767426944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2c104130 0x7fce2c1971e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 >> 172.21.15.31:0/3767426944 conn(0x7fce2c075130 msgr2=0x7fce2c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 shutdown_connections 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:45.486+0000 7fce31c62700 1 -- 172.21.15.31:0/3767426944 wait complete. 2024-09-17T02:03:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 23 2024-09-17T02:03:45.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: pgmap v346: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:03:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:03:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:03:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:03:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:03:45.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:45 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3767426944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T02:03:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: pgmap v346: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:03:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:03:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:03:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:03:45.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:03:45.990 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:45 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3767426944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T02:03:46.166 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-17T02:03:46.166 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-17T02:03:46.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-17T02:03:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:47 smithi092 ceph-mon[64495]: pgmap v347: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:47.992 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:47 smithi031 ceph-mon[77274]: pgmap v347: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.001+0000 7f472a2ce700 1 -- 172.21.15.31:0/2551711231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47241004e0 msgr2=0x7f47241008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.001+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2551711231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47241004e0 0x7f47241008b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4714009910 tx=0x7f4714009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 -- 172.21.15.31:0/2551711231 shutdown_connections 2024-09-17T02:03:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2551711231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4724100e80 0x7f4724104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2551711231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47241004e0 0x7f47241008b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 -- 172.21.15.31:0/2551711231 >> 172.21.15.31:0/2551711231 conn(0x7f47240fbda0 msgr2=0x7f47240fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 -- 172.21.15.31:0/2551711231 shutdown_connections 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 -- 172.21.15.31:0/2551711231 wait complete. 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 Processor -- start 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.002+0000 7f472a2ce700 1 -- start start 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f472a2ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47241004e0 0x7f4724073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f472a2ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 0x7f4724073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f472a2ce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724073ad0 con 0x7f4724100e80 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f472a2ce700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724073c10 con 0x7f47241004e0 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 0x7f4724073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f4723fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47241004e0 0x7f4724073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 0x7f4724073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42370/0 (socket says 172.21.15.31:42370) 2024-09-17T02:03:48.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 -- 172.21.15.31:0/2775379174 learned_addr learned my addr 172.21.15.31:0/2775379174 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 -- 172.21.15.31:0/2775379174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47241004e0 msgr2=0x7f4724073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47241004e0 0x7f4724073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 -- 172.21.15.31:0/2775379174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140095f0 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f4723fff700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47241004e0 0x7f4724073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.003+0000 7f47237fe700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 0x7f4724073590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f471800c8f0 tx=0x7f471800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.004+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47180078a0 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.004+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47241a20c0 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.004+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47241a24d0 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.004+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4718004830 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.004+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4718005530 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.005+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4710005320 con 0x7f4724100e80 2024-09-17T02:03:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.005+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4718007a00 con 0x7f4724100e80 2024-09-17T02:03:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.006+0000 7f47217fa700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f470c06e680 0x7f470c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.006+0000 7f4723fff700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f470c06e680 0x7f470c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.006+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f471808e5d0 con 0x7f4724100e80 2024-09-17T02:03:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.006+0000 7f4723fff700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f470c06e680 0x7f470c070b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4714006010 tx=0x7f471401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:48.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.010+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47180576a0 con 0x7f4724100e80 2024-09-17T02:03:48.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.269+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f4710005190 con 0x7f4724100e80 2024-09-17T02:03:48.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.270+0000 7f47217fa700 1 -- 172.21.15.31:0/2775379174 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v44) v1 ==== 107+0+4130 (secure 0 0 0) 0x7f4718007cb0 con 0x7f4724100e80 2024-09-17T02:03:48.269 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:48.269 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"btime":"2024-09-17T01:58:41:299391+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:41.082832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-17T02:03:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f470c06e680 msgr2=0x7f470c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f470c06e680 0x7f470c070b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4714006010 tx=0x7f471401a040 comp rx=0 tx=0).stop 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 msgr2=0x7f4724073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 0x7f4724073590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f471800c8f0 tx=0x7f471800cc00 comp rx=0 tx=0).stop 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 shutdown_connections 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f470c06e680 0x7f470c070b30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47241004e0 0x7f4724073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 --2- 172.21.15.31:0/2775379174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4724100e80 0x7f4724073590 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 >> 172.21.15.31:0/2775379174 conn(0x7f47240fbda0 msgr2=0x7f47240fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 shutdown_connections 2024-09-17T02:03:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:48.272+0000 7f472a2ce700 1 -- 172.21.15.31:0/2775379174 wait complete. 2024-09-17T02:03:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 24 2024-09-17T02:03:48.932 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:48 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2775379174' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T02:03:48.951 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-17T02:03:48.951 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-17T02:03:48.951 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-17T02:03:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:48 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2775379174' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T02:03:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:49.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:49 smithi092 ceph-mon[64495]: pgmap v348: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:50.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:49 smithi031 ceph-mon[77274]: pgmap v348: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:50.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 -- 172.21.15.31:0/677364938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 msgr2=0x7f9adc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:50.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/677364938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc104e50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009910 tx=0x7f9acc009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 -- 172.21.15.31:0/677364938 shutdown_connections 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/677364938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc104e50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/677364938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc1004e0 0x7f9adc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 -- 172.21.15.31:0/677364938 >> 172.21.15.31:0/677364938 conn(0x7f9adc0fbda0 msgr2=0x7f9adc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 -- 172.21.15.31:0/677364938 shutdown_connections 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.856+0000 7f9ae37b4700 1 -- 172.21.15.31:0/677364938 wait complete. 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae37b4700 1 Processor -- start 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae37b4700 1 -- start start 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae37b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc1004e0 0x7f9adc073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae37b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae37b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc073ad0 con 0x7f9adc100e80 2024-09-17T02:03:50.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae37b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc073c10 con 0x7f9adc1004e0 2024-09-17T02:03:50.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:50.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42388/0 (socket says 172.21.15.31:42388) 2024-09-17T02:03:50.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 -- 172.21.15.31:0/1380046438 learned_addr learned my addr 172.21.15.31:0/1380046438 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:50.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae1550700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc1004e0 0x7f9adc073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 -- 172.21.15.31:0/1380046438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc1004e0 msgr2=0x7f9adc073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc1004e0 0x7f9adc073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 -- 172.21.15.31:0/1380046438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0095f0 con 0x7f9adc100e80 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.857+0000 7f9ae0d4f700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc073590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00bda0 tx=0x7f9acc00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.858+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9acc01d070 con 0x7f9adc100e80 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.858+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9acc005dc0 con 0x7f9adc100e80 2024-09-17T02:03:50.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.858+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc073e90 con 0x7f9adc100e80 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.858+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9acc017400 con 0x7f9adc100e80 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.858+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc1a2410 con 0x7f9adc100e80 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.859+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc108850 con 0x7f9adc100e80 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.859+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9acc00f460 con 0x7f9adc100e80 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.860+0000 7f9ad27fc700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ac806e680 0x7f9ac8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.860+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f9acc08fb00 con 0x7f9adc100e80 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.860+0000 7f9ae1550700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ac806e680 0x7f9ac8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:50.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.860+0000 7f9ae1550700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ac806e680 0x7f9ac8070b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005950 tx=0x7f9ad800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:50.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:50.864+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9acc058bd0 con 0x7f9adc100e80 2024-09-17T02:03:50.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:51.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:03:51.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.128+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f9adc074620 con 0x7f9adc100e80 2024-09-17T02:03:51.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.128+0000 7f9ad27fc700 1 -- 172.21.15.31:0/1380046438 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v44) v1 ==== 107+0+4909 (secure 0 0 0) 0x7f9acc05c290 con 0x7f9adc100e80 2024-09-17T02:03:51.127 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:51.127 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"btime":"2024-09-17T01:58:42:300977+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:41.082832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6827/3872851712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3872851712},{"type":"v1","addr":"172.21.15.31:6827","nonce":3872851712}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-17T02:03:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ac806e680 msgr2=0x7f9ac8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ac806e680 0x7f9ac8070b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005950 tx=0x7f9ad800b410 comp rx=0 tx=0).stop 2024-09-17T02:03:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 msgr2=0x7f9adc073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc073590 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00bda0 tx=0x7f9acc00bdd0 comp rx=0 tx=0).stop 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 shutdown_connections 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f9ac806e680 0x7f9ac8070b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc1004e0 0x7f9adc073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 --2- 172.21.15.31:0/1380046438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9adc100e80 0x7f9adc073590 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 >> 172.21.15.31:0/1380046438 conn(0x7f9adc0fbda0 msgr2=0x7f9adc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 shutdown_connections 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:51.131+0000 7f9ae37b4700 1 -- 172.21.15.31:0/1380046438 wait complete. 2024-09-17T02:03:51.130 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 25 2024-09-17T02:03:51.902 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-17T02:03:51.902 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-17T02:03:51.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-17T02:03:51.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:51 smithi092 ceph-mon[64495]: pgmap v349: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:51.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:51 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1380046438' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T02:03:52.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:51 smithi031 ceph-mon[77274]: pgmap v349: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:52.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:51 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1380046438' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T02:03:52.114 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:53.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 -- 172.21.15.31:0/3855893302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 msgr2=0x7fe770103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:53.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 --2- 172.21.15.31:0/3855893302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770103d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe760009910 tx=0x7fe760009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:53.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 -- 172.21.15.31:0/3855893302 shutdown_connections 2024-09-17T02:03:53.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 --2- 172.21.15.31:0/3855893302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770103d30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:53.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 --2- 172.21.15.31:0/3855893302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7700ff3c0 0x7fe7700ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:53.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 -- 172.21.15.31:0/3855893302 >> 172.21.15.31:0/3855893302 conn(0x7fe7700fac80 msgr2=0x7fe7700fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:53.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 -- 172.21.15.31:0/3855893302 shutdown_connections 2024-09-17T02:03:53.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.971+0000 7fe7750a3700 1 -- 172.21.15.31:0/3855893302 wait complete. 2024-09-17T02:03:53.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.972+0000 7fe7750a3700 1 Processor -- start 2024-09-17T02:03:53.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.972+0000 7fe7750a3700 1 -- start start 2024-09-17T02:03:53.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.972+0000 7fe7750a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7700ff3c0 0x7fe770196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:53.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.972+0000 7fe7750a3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:53.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.972+0000 7fe7750a3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770197880 con 0x7fe7700ffd60 2024-09-17T02:03:53.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.972+0000 7fe7750a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7701979f0 con 0x7fe7700ff3c0 2024-09-17T02:03:53.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:53.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45300/0 (socket says 172.21.15.31:45300) 2024-09-17T02:03:53.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 -- 172.21.15.31:0/1064554925 learned_addr learned my addr 172.21.15.31:0/1064554925 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:53.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76ed9d700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7700ff3c0 0x7fe770196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:53.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 -- 172.21.15.31:0/1064554925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7700ff3c0 msgr2=0x7fe770196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:53.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7700ff3c0 0x7fe770196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:53.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 -- 172.21.15.31:0/1064554925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600095f0 con 0x7fe7700ffd60 2024-09-17T02:03:53.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe76e59c700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770197260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe7600059d0 tx=0x7fe76000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:53.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76001d070 con 0x7fe7700ffd60 2024-09-17T02:03:53.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe76000b610 con 0x7fe7700ffd60 2024-09-17T02:03:53.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.973+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77019fd90 con 0x7fe7700ffd60 2024-09-17T02:03:53.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.974+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe760022470 con 0x7fe7700ffd60 2024-09-17T02:03:53.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.974+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7701a0200 con 0x7fe7700ffd60 2024-09-17T02:03:53.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.975+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe770107730 con 0x7fe7700ffd60 2024-09-17T02:03:53.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.975+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe76000fac0 con 0x7fe7700ffd60 2024-09-17T02:03:53.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.976+0000 7fe767fff700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe75c06e680 0x7fe75c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:53.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.976+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe76008fb10 con 0x7fe7700ffd60 2024-09-17T02:03:53.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.976+0000 7fe76ed9d700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe75c06e680 0x7fe75c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:53.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.976+0000 7fe76ed9d700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe75c06e680 0x7fe75c070b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe758009c60 tx=0x7fe758009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:53.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:53.984+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe760058d10 con 0x7fe7700ffd60 2024-09-17T02:03:53.983 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:53 smithi031 ceph-mon[77274]: pgmap v350: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:53 smithi092 ceph-mon[64495]: pgmap v350: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:54.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.242+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fe77004f2a0 con 0x7fe7700ffd60 2024-09-17T02:03:54.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.243+0000 7fe767fff700 1 -- 172.21.15.31:0/1064554925 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v44) v1 ==== 107+0+4112 (secure 0 0 0) 0x7fe76005c3d0 con 0x7fe7700ffd60 2024-09-17T02:03:54.242 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:54.242 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":26,"btime":"2024-09-17T01:58:53:896609+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:53.896607+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:03:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.245+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe75c06e680 msgr2=0x7fe75c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.245+0000 7fe7750a3700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe75c06e680 0x7fe75c070b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe758009c60 tx=0x7fe758009260 comp rx=0 tx=0).stop 2024-09-17T02:03:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.245+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 msgr2=0x7fe770197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.245+0000 7fe7750a3700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770197260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe7600059d0 tx=0x7fe76000f690 comp rx=0 tx=0).stop 2024-09-17T02:03:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.245+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 shutdown_connections 2024-09-17T02:03:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.246+0000 7fe7750a3700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe75c06e680 0x7fe75c070b30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.246+0000 7fe7750a3700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7700ff3c0 0x7fe770196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.246+0000 7fe7750a3700 1 --2- 172.21.15.31:0/1064554925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7700ffd60 0x7fe770197260 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.246+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 >> 172.21.15.31:0/1064554925 conn(0x7fe7700fac80 msgr2=0x7fe7700fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.246+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 shutdown_connections 2024-09-17T02:03:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:54.246+0000 7fe7750a3700 1 -- 172.21.15.31:0/1064554925 wait complete. 2024-09-17T02:03:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 26 2024-09-17T02:03:54.875 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:54 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1064554925' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T02:03:54.900 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-17T02:03:54.900 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-17T02:03:54.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-17T02:03:55.110 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:55.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:54 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1064554925' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T02:03:56.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:55 smithi031 ceph-mon[77274]: pgmap v351: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:56.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:55 smithi092 ceph-mon[64495]: pgmap v351: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:56.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.818+0000 7f3b6052c700 1 -- 172.21.15.31:0/1772894757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 msgr2=0x7f3b580ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.818+0000 7f3b6052c700 1 --2- 172.21.15.31:0/1772894757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b580ff7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009910 tx=0x7f3b54009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.818+0000 7f3b6052c700 1 -- 172.21.15.31:0/1772894757 shutdown_connections 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 --2- 172.21.15.31:0/1772894757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580ffce0 0x7f3b5810a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 --2- 172.21.15.31:0/1772894757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b580ff7a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 -- 172.21.15.31:0/1772894757 >> 172.21.15.31:0/1772894757 conn(0x7f3b58074930 msgr2=0x7f3b58074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 -- 172.21.15.31:0/1772894757 shutdown_connections 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 -- 172.21.15.31:0/1772894757 wait complete. 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 Processor -- start 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 -- start start 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b58195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:56.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580ffce0 0x7f3b58196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58196b00 con 0x7f3b580ff3d0 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.819+0000 7f3b6052c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5819a890 con 0x7f3b580ffce0 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b58195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b58195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45326/0 (socket says 172.21.15.31:45326) 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 -- 172.21.15.31:0/2701536478 learned_addr learned my addr 172.21.15.31:0/2701536478 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5dac7700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580ffce0 0x7f3b58196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 -- 172.21.15.31:0/2701536478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580ffce0 msgr2=0x7f3b58196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580ffce0 0x7f3b58196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 -- 172.21.15.31:0/2701536478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540095f0 con 0x7f3b580ff3d0 2024-09-17T02:03:56.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b5e2c8700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b58195ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3b54000c00 tx=0x7f3b540055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5401d070 con 0x7f3b580ff3d0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b5400f460 con 0x7f3b580ff3d0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5819ab10 con 0x7f3b580ff3d0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b54021640 con 0x7f3b580ff3d0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.820+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5819b060 con 0x7f3b580ff3d0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.821+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58107e50 con 0x7f3b580ff3d0 2024-09-17T02:03:56.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.822+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3b5400fa60 con 0x7f3b580ff3d0 2024-09-17T02:03:56.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.822+0000 7f3b4f7fe700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b4406e680 0x7f3b44070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:56.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.823+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3b5408f9f0 con 0x7f3b580ff3d0 2024-09-17T02:03:56.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.823+0000 7f3b5dac7700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b4406e680 0x7f3b44070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:56.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.823+0000 7f3b5dac7700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b4406e680 0x7f3b44070b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b58197500 tx=0x7f3b48009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:56.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:56.827+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3b54058a60 con 0x7f3b580ff3d0 2024-09-17T02:03:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.084+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f3b5804f2a0 con 0x7f3b580ff3d0 2024-09-17T02:03:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.085+0000 7f3b4f7fe700 1 -- 172.21.15.31:0/2701536478 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v44) v1 ==== 107+0+4123 (secure 0 0 0) 0x7f3b5405c120 con 0x7f3b580ff3d0 2024-09-17T02:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"btime":"2024-09-17T01:58:53:901429+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:58:53.901417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:03:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b4406e680 msgr2=0x7f3b44070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b4406e680 0x7f3b44070b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b58197500 tx=0x7f3b48009190 comp rx=0 tx=0).stop 2024-09-17T02:03:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 msgr2=0x7f3b58195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b58195ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3b54000c00 tx=0x7f3b540055f0 comp rx=0 tx=0).stop 2024-09-17T02:03:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 shutdown_connections 2024-09-17T02:03:57.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3b4406e680 0x7f3b44070b30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b580ff3d0 0x7f3b58195ee0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.087+0000 7f3b6052c700 1 --2- 172.21.15.31:0/2701536478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b580ffce0 0x7f3b58196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.088+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 >> 172.21.15.31:0/2701536478 conn(0x7f3b58074930 msgr2=0x7f3b58104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.088+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 shutdown_connections 2024-09-17T02:03:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:57.088+0000 7f3b6052c700 1 -- 172.21.15.31:0/2701536478 wait complete. 2024-09-17T02:03:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 27 2024-09-17T02:03:57.791 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-17T02:03:57.791 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-17T02:03:57.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-17T02:03:58.003 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:03:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:57 smithi031 ceph-mon[77274]: pgmap v352: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:57 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2701536478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T02:03:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:57 smithi092 ceph-mon[64495]: pgmap v352: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:03:58.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:57 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2701536478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 -- 172.21.15.31:0/685075087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e40ffbd0 msgr2=0x7fc8e4100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/685075087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e40ffbd0 0x7fc8e4100040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009910 tx=0x7fc8d4009c20 comp rx=0 tx=0).stop 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 -- 172.21.15.31:0/685075087 shutdown_connections 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/685075087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e40ffbd0 0x7fc8e4100040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/685075087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e4104130 0x7fc8e4104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 -- 172.21.15.31:0/685075087 >> 172.21.15.31:0/685075087 conn(0x7fc8e4075130 msgr2=0x7fc8e4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 -- 172.21.15.31:0/685075087 shutdown_connections 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.632+0000 7fc8ead0a700 1 -- 172.21.15.31:0/685075087 wait complete. 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8ead0a700 1 Processor -- start 2024-09-17T02:03:59.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8ead0a700 1 -- start start 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8ead0a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e40ffbd0 0x7fc8e4195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8ead0a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 0x7fc8e4196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8ead0a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e41969e0 con 0x7fc8e4104130 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8ead0a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4196b20 con 0x7fc8e40ffbd0 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8e3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 0x7fc8e4196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8e3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 0x7fc8e4196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45334/0 (socket says 172.21.15.31:45334) 2024-09-17T02:03:59.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.633+0000 7fc8e3fff700 1 -- 172.21.15.31:0/2710018943 learned_addr learned my addr 172.21.15.31:0/2710018943 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:03:59.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e8aa6700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e40ffbd0 0x7fc8e4195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e3fff700 1 -- 172.21.15.31:0/2710018943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e40ffbd0 msgr2=0x7fc8e4195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e3fff700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e40ffbd0 0x7fc8e4195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e3fff700 1 -- 172.21.15.31:0/2710018943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40095f0 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e3fff700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 0x7fc8e4196390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40092e0 tx=0x7fc8d400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d401d070 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8d400f460 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d4017630 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e419a8a0 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.634+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e419ad90 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.635+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e41086a0 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.636+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc8d400f5d0 con 0x7fc8e4104130 2024-09-17T02:03:59.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.636+0000 7fc8e1ffb700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc8d006e680 0x7fc8d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:03:59.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.636+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc8d408fc50 con 0x7fc8e4104130 2024-09-17T02:03:59.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.636+0000 7fc8e8aa6700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc8d006e680 0x7fc8d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:03:59.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.637+0000 7fc8e8aa6700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc8d006e680 0x7fc8d0070b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc005ea0 tx=0x7fc8cc005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:03:59.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.641+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc8d4058da0 con 0x7fc8e4104130 2024-09-17T02:03:59.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.902+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fc8e4108080 con 0x7fc8e4104130 2024-09-17T02:03:59.901 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:03:59 smithi031 ceph-mon[77274]: pgmap v353: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:03:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.902+0000 7fc8e1ffb700 1 -- 172.21.15.31:0/2710018943 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v44) v1 ==== 107+0+4127 (secure 0 0 0) 0x7fc8d405c460 con 0x7fc8e4104130 2024-09-17T02:03:59.902 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:03:59.902 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":28,"btime":"2024-09-17T01:59:01:079124+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:00.516858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:03:59.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc8d006e680 msgr2=0x7fc8d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:59.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc8d006e680 0x7fc8d0070b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc005ea0 tx=0x7fc8cc005e30 comp rx=0 tx=0).stop 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 msgr2=0x7fc8e4196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 0x7fc8e4196390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40092e0 tx=0x7fc8d400be00 comp rx=0 tx=0).stop 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 shutdown_connections 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc8d006e680 0x7fc8d0070b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e40ffbd0 0x7fc8e4195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 --2- 172.21.15.31:0/2710018943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e4104130 0x7fc8e4196390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 >> 172.21.15.31:0/2710018943 conn(0x7fc8e4075130 msgr2=0x7fc8e40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 shutdown_connections 2024-09-17T02:03:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:03:59.905+0000 7fc8ead0a700 1 -- 172.21.15.31:0/2710018943 wait complete. 2024-09-17T02:03:59.905 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 28 2024-09-17T02:04:00.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:03:59 smithi092 ceph-mon[64495]: pgmap v353: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:00.627 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-17T02:04:00.627 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-17T02:04:00.627 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-17T02:04:00.836 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:00.957 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:00 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2710018943' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T02:04:01.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:00 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2710018943' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T02:04:01.961 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:01 smithi031 ceph-mon[77274]: pgmap v354: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:02.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:01 smithi092 ceph-mon[64495]: pgmap v354: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2577822026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c00ffbd0 msgr2=0x7ff7c0100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2577822026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009910 tx=0x7ff7b4009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2577822026 shutdown_connections 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2577822026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2577822026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c0104130 0x7ff7c0104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2577822026 >> 172.21.15.31:0/2577822026 conn(0x7ff7c0075130 msgr2=0x7ff7c0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2577822026 shutdown_connections 2024-09-17T02:04:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2577822026 wait complete. 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.474+0000 7ff7c59c0700 1 Processor -- start 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7c59c0700 1 -- start start 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7c59c0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7c59c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 0x7ff7c0101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7c59c0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01018b0 con 0x7ff7c0104130 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7c59c0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01019f0 con 0x7ff7c00ffbd0 2024-09-17T02:04:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7be7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 0x7ff7c0101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7be7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 0x7ff7c0101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45346/0 (socket says 172.21.15.31:45346) 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7be7fc700 1 -- 172.21.15.31:0/2540695404 learned_addr learned my addr 172.21.15.31:0/2540695404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7beffd700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7be7fc700 1 -- 172.21.15.31:0/2540695404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c00ffbd0 msgr2=0x7ff7c0100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7be7fc700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7be7fc700 1 -- 172.21.15.31:0/2540695404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40095f0 con 0x7ff7c0104130 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.475+0000 7ff7beffd700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.476+0000 7ff7be7fc700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 0x7ff7c0101370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400bd70 tx=0x7ff7b400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.476+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b401d070 con 0x7ff7c0104130 2024-09-17T02:04:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.476+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c0101c70 con 0x7ff7c0104130 2024-09-17T02:04:02.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.476+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7b400f460 con 0x7ff7c0104130 2024-09-17T02:04:02.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.476+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b4017630 con 0x7ff7c0104130 2024-09-17T02:04:02.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.476+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c01a2430 con 0x7ff7c0104130 2024-09-17T02:04:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.477+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c01086a0 con 0x7ff7c0104130 2024-09-17T02:04:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.477+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff7b4003a60 con 0x7ff7c0104130 2024-09-17T02:04:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.478+0000 7ff7c49be700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff7a806e680 0x7ff7a8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.478+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7ff7b408fda0 con 0x7ff7c0104130 2024-09-17T02:04:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.478+0000 7ff7beffd700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff7a806e680 0x7ff7a8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.478+0000 7ff7beffd700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff7a806e680 0x7ff7a8070b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0007900 tx=0x7ff7b0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:02.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.483+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff7b4058e70 con 0x7ff7c0104130 2024-09-17T02:04:02.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.746+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7ff7c0108080 con 0x7ff7c0104130 2024-09-17T02:04:02.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.747+0000 7ff7c49be700 1 -- 172.21.15.31:0/2540695404 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v44) v1 ==== 107+0+4971 (secure 0 0 0) 0x7ff7b405c530 con 0x7ff7c0104130 2024-09-17T02:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T01:59:02:084186+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:01.086772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:04:02.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.749+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff7a806e680 msgr2=0x7ff7a8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:02.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.749+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff7a806e680 0x7ff7a8070b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0007900 tx=0x7ff7b0008040 comp rx=0 tx=0).stop 2024-09-17T02:04:02.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.749+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 msgr2=0x7ff7c0101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:02.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.749+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 0x7ff7c0101370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400bd70 tx=0x7ff7b400be50 comp rx=0 tx=0).stop 2024-09-17T02:04:02.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 shutdown_connections 2024-09-17T02:04:02.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff7a806e680 0x7ff7a8070b30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:02.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c00ffbd0 0x7ff7c0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:02.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 --2- 172.21.15.31:0/2540695404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7c0104130 0x7ff7c0101370 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:02.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 >> 172.21.15.31:0/2540695404 conn(0x7ff7c0075130 msgr2=0x7ff7c0068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:02.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 shutdown_connections 2024-09-17T02:04:02.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:02.750+0000 7ff7c59c0700 1 -- 172.21.15.31:0/2540695404 wait complete. 2024-09-17T02:04:02.749 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T02:04:03.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:02 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2540695404' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T02:04:03.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:02 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2540695404' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T02:04:03.408 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-17T02:04:03.408 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-17T02:04:03.409 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-17T02:04:03.617 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:04.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:03 smithi031 ceph-mon[77274]: pgmap v355: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:04.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:03 smithi092 ceph-mon[64495]: pgmap v355: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 -- 172.21.15.31:0/148133200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4801004c0 msgr2=0x7fb480100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 --2- 172.21.15.31:0/148133200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4801004c0 0x7fb480100890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009910 tx=0x7fb47c009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 -- 172.21.15.31:0/148133200 shutdown_connections 2024-09-17T02:04:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 --2- 172.21.15.31:0/148133200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb480100e60 0x7fb480104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 --2- 172.21.15.31:0/148133200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4801004c0 0x7fb480100890 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 -- 172.21.15.31:0/148133200 >> 172.21.15.31:0/148133200 conn(0x7fb4800fbd80 msgr2=0x7fb4800fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:05.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 -- 172.21.15.31:0/148133200 shutdown_connections 2024-09-17T02:04:05.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.289+0000 7fb48799d700 1 -- 172.21.15.31:0/148133200 wait complete. 2024-09-17T02:04:05.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.290+0000 7fb48799d700 1 Processor -- start 2024-09-17T02:04:05.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.290+0000 7fb48799d700 1 -- start start 2024-09-17T02:04:05.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.290+0000 7fb48799d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4801004c0 0x7fb480195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.290+0000 7fb48799d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 0x7fb480196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.290+0000 7fb48799d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480196b50 con 0x7fb480100e60 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.290+0000 7fb48799d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48019a8e0 con 0x7fb4801004c0 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb485739700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4801004c0 0x7fb480195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb484f38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 0x7fb480196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb485739700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4801004c0 0x7fb480195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:47622/0 (socket says 172.21.15.31:47622) 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb484f38700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 0x7fb480196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45690/0 (socket says 172.21.15.31:45690) 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb485739700 1 -- 172.21.15.31:0/3298008074 learned_addr learned my addr 172.21.15.31:0/3298008074 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb484f38700 1 -- 172.21.15.31:0/3298008074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4801004c0 msgr2=0x7fb480195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb484f38700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4801004c0 0x7fb480195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb484f38700 1 -- 172.21.15.31:0/3298008074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0095f0 con 0x7fb480100e60 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb484f38700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 0x7fb480196470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb480067ea0 tx=0x7fb47400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:05.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.291+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47400f860 con 0x7fb480100e60 2024-09-17T02:04:05.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.292+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb47400fe80 con 0x7fb480100e60 2024-09-17T02:04:05.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.292+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb474010ea0 con 0x7fb480100e60 2024-09-17T02:04:05.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.292+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48019abc0 con 0x7fb480100e60 2024-09-17T02:04:05.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.292+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48019b110 con 0x7fb480100e60 2024-09-17T02:04:05.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.293+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4801087d0 con 0x7fb480100e60 2024-09-17T02:04:05.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.294+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb474010460 con 0x7fb480100e60 2024-09-17T02:04:05.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.294+0000 7fb4727fc700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb46c06e680 0x7fb46c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:05.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.295+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb47408e420 con 0x7fb480100e60 2024-09-17T02:04:05.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.295+0000 7fb485739700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb46c06e680 0x7fb46c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.295+0000 7fb485739700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb46c06e680 0x7fb46c070b30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00b5c0 tx=0x7fb47c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:05.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.303+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb474057570 con 0x7fb480100e60 2024-09-17T02:04:05.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.569+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fb48004f2a0 con 0x7fb480100e60 2024-09-17T02:04:05.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.570+0000 7fb4727fc700 1 -- 172.21.15.31:0/3298008074 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v44) v1 ==== 107+0+4980 (secure 0 0 0) 0x7fb47405ac30 con 0x7fb480100e60 2024-09-17T02:04:05.569 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:05.569 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":30,"btime":"2024-09-17T01:59:03:090655+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:03.090653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34380},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34380":{"gid":34380,"name":"cephfs.smithi031.gszbpe","rank":0,"incarnation":27,"state":"up:active","state_seq":17,"addr":"172.21.15.31:6829/2388806534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2388806534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2388806534}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34380,"qdb_cluster":[34380]},"id":1}]} 2024-09-17T02:04:05.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb46c06e680 msgr2=0x7fb46c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:05.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb46c06e680 0x7fb46c070b30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00b5c0 tx=0x7fb47c01a040 comp rx=0 tx=0).stop 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 msgr2=0x7fb480196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 0x7fb480196470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb480067ea0 tx=0x7fb47400dbb0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 shutdown_connections 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb46c06e680 0x7fb46c070b30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4801004c0 0x7fb480195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 --2- 172.21.15.31:0/3298008074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb480100e60 0x7fb480196470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 >> 172.21.15.31:0/3298008074 conn(0x7fb4800fbd80 msgr2=0x7fb4800fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 shutdown_connections 2024-09-17T02:04:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:05.574+0000 7fb48799d700 1 -- 172.21.15.31:0/3298008074 wait complete. 2024-09-17T02:04:05.574 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 30 2024-09-17T02:04:05.881 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:05 smithi031 ceph-mon[77274]: pgmap v356: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:05.930 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:05.930 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:05 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3298008074' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T02:04:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:05 smithi092 ceph-mon[64495]: pgmap v356: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:06.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:05 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3298008074' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T02:04:06.245 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-17T02:04:06.245 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-17T02:04:06.245 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-17T02:04:06.455 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:07.921 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:07 smithi031 ceph-mon[77274]: pgmap v357: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:08.041 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:07 smithi092 ceph-mon[64495]: pgmap v357: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 -- 172.21.15.31:0/210390047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c100e80 msgr2=0x7f629c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 --2- 172.21.15.31:0/210390047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c100e80 0x7f629c104e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6290009910 tx=0x7f6290009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 -- 172.21.15.31:0/210390047 shutdown_connections 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 --2- 172.21.15.31:0/210390047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c100e80 0x7f629c104e50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 --2- 172.21.15.31:0/210390047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f629c1004e0 0x7f629c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 -- 172.21.15.31:0/210390047 >> 172.21.15.31:0/210390047 conn(0x7f629c0fbda0 msgr2=0x7f629c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 -- 172.21.15.31:0/210390047 shutdown_connections 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.179+0000 7f62a33d8700 1 -- 172.21.15.31:0/210390047 wait complete. 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a33d8700 1 Processor -- start 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a33d8700 1 -- start start 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a33d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 0x7f629c196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a33d8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f629c100e80 0x7f629c196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a33d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c196c20 con 0x7f629c1004e0 2024-09-17T02:04:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a33d8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c19a9b0 con 0x7f629c100e80 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a1174700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 0x7f629c196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a1174700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 0x7f629c196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45708/0 (socket says 172.21.15.31:45708) 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.180+0000 7f62a1174700 1 -- 172.21.15.31:0/3125383831 learned_addr learned my addr 172.21.15.31:0/3125383831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a0973700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f629c100e80 0x7f629c196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a1174700 1 -- 172.21.15.31:0/3125383831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f629c100e80 msgr2=0x7f629c196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a1174700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f629c100e80 0x7f629c196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a1174700 1 -- 172.21.15.31:0/3125383831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900095f0 con 0x7f629c1004e0 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a1174700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 0x7f629c196000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f629800b4b0 tx=0x7f629800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:08.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6298011800 con 0x7f629c1004e0 2024-09-17T02:04:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6298011e20 con 0x7f629c1004e0 2024-09-17T02:04:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c19ac90 con 0x7f629c1004e0 2024-09-17T02:04:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f629800f2e0 con 0x7f629c1004e0 2024-09-17T02:04:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.181+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c19b1b0 con 0x7f629c1004e0 2024-09-17T02:04:08.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.183+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c108780 con 0x7f629c1004e0 2024-09-17T02:04:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.183+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6298010380 con 0x7f629c1004e0 2024-09-17T02:04:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.183+0000 7f628e7fc700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f628806e680 0x7f6288070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.183+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f629808e2b0 con 0x7f629c1004e0 2024-09-17T02:04:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.183+0000 7f62a0973700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f628806e680 0x7f6288070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:08.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.184+0000 7f62a0973700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f628806e680 0x7f6288070b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6290006010 tx=0x7f629001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:08.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.188+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6298057380 con 0x7f629c1004e0 2024-09-17T02:04:08.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.450+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f629c197460 con 0x7f629c1004e0 2024-09-17T02:04:08.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.450+0000 7f628e7fc700 1 -- 172.21.15.31:0/3125383831 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v44) v1 ==== 107+0+4180 (secure 0 0 0) 0x7f629805aa40 con 0x7f629c1004e0 2024-09-17T02:04:08.448 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:08.448 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"btime":"2024-09-17T01:59:18:185213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:18.185211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:04:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.452+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f628806e680 msgr2=0x7f6288070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.452+0000 7f62a33d8700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f628806e680 0x7f6288070b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6290006010 tx=0x7f629001a040 comp rx=0 tx=0).stop 2024-09-17T02:04:08.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.452+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 msgr2=0x7f629c196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.452+0000 7f62a33d8700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 0x7f629c196000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f629800b4b0 tx=0x7f629800b7c0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 shutdown_connections 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f628806e680 0x7f6288070b30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f629c1004e0 0x7f629c196000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 --2- 172.21.15.31:0/3125383831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f629c100e80 0x7f629c196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 >> 172.21.15.31:0/3125383831 conn(0x7f629c0fbda0 msgr2=0x7f629c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 shutdown_connections 2024-09-17T02:04:08.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:08.453+0000 7f62a33d8700 1 -- 172.21.15.31:0/3125383831 wait complete. 2024-09-17T02:04:08.452 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 31 2024-09-17T02:04:09.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:08 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3125383831' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T02:04:09.069 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-17T02:04:09.069 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-17T02:04:09.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-17T02:04:09.241 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:08 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3125383831' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T02:04:09.289 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:09 smithi031 ceph-mon[77274]: pgmap v358: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:10.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:09 smithi092 ceph-mon[64495]: pgmap v358: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 -- 172.21.15.31:0/4073873952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608101c90 msgr2=0x7f160810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 --2- 172.21.15.31:0/4073873952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608101c90 0x7f160810a2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009910 tx=0x7f15f8009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 -- 172.21.15.31:0/4073873952 shutdown_connections 2024-09-17T02:04:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 --2- 172.21.15.31:0/4073873952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608101c90 0x7f160810a2d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 --2- 172.21.15.31:0/4073873952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16081012f0 0x7f16081016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 -- 172.21.15.31:0/4073873952 >> 172.21.15.31:0/4073873952 conn(0x7f16080fac80 msgr2=0x7f16080fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 -- 172.21.15.31:0/4073873952 shutdown_connections 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 -- 172.21.15.31:0/4073873952 wait complete. 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.061+0000 7f160f367700 1 Processor -- start 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160f367700 1 -- start start 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160f367700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 0x7f1608196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160f367700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1608101c90 0x7f1608196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160f367700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608196c40 con 0x7f16081012f0 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160f367700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160819a9d0 con 0x7f1608101c90 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 0x7f1608196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 0x7f1608196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45720/0 (socket says 172.21.15.31:45720) 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 -- 172.21.15.31:0/3900039401 learned_addr learned my addr 172.21.15.31:0/3900039401 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160c902700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1608101c90 0x7f1608196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 -- 172.21.15.31:0/3900039401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1608101c90 msgr2=0x7f1608196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1608101c90 0x7f1608196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 -- 172.21.15.31:0/3900039401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80095f0 con 0x7f16081012f0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160c902700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1608101c90 0x7f1608196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f160d103700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 0x7f1608196020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f160400b4b0 tx=0x7f160400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.062+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1604011800 con 0x7f16081012f0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.063+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160819acb0 con 0x7f16081012f0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.063+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1604011e20 con 0x7f16081012f0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.063+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160400f2e0 con 0x7f16081012f0 2024-09-17T02:04:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.063+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160819b200 con 0x7f16081012f0 2024-09-17T02:04:11.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.064+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16081079d0 con 0x7f16081012f0 2024-09-17T02:04:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.064+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1604010380 con 0x7f16081012f0 2024-09-17T02:04:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.064+0000 7f15fe7fc700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f15f406e680 0x7f15f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.065+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f160408e330 con 0x7f16081012f0 2024-09-17T02:04:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.065+0000 7f160c902700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f15f406e680 0x7f15f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.065+0000 7f160c902700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f15f406e680 0x7f15f4070b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f15f800b5c0 tx=0x7f15f8005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.069+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1604057400 con 0x7f16081012f0 2024-09-17T02:04:11.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.332+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f160819b480 con 0x7f16081012f0 2024-09-17T02:04:11.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.332+0000 7f15fe7fc700 1 -- 172.21.15.31:0/3900039401 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v44) v1 ==== 107+0+4259 (secure 0 0 0) 0x7f160405aac0 con 0x7f16081012f0 2024-09-17T02:04:11.330 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:11.331 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"btime":"2024-09-17T01:59:18:189912+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:18.189903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:04:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.334+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f15f406e680 msgr2=0x7f15f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.334+0000 7f160f367700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f15f406e680 0x7f15f4070b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f15f800b5c0 tx=0x7f15f8005960 comp rx=0 tx=0).stop 2024-09-17T02:04:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.334+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 msgr2=0x7f1608196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.334+0000 7f160f367700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 0x7f1608196020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f160400b4b0 tx=0x7f160400b870 comp rx=0 tx=0).stop 2024-09-17T02:04:11.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 shutdown_connections 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f15f406e680 0x7f15f4070b30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16081012f0 0x7f1608196020 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 --2- 172.21.15.31:0/3900039401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1608101c90 0x7f1608196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 >> 172.21.15.31:0/3900039401 conn(0x7f16080fac80 msgr2=0x7f1608104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 shutdown_connections 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:11.335+0000 7f160f367700 1 -- 172.21.15.31:0/3900039401 wait complete. 2024-09-17T02:04:11.333 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 32 2024-09-17T02:04:12.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:11 smithi031 ceph-mon[77274]: pgmap v359: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:12.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:11 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3900039401' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T02:04:12.112 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-17T02:04:12.112 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-17T02:04:12.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-17T02:04:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:11 smithi092 ceph-mon[64495]: pgmap v359: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:12.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:11 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3900039401' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T02:04:12.327 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:14.010 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:13 smithi031 ceph-mon[77274]: pgmap v360: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:14.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 -- 172.21.15.31:0/1117526675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398105030 msgr2=0x7f4398105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1117526675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398105030 0x7f4398105400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4388009910 tx=0x7f4388009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 -- 172.21.15.31:0/1117526675 shutdown_connections 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1117526675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4398068540 0x7f43980689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1117526675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398105030 0x7f4398105400 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 -- 172.21.15.31:0/1117526675 >> 172.21.15.31:0/1117526675 conn(0x7f4398074fa0 msgr2=0x7f43980753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 -- 172.21.15.31:0/1117526675 shutdown_connections 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.121+0000 7f439d1a2700 1 -- 172.21.15.31:0/1117526675 wait complete. 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f439d1a2700 1 Processor -- start 2024-09-17T02:04:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f439d1a2700 1 -- start start 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f439d1a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 0x7f43980ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f439d1a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4398105030 0x7f43980ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f439d1a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4398100530 con 0x7f4398068540 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f439d1a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4398100670 con 0x7f4398105030 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f4397fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 0x7f43980ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f4397fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 0x7f43980ffab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55618/0 (socket says 172.21.15.31:55618) 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.122+0000 7f4397fff700 1 -- 172.21.15.31:0/1078144165 learned_addr learned my addr 172.21.15.31:0/1078144165 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f438ffff700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4398105030 0x7f43980ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4397fff700 1 -- 172.21.15.31:0/1078144165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4398105030 msgr2=0x7f43980ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4397fff700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4398105030 0x7f43980ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4397fff700 1 -- 172.21.15.31:0/1078144165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43880095f0 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4397fff700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 0x7f43980ffab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f438800bda0 tx=0x7f438800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438801d070 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4388005dc0 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4388017400 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43981008f0 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.123+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43981a2130 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.124+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4398062380 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.125+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f438800f6f0 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.125+0000 7f4395ffb700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f438406e680 0x7f4384070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.125+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f438808fb00 con 0x7f4398068540 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.125+0000 7f438ffff700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f438406e680 0x7f4384070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.126+0000 7f438ffff700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f438406e680 0x7f4384070b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f43981012a0 tx=0x7f438000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:14.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.130+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4388058bd0 con 0x7f4398068540 2024-09-17T02:04:14.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:13 smithi092 ceph-mon[64495]: pgmap v360: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.392+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f4398100fe0 con 0x7f4398068540 2024-09-17T02:04:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.393+0000 7f4395ffb700 1 -- 172.21.15.31:0/1078144165 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v44) v1 ==== 107+0+4262 (secure 0 0 0) 0x7f438805c290 con 0x7f4398068540 2024-09-17T02:04:14.391 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:14.391 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":33,"btime":"2024-09-17T01:59:24:357040+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:23.611971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:04:14.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f438406e680 msgr2=0x7f4384070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:14.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f438406e680 0x7f4384070b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f43981012a0 tx=0x7f438000b410 comp rx=0 tx=0).stop 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 msgr2=0x7f43980ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 0x7f43980ffab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f438800bda0 tx=0x7f438800bdd0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 shutdown_connections 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f438406e680 0x7f4384070b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4398068540 0x7f43980ffab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 --2- 172.21.15.31:0/1078144165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4398105030 0x7f43980ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 >> 172.21.15.31:0/1078144165 conn(0x7f4398074fa0 msgr2=0x7f43980fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 shutdown_connections 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:14.396+0000 7f439d1a2700 1 -- 172.21.15.31:0/1078144165 wait complete. 2024-09-17T02:04:14.394 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 33 2024-09-17T02:04:15.024 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:14 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1078144165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T02:04:15.047 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-17T02:04:15.047 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-17T02:04:15.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-17T02:04:15.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:14 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1078144165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T02:04:15.257 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:16.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:15 smithi031 ceph-mon[77274]: pgmap v361: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:16.239 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:15 smithi092 ceph-mon[64495]: pgmap v361: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:17.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/1545284068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 msgr2=0x7f3ec4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/1545284068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4103d30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009910 tx=0x7f3eac009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/1545284068 shutdown_connections 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/1545284068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4103d30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/1545284068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ec40ff3c0 0x7f3ec40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/1545284068 >> 172.21.15.31:0/1545284068 conn(0x7f3ec40fac60 msgr2=0x7f3ec40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/1545284068 shutdown_connections 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.238+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/1545284068 wait complete. 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.239+0000 7f3ec9e7c700 1 Processor -- start 2024-09-17T02:04:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.239+0000 7f3ec9e7c700 1 -- start start 2024-09-17T02:04:17.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.239+0000 7f3ec9e7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ec40ff3c0 0x7f3ec4195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:17.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.239+0000 7f3ec9e7c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:17.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec9e7c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4196ae0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec9e7c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec419a870 con 0x7f3ec40ff3c0 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55628/0 (socket says 172.21.15.31:55628) 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 -- 172.21.15.31:0/3757906981 learned_addr learned my addr 172.21.15.31:0/3757906981 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec37fe700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ec40ff3c0 0x7f3ec4195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 -- 172.21.15.31:0/3757906981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ec40ff3c0 msgr2=0x7f3ec4195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ec40ff3c0 0x7f3ec4195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 -- 172.21.15.31:0/3757906981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0095f0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ebaffd700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4196400 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00bd70 tx=0x7f3eac00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eac01d070 con 0x7f3ec40ffd60 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3eac005dc0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec419aaf0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.240+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3eac017400 con 0x7f3ec40ffd60 2024-09-17T02:04:17.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.241+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec419afe0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.242+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec404f2a0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.242+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3eac017670 con 0x7f3ec40ffd60 2024-09-17T02:04:17.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.242+0000 7f3ec17fa700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3eb006e680 0x7f3eb0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:17.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.243+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f3eac08fbb0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.243+0000 7f3ec37fe700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3eb006e680 0x7f3eb0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:17.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.243+0000 7f3ec37fe700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3eb006e680 0x7f3eb0070b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4005950 tx=0x7f3eb400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:17.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.247+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3eac096080 con 0x7f3ec40ffd60 2024-09-17T02:04:17.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.507+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f3ec419b2c0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.508+0000 7f3ec17fa700 1 -- 172.21.15.31:0/3757906981 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v44) v1 ==== 107+0+4259 (secure 0 0 0) 0x7f3eac058cf0 con 0x7f3ec40ffd60 2024-09-17T02:04:17.506 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:17.506 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":34,"btime":"2024-09-17T01:59:25:362593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:24.365721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T02:04:17.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.510+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3eb006e680 msgr2=0x7f3eb0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:17.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.510+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3eb006e680 0x7f3eb0070b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4005950 tx=0x7f3eb400b410 comp rx=0 tx=0).stop 2024-09-17T02:04:17.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.510+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 msgr2=0x7f3ec4196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.510+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4196400 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00bd70 tx=0x7f3eac00bda0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 shutdown_connections 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f3eb006e680 0x7f3eb0070b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ec40ff3c0 0x7f3ec4195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 --2- 172.21.15.31:0/3757906981 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ec40ffd60 0x7f3ec4196400 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 >> 172.21.15.31:0/3757906981 conn(0x7f3ec40fac60 msgr2=0x7f3ec40fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 shutdown_connections 2024-09-17T02:04:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:17.511+0000 7f3ec9e7c700 1 -- 172.21.15.31:0/3757906981 wait complete. 2024-09-17T02:04:17.510 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 34 2024-09-17T02:04:18.126 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-17T02:04:18.126 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-17T02:04:18.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-17T02:04:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:18.455 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:18 smithi031 ceph-mon[77274]: pgmap v362: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:18.455 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:18 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3757906981' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T02:04:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:18 smithi092 ceph-mon[64495]: pgmap v362: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:18 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3757906981' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T02:04:20.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 -- 172.21.15.31:0/1799495796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 msgr2=0x7f181c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:20.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 --2- 172.21.15.31:0/1799495796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c100890 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b0a0 tx=0x7f180c00b3b0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 -- 172.21.15.31:0/1799495796 shutdown_connections 2024-09-17T02:04:20.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 --2- 172.21.15.31:0/1799495796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f181c100e60 0x7f181c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 --2- 172.21.15.31:0/1799495796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c100890 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 -- 172.21.15.31:0/1799495796 >> 172.21.15.31:0/1799495796 conn(0x7f181c0fbd80 msgr2=0x7f181c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:20.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 -- 172.21.15.31:0/1799495796 shutdown_connections 2024-09-17T02:04:20.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.031+0000 7f1821381700 1 -- 172.21.15.31:0/1799495796 wait complete. 2024-09-17T02:04:20.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f1821381700 1 Processor -- start 2024-09-17T02:04:20.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f1821381700 1 -- start start 2024-09-17T02:04:20.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f1821381700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:20.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f1821381700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f181c100e60 0x7f181c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f1821381700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c196bb0 con 0x7f181c1004c0 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f1821381700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19a940 con 0x7f181c100e60 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f181affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f181affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55636/0 (socket says 172.21.15.31:55636) 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.032+0000 7f181affd700 1 -- 172.21.15.31:0/2082162488 learned_addr learned my addr 172.21.15.31:0/2082162488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f181a7fc700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f181c100e60 0x7f181c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f181affd700 1 -- 172.21.15.31:0/2082162488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f181c100e60 msgr2=0x7f181c1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:20.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f181affd700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f181c100e60 0x7f181c1964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f181affd700 1 -- 172.21.15.31:0/2082162488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009d00 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f181affd700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c195f90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f180c000f80 tx=0x7f180c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180c00e040 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f180c003e60 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c19abc0 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f180c01d910 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.033+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c19b0b0 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.034+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c1087d0 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.035+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f180c004040 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.035+0000 7f1813fff700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f180806e680 0x7f1808070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.035+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f180c090050 con 0x7f181c1004c0 2024-09-17T02:04:20.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.035+0000 7f181a7fc700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f180806e680 0x7f1808070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:20.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.036+0000 7f181a7fc700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f180806e680 0x7f1808070b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1804006fd0 tx=0x7f1804008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:20.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.039+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f180c059120 con 0x7f181c1004c0 2024-09-17T02:04:20.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.311+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f181c04f2a0 con 0x7f181c1004c0 2024-09-17T02:04:20.309 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:20 smithi031 ceph-mon[77274]: pgmap v363: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.311+0000 7f1813fff700 1 -- 172.21.15.31:0/2082162488 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v44) v1 ==== 107+0+4268 (secure 0 0 0) 0x7f180c05c7e0 con 0x7f181c1004c0 2024-09-17T02:04:20.312 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:20.313 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":35,"btime":"2024-09-17T01:59:26:368374+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:26.368371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.313+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f180806e680 msgr2=0x7f1808070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f180806e680 0x7f1808070b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1804006fd0 tx=0x7f1804008040 comp rx=0 tx=0).stop 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 msgr2=0x7f181c195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c195f90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f180c000f80 tx=0x7f180c00cdd0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 shutdown_connections 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f180806e680 0x7f1808070b30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f181c1004c0 0x7f181c195f90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 --2- 172.21.15.31:0/2082162488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f181c100e60 0x7f181c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 >> 172.21.15.31:0/2082162488 conn(0x7f181c0fbd80 msgr2=0x7f181c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 shutdown_connections 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:20.314+0000 7f1821381700 1 -- 172.21.15.31:0/2082162488 wait complete. 2024-09-17T02:04:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 35 2024-09-17T02:04:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:20 smithi092 ceph-mon[64495]: pgmap v363: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:20.965 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-17T02:04:20.965 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-17T02:04:20.966 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-17T02:04:21.172 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:21.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:21.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:21 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2082162488' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T02:04:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:21 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2082162488' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T02:04:22.333 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:22 smithi031 ceph-mon[77274]: pgmap v364: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:22.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:22 smithi092 ceph-mon[64495]: pgmap v364: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:22.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 -- 172.21.15.31:0/2839933056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 msgr2=0x7f128c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:22.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 --2- 172.21.15.31:0/2839933056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c104e50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1280009910 tx=0x7f1280009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:22.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 -- 172.21.15.31:0/2839933056 shutdown_connections 2024-09-17T02:04:22.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 --2- 172.21.15.31:0/2839933056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c104e50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 --2- 172.21.15.31:0/2839933056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 0x7f128c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 -- 172.21.15.31:0/2839933056 >> 172.21.15.31:0/2839933056 conn(0x7f128c0fbda0 msgr2=0x7f128c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 -- 172.21.15.31:0/2839933056 shutdown_connections 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.890+0000 7f1293a3a700 1 -- 172.21.15.31:0/2839933056 wait complete. 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1293a3a700 1 Processor -- start 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1293a3a700 1 -- start start 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1293a3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 0x7f128c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1293a3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1293a3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c073ad0 con 0x7f128c100e80 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1293a3a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c073c10 con 0x7f128c1004e0 2024-09-17T02:04:22.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.891+0000 7f1290fd5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1290fd5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55666/0 (socket says 172.21.15.31:55666) 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1290fd5700 1 -- 172.21.15.31:0/553134687 learned_addr learned my addr 172.21.15.31:0/553134687 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f12917d6700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 0x7f128c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1290fd5700 1 -- 172.21.15.31:0/553134687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 msgr2=0x7f128c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1290fd5700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 0x7f128c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1290fd5700 1 -- 172.21.15.31:0/553134687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800095f0 con 0x7f128c100e80 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f12917d6700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 0x7f128c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1290fd5700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c073590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f128000bd70 tx=0x7f128000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f128001d070 con 0x7f128c100e80 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1280005dc0 con 0x7f128c100e80 2024-09-17T02:04:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c073e90 con 0x7f128c100e80 2024-09-17T02:04:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1280017400 con 0x7f128c100e80 2024-09-17T02:04:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.892+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c1a2390 con 0x7f128c100e80 2024-09-17T02:04:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.893+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c108760 con 0x7f128c100e80 2024-09-17T02:04:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.894+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1280003a60 con 0x7f128c100e80 2024-09-17T02:04:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.894+0000 7f127e7fc700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f127806e680 0x7f1278070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.895+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f128008fb50 con 0x7f128c100e80 2024-09-17T02:04:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.895+0000 7f12917d6700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f127806e680 0x7f1278070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:22.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.895+0000 7f12917d6700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f127806e680 0x7f1278070b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f128800bcf0 tx=0x7f128800b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:22.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:22.899+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1280058ca0 con 0x7f128c100e80 2024-09-17T02:04:23.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.159+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f128c04f2a0 con 0x7f128c100e80 2024-09-17T02:04:23.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.160+0000 7f127e7fc700 1 -- 172.21.15.31:0/553134687 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v44) v1 ==== 107+0+5115 (secure 0 0 0) 0x7f128005c360 con 0x7f128c100e80 2024-09-17T02:04:23.158 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:23.158 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":36,"btime":"2024-09-17T01:59:30:377227+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44327,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/3556360183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3556360183},{"type":"v1","addr":"172.21.15.92:6825","nonce":3556360183}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:26.368371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:23.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f127806e680 msgr2=0x7f1278070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:23.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f127806e680 0x7f1278070b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f128800bcf0 tx=0x7f128800b2c0 comp rx=0 tx=0).stop 2024-09-17T02:04:23.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 msgr2=0x7f128c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c073590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f128000bd70 tx=0x7f128000be50 comp rx=0 tx=0).stop 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 shutdown_connections 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f127806e680 0x7f1278070b30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f128c1004e0 0x7f128c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 --2- 172.21.15.31:0/553134687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f128c100e80 0x7f128c073590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.162+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 >> 172.21.15.31:0/553134687 conn(0x7f128c0fbda0 msgr2=0x7f128c1046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.163+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 shutdown_connections 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:23.163+0000 7f1293a3a700 1 -- 172.21.15.31:0/553134687 wait complete. 2024-09-17T02:04:23.161 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 36 2024-09-17T02:04:23.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:23 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/553134687' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T02:04:23.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:23 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/553134687' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T02:04:23.831 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-17T02:04:23.831 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-17T02:04:23.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-17T02:04:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:24.469 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:24 smithi031 ceph-mon[77274]: pgmap v365: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:24.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:24 smithi092 ceph-mon[64495]: pgmap v365: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:25.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.741+0000 7f94af36a700 1 -- 172.21.15.31:0/1128408464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 msgr2=0x7f94a810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:25.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.741+0000 7f94af36a700 1 --2- 172.21.15.31:0/1128408464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a810a6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9498009910 tx=0x7f9498009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.741+0000 7f94af36a700 1 -- 172.21.15.31:0/1128408464 shutdown_connections 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.741+0000 7f94af36a700 1 --2- 172.21.15.31:0/1128408464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a810a6d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.741+0000 7f94af36a700 1 --2- 172.21.15.31:0/1128408464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94a80ff350 0x7f94a80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.742+0000 7f94af36a700 1 -- 172.21.15.31:0/1128408464 >> 172.21.15.31:0/1128408464 conn(0x7f94a80748b0 msgr2=0x7f94a8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.742+0000 7f94af36a700 1 -- 172.21.15.31:0/1128408464 shutdown_connections 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.742+0000 7f94af36a700 1 -- 172.21.15.31:0/1128408464 wait complete. 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.742+0000 7f94af36a700 1 Processor -- start 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.742+0000 7f94af36a700 1 -- start start 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94af36a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94a80ff350 0x7f94a8195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94af36a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a8196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94af36a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8196b00 con 0x7f94a80ffc60 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94af36a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a819a890 con 0x7f94a80ff350 2024-09-17T02:04:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a8196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a8196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55748/0 (socket says 172.21.15.31:55748) 2024-09-17T02:04:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 -- 172.21.15.31:0/3070575290 learned_addr learned my addr 172.21.15.31:0/3070575290 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ad106700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94a80ff350 0x7f94a8195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 -- 172.21.15.31:0/3070575290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94a80ff350 msgr2=0x7f94a8195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94a80ff350 0x7f94a8195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:25.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 -- 172.21.15.31:0/3070575290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980095f0 con 0x7f94a80ffc60 2024-09-17T02:04:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94ac905700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a8196420 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9498006010 tx=0x7f949800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f949801d070 con 0x7f94a80ffc60 2024-09-17T02:04:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a819ab10 con 0x7f94a80ffc60 2024-09-17T02:04:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.743+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9498005dc0 con 0x7f94a80ffc60 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.744+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9498017400 con 0x7f94a80ffc60 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.744+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a819b000 con 0x7f94a80ffc60 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.745+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a8107dd0 con 0x7f94a80ffc60 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.745+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9498003a60 con 0x7f94a80ffc60 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.746+0000 7f949e7fc700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f949406e680 0x7f9494070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.746+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f949808fb00 con 0x7f94a80ffc60 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.746+0000 7f94ad106700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f949406e680 0x7f9494070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.746+0000 7f94ad106700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f949406e680 0x7f9494070b30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94a806a640 tx=0x7f94a400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:25.750+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9498058c50 con 0x7f94a80ffc60 2024-09-17T02:04:26.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.012+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f94a804f2a0 con 0x7f94a80ffc60 2024-09-17T02:04:26.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.013+0000 7f949e7fc700 1 -- 172.21.15.31:0/3070575290 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v44) v1 ==== 107+0+4336 (secure 0 0 0) 0x7f949805c310 con 0x7f94a80ffc60 2024-09-17T02:04:26.012 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:26.012 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":37,"btime":"2024-09-17T01:59:45:181060+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:26.368371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:26.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f949406e680 msgr2=0x7f9494070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:26.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f949406e680 0x7f9494070b30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94a806a640 tx=0x7f94a400b410 comp rx=0 tx=0).stop 2024-09-17T02:04:26.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 msgr2=0x7f94a8196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a8196420 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9498006010 tx=0x7f949800bd70 comp rx=0 tx=0).stop 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 shutdown_connections 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f949406e680 0x7f9494070b30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94a80ff350 0x7f94a8195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 --2- 172.21.15.31:0/3070575290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a80ffc60 0x7f94a8196420 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 >> 172.21.15.31:0/3070575290 conn(0x7f94a80748b0 msgr2=0x7f94a8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 shutdown_connections 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:26.016+0000 7f94af36a700 1 -- 172.21.15.31:0/3070575290 wait complete. 2024-09-17T02:04:26.015 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 37 2024-09-17T02:04:26.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:26 smithi031 ceph-mon[77274]: pgmap v366: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:26.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:26 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3070575290' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-17T02:04:26.710 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-17T02:04:26.710 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-17T02:04:26.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-17T02:04:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:26 smithi092 ceph-mon[64495]: pgmap v366: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:26 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3070575290' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-17T02:04:26.917 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:28.370 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:28 smithi031 ceph-mon[77274]: pgmap v367: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 -- 172.21.15.31:0/3230308558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 msgr2=0x7f305c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 --2- 172.21.15.31:0/3230308558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c0ff790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f304c009910 tx=0x7f304c009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 -- 172.21.15.31:0/3230308558 shutdown_connections 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 --2- 172.21.15.31:0/3230308558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305c0ffd60 0x7f305c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 --2- 172.21.15.31:0/3230308558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c0ff790 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 -- 172.21.15.31:0/3230308558 >> 172.21.15.31:0/3230308558 conn(0x7f305c0fac80 msgr2=0x7f305c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 -- 172.21.15.31:0/3230308558 shutdown_connections 2024-09-17T02:04:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.616+0000 7f306084c700 1 -- 172.21.15.31:0/3230308558 wait complete. 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f306084c700 1 Processor -- start 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f306084c700 1 -- start start 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f306084c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f306084c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305c0ffd60 0x7f305c196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f306084c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c196b40 con 0x7f305c0ff3c0 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f306084c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c19a8d0 con 0x7f305c0ffd60 2024-09-17T02:04:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55760/0 (socket says 172.21.15.31:55760) 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 -- 172.21.15.31:0/383301507 learned_addr learned my addr 172.21.15.31:0/383301507 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f3059d9b700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305c0ffd60 0x7f305c196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 -- 172.21.15.31:0/383301507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305c0ffd60 msgr2=0x7f305c196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305c0ffd60 0x7f305c196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 -- 172.21.15.31:0/383301507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0095f0 con 0x7f305c0ff3c0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.617+0000 7f305a59c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c195f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f304c0092e0 tx=0x7f304c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.618+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304c01d070 con 0x7f305c0ff3c0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.618+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c19ab50 con 0x7f305c0ff3c0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.618+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c19b040 con 0x7f305c0ff3c0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.618+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f304c005e00 con 0x7f305c0ff3c0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.618+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304c017400 con 0x7f305c0ff3c0 2024-09-17T02:04:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.619+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c005320 con 0x7f305c0ff3c0 2024-09-17T02:04:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.619+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f304c017670 con 0x7f305c0ff3c0 2024-09-17T02:04:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.620+0000 7f304b7fe700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f304406e680 0x7f3044070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.620+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f304c08fab0 con 0x7f305c0ff3c0 2024-09-17T02:04:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.620+0000 7f3059d9b700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f304406e680 0x7f3044070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.620+0000 7f3059d9b700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f304406e680 0x7f3044070b30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f305c197540 tx=0x7f305000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.624+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f304c058c00 con 0x7f305c0ff3c0 2024-09-17T02:04:28.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:28 smithi092 ceph-mon[64495]: pgmap v367: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:28.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.887+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f303c005190 con 0x7f305c0ff3c0 2024-09-17T02:04:28.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.887+0000 7f304b7fe700 1 -- 172.21.15.31:0/383301507 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v44) v1 ==== 107+0+5180 (secure 0 0 0) 0x7f304c05c2c0 con 0x7f305c0ff3c0 2024-09-17T02:04:28.886 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:28.886 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":38,"btime":"2024-09-17T01:59:51:190143+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1658276078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1658276078},{"type":"v1","addr":"172.21.15.92:6827","nonce":1658276078}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:26.368371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f304406e680 msgr2=0x7f3044070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f304406e680 0x7f3044070b30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f305c197540 tx=0x7f305000b410 comp rx=0 tx=0).stop 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 msgr2=0x7f305c195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c195f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f304c0092e0 tx=0x7f304c00bd70 comp rx=0 tx=0).stop 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 shutdown_connections 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f304406e680 0x7f3044070b30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f305c0ff3c0 0x7f305c195f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 --2- 172.21.15.31:0/383301507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f305c0ffd60 0x7f305c196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 >> 172.21.15.31:0/383301507 conn(0x7f305c0fac80 msgr2=0x7f305c069050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 shutdown_connections 2024-09-17T02:04:28.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:28.890+0000 7f306084c700 1 -- 172.21.15.31:0/383301507 wait complete. 2024-09-17T02:04:28.890 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 38 2024-09-17T02:04:29.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:29 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/383301507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-17T02:04:29.652 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-17T02:04:29.652 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-17T02:04:29.652 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-17T02:04:29.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:29 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/383301507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-17T02:04:29.866 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:30.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:30 smithi031 ceph-mon[77274]: pgmap v368: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:30 smithi092 ceph-mon[64495]: pgmap v368: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.519+0000 7fc11a5a0700 1 -- 172.21.15.31:0/798607117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ff1b0 msgr2=0x7fc1140ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.519+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/798607117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ff1b0 0x7fc1140ff580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc110009910 tx=0x7fc110009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 -- 172.21.15.31:0/798607117 shutdown_connections 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/798607117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1140ffb50 0x7fc114103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/798607117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ff1b0 0x7fc1140ff580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 -- 172.21.15.31:0/798607117 >> 172.21.15.31:0/798607117 conn(0x7fc1140faa30 msgr2=0x7fc1140fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 -- 172.21.15.31:0/798607117 shutdown_connections 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 -- 172.21.15.31:0/798607117 wait complete. 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 Processor -- start 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.520+0000 7fc11a5a0700 1 -- start start 2024-09-17T02:04:31.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc11a5a0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1140ff1b0 0x7fc11419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc11a5a0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 0x7fc11419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc11a5a0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11419b4a0 con 0x7fc1140ffb50 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc11a5a0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1141949e0 con 0x7fc1140ff1b0 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc118d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 0x7fc11419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc118d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 0x7fc11419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55774/0 (socket says 172.21.15.31:55774) 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc118d9d700 1 -- 172.21.15.31:0/365082929 learned_addr learned my addr 172.21.15.31:0/365082929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc11959e700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1140ff1b0 0x7fc11419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc118d9d700 1 -- 172.21.15.31:0/365082929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1140ff1b0 msgr2=0x7fc11419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc118d9d700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1140ff1b0 0x7fc11419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.521+0000 7fc118d9d700 1 -- 172.21.15.31:0/365082929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100095f0 con 0x7fc1140ffb50 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.522+0000 7fc118d9d700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 0x7fc11419aea0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c960 tx=0x7fc10800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.522+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc108007a70 con 0x7fc1140ffb50 2024-09-17T02:04:31.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.522+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc108007bd0 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.522+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc114194cc0 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.522+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1080186c0 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.522+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc114195210 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.523+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc114062380 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.523+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc10800faa0 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.524+0000 7fc1067fc700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc10006e680 0x7fc100070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.524+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fc10808e720 con 0x7fc1140ffb50 2024-09-17T02:04:31.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.524+0000 7fc11959e700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc10006e680 0x7fc100070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:31.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.524+0000 7fc11959e700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc10006e680 0x7fc100070b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110006010 tx=0x7fc11001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:31.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.528+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc10805b110 con 0x7fc1140ffb50 2024-09-17T02:04:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.790+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fc114195ef0 con 0x7fc1140ffb50 2024-09-17T02:04:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.790+0000 7fc1067fc700 1 -- 172.21.15.31:0/365082929 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v44) v1 ==== 107+0+4401 (secure 0 0 0) 0x7fc10805af30 con 0x7fc1140ffb50 2024-09-17T02:04:31.790 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:31.790 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"btime":"2024-09-17T02:00:00:538468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:26.368371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc10006e680 msgr2=0x7fc100070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc10006e680 0x7fc100070b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110006010 tx=0x7fc11001a040 comp rx=0 tx=0).stop 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 msgr2=0x7fc11419aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 0x7fc11419aea0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c960 tx=0x7fc10800cd20 comp rx=0 tx=0).stop 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 shutdown_connections 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fc10006e680 0x7fc100070b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1140ff1b0 0x7fc11419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 --2- 172.21.15.31:0/365082929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1140ffb50 0x7fc11419aea0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 >> 172.21.15.31:0/365082929 conn(0x7fc1140faa30 msgr2=0x7fc1140fc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 shutdown_connections 2024-09-17T02:04:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:31.793+0000 7fc11a5a0700 1 -- 172.21.15.31:0/365082929 wait complete. 2024-09-17T02:04:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 39 2024-09-17T02:04:32.398 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:32 smithi031 ceph-mon[77274]: pgmap v369: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:32.398 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:32 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/365082929' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-17T02:04:32.423 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-17T02:04:32.423 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-09-17T02:04:32.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-17T02:04:32.636 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:32 smithi092 ceph-mon[64495]: pgmap v369: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:32 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/365082929' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-17T02:04:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 -- 172.21.15.31:0/3261723963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ffd60 msgr2=0x7fb600103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 --2- 172.21.15.31:0/3261723963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ffd60 0x7fb600103d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009910 tx=0x7fb5f0009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 -- 172.21.15.31:0/3261723963 shutdown_connections 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 --2- 172.21.15.31:0/3261723963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ffd60 0x7fb600103d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 --2- 172.21.15.31:0/3261723963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6000ff3c0 0x7fb6000ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 -- 172.21.15.31:0/3261723963 >> 172.21.15.31:0/3261723963 conn(0x7fb6000fac60 msgr2=0x7fb6000fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 -- 172.21.15.31:0/3261723963 shutdown_connections 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.244+0000 7fb6084ee700 1 -- 172.21.15.31:0/3261723963 wait complete. 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb6084ee700 1 Processor -- start 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb6084ee700 1 -- start start 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb6084ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 0x7fb600198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb6084ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6000ffd60 0x7fb6001985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb6084ee700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb600198c20 con 0x7fb6000ff3c0 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb6084ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb600198d60 con 0x7fb6000ffd60 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb60628a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 0x7fb600198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb60628a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 0x7fb600198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59478/0 (socket says 172.21.15.31:59478) 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb60628a700 1 -- 172.21.15.31:0/513703415 learned_addr learned my addr 172.21.15.31:0/513703415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb605a89700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6000ffd60 0x7fb6001985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb60628a700 1 -- 172.21.15.31:0/513703415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6000ffd60 msgr2=0x7fb6001985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb60628a700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6000ffd60 0x7fb6001985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.245+0000 7fb60628a700 1 -- 172.21.15.31:0/513703415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00095f0 con 0x7fb6000ff3c0 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.246+0000 7fb60628a700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 0x7fb600198090 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c930 tx=0x7fb5fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.246+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5fc007ad0 con 0x7fb6000ff3c0 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.246+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5fc00ce80 con 0x7fb6000ff3c0 2024-09-17T02:04:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.246+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60019cbb0 con 0x7fb6000ff3c0 2024-09-17T02:04:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.246+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5fc018630 con 0x7fb6000ff3c0 2024-09-17T02:04:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.246+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60019d0d0 con 0x7fb6000ff3c0 2024-09-17T02:04:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.247+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb600067980 con 0x7fb6000ff3c0 2024-09-17T02:04:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.248+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb5fc00f450 con 0x7fb6000ff3c0 2024-09-17T02:04:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.248+0000 7fb5f77fe700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb5ec06e680 0x7fb5ec070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.248+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fb5fc08e680 con 0x7fb6000ff3c0 2024-09-17T02:04:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.248+0000 7fb605a89700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb5ec06e680 0x7fb5ec070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:34.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.249+0000 7fb605a89700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb5ec06e680 0x7fb5ec070b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0006010 tx=0x7fb5f001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.253+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb5fc057880 con 0x7fb6000ff3c0 2024-09-17T02:04:34.532 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:34 smithi031 ceph-mon[77274]: pgmap v370: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.532+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7fb60004f2a0 con 0x7fb6000ff3c0 2024-09-17T02:04:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.533+0000 7fb5f77fe700 1 -- 172.21.15.31:0/513703415 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v44) v1 ==== 107+0+5248 (secure 0 0 0) 0x7fb5fc05af40 con 0x7fb6000ff3c0 2024-09-17T02:04:34.533 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:34.533 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-17T02:00:06:552184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44377,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/3092379292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3092379292},{"type":"v1","addr":"172.21.15.92:6827","nonce":3092379292}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T01:59:26.368371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:34.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb5ec06e680 msgr2=0x7fb5ec070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb5ec06e680 0x7fb5ec070b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0006010 tx=0x7fb5f001a040 comp rx=0 tx=0).stop 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 msgr2=0x7fb600198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 0x7fb600198090 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c930 tx=0x7fb5fc00cc40 comp rx=0 tx=0).stop 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 shutdown_connections 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fb5ec06e680 0x7fb5ec070b30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6000ff3c0 0x7fb600198090 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 --2- 172.21.15.31:0/513703415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6000ffd60 0x7fb6001985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 >> 172.21.15.31:0/513703415 conn(0x7fb6000fac60 msgr2=0x7fb6000fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 shutdown_connections 2024-09-17T02:04:34.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:34.536+0000 7fb6084ee700 1 -- 172.21.15.31:0/513703415 wait complete. 2024-09-17T02:04:34.536 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-17T02:04:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:34 smithi092 ceph-mon[64495]: pgmap v370: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:35.167 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-17T02:04:35.167 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-09-17T02:04:35.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-17T02:04:35.381 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:35.502 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:35 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/513703415' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-17T02:04:35.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:35 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/513703415' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-17T02:04:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:36 smithi031 ceph-mon[77274]: pgmap v371: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:36.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:36 smithi092 ceph-mon[64495]: pgmap v371: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.063+0000 7f65eacd8700 1 -- 172.21.15.31:0/810677988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e41004a0 msgr2=0x7f65e4100870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.063+0000 7f65eacd8700 1 --2- 172.21.15.31:0/810677988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e41004a0 0x7f65e4100870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009910 tx=0x7f65d8009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.063+0000 7f65eacd8700 1 -- 172.21.15.31:0/810677988 shutdown_connections 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.063+0000 7f65eacd8700 1 --2- 172.21.15.31:0/810677988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e4100e40 0x7f65e4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.063+0000 7f65eacd8700 1 --2- 172.21.15.31:0/810677988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e41004a0 0x7f65e4100870 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.063+0000 7f65eacd8700 1 -- 172.21.15.31:0/810677988 >> 172.21.15.31:0/810677988 conn(0x7f65e40fbd40 msgr2=0x7f65e40fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.064+0000 7f65eacd8700 1 -- 172.21.15.31:0/810677988 shutdown_connections 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.064+0000 7f65eacd8700 1 -- 172.21.15.31:0/810677988 wait complete. 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.064+0000 7f65eacd8700 1 Processor -- start 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.064+0000 7f65eacd8700 1 -- start start 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.064+0000 7f65eacd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e41004a0 0x7f65e4073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.064+0000 7f65eacd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 0x7f65e4073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65eacd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4073ad0 con 0x7f65e4100e40 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65eacd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4073c10 con 0x7f65e41004a0 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 0x7f65e4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 0x7f65e4073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59490/0 (socket says 172.21.15.31:59490) 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 -- 172.21.15.31:0/1735060788 learned_addr learned my addr 172.21.15.31:0/1735060788 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e8a74700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e41004a0 0x7f65e4073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 -- 172.21.15.31:0/1735060788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e41004a0 msgr2=0x7f65e4073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e41004a0 0x7f65e4073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 -- 172.21.15.31:0/1735060788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80095f0 con 0x7f65e4100e40 2024-09-17T02:04:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e3fff700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 0x7f65e4073590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65d000c960 tx=0x7f65d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d0007a70 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e41a20a0 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65d0007bd0 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.065+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d0018630 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.066+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e41a2400 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.067+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e41087b0 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.067+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f65d000f450 con 0x7f65e4100e40 2024-09-17T02:04:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.068+0000 7f65e1ffb700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f65d406e680 0x7f65d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.068+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f65d008e700 con 0x7f65e4100e40 2024-09-17T02:04:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.068+0000 7f65e8a74700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f65d406e680 0x7f65d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.068+0000 7f65e8a74700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f65d406e680 0x7f65d4070b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006010 tx=0x7f65d801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:37.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.072+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f65d00577d0 con 0x7f65e4100e40 2024-09-17T02:04:37.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.332+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f65e4073dd0 con 0x7f65e4100e40 2024-09-17T02:04:37.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.332+0000 7f65e1ffb700 1 -- 172.21.15.31:0/1735060788 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v44) v1 ==== 107+0+5248 (secure 0 0 0) 0x7f65d005ae90 con 0x7f65e4100e40 2024-09-17T02:04:37.331 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:37.331 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"btime":"2024-09-17T02:00:13:496226+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44377,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/3092379292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3092379292},{"type":"v1","addr":"172.21.15.92:6827","nonce":3092379292}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T02:00:12.500671+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.334+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f65d406e680 msgr2=0x7f65d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.334+0000 7f65eacd8700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f65d406e680 0x7f65d4070b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006010 tx=0x7f65d801a040 comp rx=0 tx=0).stop 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 msgr2=0x7f65e4073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 0x7f65e4073590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65d000c960 tx=0x7f65d000cc70 comp rx=0 tx=0).stop 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 shutdown_connections 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f65d406e680 0x7f65d4070b30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65e41004a0 0x7f65e4073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 --2- 172.21.15.31:0/1735060788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65e4100e40 0x7f65e4073590 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 >> 172.21.15.31:0/1735060788 conn(0x7f65e40fbd40 msgr2=0x7f65e40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 shutdown_connections 2024-09-17T02:04:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:37.335+0000 7f65eacd8700 1 -- 172.21.15.31:0/1735060788 wait complete. 2024-09-17T02:04:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 41 2024-09-17T02:04:37.977 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-09-17T02:04:37.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 42 2024-09-17T02:04:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:38.541 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:38 smithi092 ceph-mon[64495]: pgmap v372: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:38.541 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:38 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1735060788' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-17T02:04:38.603 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:38 smithi031 ceph-mon[77274]: pgmap v372: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:38.603 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:38 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1735060788' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 -- 172.21.15.31:0/2074654438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 msgr2=0x7f151c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 --2- 172.21.15.31:0/2074654438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c100040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1510009910 tx=0x7f1510009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 -- 172.21.15.31:0/2074654438 shutdown_connections 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 --2- 172.21.15.31:0/2074654438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c100040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 --2- 172.21.15.31:0/2074654438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c104130 0x7f151c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 -- 172.21.15.31:0/2074654438 >> 172.21.15.31:0/2074654438 conn(0x7f151c075130 msgr2=0x7f151c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 -- 172.21.15.31:0/2074654438 shutdown_connections 2024-09-17T02:04:39.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.920+0000 7f1522ad4700 1 -- 172.21.15.31:0/2074654438 wait complete. 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1522ad4700 1 Processor -- start 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1522ad4700 1 -- start start 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1522ad4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1522ad4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c104130 0x7f151c196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1522ad4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c196a20 con 0x7f151c0ffbd0 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1522ad4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c19a7b0 con 0x7f151c104130 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1520870700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1520870700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59520/0 (socket says 172.21.15.31:59520) 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1520870700 1 -- 172.21.15.31:0/1100139480 learned_addr learned my addr 172.21.15.31:0/1100139480 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f151bfff700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c104130 0x7f151c196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1520870700 1 -- 172.21.15.31:0/1100139480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c104130 msgr2=0x7f151c196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.921+0000 7f1520870700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c104130 0x7f151c196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:39.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1520870700 1 -- 172.21.15.31:0/1100139480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100095f0 con 0x7f151c0ffbd0 2024-09-17T02:04:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1520870700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c195e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f150c00d8d0 tx=0x7f150c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150c0098a0 con 0x7f151c0ffbd0 2024-09-17T02:04:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f150c010460 con 0x7f151c0ffbd0 2024-09-17T02:04:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c19aa90 con 0x7f151c0ffbd0 2024-09-17T02:04:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150c00f5f0 con 0x7f151c0ffbd0 2024-09-17T02:04:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.922+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c19afb0 con 0x7f151c0ffbd0 2024-09-17T02:04:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.923+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c04f2a0 con 0x7f151c0ffbd0 2024-09-17T02:04:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.923+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f150c009a00 con 0x7f151c0ffbd0 2024-09-17T02:04:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.924+0000 7f1519ffb700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f150406e680 0x7f1504070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.924+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f150c08e690 con 0x7f151c0ffbd0 2024-09-17T02:04:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.924+0000 7f151bfff700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f150406e680 0x7f1504070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.925+0000 7f151bfff700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f150406e680 0x7f1504070b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1510006010 tx=0x7f151001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:39.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:39.928+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f150c0576c0 con 0x7f151c0ffbd0 2024-09-17T02:04:40.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.188+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f151c19b270 con 0x7f151c0ffbd0 2024-09-17T02:04:40.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.189+0000 7f1519ffb700 1 -- 172.21.15.31:0/1100139480 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v44) v1 ==== 107+0+5265 (secure 0 0 0) 0x7f150c05ad80 con 0x7f151c0ffbd0 2024-09-17T02:04:40.188 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:40.188 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"btime":"2024-09-17T02:00:13:500823+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44377,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/3092379292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3092379292},{"type":"v1","addr":"172.21.15.92:6827","nonce":3092379292}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T02:00:13.500802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":42,"state":"up:starting","state_seq":1,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-17T02:04:40.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f150406e680 msgr2=0x7f1504070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:40.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f150406e680 0x7f1504070b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1510006010 tx=0x7f151001a040 comp rx=0 tx=0).stop 2024-09-17T02:04:40.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 msgr2=0x7f151c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:40.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c195e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f150c00d8d0 tx=0x7f150c00dbe0 comp rx=0 tx=0).stop 2024-09-17T02:04:40.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 shutdown_connections 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f150406e680 0x7f1504070b30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c0ffbd0 0x7f151c195e00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 --2- 172.21.15.31:0/1100139480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c104130 0x7f151c196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.191+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 >> 172.21.15.31:0/1100139480 conn(0x7f151c075130 msgr2=0x7f151c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.192+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 shutdown_connections 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:40.192+0000 7f1522ad4700 1 -- 172.21.15.31:0/1100139480 wait complete. 2024-09-17T02:04:40.191 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2024-09-17T02:04:40.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:40 smithi031 ceph-mon[77274]: pgmap v373: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:40.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:40 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/1100139480' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-17T02:04:40.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:40 smithi092 ceph-mon[64495]: pgmap v373: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:40.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:40 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/1100139480' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-17T02:04:40.923 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 42 2024-09-17T02:04:40.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 43 2024-09-17T02:04:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:42.587 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:42 smithi031 ceph-mon[77274]: pgmap v374: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:42.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:42 smithi092 ceph-mon[64495]: pgmap v374: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.851+0000 7ff2ba401700 1 -- 172.21.15.31:0/792302010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b4104130 msgr2=0x7ff2b4104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.851+0000 7ff2ba401700 1 --2- 172.21.15.31:0/792302010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b4104130 0x7ff2b4104500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009910 tx=0x7ff2a4009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.851+0000 7ff2ba401700 1 -- 172.21.15.31:0/792302010 shutdown_connections 2024-09-17T02:04:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.851+0000 7ff2ba401700 1 --2- 172.21.15.31:0/792302010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.851+0000 7ff2ba401700 1 --2- 172.21.15.31:0/792302010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b4104130 0x7ff2b4104500 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.851+0000 7ff2ba401700 1 -- 172.21.15.31:0/792302010 >> 172.21.15.31:0/792302010 conn(0x7ff2b4075130 msgr2=0x7ff2b4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.852+0000 7ff2ba401700 1 -- 172.21.15.31:0/792302010 shutdown_connections 2024-09-17T02:04:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.852+0000 7ff2ba401700 1 -- 172.21.15.31:0/792302010 wait complete. 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2ba401700 1 Processor -- start 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2ba401700 1 -- start start 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2ba401700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4194aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2ba401700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b4104130 0x7ff2b4194fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2ba401700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4069500 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2ba401700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4195520 con 0x7ff2b4104130 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4194aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4194aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59532/0 (socket says 172.21.15.31:59532) 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2b3fff700 1 -- 172.21.15.31:0/2689906198 learned_addr learned my addr 172.21.15.31:0/2689906198 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2abfff700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b4104130 0x7ff2b4194fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2b3fff700 1 -- 172.21.15.31:0/2689906198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b4104130 msgr2=0x7ff2b4194fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2b3fff700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b4104130 0x7ff2b4194fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2b3fff700 1 -- 172.21.15.31:0/2689906198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40095f0 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.853+0000 7ff2abfff700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b4104130 0x7ff2b4194fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.854+0000 7ff2b3fff700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4194aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006010 tx=0x7ff2a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.854+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2a401d070 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.854+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b41957a0 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.854+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2a4004fb0 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.854+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2a400f690 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.854+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b41a2330 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.855+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b41076a0 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.855+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff2a4022470 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.856+0000 7ff2b1ffb700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2a006e680 0x7ff2a0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.856+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7ff2a408feb0 con 0x7ff2b40ffbd0 2024-09-17T02:04:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.856+0000 7ff2abfff700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2a006e680 0x7ff2a0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.856+0000 7ff2abfff700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2a006e680 0x7ff2a0070b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff29c005fd0 tx=0x7ff29c005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:42.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:42.860+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff2a405cab0 con 0x7ff2b40ffbd0 2024-09-17T02:04:43.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.120+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7ff2b4068bd0 con 0x7ff2b40ffbd0 2024-09-17T02:04:43.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.121+0000 7ff2b1ffb700 1 -- 172.21.15.31:0/2689906198 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v44) v1 ==== 107+0+5269 (secure 0 0 0) 0x7ff2a4022720 con 0x7ff2b40ffbd0 2024-09-17T02:04:43.120 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T02:04:43.120 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"btime":"2024-09-17T02:00:14:506593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44373,"name":"cephfs.smithi092.xzgrcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6825/186400038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":186400038},{"type":"v1","addr":"172.21.15.92:6825","nonce":186400038}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44377,"name":"cephfs.smithi092.hofoma","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/3092379292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3092379292},{"type":"v1","addr":"172.21.15.92:6827","nonce":3092379292}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:49:14.942770+0000","modified":"2024-09-17T02:00:14.506591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi031.menvuk","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.31:6827/2082480478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2082480478},{"type":"v1","addr":"172.21.15.31:6827","nonce":2082480478}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi031.gszbpe","rank":1,"incarnation":42,"state":"up:active","state_seq":12,"addr":"172.21.15.31:6829/1969572226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1969572226},{"type":"v1","addr":"172.21.15.31:6829","nonce":1969572226}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416,34448]},"id":1}]} 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2a006e680 msgr2=0x7ff2a0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2a006e680 0x7ff2a0070b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff29c005fd0 tx=0x7ff29c005e30 comp rx=0 tx=0).stop 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 msgr2=0x7ff2b4194aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4194aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006010 tx=0x7ff2a400be20 comp rx=0 tx=0).stop 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 shutdown_connections 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7ff2a006e680 0x7ff2a0070b30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2b40ffbd0 0x7ff2b4194aa0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:43.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 --2- 172.21.15.31:0/2689906198 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b4104130 0x7ff2b4194fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 >> 172.21.15.31:0/2689906198 conn(0x7ff2b4075130 msgr2=0x7ff2b40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.123+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 shutdown_connections 2024-09-17T02:04:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:43.124+0000 7ff2ba401700 1 -- 172.21.15.31:0/2689906198 wait complete. 2024-09-17T02:04:43.123 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 43 2024-09-17T02:04:43.445 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:43 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/2689906198' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-17T02:04:43.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:43 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/2689906198' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-17T02:04:43.767 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T02:04:43.778 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T02:04:43.778 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T02:04:43.778 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:04:43.797 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T02:04:43.797 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:04:43.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T02:04:44.100 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:44.448 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:44 smithi031 ceph-mon[77274]: pgmap v375: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:44 smithi092 ceph-mon[64495]: pgmap v375: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:45.472 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:45 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:04:45.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 -- 172.21.15.31:0/750853532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a80ffbd0 msgr2=0x7f80a8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:45.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 --2- 172.21.15.31:0/750853532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a80ffbd0 0x7f80a8100040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f809c009910 tx=0x7f809c009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:45.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 -- 172.21.15.31:0/750853532 shutdown_connections 2024-09-17T02:04:45.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 --2- 172.21.15.31:0/750853532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a80ffbd0 0x7f80a8100040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 --2- 172.21.15.31:0/750853532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a8104130 0x7f80a8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 -- 172.21.15.31:0/750853532 >> 172.21.15.31:0/750853532 conn(0x7f80a8075130 msgr2=0x7f80a8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:45.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 -- 172.21.15.31:0/750853532 shutdown_connections 2024-09-17T02:04:45.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.717+0000 7f80ae856700 1 -- 172.21.15.31:0/750853532 wait complete. 2024-09-17T02:04:45.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80ae856700 1 Processor -- start 2024-09-17T02:04:45.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80ae856700 1 -- start start 2024-09-17T02:04:45.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80ae856700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a80ffbd0 0x7f80a8104fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:45.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80ae856700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 0x7f80a8105500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:45.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80ae856700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8105a40 con 0x7f80a8104130 2024-09-17T02:04:45.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80ae856700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8105b80 con 0x7f80a80ffbd0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.718+0000 7f80a77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 0x7f80a8105500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a80ffbd0 0x7f80a8104fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 0x7f80a8105500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49228/0 (socket says 172.21.15.31:49228) 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a77fe700 1 -- 172.21.15.31:0/3080579807 learned_addr learned my addr 172.21.15.31:0/3080579807 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a7fff700 1 -- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 msgr2=0x7f80a8105500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a7fff700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 0x7f80a8105500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a7fff700 1 -- 172.21.15.31:0/3080579807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0095f0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a77fe700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 0x7f80a8105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a7fff700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a80ffbd0 0x7f80a8104fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f809800d6d0 tx=0x7f809800d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80980041f0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8098004cf0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a81a1fd0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809800f690 con 0x7f80a80ffbd0 2024-09-17T02:04:45.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.719+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a81a23e0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.720+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a804f2a0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.721+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f809800f7f0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.721+0000 7f80a57fa700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f809006e680 0x7f8090070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:45.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.722+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7f809808e1c0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.722+0000 7f80a77fe700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f809006e680 0x7f8090070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:45.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.722+0000 7f80a77fe700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f809006e680 0x7f8090070b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f809c005850 tx=0x7f809c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:45.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.726+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f80980573f0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:45 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:04:45.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.954+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80a81064f0 con 0x7f80a80ffbd0 2024-09-17T02:04:45.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.955+0000 7f80a57fa700 1 -- 172.21.15.31:0/3080579807 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v94) v1 ==== 81+0+2035 (secure 0 0 0) 0x7f809801d810 con 0x7f80a80ffbd0 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6828/2388806534 2024-09-18T01:59:18.184899+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6827/3872851712 2024-09-18T01:58:53.896359+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6826/3872851712 2024-09-18T01:58:53.896359+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/1966802676 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3469839404 2024-09-18T01:43:18.823729+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2403228197 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/735142931 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.954 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/122129414 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1660870141 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/339238761 2024-09-18T01:44:24.407842+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/4262139956 2024-09-18T01:44:24.407842+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/2290655579 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/624102818 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/3482100483 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2073602888 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:45.955 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1798114852 2024-09-18T01:43:18.823729+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3417331215 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:6828/1181363142 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/790013800 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1648474001 2024-09-18T01:44:24.407842+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/2716325552 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/2 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2235134594 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6829/2388806534 2024-09-18T01:59:18.184899+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/398316293 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/182280579 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/2 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:45.956 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1298770794 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/2234694319 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3923214510 2024-09-18T01:43:18.823729+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1636529029 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:6829/1181363142 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3494934127 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/1543058923 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.957 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/1543058923 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f809006e680 msgr2=0x7f8090070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f809006e680 0x7f8090070b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f809c005850 tx=0x7f809c01a040 comp rx=0 tx=0).stop 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a80ffbd0 msgr2=0x7f80a8104fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a80ffbd0 0x7f80a8104fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f809800d6d0 tx=0x7f809800d9e0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 shutdown_connections 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7f809006e680 0x7f8090070b30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a80ffbd0 0x7f80a8104fc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 --2- 172.21.15.31:0/3080579807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80a8104130 0x7f80a8105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 >> 172.21.15.31:0/3080579807 conn(0x7f80a8075130 msgr2=0x7f80a80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 shutdown_connections 2024-09-17T02:04:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:45.957+0000 7f80ae856700 1 -- 172.21.15.31:0/3080579807 wait complete. 2024-09-17T02:04:45.959 INFO:teuthology.orchestra.run.smithi031.stderr:listed 35 entries 2024-09-17T02:04:46.634 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:46 smithi031 ceph-mon[77274]: pgmap v376: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:46.634 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:04:46.634 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:04:46.634 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:04:46.634 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:46 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3080579807' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T02:04:46.657 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T02:04:46.657 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:04:46.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid fb7c6180-7495-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T02:04:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:46 smithi092 ceph-mon[64495]: pgmap v376: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:04:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:04:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:04:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:46 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3080579807' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T02:04:46.926 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/mon.smithi031/config 2024-09-17T02:04:47.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:47 smithi031 ceph-mon[77274]: pgmap v377: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:47 smithi092 ceph-mon[64495]: pgmap v377: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 -- 172.21.15.31:0/1425195770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101420 msgr2=0x7fe43c1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 --2- 172.21.15.31:0/1425195770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101420 0x7fe43c1017f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009910 tx=0x7fe42c009c20 comp rx=0 tx=0).stop 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 -- 172.21.15.31:0/1425195770 shutdown_connections 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 --2- 172.21.15.31:0/1425195770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101d30 0x7fe43c10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 --2- 172.21.15.31:0/1425195770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101420 0x7fe43c1017f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 -- 172.21.15.31:0/1425195770 >> 172.21.15.31:0/1425195770 conn(0x7fe43c0fac80 msgr2=0x7fe43c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:48.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 -- 172.21.15.31:0/1425195770 shutdown_connections 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.789+0000 7fe440ca8700 1 -- 172.21.15.31:0/1425195770 wait complete. 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe440ca8700 1 Processor -- start 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe440ca8700 1 -- start start 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe440ca8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101420 0x7fe43c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe440ca8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 0x7fe43c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe440ca8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c196a90 con 0x7fe43c101d30 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe440ca8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c19a820 con 0x7fe43c101420 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe439d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 0x7fe43c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe439d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 0x7fe43c1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49252/0 (socket says 172.21.15.31:49252) 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe439d9b700 1 -- 172.21.15.31:0/3538556218 learned_addr learned my addr 172.21.15.31:0/3538556218 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.790+0000 7fe43a59c700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101420 0x7fe43c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe439d9b700 1 -- 172.21.15.31:0/3538556218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101420 msgr2=0x7fe43c195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:48.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe439d9b700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101420 0x7fe43c195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe439d9b700 1 -- 172.21.15.31:0/3538556218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0095f0 con 0x7fe43c101d30 2024-09-17T02:04:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe43a59c700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101420 0x7fe43c195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe439d9b700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 0x7fe43c1963b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe43000d8d0 tx=0x7fe43000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe430009940 con 0x7fe43c101d30 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe430010460 con 0x7fe43c101d30 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43000f5f0 con 0x7fe43c101d30 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c19ab00 con 0x7fe43c101d30 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.791+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c19b050 con 0x7fe43c101d30 2024-09-17T02:04:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.792+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c107900 con 0x7fe43c101d30 2024-09-17T02:04:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.793+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe4300105d0 con 0x7fe43c101d30 2024-09-17T02:04:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.793+0000 7fe42b7fe700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe42406e680 0x7fe424070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:04:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.793+0000 7fe43a59c700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe42406e680 0x7fe424070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:04:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.793+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6531+0+0 (secure 0 0 0) 0x7fe43008e750 con 0x7fe43c101d30 2024-09-17T02:04:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.794+0000 7fe43a59c700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe42406e680 0x7fe424070b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe42c005b40 tx=0x7fe42c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:04:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:48.798+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe430057820 con 0x7fe43c101d30 2024-09-17T02:04:49.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.027+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe43c1972a0 con 0x7fe43c101d30 2024-09-17T02:04:49.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.027+0000 7fe42b7fe700 1 -- 172.21.15.31:0/3538556218 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v94) v1 ==== 81+0+2035 (secure 0 0 0) 0x7fe43005aee0 con 0x7fe43c101d30 2024-09-17T02:04:49.026 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6828/2388806534 2024-09-18T01:59:18.184899+0000 2024-09-17T02:04:49.026 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6827/3872851712 2024-09-18T01:58:53.896359+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/1543058923 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/2716325552 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3469839404 2024-09-18T01:43:18.823729+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2403228197 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/735142931 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/1543058923 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3494934127 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/4262139956 2024-09-18T01:44:24.407842+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/2290655579 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6826/3872851712 2024-09-18T01:58:53.896359+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/1966802676 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/624102818 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.027 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/3482100483 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/122129414 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2073602888 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1798114852 2024-09-18T01:43:18.823729+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3417331215 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1648474001 2024-09-18T01:44:24.407842+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:6828/1181363142 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/790013800 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/2 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2235134594 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1298770794 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/2 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:0/2234694319 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3923214510 2024-09-18T01:43:18.823729+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/339238761 2024-09-18T01:44:24.407842+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1660870141 2024-09-18T01:42:45.749841+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.92:6829/1181363142 2024-09-18T01:52:55.106231+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1636529029 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6829/2388806534 2024-09-18T01:59:18.184899+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/398316293 2024-09-18T01:51:44.705130+0000 2024-09-17T02:04:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/182280579 2024-09-18T01:53:50.210172+0000 2024-09-17T02:04:49.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe42406e680 msgr2=0x7fe424070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:49.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe42406e680 0x7fe424070b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe42c005b40 tx=0x7fe42c01a040 comp rx=0 tx=0).stop 2024-09-17T02:04:49.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 msgr2=0x7fe43c1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:04:49.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 0x7fe43c1963b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe43000d8d0 tx=0x7fe43000dc90 comp rx=0 tx=0).stop 2024-09-17T02:04:49.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 shutdown_connections 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:6800/1457430176,v1:172.21.15.31:6801/1457430176] conn(0x7fe42406e680 0x7fe424070b30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe43c101420 0x7fe43c195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 --2- 172.21.15.31:0/3538556218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe43c101d30 0x7fe43c1963b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 >> 172.21.15.31:0/3538556218 conn(0x7fe43c0fac80 msgr2=0x7fe43c104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 shutdown_connections 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T02:04:49.030+0000 7fe440ca8700 1 -- 172.21.15.31:0/3538556218 wait complete. 2024-09-17T02:04:49.031 INFO:teuthology.orchestra.run.smithi031.stderr:listed 35 entries 2024-09-17T02:04:49.683 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:49 smithi031 ceph-mon[77274]: pgmap v378: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:49.684 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:49 smithi031 ceph-mon[77274]: from='client.? 172.21.15.31:0/3538556218' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T02:04:49.707 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-09-17T02:04:49.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:04:49.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T02:04:49.736 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:04:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:49 smithi092 ceph-mon[64495]: pgmap v378: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:49.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:49 smithi092 ceph-mon[64495]: from='client.? 172.21.15.31:0/3538556218' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T02:04:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:50.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:04:51.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:51 smithi092 ceph-mon[64495]: pgmap v379: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:51.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:51 smithi031 ceph-mon[77274]: pgmap v379: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:53.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:53 smithi031 ceph-mon[77274]: pgmap v380: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:53.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:53 smithi092 ceph-mon[64495]: pgmap v380: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:55.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:55 smithi092 ceph-mon[64495]: pgmap v381: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:55.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:55 smithi031 ceph-mon[77274]: pgmap v381: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:57.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:57 smithi092 ceph-mon[64495]: pgmap v382: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:57.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:57 smithi031 ceph-mon[77274]: pgmap v382: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:04:59.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:04:59 smithi092 ceph-mon[64495]: pgmap v383: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:04:59.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:04:59 smithi031 ceph-mon[77274]: pgmap v383: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:01.740 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:01 smithi092 ceph-mon[64495]: pgmap v384: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:01.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:01 smithi031 ceph-mon[77274]: pgmap v384: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:03.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:03 smithi092 ceph-mon[64495]: pgmap v385: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:03.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:03 smithi031 ceph-mon[77274]: pgmap v385: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:05.567 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:05 smithi031 ceph-mon[77274]: pgmap v386: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:05.567 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:05 smithi092 ceph-mon[64495]: pgmap v386: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:07.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:07 smithi092 ceph-mon[64495]: pgmap v387: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:07.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:07 smithi031 ceph-mon[77274]: pgmap v387: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:09 smithi092 ceph-mon[64495]: pgmap v388: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:09.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:09 smithi031 ceph-mon[77274]: pgmap v388: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:11.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:11 smithi092 ceph-mon[64495]: pgmap v389: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:11.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:11 smithi031 ceph-mon[77274]: pgmap v389: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:13.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:13 smithi092 ceph-mon[64495]: pgmap v390: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:13.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:13 smithi031 ceph-mon[77274]: pgmap v390: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:15 smithi092 ceph-mon[64495]: pgmap v391: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:15 smithi031 ceph-mon[77274]: pgmap v391: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:17 smithi092 ceph-mon[64495]: pgmap v392: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:17 smithi031 ceph-mon[77274]: pgmap v392: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:19 smithi092 ceph-mon[64495]: pgmap v393: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:19.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:19 smithi031 ceph-mon[77274]: pgmap v393: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:20.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:21.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:21 smithi092 ceph-mon[64495]: pgmap v394: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:21 smithi031 ceph-mon[77274]: pgmap v394: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:23 smithi031 ceph-mon[77274]: pgmap v395: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:23 smithi092 ceph-mon[64495]: pgmap v395: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:25.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:25 smithi092 ceph-mon[64495]: pgmap v396: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:25 smithi031 ceph-mon[77274]: pgmap v396: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:27 smithi031 ceph-mon[77274]: pgmap v397: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:27.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:27 smithi092 ceph-mon[64495]: pgmap v397: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:29 smithi031 ceph-mon[77274]: pgmap v398: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:29.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:29 smithi092 ceph-mon[64495]: pgmap v398: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:31 smithi031 ceph-mon[77274]: pgmap v399: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:31.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:31 smithi092 ceph-mon[64495]: pgmap v399: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:33.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:33 smithi031 ceph-mon[77274]: pgmap v400: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:33.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:33 smithi092 ceph-mon[64495]: pgmap v400: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:35.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:35 smithi092 ceph-mon[64495]: pgmap v401: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:35.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:35 smithi031 ceph-mon[77274]: pgmap v401: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:37 smithi031 ceph-mon[77274]: pgmap v402: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:37 smithi092 ceph-mon[64495]: pgmap v402: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:39.791 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:39 smithi092 ceph-mon[64495]: pgmap v403: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:39 smithi031 ceph-mon[77274]: pgmap v403: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:41.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:41 smithi092 ceph-mon[64495]: pgmap v404: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:42.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:41 smithi031 ceph-mon[77274]: pgmap v404: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:43 smithi092 ceph-mon[64495]: pgmap v405: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:44.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:43 smithi031 ceph-mon[77274]: pgmap v405: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:45 smithi092 ceph-mon[64495]: pgmap v406: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:45 smithi031 ceph-mon[77274]: pgmap v406: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:46.968 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:05:46.969 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:05:46.969 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:05:46.969 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:05:46.969 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:05:46.969 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:46 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:05:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:05:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:05:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:05:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:05:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:05:46.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:46 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:05:48.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:48 smithi092 ceph-mon[64495]: pgmap v407: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:48.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:48 smithi031 ceph-mon[77274]: pgmap v407: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:50.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:50 smithi092 ceph-mon[64495]: pgmap v408: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:50.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:50 smithi031 ceph-mon[77274]: pgmap v408: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:51.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:05:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:52 smithi092 ceph-mon[64495]: pgmap v409: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:52 smithi031 ceph-mon[77274]: pgmap v409: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:54 smithi092 ceph-mon[64495]: pgmap v410: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:54 smithi031 ceph-mon[77274]: pgmap v410: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:56.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:56 smithi092 ceph-mon[64495]: pgmap v411: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:56 smithi031 ceph-mon[77274]: pgmap v411: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:05:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:05:58 smithi092 ceph-mon[64495]: pgmap v412: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:05:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:05:58 smithi031 ceph-mon[77274]: pgmap v412: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:00 smithi092 ceph-mon[64495]: pgmap v413: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:00 smithi031 ceph-mon[77274]: pgmap v413: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:02 smithi092 ceph-mon[64495]: pgmap v414: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:02.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:02 smithi031 ceph-mon[77274]: pgmap v414: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:04 smithi092 ceph-mon[64495]: pgmap v415: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:04.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:04 smithi031 ceph-mon[77274]: pgmap v415: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:06.443 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:06 smithi031 ceph-mon[77274]: pgmap v416: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:06.443 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:06 smithi092 ceph-mon[64495]: pgmap v416: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:08 smithi092 ceph-mon[64495]: pgmap v417: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:08 smithi031 ceph-mon[77274]: pgmap v417: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:10 smithi092 ceph-mon[64495]: pgmap v418: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:10.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:10 smithi031 ceph-mon[77274]: pgmap v418: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:12 smithi092 ceph-mon[64495]: pgmap v419: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:12.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:12 smithi031 ceph-mon[77274]: pgmap v419: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:14 smithi092 ceph-mon[64495]: pgmap v420: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:14.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:14 smithi031 ceph-mon[77274]: pgmap v420: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:16.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:16 smithi092 ceph-mon[64495]: pgmap v421: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:16.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:16 smithi031 ceph-mon[77274]: pgmap v421: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:18 smithi092 ceph-mon[64495]: pgmap v422: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:18.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:18 smithi031 ceph-mon[77274]: pgmap v422: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:20 smithi092 ceph-mon[64495]: pgmap v423: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:20 smithi031 ceph-mon[77274]: pgmap v423: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:21.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:22 smithi092 ceph-mon[64495]: pgmap v424: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:22 smithi031 ceph-mon[77274]: pgmap v424: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:24.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:24 smithi031 ceph-mon[77274]: pgmap v425: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:24.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:24 smithi092 ceph-mon[64495]: pgmap v425: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:26.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:26 smithi031 ceph-mon[77274]: pgmap v426: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:26 smithi092 ceph-mon[64495]: pgmap v426: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:28.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:28 smithi092 ceph-mon[64495]: pgmap v427: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:28.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:28 smithi031 ceph-mon[77274]: pgmap v427: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:30 smithi092 ceph-mon[64495]: pgmap v428: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:30.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:30 smithi031 ceph-mon[77274]: pgmap v428: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:32 smithi092 ceph-mon[64495]: pgmap v429: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:32.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:32 smithi031 ceph-mon[77274]: pgmap v429: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:34 smithi092 ceph-mon[64495]: pgmap v430: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:34.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:34 smithi031 ceph-mon[77274]: pgmap v430: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:36.567 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:36 smithi031 ceph-mon[77274]: pgmap v431: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:36.567 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:36 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:36.597 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:36 smithi092 ceph-mon[64495]: pgmap v431: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:36.597 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:36 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:38 smithi092 ceph-mon[64495]: pgmap v432: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:38 smithi031 ceph-mon[77274]: pgmap v432: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:40.541 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:40 smithi092 ceph-mon[64495]: pgmap v433: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:40.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:40 smithi031 ceph-mon[77274]: pgmap v433: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:42.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:42 smithi031 ceph-mon[77274]: pgmap v434: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:42.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:42 smithi092 ceph-mon[64495]: pgmap v434: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:44 smithi092 ceph-mon[64495]: pgmap v435: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:44 smithi031 ceph-mon[77274]: pgmap v435: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:46 smithi092 ceph-mon[64495]: pgmap v436: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:46 smithi031 ceph-mon[77274]: pgmap v436: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:06:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:06:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:06:47.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:06:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:06:47.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:06:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:06:47.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:06:48.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:48 smithi092 ceph-mon[64495]: pgmap v437: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:48 smithi031 ceph-mon[77274]: pgmap v437: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:50 smithi092 ceph-mon[64495]: pgmap v438: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:50.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:50.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:50 smithi031 ceph-mon[77274]: pgmap v438: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:50.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:06:52.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:52 smithi092 ceph-mon[64495]: pgmap v439: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:52.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:52 smithi031 ceph-mon[77274]: pgmap v439: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:54.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:54 smithi092 ceph-mon[64495]: pgmap v440: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:54.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:54 smithi031 ceph-mon[77274]: pgmap v440: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:56.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:56 smithi092 ceph-mon[64495]: pgmap v441: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:56.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:56 smithi031 ceph-mon[77274]: pgmap v441: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:06:58.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:06:58 smithi092 ceph-mon[64495]: pgmap v442: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:06:58.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:06:58 smithi031 ceph-mon[77274]: pgmap v442: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:00.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:00 smithi092 ceph-mon[64495]: pgmap v443: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:00.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:00 smithi031 ceph-mon[77274]: pgmap v443: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:02 smithi092 ceph-mon[64495]: pgmap v444: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:02.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:02 smithi031 ceph-mon[77274]: pgmap v444: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:04.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:04 smithi092 ceph-mon[64495]: pgmap v445: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:04.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:04 smithi031 ceph-mon[77274]: pgmap v445: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:05.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:05.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:06.666 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:06 smithi031 ceph-mon[77274]: pgmap v446: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:06.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:06 smithi092 ceph-mon[64495]: pgmap v446: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:07.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:07 smithi092 ceph-mon[64495]: pgmap v447: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:07.598 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:07 smithi031 ceph-mon[77274]: pgmap v447: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:09.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:09 smithi092 ceph-mon[64495]: pgmap v448: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:09.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:09 smithi031 ceph-mon[77274]: pgmap v448: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:11.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:11 smithi092 ceph-mon[64495]: pgmap v449: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:11.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:11 smithi031 ceph-mon[77274]: pgmap v449: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:13.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:13 smithi092 ceph-mon[64495]: pgmap v450: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:13.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:13 smithi031 ceph-mon[77274]: pgmap v450: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:15.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:15 smithi092 ceph-mon[64495]: pgmap v451: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:15.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:15 smithi031 ceph-mon[77274]: pgmap v451: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:17.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:17 smithi092 ceph-mon[64495]: pgmap v452: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:17.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:17 smithi031 ceph-mon[77274]: pgmap v452: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:19.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:19 smithi092 ceph-mon[64495]: pgmap v453: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:19.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:19 smithi031 ceph-mon[77274]: pgmap v453: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:20.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:20.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:21.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:21 smithi031 ceph-mon[77274]: pgmap v454: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:21.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:21 smithi092 ceph-mon[64495]: pgmap v454: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:23.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:23 smithi031 ceph-mon[77274]: pgmap v455: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:23 smithi092 ceph-mon[64495]: pgmap v455: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:25.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:25 smithi031 ceph-mon[77274]: pgmap v456: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:25 smithi092 ceph-mon[64495]: pgmap v456: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:27.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:27 smithi031 ceph-mon[77274]: pgmap v457: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:27.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:27 smithi092 ceph-mon[64495]: pgmap v457: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:29.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:29 smithi031 ceph-mon[77274]: pgmap v458: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:29.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:29 smithi092 ceph-mon[64495]: pgmap v458: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:31.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:31 smithi031 ceph-mon[77274]: pgmap v459: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:31.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:31 smithi092 ceph-mon[64495]: pgmap v459: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:33.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:33 smithi031 ceph-mon[77274]: pgmap v460: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:33.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:33 smithi092 ceph-mon[64495]: pgmap v460: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:35 smithi031 ceph-mon[77274]: pgmap v461: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:35 smithi092 ceph-mon[64495]: pgmap v461: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:37.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:37 smithi031 ceph-mon[77274]: pgmap v462: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:37 smithi092 ceph-mon[64495]: pgmap v462: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:39.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:39 smithi092 ceph-mon[64495]: pgmap v463: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:39 smithi031 ceph-mon[77274]: pgmap v463: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:41.791 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:41 smithi092 ceph-mon[64495]: pgmap v464: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:42.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:41 smithi031 ceph-mon[77274]: pgmap v464: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:43.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:43 smithi092 ceph-mon[64495]: pgmap v465: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:44.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:43 smithi031 ceph-mon[77274]: pgmap v465: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:45 smithi092 ceph-mon[64495]: pgmap v466: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:45 smithi031 ceph-mon[77274]: pgmap v466: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:47.927 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:47 smithi092 ceph-mon[64495]: pgmap v467: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:47.927 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:47 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:07:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:47 smithi031 ceph-mon[77274]: pgmap v467: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:47 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:07:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:07:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:07:48.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:07:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:07:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:07:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:07:49.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:49 smithi092 ceph-mon[64495]: pgmap v468: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:50.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:49 smithi031 ceph-mon[77274]: pgmap v468: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:50.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:50 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:51.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:50 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:07:51.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:51 smithi092 ceph-mon[64495]: pgmap v469: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:52.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:51 smithi031 ceph-mon[77274]: pgmap v469: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:53.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:53 smithi031 ceph-mon[77274]: pgmap v470: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:53.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:53 smithi092 ceph-mon[64495]: pgmap v470: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:55.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:55 smithi092 ceph-mon[64495]: pgmap v471: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:56.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:55 smithi031 ceph-mon[77274]: pgmap v471: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:07:57.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:57 smithi092 ceph-mon[64495]: pgmap v472: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:58.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:57 smithi031 ceph-mon[77274]: pgmap v472: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:07:59.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:07:59 smithi092 ceph-mon[64495]: pgmap v473: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:00.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:07:59 smithi031 ceph-mon[77274]: pgmap v473: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:01.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:01 smithi092 ceph-mon[64495]: pgmap v474: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:02.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:01 smithi031 ceph-mon[77274]: pgmap v474: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:03.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:03 smithi092 ceph-mon[64495]: pgmap v475: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:04.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:03 smithi031 ceph-mon[77274]: pgmap v475: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:05 smithi092 ceph-mon[64495]: pgmap v476: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:05.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:05 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:06.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:05 smithi031 ceph-mon[77274]: pgmap v476: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:06.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:05 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:07.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:07 smithi092 ceph-mon[64495]: pgmap v477: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:08.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:07 smithi031 ceph-mon[77274]: pgmap v477: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:09.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:09 smithi092 ceph-mon[64495]: pgmap v478: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:10.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:09 smithi031 ceph-mon[77274]: pgmap v478: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:11.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:11 smithi092 ceph-mon[64495]: pgmap v479: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:12.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:11 smithi031 ceph-mon[77274]: pgmap v479: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:13.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:13 smithi092 ceph-mon[64495]: pgmap v480: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:14.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:13 smithi031 ceph-mon[77274]: pgmap v480: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:15.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:15 smithi092 ceph-mon[64495]: pgmap v481: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:16.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:15 smithi031 ceph-mon[77274]: pgmap v481: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:17.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:17 smithi092 ceph-mon[64495]: pgmap v482: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:18.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:17 smithi031 ceph-mon[77274]: pgmap v482: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:19.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:19 smithi092 ceph-mon[64495]: pgmap v483: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:20.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:19 smithi031 ceph-mon[77274]: pgmap v483: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:20.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:20 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:21.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:20 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:21.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:21 smithi092 ceph-mon[64495]: pgmap v484: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:22.058 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:21 smithi031 ceph-mon[77274]: pgmap v484: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:23.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:23 smithi092 ceph-mon[64495]: pgmap v485: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:24.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:23 smithi031 ceph-mon[77274]: pgmap v485: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:25.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:25 smithi092 ceph-mon[64495]: pgmap v486: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:26.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:25 smithi031 ceph-mon[77274]: pgmap v486: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:27.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:27 smithi092 ceph-mon[64495]: pgmap v487: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:28.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:27 smithi031 ceph-mon[77274]: pgmap v487: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:29.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:29 smithi092 ceph-mon[64495]: pgmap v488: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:30.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:29 smithi031 ceph-mon[77274]: pgmap v488: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:31.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:31 smithi092 ceph-mon[64495]: pgmap v489: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:32.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:31 smithi031 ceph-mon[77274]: pgmap v489: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:33.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:33 smithi092 ceph-mon[64495]: pgmap v490: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:34.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:33 smithi031 ceph-mon[77274]: pgmap v490: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:35 smithi092 ceph-mon[64495]: pgmap v491: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:35.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:36.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:35 smithi031 ceph-mon[77274]: pgmap v491: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:36.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:37.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:37 smithi092 ceph-mon[64495]: pgmap v492: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:38.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:37 smithi031 ceph-mon[77274]: pgmap v492: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:39.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:39 smithi092 ceph-mon[64495]: pgmap v493: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:40.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:39 smithi031 ceph-mon[77274]: pgmap v493: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:41.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:41 smithi092 ceph-mon[64495]: pgmap v494: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:42.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:41 smithi031 ceph-mon[77274]: pgmap v494: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:43.958 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:43 smithi092 ceph-mon[64495]: pgmap v495: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:44.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:43 smithi031 ceph-mon[77274]: pgmap v495: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:45.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:45 smithi092 ceph-mon[64495]: pgmap v496: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:46.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:45 smithi031 ceph-mon[77274]: pgmap v496: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:47.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:47 smithi092 ceph-mon[64495]: pgmap v497: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:48.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:47 smithi031 ceph-mon[77274]: pgmap v497: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:08:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:08:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:08:48.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:08:49.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:08:49.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T02:08:49.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T02:08:49.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' 2024-09-17T02:08:50.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:50 smithi092 ceph-mon[64495]: pgmap v498: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:50.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:50 smithi031 ceph-mon[77274]: pgmap v498: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:51 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:51.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:51 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:08:52.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:52 smithi092 ceph-mon[64495]: pgmap v499: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:52.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:52 smithi031 ceph-mon[77274]: pgmap v499: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:54.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:54 smithi092 ceph-mon[64495]: pgmap v500: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:54.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:54 smithi031 ceph-mon[77274]: pgmap v500: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:56.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:56 smithi092 ceph-mon[64495]: pgmap v501: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:56.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:56 smithi031 ceph-mon[77274]: pgmap v501: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:08:58.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:08:58 smithi092 ceph-mon[64495]: pgmap v502: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:08:58.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:08:58 smithi031 ceph-mon[77274]: pgmap v502: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:00.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:00 smithi092 ceph-mon[64495]: pgmap v503: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:00.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:00 smithi031 ceph-mon[77274]: pgmap v503: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:02.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:02 smithi092 ceph-mon[64495]: pgmap v504: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:02.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:02 smithi031 ceph-mon[77274]: pgmap v504: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:04.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:04 smithi092 ceph-mon[64495]: pgmap v505: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:04.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:04 smithi031 ceph-mon[77274]: pgmap v505: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:06 smithi092 ceph-mon[64495]: pgmap v506: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:06.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:06 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:09:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:06 smithi031 ceph-mon[77274]: pgmap v506: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:06.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:06 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:09:08.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:08 smithi092 ceph-mon[64495]: pgmap v507: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:08.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:08 smithi031 ceph-mon[77274]: pgmap v507: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:10.264 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:10 smithi031 ceph-mon[77274]: pgmap v508: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:10.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:10 smithi092 ceph-mon[64495]: pgmap v508: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:12.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:12 smithi092 ceph-mon[64495]: pgmap v509: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:12.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:12 smithi031 ceph-mon[77274]: pgmap v509: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:14.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:14 smithi092 ceph-mon[64495]: pgmap v510: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:14.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:14 smithi031 ceph-mon[77274]: pgmap v510: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:16.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:16 smithi092 ceph-mon[64495]: pgmap v511: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:16.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:16 smithi031 ceph-mon[77274]: pgmap v511: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:18.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:18 smithi092 ceph-mon[64495]: pgmap v512: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:18.535 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:18 smithi031 ceph-mon[77274]: pgmap v512: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:20.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:20 smithi092 ceph-mon[64495]: pgmap v513: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:20.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:20 smithi031 ceph-mon[77274]: pgmap v513: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:21.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:21 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:09:21.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:21 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:09:22.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:22 smithi092 ceph-mon[64495]: pgmap v514: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:22.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:22 smithi031 ceph-mon[77274]: pgmap v514: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:24.706 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:24 smithi092 ceph-mon[64495]: pgmap v515: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:24.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:24 smithi031 ceph-mon[77274]: pgmap v515: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:26.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:26 smithi092 ceph-mon[64495]: pgmap v516: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:26.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:26 smithi031 ceph-mon[77274]: pgmap v516: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:28.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:28 smithi092 ceph-mon[64495]: pgmap v517: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:28.765 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:28 smithi031 ceph-mon[77274]: pgmap v517: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:30.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:30 smithi092 ceph-mon[64495]: pgmap v518: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:30.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:30 smithi031 ceph-mon[77274]: pgmap v518: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:32.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:32 smithi092 ceph-mon[64495]: pgmap v519: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:32.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:32 smithi031 ceph-mon[77274]: pgmap v519: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:34.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:34 smithi092 ceph-mon[64495]: pgmap v520: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:34.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:34 smithi031 ceph-mon[77274]: pgmap v520: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:35.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:35 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:09:35.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:35 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T02:09:36.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:36 smithi092 ceph-mon[64495]: pgmap v521: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:36.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:36 smithi031 ceph-mon[77274]: pgmap v521: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:38.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:38 smithi092 ceph-mon[64495]: pgmap v522: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:38.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:38 smithi031 ceph-mon[77274]: pgmap v522: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:40.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:40 smithi092 ceph-mon[64495]: pgmap v523: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:40.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:40 smithi031 ceph-mon[77274]: pgmap v523: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:42.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:42 smithi092 ceph-mon[64495]: pgmap v524: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:42.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:42 smithi031 ceph-mon[77274]: pgmap v524: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:44.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:44 smithi092 ceph-mon[64495]: pgmap v525: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:44.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:44 smithi031 ceph-mon[77274]: pgmap v525: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:46.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:46 smithi092 ceph-mon[64495]: pgmap v526: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:46.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:46 smithi031 ceph-mon[77274]: pgmap v526: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T02:09:48.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:48 smithi092 ceph-mon[64495]: pgmap v527: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:48.739 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:48 smithi092 ceph-mon[64495]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:09:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:48 smithi031 ceph-mon[77274]: pgmap v527: 65 pgs: 65 active+clean; 151 MiB data, 725 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T02:09:48.764 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:48 smithi031 ceph-mon[77274]: from='mgr.34104 172.21.15.31:0/3919673662' entity='mgr.smithi031.ealpiz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T02:09:48.810 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-17T02:09:48.810 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T02:09:48.812 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T02:09:48.829 INFO:tasks.cephadm:Teardown begin 2024-09-17T02:09:48.829 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T02:09:48.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T02:09:48.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T02:09:48.887 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T02:09:48.887 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T02:09:48.917 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T02:09:48.942 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T02:09:48.942 INFO:tasks.cephadm.mon.smithi031:Stopping mon.smithi031... 2024-09-17T02:09:48.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031 2024-09-17T02:09:49.256 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:49 smithi031 systemd[1]: Stopping Ceph mon.smithi031 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:09:49.514 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:49 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[77270]: 2024-09-17T02:09:49.258+0000 7fe1be55c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi031 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:09:49.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:49 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031[77270]: 2024-09-17T02:09:49.258+0000 7fe1be55c640 -1 mon.smithi031@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T02:09:49.515 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:49 smithi031 podman[132768]: 2024-09-17 02:09:49.309869171 +0000 UTC m=+0.155939670 container died c2c9d962792c08fc2bea574d882277a41ecc0c6309b9bcc323eaccd8b259c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T02:09:50.014 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:49 smithi031 podman[132768]: 2024-09-17 02:09:49.808570876 +0000 UTC m=+0.654641418 container cleanup c2c9d962792c08fc2bea574d882277a41ecc0c6309b9bcc323eaccd8b259c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T02:09:50.015 INFO:journalctl@ceph.mon.smithi031.smithi031.stdout:Sep 17 02:09:49 smithi031 bash[132768]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi031 2024-09-17T02:09:50.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi031.service' 2024-09-17T02:09:50.287 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:09:50.288 INFO:tasks.cephadm.mon.smithi031:Stopped mon.smithi031 2024-09-17T02:09:50.288 INFO:tasks.cephadm.mon.smithi092:Stopping mon.smithi092... 2024-09-17T02:09:50.288 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092 2024-09-17T02:09:50.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:50 smithi092 systemd[1]: Stopping Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:09:50.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:50 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092[64491]: 2024-09-17T02:09:50.665+0000 7f9661fbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi092 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:09:50.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:50 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092[64491]: 2024-09-17T02:09:50.665+0000 7f9661fbb640 -1 mon.smithi092@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T02:09:50.989 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:50 smithi092 podman[94718]: 2024-09-17 02:09:50.871287669 +0000 UTC m=+0.398535765 container died 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T02:09:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:51 smithi092 podman[94718]: 2024-09-17 02:09:51.367346884 +0000 UTC m=+0.894594986 container cleanup 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T02:09:51.489 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:51 smithi092 bash[94718]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092 2024-09-17T02:09:51.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092.service' 2024-09-17T02:09:51.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:51 smithi092 podman[94729]: 2024-09-17 02:09:51.602368318 +0000 UTC m=+0.726598868 container remove 1a8741897f029f7e41aa2890b5fc9efef8bcb0d241234da02fb98ba8bf9cb805 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-mon-smithi092, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T02:09:51.865 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:51 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092.service: Deactivated successfully. 2024-09-17T02:09:51.866 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:51 smithi092 systemd[1]: Stopped Ceph mon.smithi092 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T02:09:51.866 INFO:journalctl@ceph.mon.smithi092.smithi092.stdout:Sep 17 02:09:51 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@mon.smithi092.service: Consumed 8.083s CPU time. 2024-09-17T02:09:51.884 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:09:51.884 INFO:tasks.cephadm.mon.smithi092:Stopped mon.smithi092 2024-09-17T02:09:51.884 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T02:09:51.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.0 2024-09-17T02:09:52.186 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:51 smithi031 systemd[1]: Stopping Ceph osd.0 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:09:52.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:52 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T02:09:52.188+0000 7f9a1c470640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:09:52.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:52 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T02:09:52.188+0000 7f9a1c470640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-17T02:09:52.515 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:52 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0[83546]: 2024-09-17T02:09:52.188+0000 7f9a1c470640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T02:09:57.805 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:57 smithi031 podman[132903]: 2024-09-17 02:09:57.524437434 +0000 UTC m=+5.440485542 container died e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True) 2024-09-17T02:09:58.233 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:57 smithi031 podman[132903]: 2024-09-17 02:09:57.897083575 +0000 UTC m=+5.813131683 container cleanup e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T02:09:58.233 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:57 smithi031 bash[132903]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0 2024-09-17T02:09:58.514 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:58 smithi031 podman[132918]: 2024-09-17 02:09:58.235796928 +0000 UTC m=+0.701546269 container remove e6f4c3911071e8de611a1fcd23a8c88316f5df1dfd302f085eac6f9034b4afdf (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T02:09:58.875 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:58 smithi031 podman[133011]: 2024-09-17 02:09:58.486961959 +0000 UTC m=+0.017032474 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T02:09:58.875 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:58 smithi031 podman[133011]: 2024-09-17 02:09:58.624916305 +0000 UTC m=+0.154986811 container create aacff6def43455df343218d1a4fdef3ea22a762f696f72962d035bbe174b6f86 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T02:09:58.875 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:58 smithi031 podman[133011]: 2024-09-17 02:09:58.877686943 +0000 UTC m=+0.407757462 container init aacff6def43455df343218d1a4fdef3ea22a762f696f72962d035bbe174b6f86 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T02:09:59.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:58 smithi031 podman[133011]: 2024-09-17 02:09:58.881416455 +0000 UTC m=+0.411486957 container start aacff6def43455df343218d1a4fdef3ea22a762f696f72962d035bbe174b6f86 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T02:09:59.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:58 smithi031 podman[133011]: 2024-09-17 02:09:58.986004729 +0000 UTC m=+0.516075240 container attach aacff6def43455df343218d1a4fdef3ea22a762f696f72962d035bbe174b6f86 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T02:09:59.265 INFO:journalctl@ceph.osd.0.smithi031.stdout:Sep 17 02:09:59 smithi031 podman[133034]: 2024-09-17 02:09:59.106830932 +0000 UTC m=+0.017693265 container died aacff6def43455df343218d1a4fdef3ea22a762f696f72962d035bbe174b6f86 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T02:09:59.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T02:09:59.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:09:59.761 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T02:09:59.761 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T02:09:59.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.1 2024-09-17T02:10:00.014 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:09:59 smithi031 systemd[1]: Stopping Ceph osd.1 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:10:00.392 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:00 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T02:10:00.108+0000 7f0460ef2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:10:00.392 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:00 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T02:10:00.108+0000 7f0460ef2640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-17T02:10:00.392 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:00 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1[86859]: 2024-09-17T02:10:00.108+0000 7f0460ef2640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T02:10:05.858 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:05 smithi031 podman[133124]: 2024-09-17 02:10:05.562846801 +0000 UTC m=+5.559442892 container died f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T02:10:06.250 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:05 smithi031 podman[133124]: 2024-09-17 02:10:05.9426552 +0000 UTC m=+5.939251282 container cleanup f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T02:10:06.250 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:05 smithi031 bash[133124]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1 2024-09-17T02:10:06.514 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:06 smithi031 podman[133143]: 2024-09-17 02:10:06.252598042 +0000 UTC m=+0.680654118 container remove f8d67cd4936a7cba7520be28143a28bbd8bce88f5d22c044e617fae768ef131c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T02:10:06.928 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:06 smithi031 podman[133229]: 2024-09-17 02:10:06.47988423 +0000 UTC m=+0.016968591 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T02:10:06.929 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:06 smithi031 podman[133229]: 2024-09-17 02:10:06.578340746 +0000 UTC m=+0.115425098 container create 095c374e1e1db0d638c4a2837edd9c1ea83e6ed4463c7f06ad64a31025ca3e5c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T02:10:06.929 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:06 smithi031 podman[133229]: 2024-09-17 02:10:06.814517158 +0000 UTC m=+0.351601518 container init 095c374e1e1db0d638c4a2837edd9c1ea83e6ed4463c7f06ad64a31025ca3e5c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T02:10:06.929 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:06 smithi031 podman[133229]: 2024-09-17 02:10:06.818148089 +0000 UTC m=+0.355232443 container start 095c374e1e1db0d638c4a2837edd9c1ea83e6ed4463c7f06ad64a31025ca3e5c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T02:10:06.929 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:06 smithi031 podman[133229]: 2024-09-17 02:10:06.931035819 +0000 UTC m=+0.468120182 container attach 095c374e1e1db0d638c4a2837edd9c1ea83e6ed4463c7f06ad64a31025ca3e5c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-17T02:10:07.264 INFO:journalctl@ceph.osd.1.smithi031.stdout:Sep 17 02:10:07 smithi031 podman[133229]: 2024-09-17 02:10:07.016890613 +0000 UTC m=+0.553974965 container died 095c374e1e1db0d638c4a2837edd9c1ea83e6ed4463c7f06ad64a31025ca3e5c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T02:10:07.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T02:10:07.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:10:07.770 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T02:10:07.771 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T02:10:07.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.2 2024-09-17T02:10:08.014 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:07 smithi031 systemd[1]: Stopping Ceph osd.2 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:10:08.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:08 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T02:10:08.096+0000 7f3cb0a34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:10:08.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:08 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T02:10:08.096+0000 7f3cb0a34640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-17T02:10:08.515 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:08 smithi031 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2[90190]: 2024-09-17T02:10:08.096+0000 7f3cb0a34640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T02:10:13.937 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:13 smithi031 podman[133331]: 2024-09-17 02:10:13.65785484 +0000 UTC m=+5.646765307 container died 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0) 2024-09-17T02:10:14.264 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:14 smithi031 podman[133331]: 2024-09-17 02:10:14.029757888 +0000 UTC m=+6.018668356 container cleanup 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T02:10:14.265 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:14 smithi031 bash[133331]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2 2024-09-17T02:10:14.645 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:14 smithi031 podman[133351]: 2024-09-17 02:10:14.314232557 +0000 UTC m=+0.654996422 container remove 50c8861efc465460b2c7d3c45da6232e9d3e286eb1d8a3601959050f11ebce77 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T02:10:14.912 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:14 smithi031 podman[133438]: 2024-09-17 02:10:14.550596217 +0000 UTC m=+0.016479792 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T02:10:14.912 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:14 smithi031 podman[133438]: 2024-09-17 02:10:14.78221584 +0000 UTC m=+0.248099443 container create 77cd778162d5140ff6d4a4e46cec7e850f97333aa2b0185588db12d89267538c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-17T02:10:15.165 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:15 smithi031 podman[133438]: 2024-09-17 02:10:15.068054233 +0000 UTC m=+0.533937804 container init 77cd778162d5140ff6d4a4e46cec7e850f97333aa2b0185588db12d89267538c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-c2ddf97) 2024-09-17T02:10:15.386 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:15 smithi031 podman[133438]: 2024-09-17 02:10:15.071691618 +0000 UTC m=+0.537575179 container start 77cd778162d5140ff6d4a4e46cec7e850f97333aa2b0185588db12d89267538c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T02:10:15.387 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:15 smithi031 podman[133438]: 2024-09-17 02:10:15.167910831 +0000 UTC m=+0.633794396 container attach 77cd778162d5140ff6d4a4e46cec7e850f97333aa2b0185588db12d89267538c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T02:10:15.514 INFO:journalctl@ceph.osd.2.smithi031.stdout:Sep 17 02:10:15 smithi031 podman[133438]: 2024-09-17 02:10:15.275280002 +0000 UTC m=+0.741163578 container died 77cd778162d5140ff6d4a4e46cec7e850f97333aa2b0185588db12d89267538c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T02:10:15.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T02:10:15.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:10:15.897 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T02:10:15.897 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T02:10:15.898 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.3 2024-09-17T02:10:16.215 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:15 smithi092 systemd[1]: Stopping Ceph osd.3 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:10:16.489 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:16 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T02:10:16.225+0000 7fd834093640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:10:16.489 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:16 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T02:10:16.225+0000 7fd834093640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-17T02:10:16.489 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:16 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T02:10:16.225+0000 7fd834093640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T02:10:19.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:18 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T02:10:18.839+0000 7fd830698640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.755690+0000 front 2024-09-17T02:09:52.755783+0000 (oldest deadline 2024-09-17T02:10:18.055470+0000) 2024-09-17T02:10:19.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:19 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:19.358+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:20.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:19 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T02:10:19.878+0000 7fd830698640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.755690+0000 front 2024-09-17T02:09:52.755783+0000 (oldest deadline 2024-09-17T02:10:18.055470+0000) 2024-09-17T02:10:20.690 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:20 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:20.363+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:20.989 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:20 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3[69667]: 2024-09-17T02:10:20.913+0000 7fd830698640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.755690+0000 front 2024-09-17T02:09:52.755783+0000 (oldest deadline 2024-09-17T02:10:18.055470+0000) 2024-09-17T02:10:21.619 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:21 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:21.318+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:21.883 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:21 smithi092 podman[94848]: 2024-09-17 02:10:21.621632899 +0000 UTC m=+5.509320019 container died 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T02:10:22.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:21 smithi092 podman[94848]: 2024-09-17 02:10:21.976489965 +0000 UTC m=+5.864177079 container cleanup 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T02:10:22.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:21 smithi092 bash[94848]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3 2024-09-17T02:10:22.645 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:22 smithi092 podman[94874]: 2024-09-17 02:10:22.286871134 +0000 UTC m=+0.661511079 container remove 4354e58e99a97439fe3900af7c52b1ffd74878a1f950031df075116eed5304e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731) 2024-09-17T02:10:22.646 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:22 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:22.322+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:22.918 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:22 smithi092 podman[94961]: 2024-09-17 02:10:22.550624004 +0000 UTC m=+0.015965713 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T02:10:22.918 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:22 smithi092 podman[94961]: 2024-09-17 02:10:22.695911341 +0000 UTC m=+0.161253040 container create 7d29d520b9a6dd4f3d1fe7bc05c2b6f8df95fbddbef9272872f434adc7e8013c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-17T02:10:23.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:22 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:22.920+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:23.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:22 smithi092 podman[94961]: 2024-09-17 02:10:22.941959115 +0000 UTC m=+0.407300825 container init 7d29d520b9a6dd4f3d1fe7bc05c2b6f8df95fbddbef9272872f434adc7e8013c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T02:10:23.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:22 smithi092 podman[94961]: 2024-09-17 02:10:22.945587358 +0000 UTC m=+0.410929066 container start 7d29d520b9a6dd4f3d1fe7bc05c2b6f8df95fbddbef9272872f434adc7e8013c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T02:10:23.239 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:23 smithi092 podman[94961]: 2024-09-17 02:10:23.01518675 +0000 UTC m=+0.480528459 container attach 7d29d520b9a6dd4f3d1fe7bc05c2b6f8df95fbddbef9272872f434adc7e8013c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T02:10:23.240 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 17 02:10:23 smithi092 podman[94961]: 2024-09-17 02:10:23.130195676 +0000 UTC m=+0.595537378 container died 7d29d520b9a6dd4f3d1fe7bc05c2b6f8df95fbddbef9272872f434adc7e8013c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T02:10:23.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:23 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:23.327+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:23.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T02:10:23.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:10:23.842 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T02:10:23.842 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T02:10:23.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.4 2024-09-17T02:10:24.170 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:23 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:23.888+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:24.170 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:23 smithi092 systemd[1]: Stopping Ceph osd.4 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:10:24.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:24 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:24.324+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:24.489 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:24 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:24.171+0000 7fdb2a826640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:10:24.489 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:24 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:24.171+0000 7fdb2a826640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-17T02:10:24.489 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:24 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:24.171+0000 7fdb2a826640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T02:10:25.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:24 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:24.910+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:25.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:25 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:25.350+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:26.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:25 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:25.955+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:26.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:26.363+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:26.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:26.363+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:27.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:26 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:26.951+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:27.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:27 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:27.378+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:27.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:27 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:27.378+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:28.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:27 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:27.958+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:28.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:27 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:27.958+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:02.514863+0000 front 2024-09-17T02:10:02.514822+0000 (oldest deadline 2024-09-17T02:10:27.814588+0000) 2024-09-17T02:10:28.740 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:28 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:28.378+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:28.740 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:28 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:28.378+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:29.326 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:29.001+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:52.513898+0000 front 2024-09-17T02:09:52.513925+0000 (oldest deadline 2024-09-17T02:10:22.514254+0000) 2024-09-17T02:10:29.326 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4[72605]: 2024-09-17T02:10:29.001+0000 7fdb26e2b640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:02.514863+0000 front 2024-09-17T02:10:02.514822+0000 (oldest deadline 2024-09-17T02:10:27.814588+0000) 2024-09-17T02:10:29.623 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:29.328+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:29.623 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:29 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:29.328+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:29.920 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:29 smithi092 podman[95065]: 2024-09-17 02:10:29.625134208 +0000 UTC m=+5.562478552 container died 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T02:10:30.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 podman[95065]: 2024-09-17 02:10:30.047340533 +0000 UTC m=+5.984684876 container cleanup 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T02:10:30.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 bash[95065]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4 2024-09-17T02:10:30.663 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 podman[95082]: 2024-09-17 02:10:30.248402196 +0000 UTC m=+0.625245999 container remove 8cb531405f042a8d8e3d54a4fd86413a5f219a1a38e2dba40c3fe7c00dfca56d (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T02:10:30.664 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:30 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:30.280+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:30.664 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:30 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:30.280+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:30.924 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 podman[95168]: 2024-09-17 02:10:30.665994352 +0000 UTC m=+0.112676132 container create 2751ba7951e2c2fcc63376294e2cf9965ac279a525807f600cb2541891e6b08c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True) 2024-09-17T02:10:30.925 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 podman[95168]: 2024-09-17 02:10:30.56951618 +0000 UTC m=+0.016197934 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T02:10:30.925 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 podman[95168]: 2024-09-17 02:10:30.92727518 +0000 UTC m=+0.373956923 container init 2751ba7951e2c2fcc63376294e2cf9965ac279a525807f600cb2541891e6b08c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T02:10:31.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:30 smithi092 podman[95168]: 2024-09-17 02:10:30.930701362 +0000 UTC m=+0.377383109 container start 2751ba7951e2c2fcc63376294e2cf9965ac279a525807f600cb2541891e6b08c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T02:10:31.239 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:31 smithi092 podman[95168]: 2024-09-17 02:10:31.018878051 +0000 UTC m=+0.465559789 container attach 2751ba7951e2c2fcc63376294e2cf9965ac279a525807f600cb2541891e6b08c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T02:10:31.240 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 17 02:10:31 smithi092 podman[95168]: 2024-09-17 02:10:31.119257612 +0000 UTC m=+0.565939361 container died 2751ba7951e2c2fcc63376294e2cf9965ac279a525807f600cb2541891e6b08c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T02:10:31.644 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:31 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:31.281+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:31.644 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:31 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:31.281+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:31.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T02:10:31.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:10:31.706 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T02:10:31.706 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T02:10:31.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5 2024-09-17T02:10:31.989 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:31 smithi092 systemd[1]: Stopping Ceph osd.5 for fb7c6180-7495-11ef-bceb-c7b262605968... 2024-09-17T02:10:32.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:32 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:32.050+0000 7f5570a7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T02:10:32.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:32 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:32.050+0000 7f5570a7b640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-17T02:10:32.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:32 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:32.050+0000 7f5570a7b640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T02:10:32.490 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:32 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:32.240+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:32.490 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:32 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:32.240+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:33.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:33 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:33.222+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:33.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:33 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:33.223+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:34.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:34 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:34.262+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:34.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:34 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:34.262+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:35.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:35 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:35.293+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:35.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:35 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:35.293+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:36.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:36 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:36.327+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-09-17T02:09:57.100538+0000 front 2024-09-17T02:09:57.100600+0000 (oldest deadline 2024-09-17T02:10:18.800443+0000) 2024-09-17T02:10:36.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:36 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:36.327+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6814 osd.1 since back 2024-09-17T02:10:04.601818+0000 front 2024-09-17T02:10:04.601834+0000 (oldest deadline 2024-09-17T02:10:26.301641+0000) 2024-09-17T02:10:36.739 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:36 smithi092 ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5[75567]: 2024-09-17T02:10:36.327+0000 7f556d080640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.31:6822 osd.2 since back 2024-09-17T02:10:11.502828+0000 front 2024-09-17T02:10:11.502799+0000 (oldest deadline 2024-09-17T02:10:36.202782+0000) 2024-09-17T02:10:37.856 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:37 smithi092 podman[95271]: 2024-09-17 02:10:37.597732472 +0000 UTC m=+5.666523958 container died dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T02:10:38.115 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:37 smithi092 podman[95271]: 2024-09-17 02:10:37.941547024 +0000 UTC m=+6.010338496 container cleanup dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T02:10:38.115 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:37 smithi092 bash[95271]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5 2024-09-17T02:10:38.489 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:38 smithi092 podman[95288]: 2024-09-17 02:10:38.11780709 +0000 UTC m=+0.516404248 container remove dde987d776d6019c03333de7ad60b1d238754c8cd1869ffb80c21d0644566291 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-17T02:10:38.810 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:38 smithi092 podman[95374]: 2024-09-17 02:10:38.444814836 +0000 UTC m=+0.015763936 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T02:10:38.811 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:38 smithi092 podman[95374]: 2024-09-17 02:10:38.551919217 +0000 UTC m=+0.122868300 container create 36af0495a1d0f33db20568ed5e4b6a0ee23a36d7a4559a227f5bd6f799c9cab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-17T02:10:38.811 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:38 smithi092 podman[95374]: 2024-09-17 02:10:38.813039549 +0000 UTC m=+0.383988650 container init 36af0495a1d0f33db20568ed5e4b6a0ee23a36d7a4559a227f5bd6f799c9cab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0) 2024-09-17T02:10:39.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:38 smithi092 podman[95374]: 2024-09-17 02:10:38.816768759 +0000 UTC m=+0.387717841 container start 36af0495a1d0f33db20568ed5e4b6a0ee23a36d7a4559a227f5bd6f799c9cab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-17T02:10:39.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:38 smithi092 podman[95374]: 2024-09-17 02:10:38.888121607 +0000 UTC m=+0.459070719 container attach 36af0495a1d0f33db20568ed5e4b6a0ee23a36d7a4559a227f5bd6f799c9cab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T02:10:39.239 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:39 smithi092 podman[95374]: 2024-09-17 02:10:39.008468933 +0000 UTC m=+0.579418023 container died 36af0495a1d0f33db20568ed5e4b6a0ee23a36d7a4559a227f5bd6f799c9cab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T02:10:39.547 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:39 smithi092 podman[95397]: 2024-09-17 02:10:39.533525012 +0000 UTC m=+0.517198513 container remove 36af0495a1d0f33db20568ed5e4b6a0ee23a36d7a4559a227f5bd6f799c9cab1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-fb7c6180-7495-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T02:10:39.547 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:39 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T02:10:39.548 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:39 smithi092 systemd[1]: Stopped Ceph osd.5 for fb7c6180-7495-11ef-bceb-c7b262605968. 2024-09-17T02:10:39.548 INFO:journalctl@ceph.osd.5.smithi092.stdout:Sep 17 02:10:39 smithi092 systemd[1]: ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5.service: Consumed 8.801s CPU time. 2024-09-17T02:10:39.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fb7c6180-7495-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T02:10:39.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T02:10:39.588 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T02:10:39.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fb7c6180-7495-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T02:10:39.753 INFO:teuthology.orchestra.run.smithi031.stdout:Deleting cluster with fsid: fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T02:10:44.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[65696]: fuse finished with error 0 and tester_r 0 2024-09-17T02:11:04.017 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fb7c6180-7495-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T02:11:04.170 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T02:11:19.317 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T02:11:19.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T02:11:19.380 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T02:11:19.381 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051/remote/smithi031/crash 2024-09-17T02:11:19.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/crash -- . 2024-09-17T02:11:19.422 INFO:teuthology.orchestra.run.smithi031.stderr:tar: /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T02:11:19.423 INFO:teuthology.orchestra.run.smithi031.stderr:tar: Error is not recoverable: exiting now 2024-09-17T02:11:19.424 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051/remote/smithi092/crash 2024-09-17T02:11:19.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/crash -- . 2024-09-17T02:11:19.449 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T02:11:19.449 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2024-09-17T02:11:19.450 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T02:11:19.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T02:11:19.505 INFO:tasks.cephadm:Compressing logs... 2024-09-17T02:11:19.505 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:11:19.549 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:11:19.574 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T02:11:19.574 INFO:teuthology.orchestra.run.smithi092.stderr:: No such file or directory 2024-09-17T02:11:19.575 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mgr.smithi092.tjdpfw.log 2024-09-17T02:11:19.575 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi092.xzgrcs.log 2024-09-17T02:11:19.575 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mgr.smithi092.tjdpfw.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-17T02:11:19.575 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi092.xzgrcs.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T02:11:19.586 INFO:teuthology.orchestra.run.smithi031.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:: No such file or directory 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi031.menvuk.log 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mon.smithi031.log 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi031.menvuk.log: /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose --/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mon.smithi031.log: /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi031.gszbpe.log 2024-09-17T02:11:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T02:11:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi031.gszbpe.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T02:11:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.cephadm.log: 85.8% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T02:11:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-17T02:11:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log 2024-09-17T02:11:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.5% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T02:11:19.588 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mgr.smithi031.ealpiz.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi092.hofoma.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi092.hofoma.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.5.log: 85.8% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi092.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log: 91.7% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-17T02:11:19.593 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi092.log: 88.9% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T02:11:19.594 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mon.smithi092.log 2024-09-17T02:11:19.594 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.1% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi092.log.gz 2024-09-17T02:11:19.594 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-17T02:11:19.594 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mon.smithi092.log: 91.9% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T02:11:19.594 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T02:11:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log: 88.8% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T02:11:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi031.log 2024-09-17T02:11:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mgr.smithi031.ealpiz.log: 91.7% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T02:11:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-17T02:11:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi031.log: 94.3% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi031.log.gz 2024-09-17T02:11:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T02:11:19.609 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T02:11:19.629 INFO:teuthology.orchestra.run.smithi092.stderr: 89.4% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mgr.smithi092.tjdpfw.log.gz 2024-09-17T02:11:19.664 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T02:11:20.051 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mgr.smithi031.ealpiz.log.gz 2024-09-17T02:11:20.055 INFO:teuthology.orchestra.run.smithi092.stderr: 92.4% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mon.smithi092.log.gz 2024-09-17T02:11:20.896 INFO:teuthology.orchestra.run.smithi031.stderr: 90.5% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mon.smithi031.log.gz 2024-09-17T02:11:24.374 INFO:teuthology.orchestra.run.smithi092.stderr: 95.1% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi092.hofoma.log.gz 2024-09-17T02:11:25.377 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-17T02:11:26.262 INFO:teuthology.orchestra.run.smithi031.stderr: 92.8% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T02:11:26.682 INFO:teuthology.orchestra.run.smithi031.stderr: 93.2% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-17T02:11:26.733 INFO:teuthology.orchestra.run.smithi092.stderr: 93.6% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-17T02:11:27.377 INFO:teuthology.orchestra.run.smithi031.stderr: 93.5% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T02:11:27.803 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-17T02:11:29.475 INFO:teuthology.orchestra.run.smithi031.stderr: 95.1% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi031.gszbpe.log.gz 2024-09-17T02:11:34.508 INFO:teuthology.orchestra.run.smithi031.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-17T02:11:35.385 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-17T02:11:35.385 INFO:teuthology.orchestra.run.smithi092.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-17T02:12:01.486 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi092.xzgrcs.log.gz 2024-09-17T02:12:01.487 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-17T02:12:01.487 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m41.924s 2024-09-17T02:12:01.487 INFO:teuthology.orchestra.run.smithi092.stderr:user 1m21.530s 2024-09-17T02:12:01.487 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m2.566s 2024-09-17T02:12:18.323 INFO:teuthology.orchestra.run.smithi031.stderr: 93.2% -- replaced with /var/log/ceph/fb7c6180-7495-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi031.menvuk.log.gz 2024-09-17T02:12:18.323 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T02:12:18.323 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m58.757s 2024-09-17T02:12:18.323 INFO:teuthology.orchestra.run.smithi031.stderr:user 1m43.764s 2024-09-17T02:12:18.323 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m2.990s 2024-09-17T02:12:18.324 INFO:tasks.cephadm:Archiving logs... 2024-09-17T02:12:18.324 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051/remote/smithi031/log 2024-09-17T02:12:18.325 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:12:31.895 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051/remote/smithi092/log 2024-09-17T02:12:31.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:12:43.167 INFO:tasks.cephadm:Removing cluster... 2024-09-17T02:12:43.168 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fb7c6180-7495-11ef-bceb-c7b262605968 --force 2024-09-17T02:12:43.329 INFO:teuthology.orchestra.run.smithi031.stdout:Deleting cluster with fsid: fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T02:12:43.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fb7c6180-7495-11ef-bceb-c7b262605968 --force 2024-09-17T02:12:43.858 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: fb7c6180-7495-11ef-bceb-c7b262605968 2024-09-17T02:12:44.197 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T02:12:44.197 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T02:12:44.215 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T02:12:44.230 INFO:tasks.cephadm:Teardown complete 2024-09-17T02:12:44.231 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T02:12:44.243 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T02:12:44.244 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T02:12:44.244 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:12:44.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:12:44.345 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T02:12:44.356 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T02:12:44.357 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:12:44.360 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:12:44.373 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-09-17T02:12:44.374 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-17T02:12:44.377 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T02:12:44.378 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-09-17T02:12:44.378 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +2594us[+2590us] +/- 45ms 2024-09-17T02:12:44.378 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -3032us[-3036us] +/- 87ms 2024-09-17T02:12:44.378 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -2294us[-2294us] +/- 90ms 2024-09-17T02:12:44.378 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:12:44.379 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T02:12:44.380 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-17T02:12:44.380 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +2570us[+2583us] +/- 45ms 2024-09-17T02:12:44.380 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -3072us[-3072us] +/- 87ms 2024-09-17T02:12:44.380 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -2313us[-2313us] +/- 90ms 2024-09-17T02:12:44.380 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:12:44.380 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T02:12:44.392 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T02:12:44.392 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T02:12:44.474 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T02:12:44.564 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T02:12:44.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T02:12:44.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:12:44.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T02:12:44.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:12:44.700 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T02:12:44.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T02:12:44.722 INFO:teuthology.task.internal:Duration was 2221.655983 seconds 2024-09-17T02:12:44.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T02:12:44.733 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T02:12:44.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:12:44.737 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:12:44.775 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T02:12:44.779 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T02:12:45.057 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T02:12:45.057 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T02:12:45.058 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:12:45.119 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-17T02:12:45.119 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:12:45.144 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T02:12:45.144 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:12:45.162 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:12:45.211 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T02:12:45.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:12:45.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:12:45.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T02:12:45.978 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T02:12:45.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:12:46.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:12:46.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T02:12:46.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:12:46.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:12:46.069 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-09-17T02:12:46.097 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-17T02:12:46.121 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:12:46.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:12:46.161 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:12:46.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:12:46.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T02:12:46.188 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T02:12:46.189 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051/remote/smithi031 2024-09-17T02:12:46.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:12:46.265 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7908051/remote/smithi092 2024-09-17T02:12:46.265 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:12:46.305 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T02:12:46.306 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:12:46.308 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:12:46.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T02:12:46.370 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T02:12:46.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T02:12:46.405 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T02:12:46.405 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:12:46.408 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:12:46.421 INFO:teuthology.orchestra.run.smithi031.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 17 02:12 /home/ubuntu/cephtest 2024-09-17T02:12:46.421 INFO:teuthology.orchestra.run.smithi031.stdout: 556333 4 d--------- 2 ubuntu ubuntu 4096 Sep 17 01:49 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:12:46.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:12:46.422 INFO:teuthology.orchestra.run.smithi031.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-17T02:12:46.423 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-17T02:12:46.423 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi031 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T02:12:46.423 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T02:12:46.447 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T02:12:46.509 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T02:12:46.513 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2221.6559834480286 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-17T02:12:46.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:12:46.607 INFO:teuthology.run:FAIL